[2025-10-27T17:00:01.109003] [INFO ] [MAIN ] Using last completed trading day: 2025-10-27 [2025-10-27T17:00:01.286026] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-27T17:00:01.286179] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-27T17:00:01.357235] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-27T17:00:01.357787] [WARN ] [STATE ] State set to: RUNNING [2025-10-27T17:00:01.357856] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-27T17:00:01.357891] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-27T17:00:01.357969] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-27T17:00:01.358002] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-27T17:00:02.910462] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-27T17:00:02.910633] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-27T17:00:02.910910] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-27T17:00:02.912055] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-27T17:00:02.912223] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-27T17:00:02.912260] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-27T17:00:02.912328] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-27T17:00:02.912366] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-27T17:00:02.912400] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-27T17:00:02.912814] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-27T17:00:02.912868] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-27T17:00:02.913051] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-27T17:00:02.913091] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-27T17:00:02.913125] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-27T17:00:02.913157] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-27T17:00:02.941007] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-27T17:00:02.968311] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-27T17:00:02.968442] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-27T17:00:02.968481] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-27T17:00:02.968510] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-27T17:00:02.968572] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-27T17:00:02.968985] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-27T17:00:02.969040] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-27T17:00:02.969074] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-27T17:00:02.969102] [INFO ] [MAIN ] Running in parallel mode [2025-10-27T17:00:02.969322] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-27T17:00:03.705877] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.813189] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.814952] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-27T17:00:03.816773] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.818512] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-27T17:00:03.844413] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:03.847316] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-27T17:00:03.847945] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-27T17:00:03.848079] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-27T17:00:03.848205] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-27T17:00:04.034544] [DEBUG] [LOCAL ] AAMI: Loaded 24637 existing records from primary storage. [2025-10-27T17:00:04.082973] [INFO ] [MAIN ] AAMI: Loaded 24637 existing records. [2025-10-27T17:00:04.343218] [DEBUG] [LOCAL ] A: Loaded 51315 existing records from primary storage. [2025-10-27T17:00:04.424154] [INFO ] [MAIN ] A: Loaded 51315 existing records. [2025-10-27T17:00:04.431085] [DEBUG] [LOCAL ] AA: Loaded 54402 existing records from primary storage. [2025-10-27T17:00:04.527350] [INFO ] [MAIN ] AA: Loaded 54402 existing records. [2025-10-27T17:00:04.762241] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:04.888461] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-27T17:00:04.897638] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:04.910029] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-27T17:00:04.933058] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-27T17:00:04.938378] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-27T17:00:04.985529] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-27T17:00:05.116301] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:05.164724] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:05.196955] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-27T17:00:05.197393] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-27T17:00:05.197709] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-27T17:00:05.197804] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-27T17:00:05.215058] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-27T17:00:05.227949] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-27T17:00:05.238984] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-27T17:00:05.244243] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-27T17:00:05.989450] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.014810] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-27T17:00:06.002612] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T17:00:06.067751] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-27T17:00:06.242160] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.253269] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-27T17:00:06.321504] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:06.321849] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-27T17:00:06.475063] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:00:06.476533] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-27T17:00:06.842309] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T17:00:06.846357] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-27T17:00:06.849994] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T17:00:06.851054] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-27T17:00:07.192029] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T17:00:07.193218] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-27T17:00:07.539311] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T17:00:07.540231] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-27T17:00:07.886399] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:00:07.896390] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-27T17:00:07.931270] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:00:07.935041] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-27T17:00:08.161482] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:00:08.172076] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-27T17:00:08.208987] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T17:00:08.209884] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-27T17:00:08.663426] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T17:00:08.665546] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-27T17:00:09.206566] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T17:00:09.207791] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-27T17:00:09.405541] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:00:09.410392] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-27T17:00:09.493686] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-27T17:00:09.494724] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-27T17:00:09.522819] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:00:09.533303] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-27T17:00:09.773560] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T17:00:09.785213] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-27T17:00:10.048262] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T17:00:10.049143] [INFO ] [REMOTE ] AAM: Full fetch complete (916 records). [2025-10-27T17:00:10.049232] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-27T17:00:10.247830] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-27T17:00:10.248029] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:00:10.248099] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:00:10.248171] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-27T17:00:10.248234] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-27T17:00:10.248272] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-27T17:00:10.248312] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-27T17:00:10.248381] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 7.3s. Estimated remaining: 4h 46m 55s. Rate: 8.2 symbols/min [2025-10-27T17:00:10.434287] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:10.489777] [DEBUG] [LOCAL ] AAP: Loaded 52419 existing records from primary storage. [2025-10-27T17:00:10.490207] [INFO ] [MAIN ] AAP: Loaded 52419 existing records. [2025-10-27T17:00:10.692781] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:10.693088] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-27T17:00:10.693202] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-27T17:00:10.693680] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-27T17:00:10.693741] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-27T17:00:11.022614] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:00:11.083848] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-27T17:00:11.105473] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:11.105722] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-27T17:00:11.852980] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T17:00:11.863752] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-27T17:00:11.916121] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T17:00:11.926802] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-27T17:00:12.271877] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:00:12.277267] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-27T17:00:13.325586] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-27T17:00:13.337845] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-27T17:00:14.173218] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T17:00:14.178427] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-27T17:00:14.227734] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T17:00:14.239066] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-27T17:00:14.722402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-27T17:00:14.743629] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-27T17:00:14.761463] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T17:00:14.771835] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-27T17:00:15.741967] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:00:15.747842] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-27T17:00:16.118318] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T17:00:16.130180] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-27T17:00:16.778452] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T17:00:16.789753] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-27T17:00:16.865540] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T17:00:16.876886] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-27T17:00:17.326435] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:00:17.332915] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-27T17:00:17.409217] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:00:17.419865] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-27T17:00:18.361851] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T17:00:18.373228] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-27T17:00:18.664705] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T17:00:18.671260] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-27T17:00:18.834785] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-27T17:00:18.846118] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-27T17:00:18.881665] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:00:18.893147] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-27T17:00:19.838778] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:00:19.843097] [INFO ] [REMOTE ] AAMI: Full fetch complete (33111 records). [2025-10-27T17:00:19.843179] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-27T17:00:20.221047] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-27T17:00:20.221177] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-27T17:00:20.221628] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-27T17:00:20.221878] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-27T17:00:20.223748] [DEBUG] [LOCAL ] AAMI: Trimmed 33111 records to 23916 (keeping 200 days of data) [2025-10-27T17:00:20.397905] [DEBUG] [LOCAL ] AAMI: Primary data saved (23916 records). [2025-10-27T17:00:20.401198] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-27T17:00:20.401622] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 17.3s. Estimated remaining: 5h 43m 25s. Rate: 6.9 symbols/min [2025-10-27T17:00:20.415003] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-27T17:00:20.528282] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-27T17:00:20.589234] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:20.620162] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:00:20.638804] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-27T17:00:20.652136] [DEBUG] [LOCAL ] AAT: Loaded 30590 existing records from primary storage. [2025-10-27T17:00:20.652378] [INFO ] [MAIN ] AAT: Loaded 30590 existing records. [2025-10-27T17:00:20.837543] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:20.837818] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-27T17:00:20.837866] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-27T17:00:20.838056] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-27T17:00:20.838093] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-27T17:00:21.215162] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:21.215674] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-27T17:00:21.571146] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T17:00:21.583413] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-27T17:00:22.556785] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:00:22.568123] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-27T17:00:22.866979] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:00:22.872468] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-27T17:00:22.912962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T17:00:22.923337] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-27T17:00:23.613981] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-27T17:00:23.625305] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-27T17:00:23.901915] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:00:23.907609] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-27T17:00:24.500456] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:00:24.511561] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-27T17:00:24.704434] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T17:00:24.713814] [INFO ] [REMOTE ] A: Full fetch complete (73568 records). [2025-10-27T17:00:24.713929] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-27T17:00:25.144582] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-27T17:00:25.144962] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-27T17:00:25.121399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:00:25.146259] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-27T17:00:25.154417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-27T17:00:25.154962] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-27T17:00:25.159146] [DEBUG] [LOCAL ] A: Trimmed 73568 records to 50510 (keeping 200 days of data) [2025-10-27T17:00:25.418988] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T17:00:25.444592] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-27T17:00:25.531354] [DEBUG] [LOCAL ] A: Primary data saved (50510 records). [2025-10-27T17:00:25.531536] [INFO ] [MAIN ] A: Full history saved. [2025-10-27T17:00:25.532015] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 22.6s. Estimated remaining: 4h 56m 12s. Rate: 8.0 symbols/min [2025-10-27T17:00:25.728861] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:25.729067] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-27T17:00:25.729125] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-27T17:00:25.729256] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-27T17:00:25.729297] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-27T17:00:25.729338] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-27T17:00:25.729369] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-27T17:00:26.089509] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:26.089875] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-27T17:00:26.279838] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:00:26.280086] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-27T17:00:26.280225] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:00:26.280303] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-27T17:00:26.280367] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:00:26.280438] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-27T17:00:26.280498] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-27T17:00:26.280535] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-27T17:00:26.280574] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-27T17:00:26.280619] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.7s. Estimated remaining: 3h 49m 25s. Rate: 10.3 symbols/min [2025-10-27T17:00:26.452017] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:26.475365] [DEBUG] [LOCAL ] AB: Loaded 24911 existing records from primary storage. [2025-10-27T17:00:26.475684] [INFO ] [MAIN ] AB: Loaded 24911 existing records. [2025-10-27T17:00:26.662672] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:26.663101] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-27T17:00:26.663418] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-27T17:00:26.679763] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-27T17:00:26.682537] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-27T17:00:26.710549] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:00:26.750913] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-27T17:00:27.059768] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-27T17:00:27.135087] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-27T17:00:27.160258] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:27.160746] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-27T17:00:28.031204] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T17:00:28.038095] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-27T17:00:28.064889] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-27T17:00:28.076445] [INFO ] [REMOTE ] AA: Full fetch complete (77735 records). [2025-10-27T17:00:28.076577] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-27T17:00:28.477054] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-27T17:00:28.477142] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-27T17:00:28.477925] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-27T17:00:28.477995] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-27T17:00:28.479708] [DEBUG] [LOCAL ] AA: Trimmed 77735 records to 53622 (keeping 200 days of data) [2025-10-27T17:00:28.828188] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-27T17:00:28.828334] [INFO ] [MAIN ] AA: Full history saved. [2025-10-27T17:00:28.828563] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 25.9s. Estimated remaining: 3h 23m 31s. Rate: 11.6 symbols/min [2025-10-27T17:00:29.006716] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:29.025920] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:00:29.032861] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-27T17:00:29.080880] [DEBUG] [LOCAL ] ABBV: Loaded 54458 existing records from primary storage. [2025-10-27T17:00:29.081236] [INFO ] [MAIN ] ABBV: Loaded 54458 existing records. [2025-10-27T17:00:29.271942] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T17:00:29.302464] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-27T17:00:29.301714] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:29.303935] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-27T17:00:29.303994] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-27T17:00:29.304462] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-27T17:00:29.304522] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-27T17:00:29.499599] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-27T17:00:29.597715] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-27T17:00:29.715090] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:29.715904] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-27T17:00:30.494274] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:00:30.501748] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-27T17:00:30.614710] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:00:30.623311] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-27T17:00:31.325050] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:00:31.334349] [INFO ] [REMOTE ] AAP: Full fetch complete (74667 records). [2025-10-27T17:00:31.334508] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-27T17:00:31.335384] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:00:31.335494] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:00:31.335539] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:00:31.335591] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-27T17:00:31.335677] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-27T17:00:31.335736] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-10-27T17:00:31.335896] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-10-27T17:00:31.336053] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 21.1s. Estimated remaining: 3h 5m 58s. Rate: 12.7 symbols/min [2025-10-27T17:00:31.532963] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:31.553570] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:00:31.561742] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-27T17:00:31.599088] [DEBUG] [LOCAL ] ABCB: Loaded 30712 existing records from primary storage. [2025-10-27T17:00:31.599404] [INFO ] [MAIN ] ABCB: Loaded 30712 existing records. [2025-10-27T17:00:31.799897] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:31.800305] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-27T17:00:31.800364] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-27T17:00:31.800704] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-27T17:00:31.800765] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-27T17:00:32.289013] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:32.289774] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-27T17:00:32.341738] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T17:00:32.375327] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-27T17:00:32.378872] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-27T17:00:32.393851] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-27T17:00:33.509166] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T17:00:33.515512] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-27T17:00:33.800067] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:00:33.806792] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-27T17:00:33.865710] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:00:33.874067] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-27T17:00:34.345771] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T17:00:34.355611] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-27T17:00:34.722318] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:00:34.728790] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-27T17:00:34.848205] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:00:34.854315] [INFO ] [REMOTE ] AAT: Full fetch complete (43049 records). [2025-10-27T17:00:34.854485] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-27T17:00:35.275618] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:00:35.275766] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-27T17:00:35.281541] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-27T17:00:35.283224] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-27T17:00:35.282832] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-27T17:00:35.283376] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-27T17:00:35.285414] [DEBUG] [LOCAL ] AAT: Trimmed 43049 records to 29917 (keeping 200 days of data) [2025-10-27T17:00:35.466448] [DEBUG] [LOCAL ] AAT: Primary data saved (29917 records). [2025-10-27T17:00:35.466596] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-27T17:00:35.468906] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 15.1s. Estimated remaining: 3h 2m 32s. Rate: 12.9 symbols/min [2025-10-27T17:00:35.642360] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:35.696161] [DEBUG] [LOCAL ] ABEV: Loaded 54059 existing records from primary storage. [2025-10-27T17:00:35.696530] [INFO ] [MAIN ] ABEV: Loaded 54059 existing records. [2025-10-27T17:00:35.889383] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:35.889853] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-27T17:00:35.889973] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-27T17:00:35.890581] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-27T17:00:35.890673] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-27T17:00:36.217947] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:00:36.299297] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:36.299967] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-27T17:00:36.300673] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-27T17:00:36.377891] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T17:00:36.389230] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-27T17:00:36.443093] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:00:36.447953] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-27T17:00:37.285223] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:00:37.290822] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-27T17:00:37.771106] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:00:37.778931] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-27T17:00:38.060058] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T17:00:38.065018] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-27T17:00:38.215478] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T17:00:38.227321] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-27T17:00:38.667023] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-27T17:00:38.679336] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-27T17:00:38.704846] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:00:38.714305] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-27T17:00:38.952790] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:00:38.961853] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-27T17:00:39.745796] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:00:39.751424] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-27T17:00:39.981597] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:00:39.991751] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-27T17:00:40.045358] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:00:40.050110] [INFO ] [REMOTE ] AB: Full fetch complete (43819 records). [2025-10-27T17:00:40.050225] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-27T17:00:40.437620] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-27T17:00:40.437744] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-27T17:00:40.438244] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-27T17:00:40.438320] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-27T17:00:40.439528] [DEBUG] [LOCAL ] AB: Trimmed 43819 records to 24063 (keeping 200 days of data) [2025-10-27T17:00:40.583908] [DEBUG] [LOCAL ] AB: Primary data saved (24063 records). [2025-10-27T17:00:40.584136] [INFO ] [MAIN ] AB: Full history saved. [2025-10-27T17:00:40.584319] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 14.3s. Estimated remaining: 3h 4m 47s. Rate: 12.8 symbols/min [2025-10-27T17:00:40.760782] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:40.798023] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T17:00:40.839762] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-27T17:00:40.841415] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:00:40.857996] [DEBUG] [LOCAL ] ABG: Loaded 18043 existing records from primary storage. [2025-10-27T17:00:40.858461] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-27T17:00:40.859594] [INFO ] [MAIN ] ABG: Loaded 18043 existing records. [2025-10-27T17:00:41.050233] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:41.050476] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-27T17:00:41.050552] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-27T17:00:41.050813] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-27T17:00:41.050881] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-27T17:00:41.411462] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:41.412026] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-27T17:00:41.478944] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:00:41.489877] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-27T17:00:42.186868] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T17:00:42.198359] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-27T17:00:42.543876] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T17:00:42.554561] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-27T17:00:42.659265] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:00:42.664861] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-27T17:00:43.226491] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:00:43.238458] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-27T17:00:43.264382] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T17:00:43.272113] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-27T17:00:43.356577] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:00:43.360527] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-27T17:00:44.276271] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:00:44.281443] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-27T17:00:44.443435] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:00:44.455978] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-27T17:00:44.474201] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:00:44.480591] [INFO ] [REMOTE ] ABCB: Full fetch complete (44873 records). [2025-10-27T17:00:44.480776] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-27T17:00:44.853267] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-27T17:00:44.853356] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-27T17:00:44.853834] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-27T17:00:44.853899] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-27T17:00:44.855007] [DEBUG] [LOCAL ] ABCB: Trimmed 44873 records to 30102 (keeping 200 days of data) [2025-10-27T17:00:45.037871] [DEBUG] [LOCAL ] ABCB: Primary data saved (30102 records). [2025-10-27T17:00:45.038018] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-27T17:00:45.040786] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 13.7s. Estimated remaining: 3h 3m 38s. Rate: 12.8 symbols/min [2025-10-27T17:00:45.224569] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:45.262198] [DEBUG] [LOCAL ] ABM: Loaded 32551 existing records from primary storage. [2025-10-27T17:00:45.262512] [INFO ] [MAIN ] ABM: Loaded 32551 existing records. [2025-10-27T17:00:45.506619] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:45.508999] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-27T17:00:45.508897] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T17:00:45.519619] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-27T17:00:45.520465] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-27T17:00:45.520595] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-27T17:00:45.521033] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-27T17:00:45.670893] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:00:45.708578] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-27T17:00:45.906711] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:45.906997] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-27T17:00:46.357193] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:00:46.368406] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-27T17:00:46.473674] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:00:46.477176] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-27T17:00:47.114085] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:00:47.118241] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-27T17:00:47.299840] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T17:00:47.310524] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-27T17:00:47.333059] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:00:47.340597] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-27T17:00:47.818937] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:00:47.823894] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-27T17:00:48.176014] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:00:48.181079] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-27T17:00:48.243480] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:00:48.254689] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-27T17:00:48.594008] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T17:00:48.599223] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-27T17:00:48.753182] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:00:48.765367] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-27T17:00:48.819220] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:00:48.829610] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-27T17:00:48.829816] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-27T17:00:49.257996] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-27T17:00:49.258163] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-27T17:00:49.259017] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-27T17:00:49.259108] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-27T17:00:49.261224] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-10-27T17:00:49.373985] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:00:49.407495] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-27T17:00:49.630387] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-10-27T17:00:49.630546] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-27T17:00:49.633308] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 20.8s. Estimated remaining: 3h 3m 14s. Rate: 12.9 symbols/min [2025-10-27T17:00:49.807952] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:49.864607] [DEBUG] [LOCAL ] ABR: Loaded 52600 existing records from primary storage. [2025-10-27T17:00:49.864952] [INFO ] [MAIN ] ABR: Loaded 52600 existing records. [2025-10-27T17:00:50.054343] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:50.054711] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-27T17:00:50.054840] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-27T17:00:50.055128] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-27T17:00:50.055170] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-27T17:00:50.174201] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:00:50.204458] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-27T17:00:50.442258] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:50.442609] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-27T17:00:50.471543] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T17:00:50.482770] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-27T17:00:50.557335] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:00:50.564787] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-27T17:00:51.371014] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:00:51.374553] [INFO ] [REMOTE ] ABG: Full fetch complete (26743 records). [2025-10-27T17:00:51.374635] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-27T17:00:51.764333] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-27T17:00:51.765504] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:00:51.764900] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-27T17:00:51.771223] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-27T17:00:51.772004] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-27T17:00:51.771733] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-27T17:00:51.773492] [DEBUG] [LOCAL ] ABG: Trimmed 26743 records to 17425 (keeping 200 days of data) [2025-10-27T17:00:51.876670] [DEBUG] [LOCAL ] ABG: Primary data saved (17425 records). [2025-10-27T17:00:51.876812] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-27T17:00:51.876913] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABG took 11.3s. Estimated remaining: 2h 54m 31s. Rate: 13.5 symbols/min [2025-10-27T17:00:52.051540] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:52.132754] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:00:52.131517] [DEBUG] [LOCAL ] ABT: Loaded 54404 existing records from primary storage. [2025-10-27T17:00:52.144557] [INFO ] [MAIN ] ABT: Loaded 54404 existing records. [2025-10-27T17:00:52.188712] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-27T17:00:52.328626] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:52.328875] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-27T17:00:52.328923] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-27T17:00:52.329106] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-27T17:00:52.329145] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-27T17:00:52.698300] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:52.699044] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-27T17:00:52.753900] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:00:52.761616] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-27T17:00:52.859007] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:00:52.870084] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-27T17:00:53.720232] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:00:53.727328] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-27T17:00:53.958314] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T17:00:53.969490] [INFO ] [REMOTE ] ABEV: Full fetch complete (77334 records). [2025-10-27T17:00:53.969612] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-27T17:00:54.365992] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-27T17:00:54.366078] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-27T17:00:54.366786] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-27T17:00:54.366849] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-27T17:00:54.368358] [DEBUG] [LOCAL ] ABEV: Trimmed 77334 records to 53283 (keeping 200 days of data) [2025-10-27T17:00:54.673010] [DEBUG] [LOCAL ] ABEV: Primary data saved (53283 records). [2025-10-27T17:00:54.673179] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-27T17:00:54.675000] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 19.2s. Estimated remaining: 2h 49m 3s. Rate: 13.9 symbols/min [2025-10-27T17:00:54.878024] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:54.880309] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-27T17:00:54.891837] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-27T17:00:54.918898] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T17:00:54.933755] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-27T17:00:54.944176] [DEBUG] [LOCAL ] ACA: Loaded 22746 existing records from primary storage. [2025-10-27T17:00:54.944413] [INFO ] [MAIN ] ACA: Loaded 22746 existing records. [2025-10-27T17:00:55.127698] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:55.127888] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-27T17:00:55.127933] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-27T17:00:55.128121] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-27T17:00:55.128175] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-27T17:00:55.495575] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:55.496072] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-27T17:00:55.529818] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:00:55.536693] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-27T17:00:56.614773] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:00:56.619583] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-27T17:00:56.771687] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:00:56.782420] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-27T17:00:57.007692] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T17:00:57.018541] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-27T17:00:57.057672] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T17:00:57.065742] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-27T17:00:57.400690] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:00:57.405759] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-27T17:00:58.111351] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T17:00:58.117532] [INFO ] [REMOTE ] ABM: Full fetch complete (45101 records). [2025-10-27T17:00:58.117694] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-27T17:00:58.552397] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-27T17:00:58.552548] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-27T17:00:58.553109] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-27T17:00:58.553245] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-27T17:00:58.554592] [DEBUG] [LOCAL ] ABM: Trimmed 45101 records to 31780 (keeping 200 days of data) [2025-10-27T17:00:58.743329] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T17:00:58.776793] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-27T17:00:58.801761] [DEBUG] [LOCAL ] ABM: Primary data saved (31780 records). [2025-10-27T17:00:58.803129] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-27T17:00:58.807307] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 13.8s. Estimated remaining: 2h 48m 27s. Rate: 14.0 symbols/min [2025-10-27T17:00:58.941273] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:00:58.978171] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-27T17:00:59.065612] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:00:59.068421] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-27T17:00:59.084104] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-27T17:00:59.131336] [DEBUG] [LOCAL ] ACCO: Loaded 37089 existing records from primary storage. [2025-10-27T17:00:59.131958] [INFO ] [MAIN ] ACCO: Loaded 37089 existing records. [2025-10-27T17:00:59.321572] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:00:59.321878] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-27T17:00:59.321933] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-27T17:00:59.322167] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-27T17:00:59.322223] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-27T17:00:59.706358] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:00:59.706791] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-27T17:01:00.109781] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:01:00.116248] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-27T17:01:02.398012] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-10-27T17:01:02.410143] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-27T17:01:02.465708] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (3.38 seconds). [2025-10-27T17:01:02.477940] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-27T17:01:02.486026] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-27T17:01:02.487095] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-27T17:01:03.742002] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (3.63 seconds). [2025-10-27T17:01:03.747675] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-27T17:01:05.844783] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-27T17:01:05.850444] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-27T17:01:05.950910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-10-27T17:01:05.960310] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-27T17:01:06.052859] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (3.57 seconds). [2025-10-27T17:01:06.063229] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-27T17:01:06.801852] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (4.39 seconds). [2025-10-27T17:01:06.812955] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-27T17:01:07.446925] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T17:01:07.454512] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-27T17:01:07.573168] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:01:07.585053] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-27T17:01:08.301459] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-27T17:01:08.310100] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-27T17:01:09.121423] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T17:01:09.144599] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-27T17:01:09.147834] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T17:01:09.154687] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-27T17:01:09.293972] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T17:01:09.304892] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-27T17:01:09.791116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:01:09.795759] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-27T17:01:10.022435] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:01:10.032853] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-27T17:01:10.567875] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:01:10.579564] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-27T17:01:11.373383] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T17:01:11.385269] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-27T17:01:11.524613] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:01:11.528827] [INFO ] [REMOTE ] ACA: Full fetch complete (34115 records). [2025-10-27T17:01:11.528937] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-27T17:01:11.936824] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-27T17:01:11.937025] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-27T17:01:11.937457] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-27T17:01:11.937536] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-27T17:01:11.960432] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-27T17:01:11.969146] [DEBUG] [LOCAL ] ACA: Trimmed 34115 records to 22078 (keeping 200 days of data) [2025-10-27T17:01:11.970082] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-27T17:01:12.104871] [DEBUG] [LOCAL ] ACA: Primary data saved (22078 records). [2025-10-27T17:01:12.104994] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-27T17:01:12.105072] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 17.4s. Estimated remaining: 3h 13m 35s. Rate: 12.1 symbols/min [2025-10-27T17:01:12.275342] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:12.305470] [DEBUG] [LOCAL ] ACEL: Loaded 26599 existing records from primary storage. [2025-10-27T17:01:12.305923] [INFO ] [MAIN ] ACEL: Loaded 26599 existing records. [2025-10-27T17:01:12.514901] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:12.515597] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-27T17:01:12.515887] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-27T17:01:12.516429] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-27T17:01:12.516512] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-27T17:01:12.720879] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T17:01:12.826515] [INFO ] [REMOTE ] ABR: Full fetch complete (74974 records). [2025-10-27T17:01:12.843747] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-27T17:01:12.865202] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:01:12.870733] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:01:12.881109] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:01:12.886319] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-27T17:01:12.903840] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-27T17:01:12.923064] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-27T17:01:12.943378] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:12.943771] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-27T17:01:12.943841] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-27T17:01:12.945802] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 23.3s. Estimated remaining: 3h 2m 48s. Rate: 12.9 symbols/min [2025-10-27T17:01:13.114239] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:13.172386] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-27T17:01:13.172771] [INFO ] [MAIN ] ACHR: Loaded 54598 existing records. [2025-10-27T17:01:13.348175] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:13.348430] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-27T17:01:13.348480] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-27T17:01:13.348862] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-27T17:01:13.348920] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-27T17:01:13.714605] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:13.715254] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-27T17:01:13.780545] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T17:01:13.792328] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-27T17:01:13.954010] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T17:01:13.959894] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-27T17:01:14.144803] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-27T17:01:14.153141] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-27T17:01:15.197906] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:01:15.203752] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-27T17:01:15.468723] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:01:15.481429] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-27T17:01:15.937770] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:01:15.946025] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-27T17:01:16.142994] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:01:16.261191] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:01:16.271103] [INFO ] [REMOTE ] ABT: Full fetch complete (77384 records). [2025-10-27T17:01:16.271241] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-27T17:01:16.272083] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:01:16.272172] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:01:16.272213] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:01:16.272274] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-27T17:01:16.272335] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-27T17:01:16.272370] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-27T17:01:16.272495] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-27T17:01:16.273960] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 24.4s. Estimated remaining: 2h 59m 27s. Rate: 13.1 symbols/min [2025-10-27T17:01:16.420851] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-27T17:01:16.446952] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:16.492028] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-10-27T17:01:16.544771] [DEBUG] [LOCAL ] ACI: Loaded 54065 existing records from primary storage. [2025-10-27T17:01:16.545099] [INFO ] [MAIN ] ACI: Loaded 54065 existing records. [2025-10-27T17:01:16.726619] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:16.726842] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-27T17:01:16.726889] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-27T17:01:16.727070] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-27T17:01:16.727108] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-27T17:01:17.092090] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:17.112027] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:01:17.214936] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-27T17:01:18.001723] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:01:18.014901] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-27T17:01:18.818094] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-27T17:01:18.821173] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:01:18.919152] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:01:19.614945] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-27T17:01:20.414920] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-27T17:01:20.734985] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T17:01:21.214990] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-27T17:01:21.266592] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-27T17:01:21.726685] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:01:22.014968] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-27T17:01:22.354755] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:01:22.814958] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-27T17:01:23.614962] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-27T17:01:24.124348] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:01:24.414975] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-27T17:01:25.123527] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-10-27T17:01:25.214909] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-27T17:01:25.475760] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:01:26.019047] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-27T17:01:26.021274] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:01:26.815003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-27T17:01:27.614913] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-27T17:01:27.809747] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-27T17:01:28.002179] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T17:01:28.009436] [INFO ] [REMOTE ] ACCO: Full fetch complete (53892 records). [2025-10-27T17:01:28.009590] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-27T17:01:28.417525] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-27T17:01:28.417220] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-27T17:01:28.418721] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-27T17:01:28.419366] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-27T17:01:28.419720] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-27T17:01:28.422162] [DEBUG] [LOCAL ] ACCO: Trimmed 53892 records to 36287 (keeping 200 days of data) [2025-10-27T17:01:28.439426] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T17:01:28.584185] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:01:28.692113] [DEBUG] [LOCAL ] ACCO: Primary data saved (36287 records). [2025-10-27T17:01:28.692258] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-27T17:01:28.692337] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 29.9s. Estimated remaining: 3h 17m 25s. Rate: 11.9 symbols/min [2025-10-27T17:01:28.898271] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:28.942590] [DEBUG] [LOCAL ] ACM: Loaded 43273 existing records from primary storage. [2025-10-27T17:01:28.942936] [INFO ] [MAIN ] ACM: Loaded 43273 existing records. [2025-10-27T17:01:29.117277] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:29.117504] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-27T17:01:29.117557] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-27T17:01:29.117786] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-27T17:01:29.117843] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-27T17:01:29.215725] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-27T17:01:29.469949] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:30.015011] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-27T17:01:30.524252] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:01:30.528934] [INFO ] [REMOTE ] ACEL: Full fetch complete (38668 records). [2025-10-27T17:01:30.529020] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-27T17:01:30.814921] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-27T17:01:30.904534] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-27T17:01:30.904617] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-27T17:01:30.905044] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-27T17:01:30.905100] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-27T17:01:30.905953] [DEBUG] [LOCAL ] ACEL: Trimmed 38668 records to 25768 (keeping 200 days of data) [2025-10-27T17:01:31.053749] [DEBUG] [LOCAL ] ACEL: Primary data saved (25768 records). [2025-10-27T17:01:31.053927] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-27T17:01:31.054045] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 18.9s. Estimated remaining: 3h 11m 30s. Rate: 12.3 symbols/min [2025-10-27T17:01:31.260225] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:31.265060] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-27T17:01:31.325791] [DEBUG] [LOCAL ] ACN: Loaded 54215 existing records from primary storage. [2025-10-27T17:01:31.326098] [INFO ] [MAIN ] ACN: Loaded 54215 existing records. [2025-10-27T17:01:31.510315] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:31.510737] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-27T17:01:31.510814] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-27T17:01:31.519172] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-27T17:01:31.533212] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-27T17:01:31.616003] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-27T17:01:31.610797] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:01:31.914672] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:32.414918] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-27T17:01:32.686451] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T17:01:33.214996] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-27T17:01:33.869296] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T17:01:34.014922] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-27T17:01:34.391894] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-27T17:01:34.815000] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-27T17:01:34.966723] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:01:35.260795] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:01:35.614941] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-27T17:01:36.414923] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-27T17:01:37.214976] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-27T17:01:37.393521] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:01:37.571676] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-27T17:01:38.021163] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-27T17:01:38.039930] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:01:38.673279] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:01:38.814910] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-27T17:01:39.614962] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-27T17:01:40.244597] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:01:40.417365] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-27T17:01:40.423454] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T17:01:41.214942] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-27T17:01:41.501993] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T17:01:41.901430] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T17:01:42.014998] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-27T17:01:42.814987] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-27T17:01:42.892179] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:01:43.614982] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-27T17:01:44.414955] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-27T17:01:44.553739] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:01:44.606700] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-27T17:01:45.170979] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:01:45.215012] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-27T17:01:46.014933] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-27T17:01:46.067548] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T17:01:46.077869] [INFO ] [REMOTE ] ACI: Full fetch complete (77232 records). [2025-10-27T17:01:46.078049] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-27T17:01:46.466327] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-27T17:01:46.466405] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-27T17:01:46.467099] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-27T17:01:46.467164] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-27T17:01:46.468541] [DEBUG] [LOCAL ] ACI: Trimmed 77232 records to 53285 (keeping 200 days of data) [2025-10-27T17:01:46.778930] [DEBUG] [LOCAL ] ACI: Primary data saved (53285 records). [2025-10-27T17:01:46.779057] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-27T17:01:46.779132] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACI took 30.5s. Estimated remaining: 3h 33m 43s. Rate: 11.0 symbols/min [2025-10-27T17:01:46.826090] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-27T17:01:46.955170] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:46.984237] [DEBUG] [LOCAL ] ACP: Loaded 31563 existing records from primary storage. [2025-10-27T17:01:46.984495] [INFO ] [MAIN ] ACP: Loaded 31563 existing records. [2025-10-27T17:01:47.158097] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:47.158314] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-27T17:01:47.158360] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-27T17:01:47.158606] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-27T17:01:47.158703] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-27T17:01:47.503949] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:47.614896] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-27T17:01:48.029012] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T17:01:48.414973] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-27T17:01:48.455218] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (3.24 seconds). [2025-10-27T17:01:48.465546] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-27T17:01:48.465695] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-27T17:01:48.669623] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:01:48.898996] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-27T17:01:48.899091] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-27T17:01:48.899828] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-27T17:01:48.899980] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-27T17:01:48.921222] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:01:48.928766] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-27T17:01:49.216485] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-27T17:01:49.234387] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-27T17:01:49.234473] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-27T17:01:49.236693] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACHR took 36.3s. Estimated remaining: 3h 27m 45s. Rate: 11.3 symbols/min [2025-10-27T17:01:49.408365] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:01:49.416408] [DEBUG] [LOCAL ] ACR: Loaded 5349 existing records from primary storage. [2025-10-27T17:01:49.416584] [INFO ] [MAIN ] ACR: Loaded 5349 existing records. [2025-10-27T17:01:49.590139] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:01:49.590383] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-27T17:01:49.590440] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-27T17:01:49.590575] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-27T17:01:49.590612] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-27T17:01:49.954227] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:01:49.989559] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:01:50.014909] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-27T17:01:50.814958] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-27T17:01:50.918777] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:01:51.614903] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-27T17:01:51.765385] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:01:52.180353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:01:52.414715] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:01:52.416352] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-27T17:01:53.186551] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T17:01:53.214993] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-27T17:01:54.015002] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-27T17:01:54.563300] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:01:54.814984] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-27T17:01:55.614925] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-27T17:01:55.691038] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-27T17:01:55.723018] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T17:01:56.414949] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-27T17:01:57.214962] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-27T17:01:57.489753] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T17:01:57.996225] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T17:01:58.014951] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-27T17:01:58.814941] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-27T17:01:58.985079] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T17:01:59.196836] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:01:59.269516] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T17:01:59.614943] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-27T17:02:00.415025] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-27T17:02:01.215007] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-27T17:02:01.871414] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T17:02:02.014968] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-27T17:02:02.815064] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-27T17:02:04.069960] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (3.65 seconds). [2025-10-27T17:02:04.072103] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-27T17:02:05.537515] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (4.32 seconds). [2025-10-27T17:02:05.545255] [INFO ] [REMOTE ] ACM: Full fetch complete (62972 records). [2025-10-27T17:02:05.545405] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-27T17:02:05.546155] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:02:05.546244] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:02:05.546287] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:02:05.546326] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-27T17:02:05.546380] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-27T17:02:05.546415] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-27T17:02:05.546829] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-27T17:02:05.548669] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACM took 36.9s. Estimated remaining: 3h 48m 8s. Rate: 10.3 symbols/min [2025-10-27T17:02:05.742184] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:05.762901] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-27T17:02:05.770625] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-27T17:02:05.801770] [DEBUG] [LOCAL ] ACRE: Loaded 33607 existing records from primary storage. [2025-10-27T17:02:05.802034] [INFO ] [MAIN ] ACRE: Loaded 33607 existing records. [2025-10-27T17:02:05.984491] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:05.984895] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-27T17:02:05.984977] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-27T17:02:05.985291] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-27T17:02:05.985426] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-27T17:02:06.215568] [DEBUG] [REMOTE ] ACR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-27T17:02:06.250787] [WARN ] [REMOTE ] ACR: No data returned for month 2025-06 [2025-10-27T17:02:06.263008] [FATAL] [REMOTE ] ACR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:02:06.283399] [FATAL] [MAIN ] ACR: Failed to fetch primary data. [2025-10-27T17:02:06.287014] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:02:06.287613] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-27T17:02:06.298380] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-27T17:02:06.298542] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-27T17:02:06.373593] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:06.374195] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-27T17:02:06.373891] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-10-27T17:02:06.375431] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACR took 17.1s. Estimated remaining: 3h 39m 8s. Rate: 10.7 symbols/min [2025-10-27T17:02:06.530387] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (4.52 seconds). [2025-10-27T17:02:06.579499] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-27T17:02:06.596850] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:06.606537] [DEBUG] [LOCAL ] ACV: Loaded 7578 existing records from primary storage. [2025-10-27T17:02:06.606762] [INFO ] [MAIN ] ACV: Loaded 7578 existing records. [2025-10-27T17:02:06.785257] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:06.785454] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-27T17:02:06.785500] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-27T17:02:06.785703] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-27T17:02:06.785760] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-27T17:02:07.147346] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:07.165228] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-27T17:02:07.167502] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T17:02:07.614973] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-27T17:02:07.685211] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:02:08.414930] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-27T17:02:08.463007] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:02:08.513392] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T17:02:08.543190] [INFO ] [REMOTE ] ACN: Full fetch complete (77419 records). [2025-10-27T17:02:08.543497] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-27T17:02:08.545353] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T17:02:08.941859] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-27T17:02:08.941944] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-27T17:02:08.942634] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-27T17:02:08.942724] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-27T17:02:08.944793] [DEBUG] [LOCAL ] ACN: Trimmed 77419 records to 53433 (keeping 200 days of data) [2025-10-27T17:02:09.069784] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:02:09.237528] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-27T17:02:09.283464] [DEBUG] [LOCAL ] ACN: Primary data saved (53433 records). [2025-10-27T17:02:09.283891] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-27T17:02:09.283997] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACN took 38.2s. Estimated remaining: 3h 34m 28s. Rate: 10.9 symbols/min [2025-10-27T17:02:09.468630] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:09.520804] [DEBUG] [LOCAL ] ACVA: Loaded 49969 existing records from primary storage. [2025-10-27T17:02:09.521281] [INFO ] [MAIN ] ACVA: Loaded 49969 existing records. [2025-10-27T17:02:09.719324] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:09.719683] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-27T17:02:09.719749] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-27T17:02:09.720006] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-27T17:02:09.720064] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-27T17:02:10.016029] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-27T17:02:10.123721] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:10.141405] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:02:10.814969] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-27T17:02:11.300933] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T17:02:11.506918] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T17:02:11.513044] [INFO ] [REMOTE ] ACP: Full fetch complete (46262 records). [2025-10-27T17:02:11.513151] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-27T17:02:11.513738] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:02:11.513821] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:02:11.513863] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:02:11.513924] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-27T17:02:11.513987] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-27T17:02:11.514020] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-27T17:02:11.514160] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-27T17:02:11.514243] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 24.7s. Estimated remaining: 3h 29m 4s. Rate: 11.2 symbols/min [2025-10-27T17:02:11.620048] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-27T17:02:11.692744] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:11.692909] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-27T17:02:11.692946] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-27T17:02:11.693052] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-27T17:02:11.693092] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-27T17:02:11.693132] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-27T17:02:11.693164] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-27T17:02:12.049003] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:12.353799] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:02:12.414935] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-27T17:02:13.214942] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-27T17:02:13.418074] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:02:13.418370] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-27T17:02:13.418459] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:02:13.418528] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-27T17:02:13.418594] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:02:13.418691] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-27T17:02:13.418762] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-27T17:02:13.418802] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-27T17:02:13.418842] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-27T17:02:13.418888] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 1.9s. Estimated remaining: 3h 23m 35s. Rate: 11.5 symbols/min [2025-10-27T17:02:13.607885] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:13.647873] [DEBUG] [LOCAL ] ADC: Loaded 47102 existing records from primary storage. [2025-10-27T17:02:13.648391] [INFO ] [MAIN ] ADC: Loaded 47102 existing records. [2025-10-27T17:02:13.762141] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:02:13.856355] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:13.856551] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-27T17:02:13.856597] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-27T17:02:13.856817] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-27T17:02:13.856871] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-27T17:02:14.027525] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-27T17:02:14.211838] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:14.814961] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-27T17:02:15.615047] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-27T17:02:15.752461] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:02:16.414971] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-27T17:02:16.807083] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T17:02:17.214947] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-27T17:02:17.321709] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T17:02:18.014980] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-27T17:02:18.247837] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:02:18.408190] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:02:18.814937] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-27T17:02:18.844246] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T17:02:19.615012] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-27T17:02:20.284821] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:02:20.414976] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-27T17:02:20.895476] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:02:21.214994] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-27T17:02:22.014939] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-27T17:02:22.070775] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:02:22.449107] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T17:02:22.814940] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-27T17:02:22.964256] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:02:23.614999] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-27T17:02:24.414958] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-27T17:02:25.071372] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T17:02:25.158623] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:02:25.214908] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-27T17:02:25.663430] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:02:26.014972] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-27T17:02:26.251550] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T17:02:26.463013] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T17:02:26.814961] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-27T17:02:27.319303] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T17:02:27.614948] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-27T17:02:28.415005] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-27T17:02:29.214937] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-27T17:02:29.608173] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T17:02:29.958347] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:02:29.962512] [INFO ] [REMOTE ] ACV: Full fetch complete (10600 records). [2025-10-27T17:02:29.963607] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-27T17:02:30.017324] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-27T17:02:30.352886] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:02:30.523058] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-27T17:02:30.523207] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-27T17:02:30.523442] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-27T17:02:30.523490] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-27T17:02:30.524275] [DEBUG] [LOCAL ] ACV: Trimmed 10600 records to 7257 (keeping 200 days of data) [2025-10-27T17:02:30.577928] [DEBUG] [LOCAL ] ACV: Primary data saved (7257 records). [2025-10-27T17:02:30.578108] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-27T17:02:30.578214] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACV took 24.2s. Estimated remaining: 3h 41m 25s. Rate: 10.6 symbols/min [2025-10-27T17:02:30.822146] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-27T17:02:30.841954] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:30.915958] [DEBUG] [LOCAL ] ADCT: Loaded 36037 existing records from primary storage. [2025-10-27T17:02:30.916353] [INFO ] [MAIN ] ADCT: Loaded 36037 existing records. [2025-10-27T17:02:31.134989] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:31.135436] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-27T17:02:31.135526] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-27T17:02:31.135818] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-27T17:02:31.135978] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-27T17:02:31.318368] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:02:31.548269] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:31.614948] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-27T17:02:32.113742] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:02:32.414964] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-27T17:02:33.195528] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:02:33.214912] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-27T17:02:33.587868] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:02:34.015020] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-27T17:02:34.260709] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:02:34.815025] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-27T17:02:35.491114] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:02:35.614951] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-27T17:02:36.276919] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:02:36.414978] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-27T17:02:36.505272] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:02:37.214939] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-27T17:02:37.715705] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:02:38.014941] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-27T17:02:38.356001] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T17:02:38.814963] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-27T17:02:38.868740] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:02:39.614941] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-27T17:02:40.414978] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-27T17:02:40.472265] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:02:40.555596] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T17:02:41.214929] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-27T17:02:42.014975] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-27T17:02:42.051486] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:02:42.814933] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-27T17:02:42.905528] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:02:43.614947] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-27T17:02:43.748336] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:02:43.757600] [INFO ] [REMOTE ] ADC: Full fetch complete (66727 records). [2025-10-27T17:02:43.757777] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-27T17:02:44.140989] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:02:44.211189] [INFO ] [REMOTE ] ACRE: Full fetch complete (49150 records). [2025-10-27T17:02:44.213668] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-27T17:02:44.326009] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-27T17:02:44.349060] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-27T17:02:44.361013] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-27T17:02:44.361199] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-27T17:02:44.426988] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-27T17:02:44.449857] [DEBUG] [LOCAL ] ADC: Trimmed 66727 records to 46272 (keeping 200 days of data) [2025-10-27T17:02:44.918828] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-27T17:02:44.919207] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-27T17:02:44.922785] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-27T17:02:44.923758] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-27T17:02:44.955629] [DEBUG] [LOCAL ] ACRE: Trimmed 49150 records to 32703 (keeping 200 days of data) [2025-10-27T17:02:44.992694] [DEBUG] [LOCAL ] ADC: Primary data saved (46272 records). [2025-10-27T17:02:44.992871] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-27T17:02:44.992990] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ADC took 31.6s. Estimated remaining: 3h 53m 56s. Rate: 10.0 symbols/min [2025-10-27T17:02:45.304345] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:45.393170] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:02:45.421177] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-27T17:02:45.425153] [DEBUG] [LOCAL ] ACRE: Primary data saved (32703 records). [2025-10-27T17:02:45.425576] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-27T17:02:45.426879] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ACRE took 39.9s. Estimated remaining: 3h 46m 5s. Rate: 10.3 symbols/min [2025-10-27T17:02:45.655257] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:45.657516] [DEBUG] [LOCAL ] ADM: Loaded 54167 existing records from primary storage. [2025-10-27T17:02:45.658250] [INFO ] [MAIN ] ADM: Loaded 54167 existing records. [2025-10-27T17:02:45.857025] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:45.867990] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-27T17:02:45.868177] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-27T17:02:45.868488] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-27T17:02:45.868530] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-27T17:02:45.994237] [DEBUG] [LOCAL ] ADNT: Loaded 46882 existing records from primary storage. [2025-10-27T17:02:46.040449] [INFO ] [MAIN ] ADNT: Loaded 46882 existing records. [2025-10-27T17:02:46.111133] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:02:46.271433] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-27T17:02:46.519060] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:46.515122] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:46.519874] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-27T17:02:46.519969] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-27T17:02:46.520170] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-27T17:02:46.520212] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-27T17:02:46.829450] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-27T17:02:46.921305] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:46.941228] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T17:02:47.615045] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-27T17:02:48.415056] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-27T17:02:48.470585] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-27T17:02:48.481344] [INFO ] [REMOTE ] ACVA: Full fetch complete (71060 records). [2025-10-27T17:02:48.481537] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-27T17:02:48.927507] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-27T17:02:48.927774] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-27T17:02:48.928479] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-27T17:02:48.928633] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-27T17:02:48.955557] [DEBUG] [LOCAL ] ACVA: Trimmed 71060 records to 49125 (keeping 200 days of data) [2025-10-27T17:02:48.962685] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T17:02:49.165811] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:02:49.224859] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-27T17:02:49.298951] [DEBUG] [LOCAL ] ACVA: Primary data saved (49125 records). [2025-10-27T17:02:49.299086] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-27T17:02:49.301701] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ACVA took 40.0s. Estimated remaining: 3h 43m 24s. Rate: 10.5 symbols/min [2025-10-27T17:02:49.466679] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:49.527020] [DEBUG] [LOCAL ] ADT: Loaded 54214 existing records from primary storage. [2025-10-27T17:02:49.527458] [INFO ] [MAIN ] ADT: Loaded 54214 existing records. [2025-10-27T17:02:49.727954] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:49.728212] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-27T17:02:49.729104] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-27T17:02:49.730339] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T17:02:49.733363] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-27T17:02:49.738394] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-27T17:02:50.020567] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-27T17:02:50.093617] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:50.815013] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-27T17:02:50.941712] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:02:51.168935] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:02:51.614984] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-27T17:02:52.414980] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-27T17:02:53.220750] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-27T17:02:53.240036] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:02:53.334286] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-27T17:02:54.009723] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:02:54.020233] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-27T17:02:54.814951] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-27T17:02:55.036880] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:02:55.045293] [INFO ] [REMOTE ] ADCT: Full fetch complete (51456 records). [2025-10-27T17:02:55.045472] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-27T17:02:55.436151] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-27T17:02:55.436288] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-27T17:02:55.436813] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-27T17:02:55.436878] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-27T17:02:55.438234] [DEBUG] [LOCAL ] ADCT: Trimmed 51456 records to 35566 (keeping 200 days of data) [2025-10-27T17:02:55.616005] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-27T17:02:55.644187] [DEBUG] [LOCAL ] ADCT: Primary data saved (35566 records). [2025-10-27T17:02:55.644448] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-27T17:02:55.644828] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADCT took 25.1s. Estimated remaining: 3h 44m 6s. Rate: 10.4 symbols/min [2025-10-27T17:02:55.824437] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:02:55.892547] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:02:55.920546] [DEBUG] [LOCAL ] ADX: Loaded 28052 existing records from primary storage. [2025-10-27T17:02:55.920896] [INFO ] [MAIN ] ADX: Loaded 28052 existing records. [2025-10-27T17:02:56.110254] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:02:56.110686] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-27T17:02:56.110827] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-27T17:02:56.111069] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-27T17:02:56.111216] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-27T17:02:56.362186] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T17:02:56.423087] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-27T17:02:56.527257] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:02:57.215011] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-27T17:02:57.928836] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:02:58.014947] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-27T17:02:58.103837] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-27T17:02:58.823564] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-27T17:02:58.825541] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:02:59.614935] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-27T17:02:59.770356] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:03:00.414992] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-27T17:03:01.214992] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-27T17:03:01.834251] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-27T17:03:02.014906] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-27T17:03:02.380071] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-10-27T17:03:02.814967] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-27T17:03:04.928509] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (4.51 seconds). [2025-10-27T17:03:04.938925] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-27T17:03:05.317458] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (4.10 seconds). [2025-10-27T17:03:05.323912] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-27T17:03:06.956372] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (4.14 seconds). [2025-10-27T17:03:06.967877] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-27T17:03:07.042869] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (5.03 seconds). [2025-10-27T17:03:07.054188] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-27T17:03:07.695300] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-27T17:03:07.702049] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-27T17:03:08.743173] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (3.80 seconds). [2025-10-27T17:03:08.753064] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-27T17:03:09.779998] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T17:03:09.786497] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-27T17:03:09.830886] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-27T17:03:09.843507] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-27T17:03:10.182308] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T17:03:10.194361] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-27T17:03:10.237473] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:03:10.814938] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-27T17:03:11.335804] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:03:11.596590] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:03:11.614908] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-27T17:03:12.328663] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-27T17:03:12.384276] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:03:12.392089] [INFO ] [REMOTE ] ADNT: Full fetch complete (67402 records). [2025-10-27T17:03:12.392213] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-27T17:03:12.393038] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:03:12.393124] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:03:12.393166] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:03:12.393234] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-27T17:03:12.393297] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-27T17:03:12.393332] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-27T17:03:12.393489] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-27T17:03:12.395159] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADNT took 27.0s. Estimated remaining: 3h 57m 48s. Rate: 9.8 symbols/min [2025-10-27T17:03:12.425048] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-27T17:03:12.577397] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:12.596923] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:03:12.652413] [DEBUG] [LOCAL ] AEE: Loaded 50716 existing records from primary storage. [2025-10-27T17:03:12.652739] [INFO ] [MAIN ] AEE: Loaded 50716 existing records. [2025-10-27T17:03:12.825412] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:12.825607] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-27T17:03:12.825683] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-27T17:03:12.825876] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-27T17:03:12.825916] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-27T17:03:13.178484] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:13.214899] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-27T17:03:13.904950] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:03:14.014923] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-27T17:03:14.814950] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-27T17:03:15.062205] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:03:15.450861] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:03:15.614927] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-27T17:03:16.414953] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-27T17:03:16.450302] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:03:17.143190] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:03:17.153739] [INFO ] [REMOTE ] ADM: Full fetch complete (77477 records). [2025-10-27T17:03:17.153894] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-27T17:03:17.220797] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-27T17:03:17.580597] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:03:17.608158] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-27T17:03:17.608245] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-27T17:03:17.609437] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-27T17:03:17.609506] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-27T17:03:17.610989] [DEBUG] [LOCAL ] ADM: Trimmed 77477 records to 53387 (keeping 200 days of data) [2025-10-27T17:03:17.935484] [DEBUG] [LOCAL ] ADM: Primary data saved (53387 records). [2025-10-27T17:03:17.935719] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-27T17:03:17.935822] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADM took 32.9s. Estimated remaining: 3h 57m 0s. Rate: 9.8 symbols/min [2025-10-27T17:03:18.020006] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-27T17:03:18.129636] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:18.140076] [DEBUG] [LOCAL ] AEFC: Loaded 7718 existing records from primary storage. [2025-10-27T17:03:18.140287] [INFO ] [MAIN ] AEFC: Loaded 7718 existing records. [2025-10-27T17:03:18.328397] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:18.328610] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-27T17:03:18.328685] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-27T17:03:18.328848] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-27T17:03:18.328888] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-27T17:03:18.705160] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:18.732040] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:03:18.814912] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-27T17:03:19.614963] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-27T17:03:20.131831] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T17:03:20.203224] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T17:03:20.415001] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-27T17:03:20.899989] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:03:21.214966] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-27T17:03:22.016623] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-27T17:03:22.017582] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:03:22.564470] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-27T17:03:22.773414] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:03:22.814987] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-27T17:03:23.614956] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-27T17:03:24.414970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-27T17:03:24.627919] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T17:03:24.966533] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:03:24.976592] [INFO ] [REMOTE ] ADX: Full fetch complete (41757 records). [2025-10-27T17:03:24.976939] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-27T17:03:25.218274] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-27T17:03:25.244858] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T17:03:25.430667] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-27T17:03:25.430795] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-27T17:03:25.431342] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-27T17:03:25.431410] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-27T17:03:25.433162] [DEBUG] [LOCAL ] ADX: Trimmed 41757 records to 27465 (keeping 200 days of data) [2025-10-27T17:03:25.607871] [DEBUG] [LOCAL ] ADX: Primary data saved (27465 records). [2025-10-27T17:03:25.608077] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-27T17:03:25.608183] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADX took 30.0s. Estimated remaining: 3h 58m 46s. Rate: 9.8 symbols/min [2025-10-27T17:03:25.817588] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:25.871101] [DEBUG] [LOCAL ] AEG: Loaded 50239 existing records from primary storage. [2025-10-27T17:03:25.871790] [INFO ] [MAIN ] AEG: Loaded 50239 existing records. [2025-10-27T17:03:26.029284] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-27T17:03:26.079992] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:26.080344] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-27T17:03:26.080397] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-27T17:03:26.080615] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-27T17:03:26.080693] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-27T17:03:26.470714] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:26.814942] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-27T17:03:26.990771] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:03:27.102000] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T17:03:27.614943] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-27T17:03:28.378634] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:03:28.414897] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-27T17:03:28.445289] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T17:03:28.455973] [INFO ] [REMOTE ] ADT: Full fetch complete (77378 records). [2025-10-27T17:03:28.456112] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-27T17:03:28.836868] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-27T17:03:28.837075] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-27T17:03:28.837843] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-27T17:03:28.837917] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-27T17:03:28.844268] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T17:03:28.847498] [DEBUG] [LOCAL ] ADT: Trimmed 77378 records to 53432 (keeping 200 days of data) [2025-10-27T17:03:29.149735] [DEBUG] [LOCAL ] ADT: Primary data saved (53432 records). [2025-10-27T17:03:29.149859] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-27T17:03:29.152130] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADT took 39.9s. Estimated remaining: 3h 55m 42s. Rate: 9.9 symbols/min [2025-10-27T17:03:29.220230] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-27T17:03:29.327699] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:29.394414] [DEBUG] [LOCAL ] AEM: Loaded 54253 existing records from primary storage. [2025-10-27T17:03:29.394736] [INFO ] [MAIN ] AEM: Loaded 54253 existing records. [2025-10-27T17:03:29.570672] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:29.570824] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-27T17:03:29.570871] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-27T17:03:29.571047] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-27T17:03:29.571086] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-27T17:03:29.702246] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:03:29.933129] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:30.014898] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-27T17:03:30.815023] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-27T17:03:31.614990] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-27T17:03:31.685191] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:03:32.079369] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:03:32.414920] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-27T17:03:32.465320] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T17:03:33.215098] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-27T17:03:34.014954] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-27T17:03:34.172243] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T17:03:34.430878] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:03:34.825691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-27T17:03:34.831781] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T17:03:35.614964] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-27T17:03:36.047373] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T17:03:36.414980] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-27T17:03:37.151220] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:03:37.153135] [INFO ] [REMOTE ] AEFC: Full fetch complete (11564 records). [2025-10-27T17:03:37.153248] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-27T17:03:37.153761] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:03:37.153846] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:03:37.153890] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:03:37.153954] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-27T17:03:37.154019] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-27T17:03:37.154055] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-27T17:03:37.154184] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-27T17:03:37.154256] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEFC took 19.2s. Estimated remaining: 3h 57m 45s. Rate: 9.8 symbols/min [2025-10-27T17:03:37.222150] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-27T17:03:37.333477] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:37.385456] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-10-27T17:03:37.385864] [INFO ] [MAIN ] AEO: Loaded 54343 existing records. [2025-10-27T17:03:37.611061] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T17:03:37.627574] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:37.628675] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-27T17:03:37.628745] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-27T17:03:37.628959] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-27T17:03:37.629019] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-27T17:03:38.018356] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-27T17:03:38.041542] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:38.815000] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-27T17:03:39.465194] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T17:03:39.623033] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-27T17:03:39.628494] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-27T17:03:40.420062] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-27T17:03:40.437892] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:03:41.037007] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:03:41.214947] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-27T17:03:42.014954] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-27T17:03:42.453101] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T17:03:42.814939] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-27T17:03:43.005338] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T17:03:43.614967] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-27T17:03:44.165213] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T17:03:44.414951] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-27T17:03:44.733183] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T17:03:45.202361] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:03:45.214898] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-27T17:03:45.717944] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:03:46.014971] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-27T17:03:46.705913] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:03:46.814982] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-27T17:03:47.614949] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-27T17:03:48.051829] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T17:03:48.414935] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-27T17:03:48.590691] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:03:49.027479] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T17:03:49.036957] [INFO ] [REMOTE ] AEE: Full fetch complete (72959 records). [2025-10-27T17:03:49.037074] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-27T17:03:49.227625] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-27T17:03:49.457089] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-27T17:03:49.457182] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-27T17:03:49.458002] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-27T17:03:49.458113] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-27T17:03:49.459768] [DEBUG] [LOCAL ] AEE: Trimmed 72959 records to 49892 (keeping 200 days of data) [2025-10-27T17:03:49.704083] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T17:03:49.797624] [DEBUG] [LOCAL ] AEE: Primary data saved (49892 records). [2025-10-27T17:03:49.797773] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-27T17:03:49.799320] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEE took 37.4s. Estimated remaining: 4h 4m 41s. Rate: 9.5 symbols/min [2025-10-27T17:03:50.027930] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-27T17:03:50.035424] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:03:50.086159] [DEBUG] [LOCAL ] AER: Loaded 48541 existing records from primary storage. [2025-10-27T17:03:50.086494] [INFO ] [MAIN ] AER: Loaded 48541 existing records. [2025-10-27T17:03:50.297003] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:03:50.297243] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-27T17:03:50.297289] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-27T17:03:50.297503] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-27T17:03:50.297560] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-27T17:03:50.655582] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:03:50.814901] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-27T17:03:50.896867] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:03:51.615001] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-27T17:03:52.274739] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-27T17:03:52.351486] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:03:52.414915] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-27T17:03:53.202687] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:03:53.214902] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-27T17:03:53.752638] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:03:54.014975] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-27T17:03:54.466706] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:03:54.814978] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-27T17:03:55.614994] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-27T17:03:56.319260] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-27T17:03:56.414907] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-27T17:03:56.652381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T17:03:56.661941] [INFO ] [REMOTE ] AEG: Full fetch complete (70640 records). [2025-10-27T17:03:56.662050] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-27T17:03:57.052672] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-27T17:03:57.052887] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-27T17:03:57.053708] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-27T17:03:57.053797] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-27T17:03:57.055364] [DEBUG] [LOCAL ] AEG: Trimmed 70640 records to 49423 (keeping 200 days of data) [2025-10-27T17:03:57.221183] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-27T17:03:57.297437] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:03:57.369832] [DEBUG] [LOCAL ] AEG: Primary data saved (49423 records). [2025-10-27T17:03:57.369950] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-27T17:03:57.372864] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 31.8s. Estimated remaining: 4h 5m 55s. Rate: 9.5 symbols/min [2025-10-27T17:03:58.014909] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-27T17:03:58.405581] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:03:58.814906] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-27T17:03:58.897940] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:03:59.614976] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-27T17:03:59.671022] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:04:00.415000] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-27T17:04:02.342992] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (3.53 seconds). [2025-10-27T17:04:02.354541] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-27T17:04:02.401840] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-27T17:04:02.412994] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-27T17:04:04.025903] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-27T17:04:04.035991] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-27T17:04:05.329480] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:04:05.338833] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-27T17:04:05.446096] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-27T17:04:05.457347] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-27T17:04:05.957225] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (3.54 seconds). [2025-10-27T17:04:05.968613] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-27T17:04:07.623217] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:04:07.661089] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-27T17:04:07.659798] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-27T17:04:07.670960] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-27T17:04:07.671947] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-27T17:04:08.073429] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-27T17:04:08.073763] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-27T17:04:08.074511] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-27T17:04:08.074558] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-27T17:04:08.076084] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 53563 (keeping 200 days of data) [2025-10-27T17:04:08.397013] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-27T17:04:08.397320] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-27T17:04:08.397449] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEO took 31.2s. Estimated remaining: 4h 10m 36s. Rate: 9.3 symbols/min [2025-10-27T17:04:08.424262] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T17:04:08.434334] [INFO ] [REMOTE ] AEM: Full fetch complete (77489 records). [2025-10-27T17:04:08.434461] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-27T17:04:08.825279] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-27T17:04:08.825387] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-27T17:04:08.826202] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-27T17:04:08.826365] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-27T17:04:08.828330] [DEBUG] [LOCAL ] AEM: Trimmed 77489 records to 53473 (keeping 200 days of data) [2025-10-27T17:04:09.144243] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:04:09.197317] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-27T17:04:09.208254] [DEBUG] [LOCAL ] AEM: Primary data saved (53473 records). [2025-10-27T17:04:09.208418] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-27T17:04:09.211062] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEM took 40.1s. Estimated remaining: 4h 4m 52s. Rate: 9.5 symbols/min [2025-10-27T17:04:10.831267] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:04:10.845240] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-27T17:04:12.859638] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-27T17:04:12.868314] [INFO ] [REMOTE ] AER: Full fetch complete (69908 records). [2025-10-27T17:04:12.868424] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-27T17:04:13.264852] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-27T17:04:13.264934] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-27T17:04:13.265613] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-27T17:04:13.265691] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-27T17:04:13.267152] [DEBUG] [LOCAL ] AER: Trimmed 69908 records to 47685 (keeping 200 days of data) [2025-10-27T17:04:13.552423] [DEBUG] [LOCAL ] AER: Primary data saved (47685 records). [2025-10-27T17:04:13.552570] [INFO ] [MAIN ] AER: Full history saved. [2025-10-27T17:04:13.554168] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 23.8s. Estimated remaining: 4h 2m 52s. Rate: 9.6 symbols/min [2025-10-27T17:04:14.150817] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.144746] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.202938] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-27T17:04:14.228361] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.260323] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-27T17:04:14.260174] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:14.261451] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-27T17:04:14.261736] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-27T17:04:14.264219] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-27T17:04:14.264299] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-27T17:04:14.374968] [DEBUG] [LOCAL ] AFB: Loaded 11166 existing records from primary storage. [2025-10-27T17:04:14.396251] [INFO ] [MAIN ] AFB: Loaded 11166 existing records. [2025-10-27T17:04:14.724078] [DEBUG] [LOCAL ] AESI: Loaded 50567 existing records from primary storage. [2025-10-27T17:04:14.756333] [INFO ] [MAIN ] AESI: Loaded 50567 existing records. [2025-10-27T17:04:14.877468] [DEBUG] [LOCAL ] AES: Loaded 54443 existing records from primary storage. [2025-10-27T17:04:14.971198] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:14.997614] [INFO ] [MAIN ] AES: Loaded 54443 existing records. [2025-10-27T17:04:15.072707] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:15.013054] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.124711] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-27T17:04:15.125121] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-27T17:04:15.212545] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-27T17:04:15.246459] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-27T17:04:15.386507] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:15.431058] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.454387] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:15.431234] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:04:15.465228] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-27T17:04:15.465575] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-27T17:04:15.471039] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-27T17:04:15.470812] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-27T17:04:15.481882] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-27T17:04:15.476383] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-27T17:04:15.482041] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-27T17:04:15.492758] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-27T17:04:15.492869] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:04:15.546347] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-27T17:04:15.576514] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:04:15.646709] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-27T17:04:15.713492] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-27T17:04:15.734815] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-27T17:04:15.772417] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-27T17:04:15.790794] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.2s. Estimated remaining: 3h 58m 57s. Rate: 9.7 symbols/min [2025-10-27T17:04:16.594876] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:16.588519] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.610791] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-27T17:04:16.728205] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.734928] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-27T17:04:16.812441] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:16.820930] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-27T17:04:16.835810] [DEBUG] [LOCAL ] AFG: Loaded 32241 existing records from primary storage. [2025-10-27T17:04:16.836073] [INFO ] [MAIN ] AFG: Loaded 32241 existing records. [2025-10-27T17:04:17.025550] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:17.025794] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-27T17:04:17.025846] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-27T17:04:17.026024] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-27T17:04:17.026064] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-27T17:04:17.391772] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:17.392099] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-27T17:04:17.649024] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:04:17.651846] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-27T17:04:18.547402] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T17:04:18.550394] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-27T17:04:18.645060] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:04:18.650447] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-27T17:04:18.870065] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T17:04:18.880789] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-27T17:04:18.905509] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T17:04:18.914724] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-27T17:04:19.107691] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:04:19.110910] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-27T17:04:19.664820] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:04:19.668529] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-27T17:04:19.863460] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:04:19.870486] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-27T17:04:20.077016] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:04:20.086388] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-27T17:04:20.263247] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T17:04:20.266042] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-27T17:04:20.467592] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:04:20.477596] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-27T17:04:21.290859] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:04:21.298837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-27T17:04:21.335777] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:04:21.475756] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T17:04:22.014949] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-27T17:04:22.123585] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:04:22.651224] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:04:22.814932] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-27T17:04:23.292250] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T17:04:23.614988] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-27T17:04:24.373580] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:04:24.414985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-27T17:04:24.901208] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:04:25.003014] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:04:25.214996] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-27T17:04:26.014982] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-27T17:04:26.814985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-27T17:04:26.963804] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T17:04:27.032892] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:04:27.575812] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:04:27.578291] [INFO ] [REMOTE ] AFB: Full fetch complete (16284 records). [2025-10-27T17:04:27.578378] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-27T17:04:27.620121] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-27T17:04:27.941289] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-27T17:04:27.941371] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-27T17:04:27.941661] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-27T17:04:27.941726] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-27T17:04:27.942259] [DEBUG] [LOCAL ] AFB: Trimmed 16284 records to 10957 (keeping 200 days of data) [2025-10-27T17:04:28.008012] [DEBUG] [LOCAL ] AFB: Primary data saved (10957 records). [2025-10-27T17:04:28.008150] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-27T17:04:28.008232] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 14.4s. Estimated remaining: 4h 4m 25s. Rate: 9.5 symbols/min [2025-10-27T17:04:28.179765] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:28.183571] [DEBUG] [LOCAL ] AFGB: Loaded 2224 existing records from primary storage. [2025-10-27T17:04:28.183779] [INFO ] [MAIN ] AFGB: Loaded 2224 existing records. [2025-10-27T17:04:28.364707] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:28.364909] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-27T17:04:28.364957] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-27T17:04:28.365075] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-27T17:04:28.365154] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-27T17:04:28.426837] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-27T17:04:28.748989] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:29.215009] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-27T17:04:29.780035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T17:04:30.015009] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-27T17:04:30.162226] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T17:04:30.250635] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:04:30.814978] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-27T17:04:31.419893] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:04:31.614960] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-27T17:04:32.414925] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-27T17:04:32.778062] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-27T17:04:32.861711] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:04:33.214996] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-27T17:04:33.786938] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:04:34.014929] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-27T17:04:34.814929] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-27T17:04:34.874557] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:04:35.270904] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:04:35.492064] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:04:35.614924] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-27T17:04:36.414952] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-27T17:04:37.214948] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-27T17:04:37.283765] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:04:37.557614] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-27T17:04:38.014948] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-27T17:04:38.730900] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T17:04:38.814920] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-27T17:04:39.572391] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T17:04:39.614926] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-27T17:04:40.133371] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T17:04:40.423195] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-27T17:04:40.445142] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:04:41.214985] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-27T17:04:41.931753] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:04:42.014919] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-27T17:04:42.814930] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-27T17:04:43.205738] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T17:04:43.484706] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:04:43.614923] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-27T17:04:43.671550] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T17:04:43.687115] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-27T17:04:43.687345] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-27T17:04:44.079787] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-27T17:04:44.079866] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-27T17:04:44.080664] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-27T17:04:44.080731] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-27T17:04:44.082249] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-10-27T17:04:44.411449] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-10-27T17:04:44.411615] [INFO ] [MAIN ] AES: Full history saved. [2025-10-27T17:04:44.411740] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AES took 30.9s. Estimated remaining: 4h 13m 24s. Rate: 9.2 symbols/min [2025-10-27T17:04:44.423429] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-27T17:04:44.585225] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:44.589466] [DEBUG] [LOCAL ] AFGC: Loaded 2572 existing records from primary storage. [2025-10-27T17:04:44.589620] [INFO ] [MAIN ] AFGC: Loaded 2572 existing records. [2025-10-27T17:04:44.768766] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:44.769213] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-27T17:04:44.769357] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-27T17:04:44.769506] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-27T17:04:44.769545] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-27T17:04:44.924754] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:04:44.998816] [INFO ] [REMOTE ] AFG: Full fetch complete (46863 records). [2025-10-27T17:04:45.035758] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-27T17:04:45.218119] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-27T17:04:45.326848] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:45.582461] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-27T17:04:45.582542] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-27T17:04:45.583045] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-27T17:04:45.583108] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-27T17:04:45.584132] [DEBUG] [LOCAL ] AFG: Trimmed 46863 records to 31571 (keeping 200 days of data) [2025-10-27T17:04:45.675981] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T17:04:45.785054] [DEBUG] [LOCAL ] AFG: Primary data saved (31571 records). [2025-10-27T17:04:45.785202] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-27T17:04:45.785284] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AFG took 30.0s. Estimated remaining: 4h 8m 45s. Rate: 9.3 symbols/min [2025-10-27T17:04:45.956126] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:45.959415] [DEBUG] [LOCAL ] AFGD: Loaded 1763 existing records from primary storage. [2025-10-27T17:04:45.959551] [INFO ] [MAIN ] AFGD: Loaded 1763 existing records. [2025-10-27T17:04:46.020136] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-27T17:04:46.147687] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:46.148131] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-27T17:04:46.148207] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-27T17:04:46.148496] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-27T17:04:46.148566] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-27T17:04:46.464450] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:04:46.534607] [INFO ] [REMOTE ] AESI: Full fetch complete (71871 records). [2025-10-27T17:04:46.552557] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-27T17:04:46.556492] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:46.821294] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-27T17:04:46.875417] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:04:47.001861] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-27T17:04:47.001956] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-27T17:04:47.002634] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-27T17:04:47.002722] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-27T17:04:47.004206] [DEBUG] [LOCAL ] AESI: Trimmed 71871 records to 49777 (keeping 200 days of data) [2025-10-27T17:04:47.236535] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:04:47.309509] [DEBUG] [LOCAL ] AESI: Primary data saved (49777 records). [2025-10-27T17:04:47.309680] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-27T17:04:47.309784] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AESI took 33.7s. Estimated remaining: 4h 4m 26s. Rate: 9.5 symbols/min [2025-10-27T17:04:47.479890] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:04:47.484265] [DEBUG] [LOCAL ] AFGE: Loaded 2255 existing records from primary storage. [2025-10-27T17:04:47.484405] [INFO ] [MAIN ] AFGE: Loaded 2255 existing records. [2025-10-27T17:04:47.623175] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-27T17:04:47.665014] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:04:47.665223] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-27T17:04:47.665271] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-27T17:04:47.665390] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-27T17:04:47.665428] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-27T17:04:48.009394] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:04:48.094788] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T17:04:48.414942] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-27T17:04:48.934298] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:04:49.214975] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-27T17:04:49.517272] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:04:50.014952] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-27T17:04:50.313831] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:04:50.814941] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-27T17:04:51.340939] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T17:04:51.614999] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-27T17:04:52.197239] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T17:04:52.414990] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-27T17:04:52.722123] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T17:04:53.214952] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-27T17:04:54.015002] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-27T17:04:54.174566] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:04:54.294206] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-27T17:04:54.814937] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-27T17:04:55.327047] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T17:04:55.614946] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-27T17:04:56.172919] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T17:04:56.414940] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-27T17:04:56.844122] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T17:04:57.214930] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-27T17:04:57.760707] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T17:04:58.014933] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-27T17:04:58.322596] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:04:58.814941] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-27T17:04:59.279612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:04:59.614935] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-27T17:05:00.003992] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T17:05:00.414973] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-27T17:05:01.214948] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-27T17:05:02.014983] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-27T17:05:02.814942] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-27T17:05:03.717311] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-27T17:05:03.718619] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-27T17:05:03.784474] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-27T17:05:04.414943] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-27T17:05:04.504637] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T17:05:04.505451] [INFO ] [REMOTE ] AFGB: Full fetch complete (3402 records). [2025-10-27T17:05:04.505519] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-27T17:05:04.505913] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:05:04.505994] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:05:04.506036] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:05:04.506074] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-27T17:05:04.506146] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-27T17:05:04.506228] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-27T17:05:04.506362] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-27T17:05:04.506444] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFGB took 36.5s. Estimated remaining: 4h 13m 28s. Rate: 9.2 symbols/min [2025-10-27T17:05:04.614526] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T17:05:04.678775] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:04.727739] [DEBUG] [LOCAL ] AFL: Loaded 53948 existing records from primary storage. [2025-10-27T17:05:04.728104] [INFO ] [MAIN ] AFL: Loaded 53948 existing records. [2025-10-27T17:05:04.907803] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:04.908010] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-27T17:05:04.908058] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-27T17:05:04.908328] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-27T17:05:04.908393] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-27T17:05:05.089918] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T17:05:05.229852] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-27T17:05:05.267467] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:05.625264] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:05:05.626085] [INFO ] [REMOTE ] AFGE: Full fetch complete (3287 records). [2025-10-27T17:05:05.626153] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-27T17:05:05.906786] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T17:05:06.005308] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-27T17:05:06.005393] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-27T17:05:06.005543] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-27T17:05:06.005609] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-27T17:05:06.006028] [DEBUG] [LOCAL ] AFGE: Trimmed 3287 records to 2214 (keeping 200 days of data) [2025-10-27T17:05:06.016138] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-27T17:05:06.019593] [DEBUG] [LOCAL ] AFGE: Primary data saved (2214 records). [2025-10-27T17:05:06.020497] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-27T17:05:06.020578] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGE took 18.7s. Estimated remaining: 4h 9m 13s. Rate: 9.3 symbols/min [2025-10-27T17:05:06.215679] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:06.264635] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-10-27T17:05:06.264962] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-10-27T17:05:06.440192] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:06.440393] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-27T17:05:06.440452] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-27T17:05:06.440678] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-27T17:05:06.440743] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-27T17:05:06.519447] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:05:06.806566] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:06.814902] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-27T17:05:07.615019] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-27T17:05:08.414969] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-27T17:05:08.578808] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T17:05:08.868472] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T17:05:09.214912] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-27T17:05:09.298374] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:05:09.678191] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T17:05:10.014931] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-27T17:05:10.814912] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-27T17:05:10.887309] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:05:10.888136] [INFO ] [REMOTE ] AFGD: Full fetch complete (2677 records). [2025-10-27T17:05:10.888207] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-27T17:05:10.888551] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:05:10.888634] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:05:10.888758] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:05:10.888842] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-27T17:05:10.888923] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-27T17:05:10.888973] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-27T17:05:10.889111] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-27T17:05:10.889206] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGD took 25.1s. Estimated remaining: 4h 7m 50s. Rate: 9.4 symbols/min [2025-10-27T17:05:11.055179] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:11.094202] [DEBUG] [LOCAL ] AGCO: Loaded 42682 existing records from primary storage. [2025-10-27T17:05:11.094501] [INFO ] [MAIN ] AGCO: Loaded 42682 existing records. [2025-10-27T17:05:11.269531] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:11.269764] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-27T17:05:11.269817] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-27T17:05:11.269987] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-27T17:05:11.270031] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-27T17:05:11.626713] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:11.620959] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-27T17:05:12.399712] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:05:12.414914] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-27T17:05:13.214994] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-27T17:05:13.496444] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:05:13.770565] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:05:14.014928] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-27T17:05:14.050957] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T17:05:14.814934] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-27T17:05:15.614949] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-27T17:05:16.296827] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T17:05:16.414960] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-27T17:05:16.799383] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T17:05:17.213492] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-27T17:05:17.223772] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-27T17:05:17.704438] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T17:05:17.855165] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:05:18.015069] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-27T17:05:18.815023] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-27T17:05:19.614947] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-27T17:05:20.066702] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T17:05:20.175559] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T17:05:20.235901] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T17:05:20.414981] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-27T17:05:20.887526] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T17:05:20.888501] [INFO ] [REMOTE ] AFGC: Full fetch complete (3571 records). [2025-10-27T17:05:20.888573] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-27T17:05:21.220516] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-27T17:05:21.244764] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-27T17:05:21.244836] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-27T17:05:21.244965] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-27T17:05:21.245004] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-27T17:05:21.245376] [DEBUG] [LOCAL ] AFGC: Trimmed 3571 records to 2550 (keeping 200 days of data) [2025-10-27T17:05:21.268352] [DEBUG] [LOCAL ] AFGC: Primary data saved (2550 records). [2025-10-27T17:05:21.268447] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-27T17:05:21.268527] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGC took 36.9s. Estimated remaining: 4h 10m 51s. Rate: 9.2 symbols/min [2025-10-27T17:05:21.440719] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:21.459930] [DEBUG] [LOCAL ] AGD: Loaded 19455 existing records from primary storage. [2025-10-27T17:05:21.460199] [INFO ] [MAIN ] AGD: Loaded 19455 existing records. [2025-10-27T17:05:21.654752] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:21.655031] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-27T17:05:21.655106] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-27T17:05:21.655344] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-27T17:05:21.655415] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-27T17:05:22.020273] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-27T17:05:22.102226] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:22.809161] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:05:22.819290] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-27T17:05:23.614927] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-27T17:05:23.934915] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T17:05:24.414931] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-27T17:05:24.901526] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T17:05:25.215005] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-27T17:05:25.573040] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:05:25.676170] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:05:26.015000] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-27T17:05:26.815089] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-27T17:05:27.615019] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-27T17:05:27.788396] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-27T17:05:28.013823] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:05:28.131633] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:05:28.237574] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:05:28.414996] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-27T17:05:29.214945] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-27T17:05:29.797940] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:05:30.014932] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-27T17:05:30.814939] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-27T17:05:31.231103] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T17:05:31.620174] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-27T17:05:31.631869] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:05:32.415008] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-27T17:05:32.830213] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:05:33.214944] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-27T17:05:33.257179] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T17:05:33.267276] [INFO ] [REMOTE ] AFL: Full fetch complete (77068 records). [2025-10-27T17:05:33.267394] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-27T17:05:33.695111] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-27T17:05:33.695226] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-27T17:05:33.696171] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-27T17:05:33.696257] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-27T17:05:33.697815] [DEBUG] [LOCAL ] AFL: Trimmed 77068 records to 53160 (keeping 200 days of data) [2025-10-27T17:05:33.972536] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:05:34.017757] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-27T17:05:34.064573] [DEBUG] [LOCAL ] AFL: Primary data saved (53160 records). [2025-10-27T17:05:34.064764] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-27T17:05:34.064855] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 29.6s. Estimated remaining: 4h 15m 36s. Rate: 9.1 symbols/min [2025-10-27T17:05:34.232781] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:34.280906] [DEBUG] [LOCAL ] AGI: Loaded 54201 existing records from primary storage. [2025-10-27T17:05:34.281313] [INFO ] [MAIN ] AGI: Loaded 54201 existing records. [2025-10-27T17:05:34.479396] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:34.479591] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-27T17:05:34.479637] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-27T17:05:34.479850] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-27T17:05:34.479896] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-27T17:05:34.841211] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:34.834975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-27T17:05:34.850579] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T17:05:34.926094] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T17:05:35.615032] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-27T17:05:36.267232] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:05:36.414929] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-27T17:05:37.214942] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-27T17:05:37.312528] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T17:05:37.493778] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:05:38.014957] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-27T17:05:38.494280] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:05:38.814936] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-27T17:05:39.614956] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-27T17:05:40.287718] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:05:40.414940] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-27T17:05:41.008948] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:05:41.079443] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (3.06 seconds). [2025-10-27T17:05:41.089582] [INFO ] [REMOTE ] AG: Full fetch complete (77792 records). [2025-10-27T17:05:41.089731] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-27T17:05:41.227734] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-27T17:05:41.500700] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-27T17:05:41.500782] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-27T17:05:41.501500] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-27T17:05:41.501562] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-27T17:05:41.502972] [DEBUG] [LOCAL ] AG: Trimmed 77792 records to 53643 (keeping 200 days of data) [2025-10-27T17:05:41.823693] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-27T17:05:41.823872] [INFO ] [MAIN ] AG: Full history saved. [2025-10-27T17:05:41.824906] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AG took 35.8s. Estimated remaining: 4h 16m 21s. Rate: 9.0 symbols/min [2025-10-27T17:05:42.000999] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:42.014945] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-27T17:05:42.052904] [DEBUG] [LOCAL ] AGL: Loaded 53365 existing records from primary storage. [2025-10-27T17:05:42.053329] [INFO ] [MAIN ] AGL: Loaded 53365 existing records. [2025-10-27T17:05:42.197052] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:05:42.246480] [INFO ] [REMOTE ] AGCO: Full fetch complete (61497 records). [2025-10-27T17:05:42.263057] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-27T17:05:42.269127] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:42.269416] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-27T17:05:42.269479] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-27T17:05:42.269828] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-27T17:05:42.269905] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-27T17:05:42.976373] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:43.026313] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-27T17:05:43.074873] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-27T17:05:43.075054] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-27T17:05:43.075816] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-27T17:05:43.075921] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-27T17:05:43.103724] [DEBUG] [LOCAL ] AGCO: Trimmed 61497 records to 41854 (keeping 200 days of data) [2025-10-27T17:05:43.106851] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:05:43.367388] [DEBUG] [LOCAL ] AGCO: Primary data saved (41854 records). [2025-10-27T17:05:43.367536] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-27T17:05:43.368186] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AGCO took 32.5s. Estimated remaining: 4h 12m 28s. Rate: 9.2 symbols/min [2025-10-27T17:05:43.511997] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:05:43.562305] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:05:43.574342] [DEBUG] [LOCAL ] AGM: Loaded 10702 existing records from primary storage. [2025-10-27T17:05:43.574565] [INFO ] [MAIN ] AGM: Loaded 10702 existing records. [2025-10-27T17:05:43.620171] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-27T17:05:43.774020] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:05:43.774223] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-27T17:05:43.774272] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-27T17:05:43.774436] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-27T17:05:43.774492] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-27T17:05:44.151350] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:05:44.414939] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-27T17:05:44.824582] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T17:05:45.062262] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T17:05:45.227176] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-27T17:05:45.233014] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:05:45.962323] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T17:05:46.014969] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-27T17:05:46.774183] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T17:05:46.814955] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-27T17:05:47.614979] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-27T17:05:48.394519] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:05:48.414914] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-27T17:05:49.214910] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-27T17:05:49.550688] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T17:05:49.633734] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:05:50.014929] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-27T17:05:50.806237] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:05:50.815372] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-27T17:05:51.511311] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:05:51.614912] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-27T17:05:52.414951] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-27T17:05:52.632719] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:05:52.969525] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:05:53.174431] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-27T17:05:53.214971] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-27T17:05:54.014989] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-27T17:05:54.654637] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:05:54.814919] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-27T17:05:55.615027] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-27T17:05:55.726151] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:05:56.219527] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:05:56.231676] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T17:05:56.414958] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-27T17:05:57.214993] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-27T17:05:57.823785] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:05:58.014984] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-27T17:05:58.375387] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:05:58.815000] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-27T17:05:59.614958] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-27T17:05:59.824148] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T17:06:00.414919] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-27T17:06:00.541333] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:06:00.548158] [INFO ] [REMOTE ] AGD: Full fetch complete (26515 records). [2025-10-27T17:06:00.548285] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-27T17:06:00.936290] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-27T17:06:00.936368] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-27T17:06:00.936714] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-27T17:06:00.936777] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-27T17:06:00.937486] [DEBUG] [LOCAL ] AGD: Trimmed 26515 records to 19100 (keeping 200 days of data) [2025-10-27T17:06:01.048834] [DEBUG] [LOCAL ] AGD: Primary data saved (19100 records). [2025-10-27T17:06:01.048977] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-27T17:06:01.049061] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AGD took 39.8s. Estimated remaining: 4h 20m 27s. Rate: 8.9 symbols/min [2025-10-27T17:06:01.217001] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:01.215454] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-27T17:06:01.244029] [DEBUG] [LOCAL ] AGO: Loaded 28041 existing records from primary storage. [2025-10-27T17:06:01.244305] [INFO ] [MAIN ] AGO: Loaded 28041 existing records. [2025-10-27T17:06:01.428966] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:01.429292] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-27T17:06:01.429341] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-27T17:06:01.429544] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-27T17:06:01.429600] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-27T17:06:01.792685] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:01.825841] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T17:06:02.014919] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-27T17:06:02.815004] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-27T17:06:03.204031] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:06:03.614942] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-27T17:06:04.194981] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:06:04.414914] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-27T17:06:04.516797] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-27T17:06:04.749059] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:06:05.039534] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (4.62 seconds). [2025-10-27T17:06:05.049262] [INFO ] [REMOTE ] AGI: Full fetch complete (76961 records). [2025-10-27T17:06:05.049391] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-27T17:06:05.050212] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:05.050305] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:05.050348] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:05.050386] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-27T17:06:05.050457] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-27T17:06:05.050529] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-27T17:06:05.050723] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-27T17:06:05.052509] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 31.0s. Estimated remaining: 4h 18m 23s. Rate: 8.9 symbols/min [2025-10-27T17:06:05.226666] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-27T17:06:05.229224] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:05.267482] [DEBUG] [LOCAL ] AGRO: Loaded 32912 existing records from primary storage. [2025-10-27T17:06:05.267785] [INFO ] [MAIN ] AGRO: Loaded 32912 existing records. [2025-10-27T17:06:05.445594] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:05.445814] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-27T17:06:05.445861] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-27T17:06:05.446202] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-27T17:06:05.446280] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-27T17:06:05.845624] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:05.856791] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T17:06:06.007862] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:06:06.014910] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-27T17:06:06.814926] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-27T17:06:06.990782] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:06:06.993312] [INFO ] [REMOTE ] AGM: Full fetch complete (13289 records). [2025-10-27T17:06:06.993382] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-27T17:06:07.350548] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-27T17:06:07.350861] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-27T17:06:07.351100] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-27T17:06:07.351141] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-27T17:06:07.351597] [DEBUG] [LOCAL ] AGM: Trimmed 13289 records to 10480 (keeping 200 days of data) [2025-10-27T17:06:07.416692] [DEBUG] [LOCAL ] AGM: Primary data saved (10480 records). [2025-10-27T17:06:07.416820] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-27T17:06:07.416900] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGM took 24.0s. Estimated remaining: 4h 15m 13s. Rate: 9.1 symbols/min [2025-10-27T17:06:07.584119] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:07.615961] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-27T17:06:07.617999] [DEBUG] [LOCAL ] AGX: Loaded 33012 existing records from primary storage. [2025-10-27T17:06:07.618291] [INFO ] [MAIN ] AGX: Loaded 33012 existing records. [2025-10-27T17:06:07.803327] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:07.803528] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-27T17:06:07.803573] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-27T17:06:07.804073] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-27T17:06:07.804132] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-27T17:06:08.185677] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:08.212863] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:06:08.414950] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-27T17:06:08.871584] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:06:09.214953] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-27T17:06:10.015026] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-27T17:06:10.445247] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:06:10.699046] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T17:06:10.814953] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-27T17:06:11.223359] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:06:11.614989] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-27T17:06:12.272163] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:06:12.414949] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-27T17:06:13.013303] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:06:13.214954] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-27T17:06:13.738202] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:06:14.014970] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-27T17:06:14.820868] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-27T17:06:14.834921] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:06:15.430449] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:06:15.614930] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-27T17:06:16.120110] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:06:16.414945] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-27T17:06:17.093398] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:06:17.149240] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:06:17.214950] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-27T17:06:18.014936] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-27T17:06:18.068493] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:06:18.814930] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-27T17:06:19.055260] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T17:06:19.614951] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-27T17:06:20.420396] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-27T17:06:20.440877] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:06:20.702898] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T17:06:21.215034] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-27T17:06:21.546896] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:06:22.014957] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-27T17:06:22.814919] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-27T17:06:23.168093] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:06:23.379193] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T17:06:23.614948] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-27T17:06:23.691461] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:06:24.415003] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-27T17:06:25.214974] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-27T17:06:25.264211] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:06:25.320245] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:06:26.015002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-27T17:06:26.526219] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:06:26.815003] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-27T17:06:27.181009] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:06:27.614947] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-27T17:06:28.415021] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-27T17:06:28.540973] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:06:28.550612] [INFO ] [REMOTE ] AGL: Full fetch complete (75614 records). [2025-10-27T17:06:28.550803] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-27T17:06:28.551563] [FATAL] [VALIDATOR ] AGL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:28.551670] [FATAL] [MAIN ] AGL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:28.551728] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:28.551769] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-27T17:06:28.551825] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-27T17:06:28.551869] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-10-27T17:06:28.551996] [DEBUG] [LOCAL ] AGL: Deleted derivative data file. [2025-10-27T17:06:28.552581] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGL took 46.7s. Estimated remaining: 4h 25m 5s. Rate: 8.7 symbols/min [2025-10-27T17:06:28.719146] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:28.757448] [DEBUG] [LOCAL ] AHH: Loaded 40649 existing records from primary storage. [2025-10-27T17:06:28.757797] [INFO ] [MAIN ] AHH: Loaded 40649 existing records. [2025-10-27T17:06:28.933330] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:28.933517] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-27T17:06:28.933563] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-27T17:06:28.933758] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-27T17:06:28.933814] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-27T17:06:29.219037] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-27T17:06:29.292893] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:29.313534] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T17:06:29.667586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:06:30.014990] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-27T17:06:30.814954] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-27T17:06:31.022132] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T17:06:31.540578] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:06:31.545957] [INFO ] [REMOTE ] AGX: Full fetch complete (48565 records). [2025-10-27T17:06:31.546046] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-27T17:06:31.546617] [FATAL] [VALIDATOR ] AGX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:06:31.546735] [FATAL] [MAIN ] AGX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:06:31.546815] [WARN ] [MAIN ] AGX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:06:31.546906] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-27T17:06:31.546987] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-27T17:06:31.547025] [INFO ] [LOCAL ] AGX: Starting deletion of derivative data. [2025-10-27T17:06:31.547142] [DEBUG] [LOCAL ] AGX: Deleted derivative data file. [2025-10-27T17:06:31.547211] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGX took 24.1s. Estimated remaining: 4h 22m 21s. Rate: 8.8 symbols/min [2025-10-27T17:06:31.620317] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-27T17:06:31.715551] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:31.715734] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-27T17:06:31.715782] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-27T17:06:31.715915] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-27T17:06:31.715972] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-27T17:06:31.716017] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-27T17:06:31.716051] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-27T17:06:32.094935] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:32.098074] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:06:32.414937] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-27T17:06:33.209012] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:06:33.217792] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-27T17:06:33.391534] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:06:33.396920] [INFO ] [REMOTE ] AGO: Full fetch complete (39694 records). [2025-10-27T17:06:33.397004] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-27T17:06:33.463966] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:06:33.480904] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-27T17:06:33.502159] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:06:33.502360] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-27T17:06:33.502750] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:06:33.508237] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-27T17:06:33.518593] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-27T17:06:33.523927] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-27T17:06:33.541148] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-27T17:06:33.557856] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 2.0s. Estimated remaining: 4h 19m 3s. Rate: 8.9 symbols/min [2025-10-27T17:06:33.921142] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:33.951727] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-27T17:06:33.951806] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-27T17:06:33.952225] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-27T17:06:33.952264] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-27T17:06:33.953249] [DEBUG] [LOCAL ] AGO: Trimmed 39694 records to 27300 (keeping 200 days of data) [2025-10-27T17:06:34.039692] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-27T17:06:34.130110] [DEBUG] [LOCAL ] AGO: Primary data saved (27300 records). [2025-10-27T17:06:34.143360] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-27T17:06:34.144379] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGO took 33.1s. Estimated remaining: 4h 14m 56s. Rate: 9.0 symbols/min [2025-10-27T17:06:34.216980] [DEBUG] [LOCAL ] AHR: Loaded 49637 existing records from primary storage. [2025-10-27T17:06:34.239393] [INFO ] [MAIN ] AHR: Loaded 49637 existing records. [2025-10-27T17:06:34.433838] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:34.528429] [DEBUG] [LOCAL ] AHT: Loaded 6490 existing records from primary storage. [2025-10-27T17:06:34.525162] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:34.528695] [INFO ] [MAIN ] AHT: Loaded 6490 existing records. [2025-10-27T17:06:34.597432] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-27T17:06:34.609945] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-27T17:06:34.638693] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-27T17:06:34.649320] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-27T17:06:34.803789] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:34.822840] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-27T17:06:34.815131] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-27T17:06:34.826098] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-27T17:06:34.827245] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-27T17:06:34.827617] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-27T17:06:35.389679] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:35.466895] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:35.517200] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:06:35.614904] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-27T17:06:35.751149] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:06:35.757150] [INFO ] [REMOTE ] AGRO: Full fetch complete (48705 records). [2025-10-27T17:06:35.757241] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-27T17:06:36.122222] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-27T17:06:36.122304] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-27T17:06:36.122841] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-27T17:06:36.122903] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-27T17:06:36.123931] [DEBUG] [LOCAL ] AGRO: Trimmed 48705 records to 32070 (keeping 200 days of data) [2025-10-27T17:06:36.318808] [DEBUG] [LOCAL ] AGRO: Primary data saved (32070 records). [2025-10-27T17:06:36.318948] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-27T17:06:36.319056] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGRO took 31.3s. Estimated remaining: 4h 11m 58s. Rate: 9.2 symbols/min [2025-10-27T17:06:36.416723] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-27T17:06:36.487302] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:36.539699] [DEBUG] [LOCAL ] AI: Loaded 54544 existing records from primary storage. [2025-10-27T17:06:36.540030] [INFO ] [MAIN ] AI: Loaded 54544 existing records. [2025-10-27T17:06:36.719543] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:36.719810] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-27T17:06:36.719861] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-27T17:06:36.720128] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-27T17:06:36.720166] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-27T17:06:37.081922] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:37.109014] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:06:37.214924] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-27T17:06:37.560443] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:06:38.015032] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-27T17:06:38.814944] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-27T17:06:39.095563] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:06:39.614994] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-27T17:06:40.212378] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T17:06:40.323618] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:06:40.414939] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-27T17:06:41.214966] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-27T17:06:41.273586] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:06:41.848565] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T17:06:41.972858] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:06:42.014953] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-27T17:06:42.814959] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-27T17:06:43.548274] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:06:43.614936] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-27T17:06:44.415056] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-27T17:06:44.687635] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:06:45.003907] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T17:06:45.214924] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-27T17:06:45.472383] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-27T17:06:45.700008] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T17:06:46.014983] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-27T17:06:46.814977] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-27T17:06:47.150952] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:06:47.614992] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-27T17:06:48.180826] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:06:48.414942] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-27T17:06:49.214927] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-27T17:06:49.369340] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:06:49.622923] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:06:50.014993] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-27T17:06:50.239780] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:06:50.814988] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-27T17:06:51.603018] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:06:51.614895] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-27T17:06:52.414973] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-27T17:06:52.743759] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:06:53.152755] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-27T17:06:53.214898] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-27T17:06:54.015022] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-27T17:06:54.163797] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:06:54.171187] [INFO ] [REMOTE ] AHH: Full fetch complete (59333 records). [2025-10-27T17:06:54.171317] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-27T17:06:54.547775] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-27T17:06:54.547854] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-27T17:06:54.548473] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-27T17:06:54.548521] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-27T17:06:54.549728] [DEBUG] [LOCAL ] AHH: Trimmed 59333 records to 39774 (keeping 200 days of data) [2025-10-27T17:06:54.787741] [DEBUG] [LOCAL ] AHH: Primary data saved (39774 records). [2025-10-27T17:06:54.787890] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-27T17:06:54.788866] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AHH took 26.2s. Estimated remaining: 4h 19m 21s. Rate: 8.9 symbols/min [2025-10-27T17:06:54.820773] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-27T17:06:54.984417] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:06:55.036284] [DEBUG] [LOCAL ] AIG: Loaded 54234 existing records from primary storage. [2025-10-27T17:06:55.036583] [INFO ] [MAIN ] AIG: Loaded 54234 existing records. [2025-10-27T17:06:55.247997] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:06:55.248428] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-27T17:06:55.248571] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-27T17:06:55.249018] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-27T17:06:55.249155] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-27T17:06:55.550489] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T17:06:55.634272] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:06:55.669225] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-27T17:06:55.701962] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:06:56.095699] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T17:06:56.414976] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-27T17:06:57.215030] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-27T17:06:57.869607] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:06:57.946711] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:06:58.014916] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-27T17:06:58.459967] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:06:58.814955] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-27T17:06:59.508992] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:06:59.614911] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-27T17:06:59.864136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T17:07:00.308448] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:07:00.415005] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-27T17:07:01.214951] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-27T17:07:02.014947] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-27T17:07:02.549296] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T17:07:02.551540] [INFO ] [REMOTE ] AHT: Full fetch complete (9033 records). [2025-10-27T17:07:02.551630] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-27T17:07:02.820227] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-27T17:07:03.041797] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-27T17:07:03.041949] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-27T17:07:03.042272] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-27T17:07:03.042328] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-27T17:07:03.043506] [DEBUG] [LOCAL ] AHT: Trimmed 9033 records to 6347 (keeping 200 days of data) [2025-10-27T17:07:03.091991] [DEBUG] [LOCAL ] AHT: Primary data saved (6347 records). [2025-10-27T17:07:03.092193] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-27T17:07:03.092297] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHT took 28.9s. Estimated remaining: 4h 20m 12s. Rate: 8.9 symbols/min [2025-10-27T17:07:03.395534] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:03.395834] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-27T17:07:03.395895] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-27T17:07:03.396034] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-27T17:07:03.396079] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-27T17:07:03.396122] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-27T17:07:03.396157] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-27T17:07:03.873307] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:03.874017] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-27T17:07:03.929098] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-27T17:07:04.119800] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:07:04.120156] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-27T17:07:04.120248] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:07:04.120295] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-27T17:07:04.120355] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:07:04.120427] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-27T17:07:04.120492] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-27T17:07:04.120529] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-27T17:07:04.120568] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-27T17:07:04.120613] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AII took 1.0s. Estimated remaining: 4h 16m 35s. Rate: 9.0 symbols/min [2025-10-27T17:07:04.298635] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:04.319597] [DEBUG] [LOCAL ] AIN: Loaded 24638 existing records from primary storage. [2025-10-27T17:07:04.319877] [INFO ] [MAIN ] AIN: Loaded 24638 existing records. [2025-10-27T17:07:04.416123] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-27T17:07:04.537794] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-27T17:07:04.558930] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:04.575690] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-27T17:07:04.575781] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-27T17:07:04.576057] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-27T17:07:04.576121] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-27T17:07:04.932815] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:05.214975] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-27T17:07:05.323210] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-27T17:07:05.862589] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:07:06.014938] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-27T17:07:06.814934] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-27T17:07:07.513752] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-27T17:07:07.610275] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:07:07.621937] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-27T17:07:07.914845] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T17:07:08.414935] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-27T17:07:09.214998] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-27T17:07:09.747854] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:07:10.020031] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-27T17:07:10.033586] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-27T17:07:10.043808] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-27T17:07:10.043933] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-27T17:07:10.430612] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-27T17:07:10.430733] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-27T17:07:10.431579] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-27T17:07:10.431768] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-27T17:07:10.433265] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53764 (keeping 200 days of data) [2025-10-27T17:07:10.648396] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:07:10.760625] [DEBUG] [LOCAL ] AI: Primary data saved (53764 records). [2025-10-27T17:07:10.760807] [INFO ] [MAIN ] AI: Full history saved. [2025-10-27T17:07:10.763309] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AI took 34.4s. Estimated remaining: 4h 16m 27s. Rate: 9.0 symbols/min [2025-10-27T17:07:10.820075] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-27T17:07:10.940106] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:10.955812] [DEBUG] [LOCAL ] AIO: Loaded 13183 existing records from primary storage. [2025-10-27T17:07:10.956044] [INFO ] [MAIN ] AIO: Loaded 13183 existing records. [2025-10-27T17:07:11.137404] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:11.137623] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-27T17:07:11.137711] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-27T17:07:11.137882] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-27T17:07:11.137921] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-27T17:07:11.514502] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:11.615366] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-27T17:07:11.616837] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T17:07:12.391912] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:07:12.414902] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-27T17:07:12.821503] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:07:13.214961] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-27T17:07:14.015042] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-27T17:07:14.241461] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T17:07:14.585390] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:07:14.594804] [INFO ] [REMOTE ] AHR: Full fetch complete (70486 records). [2025-10-27T17:07:14.594947] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-27T17:07:14.595717] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:07:14.595815] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:07:14.595856] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:07:14.595893] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-27T17:07:14.595949] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-27T17:07:14.595984] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-27T17:07:14.596126] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-27T17:07:14.596196] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AHR took 41.0s. Estimated remaining: 4h 14m 40s. Rate: 9.0 symbols/min [2025-10-27T17:07:14.762628] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:14.789784] [DEBUG] [LOCAL ] AIR: Loaded 29010 existing records from primary storage. [2025-10-27T17:07:14.790019] [INFO ] [MAIN ] AIR: Loaded 29010 existing records. [2025-10-27T17:07:14.820380] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-27T17:07:14.965952] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:14.966149] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-27T17:07:14.966195] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-27T17:07:14.966368] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-27T17:07:14.966405] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-27T17:07:15.316257] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:15.614991] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-27T17:07:15.766601] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:07:16.046216] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T17:07:16.414953] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-27T17:07:16.551117] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:07:17.214959] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-27T17:07:18.014998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-27T17:07:18.118895] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:07:18.227974] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T17:07:18.576898] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:07:18.814954] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-27T17:07:19.614970] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-27T17:07:19.895909] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:07:20.414972] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-27T17:07:20.462986] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:07:21.214967] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-27T17:07:21.943629] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:07:22.014939] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-27T17:07:22.483947] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:07:22.814951] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-27T17:07:23.615246] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-27T17:07:23.615153] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:07:23.979976] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:07:24.414952] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-27T17:07:24.790386] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T17:07:25.214934] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-27T17:07:25.654961] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:07:26.015005] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-27T17:07:26.364134] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:07:26.814951] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-27T17:07:27.517202] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:07:27.614968] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-27T17:07:27.903162] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:07:28.415018] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-27T17:07:29.004393] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T17:07:29.027949] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T17:07:29.214969] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-27T17:07:30.015054] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-27T17:07:30.457564] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:07:30.814964] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-27T17:07:30.827196] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:07:31.614979] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-27T17:07:31.932184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:07:31.942718] [INFO ] [REMOTE ] AIG: Full fetch complete (77560 records). [2025-10-27T17:07:31.942885] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-27T17:07:32.355607] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-27T17:07:32.363335] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-27T17:07:32.364939] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T17:07:32.364592] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-27T17:07:32.367783] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-27T17:07:32.369479] [DEBUG] [LOCAL ] AIG: Trimmed 77560 records to 53450 (keeping 200 days of data) [2025-10-27T17:07:32.424316] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-27T17:07:32.694738] [DEBUG] [LOCAL ] AIG: Primary data saved (53450 records). [2025-10-27T17:07:32.694873] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-27T17:07:32.695849] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AIG took 37.9s. Estimated remaining: 4h 21m 12s. Rate: 8.8 symbols/min [2025-10-27T17:07:32.882431] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:32.911686] [DEBUG] [LOCAL ] AIT: Loaded 26948 existing records from primary storage. [2025-10-27T17:07:32.911949] [INFO ] [MAIN ] AIT: Loaded 26948 existing records. [2025-10-27T17:07:33.085498] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:33.085718] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-27T17:07:33.085785] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-27T17:07:33.086085] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-27T17:07:33.086158] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-27T17:07:33.222213] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-27T17:07:33.447941] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:33.588869] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T17:07:33.592072] [INFO ] [REMOTE ] AIO: Full fetch complete (20060 records). [2025-10-27T17:07:33.592159] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-27T17:07:33.951024] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-27T17:07:33.951244] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-27T17:07:33.951558] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-27T17:07:33.951724] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-27T17:07:33.952607] [DEBUG] [LOCAL ] AIO: Trimmed 20060 records to 12787 (keeping 200 days of data) [2025-10-27T17:07:34.003862] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:07:34.020804] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-27T17:07:34.048535] [DEBUG] [LOCAL ] AIO: Primary data saved (12787 records). [2025-10-27T17:07:34.048676] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-27T17:07:34.048771] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIO took 23.3s. Estimated remaining: 4h 17m 58s. Rate: 8.9 symbols/min [2025-10-27T17:07:34.223337] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:34.261135] [DEBUG] [LOCAL ] AIV: Loaded 42538 existing records from primary storage. [2025-10-27T17:07:34.261420] [INFO ] [MAIN ] AIV: Loaded 42538 existing records. [2025-10-27T17:07:34.440569] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:34.440778] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-27T17:07:34.440827] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-27T17:07:34.441008] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-27T17:07:34.441054] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-27T17:07:34.785950] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:34.814984] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-27T17:07:34.981505] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T17:07:35.614962] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-27T17:07:36.039244] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:07:36.044808] [INFO ] [REMOTE ] AIN: Full fetch complete (33752 records). [2025-10-27T17:07:36.045011] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-27T17:07:36.427271] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-27T17:07:36.442624] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-27T17:07:36.442765] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-27T17:07:36.443296] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-27T17:07:36.443409] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-27T17:07:36.444563] [DEBUG] [LOCAL ] AIN: Trimmed 33752 records to 24135 (keeping 200 days of data) [2025-10-27T17:07:36.594976] [DEBUG] [LOCAL ] AIN: Primary data saved (24135 records). [2025-10-27T17:07:36.595164] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-27T17:07:36.595268] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIN took 32.5s. Estimated remaining: 4h 15m 30s. Rate: 9.0 symbols/min [2025-10-27T17:07:36.769828] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:36.799721] [DEBUG] [LOCAL ] AIZ: Loaded 29600 existing records from primary storage. [2025-10-27T17:07:36.800149] [INFO ] [MAIN ] AIZ: Loaded 29600 existing records. [2025-10-27T17:07:36.987274] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:36.987600] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-27T17:07:36.987683] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-27T17:07:36.987922] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-27T17:07:36.987979] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-27T17:07:37.217929] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-27T17:07:37.375782] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T17:07:37.397666] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:37.729922] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:07:38.014963] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-27T17:07:38.814916] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-27T17:07:38.928822] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T17:07:39.033226] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T17:07:39.614948] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-27T17:07:40.029842] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T17:07:40.414927] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-27T17:07:40.567964] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:07:41.214966] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-27T17:07:41.543885] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:07:42.014990] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-27T17:07:42.559260] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T17:07:42.814978] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-27T17:07:43.371166] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:07:43.614943] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-27T17:07:44.414989] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-27T17:07:44.443894] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:07:44.471458] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-27T17:07:45.214978] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-27T17:07:45.835794] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:07:46.014957] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-27T17:07:46.138481] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T17:07:46.814945] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-27T17:07:47.105934] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:07:47.614989] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-27T17:07:48.099065] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:07:48.414937] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-27T17:07:48.816486] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:07:49.214946] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-27T17:07:49.470608] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T17:07:50.014944] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-27T17:07:50.186196] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:07:50.814953] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-27T17:07:50.984468] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:07:51.614939] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-27T17:07:51.709922] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:07:52.414936] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-27T17:07:52.850552] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:07:53.214936] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-27T17:07:53.504506] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T17:07:54.014949] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-27T17:07:54.130430] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:07:54.814923] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-27T17:07:55.155794] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T17:07:55.614940] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-27T17:07:56.380719] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:07:56.390688] [INFO ] [REMOTE ] AIR: Full fetch complete (40217 records). [2025-10-27T17:07:56.390869] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-27T17:07:56.423660] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-27T17:07:56.785536] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-27T17:07:56.785612] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-27T17:07:56.786093] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-27T17:07:56.786170] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-27T17:07:56.787067] [DEBUG] [LOCAL ] AIR: Trimmed 40217 records to 28344 (keeping 200 days of data) [2025-10-27T17:07:56.953384] [DEBUG] [LOCAL ] AIR: Primary data saved (28344 records). [2025-10-27T17:07:56.953514] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-27T17:07:56.953965] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIR took 42.4s. Estimated remaining: 4h 22m 59s. Rate: 8.7 symbols/min [2025-10-27T17:07:57.119071] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T17:07:57.157033] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:07:57.168012] [DEBUG] [LOCAL ] AIZN: Loaded 3851 existing records from primary storage. [2025-10-27T17:07:57.168240] [INFO ] [MAIN ] AIZN: Loaded 3851 existing records. [2025-10-27T17:07:57.222224] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-27T17:07:57.351211] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:07:57.351412] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-27T17:07:57.351461] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-27T17:07:57.351582] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-27T17:07:57.351623] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-27T17:07:57.730318] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:07:57.981703] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:07:58.014942] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-27T17:07:58.525504] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:07:58.814936] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-27T17:07:59.522255] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:07:59.614975] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-27T17:08:00.209367] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:08:00.214569] [INFO ] [REMOTE ] AIZ: Full fetch complete (42690 records). [2025-10-27T17:08:00.214745] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-27T17:08:00.420127] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-27T17:08:00.605908] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-27T17:08:00.606022] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-27T17:08:00.606695] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-27T17:08:00.606763] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-27T17:08:00.608314] [DEBUG] [LOCAL ] AIZ: Trimmed 42690 records to 28903 (keeping 200 days of data) [2025-10-27T17:08:00.796126] [DEBUG] [LOCAL ] AIZ: Primary data saved (28903 records). [2025-10-27T17:08:00.796325] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-27T17:08:00.796423] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIZ took 24.2s. Estimated remaining: 4h 21m 13s. Rate: 8.8 symbols/min [2025-10-27T17:08:00.978554] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:01.031460] [DEBUG] [LOCAL ] AJG: Loaded 47015 existing records from primary storage. [2025-10-27T17:08:01.031945] [INFO ] [MAIN ] AJG: Loaded 47015 existing records. [2025-10-27T17:08:01.221602] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-27T17:08:01.228684] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:01.230136] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-27T17:08:01.230214] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-27T17:08:01.230505] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-27T17:08:01.230564] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-27T17:08:01.678268] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:01.898252] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:08:01.908209] [INFO ] [REMOTE ] AIV: Full fetch complete (60392 records). [2025-10-27T17:08:01.908338] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-27T17:08:02.020015] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-27T17:08:02.321703] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-27T17:08:02.322245] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-27T17:08:02.322747] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:08:02.323383] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-27T17:08:02.328540] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-27T17:08:02.329831] [DEBUG] [LOCAL ] AIV: Trimmed 60392 records to 41782 (keeping 200 days of data) [2025-10-27T17:08:02.562785] [DEBUG] [LOCAL ] AIV: Primary data saved (41782 records). [2025-10-27T17:08:02.562904] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-27T17:08:02.564007] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIV took 28.5s. Estimated remaining: 4h 18m 22s. Rate: 8.9 symbols/min [2025-10-27T17:08:02.727397] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:02.727565] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-27T17:08:02.727606] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-27T17:08:02.727738] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-27T17:08:02.727780] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-27T17:08:02.727821] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-27T17:08:02.727862] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-27T17:08:02.820117] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-27T17:08:03.083738] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:03.614982] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-27T17:08:03.641398] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:08:04.045046] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:08:04.126195] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T17:08:04.128019] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T17:08:04.414945] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-27T17:08:05.214953] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-27T17:08:05.540334] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:08:06.014891] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-27T17:08:06.494907] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T17:08:06.499622] [INFO ] [REMOTE ] AIT: Full fetch complete (38969 records). [2025-10-27T17:08:06.499780] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-27T17:08:06.793197] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:08:06.820088] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-27T17:08:06.887846] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-27T17:08:06.887929] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-27T17:08:06.888374] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-27T17:08:06.888419] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-27T17:08:06.889405] [DEBUG] [LOCAL ] AIT: Trimmed 38969 records to 26203 (keeping 200 days of data) [2025-10-27T17:08:07.051452] [DEBUG] [LOCAL ] AIT: Primary data saved (26203 records). [2025-10-27T17:08:07.051625] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-27T17:08:07.051745] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIT took 34.4s. Estimated remaining: 4h 17m 3s. Rate: 8.9 symbols/min [2025-10-27T17:08:07.216830] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:07.259822] [DEBUG] [LOCAL ] AKR: Loaded 46704 existing records from primary storage. [2025-10-27T17:08:07.260129] [INFO ] [MAIN ] AKR: Loaded 46704 existing records. [2025-10-27T17:08:07.432737] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:07.432894] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-27T17:08:07.432938] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-27T17:08:07.433142] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-27T17:08:07.433197] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-27T17:08:07.620075] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-27T17:08:07.784798] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:08.199946] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:08:08.362976] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T17:08:08.415006] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-27T17:08:09.214983] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-27T17:08:09.688326] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:08:10.014950] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-27T17:08:10.814988] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-27T17:08:11.015326] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:08:11.234137] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:08:11.251925] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:08:11.614947] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-27T17:08:12.081937] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-27T17:08:12.415059] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-27T17:08:13.215007] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-27T17:08:13.517197] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-27T17:08:13.696890] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:08:14.014930] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-27T17:08:14.768724] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T17:08:14.814918] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-27T17:08:15.614965] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-27T17:08:15.662103] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:08:16.414954] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-27T17:08:16.785139] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:08:16.972149] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T17:08:17.214975] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-27T17:08:17.496999] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-27T17:08:18.014979] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-27T17:08:18.631181] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T17:08:18.814950] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-27T17:08:19.614940] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-27T17:08:19.893567] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-27T17:08:20.414937] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-27T17:08:20.579252] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T17:08:20.672895] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T17:08:21.214931] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-27T17:08:21.757031] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T17:08:21.758504] [INFO ] [REMOTE ] AKA: Full fetch complete (2846 records). [2025-10-27T17:08:21.758572] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-27T17:08:21.937910] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T17:08:21.938126] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:08:21.938194] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:08:21.938265] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-27T17:08:21.938327] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-27T17:08:21.938363] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-27T17:08:21.938400] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-27T17:08:21.938465] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AKA took 19.4s. Estimated remaining: 4h 21m 13s. Rate: 8.8 symbols/min [2025-10-27T17:08:22.020101] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-27T17:08:22.106182] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:22.148194] [DEBUG] [LOCAL ] AL: Loaded 45506 existing records from primary storage. [2025-10-27T17:08:22.148504] [INFO ] [MAIN ] AL: Loaded 45506 existing records. [2025-10-27T17:08:22.323951] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:22.324429] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-27T17:08:22.324483] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-27T17:08:22.324939] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-27T17:08:22.324996] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-27T17:08:22.692962] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:22.814930] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-27T17:08:23.614998] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-27T17:08:23.971344] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T17:08:24.171487] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:08:24.354392] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-27T17:08:24.414930] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-27T17:08:25.214959] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-27T17:08:25.776079] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T17:08:26.014934] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-27T17:08:26.814916] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-27T17:08:26.915314] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:08:27.380420] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T17:08:27.620055] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-27T17:08:27.638063] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:08:28.414954] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-27T17:08:28.861957] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:08:29.214944] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-27T17:08:29.908739] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:08:30.014985] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-27T17:08:30.242953] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:08:30.814997] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-27T17:08:31.201416] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:08:31.614975] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-27T17:08:32.263753] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:08:32.414946] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-27T17:08:33.215009] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-27T17:08:33.692539] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-27T17:08:33.808927] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:08:33.836832] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:08:34.014916] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-27T17:08:34.815011] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-27T17:08:35.168204] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:08:35.252875] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T17:08:35.254165] [INFO ] [REMOTE ] AIZN: Full fetch complete (5720 records). [2025-10-27T17:08:35.254234] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-27T17:08:35.608502] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-27T17:08:35.608581] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-27T17:08:35.608779] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-27T17:08:35.608843] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-27T17:08:35.609229] [DEBUG] [LOCAL ] AIZN: Trimmed 5720 records to 3678 (keeping 200 days of data) [2025-10-27T17:08:35.620379] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-27T17:08:35.634936] [DEBUG] [LOCAL ] AIZN: Primary data saved (3678 records). [2025-10-27T17:08:35.635059] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-27T17:08:35.635141] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AIZN took 38.7s. Estimated remaining: 4h 24m 39s. Rate: 8.7 symbols/min [2025-10-27T17:08:35.807024] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:35.864465] [DEBUG] [LOCAL ] ALB: Loaded 54142 existing records from primary storage. [2025-10-27T17:08:35.864836] [INFO ] [MAIN ] ALB: Loaded 54142 existing records. [2025-10-27T17:08:36.040719] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:36.040930] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-27T17:08:36.040996] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-27T17:08:36.041197] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-27T17:08:36.041236] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-27T17:08:36.386091] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:36.414930] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-27T17:08:37.184275] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:08:37.214936] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-27T17:08:37.825245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:08:38.014984] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-27T17:08:38.814966] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-27T17:08:39.087006] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T17:08:39.283351] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:08:39.614997] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-27T17:08:39.894407] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:08:40.414978] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-27T17:08:40.837890] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:08:40.846600] [INFO ] [REMOTE ] AKR: Full fetch complete (65419 records). [2025-10-27T17:08:40.846741] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-27T17:08:41.231219] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-27T17:08:41.227908] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-27T17:08:41.232518] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-27T17:08:41.233369] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-27T17:08:41.233537] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-27T17:08:41.234867] [DEBUG] [LOCAL ] AKR: Trimmed 65419 records to 45897 (keeping 200 days of data) [2025-10-27T17:08:41.511116] [DEBUG] [LOCAL ] AKR: Primary data saved (45897 records). [2025-10-27T17:08:41.511260] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-27T17:08:41.512247] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKR took 34.5s. Estimated remaining: 4h 23m 60s. Rate: 8.7 symbols/min [2025-10-27T17:08:41.691626] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:41.765577] [DEBUG] [LOCAL ] ALC: Loaded 51966 existing records from primary storage. [2025-10-27T17:08:41.764440] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:08:41.775345] [INFO ] [MAIN ] ALC: Loaded 51966 existing records. [2025-10-27T17:08:41.955733] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:41.955987] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-27T17:08:41.956037] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-27T17:08:41.956238] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-27T17:08:41.956277] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-27T17:08:42.020200] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-27T17:08:42.330971] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:42.719681] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:08:42.815005] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-27T17:08:43.346524] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:08:43.355246] [INFO ] [REMOTE ] AJG: Full fetch complete (68703 records). [2025-10-27T17:08:43.355361] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-27T17:08:43.620572] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-27T17:08:43.813773] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-27T17:08:43.813912] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-27T17:08:43.814967] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-27T17:08:43.815038] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-27T17:08:43.817141] [DEBUG] [LOCAL ] AJG: Trimmed 68703 records to 46202 (keeping 200 days of data) [2025-10-27T17:08:44.188670] [DEBUG] [LOCAL ] AJG: Primary data saved (46202 records). [2025-10-27T17:08:44.189014] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-27T17:08:44.190042] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AJG took 43.4s. Estimated remaining: 4h 21m 45s. Rate: 8.7 symbols/min [2025-10-27T17:08:44.222977] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:08:44.419945] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-27T17:08:44.422692] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:08:44.471217] [DEBUG] [LOCAL ] ALE: Loaded 32460 existing records from primary storage. [2025-10-27T17:08:44.471702] [INFO ] [MAIN ] ALE: Loaded 32460 existing records. [2025-10-27T17:08:44.702957] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:08:44.703288] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-27T17:08:44.703362] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-27T17:08:44.703691] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-27T17:08:44.703776] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-27T17:08:45.148532] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:08:45.220069] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-27T17:08:45.242338] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:08:45.964223] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:08:46.014897] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-27T17:08:46.814952] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-27T17:08:47.388457] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-27T17:08:47.614995] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-27T17:08:47.896001] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:08:47.906315] [INFO ] [REMOTE ] AL: Full fetch complete (63880 records). [2025-10-27T17:08:47.906535] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-27T17:08:48.325794] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:08:48.361388] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-27T17:08:48.361504] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-27T17:08:48.362719] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-27T17:08:48.362804] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-27T17:08:48.364901] [DEBUG] [LOCAL ] AL: Trimmed 63880 records to 44745 (keeping 200 days of data) [2025-10-27T17:08:48.421416] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-27T17:08:48.648323] [DEBUG] [LOCAL ] AL: Primary data saved (44745 records). [2025-10-27T17:08:48.648540] [INFO ] [MAIN ] AL: Full history saved. [2025-10-27T17:08:48.649016] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AL took 26.7s. Estimated remaining: 4h 20m 27s. Rate: 8.8 symbols/min [2025-10-27T17:08:49.214963] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-27T17:08:49.304141] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:08:50.014994] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-27T17:08:50.339853] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T17:08:50.364886] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:08:50.815001] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-27T17:08:51.614986] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-27T17:08:51.735279] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:08:52.415158] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-27T17:08:52.421283] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:08:52.535760] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:08:53.214994] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-27T17:08:54.014966] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-27T17:08:54.462611] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T17:08:54.722071] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:08:54.814992] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-27T17:08:55.499504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:08:55.614933] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-27T17:08:56.414943] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-27T17:08:56.793281] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:08:56.858128] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:08:57.214946] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-27T17:08:58.014959] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-27T17:08:58.436620] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:08:58.814968] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-27T17:08:59.267473] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T17:08:59.311375] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-27T17:08:59.614934] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-27T17:09:00.164996] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:09:00.415008] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-27T17:09:01.215002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-27T17:09:01.909986] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:09:02.014974] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-27T17:09:02.900792] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-27T17:09:02.913135] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-27T17:09:03.663323] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T17:09:03.672056] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-27T17:09:04.584751] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T17:09:04.595705] [INFO ] [REMOTE ] ALC: Full fetch complete (73584 records). [2025-10-27T17:09:04.595931] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-27T17:09:04.597088] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:09:04.597184] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:09:04.597230] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:09:04.597272] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-27T17:09:04.597338] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-27T17:09:04.597377] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-27T17:09:04.597703] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-27T17:09:04.598457] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALC took 23.1s. Estimated remaining: 4h 24m 48s. Rate: 8.6 symbols/min [2025-10-27T17:09:04.644819] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T17:09:04.656981] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-27T17:09:05.182312] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:09:05.214937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-27T17:09:06.910498] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-27T17:09:06.923409] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-27T17:09:06.999143] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:09:07.008230] [INFO ] [REMOTE ] ALE: Full fetch complete (44323 records). [2025-10-27T17:09:07.008453] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-27T17:09:07.413616] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-27T17:09:07.413742] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-27T17:09:07.414231] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-27T17:09:07.414273] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-27T17:09:07.415366] [DEBUG] [LOCAL ] ALE: Trimmed 44323 records to 31792 (keeping 200 days of data) [2025-10-27T17:09:07.606511] [DEBUG] [LOCAL ] ALE: Primary data saved (31792 records). [2025-10-27T17:09:07.606666] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-27T17:09:07.606765] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALE took 23.4s. Estimated remaining: 4h 22m 47s. Rate: 8.7 symbols/min [2025-10-27T17:09:09.526396] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-27T17:09:09.537372] [INFO ] [REMOTE ] ALB: Full fetch complete (77115 records). [2025-10-27T17:09:09.537599] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-27T17:09:09.954553] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-27T17:09:09.954695] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-27T17:09:09.955561] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-27T17:09:09.955609] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-27T17:09:09.957677] [DEBUG] [LOCAL ] ALB: Trimmed 77115 records to 53362 (keeping 200 days of data) [2025-10-27T17:09:10.309194] [DEBUG] [LOCAL ] ALB: Primary data saved (53362 records). [2025-10-27T17:09:10.309481] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-27T17:09:10.311968] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALB took 34.7s. Estimated remaining: 4h 20m 40s. Rate: 8.8 symbols/min [2025-10-27T17:09:11.027891] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.099446] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-27T17:09:11.118092] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-27T17:09:11.147811] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-27T17:09:11.172299] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-27T17:09:11.147488] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.172727] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-27T17:09:11.172133] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.173452] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-27T17:09:11.167034] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:11.305402] [DEBUG] [LOCAL ] ALG: Loaded 9813 existing records from primary storage. [2025-10-27T17:09:11.324782] [INFO ] [MAIN ] ALG: Loaded 9813 existing records. [2025-10-27T17:09:11.629884] [DEBUG] [LOCAL ] ALEX: Loaded 31192 existing records from primary storage. [2025-10-27T17:09:11.688599] [INFO ] [MAIN ] ALEX: Loaded 31192 existing records. [2025-10-27T17:09:11.722361] [DEBUG] [LOCAL ] ALIT: Loaded 53550 existing records from primary storage. [2025-10-27T17:09:11.828485] [INFO ] [MAIN ] ALIT: Loaded 53550 existing records. [2025-10-27T17:09:11.893086] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:11.928073] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-27T17:09:11.998950] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.100353] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.130299] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-27T17:09:12.223861] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-27T17:09:12.239471] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.245207] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.264331] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-27T17:09:12.264163] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-27T17:09:12.292478] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:09:12.371765] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-27T17:09:12.359814] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:12.372271] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-27T17:09:12.372179] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-27T17:09:12.359987] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-27T17:09:12.482700] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:09:12.482523] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-27T17:09:12.525381] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-27T17:09:12.536047] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-27T17:09:12.569007] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-27T17:09:12.530693] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:09:12.623742] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-27T17:09:12.683534] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-27T17:09:12.769906] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-27T17:09:12.873377] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-27T17:09:12.923689] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.6s. Estimated remaining: 4h 18m 34s. Rate: 8.8 symbols/min [2025-10-27T17:09:13.503768] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.576555] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:13.592793] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-27T17:09:13.618546] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.639886] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-27T17:09:13.734466] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:13.734973] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-27T17:09:13.789048] [DEBUG] [LOCAL ] ALK: Loaded 53867 existing records from primary storage. [2025-10-27T17:09:13.789567] [INFO ] [MAIN ] ALK: Loaded 53867 existing records. [2025-10-27T17:09:13.991040] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:13.991328] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-27T17:09:13.991381] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-27T17:09:13.991705] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-27T17:09:13.991764] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-27T17:09:14.371822] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:14.372227] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-27T17:09:14.480390] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T17:09:14.483928] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-27T17:09:15.086129] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:09:15.089375] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-27T17:09:15.364568] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:09:15.375055] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-27T17:09:15.452367] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:09:15.460885] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-27T17:09:15.978591] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T17:09:15.982308] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-27T17:09:16.208999] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:09:16.214505] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-27T17:09:16.335156] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:09:16.345925] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-27T17:09:16.877822] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T17:09:16.891762] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-27T17:09:16.946267] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:09:17.214997] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-27T17:09:17.591755] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:09:17.726027] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:09:17.972515] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:09:18.015029] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-27T17:09:18.814999] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-27T17:09:19.161525] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-27T17:09:19.614984] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-27T17:09:19.778404] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T17:09:19.882188] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T17:09:20.414969] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-27T17:09:20.724707] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T17:09:21.214945] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-27T17:09:21.384802] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:09:22.014960] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-27T17:09:22.814934] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-27T17:09:22.935031] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:09:23.315760] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T17:09:23.568293] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:09:23.614940] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-27T17:09:24.414939] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-27T17:09:24.847836] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:09:25.214944] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-27T17:09:25.758712] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-27T17:09:26.014943] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-27T17:09:26.662928] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-27T17:09:26.814931] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-27T17:09:26.881434] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:09:27.615011] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-27T17:09:28.205297] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:09:28.207234] [INFO ] [REMOTE ] ALG: Full fetch complete (15120 records). [2025-10-27T17:09:28.207302] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-27T17:09:28.422248] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-27T17:09:28.580350] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-27T17:09:28.580468] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-27T17:09:28.580839] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-27T17:09:28.580915] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-27T17:09:28.581703] [DEBUG] [LOCAL ] ALG: Trimmed 15120 records to 9543 (keeping 200 days of data) [2025-10-27T17:09:28.634617] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:09:28.677974] [DEBUG] [LOCAL ] ALG: Primary data saved (9543 records). [2025-10-27T17:09:28.678089] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-27T17:09:28.678160] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 18.3s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-27T17:09:28.845432] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:28.891841] [DEBUG] [LOCAL ] ALL: Loaded 50286 existing records from primary storage. [2025-10-27T17:09:28.892133] [INFO ] [MAIN ] ALL: Loaded 50286 existing records. [2025-10-27T17:09:29.067787] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:29.067935] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-27T17:09:29.067982] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-27T17:09:29.068216] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-27T17:09:29.068255] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-27T17:09:29.242342] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-27T17:09:29.424418] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:29.748603] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T17:09:30.014932] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-27T17:09:30.814923] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-27T17:09:31.211930] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T17:09:31.614952] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-27T17:09:31.775702] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:09:32.308953] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:09:32.414974] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-27T17:09:33.095335] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:09:33.214995] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-27T17:09:33.834088] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:09:34.014944] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-27T17:09:34.814944] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-27T17:09:34.992635] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T17:09:35.482471] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:09:35.614938] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-27T17:09:35.711767] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T17:09:36.414943] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-27T17:09:37.215004] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-27T17:09:37.410403] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:09:38.014969] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-27T17:09:38.131829] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:09:38.815000] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-27T17:09:38.891846] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T17:09:38.898058] [INFO ] [REMOTE ] ALEX: Full fetch complete (44566 records). [2025-10-27T17:09:38.898145] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-27T17:09:39.273378] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-27T17:09:39.273456] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-27T17:09:39.273959] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-27T17:09:39.274023] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-27T17:09:39.274956] [DEBUG] [LOCAL ] ALEX: Trimmed 44566 records to 30369 (keeping 200 days of data) [2025-10-27T17:09:39.455528] [DEBUG] [LOCAL ] ALEX: Primary data saved (30369 records). [2025-10-27T17:09:39.455681] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-27T17:09:39.455777] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALEX took 29.1s. Estimated remaining: 4h 24m 17s. Rate: 8.6 symbols/min [2025-10-27T17:09:39.621052] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-27T17:09:39.623505] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:39.665817] [DEBUG] [LOCAL ] ALLE: Loaded 44606 existing records from primary storage. [2025-10-27T17:09:39.666112] [INFO ] [MAIN ] ALLE: Loaded 44606 existing records. [2025-10-27T17:09:39.848742] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:39.848973] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-27T17:09:39.849128] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-27T17:09:39.858563] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-27T17:09:39.873187] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-27T17:09:39.943501] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T17:09:40.264633] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:40.293390] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:09:40.303692] [INFO ] [REMOTE ] ALIT: Full fetch complete (76618 records). [2025-10-27T17:09:40.303830] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-27T17:09:40.420125] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-27T17:09:40.695885] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-27T17:09:40.695959] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-27T17:09:40.696738] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-27T17:09:40.696802] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-27T17:09:40.698216] [DEBUG] [LOCAL ] ALIT: Trimmed 76618 records to 52760 (keeping 200 days of data) [2025-10-27T17:09:41.005943] [DEBUG] [LOCAL ] ALIT: Primary data saved (52760 records). [2025-10-27T17:09:41.006103] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-27T17:09:41.007323] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALIT took 30.7s. Estimated remaining: 4h 21m 43s. Rate: 8.7 symbols/min [2025-10-27T17:09:41.197054] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:09:41.218275] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-27T17:09:41.214394] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:41.283366] [DEBUG] [LOCAL ] ALLY: Loaded 53998 existing records from primary storage. [2025-10-27T17:09:41.283732] [INFO ] [MAIN ] ALLY: Loaded 53998 existing records. [2025-10-27T17:09:41.460444] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:41.460663] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-27T17:09:41.460724] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-27T17:09:41.461050] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-27T17:09:41.461087] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-27T17:09:41.817279] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:41.906526] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:09:42.014959] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-27T17:09:42.674388] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:09:42.814927] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-27T17:09:43.462315] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:09:43.614932] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-27T17:09:44.414830] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T17:09:44.414995] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-27T17:09:45.084155] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:09:45.214903] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-27T17:09:46.014975] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-27T17:09:46.452384] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:09:46.463273] [INFO ] [REMOTE ] ALK: Full fetch complete (77042 records). [2025-10-27T17:09:46.463446] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-27T17:09:46.817046] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-27T17:09:46.879702] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-27T17:09:46.879835] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-27T17:09:46.880811] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-27T17:09:46.880952] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-27T17:09:46.882674] [DEBUG] [LOCAL ] ALK: Trimmed 77042 records to 53087 (keeping 200 days of data) [2025-10-27T17:09:47.150118] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:09:47.236062] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-27T17:09:47.236203] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-27T17:09:47.236283] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALK took 34.3s. Estimated remaining: 4h 21m 19s. Rate: 8.7 symbols/min [2025-10-27T17:09:47.413063] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:09:47.452275] [DEBUG] [LOCAL ] ALSN: Loaded 43809 existing records from primary storage. [2025-10-27T17:09:47.452680] [INFO ] [MAIN ] ALSN: Loaded 43809 existing records. [2025-10-27T17:09:47.624290] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-27T17:09:47.626053] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:09:47.685577] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:09:47.685940] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-27T17:09:47.685989] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-27T17:09:47.686275] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-27T17:09:47.686360] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-27T17:09:48.048785] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:09:48.414983] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-27T17:09:48.867830] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T17:09:49.215755] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-27T17:09:49.220909] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:09:49.569086] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:09:50.014936] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-27T17:09:50.814930] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-27T17:09:51.327632] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T17:09:51.614945] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-27T17:09:51.811868] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T17:09:52.229059] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:09:52.414935] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-27T17:09:52.903099] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T17:09:53.215004] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-27T17:09:53.662615] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:09:54.014962] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-27T17:09:54.383378] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:09:54.814939] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-27T17:09:55.596966] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:09:55.614894] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-27T17:09:56.224563] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:09:56.414928] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-27T17:09:56.882279] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:09:57.214936] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-27T17:09:58.014993] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-27T17:09:58.294995] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:09:58.814951] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-27T17:09:59.367670] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-27T17:09:59.463209] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T17:09:59.614912] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-27T17:10:00.414973] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-27T17:10:00.630006] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:10:01.214935] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-27T17:10:01.775499] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T17:10:02.014938] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-27T17:10:02.814955] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-27T17:10:03.401028] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-27T17:10:03.615001] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-27T17:10:04.362915] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:10:04.414963] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-27T17:10:05.077792] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (3.86 seconds). [2025-10-27T17:10:05.116712] [INFO ] [REMOTE ] ALL: Full fetch complete (71993 records). [2025-10-27T17:10:05.116931] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-27T17:10:05.120235] [FATAL] [VALIDATOR ] ALL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:05.119883] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:10:05.120450] [FATAL] [MAIN ] ALL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:05.131529] [WARN ] [MAIN ] ALL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:05.132064] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-27T17:10:05.132149] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-27T17:10:05.132192] [INFO ] [LOCAL ] ALL: Starting deletion of derivative data. [2025-10-27T17:10:05.132382] [DEBUG] [LOCAL ] ALL: Deleted derivative data file. [2025-10-27T17:10:05.133552] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 36.5s. Estimated remaining: 4h 26m 4s. Rate: 8.6 symbols/min [2025-10-27T17:10:05.215365] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-27T17:10:05.327294] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:05.357560] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (3.34 seconds). [2025-10-27T17:10:05.375510] [INFO ] [REMOTE ] ALLE: Full fetch complete (64578 records). [2025-10-27T17:10:05.375891] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-27T17:10:05.377500] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:05.378073] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:05.385597] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:05.385753] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-27T17:10:05.386368] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-27T17:10:05.386170] [DEBUG] [LOCAL ] ALTG: Loaded 23319 existing records from primary storage. [2025-10-27T17:10:05.386582] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-27T17:10:05.386914] [INFO ] [MAIN ] ALTG: Loaded 23319 existing records. [2025-10-27T17:10:05.432037] [DEBUG] [LOCAL ] ALLE: Deleted derivative data file. [2025-10-27T17:10:05.462600] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 26.0s. Estimated remaining: 4h 23m 3s. Rate: 8.7 symbols/min [2025-10-27T17:10:05.723144] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:05.734562] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-27T17:10:05.750384] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-27T17:10:05.778322] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-27T17:10:05.802427] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-27T17:10:05.802313] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:05.918124] [DEBUG] [LOCAL ] ALUR: Loaded 9342 existing records from primary storage. [2025-10-27T17:10:05.918705] [INFO ] [MAIN ] ALUR: Loaded 9342 existing records. [2025-10-27T17:10:06.337670] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:06.349154] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-27T17:10:06.357133] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:10:06.391333] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-27T17:10:06.430541] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:06.431095] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-27T17:10:06.431447] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-27T17:10:06.431037] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-27T17:10:06.788965] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:06.814939] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-27T17:10:07.614965] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-27T17:10:08.035965] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:10:08.131357] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-27T17:10:08.414997] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-27T17:10:08.667036] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:10:09.214928] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-27T17:10:09.641366] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T17:10:10.010031] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:10:10.020121] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-27T17:10:10.220382] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:10:10.814946] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-27T17:10:11.529778] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:10:11.614975] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-27T17:10:11.880217] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:10:12.414975] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-27T17:10:13.214935] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-27T17:10:13.343778] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:10:13.632694] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:10:14.014990] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-27T17:10:14.363186] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:10:14.769786] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T17:10:14.814962] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-27T17:10:15.614940] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-27T17:10:15.712628] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:10:16.414991] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-27T17:10:17.214972] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-27T17:10:17.492503] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:10:17.502578] [INFO ] [REMOTE ] ALLY: Full fetch complete (76867 records). [2025-10-27T17:10:17.502757] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-27T17:10:17.503594] [FATAL] [VALIDATOR ] ALLY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:17.503716] [FATAL] [MAIN ] ALLY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:17.503762] [WARN ] [MAIN ] ALLY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:17.503800] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-27T17:10:17.503856] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-10-27T17:10:17.503891] [INFO ] [LOCAL ] ALLY: Starting deletion of derivative data. [2025-10-27T17:10:17.504058] [DEBUG] [LOCAL ] ALLY: Deleted derivative data file. [2025-10-27T17:10:17.505047] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALLY took 36.5s. Estimated remaining: 4h 25m 8s. Rate: 8.6 symbols/min [2025-10-27T17:10:17.641281] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:10:17.694694] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:17.734490] [DEBUG] [LOCAL ] ALV: Loaded 42871 existing records from primary storage. [2025-10-27T17:10:17.734786] [INFO ] [MAIN ] ALV: Loaded 42871 existing records. [2025-10-27T17:10:17.909616] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:17.909810] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-27T17:10:17.909858] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-27T17:10:17.910100] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-27T17:10:17.910140] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-27T17:10:18.015756] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-27T17:10:18.269599] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:18.814936] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-27T17:10:19.239300] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:10:19.247701] [INFO ] [REMOTE ] ALSN: Full fetch complete (62810 records). [2025-10-27T17:10:19.247813] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-27T17:10:19.616070] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-27T17:10:19.636098] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-27T17:10:19.636179] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-27T17:10:19.636816] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-27T17:10:19.636879] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-27T17:10:19.638106] [DEBUG] [LOCAL ] ALSN: Trimmed 62810 records to 43052 (keeping 200 days of data) [2025-10-27T17:10:19.876192] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T17:10:19.923840] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:10:19.933940] [DEBUG] [LOCAL ] ALSN: Primary data saved (43052 records). [2025-10-27T17:10:19.934030] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-27T17:10:19.935140] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALSN took 32.7s. Estimated remaining: 4h 23m 5s. Rate: 8.7 symbols/min [2025-10-27T17:10:20.108721] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:20.119277] [DEBUG] [LOCAL ] ALX: Loaded 7452 existing records from primary storage. [2025-10-27T17:10:20.119503] [INFO ] [MAIN ] ALX: Loaded 7452 existing records. [2025-10-27T17:10:20.301841] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:20.302106] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-27T17:10:20.302163] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-27T17:10:20.302479] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-27T17:10:20.302539] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-27T17:10:20.420085] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-27T17:10:20.659496] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:21.214955] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-27T17:10:21.615887] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:10:21.808283] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T17:10:22.014972] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-27T17:10:22.401250] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-27T17:10:22.814991] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-27T17:10:23.346633] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T17:10:23.614943] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-27T17:10:23.980165] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T17:10:24.241695] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:10:24.414969] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-27T17:10:25.214985] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-27T17:10:26.010336] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T17:10:26.014892] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-27T17:10:26.391933] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T17:10:26.743361] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:10:26.814921] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-27T17:10:27.233528] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:10:27.614961] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-27T17:10:28.197724] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T17:10:28.414965] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-27T17:10:29.214957] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-27T17:10:30.014911] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-27T17:10:30.109289] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T17:10:30.145194] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:10:30.596558] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T17:10:30.815014] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-27T17:10:31.614979] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-27T17:10:32.415009] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-27T17:10:32.429067] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:10:33.152801] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T17:10:33.214898] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-27T17:10:33.274257] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:10:34.014993] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-27T17:10:34.500332] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T17:10:34.814910] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-27T17:10:34.949231] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:10:35.377142] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:10:35.379230] [INFO ] [REMOTE ] ALUR: Full fetch complete (18318 records). [2025-10-27T17:10:35.379310] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-27T17:10:35.620032] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-27T17:10:35.744713] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-27T17:10:35.744797] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-27T17:10:35.745101] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-27T17:10:35.745147] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-27T17:10:35.745685] [DEBUG] [LOCAL ] ALUR: Trimmed 18318 records to 9135 (keeping 200 days of data) [2025-10-27T17:10:35.795629] [DEBUG] [LOCAL ] ALUR: Primary data saved (9135 records). [2025-10-27T17:10:35.795781] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-27T17:10:35.795861] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALUR took 30.3s. Estimated remaining: 4h 26m 43s. Rate: 8.5 symbols/min [2025-10-27T17:10:35.960178] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:36.009898] [DEBUG] [LOCAL ] AM: Loaded 52592 existing records from primary storage. [2025-10-27T17:10:36.010193] [INFO ] [MAIN ] AM: Loaded 52592 existing records. [2025-10-27T17:10:36.192596] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:36.192828] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-27T17:10:36.192888] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-27T17:10:36.193072] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-27T17:10:36.193111] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-27T17:10:36.423264] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-27T17:10:36.547054] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:36.620560] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:10:36.624780] [INFO ] [REMOTE ] ALTG: Full fetch complete (33323 records). [2025-10-27T17:10:36.624856] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-27T17:10:36.987706] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-27T17:10:36.987806] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-27T17:10:36.988209] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-27T17:10:36.988252] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-27T17:10:36.989001] [DEBUG] [LOCAL ] ALTG: Trimmed 33323 records to 22760 (keeping 200 days of data) [2025-10-27T17:10:37.095980] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:10:37.122363] [DEBUG] [LOCAL ] ALTG: Primary data saved (22760 records). [2025-10-27T17:10:37.122471] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-27T17:10:37.122542] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALTG took 32.0s. Estimated remaining: 4h 24m 14s. Rate: 8.6 symbols/min [2025-10-27T17:10:37.220095] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-27T17:10:37.295583] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:37.328457] [DEBUG] [LOCAL ] AMBC: Loaded 36371 existing records from primary storage. [2025-10-27T17:10:37.328762] [INFO ] [MAIN ] AMBC: Loaded 36371 existing records. [2025-10-27T17:10:37.505103] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:37.505288] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-27T17:10:37.505337] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-27T17:10:37.505521] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-27T17:10:37.505562] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-27T17:10:37.848373] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:38.014920] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-27T17:10:38.814940] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-27T17:10:38.911141] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:10:39.614970] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-27T17:10:39.673967] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T17:10:40.414934] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-27T17:10:40.844400] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:10:41.214969] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-27T17:10:41.395757] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:10:41.612500] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:10:41.880088] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:10:42.014943] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-27T17:10:42.814953] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-27T17:10:43.475874] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:10:43.614943] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-27T17:10:43.880974] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:10:44.414938] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-27T17:10:45.214961] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-27T17:10:45.390784] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T17:10:45.608348] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:10:45.763421] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T17:10:46.014954] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-27T17:10:46.814947] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-27T17:10:46.906905] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T17:10:46.909362] [INFO ] [REMOTE ] ALX: Full fetch complete (8259 records). [2025-10-27T17:10:46.909428] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-27T17:10:46.909837] [FATAL] [VALIDATOR ] ALX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:10:46.909915] [FATAL] [MAIN ] ALX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:10:46.909956] [WARN ] [MAIN ] ALX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:10:46.909992] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-27T17:10:46.910045] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-10-27T17:10:46.910078] [INFO ] [LOCAL ] ALX: Starting deletion of derivative data. [2025-10-27T17:10:46.910226] [DEBUG] [LOCAL ] ALX: Deleted derivative data file. [2025-10-27T17:10:46.910308] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALX took 27.0s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-10-27T17:10:47.073765] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:47.124348] [DEBUG] [LOCAL ] AMBP: Loaded 45024 existing records from primary storage. [2025-10-27T17:10:47.124682] [INFO ] [MAIN ] AMBP: Loaded 45024 existing records. [2025-10-27T17:10:47.297049] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:47.297246] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-27T17:10:47.297325] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-27T17:10:47.297550] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-27T17:10:47.297604] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-27T17:10:47.622910] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-27T17:10:47.644369] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:48.414989] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-27T17:10:48.486124] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:10:48.616845] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:10:49.214983] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-27T17:10:50.014920] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-27T17:10:50.351024] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:10:50.386455] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:10:50.814933] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-27T17:10:51.614922] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-27T17:10:51.947107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:10:52.196966] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:10:52.414978] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-27T17:10:53.214969] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-27T17:10:53.358805] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T17:10:53.762386] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:10:54.014968] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-27T17:10:54.765939] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:10:54.792144] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:10:54.814894] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-27T17:10:55.614987] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-27T17:10:56.296521] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:10:56.303484] [INFO ] [REMOTE ] AMBC: Full fetch complete (51861 records). [2025-10-27T17:10:56.303572] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-27T17:10:56.420120] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-27T17:10:56.674665] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-27T17:10:56.674745] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-27T17:10:56.675251] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-27T17:10:56.675290] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-27T17:10:56.676260] [DEBUG] [LOCAL ] AMBC: Trimmed 51861 records to 35502 (keeping 200 days of data) [2025-10-27T17:10:56.870315] [DEBUG] [LOCAL ] AMBC: Primary data saved (35502 records). [2025-10-27T17:10:56.870435] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-27T17:10:56.870529] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. AMBC took 19.7s. Estimated remaining: 4h 26m 22s. Rate: 8.5 symbols/min [2025-10-27T17:10:57.047683] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:57.047920] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-27T17:10:57.048016] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-27T17:10:57.048351] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-27T17:10:57.048545] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-27T17:10:57.048723] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-27T17:10:57.048842] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-27T17:10:57.234921] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-27T17:10:57.367621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:10:57.420456] [INFO ] [REMOTE ] ALV: Full fetch complete (62451 records). [2025-10-27T17:10:57.423681] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-27T17:10:57.448102] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:57.823376] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-27T17:10:57.823461] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-27T17:10:57.824104] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-27T17:10:57.824166] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-27T17:10:57.825427] [DEBUG] [LOCAL ] ALV: Trimmed 62451 records to 42134 (keeping 200 days of data) [2025-10-27T17:10:58.033922] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-27T17:10:58.089687] [DEBUG] [LOCAL ] ALV: Primary data saved (42134 records). [2025-10-27T17:10:58.089832] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-27T17:10:58.090627] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. ALV took 40.6s. Estimated remaining: 4h 23m 54s. Rate: 8.6 symbols/min [2025-10-27T17:10:58.285888] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:58.367796] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:10:58.368938] [DEBUG] [LOCAL ] AMC: Loaded 54546 existing records from primary storage. [2025-10-27T17:10:58.380118] [INFO ] [MAIN ] AMC: Loaded 54546 existing records. [2025-10-27T17:10:58.458249] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:10:58.482238] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-27T17:10:58.484633] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:10:58.484761] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-27T17:10:58.484832] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:10:58.490599] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-27T17:10:58.500965] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-27T17:10:58.511260] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-27T17:10:58.529939] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-27T17:10:58.535670] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBQ took 1.7s. Estimated remaining: 4h 21m 11s. Rate: 8.7 symbols/min [2025-10-27T17:10:58.597458] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:58.629290] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-27T17:10:58.646298] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-27T17:10:58.667494] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-27T17:10:58.678174] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-27T17:10:58.815915] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-27T17:10:58.832487] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:10:59.136005] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:10:59.181931] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T17:10:59.184554] [DEBUG] [LOCAL ] AMCR: Loaded 54450 existing records from primary storage. [2025-10-27T17:10:59.194156] [INFO ] [MAIN ] AMCR: Loaded 54450 existing records. [2025-10-27T17:10:59.368428] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:10:59.368670] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-27T17:10:59.368737] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-27T17:10:59.368968] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-27T17:10:59.369012] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-27T17:10:59.620108] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-27T17:10:59.752722] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:00.137961] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T17:11:00.414940] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-27T17:11:01.214918] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-27T17:11:02.014967] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-27T17:11:02.358490] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-27T17:11:02.823806] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-27T17:11:02.847870] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-27T17:11:03.614996] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-27T17:11:04.116217] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T17:11:04.347815] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T17:11:04.415000] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-27T17:11:05.160486] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-27T17:11:05.214908] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-27T17:11:05.492036] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T17:11:05.767021] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T17:11:06.014924] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-27T17:11:06.815008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-27T17:11:07.056010] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:11:07.582835] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:11:07.614900] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-27T17:11:08.345743] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:11:08.414945] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-27T17:11:09.215000] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-27T17:11:09.832344] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:11:09.876518] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-27T17:11:10.014973] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-27T17:11:10.814932] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-27T17:11:11.109566] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:11:11.614944] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-27T17:11:12.415019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-27T17:11:13.016761] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-27T17:11:13.027128] [INFO ] [REMOTE ] AM: Full fetch complete (75654 records). [2025-10-27T17:11:13.027270] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-27T17:11:13.356186] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-27T17:11:13.387890] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-27T17:11:13.476227] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-27T17:11:13.476304] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-27T17:11:13.477050] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-27T17:11:13.477113] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-27T17:11:13.478540] [DEBUG] [LOCAL ] AM: Trimmed 75654 records to 51802 (keeping 200 days of data) [2025-10-27T17:11:13.792744] [DEBUG] [LOCAL ] AM: Primary data saved (51802 records). [2025-10-27T17:11:13.792987] [INFO ] [MAIN ] AM: Full history saved. [2025-10-27T17:11:13.794020] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AM took 38.0s. Estimated remaining: 4h 24m 22s. Rate: 8.6 symbols/min [2025-10-27T17:11:13.965499] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:13.996947] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:11:14.014910] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-27T17:11:14.050201] [DEBUG] [LOCAL ] AME: Loaded 49145 existing records from primary storage. [2025-10-27T17:11:14.050489] [INFO ] [MAIN ] AME: Loaded 49145 existing records. [2025-10-27T17:11:14.234473] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:14.234871] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-27T17:11:14.234980] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-27T17:11:14.235350] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-27T17:11:14.235408] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-27T17:11:14.601083] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:14.686525] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-10-27T17:11:14.752266] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:11:14.814911] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-27T17:11:15.598487] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:11:15.614899] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-27T17:11:16.414911] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-27T17:11:16.653995] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:11:17.214939] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-27T17:11:17.589108] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:11:18.014955] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-27T17:11:18.812079] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:11:18.821683] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-27T17:11:18.944221] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-27T17:11:19.384100] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:11:19.614968] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-27T17:11:20.414997] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-27T17:11:20.969400] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T17:11:20.977249] [INFO ] [REMOTE ] AMBP: Full fetch complete (64998 records). [2025-10-27T17:11:20.977437] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-27T17:11:21.233049] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-27T17:11:21.368774] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-27T17:11:21.368847] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-27T17:11:21.369464] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-27T17:11:21.369502] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-27T17:11:21.370748] [DEBUG] [LOCAL ] AMBP: Trimmed 64998 records to 44283 (keeping 200 days of data) [2025-10-27T17:11:21.615211] [DEBUG] [LOCAL ] AMBP: Primary data saved (44283 records). [2025-10-27T17:11:21.615333] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-27T17:11:21.617293] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AMBP took 34.7s. Estimated remaining: 4h 24m 35s. Rate: 8.6 symbols/min [2025-10-27T17:11:21.796120] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:21.826117] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-27T17:11:21.853968] [DEBUG] [LOCAL ] AMG: Loaded 20306 existing records from primary storage. [2025-10-27T17:11:21.854224] [INFO ] [MAIN ] AMG: Loaded 20306 existing records. [2025-10-27T17:11:22.045577] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-27T17:11:22.055319] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:22.066396] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-27T17:11:22.066528] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-27T17:11:22.068207] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-27T17:11:22.069222] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:11:22.077849] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-27T17:11:22.434221] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:22.814956] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-27T17:11:23.614934] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-27T17:11:23.919935] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-27T17:11:24.138594] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T17:11:24.324090] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-27T17:11:24.414902] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-27T17:11:25.214989] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-27T17:11:25.918097] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-27T17:11:26.014917] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-27T17:11:26.636585] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T17:11:26.814934] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-27T17:11:27.068460] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T17:11:27.078800] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-27T17:11:27.078923] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-27T17:11:27.478504] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-27T17:11:27.478699] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-27T17:11:27.479589] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-27T17:11:27.479694] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-27T17:11:27.481386] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-27T17:11:27.667798] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-27T17:11:27.679038] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:11:27.769446] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T17:11:27.861453] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-27T17:11:27.861594] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-27T17:11:27.861699] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMCR took 29.3s. Estimated remaining: 4h 24m 10s. Rate: 8.6 symbols/min [2025-10-27T17:11:28.038303] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:28.083393] [DEBUG] [LOCAL ] AMH: Loaded 52581 existing records from primary storage. [2025-10-27T17:11:28.083781] [INFO ] [MAIN ] AMH: Loaded 52581 existing records. [2025-10-27T17:11:28.261383] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:28.261575] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-27T17:11:28.261620] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-27T17:11:28.261978] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-27T17:11:28.262034] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-27T17:11:28.416818] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-27T17:11:28.630419] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:29.215005] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-27T17:11:30.014937] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-27T17:11:30.086511] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T17:11:30.131002] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T17:11:30.814972] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-27T17:11:31.172976] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T17:11:31.614930] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-27T17:11:31.669087] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-27T17:11:32.414982] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-27T17:11:32.779428] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T17:11:32.936104] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-27T17:11:32.946124] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-27T17:11:32.946235] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-27T17:11:33.220209] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-27T17:11:33.346694] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-27T17:11:33.346777] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-27T17:11:33.347578] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-27T17:11:33.347663] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-27T17:11:33.349144] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-27T17:11:33.637892] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-27T17:11:33.638020] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-27T17:11:33.638698] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMC took 35.5s. Estimated remaining: 4h 23m 36s. Rate: 8.6 symbols/min [2025-10-27T17:11:33.818851] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:33.860370] [DEBUG] [LOCAL ] AMN: Loaded 42147 existing records from primary storage. [2025-10-27T17:11:33.860716] [INFO ] [MAIN ] AMN: Loaded 42147 existing records. [2025-10-27T17:11:34.027532] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-27T17:11:34.078074] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:34.079892] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:11:34.080055] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-27T17:11:34.089263] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-27T17:11:34.089823] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-27T17:11:34.089882] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-27T17:11:34.455407] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:34.610268] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:11:34.814952] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-27T17:11:35.206830] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:11:35.614963] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-27T17:11:36.414922] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-27T17:11:36.609566] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T17:11:36.660598] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:11:37.214945] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-27T17:11:37.847293] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:11:38.014994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-27T17:11:38.818514] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-27T17:11:38.824075] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:11:38.903834] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T17:11:39.614914] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-27T17:11:39.999807] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T17:11:40.414927] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-27T17:11:40.576738] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:11:41.214987] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-27T17:11:41.620909] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:11:41.879454] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T17:11:42.014910] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-27T17:11:42.814994] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-27T17:11:43.096366] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:11:43.100179] [INFO ] [REMOTE ] AMG: Full fetch complete (29493 records). [2025-10-27T17:11:43.100249] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-27T17:11:43.458384] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-27T17:11:43.458480] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-27T17:11:43.458852] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-27T17:11:43.458913] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-27T17:11:43.459729] [DEBUG] [LOCAL ] AMG: Trimmed 29493 records to 19768 (keeping 200 days of data) [2025-10-27T17:11:43.578640] [DEBUG] [LOCAL ] AMG: Primary data saved (19768 records). [2025-10-27T17:11:43.578791] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-27T17:11:43.578866] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AMG took 22.0s. Estimated remaining: 4h 24m 36s. Rate: 8.6 symbols/min [2025-10-27T17:11:43.624526] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-27T17:11:43.752697] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:43.782053] [DEBUG] [LOCAL ] AMP: Loaded 32168 existing records from primary storage. [2025-10-27T17:11:43.782306] [INFO ] [MAIN ] AMP: Loaded 32168 existing records. [2025-10-27T17:11:43.960446] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:43.960687] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-27T17:11:43.960762] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-27T17:11:43.961054] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-27T17:11:43.961125] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-27T17:11:44.307389] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:44.414903] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-27T17:11:44.837789] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-27T17:11:45.214908] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-27T17:11:45.450589] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:11:45.689633] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:11:46.014975] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-27T17:11:46.650983] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:11:46.814945] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-27T17:11:47.614954] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-27T17:11:48.011202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T17:11:48.414928] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-27T17:11:48.479088] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:11:48.488477] [INFO ] [REMOTE ] AME: Full fetch complete (70232 records). [2025-10-27T17:11:48.488612] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-27T17:11:48.878208] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-27T17:11:48.878301] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-27T17:11:48.879060] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-27T17:11:48.879138] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-27T17:11:48.880733] [DEBUG] [LOCAL ] AME: Trimmed 70232 records to 48327 (keeping 200 days of data) [2025-10-27T17:11:48.909181] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:11:49.209609] [DEBUG] [LOCAL ] AME: Primary data saved (48327 records). [2025-10-27T17:11:49.209766] [INFO ] [MAIN ] AME: Full history saved. [2025-10-27T17:11:49.210390] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AME took 35.4s. Estimated remaining: 4h 23m 58s. Rate: 8.6 symbols/min [2025-10-27T17:11:49.231273] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-27T17:11:49.385514] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:11:49.434520] [DEBUG] [LOCAL ] AMPX: Loaded 53219 existing records from primary storage. [2025-10-27T17:11:49.434845] [INFO ] [MAIN ] AMPX: Loaded 53219 existing records. [2025-10-27T17:11:49.617336] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:11:49.617748] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-27T17:11:49.617828] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-27T17:11:49.618205] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-27T17:11:49.618304] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-27T17:11:49.910824] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:11:50.016452] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-27T17:11:50.019742] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:11:50.223199] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:11:50.814943] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-27T17:11:51.448607] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:11:51.614940] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-27T17:11:52.323632] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T17:11:52.414948] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-27T17:11:53.214933] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-27T17:11:53.411486] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:11:53.615105] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:11:54.014959] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-27T17:11:54.636840] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:11:54.814918] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-27T17:11:55.469389] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:11:55.614924] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-27T17:11:56.414922] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-27T17:11:56.470017] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:11:57.214928] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-27T17:11:57.277520] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:11:57.510088] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:11:58.014955] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-27T17:11:58.814925] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-27T17:11:59.217752] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T17:11:59.620792] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-27T17:11:59.634670] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:12:00.414954] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-27T17:12:01.169217] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-27T17:12:01.179476] [INFO ] [REMOTE ] AMH: Full fetch complete (75133 records). [2025-10-27T17:12:01.179628] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-27T17:12:01.222302] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-27T17:12:01.597802] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-27T17:12:01.597921] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-27T17:12:01.598695] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-27T17:12:01.598858] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-27T17:12:01.620390] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T17:12:01.628124] [DEBUG] [LOCAL ] AMH: Trimmed 75133 records to 51793 (keeping 200 days of data) [2025-10-27T17:12:01.950122] [DEBUG] [LOCAL ] AMH: Primary data saved (51793 records). [2025-10-27T17:12:01.950252] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-27T17:12:01.951286] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMH took 34.1s. Estimated remaining: 4h 25m 59s. Rate: 8.5 symbols/min [2025-10-27T17:12:02.021732] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-27T17:12:02.127494] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:02.167260] [DEBUG] [LOCAL ] AMPY: Loaded 40008 existing records from primary storage. [2025-10-27T17:12:02.167625] [INFO ] [MAIN ] AMPY: Loaded 40008 existing records. [2025-10-27T17:12:02.363816] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:02.364043] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-27T17:12:02.364091] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-27T17:12:02.364306] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-27T17:12:02.364363] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-27T17:12:02.726798] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:02.761546] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T17:12:02.814906] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-27T17:12:02.912927] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T17:12:03.614917] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-27T17:12:03.945055] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T17:12:04.347075] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:12:04.375466] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T17:12:04.414911] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-27T17:12:05.214920] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-27T17:12:05.394069] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:12:06.014963] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-27T17:12:06.814973] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-27T17:12:07.183614] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T17:12:07.308188] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:12:07.614908] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-27T17:12:08.076972] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:12:08.414944] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-27T17:12:08.873701] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:12:09.214988] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-27T17:12:09.955464] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:12:10.014909] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-27T17:12:10.814917] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-27T17:12:10.866309] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T17:12:10.872361] [INFO ] [REMOTE ] AMP: Full fetch complete (47498 records). [2025-10-27T17:12:10.872459] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-27T17:12:11.246896] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-27T17:12:11.246972] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-27T17:12:11.247494] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-27T17:12:11.247556] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-27T17:12:11.248525] [DEBUG] [LOCAL ] AMP: Trimmed 47498 records to 31375 (keeping 200 days of data) [2025-10-27T17:12:11.438159] [DEBUG] [LOCAL ] AMP: Primary data saved (31375 records). [2025-10-27T17:12:11.438285] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-27T17:12:11.439270] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMP took 27.9s. Estimated remaining: 4h 26m 45s. Rate: 8.5 symbols/min [2025-10-27T17:12:11.603201] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:11.621439] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-27T17:12:11.635104] [DEBUG] [LOCAL ] AMR: Loaded 29133 existing records from primary storage. [2025-10-27T17:12:11.635354] [INFO ] [MAIN ] AMR: Loaded 29133 existing records. [2025-10-27T17:12:11.817117] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:11.817389] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-27T17:12:11.817487] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-27T17:12:11.817991] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-27T17:12:11.818075] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-27T17:12:12.135833] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T17:12:12.236295] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:12.295485] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:12:12.414931] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-27T17:12:13.162566] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:12:13.214929] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-27T17:12:14.015011] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-27T17:12:14.155397] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:12:14.814941] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-27T17:12:14.875815] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T17:12:15.446434] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T17:12:15.454227] [INFO ] [REMOTE ] AMN: Full fetch complete (60174 records). [2025-10-27T17:12:15.454329] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-27T17:12:15.620519] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-27T17:12:15.855461] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-27T17:12:15.855539] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-27T17:12:15.856133] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-27T17:12:15.856194] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-27T17:12:15.857321] [DEBUG] [LOCAL ] AMN: Trimmed 60174 records to 41409 (keeping 200 days of data) [2025-10-27T17:12:16.091661] [DEBUG] [LOCAL ] AMN: Primary data saved (41409 records). [2025-10-27T17:12:16.091789] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-27T17:12:16.092733] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMN took 42.5s. Estimated remaining: 4h 25m 45s. Rate: 8.5 symbols/min [2025-10-27T17:12:16.269702] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:16.307889] [DEBUG] [LOCAL ] AMRC: Loaded 39067 existing records from primary storage. [2025-10-27T17:12:16.308239] [INFO ] [MAIN ] AMRC: Loaded 39067 existing records. [2025-10-27T17:12:16.424271] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-27T17:12:16.445022] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T17:12:16.592963] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:16.593519] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-27T17:12:16.593610] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-27T17:12:16.593982] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-27T17:12:16.594253] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-27T17:12:16.733033] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:12:16.989780] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:17.214943] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-27T17:12:18.014917] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-27T17:12:18.340765] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:12:18.446709] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T17:12:18.814935] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-27T17:12:19.614953] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-27T17:12:19.740715] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:12:20.414969] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-27T17:12:20.682392] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:12:21.215044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-27T17:12:21.430439] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:12:21.477308] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-27T17:12:21.487057] [INFO ] [REMOTE ] AMPX: Full fetch complete (74879 records). [2025-10-27T17:12:21.487188] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-27T17:12:21.488024] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:12:21.488112] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:12:21.488154] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:12:21.488191] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-27T17:12:21.488251] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-27T17:12:21.488284] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-27T17:12:21.488508] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-10-27T17:12:21.488925] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPX took 32.3s. Estimated remaining: 4h 25m 3s. Rate: 8.5 symbols/min [2025-10-27T17:12:21.654915] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:21.655043] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-27T17:12:21.655078] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-27T17:12:21.655180] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-27T17:12:21.655220] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-27T17:12:21.655262] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-27T17:12:21.655292] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-27T17:12:22.005240] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:22.014912] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-27T17:12:22.674768] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:12:22.675293] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-27T17:12:22.693222] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:12:22.693362] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-27T17:12:22.694118] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:12:22.694978] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-27T17:12:22.694870] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:12:22.695148] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-27T17:12:22.701823] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-27T17:12:22.702631] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-27T17:12:22.702745] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 1.2s. Estimated remaining: 4h 22m 52s. Rate: 8.6 symbols/min [2025-10-27T17:12:22.820168] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-27T17:12:22.870575] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:22.924597] [DEBUG] [LOCAL ] AMT: Loaded 53186 existing records from primary storage. [2025-10-27T17:12:22.924977] [INFO ] [MAIN ] AMT: Loaded 53186 existing records. [2025-10-27T17:12:23.099088] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:23.099310] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-27T17:12:23.099373] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-27T17:12:23.099701] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-27T17:12:23.099757] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-27T17:12:23.456680] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:23.614960] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-27T17:12:23.710589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:12:24.415001] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-27T17:12:24.862041] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:12:25.214961] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-27T17:12:25.500103] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:12:26.014970] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-27T17:12:26.643243] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:12:26.814941] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-27T17:12:27.102625] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:12:27.615010] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-27T17:12:28.345547] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T17:12:28.414940] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-27T17:12:28.814409] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:12:29.214941] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-27T17:12:30.014942] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-27T17:12:30.113002] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:12:30.814961] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-27T17:12:31.160352] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T17:12:31.265811] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:12:31.614955] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-27T17:12:32.305880] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:12:32.414969] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-27T17:12:32.963117] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:12:33.214963] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-27T17:12:33.974951] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T17:12:33.984127] [INFO ] [REMOTE ] AMPY: Full fetch complete (53700 records). [2025-10-27T17:12:33.984296] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-27T17:12:34.020080] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-27T17:12:34.394779] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-27T17:12:34.394880] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-27T17:12:34.395477] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-27T17:12:34.395519] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-27T17:12:34.396942] [DEBUG] [LOCAL ] AMPY: Trimmed 53700 records to 39370 (keeping 200 days of data) [2025-10-27T17:12:34.616196] [DEBUG] [LOCAL ] AMPY: Primary data saved (39370 records). [2025-10-27T17:12:34.616435] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-27T17:12:34.617230] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMPY took 32.7s. Estimated remaining: 4h 24m 29s. Rate: 8.5 symbols/min [2025-10-27T17:12:34.813669] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:34.823250] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-27T17:12:34.842119] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:12:34.867226] [DEBUG] [LOCAL ] AMTB: Loaded 20875 existing records from primary storage. [2025-10-27T17:12:34.867520] [INFO ] [MAIN ] AMTB: Loaded 20875 existing records. [2025-10-27T17:12:35.049087] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:35.049305] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-27T17:12:35.049352] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-27T17:12:35.049594] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-27T17:12:35.049690] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-27T17:12:35.395618] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:35.614907] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-27T17:12:35.729836] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:12:36.246998] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:12:36.414938] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-27T17:12:36.620992] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T17:12:37.215007] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-27T17:12:38.014917] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-27T17:12:38.175297] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T17:12:38.815005] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-27T17:12:39.130450] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-27T17:12:39.236808] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:12:39.614953] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-27T17:12:39.988576] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:12:40.414991] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-27T17:12:40.607238] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:12:41.214958] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-27T17:12:41.426542] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T17:12:41.431833] [INFO ] [REMOTE ] AMR: Full fetch complete (40658 records). [2025-10-27T17:12:41.431915] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-27T17:12:41.807997] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-27T17:12:41.808075] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-27T17:12:41.808504] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-27T17:12:41.808545] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-27T17:12:41.809458] [DEBUG] [LOCAL ] AMR: Trimmed 40658 records to 28408 (keeping 200 days of data) [2025-10-27T17:12:41.983020] [DEBUG] [LOCAL ] AMR: Primary data saved (28408 records). [2025-10-27T17:12:41.983235] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-27T17:12:41.983339] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMR took 30.5s. Estimated remaining: 4h 24m 29s. Rate: 8.5 symbols/min [2025-10-27T17:12:42.020070] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-27T17:12:42.165983] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:42.172741] [DEBUG] [LOCAL ] AMTD: Loaded 3828 existing records from primary storage. [2025-10-27T17:12:42.172944] [INFO ] [MAIN ] AMTD: Loaded 3828 existing records. [2025-10-27T17:12:42.361234] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:42.361525] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-27T17:12:42.361577] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-27T17:12:42.361792] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-27T17:12:42.361852] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-27T17:12:42.740607] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:42.814935] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-27T17:12:43.110099] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T17:12:43.619023] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-27T17:12:43.621504] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:12:43.629506] [INFO ] [REMOTE ] AMRC: Full fetch complete (54689 records). [2025-10-27T17:12:43.629594] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-27T17:12:44.015504] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-27T17:12:44.015605] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-27T17:12:44.016242] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-27T17:12:44.016299] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-27T17:12:44.017500] [DEBUG] [LOCAL ] AMRC: Trimmed 54689 records to 38274 (keeping 200 days of data) [2025-10-27T17:12:44.233125] [DEBUG] [LOCAL ] AMRC: Primary data saved (38274 records). [2025-10-27T17:12:44.233257] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-27T17:12:44.233795] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMRC took 28.1s. Estimated remaining: 4h 22m 43s. Rate: 8.6 symbols/min [2025-10-27T17:12:44.413541] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:44.418747] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-27T17:12:44.425826] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:12:44.475312] [DEBUG] [LOCAL ] AMTM: Loaded 50952 existing records from primary storage. [2025-10-27T17:12:44.475602] [INFO ] [MAIN ] AMTM: Loaded 50952 existing records. [2025-10-27T17:12:44.649783] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:44.649999] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-27T17:12:44.650045] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-27T17:12:44.650225] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-27T17:12:44.650263] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-27T17:12:45.004930] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:45.106821] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:12:45.214935] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-27T17:12:45.613288] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:12:46.014993] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-27T17:12:46.543350] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:12:46.814942] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-27T17:12:47.390298] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:12:47.521697] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:12:47.614940] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-27T17:12:48.414937] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-27T17:12:48.512154] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:12:49.026422] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T17:12:49.214955] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-27T17:12:50.014930] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-27T17:12:50.765438] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T17:12:50.814929] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-27T17:12:51.437575] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:12:51.614925] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-27T17:12:52.414936] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-27T17:12:52.614980] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:12:53.054061] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:12:53.214916] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-27T17:12:53.379955] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:12:54.014990] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-27T17:12:54.743372] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:12:54.753452] [INFO ] [REMOTE ] AMT: Full fetch complete (76158 records). [2025-10-27T17:12:54.753577] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-27T17:12:54.820174] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-27T17:12:55.142499] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-27T17:12:55.142575] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-27T17:12:55.143288] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-27T17:12:55.143349] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-27T17:12:55.144927] [DEBUG] [LOCAL ] AMT: Trimmed 76158 records to 52406 (keeping 200 days of data) [2025-10-27T17:12:55.428313] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:12:55.535942] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:12:55.543294] [DEBUG] [LOCAL ] AMT: Primary data saved (52406 records). [2025-10-27T17:12:55.543408] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-27T17:12:55.543816] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMT took 32.8s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-10-27T17:12:55.620019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-27T17:12:55.713053] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:12:55.723952] [DEBUG] [LOCAL ] AMWL: Loaded 9978 existing records from primary storage. [2025-10-27T17:12:55.724185] [INFO ] [MAIN ] AMWL: Loaded 9978 existing records. [2025-10-27T17:12:55.899512] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:12:55.899736] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-27T17:12:55.899788] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-27T17:12:55.899934] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-27T17:12:55.899970] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-27T17:12:56.251137] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:12:56.414914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-27T17:12:56.798365] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:12:57.121793] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:12:57.214953] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-27T17:12:57.902784] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:12:58.014932] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-27T17:12:58.770306] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:12:58.814903] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-27T17:12:59.614969] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-27T17:13:00.420063] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-27T17:13:00.438250] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:13:00.773466] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T17:13:00.779268] [INFO ] [REMOTE ] AMTB: Full fetch complete (29791 records). [2025-10-27T17:13:00.779355] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-27T17:13:01.137413] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-27T17:13:01.137499] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-27T17:13:01.137862] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-27T17:13:01.137922] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-27T17:13:01.138578] [DEBUG] [LOCAL ] AMTB: Trimmed 29791 records to 20491 (keeping 200 days of data) [2025-10-27T17:13:01.226533] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-27T17:13:01.270356] [DEBUG] [LOCAL ] AMTB: Primary data saved (20491 records). [2025-10-27T17:13:01.270521] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-27T17:13:01.270616] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 26.7s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-10-27T17:13:01.445699] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:01.493079] [DEBUG] [LOCAL ] AMX: Loaded 49882 existing records from primary storage. [2025-10-27T17:13:01.493426] [INFO ] [MAIN ] AMX: Loaded 49882 existing records. [2025-10-27T17:13:01.673033] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:01.673245] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-27T17:13:01.673292] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-27T17:13:01.673484] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-27T17:13:01.673524] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-27T17:13:02.024283] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-27T17:13:02.030551] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:02.814965] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-27T17:13:03.703179] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T17:13:03.713859] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-27T17:13:03.831606] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:13:03.845850] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-10-27T17:13:04.203541] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:13:04.415006] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-27T17:13:04.756750] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:13:05.214956] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-27T17:13:05.530020] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T17:13:06.015023] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-27T17:13:06.331460] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:13:06.814957] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-27T17:13:06.826630] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:13:07.614948] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-27T17:13:08.012554] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:13:08.414949] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-27T17:13:09.214919] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-27T17:13:09.787489] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-27T17:13:09.793294] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:13:10.014942] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-27T17:13:10.531623] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T17:13:10.811594] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T17:13:10.814885] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-27T17:13:11.614934] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-27T17:13:11.695590] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:13:12.091849] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T17:13:12.414939] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-27T17:13:12.779210] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-27T17:13:13.214934] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-27T17:13:13.959632] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T17:13:14.014927] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-27T17:13:14.695864] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:13:14.814957] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-27T17:13:15.615004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-27T17:13:16.414979] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-27T17:13:16.464495] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T17:13:16.993187] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:13:17.007890] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:13:17.214983] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-27T17:13:17.616312] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T17:13:18.014993] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-27T17:13:18.755904] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:13:18.757149] [INFO ] [REMOTE ] AMTD: Full fetch complete (5358 records). [2025-10-27T17:13:18.757217] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-27T17:13:18.820069] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-27T17:13:19.111871] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-27T17:13:19.111981] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-27T17:13:19.112150] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-27T17:13:19.112191] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-27T17:13:19.112543] [DEBUG] [LOCAL ] AMTD: Trimmed 5358 records to 3794 (keeping 200 days of data) [2025-10-27T17:13:19.133039] [DEBUG] [LOCAL ] AMTD: Primary data saved (3794 records). [2025-10-27T17:13:19.133107] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-27T17:13:19.133185] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMTD took 37.1s. Estimated remaining: 4h 27m 3s. Rate: 8.4 symbols/min [2025-10-27T17:13:19.300950] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:19.329912] [DEBUG] [LOCAL ] AN: Loaded 31602 existing records from primary storage. [2025-10-27T17:13:19.330191] [INFO ] [MAIN ] AN: Loaded 31602 existing records. [2025-10-27T17:13:19.505009] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:19.505203] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-27T17:13:19.505248] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-27T17:13:19.505443] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-27T17:13:19.505481] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-27T17:13:19.620099] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-27T17:13:19.859076] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:20.414920] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-27T17:13:20.646544] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:13:20.655726] [INFO ] [REMOTE ] AMTM: Full fetch complete (73508 records). [2025-10-27T17:13:20.655846] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-27T17:13:21.043817] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-27T17:13:21.043899] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-27T17:13:21.044626] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-27T17:13:21.044713] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-27T17:13:21.046088] [DEBUG] [LOCAL ] AMTM: Trimmed 73508 records to 50131 (keeping 200 days of data) [2025-10-27T17:13:21.214963] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-27T17:13:21.332200] [DEBUG] [LOCAL ] AMTM: Primary data saved (50131 records). [2025-10-27T17:13:21.332322] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-27T17:13:21.332396] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTM took 37.1s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-27T17:13:21.419029] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T17:13:21.520598] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:21.571218] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-27T17:13:21.571524] [INFO ] [MAIN ] ANET: Loaded 54546 existing records. [2025-10-27T17:13:21.779481] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:21.782382] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-27T17:13:21.782443] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-27T17:13:21.782892] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-27T17:13:21.783209] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-27T17:13:21.785005] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T17:13:22.020186] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-27T17:13:22.152557] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:22.641882] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:13:22.814945] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-27T17:13:23.203101] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:13:23.614954] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-27T17:13:24.414959] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-27T17:13:25.021393] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:13:25.196208] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:13:25.200092] [INFO ] [REMOTE ] AMWL: Full fetch complete (14742 records). [2025-10-27T17:13:25.200175] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-27T17:13:25.200597] [FATAL] [VALIDATOR ] AMWL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:13:25.200717] [FATAL] [MAIN ] AMWL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:13:25.200803] [WARN ] [MAIN ] AMWL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:13:25.200894] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-27T17:13:25.200975] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-10-27T17:13:25.201014] [INFO ] [LOCAL ] AMWL: Starting deletion of derivative data. [2025-10-27T17:13:25.201157] [DEBUG] [LOCAL ] AMWL: Deleted derivative data file. [2025-10-27T17:13:25.201269] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMWL took 29.7s. Estimated remaining: 4h 24m 8s. Rate: 8.5 symbols/min [2025-10-27T17:13:25.222417] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-27T17:13:25.376434] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:25.427790] [DEBUG] [LOCAL ] ANF: Loaded 52772 existing records from primary storage. [2025-10-27T17:13:25.428099] [INFO ] [MAIN ] ANF: Loaded 52772 existing records. [2025-10-27T17:13:25.603112] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:25.603354] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-27T17:13:25.603403] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-27T17:13:25.603676] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-27T17:13:25.603731] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-27T17:13:25.960745] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (3.15 seconds). [2025-10-27T17:13:26.005730] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:26.014953] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-27T17:13:26.429463] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:13:26.815017] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-27T17:13:27.614968] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-27T17:13:27.989966] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T17:13:28.422517] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-27T17:13:28.424984] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:13:28.673464] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T17:13:29.214952] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-27T17:13:30.014977] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-27T17:13:30.261640] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T17:13:30.471957] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:13:30.814925] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-27T17:13:31.614934] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-27T17:13:31.998681] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T17:13:32.178448] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T17:13:32.188009] [INFO ] [REMOTE ] AMX: Full fetch complete (71013 records). [2025-10-27T17:13:32.188140] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-27T17:13:32.424235] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-27T17:13:32.599674] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-27T17:13:32.599767] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-27T17:13:32.600487] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-27T17:13:32.600548] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-27T17:13:32.601886] [DEBUG] [LOCAL ] AMX: Trimmed 71013 records to 49065 (keeping 200 days of data) [2025-10-27T17:13:32.884143] [DEBUG] [LOCAL ] AMX: Primary data saved (49065 records). [2025-10-27T17:13:32.884266] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-27T17:13:32.885165] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AMX took 31.6s. Estimated remaining: 4h 24m 13s. Rate: 8.5 symbols/min [2025-10-27T17:13:33.055194] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:33.055428] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-27T17:13:33.055497] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-27T17:13:33.055683] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-27T17:13:33.055808] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-27T17:13:33.055941] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-27T17:13:33.055990] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-27T17:13:33.194925] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:13:33.223848] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-27T17:13:33.453531] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:34.014932] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-27T17:13:34.075849] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:13:34.220705] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:13:34.220996] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-27T17:13:34.221090] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:13:34.221137] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-27T17:13:34.221197] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:13:34.221267] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-27T17:13:34.221331] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-27T17:13:34.221367] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-27T17:13:34.221406] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-27T17:13:34.221450] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 1.3s. Estimated remaining: 4h 22m 15s. Rate: 8.6 symbols/min [2025-10-27T17:13:34.386944] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:34.405537] [DEBUG] [LOCAL ] ANRO: Loaded 20129 existing records from primary storage. [2025-10-27T17:13:34.405795] [INFO ] [MAIN ] ANRO: Loaded 20129 existing records. [2025-10-27T17:13:34.583102] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:13:34.583304] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-27T17:13:34.583373] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-27T17:13:34.583589] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-27T17:13:34.583634] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-27T17:13:34.823581] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-27T17:13:34.970777] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:13:35.062950] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:13:35.614969] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-27T17:13:36.415010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-27T17:13:36.659816] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T17:13:37.220335] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-27T17:13:37.228564] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:13:38.014936] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-27T17:13:38.287044] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-27T17:13:38.814947] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-27T17:13:39.614929] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-27T17:13:39.797903] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:13:39.833383] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-27T17:13:40.415001] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-27T17:13:40.459320] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:13:41.040437] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T17:13:41.214941] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-27T17:13:42.018980] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-27T17:13:42.023244] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:13:42.290217] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:13:42.814914] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-27T17:13:43.467238] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:13:43.614953] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-27T17:13:44.414937] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-27T17:13:44.589402] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:13:44.744593] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T17:13:45.200398] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T17:13:45.214917] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-27T17:13:46.014987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-27T17:13:46.667617] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:13:46.673674] [INFO ] [REMOTE ] AN: Full fetch complete (47236 records). [2025-10-27T17:13:46.673805] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-27T17:13:46.821759] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-27T17:13:47.059872] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-27T17:13:47.059956] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-27T17:13:47.060478] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-27T17:13:47.060522] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-27T17:13:47.061689] [DEBUG] [LOCAL ] AN: Trimmed 47236 records to 30923 (keeping 200 days of data) [2025-10-27T17:13:47.244054] [DEBUG] [LOCAL ] AN: Primary data saved (30923 records). [2025-10-27T17:13:47.244196] [INFO ] [MAIN ] AN: Full history saved. [2025-10-27T17:13:47.244274] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AN took 28.1s. Estimated remaining: 4h 24m 4s. Rate: 8.5 symbols/min [2025-10-27T17:13:47.614946] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-27T17:13:48.316970] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:13:48.415002] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-27T17:13:48.469230] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:13:49.214919] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-27T17:13:49.276542] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:13:49.984827] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:13:50.015002] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-27T17:13:50.723700] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-27T17:13:50.814921] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-27T17:13:51.614986] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-27T17:13:52.002277] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:13:52.414942] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-27T17:13:52.649797] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T17:13:53.214972] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-27T17:13:53.307636] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:13:54.015009] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-27T17:13:54.169374] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:13:54.180067] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-27T17:13:54.180221] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-27T17:13:54.624029] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-27T17:13:54.624614] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-27T17:13:54.626001] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-27T17:13:54.627845] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-27T17:13:54.627720] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-27T17:13:54.641536] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-27T17:13:54.654059] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T17:13:54.825381] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-27T17:13:54.978296] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-27T17:13:54.978436] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-27T17:13:54.979217] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANET took 33.6s. Estimated remaining: 4h 24m 10s. Rate: 8.5 symbols/min [2025-10-27T17:13:55.614954] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-27T17:13:56.160811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T17:13:56.414919] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-27T17:13:57.019739] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T17:13:57.031070] [INFO ] [REMOTE ] ANF: Full fetch complete (75805 records). [2025-10-27T17:13:57.031205] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-27T17:13:57.479067] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-27T17:13:57.479214] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-27T17:13:57.480087] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-27T17:13:57.480151] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-27T17:13:57.481567] [DEBUG] [LOCAL ] ANF: Trimmed 75805 records to 51990 (keeping 200 days of data) [2025-10-27T17:13:57.709720] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T17:13:57.737263] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-27T17:13:57.820214] [DEBUG] [LOCAL ] ANF: Primary data saved (51990 records). [2025-10-27T17:13:57.820356] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-27T17:13:57.821809] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANF took 32.6s. Estimated remaining: 4h 22m 44s. Rate: 8.6 symbols/min [2025-10-27T17:13:59.182110] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:13:59.187925] [INFO ] [REMOTE ] ANRO: Full fetch complete (30413 records). [2025-10-27T17:13:59.188007] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-27T17:13:59.188448] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:13:59.188527] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:13:59.188569] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:13:59.188605] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-27T17:13:59.188684] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-27T17:13:59.188738] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-27T17:13:59.188905] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-27T17:13:59.188987] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANRO took 25.0s. Estimated remaining: 4h 20m 51s. Rate: 8.6 symbols/min [2025-10-27T17:13:59.790902] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.879959] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.884991] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.900261] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-27T17:13:59.919213] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:13:59.915723] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-27T17:13:59.919988] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-27T17:13:59.920044] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-27T17:13:59.920087] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-27T17:13:59.920118] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-27T17:14:00.055909] [DEBUG] [LOCAL ] ANVS: Loaded 24280 existing records from primary storage. [2025-10-27T17:14:00.056546] [DEBUG] [LOCAL ] AOD: Loaded 31268 existing records from primary storage. [2025-10-27T17:14:00.073015] [INFO ] [MAIN ] ANVS: Loaded 24280 existing records. [2025-10-27T17:14:00.073420] [INFO ] [MAIN ] AOD: Loaded 31268 existing records. [2025-10-27T17:14:00.087158] [DEBUG] [LOCAL ] AOMR: Loaded 16465 existing records from primary storage. [2025-10-27T17:14:00.102766] [INFO ] [MAIN ] AOMR: Loaded 16465 existing records. [2025-10-27T17:14:00.761461] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.798964] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.838860] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.804635] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.847711] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:00.844177] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-27T17:14:00.853297] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-27T17:14:00.872032] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-27T17:14:00.872150] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-27T17:14:00.886509] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-27T17:14:00.904527] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-27T17:14:00.880870] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-27T17:14:00.904990] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-27T17:14:00.905061] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-27T17:14:00.905271] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-27T17:14:00.940426] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:01.030958] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-27T17:14:01.595637] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:14:01.707083] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-27T17:14:01.775544] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:14:01.822459] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-27T17:14:01.904076] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:14:01.973795] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-27T17:14:02.043997] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-27T17:14:02.107232] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-27T17:14:02.110710] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.150710] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-27T17:14:02.185077] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.178508] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-27T17:14:02.207034] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 3.0s. Estimated remaining: 4h 19m 31s. Rate: 8.7 symbols/min [2025-10-27T17:14:02.213223] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.213963] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-27T17:14:02.244428] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-27T17:14:02.408397] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:02.454778] [DEBUG] [LOCAL ] AON: Loaded 45634 existing records from primary storage. [2025-10-27T17:14:02.455105] [INFO ] [MAIN ] AON: Loaded 45634 existing records. [2025-10-27T17:14:02.634739] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:02.635011] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-27T17:14:02.635059] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-27T17:14:02.635236] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-27T17:14:02.635272] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-27T17:14:02.991919] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:02.992291] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-27T17:14:03.442337] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:14:03.449484] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-27T17:14:03.675263] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:14:03.678951] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-27T17:14:03.772919] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T17:14:03.778629] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-27T17:14:04.779542] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T17:14:04.788142] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-27T17:14:04.832230] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:14:04.860011] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:14:05.184056] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:14:05.214896] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-27T17:14:05.943122] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:14:06.026556] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-27T17:14:06.029693] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:14:06.814943] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-27T17:14:06.984387] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:14:07.505385] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T17:14:07.615040] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-27T17:14:08.414964] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-27T17:14:08.619363] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T17:14:09.214996] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-27T17:14:09.719060] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:14:10.014968] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-27T17:14:10.215798] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:14:10.814950] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-27T17:14:11.180027] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:14:11.615000] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-27T17:14:12.112422] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T17:14:12.414995] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-27T17:14:12.658429] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:14:13.010709] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T17:14:13.215008] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-27T17:14:14.014943] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-27T17:14:14.178786] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:14:14.814941] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-27T17:14:15.614942] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-27T17:14:16.122587] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T17:14:16.325188] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:14:16.414957] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-27T17:14:17.172034] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:14:17.203477] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T17:14:17.214888] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-27T17:14:17.862236] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T17:14:17.865249] [INFO ] [REMOTE ] AOMR: Full fetch complete (23074 records). [2025-10-27T17:14:17.865327] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-27T17:14:18.020045] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-27T17:14:18.267434] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-27T17:14:18.267562] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-27T17:14:18.268013] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-27T17:14:18.268079] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-27T17:14:18.268954] [DEBUG] [LOCAL ] AOMR: Trimmed 23074 records to 16054 (keeping 200 days of data) [2025-10-27T17:14:18.370189] [DEBUG] [LOCAL ] AOMR: Primary data saved (16054 records). [2025-10-27T17:14:18.370419] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-27T17:14:18.370521] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 19.2s. Estimated remaining: 4h 22m 14s. Rate: 8.6 symbols/min [2025-10-27T17:14:18.543857] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:18.573859] [DEBUG] [LOCAL ] AORT: Loaded 29251 existing records from primary storage. [2025-10-27T17:14:18.574237] [INFO ] [MAIN ] AORT: Loaded 29251 existing records. [2025-10-27T17:14:18.755153] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:18.755439] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-27T17:14:18.755491] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-27T17:14:18.755731] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-27T17:14:18.755789] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-27T17:14:18.820103] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-27T17:14:19.164699] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:19.451178] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:14:19.614901] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-27T17:14:20.003045] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:14:20.401342] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T17:14:20.414923] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-27T17:14:21.215007] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-27T17:14:21.599698] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:14:22.014941] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-27T17:14:22.814974] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-27T17:14:23.018769] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:14:23.060295] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:14:23.500492] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:14:23.614989] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-27T17:14:24.415013] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-27T17:14:24.608157] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:14:25.214951] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-27T17:14:25.994165] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:14:26.014905] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-27T17:14:26.227002] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:14:26.815001] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-27T17:14:27.614990] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-27T17:14:27.691167] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:14:27.938016] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:14:28.415005] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-27T17:14:28.579349] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:14:28.586063] [INFO ] [REMOTE ] AOD: Full fetch complete (44864 records). [2025-10-27T17:14:28.586211] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-27T17:14:28.961127] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-27T17:14:28.961202] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-27T17:14:28.961691] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-27T17:14:28.961753] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-27T17:14:28.962732] [DEBUG] [LOCAL ] AOD: Trimmed 44864 records to 30589 (keeping 200 days of data) [2025-10-27T17:14:29.137919] [DEBUG] [LOCAL ] AOD: Primary data saved (30589 records). [2025-10-27T17:14:29.138048] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-27T17:14:29.139373] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. AOD took 29.9s. Estimated remaining: 4h 23m 15s. Rate: 8.5 symbols/min [2025-10-27T17:14:29.220174] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-27T17:14:29.309072] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:29.355716] [DEBUG] [LOCAL ] AOS: Loaded 49354 existing records from primary storage. [2025-10-27T17:14:29.356037] [INFO ] [MAIN ] AOS: Loaded 49354 existing records. [2025-10-27T17:14:29.528952] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:29.529152] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-27T17:14:29.529197] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-27T17:14:29.529430] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-27T17:14:29.529467] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-27T17:14:29.883990] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:29.923819] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T17:14:29.933462] [INFO ] [REMOTE ] ANVS: Full fetch complete (36725 records). [2025-10-27T17:14:29.933690] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-27T17:14:30.020151] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-27T17:14:30.311709] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-27T17:14:30.311788] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-27T17:14:30.312190] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-27T17:14:30.312228] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-27T17:14:30.312983] [DEBUG] [LOCAL ] ANVS: Trimmed 36725 records to 23987 (keeping 200 days of data) [2025-10-27T17:14:30.441636] [DEBUG] [LOCAL ] ANVS: Primary data saved (23987 records). [2025-10-27T17:14:30.441802] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-27T17:14:30.441976] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. ANVS took 31.3s. Estimated remaining: 4h 21m 24s. Rate: 8.6 symbols/min [2025-10-27T17:14:30.558720] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:14:30.636742] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:30.645898] [DEBUG] [LOCAL ] AP: Loaded 7509 existing records from primary storage. [2025-10-27T17:14:30.646064] [INFO ] [MAIN ] AP: Loaded 7509 existing records. [2025-10-27T17:14:30.820205] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-27T17:14:30.824926] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:30.825233] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-27T17:14:30.825281] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-27T17:14:30.825447] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-27T17:14:30.825505] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-27T17:14:31.189560] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:31.449626] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:14:31.614987] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-27T17:14:32.226581] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:14:32.414925] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-27T17:14:32.467880] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:14:33.214958] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-27T17:14:33.647064] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:14:33.677990] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T17:14:34.014998] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-27T17:14:34.354132] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T17:14:34.814967] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-27T17:14:35.615037] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-27T17:14:36.350356] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:14:36.415024] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-27T17:14:36.751470] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:14:37.214965] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-27T17:14:37.961348] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T17:14:37.970637] [INFO ] [REMOTE ] AON: Full fetch complete (65222 records). [2025-10-27T17:14:37.970923] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-27T17:14:38.020187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-27T17:14:38.383430] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-27T17:14:38.383629] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-27T17:14:38.384530] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-27T17:14:38.384623] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-27T17:14:38.386659] [DEBUG] [LOCAL ] AON: Trimmed 65222 records to 44854 (keeping 200 days of data) [2025-10-27T17:14:38.656534] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:14:38.731816] [DEBUG] [LOCAL ] AON: Primary data saved (44854 records). [2025-10-27T17:14:38.731947] [INFO ] [MAIN ] AON: Full history saved. [2025-10-27T17:14:38.732403] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 36.5s. Estimated remaining: 4h 21m 41s. Rate: 8.6 symbols/min [2025-10-27T17:14:38.820298] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-27T17:14:38.909338] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:38.945536] [DEBUG] [LOCAL ] APAM: Loaded 36093 existing records from primary storage. [2025-10-27T17:14:38.945841] [INFO ] [MAIN ] APAM: Loaded 36093 existing records. [2025-10-27T17:14:39.132203] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:39.132600] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-27T17:14:39.132699] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-27T17:14:39.133025] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-27T17:14:39.133128] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-27T17:14:39.252086] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:14:39.528964] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:39.614926] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-27T17:14:40.414961] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-27T17:14:40.664476] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T17:14:40.880438] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:14:41.214916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-27T17:14:41.256869] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:14:42.014958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-27T17:14:42.551499] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:14:42.814959] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-27T17:14:43.245074] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:14:43.614977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-27T17:14:44.103474] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:14:44.414999] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-27T17:14:44.478828] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:14:45.214986] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-27T17:14:45.798253] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:14:46.014981] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-27T17:14:46.388012] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:14:46.814964] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-27T17:14:46.890074] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:14:47.311974] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T17:14:47.614974] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-27T17:14:48.414979] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-27T17:14:49.214993] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-27T17:14:49.705232] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:14:49.945054] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:14:50.014956] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-27T17:14:50.620682] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:14:50.814964] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-27T17:14:50.869987] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:14:51.617023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-27T17:14:51.620537] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:14:52.414953] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-27T17:14:52.606354] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:14:52.612039] [INFO ] [REMOTE ] AORT: Full fetch complete (42389 records). [2025-10-27T17:14:52.612160] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-27T17:14:52.987577] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:14:53.022349] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-27T17:14:53.022457] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-27T17:14:53.023023] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-27T17:14:53.023089] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-27T17:14:53.024522] [DEBUG] [LOCAL ] AORT: Trimmed 42389 records to 28591 (keeping 200 days of data) [2025-10-27T17:14:53.193955] [DEBUG] [LOCAL ] AORT: Primary data saved (28591 records). [2025-10-27T17:14:53.194146] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-27T17:14:53.194239] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AORT took 34.8s. Estimated remaining: 4h 23m 46s. Rate: 8.5 symbols/min [2025-10-27T17:14:53.220035] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-27T17:14:53.374471] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:53.425097] [DEBUG] [LOCAL ] APD: Loaded 46082 existing records from primary storage. [2025-10-27T17:14:53.425557] [INFO ] [MAIN ] APD: Loaded 46082 existing records. [2025-10-27T17:14:53.614700] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:53.615007] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-27T17:14:53.615062] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-27T17:14:53.615319] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-27T17:14:53.615376] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-27T17:14:53.991791] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:54.014938] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-27T17:14:54.645622] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T17:14:54.814966] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-27T17:14:55.614970] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-27T17:14:55.968259] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T17:14:56.388105] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:14:56.398449] [INFO ] [REMOTE ] AOS: Full fetch complete (71067 records). [2025-10-27T17:14:56.398718] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-27T17:14:56.422554] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-27T17:14:56.834113] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-27T17:14:56.834320] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-27T17:14:56.835185] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-27T17:14:56.830303] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:14:56.835414] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-27T17:14:56.840935] [DEBUG] [LOCAL ] AOS: Trimmed 71067 records to 48566 (keeping 200 days of data) [2025-10-27T17:14:57.140137] [DEBUG] [LOCAL ] AOS: Primary data saved (48566 records). [2025-10-27T17:14:57.140324] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-27T17:14:57.141259] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AOS took 28.0s. Estimated remaining: 4h 22m 44s. Rate: 8.5 symbols/min [2025-10-27T17:14:57.220102] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-27T17:14:57.316960] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:14:57.373482] [DEBUG] [LOCAL ] APG: Loaded 51359 existing records from primary storage. [2025-10-27T17:14:57.373927] [INFO ] [MAIN ] APG: Loaded 51359 existing records. [2025-10-27T17:14:57.577433] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:14:57.577974] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-27T17:14:57.578092] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-27T17:14:57.578739] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-27T17:14:57.578849] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-27T17:14:57.741742] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T17:14:57.937588] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:14:58.022164] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-27T17:14:58.028098] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:14:58.814979] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-27T17:14:59.611807] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:14:59.620714] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-27T17:15:00.414994] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-27T17:15:00.478526] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:15:00.617804] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T17:15:01.215025] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-27T17:15:02.015061] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-27T17:15:02.815009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-27T17:15:03.012110] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:15:03.014281] [INFO ] [REMOTE ] AP: Full fetch complete (9166 records). [2025-10-27T17:15:03.014374] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-27T17:15:03.414543] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-27T17:15:03.415195] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-27T17:15:03.415573] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-27T17:15:03.415809] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-27T17:15:03.416701] [DEBUG] [LOCAL ] AP: Trimmed 9166 records to 7468 (keeping 200 days of data) [2025-10-27T17:15:03.488630] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-27T17:15:03.506868] [DEBUG] [LOCAL ] AP: Primary data saved (7468 records). [2025-10-27T17:15:03.537705] [INFO ] [MAIN ] AP: Full history saved. [2025-10-27T17:15:03.537980] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AP took 33.1s. Estimated remaining: 4h 22m 26s. Rate: 8.5 symbols/min [2025-10-27T17:15:03.588376] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-10-27T17:15:03.626174] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-27T17:15:03.740148] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:03.795222] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-27T17:15:03.795664] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-10-27T17:15:03.988060] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:03.988462] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-27T17:15:03.988525] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-27T17:15:03.988839] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-27T17:15:03.988900] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-27T17:15:04.357768] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:04.414999] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-27T17:15:04.742633] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:15:05.092696] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:15:05.215008] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-27T17:15:06.015055] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-27T17:15:06.814946] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-27T17:15:07.075790] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-27T17:15:07.465260] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T17:15:07.577848] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-27T17:15:07.615056] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-27T17:15:08.286243] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:15:08.415020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-27T17:15:09.083099] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T17:15:09.089582] [INFO ] [REMOTE ] APAM: Full fetch complete (51909 records). [2025-10-27T17:15:09.089702] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-27T17:15:09.226561] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-27T17:15:09.466911] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-27T17:15:09.467039] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-27T17:15:09.467633] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-27T17:15:09.467720] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-27T17:15:09.468743] [DEBUG] [LOCAL ] APAM: Trimmed 51909 records to 35313 (keeping 200 days of data) [2025-10-27T17:15:09.674763] [DEBUG] [LOCAL ] APAM: Primary data saved (35313 records). [2025-10-27T17:15:09.674886] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-27T17:15:09.675294] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 30.9s. Estimated remaining: 4h 22m 3s. Rate: 8.5 symbols/min [2025-10-27T17:15:09.844541] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:09.893433] [DEBUG] [LOCAL ] APLE: Loaded 52707 existing records from primary storage. [2025-10-27T17:15:09.893750] [INFO ] [MAIN ] APLE: Loaded 52707 existing records. [2025-10-27T17:15:10.020067] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-27T17:15:10.099902] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:10.100283] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-27T17:15:10.100353] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-27T17:15:10.100706] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-27T17:15:10.100763] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-27T17:15:10.492401] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:10.522257] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-27T17:15:10.814924] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-27T17:15:11.521525] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:15:11.614904] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-27T17:15:11.778506] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-27T17:15:12.414970] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-27T17:15:12.635934] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T17:15:12.868325] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:15:13.214973] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-27T17:15:13.759208] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T17:15:14.014959] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-27T17:15:14.463990] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:15:14.814939] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-27T17:15:15.614917] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-27T17:15:15.968779] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T17:15:16.166404] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:15:16.414944] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-27T17:15:17.214997] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-27T17:15:17.934045] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T17:15:18.014951] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-27T17:15:18.048771] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:15:18.550530] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T17:15:18.815014] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-27T17:15:19.466274] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:15:19.614913] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-27T17:15:20.171318] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:15:20.414968] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-27T17:15:21.214964] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-27T17:15:21.624774] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-27T17:15:21.986417] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T17:15:22.014927] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-27T17:15:22.814928] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-27T17:15:22.979744] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:15:23.615001] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-27T17:15:23.760344] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:15:24.414913] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-27T17:15:24.518601] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:15:25.087122] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:15:25.214911] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-27T17:15:26.015031] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-27T17:15:26.050986] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T17:15:26.815013] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-27T17:15:26.894884] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:15:27.614929] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-27T17:15:27.687506] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T17:15:27.696299] [INFO ] [REMOTE ] APD: Full fetch complete (67277 records). [2025-10-27T17:15:27.696408] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-27T17:15:28.081387] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-27T17:15:28.081488] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-27T17:15:28.082220] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-27T17:15:28.082284] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-27T17:15:28.083738] [DEBUG] [LOCAL ] APD: Trimmed 67277 records to 45282 (keeping 200 days of data) [2025-10-27T17:15:28.367451] [DEBUG] [LOCAL ] APD: Primary data saved (45282 records). [2025-10-27T17:15:28.367585] [INFO ] [MAIN ] APD: Full history saved. [2025-10-27T17:15:28.368701] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 35.2s. Estimated remaining: 4h 25m 17s. Rate: 8.4 symbols/min [2025-10-27T17:15:28.422910] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-27T17:15:28.539136] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:28.593400] [DEBUG] [LOCAL ] APO: Loaded 54163 existing records from primary storage. [2025-10-27T17:15:28.593729] [INFO ] [MAIN ] APO: Loaded 54163 existing records. [2025-10-27T17:15:28.781754] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:28.782068] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-27T17:15:28.782181] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-27T17:15:28.782583] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-27T17:15:28.782730] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-27T17:15:29.135804] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T17:15:29.225846] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:29.226838] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-27T17:15:29.252457] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T17:15:29.262167] [INFO ] [REMOTE ] APG: Full fetch complete (71911 records). [2025-10-27T17:15:29.262340] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-27T17:15:29.263283] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:15:29.263383] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:15:29.263427] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:15:29.263467] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-27T17:15:29.263568] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-27T17:15:29.263636] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-27T17:15:29.263864] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-27T17:15:29.264744] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 32.1s. Estimated remaining: 4h 23m 24s. Rate: 8.5 symbols/min [2025-10-27T17:15:29.433743] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:29.444038] [DEBUG] [LOCAL ] APOS: Loaded 7137 existing records from primary storage. [2025-10-27T17:15:29.444286] [INFO ] [MAIN ] APOS: Loaded 7137 existing records. [2025-10-27T17:15:29.621305] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:29.621505] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-27T17:15:29.621551] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-27T17:15:29.621741] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-27T17:15:29.621798] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-27T17:15:29.980069] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:30.014903] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-27T17:15:30.073713] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T17:15:30.813411] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:15:30.823068] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-27T17:15:30.839851] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T17:15:31.614986] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-27T17:15:32.233604] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:15:32.414966] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-27T17:15:32.586175] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:15:33.214959] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-27T17:15:34.015014] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-27T17:15:34.181515] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:15:34.753010] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T17:15:34.814918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-27T17:15:35.021598] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:15:35.614932] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-27T17:15:35.724179] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:15:36.414918] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-27T17:15:37.214943] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-27T17:15:37.262229] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T17:15:37.944603] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:15:38.014942] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-27T17:15:38.486000] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:15:38.496260] [INFO ] [REMOTE ] APH: Full fetch complete (77870 records). [2025-10-27T17:15:38.496392] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-27T17:15:38.612443] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:15:38.820027] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-27T17:15:38.891980] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-27T17:15:38.892055] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-27T17:15:38.892789] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-27T17:15:38.892852] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-27T17:15:38.894322] [DEBUG] [LOCAL ] APH: Trimmed 77870 records to 53691 (keeping 200 days of data) [2025-10-27T17:15:39.220782] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-27T17:15:39.220940] [INFO ] [MAIN ] APH: Full history saved. [2025-10-27T17:15:39.221051] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 35.7s. Estimated remaining: 4h 24m 5s. Rate: 8.5 symbols/min [2025-10-27T17:15:39.341684] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:15:39.397175] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:39.446316] [DEBUG] [LOCAL ] APTV: Loaded 52575 existing records from primary storage. [2025-10-27T17:15:39.446628] [INFO ] [MAIN ] APTV: Loaded 52575 existing records. [2025-10-27T17:15:39.620747] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-27T17:15:39.625431] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:39.626540] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-27T17:15:39.626627] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-27T17:15:39.626872] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-27T17:15:39.626920] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-27T17:15:39.976782] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:40.414998] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-27T17:15:40.956420] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T17:15:41.214966] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-27T17:15:41.885691] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:15:42.014957] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-27T17:15:42.588591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T17:15:42.814975] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-27T17:15:43.487762] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:15:43.614928] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-27T17:15:44.396907] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:15:44.407126] [INFO ] [REMOTE ] APLE: Full fetch complete (74772 records). [2025-10-27T17:15:44.407287] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-27T17:15:44.420581] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-27T17:15:44.801184] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-27T17:15:44.801267] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-27T17:15:44.802066] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-27T17:15:44.802130] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-27T17:15:44.803520] [DEBUG] [LOCAL ] APLE: Trimmed 74772 records to 51909 (keeping 200 days of data) [2025-10-27T17:15:45.116548] [DEBUG] [LOCAL ] APLE: Primary data saved (51909 records). [2025-10-27T17:15:45.116829] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-27T17:15:45.117246] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APLE took 35.4s. Estimated remaining: 4h 23m 38s. Rate: 8.5 symbols/min [2025-10-27T17:15:45.219541] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-27T17:15:45.295888] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:45.347520] [DEBUG] [LOCAL ] AQN: Loaded 52380 existing records from primary storage. [2025-10-27T17:15:45.347913] [INFO ] [MAIN ] AQN: Loaded 52380 existing records. [2025-10-27T17:15:45.529856] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:45.530215] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-27T17:15:45.530264] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-27T17:15:45.546885] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-27T17:15:45.558927] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-27T17:15:45.592421] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T17:15:45.946961] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:45.948078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:15:45.982597] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:15:46.014943] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-27T17:15:46.814932] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-27T17:15:47.407591] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:15:47.614961] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-27T17:15:48.414971] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-27T17:15:48.650567] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:15:48.654934] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-27T17:15:48.656432] [INFO ] [REMOTE ] APOS: Full fetch complete (10222 records). [2025-10-27T17:15:48.667998] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-27T17:15:49.029804] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-27T17:15:49.029882] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-27T17:15:49.030123] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-27T17:15:49.030163] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-27T17:15:49.030564] [DEBUG] [LOCAL ] APOS: Trimmed 10222 records to 6830 (keeping 200 days of data) [2025-10-27T17:15:49.071240] [DEBUG] [LOCAL ] APOS: Primary data saved (6830 records). [2025-10-27T17:15:49.071334] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-27T17:15:49.071409] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APOS took 19.8s. Estimated remaining: 4h 22m 39s. Rate: 8.5 symbols/min [2025-10-27T17:15:49.219270] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-27T17:15:49.240181] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:15:49.246011] [DEBUG] [LOCAL ] AQNB: Loaded 3910 existing records from primary storage. [2025-10-27T17:15:49.246163] [INFO ] [MAIN ] AQNB: Loaded 3910 existing records. [2025-10-27T17:15:49.425187] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:15:49.425530] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-27T17:15:49.425600] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-27T17:15:49.425842] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-27T17:15:49.425898] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-27T17:15:49.771058] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:15:50.014927] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-27T17:15:50.193933] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T17:15:50.597425] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T17:15:50.764536] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:15:50.814905] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-27T17:15:51.614958] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-27T17:15:51.619141] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:15:52.414945] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-27T17:15:52.925828] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T17:15:53.155397] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:15:53.214899] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-27T17:15:54.014992] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-27T17:15:54.389894] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T17:15:54.814967] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-27T17:15:54.968442] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:15:55.614945] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-27T17:15:56.049995] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:15:56.414916] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-27T17:15:56.642898] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T17:15:57.022265] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:15:57.214983] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-27T17:15:58.015011] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-27T17:15:58.814972] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-27T17:15:59.235157] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:15:59.433118] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-27T17:15:59.614905] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-27T17:15:59.815315] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T17:16:00.414961] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-27T17:16:01.214955] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-27T17:16:01.673468] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T17:16:02.015185] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-27T17:16:02.641782] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:16:02.815309] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-27T17:16:02.961273] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-27T17:16:03.614973] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-27T17:16:03.730784] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T17:16:04.348288] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:16:04.414932] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-27T17:16:05.214999] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-27T17:16:06.014988] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-27T17:16:06.230439] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-27T17:16:06.554037] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-27T17:16:06.584514] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T17:16:06.814963] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-27T17:16:07.305366] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:16:07.614961] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-27T17:16:08.414994] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-27T17:16:08.642412] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:16:08.652589] [INFO ] [REMOTE ] APO: Full fetch complete (77454 records). [2025-10-27T17:16:08.652755] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-27T17:16:09.040573] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-27T17:16:09.040677] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-27T17:16:09.041446] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-27T17:16:09.041490] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-27T17:16:09.042917] [DEBUG] [LOCAL ] APO: Trimmed 77454 records to 53373 (keeping 200 days of data) [2025-10-27T17:16:09.227821] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-27T17:16:09.379022] [DEBUG] [LOCAL ] APO: Primary data saved (53373 records). [2025-10-27T17:16:09.379166] [INFO ] [MAIN ] APO: Full history saved. [2025-10-27T17:16:09.380210] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 41.0s. Estimated remaining: 4h 26m 11s. Rate: 8.4 symbols/min [2025-10-27T17:16:09.486325] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T17:16:09.487913] [INFO ] [REMOTE ] AQNB: Full fetch complete (5357 records). [2025-10-27T17:16:09.488832] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-27T17:16:09.604680] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:09.627971] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T17:16:09.957628] [DEBUG] [LOCAL ] AR: Loaded 54367 existing records from primary storage. [2025-10-27T17:16:09.982600] [INFO ] [MAIN ] AR: Loaded 54367 existing records. [2025-10-27T17:16:10.042856] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-27T17:16:10.050704] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-27T17:16:10.063689] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-27T17:16:10.076484] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-27T17:16:10.105029] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-27T17:16:10.138200] [DEBUG] [LOCAL ] AQNB: Trimmed 5357 records to 3764 (keeping 200 days of data) [2025-10-27T17:16:10.228106] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:10.230870] [DEBUG] [LOCAL ] AQNB: Primary data saved (3764 records). [2025-10-27T17:16:10.231027] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-27T17:16:10.231115] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-27T17:16:10.231185] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-27T17:16:10.231297] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AQNB took 21.2s. Estimated remaining: 4h 24m 20s. Rate: 8.4 symbols/min [2025-10-27T17:16:10.242821] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-27T17:16:10.264269] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-27T17:16:10.549852] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:10.804482] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:10.816674] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-27T17:16:10.818269] [DEBUG] [LOCAL ] ARCO: Loaded 44792 existing records from primary storage. [2025-10-27T17:16:10.818491] [INFO ] [MAIN ] ARCO: Loaded 44792 existing records. [2025-10-27T17:16:11.010123] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:11.010384] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-27T17:16:11.010436] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-27T17:16:11.010785] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-27T17:16:11.010842] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-27T17:16:11.365891] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:11.401223] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T17:16:11.614925] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-27T17:16:11.759496] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:16:12.421912] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-27T17:16:12.448079] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T17:16:13.081286] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:16:13.214924] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-27T17:16:13.935632] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:16:14.014932] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-27T17:16:14.814991] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-27T17:16:15.492721] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:16:15.582240] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T17:16:15.614911] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-27T17:16:15.746047] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:16:15.755751] [INFO ] [REMOTE ] APTV: Full fetch complete (75744 records). [2025-10-27T17:16:15.755886] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-27T17:16:16.131461] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-27T17:16:16.131540] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-27T17:16:16.132284] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-27T17:16:16.132349] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-27T17:16:16.133777] [DEBUG] [LOCAL ] APTV: Trimmed 75744 records to 51758 (keeping 200 days of data) [2025-10-27T17:16:16.415697] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-27T17:16:16.430851] [DEBUG] [LOCAL ] APTV: Primary data saved (51758 records). [2025-10-27T17:16:16.431009] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-27T17:16:16.432096] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. APTV took 37.2s. Estimated remaining: 4h 23m 58s. Rate: 8.4 symbols/min [2025-10-27T17:16:16.614619] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:16.632049] [DEBUG] [LOCAL ] ARDC: Loaded 15417 existing records from primary storage. [2025-10-27T17:16:16.632285] [INFO ] [MAIN ] ARDC: Loaded 15417 existing records. [2025-10-27T17:16:16.812292] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:16.812512] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-27T17:16:16.812564] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-27T17:16:16.812760] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-27T17:16:16.812821] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-27T17:16:17.183748] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:17.209101] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:16:17.217354] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-27T17:16:17.963989] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:16:18.015018] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-27T17:16:18.150093] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T17:16:18.814933] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-27T17:16:19.128938] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:16:19.615007] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-27T17:16:20.417094] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-27T17:16:20.419471] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T17:16:20.702556] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:16:21.215009] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-27T17:16:22.014930] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-27T17:16:22.087908] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:16:22.814955] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-27T17:16:22.884254] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T17:16:23.614913] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-27T17:16:23.675020] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T17:16:23.880371] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:16:24.414940] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-27T17:16:25.144456] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:16:25.154611] [INFO ] [REMOTE ] AQN: Full fetch complete (74918 records). [2025-10-27T17:16:25.155252] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-27T17:16:25.157299] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:16:25.157464] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:16:25.157517] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:16:25.157637] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-27T17:16:25.157755] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-27T17:16:25.157798] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-27T17:16:25.158022] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-27T17:16:25.158513] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 40.0s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-10-27T17:16:25.228087] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-27T17:16:25.348548] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:25.381995] [DEBUG] [LOCAL ] ARDT: Loaded 27853 existing records from primary storage. [2025-10-27T17:16:25.382367] [INFO ] [MAIN ] ARDT: Loaded 27853 existing records. [2025-10-27T17:16:25.571608] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:25.571964] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-27T17:16:25.572025] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-27T17:16:25.572303] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-27T17:16:25.572352] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-27T17:16:25.965712] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:26.005715] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T17:16:26.007018] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T17:16:26.016617] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-27T17:16:26.814963] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-27T17:16:27.165687] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:16:27.614949] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-27T17:16:28.375019] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:16:28.414925] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-27T17:16:28.628341] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:16:29.214935] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-27T17:16:30.014922] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-27T17:16:30.093209] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T17:16:30.131270] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:16:30.814982] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-27T17:16:31.234791] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:16:31.408599] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:16:31.614998] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-27T17:16:32.414942] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-27T17:16:32.685924] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:16:33.215014] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-27T17:16:33.548125] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:16:33.949102] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T17:16:34.014905] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-27T17:16:34.814902] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-27T17:16:34.863615] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:16:35.614940] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-27T17:16:36.291346] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T17:16:36.414911] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-27T17:16:36.794746] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T17:16:37.214999] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-27T17:16:37.613473] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:16:37.617311] [INFO ] [REMOTE ] ARDC: Full fetch complete (21681 records). [2025-10-27T17:16:37.617380] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-27T17:16:37.974498] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-27T17:16:37.974576] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-27T17:16:37.974906] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-27T17:16:37.974969] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-27T17:16:37.975541] [DEBUG] [LOCAL ] ARDC: Trimmed 21681 records to 14965 (keeping 200 days of data) [2025-10-27T17:16:38.019364] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-27T17:16:38.065172] [DEBUG] [LOCAL ] ARDC: Primary data saved (14965 records). [2025-10-27T17:16:38.065264] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-27T17:16:38.065334] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. ARDC took 21.6s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-10-27T17:16:38.233122] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:38.279613] [DEBUG] [LOCAL ] ARE: Loaded 51653 existing records from primary storage. [2025-10-27T17:16:38.279931] [INFO ] [MAIN ] ARE: Loaded 51653 existing records. [2025-10-27T17:16:38.453408] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:38.453630] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-27T17:16:38.453711] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-27T17:16:38.453987] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-27T17:16:38.454042] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-27T17:16:38.811005] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:38.814898] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-27T17:16:38.876252] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:16:39.199445] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T17:16:39.614961] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-27T17:16:40.103401] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T17:16:40.414987] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-27T17:16:41.227024] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-27T17:16:41.233999] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T17:16:41.780906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:16:42.014972] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-27T17:16:42.604878] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:16:42.814910] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-27T17:16:43.292226] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:16:43.614950] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-27T17:16:44.027916] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T17:16:44.414946] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-27T17:16:45.214942] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-27T17:16:45.662181] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T17:16:45.671818] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-27T17:16:45.671937] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-27T17:16:45.673237] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:16:45.673322] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:16:45.673389] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:16:45.673462] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-27T17:16:45.673524] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-27T17:16:45.673560] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-27T17:16:45.673705] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-27T17:16:45.673796] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. AR took 36.3s. Estimated remaining: 4h 25m 43s. Rate: 8.4 symbols/min [2025-10-27T17:16:45.842686] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:45.888678] [DEBUG] [LOCAL ] ARES: Loaded 50410 existing records from primary storage. [2025-10-27T17:16:45.889104] [INFO ] [MAIN ] ARES: Loaded 50410 existing records. [2025-10-27T17:16:46.034568] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-27T17:16:46.083211] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:46.099448] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-27T17:16:46.099542] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-27T17:16:46.101007] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:16:46.104510] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-27T17:16:46.110571] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-27T17:16:46.479718] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:46.619679] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T17:16:46.627784] [INFO ] [REMOTE ] ARCO: Full fetch complete (64740 records). [2025-10-27T17:16:46.627932] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-27T17:16:46.824588] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-27T17:16:47.051736] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-27T17:16:47.051854] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-27T17:16:47.052718] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-27T17:16:47.052843] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-27T17:16:47.054848] [DEBUG] [LOCAL ] ARCO: Trimmed 64740 records to 44014 (keeping 200 days of data) [2025-10-27T17:16:47.329058] [DEBUG] [LOCAL ] ARCO: Primary data saved (44014 records). [2025-10-27T17:16:47.329242] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-27T17:16:47.329339] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. ARCO took 37.1s. Estimated remaining: 4h 24m 9s. Rate: 8.4 symbols/min [2025-10-27T17:16:47.502067] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:47.546139] [DEBUG] [LOCAL ] ARI: Loaded 44089 existing records from primary storage. [2025-10-27T17:16:47.546547] [INFO ] [MAIN ] ARI: Loaded 44089 existing records. [2025-10-27T17:16:47.620104] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-27T17:16:47.755149] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:47.755460] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-27T17:16:47.755514] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-27T17:16:47.755887] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-27T17:16:47.755947] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-27T17:16:48.151329] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:48.173072] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T17:16:48.414975] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-27T17:16:49.045002] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T17:16:49.214953] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-27T17:16:49.451773] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:16:49.484856] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T17:16:50.014950] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-27T17:16:50.814918] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-27T17:16:50.855356] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:16:51.186922] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:16:51.614952] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-27T17:16:51.672277] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:16:52.415018] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-27T17:16:52.992706] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:16:53.214934] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-27T17:16:54.014925] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-27T17:16:54.221941] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:16:54.804256] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:16:54.816529] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-27T17:16:55.203202] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T17:16:55.209277] [INFO ] [REMOTE ] ARDT: Full fetch complete (41765 records). [2025-10-27T17:16:55.209369] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-27T17:16:55.584988] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-27T17:16:55.585077] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-27T17:16:55.585560] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-27T17:16:55.585602] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-27T17:16:55.586529] [DEBUG] [LOCAL ] ARDT: Trimmed 41765 records to 27328 (keeping 200 days of data) [2025-10-27T17:16:55.635507] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-27T17:16:55.743586] [DEBUG] [LOCAL ] ARDT: Primary data saved (27328 records). [2025-10-27T17:16:55.743750] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-27T17:16:55.743834] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 30.6s. Estimated remaining: 4h 24m 22s. Rate: 8.4 symbols/min [2025-10-27T17:16:55.914288] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:16:55.956544] [DEBUG] [LOCAL ] ARLO: Loaded 44193 existing records from primary storage. [2025-10-27T17:16:55.956897] [INFO ] [MAIN ] ARLO: Loaded 44193 existing records. [2025-10-27T17:16:56.147033] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:16:56.147329] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-27T17:16:56.147407] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-27T17:16:56.147775] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-27T17:16:56.147833] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-27T17:16:56.415561] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-27T17:16:56.520206] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:16:56.562781] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T17:16:57.214910] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-27T17:16:57.270100] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T17:16:58.014959] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-27T17:16:58.074788] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T17:16:58.814450] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:16:58.823931] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-27T17:16:59.594747] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T17:16:59.614893] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-27T17:16:59.958196] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:17:00.414940] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-27T17:17:01.224357] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-27T17:17:01.225734] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:17:02.014985] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-27T17:17:02.530868] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T17:17:02.815004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-27T17:17:03.614920] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-27T17:17:03.784316] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-27T17:17:03.861977] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T17:17:04.414967] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-27T17:17:04.648492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T17:17:05.004804] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:17:05.215000] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-27T17:17:05.609507] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T17:17:06.014975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-27T17:17:06.753165] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:17:06.814908] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-27T17:17:07.617052] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-27T17:17:07.619516] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:17:07.629221] [INFO ] [REMOTE ] ARE: Full fetch complete (72668 records). [2025-10-27T17:17:07.629328] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-27T17:17:07.630052] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:07.630146] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:07.630216] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:07.630291] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-27T17:17:07.630354] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-27T17:17:07.630389] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-27T17:17:07.630541] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-27T17:17:07.631535] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 29.6s. Estimated remaining: 4h 25m 29s. Rate: 8.4 symbols/min [2025-10-27T17:17:07.824806] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:07.880133] [DEBUG] [LOCAL ] ARMK: Loaded 51086 existing records from primary storage. [2025-10-27T17:17:07.880467] [INFO ] [MAIN ] ARMK: Loaded 51086 existing records. [2025-10-27T17:17:08.070776] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:08.071213] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-27T17:17:08.071285] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-27T17:17:08.071600] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-27T17:17:08.071763] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-27T17:17:08.423561] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-27T17:17:08.458760] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:17:08.464384] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:08.884062] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T17:17:09.214962] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-27T17:17:10.020038] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-27T17:17:10.040551] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:17:10.814968] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-27T17:17:11.179492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:17:11.439583] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:17:11.614910] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-27T17:17:12.414976] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-27T17:17:12.452845] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:17:12.823065] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:17:13.214948] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-27T17:17:13.947044] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:17:14.014910] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-27T17:17:14.814992] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-27T17:17:14.938095] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T17:17:15.179785] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T17:17:15.614942] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-27T17:17:16.415000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-27T17:17:16.670492] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T17:17:16.909861] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:17:16.917817] [INFO ] [REMOTE ] ARI: Full fetch complete (62196 records). [2025-10-27T17:17:16.917918] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-27T17:17:17.220097] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-27T17:17:17.302365] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-27T17:17:17.302437] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-27T17:17:17.303051] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-27T17:17:17.303115] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-27T17:17:17.304237] [DEBUG] [LOCAL ] ARI: Trimmed 62196 records to 43209 (keeping 200 days of data) [2025-10-27T17:17:17.551220] [DEBUG] [LOCAL ] ARI: Primary data saved (43209 records). [2025-10-27T17:17:17.551343] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-27T17:17:17.551419] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARI took 30.2s. Estimated remaining: 4h 26m 4s. Rate: 8.4 symbols/min [2025-10-27T17:17:17.715437] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:17.757866] [DEBUG] [LOCAL ] AROC: Loaded 49804 existing records from primary storage. [2025-10-27T17:17:17.758174] [INFO ] [MAIN ] AROC: Loaded 49804 existing records. [2025-10-27T17:17:17.943983] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:17.944472] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-27T17:17:17.944607] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-27T17:17:17.944971] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-27T17:17:17.945025] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-27T17:17:18.015427] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-27T17:17:18.369678] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:18.372502] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:17:18.814971] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-27T17:17:18.962418] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T17:17:19.314088] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:17:19.614993] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-27T17:17:20.415060] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-27T17:17:20.610850] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:17:21.030466] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:17:21.214968] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-27T17:17:21.974579] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:17:22.014936] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-27T17:17:22.815131] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-27T17:17:23.381502] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:17:23.391419] [INFO ] [REMOTE ] ARES: Full fetch complete (71717 records). [2025-10-27T17:17:23.391572] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-27T17:17:23.620037] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-27T17:17:23.814883] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-27T17:17:23.815023] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-27T17:17:23.815765] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-27T17:17:23.815840] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-27T17:17:23.817151] [DEBUG] [LOCAL ] ARES: Trimmed 71717 records to 49601 (keeping 200 days of data) [2025-10-27T17:17:24.151587] [DEBUG] [LOCAL ] ARES: Primary data saved (49601 records). [2025-10-27T17:17:24.151822] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-27T17:17:24.153173] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARES took 38.5s. Estimated remaining: 4h 25m 48s. Rate: 8.4 symbols/min [2025-10-27T17:17:24.154280] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:17:24.292346] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:17:24.373180] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:24.420673] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-27T17:17:24.422489] [DEBUG] [LOCAL ] ARR: Loaded 52859 existing records from primary storage. [2025-10-27T17:17:24.422896] [INFO ] [MAIN ] ARR: Loaded 52859 existing records. [2025-10-27T17:17:24.603248] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:24.603578] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-27T17:17:24.603633] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-27T17:17:24.603994] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-27T17:17:24.604043] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-27T17:17:24.999086] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:25.057169] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:17:25.214927] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-27T17:17:26.014910] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-27T17:17:26.101174] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:17:26.814928] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-27T17:17:26.924774] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:17:26.932762] [INFO ] [REMOTE ] ARLO: Full fetch complete (62921 records). [2025-10-27T17:17:26.932870] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-27T17:17:26.933545] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:26.933628] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:26.933705] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:26.933775] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-27T17:17:26.933837] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-27T17:17:26.933871] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-27T17:17:26.933985] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-27T17:17:26.935013] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARLO took 31.2s. Estimated remaining: 4h 24m 34s. Rate: 8.4 symbols/min [2025-10-27T17:17:27.106100] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:27.146414] [DEBUG] [LOCAL ] ARW: Loaded 33601 existing records from primary storage. [2025-10-27T17:17:27.146695] [INFO ] [MAIN ] ARW: Loaded 33601 existing records. [2025-10-27T17:17:27.332355] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:27.332706] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-27T17:17:27.332847] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-27T17:17:27.333156] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-27T17:17:27.333267] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-27T17:17:27.616413] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-27T17:17:27.703663] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:17:27.746259] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:28.333293] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T17:17:28.414960] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-27T17:17:29.214953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-27T17:17:29.461226] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:17:29.707618] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T17:17:30.014941] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-27T17:17:30.818558] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-27T17:17:30.823634] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:17:31.184612] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:17:31.614959] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-27T17:17:32.414912] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-27T17:17:32.667463] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:17:33.037765] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T17:17:33.214940] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-27T17:17:33.890432] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:17:34.014917] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-27T17:17:34.400360] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:17:34.814940] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-27T17:17:35.614925] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-27T17:17:35.967301] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T17:17:35.976922] [INFO ] [REMOTE ] ARMK: Full fetch complete (72916 records). [2025-10-27T17:17:35.977094] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-27T17:17:36.388728] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-27T17:17:36.388818] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-27T17:17:36.389602] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-27T17:17:36.389687] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-27T17:17:36.391070] [DEBUG] [LOCAL ] ARMK: Trimmed 72916 records to 50218 (keeping 200 days of data) [2025-10-27T17:17:36.443278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-27T17:17:36.706224] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:17:36.730994] [DEBUG] [LOCAL ] ARMK: Primary data saved (50218 records). [2025-10-27T17:17:36.731452] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-27T17:17:36.732320] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARMK took 29.1s. Estimated remaining: 4h 25m 7s. Rate: 8.4 symbols/min [2025-10-27T17:17:36.895337] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:36.895519] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-27T17:17:36.895555] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-27T17:17:36.895687] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-27T17:17:36.895739] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-27T17:17:36.895780] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-27T17:17:36.895811] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-27T17:17:37.220089] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-27T17:17:37.260483] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:37.397535] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T17:17:37.597749] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:17:38.014938] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-27T17:17:38.601360] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:17:38.814961] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-27T17:17:39.493459] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:17:39.493798] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-27T17:17:39.493908] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:17:39.493953] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-27T17:17:39.493985] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:17:39.494019] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-27T17:17:39.494072] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-27T17:17:39.494106] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-27T17:17:39.494145] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-27T17:17:39.494189] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 2.8s. Estimated remaining: 4h 23m 54s. Rate: 8.4 symbols/min [2025-10-27T17:17:39.620099] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-27T17:17:39.664559] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:39.717660] [DEBUG] [LOCAL ] AS: Loaded 53975 existing records from primary storage. [2025-10-27T17:17:39.717969] [INFO ] [MAIN ] AS: Loaded 53975 existing records. [2025-10-27T17:17:39.894224] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:39.894428] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-27T17:17:39.894474] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-27T17:17:39.894764] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-27T17:17:39.894823] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-27T17:17:40.242542] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:40.414907] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-27T17:17:40.532449] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:17:41.214946] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-27T17:17:41.742740] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:17:42.014908] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-27T17:17:42.067738] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-27T17:17:42.814982] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-27T17:17:42.886596] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:17:43.149042] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:17:43.614953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-27T17:17:44.414966] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-27T17:17:44.854201] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:17:44.864006] [INFO ] [REMOTE ] AROC: Full fetch complete (71463 records). [2025-10-27T17:17:44.864132] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-27T17:17:45.216052] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-27T17:17:45.255773] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-27T17:17:45.255849] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-27T17:17:45.256531] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-27T17:17:45.256593] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-27T17:17:45.257990] [DEBUG] [LOCAL ] AROC: Trimmed 71463 records to 49007 (keeping 200 days of data) [2025-10-27T17:17:45.510253] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:17:45.578637] [DEBUG] [LOCAL ] AROC: Primary data saved (49007 records). [2025-10-27T17:17:45.578796] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-27T17:17:45.578917] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. AROC took 28.0s. Estimated remaining: 4h 23m 31s. Rate: 8.4 symbols/min [2025-10-27T17:17:45.721358] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T17:17:45.797931] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:45.813032] [DEBUG] [LOCAL ] ASA: Loaded 15913 existing records from primary storage. [2025-10-27T17:17:45.813336] [INFO ] [MAIN ] ASA: Loaded 15913 existing records. [2025-10-27T17:17:46.002049] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:46.002291] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-27T17:17:46.002349] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-27T17:17:46.002830] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-27T17:17:46.002888] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-27T17:17:46.024896] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-27T17:17:46.387484] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:46.473361] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T17:17:46.814953] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-27T17:17:47.051878] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:17:47.614991] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-27T17:17:48.113612] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:17:48.414925] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-27T17:17:49.005415] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:17:49.214951] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-27T17:17:50.014920] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-27T17:17:50.357812] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T17:17:50.814941] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-27T17:17:51.460975] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T17:17:51.614944] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-27T17:17:52.110196] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T17:17:52.164265] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T17:17:52.414929] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-27T17:17:52.471506] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:17:53.214912] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-27T17:17:53.525205] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:17:54.014924] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-27T17:17:54.690035] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:17:54.696581] [INFO ] [REMOTE ] ARW: Full fetch complete (48385 records). [2025-10-27T17:17:54.696706] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-27T17:17:54.697420] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:17:54.697511] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:17:54.697554] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:17:54.697591] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-27T17:17:54.697667] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-27T17:17:54.697737] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-27T17:17:54.697913] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-10-27T17:17:54.699178] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. ARW took 27.8s. Estimated remaining: 4h 23m 53s. Rate: 8.4 symbols/min [2025-10-27T17:17:54.820064] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-27T17:17:54.871495] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:17:54.930268] [DEBUG] [LOCAL ] ASAN: Loaded 53499 existing records from primary storage. [2025-10-27T17:17:54.930614] [INFO ] [MAIN ] ASAN: Loaded 53499 existing records. [2025-10-27T17:17:55.107313] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:17:55.107540] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-27T17:17:55.107603] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-27T17:17:55.107834] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-27T17:17:55.107893] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-27T17:17:55.473555] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:17:55.554992] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:17:55.614861] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-27T17:17:56.074196] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-27T17:17:56.330238] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:17:56.414915] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-27T17:17:56.916800] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T17:17:57.214933] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-27T17:17:58.014998] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-27T17:17:58.722357] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:17:58.814949] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-27T17:17:59.614945] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-27T17:18:00.318260] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-27T17:18:00.414916] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-27T17:18:00.593046] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T17:18:00.982673] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:18:01.214990] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-27T17:18:02.015029] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-27T17:18:02.790592] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T17:18:02.814911] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-27T17:18:03.276005] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:18:03.614953] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-27T17:18:03.775369] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-27T17:18:04.258039] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:18:04.414910] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-27T17:18:04.762566] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:18:05.214952] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-27T17:18:05.876804] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:18:06.014916] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-27T17:18:06.514038] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T17:18:06.815159] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-27T17:18:06.840314] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T17:18:06.845355] [INFO ] [REMOTE ] ASA: Full fetch complete (20761 records). [2025-10-27T17:18:06.845448] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-27T17:18:06.846174] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:06.846288] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:06.846374] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:06.846469] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-27T17:18:06.846571] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-27T17:18:06.846619] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-10-27T17:18:06.846883] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-10-27T17:18:06.846985] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ASA took 21.3s. Estimated remaining: 4h 24m 59s. Rate: 8.4 symbols/min [2025-10-27T17:18:07.031783] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:07.086587] [DEBUG] [LOCAL ] ASB: Loaded 50446 existing records from primary storage. [2025-10-27T17:18:07.087066] [INFO ] [MAIN ] ASB: Loaded 50446 existing records. [2025-10-27T17:18:07.285768] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:07.286044] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-27T17:18:07.286098] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-27T17:18:07.286329] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-27T17:18:07.286369] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-27T17:18:07.620066] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-27T17:18:07.680755] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:08.415170] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-27T17:18:08.418447] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:18:09.214928] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-27T17:18:09.727483] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T17:18:09.818479] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:18:10.014949] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-27T17:18:10.655054] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:18:10.815149] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-27T17:18:11.615026] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-27T17:18:11.702278] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:18:12.286024] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:18:12.414936] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-27T17:18:13.214973] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-27T17:18:13.523887] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:18:13.637224] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:18:13.646714] [INFO ] [REMOTE ] ARR: Full fetch complete (75153 records). [2025-10-27T17:18:13.646827] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-27T17:18:13.647464] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:13.647549] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:13.647590] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:13.647679] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-27T17:18:13.647752] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-27T17:18:13.647796] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-27T17:18:13.647929] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-10-27T17:18:13.647993] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ARR took 49.5s. Estimated remaining: 4h 24m 47s. Rate: 8.4 symbols/min [2025-10-27T17:18:13.814937] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:13.820376] [DEBUG] [LOCAL ] ASBA: Loaded 3508 existing records from primary storage. [2025-10-27T17:18:13.820513] [INFO ] [MAIN ] ASBA: Loaded 3508 existing records. [2025-10-27T17:18:13.992545] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:13.992799] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-27T17:18:13.992865] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-27T17:18:13.992990] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-27T17:18:13.993027] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-27T17:18:14.022677] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-27T17:18:14.339700] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:14.567395] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:18:14.814919] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-27T17:18:15.305503] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:18:15.614965] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-27T17:18:15.999768] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T17:18:16.312108] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T17:18:16.414960] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-27T17:18:17.214974] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-27T17:18:17.595885] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T17:18:18.014899] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-27T17:18:18.054299] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T17:18:18.814958] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-27T17:18:19.614940] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-27T17:18:19.744327] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:18:19.967130] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T17:18:20.366236] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:18:20.414918] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-27T17:18:21.214959] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-27T17:18:22.014941] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-27T17:18:22.282114] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T17:18:22.292433] [INFO ] [REMOTE ] AS: Full fetch complete (76926 records). [2025-10-27T17:18:22.292596] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-27T17:18:22.702322] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-27T17:18:22.702400] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-27T17:18:22.703171] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-27T17:18:22.703235] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-27T17:18:22.704732] [DEBUG] [LOCAL ] AS: Trimmed 76926 records to 53194 (keeping 200 days of data) [2025-10-27T17:18:22.818230] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-27T17:18:23.011831] [DEBUG] [LOCAL ] AS: Primary data saved (53194 records). [2025-10-27T17:18:23.012074] [INFO ] [MAIN ] AS: Full history saved. [2025-10-27T17:18:23.013324] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. AS took 43.5s. Estimated remaining: 4h 25m 11s. Rate: 8.3 symbols/min [2025-10-27T17:18:23.133367] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T17:18:23.164934] [INFO ] [REMOTE ] ASAN: Full fetch complete (76239 records). [2025-10-27T17:18:23.175350] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-27T17:18:23.210435] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:23.228934] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:23.228319] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:23.229421] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:23.229592] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-27T17:18:23.229689] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-27T17:18:23.229746] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-10-27T17:18:23.229878] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-10-27T17:18:23.230963] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASAN took 28.5s. Estimated remaining: 4h 23m 24s. Rate: 8.4 symbols/min [2025-10-27T17:18:23.413845] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:23.430341] [DEBUG] [LOCAL ] ASC: Loaded 37801 existing records from primary storage. [2025-10-27T17:18:23.430840] [INFO ] [MAIN ] ASC: Loaded 37801 existing records. [2025-10-27T17:18:23.475737] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T17:18:23.628243] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-27T17:18:23.630568] [DEBUG] [LOCAL ] ASG: Loaded 19621 existing records from primary storage. [2025-10-27T17:18:23.635111] [INFO ] [MAIN ] ASG: Loaded 19621 existing records. [2025-10-27T17:18:23.634935] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:23.672130] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-27T17:18:23.678728] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-27T17:18:23.710453] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-27T17:18:23.726782] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-27T17:18:23.949429] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:23.969191] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-27T17:18:23.969389] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-27T17:18:24.001665] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-27T17:18:24.011740] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-27T17:18:24.051189] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T17:18:24.207617] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-27T17:18:24.349398] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:24.420567] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-27T17:18:24.600262] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:24.838286] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:18:25.214947] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-27T17:18:26.014941] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-27T17:18:26.529500] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:18:26.564256] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:18:26.814949] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-27T17:18:27.614943] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-27T17:18:27.939852] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T17:18:28.414927] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-27T17:18:28.587564] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T17:18:29.214957] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-27T17:18:29.491256] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:18:30.014920] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-27T17:18:30.206768] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:18:30.814939] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-27T17:18:31.239353] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T17:18:31.240698] [INFO ] [REMOTE ] ASBA: Full fetch complete (5134 records). [2025-10-27T17:18:31.240768] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-27T17:18:31.546427] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:18:31.620019] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-27T17:18:31.652700] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-27T17:18:31.652792] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-27T17:18:31.652930] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-27T17:18:31.652968] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-27T17:18:31.653348] [DEBUG] [LOCAL ] ASBA: Trimmed 5134 records to 3407 (keeping 200 days of data) [2025-10-27T17:18:31.673487] [DEBUG] [LOCAL ] ASBA: Primary data saved (3407 records). [2025-10-27T17:18:31.673604] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-27T17:18:31.673703] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASBA took 18.0s. Estimated remaining: 4h 23m 35s. Rate: 8.4 symbols/min [2025-10-27T17:18:31.845067] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:31.866831] [DEBUG] [LOCAL ] ASGI: Loaded 23238 existing records from primary storage. [2025-10-27T17:18:31.867070] [INFO ] [MAIN ] ASGI: Loaded 23238 existing records. [2025-10-27T17:18:32.041128] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:32.041335] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-27T17:18:32.041381] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-27T17:18:32.041547] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-27T17:18:32.041585] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-27T17:18:32.388584] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:32.414901] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-27T17:18:33.214977] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-27T17:18:33.501075] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T17:18:33.563707] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:18:34.014939] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-27T17:18:34.342843] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:18:34.814972] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-27T17:18:35.288063] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:18:35.614939] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-27T17:18:36.414962] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-27T17:18:36.520677] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:18:36.743036] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:18:37.062189] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:18:37.214950] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-27T17:18:38.014955] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-27T17:18:38.236214] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:18:38.814960] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-27T17:18:39.614970] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-27T17:18:39.894965] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T17:18:40.245783] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:18:40.414941] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-27T17:18:40.792413] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:18:41.214996] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-27T17:18:41.443588] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:18:42.014946] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-27T17:18:42.397820] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T17:18:42.407060] [INFO ] [REMOTE ] ASB: Full fetch complete (71958 records). [2025-10-27T17:18:42.407168] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-27T17:18:42.407986] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:42.408073] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:42.408114] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:42.408152] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-27T17:18:42.408206] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-27T17:18:42.408240] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-10-27T17:18:42.408376] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-10-27T17:18:42.408463] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASB took 35.6s. Estimated remaining: 4h 24m 19s. Rate: 8.4 symbols/min [2025-10-27T17:18:42.575629] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:18:42.607978] [DEBUG] [LOCAL ] ASGN: Loaded 37382 existing records from primary storage. [2025-10-27T17:18:42.608277] [INFO ] [MAIN ] ASGN: Loaded 37382 existing records. [2025-10-27T17:18:42.787723] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:18:42.788016] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-27T17:18:42.788211] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-27T17:18:42.788494] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-27T17:18:42.788561] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-27T17:18:42.825336] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-27T17:18:42.910454] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:18:43.167137] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:18:43.614940] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-27T17:18:44.358213] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:18:44.414983] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-27T17:18:44.495679] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T17:18:45.214938] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-27T17:18:45.765863] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:18:45.926160] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T17:18:46.015005] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-27T17:18:46.721142] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:18:46.814955] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-27T17:18:47.614924] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-27T17:18:48.091739] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:18:48.255183] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:18:48.414939] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-27T17:18:49.214912] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-27T17:18:49.688871] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:18:49.951549] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T17:18:50.014926] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-27T17:18:50.722893] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T17:18:50.814964] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-27T17:18:51.614961] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-27T17:18:51.813360] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T17:18:52.414958] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-27T17:18:53.036304] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:18:53.214959] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-27T17:18:53.638717] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:18:53.645966] [INFO ] [REMOTE ] ASC: Full fetch complete (55718 records). [2025-10-27T17:18:53.646124] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-27T17:18:53.647088] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:53.647190] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:53.647236] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:53.647276] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-27T17:18:53.647334] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-27T17:18:53.647370] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-10-27T17:18:53.647592] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-10-27T17:18:53.647725] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASC took 30.6s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-27T17:18:54.014942] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-27T17:18:54.226330] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T17:18:54.814942] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-27T17:18:55.054446] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:18:55.058900] [INFO ] [REMOTE ] ASG: Full fetch complete (30864 records). [2025-10-27T17:18:55.059044] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-27T17:18:55.441123] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-27T17:18:55.441203] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-27T17:18:55.441616] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-27T17:18:55.441700] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-27T17:18:55.442346] [DEBUG] [LOCAL ] ASG: Trimmed 30864 records to 19127 (keeping 200 days of data) [2025-10-27T17:18:55.544778] [DEBUG] [LOCAL ] ASG: Primary data saved (19127 records). [2025-10-27T17:18:55.544900] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-27T17:18:55.545018] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASG took 32.3s. Estimated remaining: 4h 23m 47s. Rate: 8.4 symbols/min [2025-10-27T17:18:55.620948] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-27T17:18:55.632556] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:18:56.415072] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-27T17:18:56.649939] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:18:57.131504] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:18:57.214914] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-27T17:18:58.015053] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-27T17:18:58.475502] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T17:18:58.480097] [INFO ] [REMOTE ] ASGI: Full fetch complete (32653 records). [2025-10-27T17:18:58.480171] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-27T17:18:58.480705] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:18:58.480788] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:18:58.480829] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:18:58.480899] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-27T17:18:58.480960] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-27T17:18:58.480994] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-10-27T17:18:58.481127] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-10-27T17:18:58.481211] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASGI took 26.8s. Estimated remaining: 4h 22m 41s. Rate: 8.4 symbols/min [2025-10-27T17:18:59.652501] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:18:59.660717] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-27T17:19:01.216610] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:19:01.225132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-27T17:19:02.526013] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:19:02.534213] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-27T17:19:03.786910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:19:03.795737] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-27T17:19:04.919048] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T17:19:04.927197] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-27T17:19:06.337984] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T17:19:06.346616] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-27T17:19:07.765993] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:19:07.777332] [INFO ] [REMOTE ] ASGN: Full fetch complete (53864 records). [2025-10-27T17:19:07.777492] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-27T17:19:08.154505] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-27T17:19:08.154580] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-27T17:19:08.155139] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-27T17:19:08.155201] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-27T17:19:08.156250] [DEBUG] [LOCAL ] ASGN: Trimmed 53864 records to 36722 (keeping 200 days of data) [2025-10-27T17:19:08.358302] [DEBUG] [LOCAL ] ASGN: Primary data saved (36722 records). [2025-10-27T17:19:08.358445] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-27T17:19:08.358524] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 25.9s. Estimated remaining: 4h 23m 12s. Rate: 8.4 symbols/min [2025-10-27T17:19:09.086531] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.111192] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.171537] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.203343] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:09.212515] [DEBUG] [LOCAL ] ASIX: Loaded 23254 existing records from primary storage. [2025-10-27T17:19:09.213690] [INFO ] [MAIN ] ASIX: Loaded 23254 existing records. [2025-10-27T17:19:09.368150] [DEBUG] [LOCAL ] ASH: Loaded 37849 existing records from primary storage. [2025-10-27T17:19:09.423921] [DEBUG] [LOCAL ] ASR: Loaded 9542 existing records from primary storage. [2025-10-27T17:19:09.429319] [INFO ] [MAIN ] ASH: Loaded 37849 existing records. [2025-10-27T17:19:09.437965] [INFO ] [MAIN ] ASR: Loaded 9542 existing records. [2025-10-27T17:19:09.462037] [DEBUG] [LOCAL ] ASPN: Loaded 50576 existing records from primary storage. [2025-10-27T17:19:09.479756] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:09.485457] [INFO ] [MAIN ] ASPN: Loaded 50576 existing records. [2025-10-27T17:19:09.485347] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-27T17:19:09.553547] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-27T17:19:09.674401] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-27T17:19:09.750334] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-27T17:19:10.021495] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.117616] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.104975] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.118568] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-27T17:19:10.125742] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-27T17:19:10.141711] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-27T17:19:10.150528] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:10.141877] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.192749] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-27T17:19:10.225826] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-27T17:19:10.225732] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-27T17:19:10.293540] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-27T17:19:10.269105] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-27T17:19:10.421512] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-27T17:19:10.439092] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-27T17:19:10.899173] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:10.943059] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-27T17:19:11.393271] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.454937] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-27T17:19:11.582922] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.598876] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-27T17:19:11.658674] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:11.659063] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-27T17:19:12.432710] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T17:19:12.434624] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-27T17:19:12.450844] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:19:12.454593] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-27T17:19:13.039323] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:19:13.047040] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-27T17:19:13.146087] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:19:13.150182] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-27T17:19:13.672489] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-27T17:19:13.683084] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-27T17:19:13.689348] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T17:19:13.691324] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-27T17:19:14.008860] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T17:19:14.016769] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-27T17:19:14.070172] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:19:14.074487] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-27T17:19:14.214243] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T17:19:14.216573] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-27T17:19:14.741758] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T17:19:14.744821] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-27T17:19:14.869505] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:19:14.875601] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-27T17:19:14.912742] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:19:15.152229] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:19:15.183762] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:19:15.614982] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-27T17:19:16.129682] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T17:19:16.414961] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-27T17:19:16.785041] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T17:19:17.218208] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-27T17:19:17.227919] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:19:18.014996] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-27T17:19:18.428750] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:19:18.814975] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-27T17:19:18.877703] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:19:19.614950] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-27T17:19:20.088184] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:19:20.335088] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T17:19:20.414905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-27T17:19:21.214984] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-27T17:19:21.794731] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T17:19:22.014959] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-27T17:19:22.814902] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-27T17:19:22.920333] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:19:23.063319] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T17:19:23.614913] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-27T17:19:24.196939] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:19:24.414984] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-27T17:19:25.094128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:19:25.214966] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-27T17:19:25.466606] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T17:19:26.014923] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-27T17:19:26.308456] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:19:26.316091] [INFO ] [REMOTE ] ASH: Full fetch complete (55657 records). [2025-10-27T17:19:26.316187] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-27T17:19:26.725238] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-27T17:19:26.725337] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-27T17:19:26.725940] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-27T17:19:26.726003] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-27T17:19:26.727060] [DEBUG] [LOCAL ] ASH: Trimmed 55657 records to 37142 (keeping 200 days of data) [2025-10-27T17:19:26.815481] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-27T17:19:26.975816] [DEBUG] [LOCAL ] ASH: Primary data saved (37142 records). [2025-10-27T17:19:26.977103] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-27T17:19:26.977253] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASH took 18.6s. Estimated remaining: 4h 25m 42s. Rate: 8.3 symbols/min [2025-10-27T17:19:26.976966] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T17:19:27.152320] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:27.202525] [DEBUG] [LOCAL ] ASX: Loaded 53647 existing records from primary storage. [2025-10-27T17:19:27.202871] [INFO ] [MAIN ] ASX: Loaded 53647 existing records. [2025-10-27T17:19:27.390041] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:27.391055] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-27T17:19:27.391107] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-27T17:19:27.391322] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-27T17:19:27.391381] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-27T17:19:27.622150] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-27T17:19:27.750172] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:27.760552] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:19:28.414939] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-27T17:19:29.215004] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-27T17:19:29.320326] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:19:30.014991] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-27T17:19:30.284159] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T17:19:30.309634] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T17:19:30.814971] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-27T17:19:31.313872] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:19:31.614962] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-27T17:19:31.669934] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T17:19:31.675223] [INFO ] [REMOTE ] ASIX: Full fetch complete (31063 records). [2025-10-27T17:19:31.675362] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-27T17:19:32.049753] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-27T17:19:32.049867] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-27T17:19:32.050348] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-27T17:19:32.050394] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-27T17:19:32.051477] [DEBUG] [LOCAL ] ASIX: Trimmed 31063 records to 22673 (keeping 200 days of data) [2025-10-27T17:19:32.190886] [DEBUG] [LOCAL ] ASIX: Primary data saved (22673 records). [2025-10-27T17:19:32.191070] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-27T17:19:32.191171] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASIX took 23.8s. Estimated remaining: 4h 25m 7s. Rate: 8.3 symbols/min [2025-10-27T17:19:32.333805] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:19:32.361758] [INFO ] [REMOTE ] ASR: Full fetch complete (12588 records). [2025-10-27T17:19:32.368477] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-27T17:19:32.417554] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-27T17:19:32.419616] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:32.718289] [DEBUG] [LOCAL ] ATEN: Loaded 38121 existing records from primary storage. [2025-10-27T17:19:32.718776] [INFO ] [MAIN ] ATEN: Loaded 38121 existing records. [2025-10-27T17:19:33.000863] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-27T17:19:33.001403] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-27T17:19:33.005089] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-27T17:19:33.005175] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-27T17:19:33.004630] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:33.005866] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-27T17:19:33.006231] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-27T17:19:33.006326] [DEBUG] [LOCAL ] ASR: Trimmed 12588 records to 9374 (keeping 200 days of data) [2025-10-27T17:19:33.006834] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-27T17:19:33.006913] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-27T17:19:33.186435] [DEBUG] [LOCAL ] ASR: Primary data saved (9374 records). [2025-10-27T17:19:33.202016] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-27T17:19:33.214988] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASR took 24.8s. Estimated remaining: 4h 23m 36s. Rate: 8.4 symbols/min [2025-10-27T17:19:33.215110] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-27T17:19:33.585533] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:33.616107] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:33.644065] [DEBUG] [LOCAL ] ATGE: Loaded 30729 existing records from primary storage. [2025-10-27T17:19:33.644434] [INFO ] [MAIN ] ATGE: Loaded 30729 existing records. [2025-10-27T17:19:33.838062] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:33.850981] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-27T17:19:33.851440] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-27T17:19:33.852854] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:19:33.862267] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-27T17:19:33.862607] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-27T17:19:34.018072] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-27T17:19:34.218469] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:34.814970] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-27T17:19:35.011713] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T17:19:35.614940] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-27T17:19:36.272779] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:19:36.313102] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-27T17:19:36.414934] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-27T17:19:37.022136] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:19:37.214936] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-27T17:19:37.330976] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:19:38.014932] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-27T17:19:38.815154] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-27T17:19:39.237201] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:19:39.614927] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-27T17:19:39.899680] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T17:19:40.107829] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:19:40.414933] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-27T17:19:41.028374] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T17:19:41.214931] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-27T17:19:41.660033] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:19:42.014941] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-27T17:19:42.814940] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-27T17:19:42.908830] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:19:43.056014] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:19:43.614981] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-27T17:19:44.414973] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-27T17:19:44.583124] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:19:44.830184] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T17:19:45.214992] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-27T17:19:45.790777] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:19:46.014985] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-27T17:19:46.736266] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T17:19:46.814924] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-27T17:19:47.569097] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T17:19:47.614915] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-27T17:19:48.414958] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-27T17:19:48.561358] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:19:48.724487] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T17:19:49.214993] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-27T17:19:50.023162] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-27T17:19:50.033162] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:19:50.045221] [INFO ] [REMOTE ] ASPN: Full fetch complete (72577 records). [2025-10-27T17:19:50.045467] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-27T17:19:50.469601] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-27T17:19:50.469766] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-27T17:19:50.470801] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-27T17:19:50.470885] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-27T17:19:50.472930] [DEBUG] [LOCAL ] ASPN: Trimmed 72577 records to 49804 (keeping 200 days of data) [2025-10-27T17:19:50.779919] [DEBUG] [LOCAL ] ASPN: Primary data saved (49804 records). [2025-10-27T17:19:50.780190] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-27T17:19:50.780333] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 42.4s. Estimated remaining: 4h 25m 49s. Rate: 8.3 symbols/min [2025-10-27T17:19:50.820091] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-27T17:19:50.913410] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:19:51.005297] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:51.035439] [DEBUG] [LOCAL ] ATHM: Loaded 31589 existing records from primary storage. [2025-10-27T17:19:51.035792] [INFO ] [MAIN ] ATHM: Loaded 31589 existing records. [2025-10-27T17:19:51.215384] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:51.215704] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-27T17:19:51.215783] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-27T17:19:51.215960] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-27T17:19:51.216000] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-27T17:19:51.591917] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:51.615010] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-27T17:19:51.709815] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T17:19:52.227799] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:19:52.415004] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-27T17:19:52.714613] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T17:19:53.214937] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-27T17:19:53.961499] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:19:54.014963] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-27T17:19:54.366324] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:19:54.814957] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-27T17:19:55.217843] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:19:55.615062] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-27T17:19:56.025795] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:19:56.034271] [INFO ] [REMOTE ] ATEN: Full fetch complete (56540 records). [2025-10-27T17:19:56.034490] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-27T17:19:56.431678] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-27T17:19:56.488888] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-27T17:19:56.488969] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-27T17:19:56.489633] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-27T17:19:56.489722] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-27T17:19:56.490874] [DEBUG] [LOCAL ] ATEN: Trimmed 56540 records to 37301 (keeping 200 days of data) [2025-10-27T17:19:56.724771] [DEBUG] [LOCAL ] ATEN: Primary data saved (37301 records). [2025-10-27T17:19:56.724914] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-27T17:19:56.725289] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATEN took 24.5s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-27T17:19:56.889194] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:19:56.899113] [DEBUG] [LOCAL ] ATHS: Loaded 6543 existing records from primary storage. [2025-10-27T17:19:56.899328] [INFO ] [MAIN ] ATHS: Loaded 6543 existing records. [2025-10-27T17:19:57.070696] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:19:57.070947] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-27T17:19:57.070995] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-27T17:19:57.071139] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-27T17:19:57.071178] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-27T17:19:57.219337] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-27T17:19:57.422826] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:19:57.642761] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-27T17:19:58.014961] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-27T17:19:58.184452] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:19:58.522951] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T17:19:58.814989] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-27T17:19:58.907834] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-27T17:19:59.614976] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-27T17:20:00.054044] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:20:00.078137] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:20:00.414929] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-27T17:20:01.215039] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-27T17:20:02.014941] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-27T17:20:02.077448] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:20:02.610287] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:20:02.814969] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-27T17:20:03.451503] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:20:03.614942] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-27T17:20:04.185046] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:20:04.414942] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-27T17:20:04.674062] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:20:04.680138] [INFO ] [REMOTE ] ATGE: Full fetch complete (45340 records). [2025-10-27T17:20:04.680298] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-27T17:20:05.059377] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-27T17:20:05.059518] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-27T17:20:05.060074] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-27T17:20:05.060191] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-27T17:20:05.061200] [DEBUG] [LOCAL ] ATGE: Trimmed 45340 records to 29886 (keeping 200 days of data) [2025-10-27T17:20:05.218787] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-27T17:20:05.234311] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:20:05.245819] [DEBUG] [LOCAL ] ATGE: Primary data saved (29886 records). [2025-10-27T17:20:05.246573] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-27T17:20:05.246710] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATGE took 32.0s. Estimated remaining: 4h 25m 34s. Rate: 8.3 symbols/min [2025-10-27T17:20:05.409967] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:05.457681] [DEBUG] [LOCAL ] ATI: Loaded 52040 existing records from primary storage. [2025-10-27T17:20:05.458002] [INFO ] [MAIN ] ATI: Loaded 52040 existing records. [2025-10-27T17:20:05.629020] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:05.629222] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-27T17:20:05.629268] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-27T17:20:05.629835] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-27T17:20:05.629917] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-27T17:20:05.975594] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:06.014925] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-27T17:20:06.814956] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-27T17:20:06.846158] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T17:20:07.464794] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T17:20:07.614971] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-27T17:20:07.712836] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:20:08.414960] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-27T17:20:09.215003] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-27T17:20:09.624257] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:20:09.787550] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:20:09.787844] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:20:09.801807] [INFO ] [REMOTE ] ASX: Full fetch complete (76783 records). [2025-10-27T17:20:09.801983] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-27T17:20:10.022829] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-27T17:20:10.201212] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-27T17:20:10.201303] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-27T17:20:10.202078] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-27T17:20:10.202141] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-27T17:20:10.203700] [DEBUG] [LOCAL ] ASX: Trimmed 76783 records to 52859 (keeping 200 days of data) [2025-10-27T17:20:10.507286] [DEBUG] [LOCAL ] ASX: Primary data saved (52859 records). [2025-10-27T17:20:10.507453] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-27T17:20:10.508471] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ASX took 43.5s. Estimated remaining: 4h 25m 0s. Rate: 8.3 symbols/min [2025-10-27T17:20:10.624870] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T17:20:10.690980] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:10.725803] [DEBUG] [LOCAL ] ATKR: Loaded 35299 existing records from primary storage. [2025-10-27T17:20:10.726084] [INFO ] [MAIN ] ATKR: Loaded 35299 existing records. [2025-10-27T17:20:10.820118] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-27T17:20:10.906796] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:10.907011] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-27T17:20:10.907056] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-27T17:20:10.907480] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-27T17:20:10.907538] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-27T17:20:11.250916] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:11.614995] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-27T17:20:12.065692] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:20:12.414992] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-27T17:20:12.770581] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:20:13.214992] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-27T17:20:13.886710] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:20:14.014955] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-27T17:20:14.715048] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:20:14.814928] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-27T17:20:14.911555] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:20:15.614927] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-27T17:20:15.929600] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:20:16.415008] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-27T17:20:16.986387] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T17:20:17.043269] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T17:20:17.214977] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-27T17:20:18.015005] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-27T17:20:18.814993] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-27T17:20:19.614286] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-27T17:20:19.615463] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-27T17:20:19.616066] [INFO ] [REMOTE ] ATHS: Full fetch complete (9517 records). [2025-10-27T17:20:19.616170] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-27T17:20:19.616701] [FATAL] [VALIDATOR ] ATHS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:20:19.617674] [FATAL] [MAIN ] ATHS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:20:19.617745] [WARN ] [MAIN ] ATHS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:20:19.617793] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-27T17:20:19.617850] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-10-27T17:20:19.617887] [INFO ] [LOCAL ] ATHS: Starting deletion of derivative data. [2025-10-27T17:20:19.618024] [DEBUG] [LOCAL ] ATHS: Deleted derivative data file. [2025-10-27T17:20:19.618107] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHS took 22.9s. Estimated remaining: 4h 25m 18s. Rate: 8.3 symbols/min [2025-10-27T17:20:19.807787] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:19.847448] [DEBUG] [LOCAL ] ATMU: Loaded 39070 existing records from primary storage. [2025-10-27T17:20:19.847893] [INFO ] [MAIN ] ATMU: Loaded 39070 existing records. [2025-10-27T17:20:20.031147] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:20.031446] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-27T17:20:20.031503] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-27T17:20:20.031833] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-27T17:20:20.031891] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-27T17:20:20.403688] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:20.414919] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-27T17:20:20.515740] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:20:20.772142] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:20:21.214958] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-27T17:20:21.262569] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-27T17:20:21.837960] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:20:22.014983] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-27T17:20:22.084905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T17:20:22.749991] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:20:22.814939] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-27T17:20:23.515187] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:20:23.614975] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-27T17:20:24.414965] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-27T17:20:25.214953] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-27T17:20:25.379234] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:20:25.591300] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T17:20:26.014930] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-27T17:20:26.291252] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:20:26.298632] [INFO ] [REMOTE ] ATHM: Full fetch complete (48927 records). [2025-10-27T17:20:26.298775] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-27T17:20:26.299396] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:20:26.299480] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:20:26.299522] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:20:26.299597] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-27T17:20:26.299703] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-27T17:20:26.299754] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-27T17:20:26.299897] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-27T17:20:26.299987] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHM took 35.5s. Estimated remaining: 4h 25m 3s. Rate: 8.3 symbols/min [2025-10-27T17:20:26.482596] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:26.523058] [DEBUG] [LOCAL ] ATO: Loaded 42051 existing records from primary storage. [2025-10-27T17:20:26.523337] [INFO ] [MAIN ] ATO: Loaded 42051 existing records. [2025-10-27T17:20:26.697862] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:26.698080] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-27T17:20:26.698127] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-27T17:20:26.698309] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-27T17:20:26.698345] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-27T17:20:26.820077] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-27T17:20:27.049049] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:27.470555] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:20:27.614986] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-27T17:20:27.990527] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T17:20:28.414999] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-27T17:20:28.709594] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:20:29.214961] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-27T17:20:29.407346] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:20:30.014977] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-27T17:20:30.814976] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-27T17:20:30.889561] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:20:31.614918] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-27T17:20:31.919633] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:20:32.008635] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-27T17:20:32.415012] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-27T17:20:33.159482] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:20:33.214959] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-27T17:20:33.554467] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:20:34.014951] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-27T17:20:34.793635] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:20:34.800152] [INFO ] [REMOTE ] ATKR: Full fetch complete (52994 records). [2025-10-27T17:20:34.800340] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-27T17:20:34.821110] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-27T17:20:35.174022] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-27T17:20:35.174093] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-27T17:20:35.174625] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-27T17:20:35.174699] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-27T17:20:35.175724] [DEBUG] [LOCAL ] ATKR: Trimmed 52994 records to 34497 (keeping 200 days of data) [2025-10-27T17:20:35.391450] [DEBUG] [LOCAL ] ATKR: Primary data saved (34497 records). [2025-10-27T17:20:35.391629] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-27T17:20:35.391853] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATKR took 24.9s. Estimated remaining: 4h 25m 20s. Rate: 8.3 symbols/min [2025-10-27T17:20:35.600182] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:35.604855] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:20:35.615169] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-27T17:20:35.647819] [DEBUG] [LOCAL ] ATR: Loaded 30816 existing records from primary storage. [2025-10-27T17:20:35.648068] [INFO ] [MAIN ] ATR: Loaded 30816 existing records. [2025-10-27T17:20:35.825068] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:35.825305] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-27T17:20:35.825359] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-27T17:20:35.825530] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-27T17:20:35.825567] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-27T17:20:36.183384] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:36.243621] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:20:36.414910] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-27T17:20:36.706064] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:20:37.214987] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-27T17:20:37.836538] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T17:20:38.014981] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-27T17:20:38.751927] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T17:20:38.761627] [INFO ] [REMOTE ] ATI: Full fetch complete (74172 records). [2025-10-27T17:20:38.761819] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-27T17:20:38.825579] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-27T17:20:39.156392] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-27T17:20:39.156605] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-27T17:20:39.157505] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-27T17:20:39.157598] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-27T17:20:39.159334] [DEBUG] [LOCAL ] ATI: Trimmed 74172 records to 51272 (keeping 200 days of data) [2025-10-27T17:20:39.314168] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:20:39.511679] [DEBUG] [LOCAL ] ATI: Primary data saved (51272 records). [2025-10-27T17:20:39.511859] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-27T17:20:39.511971] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATI took 34.3s. Estimated remaining: 4h 24m 33s. Rate: 8.3 symbols/min [2025-10-27T17:20:39.624027] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-27T17:20:39.700379] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:39.717441] [DEBUG] [LOCAL ] ATS: Loaded 17194 existing records from primary storage. [2025-10-27T17:20:39.717698] [INFO ] [MAIN ] ATS: Loaded 17194 existing records. [2025-10-27T17:20:39.899696] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:39.899918] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-27T17:20:39.900005] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-27T17:20:39.900202] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-27T17:20:39.900258] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-27T17:20:40.096266] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:20:40.291634] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:40.414979] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-27T17:20:41.192245] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:20:41.214980] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-27T17:20:41.267455] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:20:42.014936] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-27T17:20:42.213280] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:20:42.815014] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-27T17:20:43.205718] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:20:43.614969] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-27T17:20:43.968502] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:20:44.414957] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-27T17:20:44.661092] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:20:45.214944] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-27T17:20:45.588007] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:20:46.014940] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-27T17:20:46.814957] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-27T17:20:46.890002] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T17:20:47.034173] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:20:47.614935] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-27T17:20:48.194144] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:20:48.414985] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-27T17:20:48.927362] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:20:49.129589] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:20:49.215004] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-27T17:20:50.014947] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-27T17:20:50.333977] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:20:50.814988] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-27T17:20:51.614936] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-27T17:20:51.688430] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:20:51.746261] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:20:52.229493] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:20:52.414936] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-27T17:20:53.214926] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-27T17:20:53.406453] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:20:54.014904] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-27T17:20:54.403189] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:20:54.814945] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-27T17:20:55.580254] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:20:55.587197] [INFO ] [REMOTE ] ATMU: Full fetch complete (56659 records). [2025-10-27T17:20:55.587297] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-27T17:20:55.620025] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-27T17:20:55.971450] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-27T17:20:55.971525] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-27T17:20:55.972143] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-27T17:20:55.972206] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-27T17:20:55.973271] [DEBUG] [LOCAL ] ATMU: Trimmed 56659 records to 38247 (keeping 200 days of data) [2025-10-27T17:20:56.195568] [DEBUG] [LOCAL ] ATMU: Primary data saved (38247 records). [2025-10-27T17:20:56.195723] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-27T17:20:56.196165] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATMU took 36.6s. Estimated remaining: 4h 26m 26s. Rate: 8.2 symbols/min [2025-10-27T17:20:56.389498] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:20:56.418821] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-27T17:20:56.461732] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:20:56.470610] [DEBUG] [LOCAL ] ATUS: Loaded 50699 existing records from primary storage. [2025-10-27T17:20:56.471960] [INFO ] [MAIN ] ATUS: Loaded 50699 existing records. [2025-10-27T17:20:56.671779] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:20:56.672162] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-27T17:20:56.672234] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-27T17:20:56.672412] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-27T17:20:56.672453] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-27T17:20:56.980719] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:20:57.047969] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:20:57.214925] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-27T17:20:57.426828] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:20:58.014947] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-27T17:20:58.814987] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-27T17:20:59.147776] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:20:59.213051] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T17:20:59.614924] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-27T17:20:59.679105] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:21:00.414951] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-27T17:21:01.215002] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-27T17:21:01.533901] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:21:01.984351] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:21:01.988906] [INFO ] [REMOTE ] ATS: Full fetch complete (25353 records). [2025-10-27T17:21:01.989079] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-27T17:21:02.020299] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-27T17:21:02.373837] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-27T17:21:02.373926] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-27T17:21:02.374284] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-27T17:21:02.374323] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-27T17:21:02.375115] [DEBUG] [LOCAL ] ATS: Trimmed 25353 records to 16610 (keeping 200 days of data) [2025-10-27T17:21:02.466206] [DEBUG] [LOCAL ] ATS: Primary data saved (16610 records). [2025-10-27T17:21:02.466337] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-27T17:21:02.466413] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATS took 23.0s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min [2025-10-27T17:21:02.629754] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:02.677033] [DEBUG] [LOCAL ] AU: Loaded 53860 existing records from primary storage. [2025-10-27T17:21:02.677333] [INFO ] [MAIN ] AU: Loaded 53860 existing records. [2025-10-27T17:21:02.821724] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-27T17:21:02.850389] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:02.851366] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-27T17:21:02.851414] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-27T17:21:02.851594] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-27T17:21:02.851631] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-27T17:21:03.200761] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:03.615055] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-27T17:21:04.274681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-27T17:21:04.299106] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:21:04.304795] [INFO ] [REMOTE ] ATR: Full fetch complete (44013 records). [2025-10-27T17:21:04.304884] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-27T17:21:04.414923] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-27T17:21:04.698583] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-27T17:21:04.698682] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-27T17:21:04.699178] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-27T17:21:04.699219] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-27T17:21:04.700128] [DEBUG] [LOCAL ] ATR: Trimmed 44013 records to 30289 (keeping 200 days of data) [2025-10-27T17:21:04.888539] [DEBUG] [LOCAL ] ATR: Primary data saved (30289 records). [2025-10-27T17:21:04.888695] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-27T17:21:04.890269] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 29.5s. Estimated remaining: 4h 24m 57s. Rate: 8.3 symbols/min [2025-10-27T17:21:05.060251] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:05.121351] [DEBUG] [LOCAL ] AUB: Loaded 46502 existing records from primary storage. [2025-10-27T17:21:05.121636] [INFO ] [MAIN ] AUB: Loaded 46502 existing records. [2025-10-27T17:21:05.302787] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:05.303096] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-27T17:21:05.303158] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-27T17:21:05.303417] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-27T17:21:05.303491] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-27T17:21:05.727952] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:05.728587] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-27T17:21:05.731305] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T17:21:06.025820] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-27T17:21:06.028287] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:21:06.291684] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (3.47 seconds). [2025-10-27T17:21:06.814987] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-27T17:21:07.054435] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:21:07.614921] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-27T17:21:07.944899] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:21:08.091083] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-27T17:21:08.414947] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-27T17:21:08.951266] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:21:08.958919] [INFO ] [REMOTE ] ATO: Full fetch complete (60598 records). [2025-10-27T17:21:08.959075] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-27T17:21:09.220173] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-27T17:21:09.345457] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-27T17:21:09.345530] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-27T17:21:09.346203] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-27T17:21:09.346267] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-27T17:21:09.347539] [DEBUG] [LOCAL ] ATO: Trimmed 60598 records to 41245 (keeping 200 days of data) [2025-10-27T17:21:09.594382] [DEBUG] [LOCAL ] ATO: Primary data saved (41245 records). [2025-10-27T17:21:09.594499] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-27T17:21:09.595513] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATO took 43.3s. Estimated remaining: 4h 24m 18s. Rate: 8.3 symbols/min [2025-10-27T17:21:09.761506] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:09.770385] [DEBUG] [LOCAL ] AUNA: Loaded 5332 existing records from primary storage. [2025-10-27T17:21:09.770587] [INFO ] [MAIN ] AUNA: Loaded 5332 existing records. [2025-10-27T17:21:09.944105] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:09.944245] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-27T17:21:09.944292] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-27T17:21:09.944415] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-27T17:21:09.944450] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-27T17:21:10.020074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-27T17:21:10.293690] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:10.814947] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-27T17:21:10.983596] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T17:21:10.998363] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-27T17:21:11.160154] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:21:11.359722] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:21:11.615062] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-27T17:21:12.414965] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-27T17:21:12.802472] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:21:13.214951] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-27T17:21:13.746968] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T17:21:13.943190] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:21:14.014917] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-27T17:21:14.649987] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T17:21:14.814939] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-27T17:21:15.614991] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-27T17:21:15.968964] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:21:16.280240] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T17:21:16.414931] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-27T17:21:17.214963] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-27T17:21:17.644065] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:21:18.014950] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-27T17:21:18.814981] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-27T17:21:19.162899] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:21:19.222757] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T17:21:19.283632] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T17:21:19.614996] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-27T17:21:20.414940] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-27T17:21:20.887494] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:21:21.023019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:21:21.214933] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-27T17:21:22.014912] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-27T17:21:22.484259] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:21:22.707565] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:21:22.814960] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-27T17:21:23.615019] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-27T17:21:23.985267] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T17:21:24.414964] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-27T17:21:24.991978] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T17:21:25.214972] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-27T17:21:25.623511] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T17:21:25.697892] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T17:21:26.014940] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-27T17:21:26.812207] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T17:21:26.813883] [INFO ] [REMOTE ] AUNA: Full fetch complete (7826 records). [2025-10-27T17:21:26.813951] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-27T17:21:26.814311] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:21:26.814390] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:21:26.814454] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:21:26.814524] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-27T17:21:26.814586] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-27T17:21:26.814621] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-10-27T17:21:26.814772] [DEBUG] [LOCAL ] AUNA: Deleted derivative data file. [2025-10-27T17:21:26.814848] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. AUNA took 17.2s. Estimated remaining: 4h 26m 15s. Rate: 8.2 symbols/min [2025-10-27T17:21:26.815021] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-27T17:21:26.992466] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:27.029712] [DEBUG] [LOCAL ] AVA: Loaded 38783 existing records from primary storage. [2025-10-27T17:21:27.030015] [INFO ] [MAIN ] AVA: Loaded 38783 existing records. [2025-10-27T17:21:27.208458] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:27.208685] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-27T17:21:27.208745] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-27T17:21:27.208993] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-27T17:21:27.209051] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-27T17:21:27.565150] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:27.614979] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-27T17:21:28.415015] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-27T17:21:28.614011] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T17:21:28.658518] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:21:29.214957] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-27T17:21:30.014970] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-27T17:21:30.160930] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:21:30.504358] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:21:30.815010] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-27T17:21:31.615001] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-27T17:21:31.743221] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:21:31.961891] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:21:32.414991] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-27T17:21:33.169971] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:21:33.214908] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-27T17:21:33.580878] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T17:21:34.015005] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-27T17:21:34.814929] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-27T17:21:34.920781] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:21:35.627137] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-27T17:21:35.636012] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:21:35.649953] [INFO ] [REMOTE ] AUB: Full fetch complete (66490 records). [2025-10-27T17:21:35.650196] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-27T17:21:36.161771] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-27T17:21:36.161871] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-27T17:21:36.162624] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-27T17:21:36.162720] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-27T17:21:36.164171] [DEBUG] [LOCAL ] AUB: Trimmed 66490 records to 45688 (keeping 200 days of data) [2025-10-27T17:21:36.417279] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-27T17:21:36.492108] [DEBUG] [LOCAL ] AUB: Primary data saved (45688 records). [2025-10-27T17:21:36.492237] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-27T17:21:36.493926] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AUB took 31.6s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-27T17:21:36.663355] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:36.674230] [DEBUG] [LOCAL ] AVAL: Loaded 8579 existing records from primary storage. [2025-10-27T17:21:36.674582] [INFO ] [MAIN ] AVAL: Loaded 8579 existing records. [2025-10-27T17:21:36.848272] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:36.848527] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-27T17:21:36.848707] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-27T17:21:36.848949] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-27T17:21:36.849006] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-27T17:21:37.210999] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:37.222743] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-27T17:21:37.244696] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:21:37.625796] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T17:21:37.635059] [INFO ] [REMOTE ] ATUS: Full fetch complete (71447 records). [2025-10-27T17:21:37.635163] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-27T17:21:38.027773] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-27T17:21:38.024191] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-27T17:21:38.027893] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-27T17:21:38.029875] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-27T17:21:38.037844] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-27T17:21:38.053494] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:21:38.062375] [DEBUG] [LOCAL ] ATUS: Trimmed 71447 records to 49931 (keeping 200 days of data) [2025-10-27T17:21:38.166229] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:21:38.352077] [DEBUG] [LOCAL ] ATUS: Primary data saved (49931 records). [2025-10-27T17:21:38.352245] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-27T17:21:38.352817] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. ATUS took 42.2s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-10-27T17:21:38.523456] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:38.565790] [DEBUG] [LOCAL ] AVB: Loaded 42750 existing records from primary storage. [2025-10-27T17:21:38.566097] [INFO ] [MAIN ] AVB: Loaded 42750 existing records. [2025-10-27T17:21:38.782282] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:38.782509] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-27T17:21:38.782557] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-27T17:21:38.782767] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-27T17:21:38.782823] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-27T17:21:38.823572] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-27T17:21:39.136367] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:39.614915] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-27T17:21:39.921748] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:21:40.170532] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:21:40.414958] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-27T17:21:40.506149] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T17:21:41.214942] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-27T17:21:41.637064] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T17:21:42.015120] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-27T17:21:42.624125] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:21:42.814942] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-27T17:21:43.190862] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:21:43.386612] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T17:21:43.614974] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-27T17:21:44.168084] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T17:21:44.414934] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-27T17:21:45.198639] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:21:45.214931] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-27T17:21:45.681671] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T17:21:46.014961] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-27T17:21:46.814983] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-27T17:21:47.431978] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T17:21:47.452326] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:21:47.614965] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-27T17:21:48.415005] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-27T17:21:49.214963] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-27T17:21:49.657122] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-27T17:21:49.819679] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T17:21:50.014961] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-27T17:21:50.035905] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:21:50.814959] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-27T17:21:51.548443] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:21:51.614947] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-27T17:21:52.099814] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T17:21:52.107532] [INFO ] [REMOTE ] AVA: Full fetch complete (55433 records). [2025-10-27T17:21:52.107765] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-27T17:21:52.420123] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-27T17:21:52.539546] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-27T17:21:52.539713] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-27T17:21:52.540595] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-27T17:21:52.540684] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-27T17:21:52.542361] [DEBUG] [LOCAL ] AVA: Trimmed 55433 records to 37994 (keeping 200 days of data) [2025-10-27T17:21:52.792135] [DEBUG] [LOCAL ] AVA: Primary data saved (37994 records). [2025-10-27T17:21:52.792341] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-27T17:21:52.793495] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AVA took 26.0s. Estimated remaining: 4h 26m 43s. Rate: 8.2 symbols/min [2025-10-27T17:21:52.985069] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:52.985464] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-27T17:21:52.985527] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-27T17:21:52.985763] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-27T17:21:52.985865] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-27T17:21:52.985986] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-27T17:21:52.986239] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-27T17:21:53.232573] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-27T17:21:53.380120] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:21:53.409293] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:53.754858] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:21:54.014989] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-27T17:21:54.225955] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:21:54.226302] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-27T17:21:54.226401] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:21:54.226476] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-27T17:21:54.226553] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:21:54.226635] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-27T17:21:54.226751] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-27T17:21:54.226799] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-27T17:21:54.226850] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-27T17:21:54.226905] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 1.4s. Estimated remaining: 4h 25m 24s. Rate: 8.2 symbols/min [2025-10-27T17:21:54.414161] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:54.435798] [DEBUG] [LOCAL ] AVD: Loaded 21565 existing records from primary storage. [2025-10-27T17:21:54.436053] [INFO ] [MAIN ] AVD: Loaded 21565 existing records. [2025-10-27T17:21:54.614091] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:54.637431] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-27T17:21:54.637522] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-27T17:21:54.640233] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-27T17:21:54.640347] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-27T17:21:54.705669] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T17:21:54.752517] [INFO ] [REMOTE ] AU: Full fetch complete (76654 records). [2025-10-27T17:21:54.752744] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-27T17:21:54.816803] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-27T17:21:55.226516] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:55.454006] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-27T17:21:55.454100] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-27T17:21:55.454937] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-27T17:21:55.455002] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-27T17:21:55.456531] [DEBUG] [LOCAL ] AU: Trimmed 76654 records to 53079 (keeping 200 days of data) [2025-10-27T17:21:55.633682] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-27T17:21:55.788762] [DEBUG] [LOCAL ] AU: Primary data saved (53079 records). [2025-10-27T17:21:55.788974] [INFO ] [MAIN ] AU: Full history saved. [2025-10-27T17:21:55.789076] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AU took 53.3s. Estimated remaining: 4h 24m 8s. Rate: 8.3 symbols/min [2025-10-27T17:21:55.923861] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:21:55.964944] [INFO ] [REMOTE ] AVAL: Full fetch complete (15124 records). [2025-10-27T17:21:55.965915] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-27T17:21:55.992087] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:56.252783] [DEBUG] [LOCAL ] AVK: Loaded 18934 existing records from primary storage. [2025-10-27T17:21:56.269867] [INFO ] [MAIN ] AVK: Loaded 18934 existing records. [2025-10-27T17:21:56.416733] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-27T17:21:56.568635] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-27T17:21:56.569385] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-27T17:21:56.573049] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-27T17:21:56.573199] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-27T17:21:56.572629] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:56.573983] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-27T17:21:56.574241] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-27T17:21:56.574367] [DEBUG] [LOCAL ] AVAL: Trimmed 15124 records to 8321 (keeping 200 days of data) [2025-10-27T17:21:56.574813] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-27T17:21:56.575110] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-27T17:21:56.706930] [DEBUG] [LOCAL ] AVAL: Primary data saved (8321 records). [2025-10-27T17:21:56.728493] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-27T17:21:56.728706] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 20.2s. Estimated remaining: 4h 22m 45s. Rate: 8.3 symbols/min [2025-10-27T17:21:57.113484] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:21:57.204165] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:57.227842] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-27T17:21:57.239820] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:21:57.261036] [DEBUG] [LOCAL ] AVNS: Loaded 33963 existing records from primary storage. [2025-10-27T17:21:57.261344] [INFO ] [MAIN ] AVNS: Loaded 33963 existing records. [2025-10-27T17:21:57.454442] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:21:57.454662] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-27T17:21:57.454725] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-27T17:21:57.454968] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-27T17:21:57.455012] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-27T17:21:57.870733] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:21:57.873284] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:21:58.014934] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-27T17:21:58.366088] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:21:58.814935] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-27T17:21:59.097111] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:21:59.509771] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:21:59.614961] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-27T17:22:00.414942] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-27T17:22:01.222143] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-27T17:22:01.226527] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T17:22:02.015005] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-27T17:22:02.815030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-27T17:22:03.485735] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-10-27T17:22:03.614908] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-27T17:22:04.483911] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (3.26 seconds). [2025-10-27T17:22:04.491185] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-27T17:22:04.852369] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:22:04.969139] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:22:05.214996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-27T17:22:05.347848] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:22:05.521568] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-10-27T17:22:06.014930] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-27T17:22:06.031071] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:22:06.814958] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-27T17:22:07.444883] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T17:22:07.614964] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-27T17:22:07.682442] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T17:22:08.414977] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-27T17:22:08.712338] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:22:09.214942] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-27T17:22:09.238189] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T17:22:10.014979] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-27T17:22:10.263594] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T17:22:10.814960] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-27T17:22:11.601144] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:22:11.614911] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-27T17:22:12.045303] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:22:12.414948] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-27T17:22:12.787799] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:22:13.161915] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:22:13.214914] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-27T17:22:14.015017] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-27T17:22:14.548283] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:22:14.814918] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-27T17:22:14.838601] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:22:15.614975] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-27T17:22:16.414911] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-27T17:22:16.471884] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:22:16.479900] [INFO ] [REMOTE ] AVB: Full fetch complete (59578 records). [2025-10-27T17:22:16.480010] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-27T17:22:16.861830] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-27T17:22:16.861900] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-27T17:22:16.862507] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-27T17:22:16.862547] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-27T17:22:16.863714] [DEBUG] [LOCAL ] AVB: Trimmed 59578 records to 41943 (keeping 200 days of data) [2025-10-27T17:22:17.146500] [DEBUG] [LOCAL ] AVB: Primary data saved (41943 records). [2025-10-27T17:22:17.146671] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-27T17:22:17.147468] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 38.8s. Estimated remaining: 4h 25m 15s. Rate: 8.2 symbols/min [2025-10-27T17:22:17.218425] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-27T17:22:17.301280] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T17:22:17.360715] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:17.367353] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:22:17.406007] [DEBUG] [LOCAL ] AVNT: Loaded 39076 existing records from primary storage. [2025-10-27T17:22:17.406289] [INFO ] [MAIN ] AVNT: Loaded 39076 existing records. [2025-10-27T17:22:17.590738] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:17.590947] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-27T17:22:17.590995] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-27T17:22:17.591273] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-27T17:22:17.591331] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-27T17:22:17.951680] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:18.014993] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-27T17:22:18.452815] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:22:18.814996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-27T17:22:19.256225] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:22:19.614962] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-27T17:22:19.780036] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:22:20.415006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-27T17:22:20.569456] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:22:20.573945] [INFO ] [REMOTE ] AVK: Full fetch complete (26797 records). [2025-10-27T17:22:20.574017] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-27T17:22:20.940063] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-27T17:22:20.940160] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-27T17:22:20.940575] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-27T17:22:20.940636] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-27T17:22:20.941346] [DEBUG] [LOCAL ] AVK: Trimmed 26797 records to 18417 (keeping 200 days of data) [2025-10-27T17:22:21.052137] [DEBUG] [LOCAL ] AVK: Primary data saved (18417 records). [2025-10-27T17:22:21.052282] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-27T17:22:21.052364] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 25.3s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-10-27T17:22:21.226117] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-27T17:22:21.231223] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:21.282153] [DEBUG] [LOCAL ] AVTR: Loaded 54350 existing records from primary storage. [2025-10-27T17:22:21.282479] [INFO ] [MAIN ] AVTR: Loaded 54350 existing records. [2025-10-27T17:22:21.459670] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:21.459987] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-27T17:22:21.460062] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-27T17:22:21.460391] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-27T17:22:21.460474] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-27T17:22:21.647342] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:22:21.848675] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:22.014946] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-27T17:22:22.318915] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:22:22.322434] [INFO ] [REMOTE ] AVD: Full fetch complete (32316 records). [2025-10-27T17:22:22.322514] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-27T17:22:22.699487] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-27T17:22:22.699564] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-27T17:22:22.699985] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-27T17:22:22.700048] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-27T17:22:22.700773] [DEBUG] [LOCAL ] AVD: Trimmed 32316 records to 20940 (keeping 200 days of data) [2025-10-27T17:22:22.815915] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-27T17:22:22.821222] [DEBUG] [LOCAL ] AVD: Primary data saved (20940 records). [2025-10-27T17:22:22.821311] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-27T17:22:22.821419] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVD took 28.6s. Estimated remaining: 4h 23m 16s. Rate: 8.3 symbols/min [2025-10-27T17:22:23.007420] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:23.049822] [DEBUG] [LOCAL ] AVY: Loaded 38829 existing records from primary storage. [2025-10-27T17:22:23.050160] [INFO ] [MAIN ] AVY: Loaded 38829 existing records. [2025-10-27T17:22:23.266222] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:23.266672] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-27T17:22:23.266843] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-27T17:22:23.267188] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-27T17:22:23.267251] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-27T17:22:23.616370] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-27T17:22:23.767347] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:23.814368] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T17:22:24.225601] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:22:24.414928] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-27T17:22:25.000591] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:22:25.214956] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-27T17:22:26.014981] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-27T17:22:26.201544] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T17:22:26.296238] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:22:26.814938] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-27T17:22:27.556531] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:22:27.614930] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-27T17:22:28.415019] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-27T17:22:28.517816] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T17:22:28.616976] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:22:29.215157] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-27T17:22:29.984866] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:22:30.014968] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-27T17:22:30.328385] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:22:30.814965] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-27T17:22:31.233907] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:22:31.614949] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-27T17:22:31.851676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:22:32.414938] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-27T17:22:33.136139] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T17:22:33.214974] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-27T17:22:34.014965] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-27T17:22:34.135333] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:22:34.814966] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-27T17:22:35.067061] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:22:35.208973] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:22:35.615011] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-27T17:22:36.017537] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:22:36.414985] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-27T17:22:37.214915] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-27T17:22:37.241117] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:22:37.693804] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T17:22:38.014928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-27T17:22:38.814952] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-27T17:22:39.044182] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:22:39.301836] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T17:22:39.614977] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-27T17:22:39.772089] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:22:40.415019] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-27T17:22:40.608985] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:22:41.214944] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-27T17:22:41.641970] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:22:41.648163] [INFO ] [REMOTE ] AVNS: Full fetch complete (48263 records). [2025-10-27T17:22:41.648274] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-27T17:22:42.020198] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-27T17:22:42.022903] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-27T17:22:42.023000] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-27T17:22:42.024372] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-27T17:22:42.024439] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-27T17:22:42.025539] [DEBUG] [LOCAL ] AVNS: Trimmed 48263 records to 33316 (keeping 200 days of data) [2025-10-27T17:22:42.218608] [DEBUG] [LOCAL ] AVNS: Primary data saved (33316 records). [2025-10-27T17:22:42.218753] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-27T17:22:42.218831] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNS took 45.5s. Estimated remaining: 4h 25m 31s. Rate: 8.2 symbols/min [2025-10-27T17:22:42.392180] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:42.415841] [DEBUG] [LOCAL ] AWF: Loaded 24433 existing records from primary storage. [2025-10-27T17:22:42.416240] [INFO ] [MAIN ] AWF: Loaded 24433 existing records. [2025-10-27T17:22:42.545886] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T17:22:42.600999] [INFO ] [REMOTE ] AVNT: Full fetch complete (55946 records). [2025-10-27T17:22:42.625602] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:42.625694] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-27T17:22:42.625950] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-27T17:22:42.626059] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-27T17:22:42.626358] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-27T17:22:42.657594] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-27T17:22:42.818336] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-27T17:22:43.373816] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-27T17:22:43.378052] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:43.378458] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-27T17:22:43.379122] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-27T17:22:43.379209] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-27T17:22:43.380487] [DEBUG] [LOCAL ] AVNT: Trimmed 55946 records to 38236 (keeping 200 days of data) [2025-10-27T17:22:43.510823] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:22:43.620531] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-27T17:22:43.654825] [DEBUG] [LOCAL ] AVNT: Primary data saved (38236 records). [2025-10-27T17:22:43.654938] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-27T17:22:43.655014] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 26.5s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-10-27T17:22:43.821010] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:43.845107] [DEBUG] [LOCAL ] AWI: Loaded 25413 existing records from primary storage. [2025-10-27T17:22:43.845343] [INFO ] [MAIN ] AWI: Loaded 25413 existing records. [2025-10-27T17:22:44.018296] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:44.018478] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-27T17:22:44.018523] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-27T17:22:44.018740] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-27T17:22:44.018794] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-27T17:22:44.390596] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:44.424387] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-27T17:22:44.443987] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:22:45.214902] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-27T17:22:45.274661] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:22:45.826286] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:22:46.014950] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-27T17:22:46.382426] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T17:22:46.814942] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-27T17:22:47.122325] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:22:47.614997] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-27T17:22:47.986999] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T17:22:48.414912] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-27T17:22:48.773458] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:22:49.214942] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-27T17:22:49.708474] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:22:50.014941] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-27T17:22:50.240383] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:22:50.814919] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-27T17:22:50.924534] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:22:51.614957] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-27T17:22:52.414968] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-27T17:22:52.578392] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T17:22:52.586749] [INFO ] [REMOTE ] AVY: Full fetch complete (56772 records). [2025-10-27T17:22:52.586848] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-27T17:22:52.991577] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-27T17:22:52.991732] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-27T17:22:52.992466] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-27T17:22:52.992633] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-27T17:22:52.994566] [DEBUG] [LOCAL ] AVY: Trimmed 56772 records to 37987 (keeping 200 days of data) [2025-10-27T17:22:53.117909] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:22:53.233348] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-27T17:22:53.270624] [DEBUG] [LOCAL ] AVY: Primary data saved (37987 records). [2025-10-27T17:22:53.270943] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-27T17:22:53.271915] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVY took 30.4s. Estimated remaining: 4h 24m 35s. Rate: 8.2 symbols/min [2025-10-27T17:22:53.465513] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:22:53.463997] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:22:53.519819] [DEBUG] [LOCAL ] AWK: Loaded 49024 existing records from primary storage. [2025-10-27T17:22:53.520148] [INFO ] [MAIN ] AWK: Loaded 49024 existing records. [2025-10-27T17:22:53.698211] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:22:53.698495] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-27T17:22:53.698550] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-27T17:22:53.698825] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-27T17:22:53.698880] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-27T17:22:54.027858] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-27T17:22:54.079955] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:22:54.814962] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-27T17:22:54.961381] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:22:55.064272] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:22:55.595674] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T17:22:55.614974] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-27T17:22:56.414998] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-27T17:22:56.707246] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:22:57.215004] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-27T17:22:57.905625] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:22:58.015002] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-27T17:22:58.814966] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-27T17:22:59.157304] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T17:22:59.614954] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-27T17:23:00.414999] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-27T17:23:04.815593] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (6.80 seconds). [2025-10-27T17:23:04.822114] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-27T17:23:05.686202] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (6.07 seconds). [2025-10-27T17:23:05.696181] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-27T17:23:05.777992] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (6.96 seconds). [2025-10-27T17:23:05.784005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-27T17:23:06.672047] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (6.26 seconds). [2025-10-27T17:23:06.682125] [INFO ] [REMOTE ] AVTR: Full fetch complete (77676 records). [2025-10-27T17:23:06.682239] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-27T17:23:07.084307] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-27T17:23:07.084438] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-27T17:23:07.085545] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-27T17:23:07.085630] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-27T17:23:07.087540] [DEBUG] [LOCAL ] AVTR: Trimmed 77676 records to 53570 (keeping 200 days of data) [2025-10-27T17:23:07.405309] [DEBUG] [LOCAL ] AVTR: Primary data saved (53570 records). [2025-10-27T17:23:07.405447] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-27T17:23:07.405524] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVTR took 46.4s. Estimated remaining: 4h 25m 47s. Rate: 8.2 symbols/min [2025-10-27T17:23:07.577701] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:07.598968] [DEBUG] [LOCAL ] AWP: Loaded 21870 existing records from primary storage. [2025-10-27T17:23:07.599278] [INFO ] [MAIN ] AWP: Loaded 21870 existing records. [2025-10-27T17:23:07.778004] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:07.778231] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-27T17:23:07.778281] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-27T17:23:07.778439] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-27T17:23:07.778480] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-27T17:23:08.031079] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-10-27T17:23:08.076873] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-27T17:23:08.187838] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:08.188691] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-27T17:23:08.484339] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-27T17:23:08.490980] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-27T17:23:08.856569] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (3.16 seconds). [2025-10-27T17:23:08.867454] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-27T17:23:09.277638] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T17:23:09.284412] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-27T17:23:09.783230] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:23:09.789608] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-27T17:23:10.117579] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:23:10.124046] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-27T17:23:10.186493] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:23:10.194599] [INFO ] [REMOTE ] AWI: Full fetch complete (36170 records). [2025-10-27T17:23:10.194929] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-27T17:23:10.608888] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:23:10.633012] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-27T17:23:10.633120] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-27T17:23:10.633434] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-27T17:23:10.634257] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-27T17:23:10.634998] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-27T17:23:10.635901] [DEBUG] [LOCAL ] AWI: Trimmed 36170 records to 24899 (keeping 200 days of data) [2025-10-27T17:23:10.787666] [DEBUG] [LOCAL ] AWI: Primary data saved (24899 records). [2025-10-27T17:23:10.787847] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-27T17:23:10.787933] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWI took 27.1s. Estimated remaining: 4h 24m 54s. Rate: 8.2 symbols/min [2025-10-27T17:23:10.956512] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:10.976444] [DEBUG] [LOCAL ] AWR: Loaded 22990 existing records from primary storage. [2025-10-27T17:23:10.976863] [INFO ] [MAIN ] AWR: Loaded 22990 existing records. [2025-10-27T17:23:11.157142] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:11.157443] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-27T17:23:11.157542] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-27T17:23:11.162961] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-27T17:23:11.169634] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T17:23:11.169224] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-27T17:23:11.216442] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-27T17:23:11.263696] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T17:23:11.294966] [INFO ] [REMOTE ] AWF: Full fetch complete (35908 records). [2025-10-27T17:23:11.300758] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-27T17:23:11.796779] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:11.829131] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-27T17:23:11.941086] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-27T17:23:11.941184] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-27T17:23:11.941591] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-27T17:23:11.941746] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-27T17:23:11.942835] [DEBUG] [LOCAL ] AWF: Trimmed 35908 records to 23920 (keeping 200 days of data) [2025-10-27T17:23:12.091077] [DEBUG] [LOCAL ] AWF: Primary data saved (23920 records). [2025-10-27T17:23:12.091395] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-27T17:23:12.091603] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWF took 29.9s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-10-27T17:23:12.215030] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:23:12.251114] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-27T17:23:12.329603] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:12.363841] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:23:12.378420] [DEBUG] [LOCAL ] AX: Loaded 28100 existing records from primary storage. [2025-10-27T17:23:12.378714] [INFO ] [MAIN ] AX: Loaded 28100 existing records. [2025-10-27T17:23:12.420026] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-27T17:23:12.561400] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:12.561776] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-27T17:23:12.561831] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-27T17:23:12.562024] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-27T17:23:12.562082] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-27T17:23:12.913588] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:13.106386] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T17:23:13.162488] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:23:13.214915] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-27T17:23:13.925734] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:23:14.014906] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-27T17:23:14.198746] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:23:14.814950] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-27T17:23:15.413359] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:23:15.614946] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-27T17:23:15.846989] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:23:16.414948] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-27T17:23:17.214989] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-27T17:23:17.462840] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T17:23:17.465910] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:23:17.776458] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:23:18.014934] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-27T17:23:18.815002] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-27T17:23:19.614922] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-27T17:23:19.698049] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T17:23:19.924085] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:23:20.414943] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-27T17:23:21.025349] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:23:21.214998] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-27T17:23:22.014954] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-27T17:23:22.155032] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:23:22.164389] [INFO ] [REMOTE ] AWK: Full fetch complete (70909 records). [2025-10-27T17:23:22.164508] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-27T17:23:22.568672] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:23:22.599190] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-27T17:23:22.599325] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-27T17:23:22.601061] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-27T17:23:22.601137] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-27T17:23:22.602714] [DEBUG] [LOCAL ] AWK: Trimmed 70909 records to 48248 (keeping 200 days of data) [2025-10-27T17:23:22.821235] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-27T17:23:22.910305] [DEBUG] [LOCAL ] AWK: Primary data saved (48248 records). [2025-10-27T17:23:22.910459] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-27T17:23:22.911272] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWK took 29.6s. Estimated remaining: 4h 24m 11s. Rate: 8.2 symbols/min [2025-10-27T17:23:23.099929] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:23.103229] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:23:23.161964] [DEBUG] [LOCAL ] AXL: Loaded 51299 existing records from primary storage. [2025-10-27T17:23:23.162301] [INFO ] [MAIN ] AXL: Loaded 51299 existing records. [2025-10-27T17:23:23.351434] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:23.351668] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-27T17:23:23.351729] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-27T17:23:23.351931] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-27T17:23:23.351987] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-27T17:23:23.617495] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-27T17:23:23.742462] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:23.804884] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:23:24.414971] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-27T17:23:24.871726] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:23:25.215007] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-27T17:23:25.917515] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:23:26.014953] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-27T17:23:26.060061] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:23:26.814951] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-27T17:23:27.282877] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T17:23:27.614948] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-27T17:23:28.169946] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T17:23:28.414937] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-27T17:23:28.467404] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:23:29.111375] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:23:29.214967] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-27T17:23:30.014928] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-27T17:23:30.028149] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:23:30.814921] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-27T17:23:31.508345] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:23:31.614948] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-27T17:23:32.101370] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:23:32.105256] [INFO ] [REMOTE ] AWP: Full fetch complete (31364 records). [2025-10-27T17:23:32.105368] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-27T17:23:32.105952] [FATAL] [VALIDATOR ] AWP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:23:32.106036] [FATAL] [MAIN ] AWP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:23:32.106081] [WARN ] [MAIN ] AWP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:23:32.106158] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-27T17:23:32.106234] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-27T17:23:32.106280] [INFO ] [LOCAL ] AWP: Starting deletion of derivative data. [2025-10-27T17:23:32.106445] [DEBUG] [LOCAL ] AWP: Deleted derivative data file. [2025-10-27T17:23:32.106548] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWP took 24.7s. Estimated remaining: 4h 24m 26s. Rate: 8.2 symbols/min [2025-10-27T17:23:32.272489] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:32.319003] [DEBUG] [LOCAL ] AXP: Loaded 53922 existing records from primary storage. [2025-10-27T17:23:32.319299] [INFO ] [MAIN ] AXP: Loaded 53922 existing records. [2025-10-27T17:23:32.416208] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-27T17:23:32.494088] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:32.494251] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-27T17:23:32.494321] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-27T17:23:32.494635] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-27T17:23:32.494725] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-27T17:23:32.851995] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:33.139224] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:23:33.214901] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-27T17:23:33.263780] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:23:34.014965] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-27T17:23:34.126057] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:23:34.814992] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-27T17:23:35.614991] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-27T17:23:36.105547] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:23:36.221402] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:23:36.414916] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-27T17:23:36.525892] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:23:37.214915] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-27T17:23:37.457594] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:23:38.014919] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-27T17:23:38.073334] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:23:38.814968] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-27T17:23:39.614984] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-27T17:23:39.811808] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T17:23:40.414916] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-27T17:23:40.730516] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T17:23:40.890129] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T17:23:41.214950] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-27T17:23:41.472351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:23:41.477434] [INFO ] [REMOTE ] AX: Full fetch complete (41897 records). [2025-10-27T17:23:41.477521] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-27T17:23:41.848993] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-27T17:23:41.849083] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-27T17:23:41.849590] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-27T17:23:41.849678] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-27T17:23:41.850519] [DEBUG] [LOCAL ] AX: Trimmed 41897 records to 27347 (keeping 200 days of data) [2025-10-27T17:23:42.002632] [DEBUG] [LOCAL ] AX: Primary data saved (27347 records). [2025-10-27T17:23:42.002803] [INFO ] [MAIN ] AX: Full history saved. [2025-10-27T17:23:42.002883] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AX took 29.9s. Estimated remaining: 4h 24m 47s. Rate: 8.2 symbols/min [2025-10-27T17:23:42.023826] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-27T17:23:42.171198] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:42.176304] [DEBUG] [LOCAL ] AXR: Loaded 2937 existing records from primary storage. [2025-10-27T17:23:42.176501] [INFO ] [MAIN ] AXR: Loaded 2937 existing records. [2025-10-27T17:23:42.348624] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:42.348848] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-27T17:23:42.348893] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-27T17:23:42.349013] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-27T17:23:42.349049] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-27T17:23:42.706514] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:42.814923] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-27T17:23:43.107576] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T17:23:43.151893] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T17:23:43.156802] [INFO ] [REMOTE ] AWR: Full fetch complete (32500 records). [2025-10-27T17:23:43.156907] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-27T17:23:43.520983] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-27T17:23:43.521057] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-27T17:23:43.521468] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-27T17:23:43.521512] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-27T17:23:43.522239] [DEBUG] [LOCAL ] AWR: Trimmed 32500 records to 22460 (keeping 200 days of data) [2025-10-27T17:23:43.617013] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-27T17:23:43.655224] [DEBUG] [LOCAL ] AWR: Primary data saved (22460 records). [2025-10-27T17:23:43.655351] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-27T17:23:43.655427] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AWR took 32.9s. Estimated remaining: 4h 23m 37s. Rate: 8.2 symbols/min [2025-10-27T17:23:43.833394] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:43.868501] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:23:43.905055] [DEBUG] [LOCAL ] AXS: Loaded 39390 existing records from primary storage. [2025-10-27T17:23:43.905397] [INFO ] [MAIN ] AXS: Loaded 39390 existing records. [2025-10-27T17:23:44.077793] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:44.078000] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-27T17:23:44.078046] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-27T17:23:44.078288] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-27T17:23:44.078326] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-27T17:23:44.420056] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-27T17:23:44.449028] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:44.973750] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T17:23:45.214939] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-27T17:23:45.544864] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:23:46.014926] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-27T17:23:46.814952] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-27T17:23:46.914372] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:23:47.615385] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-27T17:23:47.954045] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:23:48.162718] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:23:48.414981] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-27T17:23:48.795762] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T17:23:49.214958] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-27T17:23:49.606417] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T17:23:50.014942] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-27T17:23:50.397332] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:23:50.814969] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-27T17:23:51.404129] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T17:23:51.494998] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:23:51.614926] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-27T17:23:52.415010] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-27T17:23:52.914469] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T17:23:52.924270] [INFO ] [REMOTE ] AXL: Full fetch complete (73212 records). [2025-10-27T17:23:52.924393] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-27T17:23:53.004498] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T17:23:53.220080] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-27T17:23:53.325707] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-27T17:23:53.325790] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-27T17:23:53.326499] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-27T17:23:53.326539] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-27T17:23:53.328004] [DEBUG] [LOCAL ] AXL: Trimmed 73212 records to 50492 (keeping 200 days of data) [2025-10-27T17:23:53.599317] [DEBUG] [LOCAL ] AXL: Primary data saved (50492 records). [2025-10-27T17:23:53.599467] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-27T17:23:53.599585] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AXL took 30.7s. Estimated remaining: 4h 23m 59s. Rate: 8.2 symbols/min [2025-10-27T17:23:53.764686] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:23:53.811426] [DEBUG] [LOCAL ] AXTA: Loaded 53069 existing records from primary storage. [2025-10-27T17:23:53.811756] [INFO ] [MAIN ] AXTA: Loaded 53069 existing records. [2025-10-27T17:23:53.984220] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:23:53.984448] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-27T17:23:53.984501] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-27T17:23:53.984720] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-27T17:23:53.984777] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-27T17:23:54.020164] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-27T17:23:54.341258] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:23:54.395766] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T17:23:54.557865] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T17:23:54.814969] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-27T17:23:55.614995] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-27T17:23:56.415004] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-27T17:23:56.585842] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:23:56.906557] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T17:23:57.214978] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-27T17:23:57.682786] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:23:58.014920] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-27T17:23:58.805490] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:23:58.814888] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-27T17:23:59.365130] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T17:23:59.614971] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-27T17:24:00.150456] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:24:00.415009] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-27T17:24:01.214951] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-27T17:24:02.020063] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-27T17:24:02.039573] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-27T17:24:02.815006] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-27T17:24:03.954355] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-27T17:24:03.955806] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-27T17:24:05.026543] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:24:05.027982] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-27T17:24:05.052055] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-27T17:24:05.114958] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (4.70 seconds). [2025-10-27T17:24:05.214930] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-27T17:24:05.771608] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-27T17:24:05.771800] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:24:06.014956] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-27T17:24:06.748878] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T17:24:06.814913] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-27T17:24:07.614943] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-27T17:24:07.996513] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T17:24:08.006684] [INFO ] [REMOTE ] AXP: Full fetch complete (77103 records). [2025-10-27T17:24:08.006822] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-27T17:24:08.397379] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-27T17:24:08.397478] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-27T17:24:08.398332] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-27T17:24:08.398412] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-27T17:24:08.410140] [DEBUG] [LOCAL ] AXP: Trimmed 77103 records to 53134 (keeping 200 days of data) [2025-10-27T17:24:08.415353] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-27T17:24:08.432222] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:24:08.778768] [DEBUG] [LOCAL ] AXP: Primary data saved (53134 records). [2025-10-27T17:24:08.779038] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-27T17:24:08.779157] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXP took 36.7s. Estimated remaining: 4h 25m 19s. Rate: 8.2 symbols/min [2025-10-27T17:24:08.887396] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T17:24:08.928316] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:24:09.214990] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-27T17:24:09.944102] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:24:09.945268] [INFO ] [REMOTE ] AXR: Full fetch complete (4286 records). [2025-10-27T17:24:09.945340] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-27T17:24:10.021103] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-27T17:24:10.304168] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-27T17:24:10.304252] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-27T17:24:10.304421] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-27T17:24:10.304462] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-27T17:24:10.304876] [DEBUG] [LOCAL ] AXR: Trimmed 4286 records to 2799 (keeping 200 days of data) [2025-10-27T17:24:10.320902] [DEBUG] [LOCAL ] AXR: Primary data saved (2799 records). [2025-10-27T17:24:10.320965] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-27T17:24:10.321037] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXR took 28.3s. Estimated remaining: 4h 24m 8s. Rate: 8.2 symbols/min [2025-10-27T17:24:10.815050] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-27T17:24:11.153496] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T17:24:11.614959] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-27T17:24:12.553115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T17:24:12.563917] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-27T17:24:12.907046] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T17:24:13.215010] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-27T17:24:13.930854] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:24:14.014940] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-27T17:24:14.556011] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:24:14.564566] [INFO ] [REMOTE ] AXS: Full fetch complete (56295 records). [2025-10-27T17:24:14.564758] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-27T17:24:14.940413] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-27T17:24:14.940539] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-27T17:24:14.941151] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-27T17:24:14.941213] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-27T17:24:14.942470] [DEBUG] [LOCAL ] AXS: Trimmed 56295 records to 38703 (keeping 200 days of data) [2025-10-27T17:24:15.181474] [DEBUG] [LOCAL ] AXS: Primary data saved (38703 records). [2025-10-27T17:24:15.181611] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-27T17:24:15.182537] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 31.5s. Estimated remaining: 4h 23m 34s. Rate: 8.2 symbols/min [2025-10-27T17:24:15.548982] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:24:15.560838] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-27T17:24:17.251673] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T17:24:17.262870] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-27T17:24:18.774130] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T17:24:18.784537] [INFO ] [REMOTE ] AXTA: Full fetch complete (75504 records). [2025-10-27T17:24:18.784735] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-27T17:24:19.175540] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-27T17:24:19.175631] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-27T17:24:19.176420] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-27T17:24:19.176473] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-27T17:24:19.178025] [DEBUG] [LOCAL ] AXTA: Trimmed 75504 records to 52292 (keeping 200 days of data) [2025-10-27T17:24:19.472139] [DEBUG] [LOCAL ] AXTA: Primary data saved (52292 records). [2025-10-27T17:24:19.472288] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-27T17:24:19.472391] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 25.9s. Estimated remaining: 4h 22m 54s. Rate: 8.2 symbols/min [2025-10-27T17:24:20.082420] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.132429] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.133229] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.133450] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-27T17:24:20.139748] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-27T17:24:20.189477] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-27T17:24:20.209020] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-27T17:24:20.212968] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-27T17:24:20.213162] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-27T17:24:20.212731] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:20.311758] [DEBUG] [LOCAL ] AZO: Loaded 11011 existing records from primary storage. [2025-10-27T17:24:20.324361] [INFO ] [MAIN ] AZO: Loaded 11011 existing records. [2025-10-27T17:24:20.488135] [DEBUG] [LOCAL ] AYI: Loaded 24296 existing records from primary storage. [2025-10-27T17:24:20.535348] [INFO ] [MAIN ] AYI: Loaded 24296 existing records. [2025-10-27T17:24:20.571911] [DEBUG] [LOCAL ] AZZ: Loaded 23290 existing records from primary storage. [2025-10-27T17:24:20.604609] [INFO ] [MAIN ] AZZ: Loaded 23290 existing records. [2025-10-27T17:24:21.025243] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.096425] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.097384] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-27T17:24:21.101288] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.117763] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-27T17:24:21.163052] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.206465] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-27T17:24:21.192386] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-27T17:24:21.241359] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:21.271532] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-27T17:24:21.314298] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:21.325580] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-27T17:24:21.320023] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-27T17:24:21.325708] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-27T17:24:21.341392] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-27T17:24:21.366798] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-27T17:24:21.367071] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-27T17:24:22.459100] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.475188] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-27T17:24:22.693415] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.731504] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-27T17:24:22.754347] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:22.756137] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:24:22.762770] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-27T17:24:22.762455] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-27T17:24:23.069677] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:24:23.070144] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-27T17:24:23.070245] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:24:23.070334] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-27T17:24:23.070399] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:24:23.070474] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-27T17:24:23.070574] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-27T17:24:23.070635] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-27T17:24:23.070729] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-27T17:24:23.070794] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.6s. Estimated remaining: 4h 22m 7s. Rate: 8.3 symbols/min [2025-10-27T17:24:23.254435] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:23.314820] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-27T17:24:23.315400] [INFO ] [MAIN ] BA: Loaded 54570 existing records. [2025-10-27T17:24:23.517886] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:23.527184] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-27T17:24:23.527078] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:24:23.530705] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-27T17:24:23.527324] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-27T17:24:23.531769] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-27T17:24:23.531868] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-27T17:24:23.909371] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:23.909827] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-27T17:24:24.063967] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T17:24:24.068919] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-27T17:24:24.129711] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:24:24.132097] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-27T17:24:24.273380] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:24:24.279802] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-27T17:24:24.688762] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:24:24.693620] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-27T17:24:24.860387] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:24:25.012584] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:24:25.214963] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-27T17:24:25.498805] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:24:26.014957] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-27T17:24:26.131938] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:24:26.420486] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-27T17:24:26.814945] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-27T17:24:26.956108] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T17:24:27.615008] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-27T17:24:28.414964] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-27T17:24:28.625561] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T17:24:28.782917] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T17:24:29.051731] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T17:24:29.214963] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-27T17:24:30.014961] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-27T17:24:30.120425] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:24:30.713105] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:24:30.814940] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-27T17:24:31.614987] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-27T17:24:32.414969] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-27T17:24:32.548540] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:24:32.927105] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-27T17:24:33.009402] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:24:33.214948] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-27T17:24:34.014941] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-27T17:24:34.295491] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T17:24:34.814961] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-27T17:24:35.614999] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-27T17:24:35.734568] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T17:24:35.885737] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T17:24:36.414962] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-27T17:24:36.648363] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:24:37.214928] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-27T17:24:37.265292] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:24:37.861532] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:24:38.014923] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-27T17:24:38.814948] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-27T17:24:39.079291] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T17:24:39.084934] [INFO ] [REMOTE ] AZZ: Full fetch complete (32113 records). [2025-10-27T17:24:39.085010] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-27T17:24:39.470435] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-27T17:24:39.470520] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-27T17:24:39.470997] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-27T17:24:39.471059] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-27T17:24:39.471950] [DEBUG] [LOCAL ] AZZ: Trimmed 32113 records to 22861 (keeping 200 days of data) [2025-10-27T17:24:39.615743] [DEBUG] [LOCAL ] AZZ: Primary data saved (22861 records). [2025-10-27T17:24:39.615813] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-27T17:24:39.616071] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-27T17:24:39.617086] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZZ took 20.1s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-10-27T17:24:39.787397] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:39.843753] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-27T17:24:39.844069] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-10-27T17:24:40.015825] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:40.016046] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-27T17:24:40.016092] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-27T17:24:40.016292] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-27T17:24:40.016347] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-27T17:24:40.365744] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:40.414898] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-27T17:24:40.951504] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T17:24:41.086958] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T17:24:41.214931] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-27T17:24:42.015012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-27T17:24:42.577578] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-27T17:24:42.668750] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T17:24:42.814983] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-27T17:24:42.983481] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T17:24:43.614961] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-27T17:24:43.701292] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:24:44.414951] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-27T17:24:45.214952] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-27T17:24:45.708368] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:24:45.711158] [INFO ] [REMOTE ] AZO: Full fetch complete (16042 records). [2025-10-27T17:24:45.711233] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-27T17:24:46.016814] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-27T17:24:46.109364] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-27T17:24:46.109593] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-27T17:24:46.110266] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-27T17:24:46.110389] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-27T17:24:46.111742] [DEBUG] [LOCAL ] AZO: Trimmed 16042 records to 10621 (keeping 200 days of data) [2025-10-27T17:24:46.188344] [DEBUG] [LOCAL ] AZO: Primary data saved (10621 records). [2025-10-27T17:24:46.188673] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-27T17:24:46.188823] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZO took 26.7s. Estimated remaining: 4h 23m 24s. Rate: 8.2 symbols/min [2025-10-27T17:24:46.341357] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T17:24:46.417224] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:46.463935] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-27T17:24:46.464245] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-10-27T17:24:46.635474] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:46.635696] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-27T17:24:46.635752] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-27T17:24:46.635937] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-27T17:24:46.635974] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-27T17:24:46.840446] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-27T17:24:46.989068] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:47.210728] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:24:47.614931] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-27T17:24:48.018872] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-27T17:24:48.414972] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-27T17:24:48.639765] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:24:49.214966] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-27T17:24:49.644858] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:24:50.015009] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-27T17:24:50.582275] [DEBUG] [REMOTE ] BABA: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-27T17:24:50.582374] [WARN ] [REMOTE ] BABA: No data returned for month 2025-03 [2025-10-27T17:24:50.582442] [FATAL] [REMOTE ] BABA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:24:50.582484] [FATAL] [MAIN ] BABA: Failed to fetch primary data. [2025-10-27T17:24:50.582515] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:24:50.582576] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-27T17:24:50.582636] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-27T17:24:50.582721] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-10-27T17:24:50.582839] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-10-27T17:24:50.582890] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. BABA took 11.0s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-27T17:24:50.754848] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:50.807189] [DEBUG] [LOCAL ] BAH: Loaded 52412 existing records from primary storage. [2025-10-27T17:24:50.807523] [INFO ] [MAIN ] BAH: Loaded 52412 existing records. [2025-10-27T17:24:50.838831] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-27T17:24:50.987984] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:50.988180] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-27T17:24:50.988226] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-27T17:24:50.988410] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-27T17:24:50.988450] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-27T17:24:51.353362] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:51.453594] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-27T17:24:51.614932] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-27T17:24:51.849839] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:24:52.169282] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T17:24:52.272192] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T17:24:52.282547] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-27T17:24:52.282705] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-27T17:24:52.429219] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-27T17:24:52.679248] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-27T17:24:52.679326] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-27T17:24:52.680134] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-27T17:24:52.680196] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-27T17:24:52.681700] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-27T17:24:52.999535] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-27T17:24:52.999683] [INFO ] [MAIN ] BA: Full history saved. [2025-10-27T17:24:53.000423] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 29.9s. Estimated remaining: 4h 21m 47s. Rate: 8.3 symbols/min [2025-10-27T17:24:53.173079] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:53.209637] [DEBUG] [LOCAL ] BAK: Loaded 39995 existing records from primary storage. [2025-10-27T17:24:53.209940] [INFO ] [MAIN ] BAK: Loaded 39995 existing records. [2025-10-27T17:24:53.221181] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-27T17:24:53.391618] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:53.391822] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-27T17:24:53.391868] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-27T17:24:53.392290] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-27T17:24:53.392333] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-27T17:24:53.750520] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:54.014962] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-27T17:24:54.243799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:24:54.815025] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-27T17:24:55.118671] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:24:55.465386] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-27T17:24:55.614930] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-27T17:24:56.013788] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:24:56.414968] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-27T17:24:56.920328] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:24:56.925421] [INFO ] [REMOTE ] AYI: Full fetch complete (36376 records). [2025-10-27T17:24:56.925526] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-27T17:24:57.223436] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-27T17:24:57.322480] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-27T17:24:57.322584] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-27T17:24:57.323192] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-27T17:24:57.323260] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-27T17:24:57.324409] [DEBUG] [LOCAL ] AYI: Trimmed 36376 records to 23636 (keeping 200 days of data) [2025-10-27T17:24:57.505160] [DEBUG] [LOCAL ] AYI: Primary data saved (23636 records). [2025-10-27T17:24:57.513212] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-27T17:24:57.513458] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. AYI took 38.0s. Estimated remaining: 4h 21m 11s. Rate: 8.3 symbols/min [2025-10-27T17:24:57.549095] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:24:57.705886] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:24:57.761081] [DEBUG] [LOCAL ] BALL: Loaded 52693 existing records from primary storage. [2025-10-27T17:24:57.761541] [INFO ] [MAIN ] BALL: Loaded 52693 existing records. [2025-10-27T17:24:57.948019] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:24:57.948313] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-27T17:24:57.948385] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-27T17:24:57.948634] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-27T17:24:57.948735] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-27T17:24:58.025147] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-27T17:24:58.351851] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:24:58.815037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-27T17:24:59.124343] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:24:59.614966] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-27T17:24:59.932107] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-27T17:25:00.229036] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T17:25:00.414978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-27T17:25:01.215011] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-27T17:25:01.653551] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:25:02.014977] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-27T17:25:02.815078] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-27T17:25:04.121437] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-10-27T17:25:04.134304] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-27T17:25:04.405106] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (3.19 seconds). [2025-10-27T17:25:04.415167] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-27T17:25:05.059427] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T17:25:05.214953] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-27T17:25:05.599659] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.58 seconds). [2025-10-27T17:25:05.864309] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:25:06.014935] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-27T17:25:06.427118] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T17:25:06.484819] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:25:06.814999] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-27T17:25:07.614991] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-27T17:25:08.014926] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T17:25:08.414944] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-27T17:25:08.955289] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-27T17:25:09.214943] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-27T17:25:09.370399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:25:09.767454] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:25:10.014935] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-27T17:25:10.814999] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-27T17:25:11.614981] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-27T17:25:11.696308] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-27T17:25:11.932324] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T17:25:12.132310] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T17:25:12.414949] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-27T17:25:12.945959] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T17:25:13.215000] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-27T17:25:13.495312] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:25:14.014995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-27T17:25:14.815009] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-27T17:25:14.952364] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:25:15.542311] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:25:15.614949] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-27T17:25:16.414918] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-27T17:25:16.765694] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:25:17.213045] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:25:17.222716] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-27T17:25:18.014969] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-27T17:25:18.820057] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-27T17:25:18.842913] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-27T17:25:18.887465] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T17:25:19.614996] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-27T17:25:19.757631] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:25:20.068420] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:25:20.414984] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-27T17:25:21.214937] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-27T17:25:21.360112] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:25:21.368457] [INFO ] [REMOTE ] BAK: Full fetch complete (56810 records). [2025-10-27T17:25:21.368751] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-27T17:25:21.811538] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-27T17:25:21.811769] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-27T17:25:21.812596] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-27T17:25:21.812707] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-27T17:25:21.814317] [DEBUG] [LOCAL ] BAK: Trimmed 56810 records to 39231 (keeping 200 days of data) [2025-10-27T17:25:22.018168] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-27T17:25:22.048861] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T17:25:22.090353] [DEBUG] [LOCAL ] BAK: Primary data saved (39231 records). [2025-10-27T17:25:22.090506] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-27T17:25:22.090592] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAK took 29.1s. Estimated remaining: 4h 24m 4s. Rate: 8.2 symbols/min [2025-10-27T17:25:22.257071] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:22.257233] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-27T17:25:22.257269] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-27T17:25:22.257389] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-27T17:25:22.257440] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-27T17:25:22.257482] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-27T17:25:22.257514] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-27T17:25:22.595943] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:22.814944] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-27T17:25:23.614963] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-27T17:25:23.793546] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T17:25:23.804983] [INFO ] [REMOTE ] BAH: Full fetch complete (75272 records). [2025-10-27T17:25:23.805148] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-27T17:25:24.153684] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T17:25:24.155332] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-27T17:25:24.215267] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-27T17:25:24.225800] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-27T17:25:24.383858] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-27T17:25:24.396092] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-27T17:25:24.404352] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-27T17:25:24.410769] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-27T17:25:24.420357] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-27T17:25:24.482935] [DEBUG] [LOCAL ] BAH: Trimmed 75272 records to 51639 (keeping 200 days of data) [2025-10-27T17:25:24.879856] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-27T17:25:24.882405] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-27T17:25:24.883480] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-27T17:25:24.883855] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-27T17:25:24.890284] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-27T17:25:25.061142] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T17:25:25.204127] [DEBUG] [LOCAL ] BAH: Primary data saved (51639 records). [2025-10-27T17:25:25.210690] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-27T17:25:25.214289] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAH took 34.6s. Estimated remaining: 4h 23m 13s. Rate: 8.2 symbols/min [2025-10-27T17:25:25.215889] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-27T17:25:25.497790] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:25.608419] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T17:25:25.639788] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-27T17:25:25.640029] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-27T17:25:25.640127] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BAC took 39.5s. Estimated remaining: 4h 21m 55s. Rate: 8.2 symbols/min [2025-10-27T17:25:25.837479] [DEBUG] [LOCAL ] BAM: Loaded 52844 existing records from primary storage. [2025-10-27T17:25:25.836533] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:25.838023] [INFO ] [MAIN ] BAM: Loaded 52844 existing records. [2025-10-27T17:25:26.016496] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-27T17:25:26.016408] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:26.016789] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-27T17:25:26.017586] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-27T17:25:26.031122] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-27T17:25:26.031211] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-27T17:25:26.152682] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:25:26.161052] [DEBUG] [LOCAL ] BANC: Loaded 52164 existing records from primary storage. [2025-10-27T17:25:26.172195] [INFO ] [MAIN ] BANC: Loaded 52164 existing records. [2025-10-27T17:25:26.519065] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:26.547490] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-27T17:25:26.566418] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-27T17:25:26.587045] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:26.587331] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-27T17:25:26.587412] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-27T17:25:26.821928] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-27T17:25:26.939475] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:27.614954] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-27T17:25:27.747672] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T17:25:27.757621] [INFO ] [REMOTE ] BALL: Full fetch complete (75627 records). [2025-10-27T17:25:27.757755] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-27T17:25:28.164224] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-27T17:25:28.164321] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-27T17:25:28.165218] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-27T17:25:28.165294] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-27T17:25:28.166856] [DEBUG] [LOCAL ] BALL: Trimmed 75627 records to 51906 (keeping 200 days of data) [2025-10-27T17:25:28.395971] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:25:28.415062] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-27T17:25:28.508052] [DEBUG] [LOCAL ] BALL: Primary data saved (51906 records). [2025-10-27T17:25:28.508195] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-27T17:25:28.508283] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALL took 31.0s. Estimated remaining: 4h 21m 2s. Rate: 8.3 symbols/min [2025-10-27T17:25:28.672629] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:28.697699] [DEBUG] [LOCAL ] BAP: Loaded 25783 existing records from primary storage. [2025-10-27T17:25:28.697940] [INFO ] [MAIN ] BAP: Loaded 25783 existing records. [2025-10-27T17:25:28.871014] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:28.871180] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-27T17:25:28.871224] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-27T17:25:28.871389] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-27T17:25:28.871426] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-27T17:25:29.159428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:25:29.225351] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-27T17:25:29.229914] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:29.427747] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T17:25:29.753563] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T17:25:30.014943] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-27T17:25:30.814987] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-27T17:25:31.614924] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-27T17:25:31.745223] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T17:25:32.029276] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T17:25:32.123182] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:25:32.414945] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-27T17:25:33.215016] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-27T17:25:34.014941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-27T17:25:34.248218] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:25:34.305805] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:25:34.814920] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-27T17:25:35.366055] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:25:35.614957] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-27T17:25:36.280501] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T17:25:36.301112] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T17:25:36.414910] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-27T17:25:37.214988] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-27T17:25:37.577176] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T17:25:38.014980] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-27T17:25:38.274283] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:25:38.651260] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T17:25:38.814937] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-27T17:25:39.614964] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-27T17:25:40.076133] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:25:40.414984] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-27T17:25:41.035635] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:25:41.154752] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T17:25:41.214979] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-27T17:25:42.014947] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-27T17:25:42.303499] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:25:42.308018] [INFO ] [REMOTE ] BALY: Full fetch complete (16307 records). [2025-10-27T17:25:42.308126] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-27T17:25:42.495708] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T17:25:42.496006] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:25:42.496072] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:25:42.496140] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-27T17:25:42.496201] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-27T17:25:42.496236] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-27T17:25:42.496275] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-27T17:25:42.496329] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALY took 20.4s. Estimated remaining: 4h 22m 4s. Rate: 8.2 symbols/min [2025-10-27T17:25:42.670969] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:42.705185] [DEBUG] [LOCAL ] BARK: Loaded 38672 existing records from primary storage. [2025-10-27T17:25:42.705480] [INFO ] [MAIN ] BARK: Loaded 38672 existing records. [2025-10-27T17:25:42.814941] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-27T17:25:42.894301] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:42.894503] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-27T17:25:42.894552] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-27T17:25:42.894797] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-27T17:25:42.894854] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-27T17:25:43.289711] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:43.445481] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:25:43.614941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-27T17:25:44.099092] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:25:44.414939] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-27T17:25:45.214948] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-27T17:25:45.504562] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T17:25:45.726335] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T17:25:46.014941] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-27T17:25:46.205286] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:25:46.814923] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-27T17:25:47.589126] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:25:47.614900] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-27T17:25:47.677268] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:25:48.414938] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-27T17:25:48.819244] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:25:49.214994] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-27T17:25:49.751786] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T17:25:50.014942] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-27T17:25:50.232857] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:25:50.814981] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-27T17:25:51.362197] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T17:25:51.614981] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-27T17:25:52.263577] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:25:52.414983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-27T17:25:52.597736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T17:25:53.173614] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:25:53.214983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-27T17:25:54.014927] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-27T17:25:54.047186] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:25:54.815019] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-27T17:25:55.477691] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T17:25:55.614976] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-27T17:25:56.335930] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-27T17:25:56.342752] [INFO ] [REMOTE ] BAP: Full fetch complete (37273 records). [2025-10-27T17:25:56.342862] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-27T17:25:56.420055] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-27T17:25:56.713817] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-27T17:25:56.713891] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-27T17:25:56.714316] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-27T17:25:56.714354] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-27T17:25:56.715141] [DEBUG] [LOCAL ] BAP: Trimmed 37273 records to 24970 (keeping 200 days of data) [2025-10-27T17:25:56.862436] [DEBUG] [LOCAL ] BAP: Primary data saved (24970 records). [2025-10-27T17:25:56.862608] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-27T17:25:56.862803] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BAP took 28.4s. Estimated remaining: 4h 23m 8s. Rate: 8.2 symbols/min [2025-10-27T17:25:57.038949] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:25:57.123522] [DEBUG] [LOCAL ] BAX: Loaded 54316 existing records from primary storage. [2025-10-27T17:25:57.125983] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:25:57.126613] [INFO ] [MAIN ] BAX: Loaded 54316 existing records. [2025-10-27T17:25:57.220246] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-27T17:25:57.315805] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:25:57.316078] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-27T17:25:57.316127] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-27T17:25:57.316373] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-27T17:25:57.316461] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-27T17:25:57.673983] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:25:57.804081] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T17:25:58.014986] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-27T17:25:58.569114] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:25:58.815013] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-27T17:25:59.096598] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:25:59.614975] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-27T17:26:00.396026] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:26:00.406871] [INFO ] [REMOTE ] BAM: Full fetch complete (75312 records). [2025-10-27T17:26:00.407035] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-27T17:26:00.420545] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-27T17:26:00.819330] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-27T17:26:00.819417] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-27T17:26:00.820296] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-27T17:26:00.820364] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-27T17:26:00.821922] [DEBUG] [LOCAL ] BAM: Trimmed 75312 records to 52063 (keeping 200 days of data) [2025-10-27T17:26:01.133480] [DEBUG] [LOCAL ] BAM: Primary data saved (52063 records). [2025-10-27T17:26:01.133673] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-27T17:26:01.134700] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAM took 35.9s. Estimated remaining: 4h 22m 30s. Rate: 8.2 symbols/min [2025-10-27T17:26:01.225797] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-27T17:26:01.308754] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:01.361866] [DEBUG] [LOCAL ] BB: Loaded 53644 existing records from primary storage. [2025-10-27T17:26:01.362183] [INFO ] [MAIN ] BB: Loaded 53644 existing records. [2025-10-27T17:26:01.544989] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:01.545199] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-27T17:26:01.545248] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-27T17:26:01.545437] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-27T17:26:01.545475] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-27T17:26:01.962738] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:02.007418] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-27T17:26:02.021559] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-27T17:26:02.814981] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-27T17:26:05.177007] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-27T17:26:05.186164] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-27T17:26:05.326966] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (4.91 seconds). [2025-10-27T17:26:05.337373] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-27T17:26:05.509352] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (3.49 seconds). [2025-10-27T17:26:05.519678] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-27T17:26:05.725790] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (4.50 seconds). [2025-10-27T17:26:05.735753] [INFO ] [REMOTE ] BANC: Full fetch complete (74656 records). [2025-10-27T17:26:05.735863] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-27T17:26:06.115908] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-27T17:26:06.115979] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-27T17:26:06.116710] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-27T17:26:06.116772] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-27T17:26:06.118187] [DEBUG] [LOCAL ] BANC: Trimmed 74656 records to 51382 (keeping 200 days of data) [2025-10-27T17:26:06.413617] [DEBUG] [LOCAL ] BANC: Primary data saved (51382 records). [2025-10-27T17:26:06.413769] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-27T17:26:06.413848] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BANC took 40.8s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-10-27T17:26:06.577700] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:06.624208] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-27T17:26:06.624498] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-10-27T17:26:06.802964] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:06.803265] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-27T17:26:06.803384] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-27T17:26:06.803784] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-27T17:26:06.803841] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-27T17:26:07.135467] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:26:07.182131] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:07.177594] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-27T17:26:07.182595] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-27T17:26:07.589005] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-27T17:26:07.614899] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-27T17:26:07.665226] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T17:26:08.107163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T17:26:08.415020] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-27T17:26:09.115599] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:26:09.214985] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-27T17:26:09.929523] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-27T17:26:10.015008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-27T17:26:10.273832] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:26:10.486400] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T17:26:10.815004] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-27T17:26:11.614990] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-27T17:26:12.088452] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:26:12.097200] [INFO ] [REMOTE ] BARK: Full fetch complete (55926 records). [2025-10-27T17:26:12.097416] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-27T17:26:12.423208] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-27T17:26:12.562843] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-27T17:26:12.562957] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-27T17:26:12.563695] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-27T17:26:12.563825] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-27T17:26:12.595732] [DEBUG] [LOCAL ] BARK: Trimmed 55926 records to 37982 (keeping 200 days of data) [2025-10-27T17:26:12.597993] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:26:12.818928] [DEBUG] [LOCAL ] BARK: Primary data saved (37982 records). [2025-10-27T17:26:12.819077] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-27T17:26:12.819161] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BARK took 30.3s. Estimated remaining: 4h 21m 46s. Rate: 8.2 symbols/min [2025-10-27T17:26:12.987800] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:13.026859] [DEBUG] [LOCAL ] BBAR: Loaded 43302 existing records from primary storage. [2025-10-27T17:26:13.027238] [INFO ] [MAIN ] BBAR: Loaded 43302 existing records. [2025-10-27T17:26:13.215970] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-27T17:26:13.215734] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:13.217729] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-27T17:26:13.217808] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-27T17:26:13.218120] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-27T17:26:13.218211] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-27T17:26:13.564003] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:26:13.640598] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:14.015026] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-27T17:26:14.450579] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-27T17:26:14.814960] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-27T17:26:15.480150] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-27T17:26:15.517582] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:26:15.614900] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-27T17:26:16.415021] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-27T17:26:17.093158] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-27T17:26:17.138530] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T17:26:17.214914] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-27T17:26:17.899708] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:26:18.014909] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-27T17:26:18.814965] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-27T17:26:18.957552] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:26:19.316822] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:26:19.614949] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-27T17:26:20.414958] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-27T17:26:20.932882] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T17:26:21.160275] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T17:26:21.214904] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-27T17:26:21.954244] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:26:22.014966] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-27T17:26:22.814941] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-27T17:26:23.232975] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T17:26:23.520824] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-27T17:26:23.614924] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-27T17:26:24.414923] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-27T17:26:24.472615] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:26:25.044748] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:26:25.214978] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-27T17:26:26.014987] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-27T17:26:26.814920] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-27T17:26:26.919145] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-27T17:26:26.960026] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:26:27.614976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-27T17:26:28.150934] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:26:28.414954] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-27T17:26:29.158697] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T17:26:29.214902] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-27T17:26:29.321397] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:26:30.015009] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-27T17:26:30.472768] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T17:26:30.482786] [INFO ] [REMOTE ] BB: Full fetch complete (76958 records). [2025-10-27T17:26:30.482909] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-27T17:26:30.820121] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-27T17:26:30.875250] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-27T17:26:30.875327] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-27T17:26:30.876127] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-27T17:26:30.876193] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-27T17:26:30.877628] [DEBUG] [LOCAL ] BB: Trimmed 76958 records to 52860 (keeping 200 days of data) [2025-10-27T17:26:31.187565] [DEBUG] [LOCAL ] BB: Primary data saved (52860 records). [2025-10-27T17:26:31.187738] [INFO ] [MAIN ] BB: Full history saved. [2025-10-27T17:26:31.188823] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BB took 30.1s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-27T17:26:31.364874] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:31.461000] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T17:26:31.484848] [DEBUG] [LOCAL ] BBD: Loaded 54051 existing records from primary storage. [2025-10-27T17:26:31.486884] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T17:26:31.487234] [INFO ] [MAIN ] BBD: Loaded 54051 existing records. [2025-10-27T17:26:31.620006] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-27T17:26:31.677088] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:31.677355] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-27T17:26:31.677421] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-27T17:26:31.677730] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-27T17:26:31.677786] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-27T17:26:32.046380] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:32.102506] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:26:32.414937] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-27T17:26:33.214952] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-27T17:26:33.729804] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T17:26:33.739524] [INFO ] [REMOTE ] BAX: Full fetch complete (77232 records). [2025-10-27T17:26:33.739706] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-27T17:26:33.740529] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:26:33.740621] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:26:33.740699] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:26:33.740748] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-27T17:26:33.740807] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-27T17:26:33.740885] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-10-27T17:26:33.741046] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-10-27T17:26:33.741133] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BAX took 36.9s. Estimated remaining: 4h 22m 34s. Rate: 8.2 symbols/min [2025-10-27T17:26:33.907191] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:33.937571] [DEBUG] [LOCAL ] BBDC: Loaded 33245 existing records from primary storage. [2025-10-27T17:26:33.937887] [INFO ] [MAIN ] BBDC: Loaded 33245 existing records. [2025-10-27T17:26:34.026049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-27T17:26:34.113797] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:34.113973] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-27T17:26:34.114017] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-27T17:26:34.114182] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-27T17:26:34.114220] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-27T17:26:34.483206] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:34.732838] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T17:26:34.814904] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-27T17:26:35.068349] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-27T17:26:35.615000] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-27T17:26:35.670706] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:26:35.994032] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:26:36.414967] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-27T17:26:37.064478] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:26:37.073393] [INFO ] [REMOTE ] BBAR: Full fetch complete (61256 records). [2025-10-27T17:26:37.073527] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-27T17:26:37.220111] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-27T17:26:37.468128] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-27T17:26:37.468305] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-27T17:26:37.469034] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-27T17:26:37.469119] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-27T17:26:37.492907] [DEBUG] [LOCAL ] BBAR: Trimmed 61256 records to 42596 (keeping 200 days of data) [2025-10-27T17:26:37.495909] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T17:26:37.758172] [DEBUG] [LOCAL ] BBAR: Primary data saved (42596 records). [2025-10-27T17:26:37.758302] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-27T17:26:37.758381] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAR took 24.9s. Estimated remaining: 4h 21m 54s. Rate: 8.2 symbols/min [2025-10-27T17:26:37.924052] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:37.930305] [DEBUG] [LOCAL ] BBDO: Loaded 4992 existing records from primary storage. [2025-10-27T17:26:37.930495] [INFO ] [MAIN ] BBDO: Loaded 4992 existing records. [2025-10-27T17:26:38.020098] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-27T17:26:38.110012] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:38.110253] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-27T17:26:38.110300] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-27T17:26:38.110440] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-27T17:26:38.110478] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-27T17:26:38.459235] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:38.814958] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-27T17:26:39.220682] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T17:26:39.505492] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:26:39.577975] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T17:26:39.614936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-27T17:26:40.279597] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T17:26:40.414990] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-27T17:26:41.214953] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-27T17:26:42.014956] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-27T17:26:42.376549] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T17:26:42.583503] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T17:26:42.814959] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-27T17:26:42.960173] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-27T17:26:42.972075] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-27T17:26:42.972361] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-27T17:26:43.371675] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-27T17:26:43.371768] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-27T17:26:43.372584] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-27T17:26:43.372627] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-27T17:26:43.374133] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-27T17:26:43.630504] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-27T17:26:43.681236] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-27T17:26:43.681412] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-27T17:26:43.683016] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAI took 37.3s. Estimated remaining: 4h 21m 33s. Rate: 8.2 symbols/min [2025-10-27T17:26:43.850364] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:43.870104] [DEBUG] [LOCAL ] BBN: Loaded 17992 existing records from primary storage. [2025-10-27T17:26:43.870342] [INFO ] [MAIN ] BBN: Loaded 17992 existing records. [2025-10-27T17:26:44.052665] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:44.053057] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-27T17:26:44.053111] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-27T17:26:44.053289] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-27T17:26:44.053345] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-27T17:26:44.289225] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T17:26:44.372716] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:26:44.422834] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-27T17:26:44.466284] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:45.214936] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-27T17:26:45.682729] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:26:45.717105] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T17:26:46.014933] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-27T17:26:46.814956] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-27T17:26:46.875418] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T17:26:47.614952] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-27T17:26:48.414946] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-27T17:26:48.450506] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T17:26:48.493264] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T17:26:48.780322] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:26:49.214974] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-27T17:26:50.015022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-27T17:26:50.651232] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:26:50.710539] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-27T17:26:50.814936] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-27T17:26:51.614934] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-27T17:26:52.045056] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:26:52.051821] [INFO ] [REMOTE ] BBDC: Full fetch complete (48847 records). [2025-10-27T17:26:52.051945] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-27T17:26:52.415935] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-27T17:26:52.451594] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-27T17:26:52.451702] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-27T17:26:52.452321] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-27T17:26:52.452380] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-27T17:26:52.453530] [DEBUG] [LOCAL ] BBDC: Trimmed 48847 records to 32408 (keeping 200 days of data) [2025-10-27T17:26:52.653845] [DEBUG] [LOCAL ] BBDC: Primary data saved (32408 records). [2025-10-27T17:26:52.653976] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-27T17:26:52.654059] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBDC took 18.9s. Estimated remaining: 4h 21m 42s. Rate: 8.2 symbols/min [2025-10-27T17:26:52.852230] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:52.852425] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-27T17:26:52.852463] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-27T17:26:52.852573] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-27T17:26:52.852614] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-27T17:26:52.852688] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-27T17:26:52.852739] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-27T17:26:53.220811] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-27T17:26:53.253565] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:53.290744] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:26:53.337604] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:26:53.783237] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T17:26:54.014957] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-27T17:26:54.815010] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-27T17:26:55.020384] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:26:55.020730] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-27T17:26:55.020815] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:26:55.020862] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-27T17:26:55.020896] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:26:55.020931] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-27T17:26:55.020986] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-27T17:26:55.021022] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-27T17:26:55.021061] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-27T17:26:55.021106] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 2.4s. Estimated remaining: 4h 20m 46s. Rate: 8.2 symbols/min [2025-10-27T17:26:55.186784] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:26:55.194749] [DEBUG] [LOCAL ] BBU: Loaded 5880 existing records from primary storage. [2025-10-27T17:26:55.194956] [INFO ] [MAIN ] BBU: Loaded 5880 existing records. [2025-10-27T17:26:55.372148] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:26:55.372353] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-27T17:26:55.372399] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-27T17:26:55.372543] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-27T17:26:55.372579] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-27T17:26:55.618799] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-27T17:26:55.737205] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:26:55.943483] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:26:56.414979] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-27T17:26:56.564362] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:26:57.215008] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-27T17:26:58.014912] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-27T17:26:58.054687] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:26:58.070439] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:26:58.712848] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T17:26:58.814980] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-27T17:26:59.229173] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:26:59.614941] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-27T17:27:00.163883] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:27:00.415018] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-27T17:27:01.214988] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-27T17:27:02.014933] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-27T17:27:02.815060] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-27T17:27:04.022905] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-27T17:27:04.024368] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-27T17:27:04.314605] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T17:27:04.414924] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-27T17:27:04.543674] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:27:04.625797] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T17:27:04.816278] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (4.40 seconds). [2025-10-27T17:27:05.214956] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-27T17:27:05.406058] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:27:06.015037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-27T17:27:06.106087] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T17:27:06.459778] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T17:27:06.814951] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-27T17:27:07.620308] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-27T17:27:07.622918] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:27:08.414984] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-27T17:27:08.477363] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T17:27:09.100120] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T17:27:09.101637] [INFO ] [REMOTE ] BBDO: Full fetch complete (7357 records). [2025-10-27T17:27:09.101733] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-27T17:27:09.102092] [FATAL] [VALIDATOR ] BBDO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:27:09.102192] [FATAL] [MAIN ] BBDO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:27:09.102235] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:27:09.102298] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-27T17:27:09.102358] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-27T17:27:09.102393] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-27T17:27:09.102525] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-27T17:27:09.102610] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBDO took 31.3s. Estimated remaining: 4h 21m 45s. Rate: 8.2 symbols/min [2025-10-27T17:27:09.220140] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-27T17:27:09.271801] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:09.285671] [DEBUG] [LOCAL ] BBUC: Loaded 14138 existing records from primary storage. [2025-10-27T17:27:09.285938] [INFO ] [MAIN ] BBUC: Loaded 14138 existing records. [2025-10-27T17:27:09.461104] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:09.461297] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-27T17:27:09.461342] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-27T17:27:09.461618] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-27T17:27:09.461707] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-27T17:27:09.814872] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:10.014926] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-27T17:27:10.095592] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:27:10.814944] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-27T17:27:10.924246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T17:27:11.614983] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-27T17:27:12.038608] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:27:12.414947] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-27T17:27:12.482888] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:27:13.214954] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-27T17:27:13.625203] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:27:13.999901] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:27:14.014896] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-27T17:27:14.662832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:27:14.814946] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-27T17:27:15.250708] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:27:15.614948] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-27T17:27:16.415001] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-27T17:27:16.673246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T17:27:17.215026] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-27T17:27:17.347701] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:27:17.350623] [INFO ] [REMOTE ] BBN: Full fetch complete (24881 records). [2025-10-27T17:27:17.350718] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-27T17:27:17.351186] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:27:17.351264] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:27:17.351305] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:27:17.351342] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-27T17:27:17.351396] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-27T17:27:17.351429] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-27T17:27:17.351577] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-27T17:27:17.351684] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBN took 33.7s. Estimated remaining: 4h 21m 46s. Rate: 8.2 symbols/min [2025-10-27T17:27:17.515496] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:17.567287] [DEBUG] [LOCAL ] BBVA: Loaded 49816 existing records from primary storage. [2025-10-27T17:27:17.567620] [INFO ] [MAIN ] BBVA: Loaded 49816 existing records. [2025-10-27T17:27:17.740766] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:17.740941] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-27T17:27:17.740986] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-27T17:27:17.741180] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-27T17:27:17.741217] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-27T17:27:18.020111] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-27T17:27:18.082798] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:18.698440] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T17:27:18.814992] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-27T17:27:18.932741] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:27:19.588068] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T17:27:19.591509] [INFO ] [REMOTE ] BBU: Full fetch complete (7577 records). [2025-10-27T17:27:19.591707] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-27T17:27:19.617679] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-27T17:27:19.980022] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-27T17:27:19.980125] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-27T17:27:19.980442] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-27T17:27:19.980520] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-27T17:27:19.981021] [DEBUG] [LOCAL ] BBU: Trimmed 7577 records to 5811 (keeping 200 days of data) [2025-10-27T17:27:20.016433] [DEBUG] [LOCAL ] BBU: Primary data saved (5811 records). [2025-10-27T17:27:20.016595] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-27T17:27:20.016710] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBU took 25.0s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-27T17:27:20.193154] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:20.224554] [DEBUG] [LOCAL ] BBW: Loaded 27551 existing records from primary storage. [2025-10-27T17:27:20.224939] [INFO ] [MAIN ] BBW: Loaded 27551 existing records. [2025-10-27T17:27:20.455037] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-27T17:27:20.460715] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:20.462457] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-27T17:27:20.462522] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-27T17:27:20.462774] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-27T17:27:20.462834] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-27T17:27:20.616111] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:27:20.841738] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:21.214966] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-27T17:27:21.942486] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:27:22.014979] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-27T17:27:22.167715] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:27:22.178065] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-27T17:27:22.178235] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-27T17:27:22.559682] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-27T17:27:22.559770] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-27T17:27:22.560510] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-27T17:27:22.560552] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-27T17:27:22.562074] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 53275 (keeping 200 days of data) [2025-10-27T17:27:22.826200] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-27T17:27:22.868310] [DEBUG] [LOCAL ] BBD: Primary data saved (53275 records). [2025-10-27T17:27:22.868414] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-27T17:27:22.869258] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBD took 51.7s. Estimated remaining: 4h 20m 5s. Rate: 8.2 symbols/min [2025-10-27T17:27:23.036440] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:23.087303] [DEBUG] [LOCAL ] BBWI: Loaded 54371 existing records from primary storage. [2025-10-27T17:27:23.087732] [INFO ] [MAIN ] BBWI: Loaded 54371 existing records. [2025-10-27T17:27:23.270901] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:23.271226] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-27T17:27:23.271277] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-27T17:27:23.271474] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-27T17:27:23.271515] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-27T17:27:23.527254] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:27:23.589462] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:27:23.619998] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-27T17:27:23.691517] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:24.414963] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-27T17:27:24.773860] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:27:25.179256] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T17:27:25.214936] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-27T17:27:25.812497] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T17:27:26.014925] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-27T17:27:26.814951] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-27T17:27:27.292125] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:27:27.614909] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-27T17:27:27.904993] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:27:27.909064] [INFO ] [REMOTE ] BBUC: Full fetch complete (19293 records). [2025-10-27T17:27:27.909155] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-27T17:27:28.275012] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-27T17:27:28.275128] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-27T17:27:28.275613] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-27T17:27:28.275716] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-27T17:27:28.276692] [DEBUG] [LOCAL ] BBUC: Trimmed 19293 records to 13766 (keeping 200 days of data) [2025-10-27T17:27:28.361418] [DEBUG] [LOCAL ] BBUC: Primary data saved (13766 records). [2025-10-27T17:27:28.361547] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-27T17:27:28.361624] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 19.3s. Estimated remaining: 4h 19m 40s. Rate: 8.2 symbols/min [2025-10-27T17:27:28.422796] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-27T17:27:28.546858] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:28.593300] [DEBUG] [LOCAL ] BBY: Loaded 54210 existing records from primary storage. [2025-10-27T17:27:28.593617] [INFO ] [MAIN ] BBY: Loaded 54210 existing records. [2025-10-27T17:27:28.773769] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:28.774133] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-27T17:27:28.774190] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-27T17:27:28.774369] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-27T17:27:28.774407] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-27T17:27:29.126054] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:29.199913] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:27:29.214922] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-27T17:27:29.423698] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:27:30.014996] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-27T17:27:30.488995] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T17:27:30.814951] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-27T17:27:31.624014] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-27T17:27:31.631376] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:27:31.997989] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:27:32.414917] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-27T17:27:32.458767] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:27:33.214945] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-27T17:27:34.008392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:27:34.019366] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-27T17:27:34.539192] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:27:34.814940] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-27T17:27:35.392726] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:27:35.614934] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-27T17:27:35.905619] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:27:36.414966] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-27T17:27:37.214913] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-27T17:27:37.247964] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:27:37.684176] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T17:27:38.015016] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-27T17:27:38.814949] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-27T17:27:38.934506] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:27:38.960153] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T17:27:39.614956] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-27T17:27:40.421527] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-27T17:27:40.451840] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:27:40.451350] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:27:41.214939] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-27T17:27:42.014921] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-27T17:27:42.157885] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:27:42.814936] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-27T17:27:42.842550] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:27:43.039412] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:27:43.614936] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-27T17:27:44.284112] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:27:44.414931] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-27T17:27:45.214910] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-27T17:27:45.432734] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T17:27:45.703627] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:27:46.014934] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-27T17:27:46.515224] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T17:27:46.814976] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-27T17:27:47.298555] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:27:47.614913] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-27T17:27:48.061766] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:27:48.414935] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-27T17:27:49.214957] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-27T17:27:49.456980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:27:49.616468] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:27:49.622706] [INFO ] [REMOTE ] BBW: Full fetch complete (39374 records). [2025-10-27T17:27:49.622812] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-27T17:27:49.998036] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-27T17:27:49.998109] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-27T17:27:49.998606] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-27T17:27:49.998693] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-27T17:27:49.999583] [DEBUG] [LOCAL ] BBW: Trimmed 39374 records to 26942 (keeping 200 days of data) [2025-10-27T17:27:50.052621] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-27T17:27:50.164752] [DEBUG] [LOCAL ] BBW: Primary data saved (26942 records). [2025-10-27T17:27:50.164892] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-27T17:27:50.164991] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBW took 30.1s. Estimated remaining: 4h 21m 50s. Rate: 8.2 symbols/min [2025-10-27T17:27:50.331919] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:50.369767] [DEBUG] [LOCAL ] BC: Loaded 44612 existing records from primary storage. [2025-10-27T17:27:50.370059] [INFO ] [MAIN ] BC: Loaded 44612 existing records. [2025-10-27T17:27:50.555239] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:50.555453] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-27T17:27:50.555501] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-27T17:27:50.556051] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-27T17:27:50.556107] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-27T17:27:50.818912] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-27T17:27:50.933628] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:50.961810] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:27:51.389754] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T17:27:51.614945] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-27T17:27:52.420552] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-27T17:27:52.427316] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:27:53.214982] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-27T17:27:53.431931] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:27:53.441499] [INFO ] [REMOTE ] BBVA: Full fetch complete (71908 records). [2025-10-27T17:27:53.441620] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-27T17:27:53.842807] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-27T17:27:53.842912] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-27T17:27:53.843762] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-27T17:27:53.843844] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-27T17:27:53.845259] [DEBUG] [LOCAL ] BBVA: Trimmed 71908 records to 48999 (keeping 200 days of data) [2025-10-27T17:27:54.023355] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-27T17:27:54.094121] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:27:54.167487] [DEBUG] [LOCAL ] BBVA: Primary data saved (48999 records). [2025-10-27T17:27:54.167616] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-27T17:27:54.167723] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBVA took 36.8s. Estimated remaining: 4h 21m 11s. Rate: 8.2 symbols/min [2025-10-27T17:27:54.337733] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:54.374562] [DEBUG] [LOCAL ] BCAT: Loaded 34675 existing records from primary storage. [2025-10-27T17:27:54.374849] [INFO ] [MAIN ] BCAT: Loaded 34675 existing records. [2025-10-27T17:27:54.550405] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:54.550682] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-27T17:27:54.550751] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-27T17:27:54.551325] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-27T17:27:54.551385] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-27T17:27:54.823933] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-27T17:27:54.906445] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:55.077414] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T17:27:55.614899] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-27T17:27:56.125316] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T17:27:56.137192] [INFO ] [REMOTE ] BBY: Full fetch complete (77407 records). [2025-10-27T17:27:56.137459] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-27T17:27:56.418059] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-27T17:27:56.537279] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-27T17:27:56.537399] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-27T17:27:56.538288] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-27T17:27:56.538351] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-27T17:27:56.554878] [DEBUG] [LOCAL ] BBY: Trimmed 77407 records to 53430 (keeping 200 days of data) [2025-10-27T17:27:56.566730] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T17:27:56.903377] [DEBUG] [LOCAL ] BBY: Primary data saved (53430 records). [2025-10-27T17:27:56.903548] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-27T17:27:56.903756] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBY took 28.5s. Estimated remaining: 4h 20m 21s. Rate: 8.2 symbols/min [2025-10-27T17:27:57.066114] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:27:57.133415] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:27:57.162927] [DEBUG] [LOCAL ] BCC: Loaded 29040 existing records from primary storage. [2025-10-27T17:27:57.163209] [INFO ] [MAIN ] BCC: Loaded 29040 existing records. [2025-10-27T17:27:57.223959] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-27T17:27:57.338175] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:27:57.338408] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-27T17:27:57.338456] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-27T17:27:57.338640] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-27T17:27:57.338728] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-27T17:27:57.686582] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:27:57.790036] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T17:27:58.014975] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-27T17:27:58.814924] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-27T17:27:58.953427] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:27:59.025553] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T17:27:59.614977] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-27T17:27:59.876249] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T17:28:00.415039] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-27T17:28:01.214972] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-27T17:28:02.014955] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-27T17:28:02.433427] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-27T17:28:02.815022] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-27T17:28:04.269099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (3.85 seconds). [2025-10-27T17:28:04.275765] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-27T17:28:04.945551] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T17:28:04.956400] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-27T17:28:05.438359] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (4.22 seconds). [2025-10-27T17:28:05.446927] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-27T17:28:05.812772] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:28:06.014914] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-27T17:28:06.258240] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (4.24 seconds). [2025-10-27T17:28:06.380913] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:28:06.607398] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T17:28:06.814931] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-27T17:28:07.332361] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T17:28:07.615065] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-27T17:28:07.861112] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:28:08.414979] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-27T17:28:08.804067] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:28:09.214917] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-27T17:28:09.215600] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T17:28:10.014985] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-27T17:28:10.814951] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-27T17:28:11.432410] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T17:28:11.444858] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-27T17:28:11.445117] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-27T17:28:11.625785] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-27T17:28:11.772254] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T17:28:11.876749] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-27T17:28:11.876841] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-27T17:28:11.877690] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-27T17:28:11.877753] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-27T17:28:11.879256] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53591 (keeping 200 days of data) [2025-10-27T17:28:12.218130] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-27T17:28:12.231492] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-27T17:28:12.232566] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:28:12.232992] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBWI took 49.4s. Estimated remaining: 4h 21m 28s. Rate: 8.2 symbols/min [2025-10-27T17:28:12.415574] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-27T17:28:12.415504] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:12.464574] [DEBUG] [LOCAL ] BCE: Loaded 53017 existing records from primary storage. [2025-10-27T17:28:12.464935] [INFO ] [MAIN ] BCE: Loaded 53017 existing records. [2025-10-27T17:28:12.637387] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:12.637587] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-27T17:28:12.637633] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-27T17:28:12.637942] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-27T17:28:12.637998] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-27T17:28:12.984841] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:13.163127] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:28:13.214901] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-27T17:28:13.287099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:28:14.015007] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-27T17:28:14.578876] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T17:28:14.814913] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-27T17:28:15.576882] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:28:15.614921] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-27T17:28:16.414952] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-27T17:28:16.521456] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T17:28:17.214938] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-27T17:28:17.364715] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:28:17.406798] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:28:18.014956] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-27T17:28:18.771272] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T17:28:18.779903] [INFO ] [REMOTE ] BC: Full fetch complete (63922 records). [2025-10-27T17:28:18.780087] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-27T17:28:18.820155] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-27T17:28:19.204294] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-27T17:28:19.204564] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-27T17:28:19.205826] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-27T17:28:19.205919] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-27T17:28:19.207924] [DEBUG] [LOCAL ] BC: Trimmed 63922 records to 43867 (keeping 200 days of data) [2025-10-27T17:28:19.298626] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T17:28:19.519977] [DEBUG] [LOCAL ] BC: Primary data saved (43867 records). [2025-10-27T17:28:19.520166] [INFO ] [MAIN ] BC: Full history saved. [2025-10-27T17:28:19.520269] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 29.4s. Estimated remaining: 4h 21m 20s. Rate: 8.2 symbols/min [2025-10-27T17:28:19.623598] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-27T17:28:19.704526] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:19.737393] [DEBUG] [LOCAL ] BCH: Loaded 30400 existing records from primary storage. [2025-10-27T17:28:19.737786] [INFO ] [MAIN ] BCH: Loaded 30400 existing records. [2025-10-27T17:28:19.962094] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:19.962413] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-27T17:28:19.962496] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-27T17:28:19.962852] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-27T17:28:19.962939] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-27T17:28:20.376178] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:20.410906] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:28:20.415028] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-27T17:28:21.214975] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-27T17:28:21.249369] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:28:21.528334] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:28:21.535577] [INFO ] [REMOTE ] BCC: Full fetch complete (41760 records). [2025-10-27T17:28:21.535766] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-27T17:28:21.980212] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-27T17:28:21.980298] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-27T17:28:21.980825] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-27T17:28:21.980888] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-27T17:28:21.981857] [DEBUG] [LOCAL ] BCC: Trimmed 41760 records to 28474 (keeping 200 days of data) [2025-10-27T17:28:22.034136] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-27T17:28:22.153634] [DEBUG] [LOCAL ] BCC: Primary data saved (28474 records). [2025-10-27T17:28:22.153828] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-27T17:28:22.153920] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 25.3s. Estimated remaining: 4h 20m 30s. Rate: 8.2 symbols/min [2025-10-27T17:28:22.319056] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:22.344011] [DEBUG] [LOCAL ] BCO: Loaded 25188 existing records from primary storage. [2025-10-27T17:28:22.344270] [INFO ] [MAIN ] BCO: Loaded 25188 existing records. [2025-10-27T17:28:22.543745] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:22.544107] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-27T17:28:22.544182] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-27T17:28:22.544388] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-27T17:28:22.544440] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-27T17:28:22.822201] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-27T17:28:22.824548] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:28:22.950914] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:22.965055] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T17:28:23.614956] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-27T17:28:24.356046] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T17:28:24.414902] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-27T17:28:24.776972] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:28:25.214941] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-27T17:28:25.792315] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:28:26.014939] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-27T17:28:26.196753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:28:26.814942] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-27T17:28:27.080440] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:28:27.614992] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-27T17:28:28.415023] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-27T17:28:28.482693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:28:28.829319] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:28:28.836165] [INFO ] [REMOTE ] BCAT: Full fetch complete (50048 records). [2025-10-27T17:28:28.836260] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-27T17:28:29.207337] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-27T17:28:29.207417] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-27T17:28:29.207978] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-27T17:28:29.208040] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-27T17:28:29.209004] [DEBUG] [LOCAL ] BCAT: Trimmed 50048 records to 34005 (keeping 200 days of data) [2025-10-27T17:28:29.264016] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-27T17:28:29.417332] [DEBUG] [LOCAL ] BCAT: Primary data saved (34005 records). [2025-10-27T17:28:29.417477] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-27T17:28:29.417558] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCAT took 35.2s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-10-27T17:28:29.595054] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:29.614534] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:28:29.676999] [DEBUG] [LOCAL ] BCS: Loaded 54220 existing records from primary storage. [2025-10-27T17:28:29.677352] [INFO ] [MAIN ] BCS: Loaded 54220 existing records. [2025-10-27T17:28:29.856523] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:29.856740] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-27T17:28:29.856793] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-27T17:28:29.857097] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-27T17:28:29.857136] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-27T17:28:30.015247] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-27T17:28:30.219158] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:30.560197] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:28:30.814964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-27T17:28:31.594510] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T17:28:31.614916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-27T17:28:32.077194] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T17:28:32.414950] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-27T17:28:33.214912] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-27T17:28:33.386242] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:28:33.689413] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T17:28:34.014967] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-27T17:28:34.233786] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:28:34.815015] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-27T17:28:35.513152] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T17:28:35.614911] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-27T17:28:36.272340] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-27T17:28:36.414942] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-27T17:28:36.646111] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:28:37.214968] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-27T17:28:38.014980] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-27T17:28:38.284340] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T17:28:38.814923] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-27T17:28:38.835855] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:28:38.889772] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:28:39.614999] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-27T17:28:39.781103] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:28:40.414934] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-27T17:28:40.441082] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:28:41.214913] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-27T17:28:41.608668] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:28:42.014917] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-27T17:28:42.259521] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:28:42.265910] [INFO ] [REMOTE ] BCH: Full fetch complete (41816 records). [2025-10-27T17:28:42.266005] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-27T17:28:42.651683] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-27T17:28:42.651770] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-27T17:28:42.652269] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-27T17:28:42.652310] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-27T17:28:42.653238] [DEBUG] [LOCAL ] BCH: Trimmed 41816 records to 29646 (keeping 200 days of data) [2025-10-27T17:28:42.818696] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-27T17:28:42.831596] [DEBUG] [LOCAL ] BCH: Primary data saved (29646 records). [2025-10-27T17:28:42.831750] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-27T17:28:42.831859] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 23.3s. Estimated remaining: 4h 21m 10s. Rate: 8.2 symbols/min [2025-10-27T17:28:42.923280] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:28:43.024076] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:43.052326] [DEBUG] [LOCAL ] BCSF: Loaded 28577 existing records from primary storage. [2025-10-27T17:28:43.052578] [INFO ] [MAIN ] BCSF: Loaded 28577 existing records. [2025-10-27T17:28:43.233052] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:43.233261] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-27T17:28:43.233317] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-27T17:28:43.233501] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-27T17:28:43.233539] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-27T17:28:43.581919] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:43.614898] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-27T17:28:44.414908] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-27T17:28:44.509924] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:28:44.827436] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T17:28:45.214916] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-27T17:28:45.502272] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T17:28:46.014947] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-27T17:28:46.230894] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:28:46.814976] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-27T17:28:47.111207] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:28:47.614977] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-27T17:28:48.414905] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-27T17:28:48.568854] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:28:48.883626] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:28:49.214932] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-27T17:28:50.021289] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-27T17:28:50.030074] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:28:50.067542] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T17:28:50.814946] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-27T17:28:50.891298] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:28:50.895019] [INFO ] [REMOTE ] BCO: Full fetch complete (35977 records). [2025-10-27T17:28:50.895096] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-27T17:28:51.289825] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-27T17:28:51.289934] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-27T17:28:51.290432] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-27T17:28:51.290475] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-27T17:28:51.291250] [DEBUG] [LOCAL ] BCO: Trimmed 35977 records to 24419 (keeping 200 days of data) [2025-10-27T17:28:51.432106] [DEBUG] [LOCAL ] BCO: Primary data saved (24419 records). [2025-10-27T17:28:51.432225] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-27T17:28:51.432310] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCO took 29.3s. Estimated remaining: 4h 21m 14s. Rate: 8.2 symbols/min [2025-10-27T17:28:51.610134] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:51.614981] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-27T17:28:51.637875] [DEBUG] [LOCAL ] BCX: Loaded 22345 existing records from primary storage. [2025-10-27T17:28:51.638270] [INFO ] [MAIN ] BCX: Loaded 22345 existing records. [2025-10-27T17:28:51.818815] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:51.819011] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-27T17:28:51.819058] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-27T17:28:51.819232] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-27T17:28:51.819300] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-27T17:28:52.212425] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:52.414994] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-27T17:28:52.475702] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:28:52.486121] [INFO ] [REMOTE ] BCE: Full fetch complete (76097 records). [2025-10-27T17:28:52.486293] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-27T17:28:52.961729] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-27T17:28:52.961831] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-27T17:28:52.962901] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-27T17:28:52.962980] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-27T17:28:52.964583] [DEBUG] [LOCAL ] BCE: Trimmed 76097 records to 52235 (keeping 200 days of data) [2025-10-27T17:28:53.249203] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-27T17:28:53.368214] [DEBUG] [LOCAL ] BCE: Primary data saved (52235 records). [2025-10-27T17:28:53.368357] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-27T17:28:53.368822] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCE took 41.1s. Estimated remaining: 4h 20m 18s. Rate: 8.2 symbols/min [2025-10-27T17:28:53.555470] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:28:53.581825] [DEBUG] [LOCAL ] BDC: Loaded 24242 existing records from primary storage. [2025-10-27T17:28:53.582081] [INFO ] [MAIN ] BDC: Loaded 24242 existing records. [2025-10-27T17:28:53.870935] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-27T17:28:53.875189] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:28:53.886993] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-27T17:28:53.887770] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-27T17:28:53.907100] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-27T17:28:53.907799] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:28:53.908139] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-27T17:28:54.025377] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-27T17:28:54.283438] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:28:54.331714] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:28:54.814943] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-27T17:28:55.244254] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:28:55.614951] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-27T17:28:55.962961] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:28:56.414925] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-27T17:28:56.681791] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:28:57.214953] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-27T17:28:58.014917] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-27T17:28:58.035883] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:28:58.190303] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T17:28:58.814921] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-27T17:28:59.168168] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:28:59.427493] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T17:28:59.614947] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-27T17:29:00.414950] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-27T17:29:01.214938] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-27T17:29:02.015030] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-27T17:29:02.247569] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-27T17:29:02.815019] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-27T17:29:03.548484] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-10-27T17:29:03.566950] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-27T17:29:03.614930] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-27T17:29:04.368766] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-27T17:29:04.414911] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-27T17:29:05.106173] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-27T17:29:05.214915] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-27T17:29:05.365453] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:29:05.389452] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T17:29:06.014949] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-27T17:29:06.619622] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T17:29:06.814938] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-27T17:29:07.240088] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:29:07.620100] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-27T17:29:07.631248] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:29:08.415009] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-27T17:29:09.214947] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-27T17:29:09.430022] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:29:09.441673] [INFO ] [REMOTE ] BCS: Full fetch complete (77524 records). [2025-10-27T17:29:09.441921] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-27T17:29:09.881632] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-27T17:29:09.881879] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-27T17:29:09.883067] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-27T17:29:09.883285] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-27T17:29:09.896568] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:29:09.901454] [DEBUG] [LOCAL ] BCS: Trimmed 77524 records to 53437 (keeping 200 days of data) [2025-10-27T17:29:10.015188] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-27T17:29:10.018293] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T17:29:10.033703] [INFO ] [REMOTE ] BCSF: Full fetch complete (39946 records). [2025-10-27T17:29:10.038815] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-27T17:29:10.563568] [DEBUG] [LOCAL ] BCS: Primary data saved (53437 records). [2025-10-27T17:29:10.573963] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-27T17:29:10.579177] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCS took 41.2s. Estimated remaining: 4h 21m 39s. Rate: 8.1 symbols/min [2025-10-27T17:29:10.638224] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-27T17:29:10.638318] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-27T17:29:10.638873] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-27T17:29:10.638935] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-27T17:29:10.639806] [DEBUG] [LOCAL ] BCSF: Trimmed 39946 records to 27770 (keeping 200 days of data) [2025-10-27T17:29:10.802020] [DEBUG] [LOCAL ] BCSF: Primary data saved (27770 records). [2025-10-27T17:29:10.802151] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-27T17:29:10.802233] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCSF took 28.0s. Estimated remaining: 4h 20m 28s. Rate: 8.2 symbols/min [2025-10-27T17:29:10.814914] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-27T17:29:11.442520] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T17:29:11.525532] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:29:11.614935] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-27T17:29:12.415031] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-27T17:29:12.791929] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T17:29:12.797178] [INFO ] [REMOTE ] BCX: Full fetch complete (33624 records). [2025-10-27T17:29:12.797285] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-27T17:29:13.158843] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-27T17:29:13.158921] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-27T17:29:13.159348] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-27T17:29:13.159387] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-27T17:29:13.160171] [DEBUG] [LOCAL ] BCX: Trimmed 33624 records to 21778 (keeping 200 days of data) [2025-10-27T17:29:13.291725] [DEBUG] [LOCAL ] BCX: Primary data saved (21778 records). [2025-10-27T17:29:13.291906] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-27T17:29:13.292152] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCX took 21.9s. Estimated remaining: 4h 19m 37s. Rate: 8.2 symbols/min [2025-10-27T17:29:13.327093] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:29:13.333518] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-27T17:29:14.568165] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:29:14.573747] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-27T17:29:15.350266] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T17:29:15.356592] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-27T17:29:16.265194] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:29:16.271667] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-27T17:29:17.349549] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:29:17.356238] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-27T17:29:18.131873] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:29:18.136352] [INFO ] [REMOTE ] BDC: Full fetch complete (35610 records). [2025-10-27T17:29:18.136438] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-27T17:29:18.531922] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-27T17:29:18.531995] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-27T17:29:18.532420] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-27T17:29:18.532460] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-27T17:29:18.533224] [DEBUG] [LOCAL ] BDC: Trimmed 35610 records to 23527 (keeping 200 days of data) [2025-10-27T17:29:18.674148] [DEBUG] [LOCAL ] BDC: Primary data saved (23527 records). [2025-10-27T17:29:18.674273] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-27T17:29:18.674346] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 25.3s. Estimated remaining: 4h 19m 13s. Rate: 8.2 symbols/min [2025-10-27T17:29:19.173157] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.353378] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.375362] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.377334] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:19.430011] [DEBUG] [LOCAL ] BDJ: Loaded 29651 existing records from primary storage. [2025-10-27T17:29:19.430449] [INFO ] [MAIN ] BDJ: Loaded 29651 existing records. [2025-10-27T17:29:19.600354] [DEBUG] [LOCAL ] BDX: Loaded 52874 existing records from primary storage. [2025-10-27T17:29:19.618771] [INFO ] [MAIN ] BDX: Loaded 52874 existing records. [2025-10-27T17:29:19.613289] [DEBUG] [LOCAL ] BDN: Loaded 48337 existing records from primary storage. [2025-10-27T17:29:19.670910] [INFO ] [MAIN ] BDN: Loaded 48337 existing records. [2025-10-27T17:29:19.773205] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:19.826391] [DEBUG] [LOCAL ] BE: Loaded 54441 existing records from primary storage. [2025-10-27T17:29:19.849357] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-27T17:29:19.888442] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-27T17:29:19.888232] [INFO ] [MAIN ] BE: Loaded 54441 existing records. [2025-10-27T17:29:19.959327] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-27T17:29:19.970632] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-27T17:29:20.107340] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.135226] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.174032] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-27T17:29:20.252386] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-27T17:29:20.255736] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-27T17:29:20.372467] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.414803] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.483971] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-27T17:29:20.492402] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:20.546803] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-27T17:29:20.560996] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-27T17:29:20.560858] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-27T17:29:20.605611] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-27T17:29:20.591119] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-27T17:29:20.622537] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-27T17:29:21.411067] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.526147] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-27T17:29:21.620261] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.642209] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-27T17:29:21.818761] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.815782] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:21.819274] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-27T17:29:21.819057] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-27T17:29:22.976377] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:29:22.982782] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-27T17:29:23.077578] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T17:29:23.087192] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-27T17:29:23.299366] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:29:23.309635] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-27T17:29:23.632858] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T17:29:23.643069] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-27T17:29:23.823818] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:29:23.830875] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-27T17:29:24.153144] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:29:24.414990] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-27T17:29:24.791198] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:29:24.937898] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:29:24.974251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T17:29:25.214963] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-27T17:29:25.597363] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T17:29:26.014991] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-27T17:29:26.789470] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T17:29:26.814900] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-27T17:29:27.192772] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:29:27.615003] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-27T17:29:28.414951] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-27T17:29:28.931498] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T17:29:29.129432] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:29:29.214900] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-27T17:29:29.318097] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:29:30.014945] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-27T17:29:30.476387] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:29:30.814897] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-27T17:29:30.854680] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:29:31.614991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-27T17:29:31.937023] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T17:29:32.414949] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-27T17:29:33.204094] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:29:33.214909] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-27T17:29:34.014969] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-27T17:29:34.106926] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T17:29:34.340961] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T17:29:34.814970] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-27T17:29:35.551284] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:29:35.614908] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-27T17:29:36.120407] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:29:36.414949] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-27T17:29:37.214994] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-27T17:29:37.293059] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:29:37.355897] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T17:29:38.015020] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-27T17:29:38.822361] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-27T17:29:38.827562] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:29:39.263237] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:29:39.614952] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-27T17:29:40.414956] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-27T17:29:40.656788] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:29:41.056131] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:29:41.214958] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-27T17:29:41.795030] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T17:29:41.804560] [INFO ] [REMOTE ] BDN: Full fetch complete (69371 records). [2025-10-27T17:29:41.804761] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-27T17:29:42.023707] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-27T17:29:42.204481] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-27T17:29:42.204564] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-27T17:29:42.205336] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-27T17:29:42.205403] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-27T17:29:42.206764] [DEBUG] [LOCAL ] BDN: Trimmed 69371 records to 47524 (keeping 200 days of data) [2025-10-27T17:29:42.327825] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:29:42.408243] [INFO ] [REMOTE ] BDJ: Full fetch complete (42734 records). [2025-10-27T17:29:42.416605] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-27T17:29:42.703833] [DEBUG] [LOCAL ] BDN: Primary data saved (47524 records). [2025-10-27T17:29:42.735739] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-27T17:29:42.741241] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDN took 24.0s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-10-27T17:29:42.820945] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-27T17:29:43.127726] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:43.138725] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-27T17:29:43.138856] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-27T17:29:43.139347] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-27T17:29:43.139497] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-27T17:29:43.139126] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-27T17:29:43.139683] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-27T17:29:43.139792] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-27T17:29:43.139910] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-27T17:29:43.173183] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-27T17:29:43.216781] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-27T17:29:43.261084] [DEBUG] [LOCAL ] BDJ: Trimmed 42734 records to 28843 (keeping 200 days of data) [2025-10-27T17:29:43.708440] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:43.702696] [DEBUG] [LOCAL ] BDJ: Primary data saved (28843 records). [2025-10-27T17:29:43.708841] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-27T17:29:43.709083] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDJ took 25.0s. Estimated remaining: 4h 20m 29s. Rate: 8.2 symbols/min [2025-10-27T17:29:43.709394] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-27T17:29:43.900403] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:43.958473] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T17:29:43.985299] [DEBUG] [LOCAL ] BEKE: Loaded 53965 existing records from primary storage. [2025-10-27T17:29:43.985617] [INFO ] [MAIN ] BEKE: Loaded 53965 existing records. [2025-10-27T17:29:44.161240] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-27T17:29:44.161091] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:44.162548] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-27T17:29:44.162606] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-27T17:29:44.162855] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-27T17:29:44.162914] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-27T17:29:44.420157] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-27T17:29:44.531035] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:44.883332] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:29:44.920877] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T17:29:45.214950] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-27T17:29:46.014991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-27T17:29:46.757707] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T17:29:46.814964] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-27T17:29:47.615057] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-27T17:29:48.008770] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T17:29:48.013589] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:29:48.369164] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:29:48.414906] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-27T17:29:49.215022] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-27T17:29:50.014945] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-27T17:29:50.083607] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:29:50.304671] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T17:29:50.814965] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-27T17:29:51.306635] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-27T17:29:51.614935] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-27T17:29:52.079902] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T17:29:52.414959] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-27T17:29:52.489000] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T17:29:53.214947] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-27T17:29:53.817415] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:29:54.014969] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-27T17:29:54.814999] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-27T17:29:55.372019] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T17:29:55.382718] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-27T17:29:55.382867] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-27T17:29:55.621971] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-27T17:29:55.726625] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:29:55.833991] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-27T17:29:55.834087] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-27T17:29:55.834964] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-27T17:29:55.835030] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-27T17:29:55.836582] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-27T17:29:56.130861] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:29:56.151938] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-27T17:29:56.152076] [INFO ] [MAIN ] BE: Full history saved. [2025-10-27T17:29:56.154196] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BE took 37.5s. Estimated remaining: 4h 21m 6s. Rate: 8.1 symbols/min [2025-10-27T17:29:56.353517] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:56.354772] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T17:29:56.365098] [INFO ] [REMOTE ] BDX: Full fetch complete (75399 records). [2025-10-27T17:29:56.365237] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-27T17:29:56.420262] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-27T17:29:56.736042] [DEBUG] [LOCAL ] BEN: Loaded 53886 existing records from primary storage. [2025-10-27T17:29:56.759065] [INFO ] [MAIN ] BEN: Loaded 53886 existing records. [2025-10-27T17:29:56.904256] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:29:56.919921] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-27T17:29:56.930981] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-27T17:29:56.942205] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-27T17:29:56.947489] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-27T17:29:56.999352] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:56.999921] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-27T17:29:57.000009] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-27T17:29:57.000243] [DEBUG] [LOCAL ] BDX: Trimmed 75399 records to 52047 (keeping 200 days of data) [2025-10-27T17:29:57.000369] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-27T17:29:57.000457] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-27T17:29:57.219893] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-27T17:29:57.487958] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:57.685823] [DEBUG] [LOCAL ] BDX: Primary data saved (52047 records). [2025-10-27T17:29:57.685953] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-27T17:29:57.686030] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BDX took 39.0s. Estimated remaining: 4h 20m 8s. Rate: 8.2 symbols/min [2025-10-27T17:29:57.850050] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:29:57.885085] [DEBUG] [LOCAL ] BEP: Loaded 39485 existing records from primary storage. [2025-10-27T17:29:57.885357] [INFO ] [MAIN ] BEP: Loaded 39485 existing records. [2025-10-27T17:29:58.026087] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-27T17:29:58.067879] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:29:58.068056] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-27T17:29:58.068105] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-27T17:29:58.068311] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-27T17:29:58.068370] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-27T17:29:58.426334] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T17:29:58.426204] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:29:58.814908] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-27T17:29:58.946501] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:29:59.614945] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-27T17:30:00.052154] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:30:00.415010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-27T17:30:01.220051] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-27T17:30:01.234398] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:30:02.014986] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-27T17:30:02.404749] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T17:30:02.762728] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:30:02.814991] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-27T17:30:03.614921] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-27T17:30:03.802083] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:30:03.803317] [INFO ] [REMOTE ] BEDU: Full fetch complete (1333 records). [2025-10-27T17:30:03.803400] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-27T17:30:04.005462] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-27T17:30:04.005701] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:30:04.005764] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:30:04.005832] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-27T17:30:04.005899] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-27T17:30:04.005957] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-27T17:30:04.005999] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-27T17:30:04.006057] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 21.3s. Estimated remaining: 4h 19m 52s. Rate: 8.2 symbols/min [2025-10-27T17:30:04.180359] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:04.221820] [DEBUG] [LOCAL ] BEPC: Loaded 47001 existing records from primary storage. [2025-10-27T17:30:04.222184] [INFO ] [MAIN ] BEPC: Loaded 47001 existing records. [2025-10-27T17:30:04.407115] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:04.407362] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-27T17:30:04.407420] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-27T17:30:04.407697] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-27T17:30:04.407753] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-27T17:30:04.438532] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-27T17:30:04.762933] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:05.009471] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-10-27T17:30:05.215025] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-27T17:30:06.015012] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-27T17:30:06.848753] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-27T17:30:06.859237] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-27T17:30:06.958995] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-27T17:30:07.624720] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-27T17:30:07.632577] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T17:30:07.797568] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T17:30:08.082374] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T17:30:08.415051] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-27T17:30:09.215010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-27T17:30:09.431202] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:30:09.972597] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:30:10.015016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-27T17:30:10.437258] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T17:30:10.814926] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-27T17:30:11.614953] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-27T17:30:11.672044] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:30:12.303184] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:30:12.414959] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-27T17:30:12.931793] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:30:13.215014] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-27T17:30:14.014963] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-27T17:30:14.814952] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-27T17:30:14.877740] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-27T17:30:14.918082] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T17:30:15.476666] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T17:30:15.614942] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-27T17:30:16.181155] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T17:30:16.415009] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-27T17:30:17.215008] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-27T17:30:17.259687] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:30:18.020876] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-27T17:30:18.039147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T17:30:18.250865] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:30:18.814998] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-27T17:30:19.253611] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T17:30:19.614939] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-27T17:30:20.414957] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-27T17:30:21.114958] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-27T17:30:21.125103] [INFO ] [REMOTE ] BEKE: Full fetch complete (77327 records). [2025-10-27T17:30:21.125243] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-27T17:30:21.229303] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-27T17:30:21.432283] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:30:21.559207] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-27T17:30:21.559281] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-27T17:30:21.560062] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-27T17:30:21.560123] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-27T17:30:21.561931] [DEBUG] [LOCAL ] BEKE: Trimmed 77327 records to 53182 (keeping 200 days of data) [2025-10-27T17:30:21.876040] [DEBUG] [LOCAL ] BEKE: Primary data saved (53182 records). [2025-10-27T17:30:21.876170] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-27T17:30:21.876246] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEKE took 38.2s. Estimated remaining: 4h 21m 15s. Rate: 8.1 symbols/min [2025-10-27T17:30:22.043538] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:22.042188] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-27T17:30:22.066559] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:30:22.078577] [DEBUG] [LOCAL ] BEPH: Loaded 4959 existing records from primary storage. [2025-10-27T17:30:22.078782] [INFO ] [MAIN ] BEPH: Loaded 4959 existing records. [2025-10-27T17:30:22.256091] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:22.256313] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-27T17:30:22.256369] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-27T17:30:22.256514] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-27T17:30:22.256568] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-27T17:30:22.599400] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:22.814902] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-27T17:30:22.906858] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T17:30:23.209031] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T17:30:23.358544] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:30:23.615010] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-27T17:30:24.415019] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-27T17:30:25.082106] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:30:25.215003] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-27T17:30:25.576121] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T17:30:25.898980] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:30:26.014899] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-27T17:30:26.814952] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-27T17:30:27.394837] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T17:30:27.614953] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-27T17:30:28.324089] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T17:30:28.414980] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-27T17:30:28.633431] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:30:28.642480] [INFO ] [REMOTE ] BEP: Full fetch complete (59200 records). [2025-10-27T17:30:28.642696] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-27T17:30:29.048634] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-27T17:30:29.048737] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-27T17:30:29.049383] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-27T17:30:29.049421] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-27T17:30:29.050465] [DEBUG] [LOCAL ] BEP: Trimmed 59200 records to 38684 (keeping 200 days of data) [2025-10-27T17:30:29.218714] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-27T17:30:29.274186] [DEBUG] [LOCAL ] BEP: Primary data saved (38684 records). [2025-10-27T17:30:29.274324] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-27T17:30:29.274404] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEP took 31.6s. Estimated remaining: 4h 21m 8s. Rate: 8.1 symbols/min [2025-10-27T17:30:29.437853] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:29.444079] [DEBUG] [LOCAL ] BEPI: Loaded 3610 existing records from primary storage. [2025-10-27T17:30:29.444246] [INFO ] [MAIN ] BEPI: Loaded 3610 existing records. [2025-10-27T17:30:29.620594] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:29.620807] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-27T17:30:29.620867] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-27T17:30:29.621080] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-27T17:30:29.621205] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-27T17:30:29.970637] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:29.999321] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:30:30.014928] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-27T17:30:30.505398] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:30:30.814910] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-27T17:30:31.066907] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T17:30:31.614954] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-27T17:30:32.202282] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:30:32.211824] [INFO ] [REMOTE ] BEPC: Full fetch complete (68818 records). [2025-10-27T17:30:32.211993] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-27T17:30:32.421166] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-27T17:30:32.596931] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-27T17:30:32.597019] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-27T17:30:32.597759] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-27T17:30:32.597822] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-27T17:30:32.599303] [DEBUG] [LOCAL ] BEPC: Trimmed 68818 records to 46201 (keeping 200 days of data) [2025-10-27T17:30:32.886247] [DEBUG] [LOCAL ] BEPC: Primary data saved (46201 records). [2025-10-27T17:30:32.891135] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-27T17:30:32.891718] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEPC took 28.9s. Estimated remaining: 4h 20m 28s. Rate: 8.1 symbols/min [2025-10-27T17:30:32.891925] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:30:33.064436] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:33.069732] [DEBUG] [LOCAL ] BEPJ: Loaded 3102 existing records from primary storage. [2025-10-27T17:30:33.069902] [INFO ] [MAIN ] BEPJ: Loaded 3102 existing records. [2025-10-27T17:30:33.220358] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-27T17:30:33.256759] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:33.257311] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-27T17:30:33.257391] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-27T17:30:33.257718] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-27T17:30:33.257803] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-27T17:30:33.608430] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T17:30:33.658106] [INFO ] [REMOTE ] BEN: Full fetch complete (77059 records). [2025-10-27T17:30:33.660096] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-27T17:30:33.679000] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:34.023237] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-27T17:30:34.073284] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-27T17:30:34.073439] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-27T17:30:34.074240] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-27T17:30:34.074303] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-27T17:30:34.075786] [DEBUG] [LOCAL ] BEN: Trimmed 77059 records to 53102 (keeping 200 days of data) [2025-10-27T17:30:34.188027] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:30:34.409239] [DEBUG] [LOCAL ] BEN: Primary data saved (53102 records). [2025-10-27T17:30:34.409362] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-27T17:30:34.409855] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEN took 38.3s. Estimated remaining: 4h 19m 31s. Rate: 8.2 symbols/min [2025-10-27T17:30:34.584372] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:34.581273] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:30:34.621098] [DEBUG] [LOCAL ] BFAM: Loaded 34346 existing records from primary storage. [2025-10-27T17:30:34.621378] [INFO ] [MAIN ] BFAM: Loaded 34346 existing records. [2025-10-27T17:30:34.792968] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:34.793156] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-27T17:30:34.793244] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-27T17:30:34.793456] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-27T17:30:34.793504] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-27T17:30:34.822600] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-27T17:30:35.156175] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:35.176292] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T17:30:35.614936] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-27T17:30:36.414941] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-27T17:30:36.528301] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T17:30:37.074493] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T17:30:37.214943] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-27T17:30:37.601903] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-27T17:30:38.014983] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-27T17:30:38.581066] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T17:30:38.814915] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-27T17:30:39.349142] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T17:30:39.614987] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-27T17:30:40.414944] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-27T17:30:40.837254] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T17:30:40.941183] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T17:30:41.214947] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-27T17:30:41.873710] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:30:42.014990] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-27T17:30:42.765922] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:30:42.814937] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-27T17:30:43.275530] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T17:30:43.614962] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-27T17:30:44.164896] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T17:30:44.414980] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-27T17:30:45.214947] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-27T17:30:45.620186] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:30:45.800625] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:30:46.014923] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-27T17:30:46.323660] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T17:30:46.814937] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-27T17:30:47.490414] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:30:47.614937] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-27T17:30:48.414951] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-27T17:30:48.744859] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-27T17:30:48.863292] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:30:49.214940] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-27T17:30:49.596699] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T17:30:50.014958] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-27T17:30:50.465971] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:30:50.815022] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-27T17:30:51.435412] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T17:30:51.614986] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-27T17:30:52.414948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-27T17:30:53.037986] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:30:53.066926] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T17:30:53.068531] [INFO ] [REMOTE ] BEPI: Full fetch complete (4696 records). [2025-10-27T17:30:53.068607] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-27T17:30:53.220175] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-27T17:30:53.440153] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-27T17:30:53.440239] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-27T17:30:53.440394] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-27T17:30:53.440436] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-27T17:30:53.440944] [DEBUG] [LOCAL ] BEPI: Trimmed 4696 records to 3495 (keeping 200 days of data) [2025-10-27T17:30:53.462189] [DEBUG] [LOCAL ] BEPI: Primary data saved (3495 records). [2025-10-27T17:30:53.462330] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-27T17:30:53.462410] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPI took 24.2s. Estimated remaining: 4h 21m 3s. Rate: 8.1 symbols/min [2025-10-27T17:30:53.637363] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:53.675591] [DEBUG] [LOCAL ] BFH: Loaded 42050 existing records from primary storage. [2025-10-27T17:30:53.675944] [INFO ] [MAIN ] BFH: Loaded 42050 existing records. [2025-10-27T17:30:53.861107] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:53.861322] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-27T17:30:53.861370] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-27T17:30:53.861555] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-27T17:30:53.861594] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-27T17:30:54.020199] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-27T17:30:54.245785] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:54.523198] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:30:54.663583] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:30:54.814931] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-27T17:30:55.614964] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-27T17:30:56.115957] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T17:30:56.246092] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:30:56.414938] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-27T17:30:56.907418] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T17:30:56.908407] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4400 records). [2025-10-27T17:30:56.908476] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-27T17:30:57.220398] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-27T17:30:57.305740] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-27T17:30:57.305829] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-27T17:30:57.306008] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-27T17:30:57.306047] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-27T17:30:57.306521] [DEBUG] [LOCAL ] BEPJ: Trimmed 4400 records to 3063 (keeping 200 days of data) [2025-10-27T17:30:57.328638] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3063 records). [2025-10-27T17:30:57.328791] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-27T17:30:57.328875] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPJ took 24.4s. Estimated remaining: 4h 20m 25s. Rate: 8.1 symbols/min [2025-10-27T17:30:57.509412] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:30:57.522977] [DEBUG] [LOCAL ] BFK: Loaded 14046 existing records from primary storage. [2025-10-27T17:30:57.523208] [INFO ] [MAIN ] BFK: Loaded 14046 existing records. [2025-10-27T17:30:57.708224] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:30:57.708455] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-27T17:30:57.708500] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-27T17:30:57.708705] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-27T17:30:57.708761] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-27T17:30:57.982849] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:30:58.020085] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-27T17:30:58.081555] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:30:58.814942] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-27T17:30:59.240263] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:30:59.614938] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-27T17:31:00.118112] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T17:31:00.204044] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:31:00.205523] [INFO ] [REMOTE ] BEPH: Full fetch complete (7520 records). [2025-10-27T17:31:00.205591] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-27T17:31:00.420061] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-27T17:31:00.571766] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-27T17:31:00.571844] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-27T17:31:00.572053] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-27T17:31:00.572092] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-27T17:31:00.572473] [DEBUG] [LOCAL ] BEPH: Trimmed 7520 records to 4804 (keeping 200 days of data) [2025-10-27T17:31:00.600827] [DEBUG] [LOCAL ] BEPH: Primary data saved (4804 records). [2025-10-27T17:31:00.600914] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-27T17:31:00.600986] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPH took 38.7s. Estimated remaining: 4h 19m 43s. Rate: 8.1 symbols/min [2025-10-27T17:31:00.774174] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:00.822279] [DEBUG] [LOCAL ] BFLY: Loaded 52623 existing records from primary storage. [2025-10-27T17:31:00.822583] [INFO ] [MAIN ] BFLY: Loaded 52623 existing records. [2025-10-27T17:31:00.997872] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:00.998564] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-27T17:31:00.998617] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-27T17:31:00.998926] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-27T17:31:00.998982] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-27T17:31:01.221452] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-27T17:31:01.374045] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:02.015021] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-27T17:31:02.815006] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-27T17:31:04.051691] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (3.63 seconds). [2025-10-27T17:31:04.060110] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-27T17:31:04.389445] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-10-27T17:31:04.414932] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-27T17:31:04.789159] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:31:05.214987] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-27T17:31:05.291228] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (3.28 seconds). [2025-10-27T17:31:05.564973] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:31:06.015013] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-27T17:31:06.698081] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T17:31:06.782609] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T17:31:06.790131] [INFO ] [REMOTE ] BFAM: Full fetch complete (47535 records). [2025-10-27T17:31:06.790311] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-27T17:31:06.824737] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-27T17:31:07.172737] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-27T17:31:07.172828] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-27T17:31:07.173428] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-27T17:31:07.173472] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-27T17:31:07.174790] [DEBUG] [LOCAL ] BFAM: Trimmed 47535 records to 33693 (keeping 200 days of data) [2025-10-27T17:31:07.373521] [DEBUG] [LOCAL ] BFAM: Primary data saved (33693 records). [2025-10-27T17:31:07.373671] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-27T17:31:07.373785] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 33.0s. Estimated remaining: 4h 19m 31s. Rate: 8.1 symbols/min [2025-10-27T17:31:07.549405] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:07.577408] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T17:31:07.595041] [DEBUG] [LOCAL ] BFS: Loaded 9682 existing records from primary storage. [2025-10-27T17:31:07.595250] [INFO ] [MAIN ] BFS: Loaded 9682 existing records. [2025-10-27T17:31:07.625712] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-27T17:31:07.784279] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:07.784585] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-27T17:31:07.784761] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-27T17:31:07.784912] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-27T17:31:07.784950] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-27T17:31:07.901703] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T17:31:08.178011] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:08.414946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-27T17:31:09.101300] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:31:09.214972] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-27T17:31:09.260167] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:31:09.959754] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T17:31:10.014959] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-27T17:31:10.814955] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-27T17:31:11.366791] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:31:11.614952] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-27T17:31:12.416821] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-27T17:31:12.420724] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:31:12.449446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:31:13.214959] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-27T17:31:13.222445] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T17:31:13.875732] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:31:14.014933] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-27T17:31:14.814961] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-27T17:31:15.458221] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:31:15.614950] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-27T17:31:15.980582] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:31:16.414981] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-27T17:31:16.588787] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T17:31:16.855499] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T17:31:17.214908] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-27T17:31:18.014929] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-27T17:31:18.095475] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T17:31:18.814943] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-27T17:31:19.467967] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:31:19.546010] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:31:19.614944] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-27T17:31:20.282620] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:31:20.414980] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-27T17:31:21.214954] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-27T17:31:21.875138] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:31:22.014974] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-27T17:31:22.138778] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T17:31:22.522622] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:31:22.814954] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-27T17:31:23.614958] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-27T17:31:24.414962] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-27T17:31:24.472744] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:31:24.475896] [INFO ] [REMOTE ] BFK: Full fetch complete (19232 records). [2025-10-27T17:31:24.475983] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-27T17:31:24.476447] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:31:24.476531] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:31:24.476593] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:31:24.476688] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-27T17:31:24.476759] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-27T17:31:24.476795] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-27T17:31:24.476925] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-27T17:31:24.476996] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFK took 27.1s. Estimated remaining: 4h 20m 45s. Rate: 8.1 symbols/min [2025-10-27T17:31:24.646160] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:24.668504] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T17:31:24.688469] [DEBUG] [LOCAL ] BFZ: Loaded 12259 existing records from primary storage. [2025-10-27T17:31:24.688731] [INFO ] [MAIN ] BFZ: Loaded 12259 existing records. [2025-10-27T17:31:24.861980] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:24.862149] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-27T17:31:24.862195] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-27T17:31:24.862340] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-27T17:31:24.862379] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-27T17:31:25.211785] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:25.214897] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-27T17:31:25.735953] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T17:31:25.855040] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:31:26.014960] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-27T17:31:26.814905] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-27T17:31:26.962838] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:31:27.614952] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-27T17:31:28.414921] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-27T17:31:28.655547] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:31:29.057533] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:31:29.214987] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-27T17:31:29.363201] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T17:31:30.014941] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-27T17:31:30.517213] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:31:30.814966] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-27T17:31:30.871383] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T17:31:30.879548] [INFO ] [REMOTE ] BFH: Full fetch complete (60258 records). [2025-10-27T17:31:30.879698] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-27T17:31:31.249947] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-27T17:31:31.250020] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-27T17:31:31.250629] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-27T17:31:31.250707] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-27T17:31:31.251829] [DEBUG] [LOCAL ] BFH: Trimmed 60258 records to 41171 (keeping 200 days of data) [2025-10-27T17:31:31.491861] [DEBUG] [LOCAL ] BFH: Primary data saved (41171 records). [2025-10-27T17:31:31.491985] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-27T17:31:31.492057] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFH took 38.0s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-27T17:31:31.611350] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:31:31.616691] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-27T17:31:31.681265] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:31.730789] [DEBUG] [LOCAL ] BG: Loaded 51175 existing records from primary storage. [2025-10-27T17:31:31.731224] [INFO ] [MAIN ] BG: Loaded 51175 existing records. [2025-10-27T17:31:31.908268] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:31.908487] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-27T17:31:31.908535] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-27T17:31:31.908852] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-27T17:31:31.908909] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-27T17:31:32.260061] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:32.414951] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-27T17:31:32.899117] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T17:31:33.214988] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-27T17:31:33.791821] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T17:31:33.850135] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:31:34.014990] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-27T17:31:34.814945] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-27T17:31:35.602326] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:31:35.614895] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-27T17:31:35.669797] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T17:31:36.414946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-27T17:31:37.081941] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:31:37.101889] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:31:37.214940] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-27T17:31:38.015023] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-27T17:31:38.815040] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-27T17:31:38.865376] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T17:31:39.574035] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:31:39.614912] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-27T17:31:39.753360] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:31:39.755838] [INFO ] [REMOTE ] BFS: Full fetch complete (13122 records). [2025-10-27T17:31:39.755906] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-27T17:31:40.115792] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-27T17:31:40.115869] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-27T17:31:40.116153] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-27T17:31:40.116218] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-27T17:31:40.116794] [DEBUG] [LOCAL ] BFS: Trimmed 13122 records to 9503 (keeping 200 days of data) [2025-10-27T17:31:40.180117] [DEBUG] [LOCAL ] BFS: Primary data saved (9503 records). [2025-10-27T17:31:40.180338] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-27T17:31:40.180494] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFS took 32.8s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-10-27T17:31:40.348383] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:40.365222] [DEBUG] [LOCAL ] BGB: Loaded 17817 existing records from primary storage. [2025-10-27T17:31:40.365441] [INFO ] [MAIN ] BGB: Loaded 17817 existing records. [2025-10-27T17:31:40.426599] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-27T17:31:40.545477] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:40.545741] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-27T17:31:40.545798] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-27T17:31:40.546032] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-27T17:31:40.546070] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-27T17:31:40.894970] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:41.214954] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-27T17:31:41.574605] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T17:31:41.584620] [INFO ] [REMOTE ] BFLY: Full fetch complete (75494 records). [2025-10-27T17:31:41.584792] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-27T17:31:42.010930] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-27T17:31:42.011219] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-27T17:31:42.012204] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-27T17:31:42.012284] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-27T17:31:42.014078] [DEBUG] [LOCAL ] BFLY: Trimmed 75494 records to 51867 (keeping 200 days of data) [2025-10-27T17:31:42.014938] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-27T17:31:42.256710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:31:42.292816] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T17:31:42.382993] [DEBUG] [LOCAL ] BFLY: Primary data saved (51867 records). [2025-10-27T17:31:42.383159] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-27T17:31:42.383260] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFLY took 41.8s. Estimated remaining: 4h 19m 47s. Rate: 8.1 symbols/min [2025-10-27T17:31:42.568029] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:42.586264] [DEBUG] [LOCAL ] BGH: Loaded 17283 existing records from primary storage. [2025-10-27T17:31:42.586534] [INFO ] [MAIN ] BGH: Loaded 17283 existing records. [2025-10-27T17:31:42.790860] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:42.802332] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-27T17:31:42.803425] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T17:31:42.803768] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-27T17:31:42.808019] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-27T17:31:42.808116] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-27T17:31:42.820101] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-27T17:31:43.205843] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:43.615013] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-27T17:31:44.205100] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:31:44.325203] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T17:31:44.414974] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-27T17:31:45.214970] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-27T17:31:46.015013] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-27T17:31:46.278432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T17:31:46.359625] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:31:46.628567] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T17:31:46.814997] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-27T17:31:47.310277] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:31:47.614989] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-27T17:31:48.110549] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:31:48.414951] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-27T17:31:49.215003] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-27T17:31:49.849233] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T17:31:50.014925] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-27T17:31:50.204095] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:31:50.815011] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-27T17:31:51.049477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T17:31:51.614995] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-27T17:31:52.414928] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-27T17:31:52.571426] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:31:52.574062] [INFO ] [REMOTE ] BFZ: Full fetch complete (17706 records). [2025-10-27T17:31:52.574130] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-27T17:31:52.956603] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T17:31:53.002626] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-27T17:31:53.002743] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-27T17:31:53.003132] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-27T17:31:53.003175] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-27T17:31:53.003784] [DEBUG] [LOCAL ] BFZ: Trimmed 17706 records to 11944 (keeping 200 days of data) [2025-10-27T17:31:53.073097] [DEBUG] [LOCAL ] BFZ: Primary data saved (11944 records). [2025-10-27T17:31:53.073231] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-27T17:31:53.073307] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 28.6s. Estimated remaining: 4h 20m 7s. Rate: 8.1 symbols/min [2025-10-27T17:31:53.220838] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-27T17:31:53.241244] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:53.255290] [DEBUG] [LOCAL ] BGR: Loaded 13583 existing records from primary storage. [2025-10-27T17:31:53.256177] [INFO ] [MAIN ] BGR: Loaded 13583 existing records. [2025-10-27T17:31:53.432521] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:53.432762] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-27T17:31:53.432814] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-27T17:31:53.432985] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-27T17:31:53.433021] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-27T17:31:53.795266] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:53.817762] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:31:54.014987] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-27T17:31:54.788732] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T17:31:54.814924] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-27T17:31:54.932292] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:31:54.941497] [INFO ] [REMOTE ] BG: Full fetch complete (72699 records). [2025-10-27T17:31:54.941634] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-27T17:31:54.942409] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:31:54.942497] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:31:54.942542] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:31:54.942580] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-27T17:31:54.942635] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-27T17:31:54.942724] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-10-27T17:31:54.942926] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-10-27T17:31:54.943020] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BG took 23.5s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-27T17:31:55.119296] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:31:55.163194] [DEBUG] [LOCAL ] BGS: Loaded 51254 existing records from primary storage. [2025-10-27T17:31:55.163548] [INFO ] [MAIN ] BGS: Loaded 51254 existing records. [2025-10-27T17:31:55.338110] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:31:55.338347] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-27T17:31:55.338417] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-27T17:31:55.338846] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-27T17:31:55.338906] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-27T17:31:55.618205] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-27T17:31:55.699972] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:31:55.777425] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T17:31:56.221194] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T17:31:56.414969] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-27T17:31:57.183207] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T17:31:57.214912] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-27T17:31:57.899198] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:31:58.014908] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-27T17:31:58.815053] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-27T17:31:58.865043] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:31:59.614965] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-27T17:31:59.851001] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:32:00.414960] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-27T17:32:00.648325] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:32:01.214939] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-27T17:32:02.014972] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-27T17:32:02.814966] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-27T17:32:03.396908] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-10-27T17:32:03.614962] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-27T17:32:04.249726] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-10-27T17:32:04.311482] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:32:04.414965] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-27T17:32:04.558179] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:32:04.588325] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T17:32:05.214930] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-27T17:32:05.661073] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:32:06.014958] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-27T17:32:06.437419] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T17:32:06.708665] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:32:06.814909] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-27T17:32:07.614913] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-27T17:32:07.901904] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:32:07.905530] [INFO ] [REMOTE ] BGH: Full fetch complete (22912 records). [2025-10-27T17:32:07.905608] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-27T17:32:07.906114] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:32:07.906196] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:32:07.906258] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:32:07.906347] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-27T17:32:07.906414] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-27T17:32:07.906450] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-27T17:32:07.906713] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-27T17:32:07.906808] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGH took 25.5s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-27T17:32:08.074839] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:08.084995] [DEBUG] [LOCAL ] BGSF: Loaded 8349 existing records from primary storage. [2025-10-27T17:32:08.085211] [INFO ] [MAIN ] BGSF: Loaded 8349 existing records. [2025-10-27T17:32:08.270630] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:08.271004] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-27T17:32:08.271092] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-27T17:32:08.279575] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-27T17:32:08.280325] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:32:08.280025] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-27T17:32:08.421202] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-27T17:32:08.644100] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:09.214975] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-27T17:32:09.352593] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T17:32:10.015040] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-27T17:32:10.666723] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T17:32:10.814980] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-27T17:32:10.941441] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:32:11.094477] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T17:32:11.614950] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-27T17:32:12.337697] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:32:12.414942] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-27T17:32:13.214933] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-27T17:32:13.365067] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T17:32:13.975587] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:32:14.014923] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-27T17:32:14.814924] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-27T17:32:14.969407] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T17:32:15.614950] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-27T17:32:15.896743] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:32:15.900454] [INFO ] [REMOTE ] BGB: Full fetch complete (26510 records). [2025-10-27T17:32:15.900542] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-27T17:32:16.276998] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-27T17:32:16.277093] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-27T17:32:16.277511] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-27T17:32:16.277574] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-27T17:32:16.278481] [DEBUG] [LOCAL ] BGB: Trimmed 26510 records to 17226 (keeping 200 days of data) [2025-10-27T17:32:16.382820] [DEBUG] [LOCAL ] BGB: Primary data saved (17226 records). [2025-10-27T17:32:16.382954] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-27T17:32:16.383034] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGB took 36.2s. Estimated remaining: 4h 19m 53s. Rate: 8.1 symbols/min [2025-10-27T17:32:16.420108] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-27T17:32:16.561123] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:16.578383] [DEBUG] [LOCAL ] BGT: Loaded 16371 existing records from primary storage. [2025-10-27T17:32:16.578622] [INFO ] [MAIN ] BGT: Loaded 16371 existing records. [2025-10-27T17:32:16.750924] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:16.751182] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-27T17:32:16.751237] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-27T17:32:16.751411] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-27T17:32:16.751467] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-27T17:32:17.109889] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:17.119884] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:32:17.153861] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T17:32:17.214918] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-27T17:32:18.014967] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-27T17:32:18.472581] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:32:18.689330] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T17:32:18.814931] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-27T17:32:19.615470] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-27T17:32:19.615398] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:32:19.962873] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T17:32:20.414954] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-27T17:32:21.214920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-27T17:32:21.293688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T17:32:21.850359] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T17:32:22.014910] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-27T17:32:22.814963] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-27T17:32:22.897188] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:32:23.473295] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T17:32:23.614921] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-27T17:32:24.414938] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-27T17:32:24.665010] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T17:32:25.214945] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-27T17:32:25.646029] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:32:26.020009] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-27T17:32:26.021789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T17:32:26.814949] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-27T17:32:27.056763] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:32:27.059707] [INFO ] [REMOTE ] BGR: Full fetch complete (19852 records). [2025-10-27T17:32:27.059783] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-27T17:32:27.420691] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-27T17:32:27.420775] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-27T17:32:27.421143] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-27T17:32:27.421180] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-27T17:32:27.421750] [DEBUG] [LOCAL ] BGR: Trimmed 19852 records to 13127 (keeping 200 days of data) [2025-10-27T17:32:27.481753] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:32:27.505298] [DEBUG] [LOCAL ] BGR: Primary data saved (13127 records). [2025-10-27T17:32:27.505433] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-27T17:32:27.505508] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGR took 34.4s. Estimated remaining: 4h 20m 16s. Rate: 8.1 symbols/min [2025-10-27T17:32:27.620027] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-27T17:32:27.674781] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:27.692186] [DEBUG] [LOCAL ] BGX: Loaded 11319 existing records from primary storage. [2025-10-27T17:32:27.692445] [INFO ] [MAIN ] BGX: Loaded 11319 existing records. [2025-10-27T17:32:27.868767] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:27.868984] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-27T17:32:27.869045] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-27T17:32:27.869190] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-27T17:32:27.869228] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-27T17:32:28.231090] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:28.390419] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:32:28.414907] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-27T17:32:29.082672] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T17:32:29.214952] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-27T17:32:30.014920] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-27T17:32:30.363753] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:32:30.814939] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-27T17:32:31.505969] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:32:31.614939] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-27T17:32:31.926526] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:32:32.415001] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-27T17:32:33.172734] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:32:33.214900] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-27T17:32:33.298377] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T17:32:34.014947] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-27T17:32:34.814937] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-27T17:32:34.945692] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:32:34.993895] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:32:35.614958] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-27T17:32:35.748198] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:32:35.751037] [INFO ] [REMOTE ] BGSF: Full fetch complete (9772 records). [2025-10-27T17:32:35.751123] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-27T17:32:36.101988] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-27T17:32:36.102062] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-27T17:32:36.102293] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-27T17:32:36.102332] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-27T17:32:36.102777] [DEBUG] [LOCAL ] BGSF: Trimmed 9772 records to 8297 (keeping 200 days of data) [2025-10-27T17:32:36.152040] [DEBUG] [LOCAL ] BGSF: Primary data saved (8297 records). [2025-10-27T17:32:36.152150] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-27T17:32:36.152222] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGSF took 28.2s. Estimated remaining: 4h 20m 18s. Rate: 8.1 symbols/min [2025-10-27T17:32:36.326159] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:36.335693] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:32:36.358058] [DEBUG] [LOCAL ] BGY: Loaded 21577 existing records from primary storage. [2025-10-27T17:32:36.358319] [INFO ] [MAIN ] BGY: Loaded 21577 existing records. [2025-10-27T17:32:36.420148] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-27T17:32:36.538022] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:36.538210] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-27T17:32:36.538257] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-27T17:32:36.538413] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-27T17:32:36.538451] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-27T17:32:36.888235] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:37.214923] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-27T17:32:38.020015] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-27T17:32:38.037049] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:32:38.046974] [INFO ] [REMOTE ] BGS: Full fetch complete (72671 records). [2025-10-27T17:32:38.047113] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-27T17:32:38.408992] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:32:38.469727] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-27T17:32:38.469815] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-27T17:32:38.470554] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-27T17:32:38.470605] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-27T17:32:38.472011] [DEBUG] [LOCAL ] BGS: Trimmed 72671 records to 50455 (keeping 200 days of data) [2025-10-27T17:32:38.593749] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T17:32:38.771054] [DEBUG] [LOCAL ] BGS: Primary data saved (50455 records). [2025-10-27T17:32:38.771190] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-27T17:32:38.771269] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGS took 43.8s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-10-27T17:32:38.822800] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-27T17:32:38.941061] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:38.956426] [DEBUG] [LOCAL ] BH: Loaded 16651 existing records from primary storage. [2025-10-27T17:32:38.956638] [INFO ] [MAIN ] BH: Loaded 16651 existing records. [2025-10-27T17:32:39.128712] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:39.128904] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-27T17:32:39.128949] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-27T17:32:39.129105] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-27T17:32:39.129142] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-27T17:32:39.490678] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:39.614923] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-27T17:32:39.880988] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:32:40.177631] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:32:40.414990] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-27T17:32:41.214992] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-27T17:32:41.271858] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:32:41.275050] [INFO ] [REMOTE ] BGT: Full fetch complete (24122 records). [2025-10-27T17:32:41.275127] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-27T17:32:41.637886] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-27T17:32:41.637967] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-27T17:32:41.638346] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-27T17:32:41.638386] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-27T17:32:41.639018] [DEBUG] [LOCAL ] BGT: Trimmed 24122 records to 15819 (keeping 200 days of data) [2025-10-27T17:32:41.741911] [DEBUG] [LOCAL ] BGT: Primary data saved (15819 records). [2025-10-27T17:32:41.742032] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-27T17:32:41.742113] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGT took 25.4s. Estimated remaining: 4h 18m 50s. Rate: 8.1 symbols/min [2025-10-27T17:32:41.911186] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:41.952497] [DEBUG] [LOCAL ] BHC: Loaded 47252 existing records from primary storage. [2025-10-27T17:32:41.952895] [INFO ] [MAIN ] BHC: Loaded 47252 existing records. [2025-10-27T17:32:42.018588] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-27T17:32:42.134811] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:42.135013] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-27T17:32:42.135074] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-27T17:32:42.135420] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-27T17:32:42.135479] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-27T17:32:42.460917] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:32:42.521630] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:42.814982] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-27T17:32:42.993258] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:32:43.194605] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T17:32:43.614939] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-27T17:32:44.340933] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:32:44.414905] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-27T17:32:45.165357] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T17:32:45.214903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-27T17:32:45.861186] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:32:46.014952] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-27T17:32:46.814915] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-27T17:32:46.956635] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T17:32:47.617203] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-27T17:32:47.621811] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:32:48.414996] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-27T17:32:48.860533] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:32:49.214935] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-27T17:32:49.981768] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:32:50.016672] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-27T17:32:50.021321] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:32:50.814919] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-27T17:32:50.947826] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T17:32:51.349531] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T17:32:51.614974] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-27T17:32:52.265456] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T17:32:52.414988] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-27T17:32:53.192958] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:32:53.214922] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-27T17:32:54.010318] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T17:32:54.014892] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-27T17:32:54.814994] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-27T17:32:55.152123] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T17:32:55.155756] [INFO ] [REMOTE ] BGX: Full fetch complete (16442 records). [2025-10-27T17:32:55.155853] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-27T17:32:55.548169] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-27T17:32:55.548249] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-27T17:32:55.548564] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-27T17:32:55.548603] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-27T17:32:55.549152] [DEBUG] [LOCAL ] BGX: Trimmed 16442 records to 10924 (keeping 200 days of data) [2025-10-27T17:32:55.613877] [DEBUG] [LOCAL ] BGX: Primary data saved (10924 records). [2025-10-27T17:32:55.614008] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-27T17:32:55.614084] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 28.1s. Estimated remaining: 4h 19m 34s. Rate: 8.1 symbols/min [2025-10-27T17:32:55.625090] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-27T17:32:55.791617] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:32:55.813837] [DEBUG] [LOCAL ] BHE: Loaded 23916 existing records from primary storage. [2025-10-27T17:32:55.814132] [INFO ] [MAIN ] BHE: Loaded 23916 existing records. [2025-10-27T17:32:55.995537] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:32:55.995778] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-27T17:32:55.995847] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-27T17:32:55.996112] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-27T17:32:55.996175] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-27T17:32:56.172622] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:32:56.394287] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:32:56.410369] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:32:56.415032] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-27T17:32:57.214973] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-27T17:32:57.717552] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:32:58.014952] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-27T17:32:58.214407] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:32:58.777483] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:32:58.814903] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-27T17:32:59.614940] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-27T17:32:59.900062] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:32:59.904409] [INFO ] [REMOTE ] BGY: Full fetch complete (32855 records). [2025-10-27T17:32:59.904488] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-27T17:33:00.280918] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-27T17:33:00.280995] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-27T17:33:00.281414] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-27T17:33:00.281453] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-27T17:33:00.282165] [DEBUG] [LOCAL ] BGY: Trimmed 32855 records to 21175 (keeping 200 days of data) [2025-10-27T17:33:00.400118] [DEBUG] [LOCAL ] BGY: Primary data saved (21175 records). [2025-10-27T17:33:00.400239] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-27T17:33:00.400311] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BGY took 24.2s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-10-27T17:33:00.420829] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-27T17:33:00.583626] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:00.604452] [DEBUG] [LOCAL ] BHK: Loaded 24267 existing records from primary storage. [2025-10-27T17:33:00.604743] [INFO ] [MAIN ] BHK: Loaded 24267 existing records. [2025-10-27T17:33:00.783824] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:00.784028] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-27T17:33:00.784075] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-27T17:33:00.784273] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-27T17:33:00.784310] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-27T17:33:01.145229] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:01.214944] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-27T17:33:01.948069] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-27T17:33:02.015004] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-27T17:33:02.814999] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-27T17:33:03.696088] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (3.28 seconds). [2025-10-27T17:33:03.699934] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-27T17:33:04.699714] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T17:33:04.704274] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-27T17:33:04.825818] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-27T17:33:04.941782] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (3.73 seconds). [2025-10-27T17:33:05.213357] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T17:33:05.222816] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-27T17:33:06.014997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-27T17:33:06.571359] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T17:33:06.750807] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T17:33:06.814929] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-27T17:33:07.233491] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T17:33:07.417747] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T17:33:07.614960] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-27T17:33:08.414912] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-27T17:33:08.676841] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:33:09.214997] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-27T17:33:09.906320] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T17:33:10.014914] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-27T17:33:10.058016] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T17:33:10.814941] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-27T17:33:11.048739] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:33:11.051794] [INFO ] [REMOTE ] BH: Full fetch complete (19480 records). [2025-10-27T17:33:11.051873] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-27T17:33:11.052309] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:33:11.052390] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:11.052459] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:11.052533] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-27T17:33:11.052597] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-27T17:33:11.052634] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-27T17:33:11.052863] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-10-27T17:33:11.052950] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BH took 32.3s. Estimated remaining: 4h 19m 23s. Rate: 8.1 symbols/min [2025-10-27T17:33:11.220139] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:11.267498] [DEBUG] [LOCAL ] BHP: Loaded 54141 existing records from primary storage. [2025-10-27T17:33:11.267828] [INFO ] [MAIN ] BHP: Loaded 54141 existing records. [2025-10-27T17:33:11.440260] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:11.440471] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-27T17:33:11.440516] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-27T17:33:11.440746] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-27T17:33:11.440804] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-27T17:33:11.633430] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-27T17:33:11.615310] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T17:33:11.819730] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:12.415011] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-27T17:33:12.712839] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:33:13.142192] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T17:33:13.214927] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-27T17:33:14.021184] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-27T17:33:14.024766] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T17:33:14.814917] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-27T17:33:14.929743] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:33:15.614970] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-27T17:33:16.373935] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:33:16.414959] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-27T17:33:17.214913] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-27T17:33:17.344696] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:33:17.522744] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:33:18.014919] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-27T17:33:18.424029] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:33:18.814958] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-27T17:33:19.240311] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T17:33:19.614943] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-27T17:33:20.271609] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:33:20.414917] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-27T17:33:21.142349] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T17:33:21.214931] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-27T17:33:22.014917] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-27T17:33:22.189459] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T17:33:22.436630] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:33:22.445500] [INFO ] [REMOTE ] BHC: Full fetch complete (67621 records). [2025-10-27T17:33:22.445624] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-27T17:33:22.822090] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-27T17:33:22.838891] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-27T17:33:22.839099] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-27T17:33:22.840403] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-27T17:33:22.840470] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-27T17:33:22.841842] [DEBUG] [LOCAL ] BHC: Trimmed 67621 records to 46452 (keeping 200 days of data) [2025-10-27T17:33:23.095539] [DEBUG] [LOCAL ] BHC: Primary data saved (46452 records). [2025-10-27T17:33:23.095639] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-27T17:33:23.096534] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BHC took 41.4s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-27T17:33:23.276396] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:23.285109] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T17:33:23.311783] [DEBUG] [LOCAL ] BHR: Loaded 22412 existing records from primary storage. [2025-10-27T17:33:23.312055] [INFO ] [MAIN ] BHR: Loaded 22412 existing records. [2025-10-27T17:33:23.488491] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:23.488787] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-27T17:33:23.488839] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-27T17:33:23.489029] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-27T17:33:23.489066] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-27T17:33:23.625517] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-27T17:33:23.844833] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:23.863884] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:33:24.414950] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-27T17:33:25.214939] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-27T17:33:25.671397] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-27T17:33:25.698112] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T17:33:26.014969] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-27T17:33:26.476106] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:33:26.814960] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-27T17:33:27.614967] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-27T17:33:28.008003] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T17:33:28.160503] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:33:28.275457] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T17:33:28.414944] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-27T17:33:29.214940] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-27T17:33:29.374026] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T17:33:29.380205] [INFO ] [REMOTE ] BHE: Full fetch complete (36202 records). [2025-10-27T17:33:29.380334] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-27T17:33:29.381040] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:33:29.381141] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:29.381195] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:29.381271] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-27T17:33:29.381350] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-27T17:33:29.381405] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-10-27T17:33:29.381600] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-10-27T17:33:29.381750] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHE took 33.8s. Estimated remaining: 4h 19m 36s. Rate: 8.1 symbols/min [2025-10-27T17:33:29.556806] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:29.556955] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-27T17:33:29.556991] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-27T17:33:29.557100] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-27T17:33:29.557141] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-27T17:33:29.557183] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-27T17:33:29.557216] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-27T17:33:29.913832] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:29.998696] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:33:30.003398] [INFO ] [REMOTE ] BHK: Full fetch complete (30776 records). [2025-10-27T17:33:30.003524] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-27T17:33:30.025023] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-27T17:33:30.378560] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-27T17:33:30.378627] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-27T17:33:30.379058] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-27T17:33:30.379108] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-27T17:33:30.379823] [DEBUG] [LOCAL ] BHK: Trimmed 30776 records to 23928 (keeping 200 days of data) [2025-10-27T17:33:30.517337] [DEBUG] [LOCAL ] BHK: Primary data saved (23928 records). [2025-10-27T17:33:30.517458] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-27T17:33:30.517537] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHK took 30.1s. Estimated remaining: 4h 18m 40s. Rate: 8.1 symbols/min [2025-10-27T17:33:30.589956] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:33:30.689586] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:30.735073] [DEBUG] [LOCAL ] BHVN: Loaded 51373 existing records from primary storage. [2025-10-27T17:33:30.735390] [INFO ] [MAIN ] BHVN: Loaded 51373 existing records. [2025-10-27T17:33:30.820189] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-27T17:33:30.912076] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:30.912276] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-27T17:33:30.912331] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-27T17:33:30.912631] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-27T17:33:30.912722] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-27T17:33:31.268134] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:31.614967] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-27T17:33:31.741199] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T17:33:32.414935] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-27T17:33:32.700289] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:33:32.780706] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T17:33:33.214942] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-27T17:33:34.015001] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-27T17:33:34.700348] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:33:34.814899] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-27T17:33:35.614922] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-27T17:33:35.707469] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:33:35.826087] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:33:36.422306] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-27T17:33:36.424116] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T17:33:37.214986] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-27T17:33:38.014914] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-27T17:33:38.063973] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:33:38.366548] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:33:38.815076] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-27T17:33:39.614937] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-27T17:33:40.104006] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T17:33:40.211223] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:33:40.414960] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-27T17:33:40.458437] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:33:40.835192] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T17:33:41.214910] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-27T17:33:42.015005] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-27T17:33:42.404398] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:33:42.814952] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-27T17:33:43.090519] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-27T17:33:43.614964] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-27T17:33:43.826904] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T17:33:43.880783] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-27T17:33:44.414960] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-27T17:33:45.214935] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-27T17:33:45.540082] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T17:33:46.014938] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-27T17:33:46.187239] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:33:46.497522] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:33:46.814960] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-27T17:33:47.615003] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-27T17:33:47.942074] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T17:33:48.414937] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-27T17:33:48.930313] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:33:48.931183] [INFO ] [REMOTE ] BHV: Full fetch complete (1428 records). [2025-10-27T17:33:48.931252] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-27T17:33:49.109118] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T17:33:49.109411] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:33:49.124074] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:33:49.134989] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-27T17:33:49.135134] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-27T17:33:49.135186] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-27T17:33:49.135399] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-27T17:33:49.135492] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHV took 19.8s. Estimated remaining: 4h 19m 59s. Rate: 8.1 symbols/min [2025-10-27T17:33:49.136907] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T17:33:49.219123] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-27T17:33:49.236224] [INFO ] [REMOTE ] BHP: Full fetch complete (77439 records). [2025-10-27T17:33:49.246675] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-27T17:33:49.399487] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:49.755095] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-27T17:33:49.754873] [DEBUG] [LOCAL ] BILL: Loaded 53268 existing records from primary storage. [2025-10-27T17:33:49.755264] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-27T17:33:49.756265] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-27T17:33:49.756343] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-27T17:33:49.756609] [INFO ] [MAIN ] BILL: Loaded 53268 existing records. [2025-10-27T17:33:49.856450] [DEBUG] [LOCAL ] BHP: Trimmed 77439 records to 53359 (keeping 200 days of data) [2025-10-27T17:33:50.015700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-27T17:33:50.025182] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:50.033349] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-27T17:33:50.035622] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-27T17:33:50.036867] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-27T17:33:50.037434] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-27T17:33:50.613335] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:50.618741] [DEBUG] [LOCAL ] BHP: Primary data saved (53359 records). [2025-10-27T17:33:50.619140] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-27T17:33:50.619235] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 39.6s. Estimated remaining: 4h 19m 5s. Rate: 8.1 symbols/min [2025-10-27T17:33:50.792790] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:33:50.815556] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-27T17:33:50.816847] [DEBUG] [LOCAL ] BIO: Loaded 24067 existing records from primary storage. [2025-10-27T17:33:50.817108] [INFO ] [MAIN ] BIO: Loaded 24067 existing records. [2025-10-27T17:33:51.001970] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:33:51.002263] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-27T17:33:51.002322] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-27T17:33:51.002485] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-27T17:33:51.002523] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-27T17:33:51.313567] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:33:51.412316] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T17:33:51.415963] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:33:51.614948] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-27T17:33:52.414918] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-27T17:33:52.450232] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:33:52.673917] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T17:33:53.215007] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-27T17:33:53.469197] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:33:54.014953] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-27T17:33:54.814984] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-27T17:33:55.102047] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T17:33:55.243092] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:33:55.539673] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T17:33:55.614932] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-27T17:33:56.414930] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-27T17:33:57.201482] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:33:57.214902] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-27T17:33:57.261060] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:33:57.858940] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T17:33:58.014946] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-27T17:33:58.814965] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-27T17:33:59.614951] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-27T17:33:59.756567] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:33:59.830543] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:34:00.414932] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-27T17:34:01.214953] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-27T17:34:02.014918] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-27T17:34:02.402789] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-27T17:34:02.412704] [INFO ] [REMOTE ] BHVN: Full fetch complete (70833 records). [2025-10-27T17:34:02.412851] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-27T17:34:02.801098] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-27T17:34:02.801191] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-27T17:34:02.802006] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-27T17:34:02.802081] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-27T17:34:02.803463] [DEBUG] [LOCAL ] BHVN: Trimmed 70833 records to 50598 (keeping 200 days of data) [2025-10-27T17:34:03.090336] [DEBUG] [LOCAL ] BHVN: Primary data saved (50598 records). [2025-10-27T17:34:03.090461] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-27T17:34:03.090536] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHVN took 32.6s. Estimated remaining: 4h 19m 36s. Rate: 8.1 symbols/min [2025-10-27T17:34:03.259704] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:03.295018] [DEBUG] [LOCAL ] BIP: Loaded 39408 existing records from primary storage. [2025-10-27T17:34:03.295297] [INFO ] [MAIN ] BIP: Loaded 39408 existing records. [2025-10-27T17:34:03.474974] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:03.475164] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-27T17:34:03.475211] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-27T17:34:03.475393] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-27T17:34:03.475448] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-27T17:34:03.827721] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:03.828056] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-27T17:34:04.738403] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-27T17:34:04.744678] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-27T17:34:04.975378] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (3.76 seconds). [2025-10-27T17:34:04.981477] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-27T17:34:05.139788] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (4.72 seconds). [2025-10-27T17:34:05.215012] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-27T17:34:05.216093] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:34:05.984551] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:34:05.989985] [INFO ] [REMOTE ] BHR: Full fetch complete (31193 records). [2025-10-27T17:34:05.990097] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-27T17:34:06.022948] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-27T17:34:06.372930] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-27T17:34:06.373011] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-27T17:34:06.373472] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-27T17:34:06.373515] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-27T17:34:06.374247] [DEBUG] [LOCAL ] BHR: Trimmed 31193 records to 21977 (keeping 200 days of data) [2025-10-27T17:34:06.498223] [DEBUG] [LOCAL ] BHR: Primary data saved (21977 records). [2025-10-27T17:34:06.498345] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-27T17:34:06.498419] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHR took 43.4s. Estimated remaining: 4h 18m 58s. Rate: 8.1 symbols/min [2025-10-27T17:34:06.674123] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:06.717914] [DEBUG] [LOCAL ] BIPC: Loaded 41611 existing records from primary storage. [2025-10-27T17:34:06.718304] [INFO ] [MAIN ] BIPC: Loaded 41611 existing records. [2025-10-27T17:34:06.908229] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:06.909124] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-27T17:34:06.921717] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-27T17:34:06.924906] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T17:34:06.925047] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-27T17:34:06.930599] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-27T17:34:06.967975] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-27T17:34:07.126347] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T17:34:07.338849] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:07.593040] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T17:34:07.614905] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-27T17:34:07.997236] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:34:08.414909] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-27T17:34:08.712252] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:34:09.214931] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-27T17:34:09.765959] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:34:10.014967] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-27T17:34:10.621217] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:34:10.814936] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-27T17:34:11.250556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:34:11.615010] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-27T17:34:12.324054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:34:12.414931] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-27T17:34:12.694073] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T17:34:13.214979] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-27T17:34:13.565408] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:34:14.014954] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-27T17:34:14.769754] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:34:14.814919] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-27T17:34:15.615010] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-27T17:34:16.006504] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:34:16.265259] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:34:16.414945] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-27T17:34:17.090871] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T17:34:17.214929] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-27T17:34:17.348204] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:34:18.014935] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-27T17:34:18.415327] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:34:18.814894] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-27T17:34:18.846783] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:34:19.615005] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-27T17:34:20.137456] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T17:34:20.284984] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T17:34:20.414949] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-27T17:34:21.214977] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-27T17:34:21.978333] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:34:21.982315] [INFO ] [REMOTE ] BIO: Full fetch complete (34657 records). [2025-10-27T17:34:21.982404] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-27T17:34:22.015442] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-27T17:34:22.347399] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T17:34:22.428635] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-27T17:34:22.428737] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-27T17:34:22.429182] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-27T17:34:22.429221] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-27T17:34:22.429963] [DEBUG] [LOCAL ] BIO: Trimmed 34657 records to 23423 (keeping 200 days of data) [2025-10-27T17:34:22.573732] [DEBUG] [LOCAL ] BIO: Primary data saved (23423 records). [2025-10-27T17:34:22.574156] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-27T17:34:22.574264] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BIO took 32.0s. Estimated remaining: 4h 19m 56s. Rate: 8.0 symbols/min [2025-10-27T17:34:22.750448] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:22.754493] [DEBUG] [LOCAL ] BIPH: Loaded 2371 existing records from primary storage. [2025-10-27T17:34:22.754664] [INFO ] [MAIN ] BIPH: Loaded 2371 existing records. [2025-10-27T17:34:22.820971] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-27T17:34:22.936858] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:22.937104] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-27T17:34:22.937151] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-27T17:34:22.937738] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-27T17:34:22.937796] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-27T17:34:23.284837] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:23.614955] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-27T17:34:23.676387] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:34:24.414930] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-27T17:34:24.679343] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T17:34:24.690231] [INFO ] [REMOTE ] BILL: Full fetch complete (76123 records). [2025-10-27T17:34:24.690376] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-27T17:34:24.873461] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T17:34:25.126871] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-27T17:34:25.126954] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-27T17:34:25.127800] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-27T17:34:25.127864] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-27T17:34:25.129351] [DEBUG] [LOCAL ] BILL: Trimmed 76123 records to 52486 (keeping 200 days of data) [2025-10-27T17:34:25.218737] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-27T17:34:25.430483] [DEBUG] [LOCAL ] BILL: Primary data saved (52486 records). [2025-10-27T17:34:25.430621] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-27T17:34:25.430734] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BILL took 36.3s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-27T17:34:25.892601] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T17:34:26.014950] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-27T17:34:26.225494] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T17:34:26.574721] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:34:26.814937] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-27T17:34:27.614985] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-27T17:34:27.751019] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T17:34:28.029804] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:34:28.415002] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-27T17:34:29.214991] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-27T17:34:29.964172] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:34:30.014907] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-27T17:34:30.480914] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T17:34:30.488776] [INFO ] [REMOTE ] BIPC: Full fetch complete (60177 records). [2025-10-27T17:34:30.488860] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-27T17:34:30.820132] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-27T17:34:30.870411] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-27T17:34:30.870562] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-27T17:34:30.871281] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-27T17:34:30.871342] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-27T17:34:30.872530] [DEBUG] [LOCAL ] BIPC: Trimmed 60177 records to 40781 (keeping 200 days of data) [2025-10-27T17:34:31.116036] [DEBUG] [LOCAL ] BIPC: Primary data saved (40781 records). [2025-10-27T17:34:31.116149] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-27T17:34:31.116990] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BIPC took 24.6s. Estimated remaining: 4h 18m 53s. Rate: 8.1 symbols/min [2025-10-27T17:34:31.296953] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T17:34:31.621412] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-27T17:34:31.636525] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:34:31.645781] [INFO ] [REMOTE ] BIP: Full fetch complete (57672 records). [2025-10-27T17:34:31.645898] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-27T17:34:32.024626] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-27T17:34:32.024857] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-27T17:34:32.025514] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-27T17:34:32.025555] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-27T17:34:32.026710] [DEBUG] [LOCAL ] BIP: Trimmed 57672 records to 38519 (keeping 200 days of data) [2025-10-27T17:34:32.241460] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T17:34:32.257832] [DEBUG] [LOCAL ] BIP: Primary data saved (38519 records). [2025-10-27T17:34:32.257928] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-27T17:34:32.257997] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIP took 29.2s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-10-27T17:34:32.414958] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-27T17:34:32.753670] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:34:33.214988] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-27T17:34:33.737453] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T17:34:34.014969] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-27T17:34:34.337089] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T17:34:34.814941] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-27T17:34:35.325175] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:34:35.614925] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-27T17:34:36.132508] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T17:34:36.414978] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-27T17:34:37.042428] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T17:34:37.043536] [INFO ] [REMOTE ] BIPH: Full fetch complete (3641 records). [2025-10-27T17:34:37.043617] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-27T17:34:37.395259] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-27T17:34:37.395332] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-27T17:34:37.395450] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-27T17:34:37.395486] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-27T17:34:37.395849] [DEBUG] [LOCAL ] BIPH: Trimmed 3641 records to 2251 (keeping 200 days of data) [2025-10-27T17:34:37.409185] [DEBUG] [LOCAL ] BIPH: Primary data saved (2251 records). [2025-10-27T17:34:37.409244] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-27T17:34:37.409308] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPH took 14.8s. Estimated remaining: 4h 17m 35s. Rate: 8.1 symbols/min [2025-10-27T17:34:38.108476] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.091972] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.125762] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.124981] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:34:38.134752] [DEBUG] [LOCAL ] BIPJ: Loaded 3116 existing records from primary storage. [2025-10-27T17:34:38.137560] [DEBUG] [LOCAL ] BIPI: Loaded 2842 existing records from primary storage. [2025-10-27T17:34:38.138357] [INFO ] [MAIN ] BIPI: Loaded 2842 existing records. [2025-10-27T17:34:38.138100] [INFO ] [MAIN ] BIPJ: Loaded 3116 existing records. [2025-10-27T17:34:38.384823] [DEBUG] [LOCAL ] BIT: Loaded 24068 existing records from primary storage. [2025-10-27T17:34:38.434315] [INFO ] [MAIN ] BIT: Loaded 24068 existing records. [2025-10-27T17:34:38.549967] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:38.594512] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-27T17:34:38.603417] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:38.603632] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-27T17:34:38.638674] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-27T17:34:38.638858] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-27T17:34:38.664730] [DEBUG] [LOCAL ] BIRK: Loaded 51897 existing records from primary storage. [2025-10-27T17:34:38.669940] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-27T17:34:38.692850] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-27T17:34:38.685808] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-27T17:34:38.693049] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-27T17:34:38.697478] [INFO ] [MAIN ] BIRK: Loaded 51897 existing records. [2025-10-27T17:34:39.093738] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:39.129986] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-27T17:34:39.130098] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-27T17:34:39.149746] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-27T17:34:39.220506] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-27T17:34:39.409231] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:34:39.552058] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-27T17:34:39.552226] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-27T17:34:39.629701] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-27T17:34:39.630155] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-27T17:34:40.060186] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.114692] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-27T17:34:40.176727] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.187698] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-27T17:34:40.422633] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.435282] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-27T17:34:40.544788] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:34:40.545156] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-27T17:34:40.650979] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T17:34:40.652279] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-27T17:34:40.858062] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T17:34:40.939927] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T17:34:41.214924] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-27T17:34:41.543186] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T17:34:41.772894] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T17:34:41.776765] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T17:34:42.014935] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-27T17:34:42.815007] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-27T17:34:43.429784] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T17:34:43.614917] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-27T17:34:43.662890] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:34:44.045460] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T17:34:44.414952] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-27T17:34:45.063728] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T17:34:45.214946] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-27T17:34:46.014989] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-27T17:34:46.411754] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T17:34:46.814967] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-27T17:34:46.908490] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T17:34:47.095818] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-27T17:34:47.614949] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-27T17:34:48.415005] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-27T17:34:49.214924] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-27T17:34:49.287515] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T17:34:49.342675] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T17:34:49.918330] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T17:34:50.014940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-27T17:34:50.357385] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T17:34:50.814964] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-27T17:34:51.614915] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-27T17:34:52.162544] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T17:34:52.414909] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-27T17:34:52.635415] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:34:52.786540] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:34:53.214935] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-27T17:34:54.014914] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-27T17:34:54.336892] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T17:34:54.415338] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T17:34:54.814942] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-27T17:34:55.614995] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-27T17:34:55.863409] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:34:56.078258] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:34:56.414961] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-27T17:34:57.214988] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-27T17:34:57.870102] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:34:57.909382] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:34:58.014904] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-27T17:34:58.815045] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-27T17:34:59.155252] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T17:34:59.614964] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-27T17:34:59.662565] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:34:59.993017] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T17:35:00.414988] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-27T17:35:01.214967] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-27T17:35:02.014993] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-27T17:35:02.814965] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-27T17:35:03.666546] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-27T17:35:03.671822] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-27T17:35:03.802149] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T17:35:03.803213] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4129 records). [2025-10-27T17:35:03.803281] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-27T17:35:03.803747] [FATAL] [VALIDATOR ] BIPJ: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:35:03.803868] [FATAL] [MAIN ] BIPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:35:03.803939] [WARN ] [MAIN ] BIPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:35:03.804011] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-27T17:35:03.804072] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-27T17:35:03.804107] [INFO ] [LOCAL ] BIPJ: Starting deletion of derivative data. [2025-10-27T17:35:03.804244] [DEBUG] [LOCAL ] BIPJ: Deleted derivative data file. [2025-10-27T17:35:03.804328] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPJ took 26.4s. Estimated remaining: 4h 19m 48s. Rate: 8.0 symbols/min [2025-10-27T17:35:03.979578] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:04.038212] [DEBUG] [LOCAL ] BJ: Loaded 52222 existing records from primary storage. [2025-10-27T17:35:04.038545] [INFO ] [MAIN ] BJ: Loaded 52222 existing records. [2025-10-27T17:35:04.148983] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-27T17:35:04.234665] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:04.234912] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-27T17:35:04.234966] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-27T17:35:04.235179] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-27T17:35:04.235223] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-27T17:35:04.418715] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-27T17:35:04.658297] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:04.928427] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T17:35:05.173671] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-27T17:35:05.214922] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-27T17:35:05.237086] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:35:06.014980] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-27T17:35:06.357141] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T17:35:06.358255] [INFO ] [REMOTE ] BIPI: Full fetch complete (4506 records). [2025-10-27T17:35:06.358326] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-27T17:35:06.797723] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-27T17:35:06.797842] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-27T17:35:06.798042] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-27T17:35:06.798086] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-27T17:35:06.798689] [DEBUG] [LOCAL ] BIPI: Trimmed 4506 records to 2727 (keeping 200 days of data) [2025-10-27T17:35:06.815777] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-27T17:35:06.818756] [DEBUG] [LOCAL ] BIPI: Primary data saved (2727 records). [2025-10-27T17:35:06.819942] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-27T17:35:06.820075] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIPI took 29.4s. Estimated remaining: 4h 19m 8s. Rate: 8.0 symbols/min [2025-10-27T17:35:07.035629] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:07.093958] [DEBUG] [LOCAL ] BK: Loaded 54317 existing records from primary storage. [2025-10-27T17:35:07.094422] [INFO ] [MAIN ] BK: Loaded 54317 existing records. [2025-10-27T17:35:07.319251] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:07.319600] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-27T17:35:07.319679] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-27T17:35:07.320011] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-27T17:35:07.320070] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-27T17:35:07.618120] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-27T17:35:07.711407] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:08.414996] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-27T17:35:08.557820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-27T17:35:09.207536] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:35:09.217201] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-27T17:35:09.397042] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-27T17:35:10.015028] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-27T17:35:10.263098] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T17:35:10.659487] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:35:10.665184] [INFO ] [REMOTE ] BIT: Full fetch complete (32438 records). [2025-10-27T17:35:10.665303] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-27T17:35:10.821065] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-27T17:35:11.076404] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-27T17:35:11.076487] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-27T17:35:11.076931] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-27T17:35:11.076993] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-27T17:35:11.077795] [DEBUG] [LOCAL ] BIT: Trimmed 32438 records to 23558 (keeping 200 days of data) [2025-10-27T17:35:11.217053] [DEBUG] [LOCAL ] BIT: Primary data saved (23558 records). [2025-10-27T17:35:11.217201] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-27T17:35:11.217308] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIT took 33.8s. Estimated remaining: 4h 18m 38s. Rate: 8.1 symbols/min [2025-10-27T17:35:11.392470] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:11.436440] [DEBUG] [LOCAL ] BKD: Loaded 51079 existing records from primary storage. [2025-10-27T17:35:11.436926] [INFO ] [MAIN ] BKD: Loaded 51079 existing records. [2025-10-27T17:35:11.621099] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-27T17:35:11.626874] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:11.628074] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-27T17:35:11.628157] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-27T17:35:11.628721] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-27T17:35:11.628816] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-27T17:35:11.823460] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:35:12.050709] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:12.414973] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-27T17:35:12.863959] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T17:35:12.874247] [INFO ] [REMOTE ] BIRK: Full fetch complete (73461 records). [2025-10-27T17:35:12.874430] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-27T17:35:13.220255] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-27T17:35:13.277058] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-27T17:35:13.277139] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-27T17:35:13.277935] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-27T17:35:13.277998] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-27T17:35:13.279312] [DEBUG] [LOCAL ] BIRK: Trimmed 73461 records to 51082 (keeping 200 days of data) [2025-10-27T17:35:13.582949] [DEBUG] [LOCAL ] BIRK: Primary data saved (51082 records). [2025-10-27T17:35:13.583185] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-27T17:35:13.583284] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 36.2s. Estimated remaining: 4h 17m 53s. Rate: 8.1 symbols/min [2025-10-27T17:35:13.767604] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:13.802776] [DEBUG] [LOCAL ] BKE: Loaded 34000 existing records from primary storage. [2025-10-27T17:35:13.803187] [INFO ] [MAIN ] BKE: Loaded 34000 existing records. [2025-10-27T17:35:13.986177] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T17:35:14.054209] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:14.056572] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:35:14.056987] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-27T17:35:14.068399] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-27T17:35:14.069283] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-27T17:35:14.069509] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-27T17:35:14.069551] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-27T17:35:14.455986] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:14.745605] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:35:14.814973] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-27T17:35:15.561837] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T17:35:15.615048] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-27T17:35:16.415030] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-27T17:35:16.747432] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T17:35:16.909310] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:35:17.214968] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-27T17:35:17.828495] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T17:35:18.014970] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-27T17:35:18.681065] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:35:18.814922] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-27T17:35:19.614967] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-27T17:35:19.921185] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T17:35:19.989781] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T17:35:20.414959] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-27T17:35:21.214918] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-27T17:35:21.276546] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:35:21.305168] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:35:22.014937] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-27T17:35:22.528384] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:35:22.814950] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-27T17:35:23.261670] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:35:23.614934] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-27T17:35:24.399120] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:35:24.414913] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-27T17:35:24.589353] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T17:35:25.214948] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-27T17:35:25.901662] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:35:26.014951] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-27T17:35:26.814930] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-27T17:35:26.867249] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T17:35:27.614961] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-27T17:35:27.965223] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T17:35:28.414915] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-27T17:35:28.662538] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:35:29.110404] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:35:29.214938] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-27T17:35:29.821114] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T17:35:30.014929] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-27T17:35:30.313668] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T17:35:30.814939] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-27T17:35:31.614958] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-27T17:35:31.854433] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:35:32.055175] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:35:32.414907] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-27T17:35:32.867686] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T17:35:33.214928] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-27T17:35:33.833945] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:35:34.014969] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-27T17:35:34.696999] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T17:35:34.710375] [INFO ] [REMOTE ] BJ: Full fetch complete (74386 records). [2025-10-27T17:35:34.710568] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-27T17:35:34.823724] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-27T17:35:35.124273] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-27T17:35:35.124363] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-27T17:35:35.125166] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-27T17:35:35.125234] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-27T17:35:35.126791] [DEBUG] [LOCAL ] BJ: Trimmed 74386 records to 51411 (keeping 200 days of data) [2025-10-27T17:35:35.434283] [DEBUG] [LOCAL ] BJ: Primary data saved (51411 records). [2025-10-27T17:35:35.434440] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-27T17:35:35.436880] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 31.6s. Estimated remaining: 4h 19m 31s. Rate: 8.0 symbols/min [2025-10-27T17:35:35.605592] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:35.614939] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-27T17:35:35.642999] [DEBUG] [LOCAL ] BKH: Loaded 37992 existing records from primary storage. [2025-10-27T17:35:35.643412] [INFO ] [MAIN ] BKH: Loaded 37992 existing records. [2025-10-27T17:35:35.829234] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T17:35:35.865778] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:35.867031] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-27T17:35:35.867140] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-27T17:35:35.867410] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-27T17:35:35.867466] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-27T17:35:36.221175] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:36.414944] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-27T17:35:36.523048] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T17:35:36.782236] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T17:35:36.792396] [INFO ] [REMOTE ] BK: Full fetch complete (77669 records). [2025-10-27T17:35:36.792528] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-27T17:35:37.180568] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-27T17:35:37.180669] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-27T17:35:37.181514] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-27T17:35:37.181577] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-27T17:35:37.182973] [DEBUG] [LOCAL ] BK: Trimmed 77669 records to 53535 (keeping 200 days of data) [2025-10-27T17:35:37.235850] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-27T17:35:37.505876] [DEBUG] [LOCAL ] BK: Primary data saved (53535 records). [2025-10-27T17:35:37.506031] [INFO ] [MAIN ] BK: Full history saved. [2025-10-27T17:35:37.506174] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 30.7s. Estimated remaining: 4h 18m 44s. Rate: 8.0 symbols/min [2025-10-27T17:35:37.633891] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T17:35:37.711336] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:37.747679] [DEBUG] [LOCAL ] BKKT: Loaded 38106 existing records from primary storage. [2025-10-27T17:35:37.747989] [INFO ] [MAIN ] BKKT: Loaded 38106 existing records. [2025-10-27T17:35:37.919440] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:37.919661] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-27T17:35:37.919723] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-27T17:35:37.919902] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-27T17:35:37.919940] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-27T17:35:38.019309] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-27T17:35:38.269070] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:38.324511] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T17:35:38.814959] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-27T17:35:39.614940] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-27T17:35:39.824426] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T17:35:40.285673] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T17:35:40.414996] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-27T17:35:40.974823] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T17:35:41.214957] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-27T17:35:41.780244] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:35:42.014961] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-27T17:35:42.158894] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:35:42.165301] [INFO ] [REMOTE ] BKE: Full fetch complete (50041 records). [2025-10-27T17:35:42.165409] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-27T17:35:42.572629] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-27T17:35:42.572733] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-27T17:35:42.573301] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-27T17:35:42.573340] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-27T17:35:42.574363] [DEBUG] [LOCAL ] BKE: Trimmed 50041 records to 33221 (keeping 200 days of data) [2025-10-27T17:35:42.779922] [DEBUG] [LOCAL ] BKE: Primary data saved (33221 records). [2025-10-27T17:35:42.780053] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-27T17:35:42.780127] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKE took 29.2s. Estimated remaining: 4h 18m 21s. Rate: 8.0 symbols/min [2025-10-27T17:35:42.821118] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-27T17:35:42.946180] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:42.955136] [DEBUG] [LOCAL ] BKN: Loaded 7384 existing records from primary storage. [2025-10-27T17:35:42.955413] [INFO ] [MAIN ] BKN: Loaded 7384 existing records. [2025-10-27T17:35:43.131075] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:43.131303] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-27T17:35:43.131356] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-27T17:35:43.131501] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-27T17:35:43.131538] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-27T17:35:43.487480] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:43.507373] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T17:35:43.614924] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-27T17:35:43.956836] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:35:44.414970] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-27T17:35:44.971804] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:35:45.028777] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T17:35:45.214932] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-27T17:35:45.625221] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T17:35:46.014935] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-27T17:35:46.473620] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T17:35:46.814939] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-27T17:35:47.614971] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-27T17:35:48.164570] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:35:48.414935] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-27T17:35:48.854009] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T17:35:49.214911] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-27T17:35:49.249766] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T17:35:49.682822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:35:50.014933] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-27T17:35:50.777561] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T17:35:50.814914] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-27T17:35:51.614946] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-27T17:35:51.960135] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:35:52.414937] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-27T17:35:53.042272] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T17:35:53.052542] [INFO ] [REMOTE ] BKD: Full fetch complete (72099 records). [2025-10-27T17:35:53.052776] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-27T17:35:53.220238] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-27T17:35:53.474003] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-27T17:35:53.474096] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-27T17:35:53.475026] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-27T17:35:53.475104] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-27T17:35:53.476945] [DEBUG] [LOCAL ] BKD: Trimmed 72099 records to 50297 (keeping 200 days of data) [2025-10-27T17:35:53.780240] [DEBUG] [LOCAL ] BKD: Primary data saved (50297 records). [2025-10-27T17:35:53.780377] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-27T17:35:53.780456] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKD took 42.6s. Estimated remaining: 4h 18m 39s. Rate: 8.0 symbols/min [2025-10-27T17:35:53.946779] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:35:53.990457] [DEBUG] [LOCAL ] BKSY: Loaded 49624 existing records from primary storage. [2025-10-27T17:35:53.990929] [INFO ] [MAIN ] BKSY: Loaded 49624 existing records. [2025-10-27T17:35:54.021004] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-27T17:35:54.115068] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T17:35:54.200908] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:35:54.201100] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-27T17:35:54.201145] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-27T17:35:54.201314] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-27T17:35:54.201352] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-27T17:35:54.503352] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T17:35:54.570498] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:35:54.591210] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:35:54.814915] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-27T17:35:55.614950] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-27T17:35:56.375241] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:35:56.414911] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-27T17:35:57.063574] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T17:35:57.214958] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-27T17:35:58.014932] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-27T17:35:58.092720] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:35:58.164906] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:35:58.814979] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-27T17:35:59.448420] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:35:59.615001] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-27T17:36:00.061611] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T17:36:00.414977] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-27T17:36:01.214944] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-27T17:36:01.831360] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-27T17:36:02.014936] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-27T17:36:02.814944] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-27T17:36:03.917948] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-27T17:36:03.920523] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-27T17:36:04.670120] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (4.26 seconds). [2025-10-27T17:36:04.680781] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-27T17:36:05.501042] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T17:36:05.502909] [INFO ] [REMOTE ] BKN: Full fetch complete (11095 records). [2025-10-27T17:36:05.502981] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-27T17:36:05.913193] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-27T17:36:05.913310] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-27T17:36:05.913710] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-27T17:36:05.913797] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-27T17:36:05.914582] [DEBUG] [LOCAL ] BKN: Trimmed 11095 records to 7164 (keeping 200 days of data) [2025-10-27T17:36:05.978200] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-27T17:36:05.998220] [DEBUG] [LOCAL ] BKN: Primary data saved (7164 records). [2025-10-27T17:36:05.998778] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-27T17:36:05.998890] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKN took 23.2s. Estimated remaining: 4h 19m 5s. Rate: 8.0 symbols/min [2025-10-27T17:36:05.999209] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-27T17:36:06.192829] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:06.208840] [DEBUG] [LOCAL ] BKT: Loaded 12963 existing records from primary storage. [2025-10-27T17:36:06.209084] [INFO ] [MAIN ] BKT: Loaded 12963 existing records. [2025-10-27T17:36:06.416111] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:06.416484] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-27T17:36:06.416578] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-27T17:36:06.416920] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-27T17:36:06.417024] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-27T17:36:06.532753] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (4.52 seconds). [2025-10-27T17:36:06.608008] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-27T17:36:06.845878] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:06.846173] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-27T17:36:06.885619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T17:36:07.165507] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:36:07.614918] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-27T17:36:07.657010] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:36:08.414964] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-27T17:36:08.549314] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T17:36:09.084177] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:36:09.215012] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-27T17:36:09.547465] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T17:36:09.555111] [INFO ] [REMOTE ] BKH: Full fetch complete (53060 records). [2025-10-27T17:36:09.555228] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-27T17:36:09.555927] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:36:09.556016] [FATAL] [MAIN ] BKH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:36:09.556060] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:36:09.556100] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-27T17:36:09.556156] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-27T17:36:09.556191] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-10-27T17:36:09.556315] [DEBUG] [LOCAL ] BKH: Deleted derivative data file. [2025-10-27T17:36:09.556774] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKH took 34.1s. Estimated remaining: 4h 18m 30s. Rate: 8.0 symbols/min [2025-10-27T17:36:09.760619] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:09.802588] [DEBUG] [LOCAL ] BKU: Loaded 42767 existing records from primary storage. [2025-10-27T17:36:09.802914] [INFO ] [MAIN ] BKU: Loaded 42767 existing records. [2025-10-27T17:36:10.006552] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:10.006819] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-27T17:36:10.006890] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-27T17:36:10.007150] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-27T17:36:10.007217] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-27T17:36:10.020080] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-27T17:36:10.366556] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:10.623454] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T17:36:10.814949] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-27T17:36:11.614958] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-27T17:36:11.796818] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T17:36:12.238298] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T17:36:12.248071] [INFO ] [REMOTE ] BKKT: Full fetch complete (52381 records). [2025-10-27T17:36:12.248180] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-27T17:36:12.425456] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-27T17:36:12.665845] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-27T17:36:12.665940] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-27T17:36:12.666539] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-27T17:36:12.666583] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-27T17:36:12.667618] [DEBUG] [LOCAL ] BKKT: Trimmed 52381 records to 37775 (keeping 200 days of data) [2025-10-27T17:36:12.881105] [DEBUG] [LOCAL ] BKKT: Primary data saved (37775 records). [2025-10-27T17:36:12.881234] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-27T17:36:12.881311] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKKT took 35.4s. Estimated remaining: 4h 17m 53s. Rate: 8.0 symbols/min [2025-10-27T17:36:13.045303] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:13.072710] [DEBUG] [LOCAL ] BKV: Loaded 29719 existing records from primary storage. [2025-10-27T17:36:13.072954] [INFO ] [MAIN ] BKV: Loaded 29719 existing records. [2025-10-27T17:36:13.220430] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-27T17:36:13.250158] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:13.250438] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-27T17:36:13.250490] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-27T17:36:13.250791] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-27T17:36:13.250849] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-27T17:36:13.609726] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:13.650086] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-27T17:36:13.718385] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T17:36:13.861900] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T17:36:14.014954] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-27T17:36:14.433866] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T17:36:14.814979] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-27T17:36:15.592707] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T17:36:15.614909] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-27T17:36:16.389342] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:36:16.414899] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-27T17:36:17.214926] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-27T17:36:17.222774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:36:18.014984] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-27T17:36:18.263299] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:36:18.814941] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-27T17:36:19.614915] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-27T17:36:19.694209] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:36:19.913421] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:36:20.414946] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-27T17:36:20.813839] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:36:21.214911] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-27T17:36:21.288148] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:36:22.014932] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-27T17:36:22.039069] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:36:22.804005] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T17:36:22.814912] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-27T17:36:23.614909] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-27T17:36:23.690224] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T17:36:24.414929] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-27T17:36:24.526112] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T17:36:25.214953] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-27T17:36:25.898299] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T17:36:25.902549] [INFO ] [REMOTE ] BKT: Full fetch complete (16805 records). [2025-10-27T17:36:25.902618] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-27T17:36:26.020151] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-27T17:36:26.276000] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-27T17:36:26.276176] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-27T17:36:26.276670] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-27T17:36:26.276761] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-27T17:36:26.277727] [DEBUG] [LOCAL ] BKT: Trimmed 16805 records to 12719 (keeping 200 days of data) [2025-10-27T17:36:26.360076] [DEBUG] [LOCAL ] BKT: Primary data saved (12719 records). [2025-10-27T17:36:26.360332] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-27T17:36:26.360434] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKT took 20.4s. Estimated remaining: 4h 18m 28s. Rate: 8.0 symbols/min [2025-10-27T17:36:26.524117] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-27T17:36:26.604715] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:26.639592] [DEBUG] [LOCAL ] BLCO: Loaded 35220 existing records from primary storage. [2025-10-27T17:36:26.639909] [INFO ] [MAIN ] BLCO: Loaded 35220 existing records. [2025-10-27T17:36:26.815713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-27T17:36:26.827952] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:26.828204] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-27T17:36:26.828252] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-27T17:36:26.828462] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-27T17:36:26.828519] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-27T17:36:27.193885] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:27.362285] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:36:27.614936] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-27T17:36:27.834014] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:36:28.414939] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-27T17:36:28.688447] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T17:36:29.214953] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-27T17:36:29.838180] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T17:36:30.014910] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-27T17:36:30.045936] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T17:36:30.814970] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-27T17:36:31.198971] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T17:36:31.614973] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-27T17:36:31.735114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:36:32.414939] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-27T17:36:33.214954] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-27T17:36:33.702167] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-27T17:36:33.712213] [INFO ] [REMOTE ] BKSY: Full fetch complete (70741 records). [2025-10-27T17:36:33.712345] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-27T17:36:33.832959] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:36:34.023024] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-27T17:36:34.132386] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-27T17:36:34.132508] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-27T17:36:34.133313] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-27T17:36:34.133393] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-27T17:36:34.135002] [DEBUG] [LOCAL ] BKSY: Trimmed 70741 records to 48907 (keeping 200 days of data) [2025-10-27T17:36:34.356555] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:36:34.447598] [DEBUG] [LOCAL ] BKSY: Primary data saved (48907 records). [2025-10-27T17:36:34.447757] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-27T17:36:34.447840] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKSY took 40.7s. Estimated remaining: 4h 18m 25s. Rate: 8.0 symbols/min [2025-10-27T17:36:34.617506] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:34.648704] [DEBUG] [LOCAL ] BLD: Loaded 27346 existing records from primary storage. [2025-10-27T17:36:34.649040] [INFO ] [MAIN ] BLD: Loaded 27346 existing records. [2025-10-27T17:36:34.827637] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-27T17:36:34.832739] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:34.833861] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-27T17:36:34.833915] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-27T17:36:34.834077] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-27T17:36:34.834116] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-27T17:36:35.196457] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:35.280089] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T17:36:35.614989] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-27T17:36:36.215059] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T17:36:36.414949] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-27T17:36:36.480754] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:36:37.214979] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-27T17:36:37.394279] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:36:38.014942] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-27T17:36:38.344253] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:36:38.797518] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T17:36:38.814903] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-27T17:36:39.614936] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-27T17:36:40.097004] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T17:36:40.414918] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-27T17:36:40.940506] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:36:41.214950] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-27T17:36:41.439177] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:36:42.014970] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-27T17:36:42.335885] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:36:42.341995] [INFO ] [REMOTE ] BKV: Full fetch complete (44860 records). [2025-10-27T17:36:42.342091] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-27T17:36:42.728535] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-27T17:36:42.728622] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-27T17:36:42.729169] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-27T17:36:42.729223] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-27T17:36:42.730139] [DEBUG] [LOCAL ] BKV: Trimmed 44860 records to 29033 (keeping 200 days of data) [2025-10-27T17:36:42.816355] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-27T17:36:42.896436] [DEBUG] [LOCAL ] BKV: Primary data saved (29033 records). [2025-10-27T17:36:42.896554] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-27T17:36:42.896626] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKV took 30.0s. Estimated remaining: 4h 18m 24s. Rate: 8.0 symbols/min [2025-10-27T17:36:43.066914] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:43.114283] [DEBUG] [LOCAL ] BLDR: Loaded 52578 existing records from primary storage. [2025-10-27T17:36:43.114630] [INFO ] [MAIN ] BLDR: Loaded 52578 existing records. [2025-10-27T17:36:43.290831] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:43.291205] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-27T17:36:43.291417] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-27T17:36:43.291956] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-27T17:36:43.292047] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-27T17:36:43.419111] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:36:43.620014] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-27T17:36:43.675204] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:44.139296] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T17:36:44.414995] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-27T17:36:44.619450] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:36:45.212499] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T17:36:45.215202] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-27T17:36:46.015001] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-27T17:36:46.299691] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:36:46.814993] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-27T17:36:47.214505] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:36:47.614952] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-27T17:36:48.255305] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:36:48.404679] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:36:48.414894] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-27T17:36:49.214909] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-27T17:36:49.235835] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T17:36:50.014926] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-27T17:36:50.215996] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T17:36:50.814994] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-27T17:36:51.614917] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-27T17:36:51.671285] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T17:36:51.722024] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:36:51.730966] [INFO ] [REMOTE ] BKU: Full fetch complete (61197 records). [2025-10-27T17:36:51.731076] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-27T17:36:52.105057] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-27T17:36:52.105135] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-27T17:36:52.105816] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-27T17:36:52.105879] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-27T17:36:52.107186] [DEBUG] [LOCAL ] BKU: Trimmed 61197 records to 42038 (keeping 200 days of data) [2025-10-27T17:36:52.353623] [DEBUG] [LOCAL ] BKU: Primary data saved (42038 records). [2025-10-27T17:36:52.353766] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-27T17:36:52.354458] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 42.8s. Estimated remaining: 4h 18m 31s. Rate: 8.0 symbols/min [2025-10-27T17:36:52.420118] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-27T17:36:52.522890] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:52.538553] [DEBUG] [LOCAL ] BLE: Loaded 13757 existing records from primary storage. [2025-10-27T17:36:52.538796] [INFO ] [MAIN ] BLE: Loaded 13757 existing records. [2025-10-27T17:36:52.716893] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:52.717134] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-27T17:36:52.717202] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-27T17:36:52.717398] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-27T17:36:52.717453] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-27T17:36:53.062912] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:53.214920] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-27T17:36:53.527999] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T17:36:53.533837] [INFO ] [REMOTE ] BLCO: Full fetch complete (52121 records). [2025-10-27T17:36:53.533928] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-27T17:36:53.913389] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-27T17:36:53.913482] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-27T17:36:53.914151] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-27T17:36:53.914240] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-27T17:36:53.915424] [DEBUG] [LOCAL ] BLCO: Trimmed 52121 records to 34457 (keeping 200 days of data) [2025-10-27T17:36:54.015232] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-27T17:36:54.119199] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T17:36:54.158497] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:36:54.185894] [DEBUG] [LOCAL ] BLCO: Primary data saved (34457 records). [2025-10-27T17:36:54.186006] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-27T17:36:54.186102] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 27.8s. Estimated remaining: 4h 17m 44s. Rate: 8.0 symbols/min [2025-10-27T17:36:54.360537] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:54.394528] [DEBUG] [LOCAL ] BLK: Loaded 34575 existing records from primary storage. [2025-10-27T17:36:54.394818] [INFO ] [MAIN ] BLK: Loaded 34575 existing records. [2025-10-27T17:36:54.570859] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:54.571017] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-27T17:36:54.571063] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-27T17:36:54.571487] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-27T17:36:54.571524] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-27T17:36:54.819503] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-27T17:36:54.925962] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:55.218973] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:36:55.223513] [INFO ] [REMOTE ] BLD: Full fetch complete (39776 records). [2025-10-27T17:36:55.223592] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-27T17:36:55.587974] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-27T17:36:55.588044] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-27T17:36:55.588534] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-27T17:36:55.588573] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-27T17:36:55.589371] [DEBUG] [LOCAL ] BLD: Trimmed 39776 records to 26648 (keeping 200 days of data) [2025-10-27T17:36:55.638060] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-27T17:36:55.747492] [DEBUG] [LOCAL ] BLD: Primary data saved (26648 records). [2025-10-27T17:36:55.748027] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-27T17:36:55.748143] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLD took 21.3s. Estimated remaining: 4h 16m 55s. Rate: 8.1 symbols/min [2025-10-27T17:36:55.919275] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:36:55.960019] [DEBUG] [LOCAL ] BLND: Loaded 49966 existing records from primary storage. [2025-10-27T17:36:55.960304] [INFO ] [MAIN ] BLND: Loaded 49966 existing records. [2025-10-27T17:36:56.141301] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:36:56.141763] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-27T17:36:56.141919] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-27T17:36:56.148042] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-27T17:36:56.148152] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-27T17:36:56.191755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T17:36:56.425195] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-27T17:36:56.541539] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:36:56.608034] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T17:36:57.215012] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-27T17:36:58.014951] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-27T17:36:58.285517] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T17:36:58.457589] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T17:36:58.814935] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-27T17:36:59.620020] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-27T17:36:59.635504] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:37:00.304364] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T17:37:00.414918] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-27T17:37:01.029600] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:01.214945] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-27T17:37:02.015009] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-27T17:37:02.815005] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-27T17:37:04.174735] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-10-27T17:37:04.185556] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-27T17:37:04.221127] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-27T17:37:04.414950] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-27T17:37:05.373854] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-27T17:37:05.377069] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-27T17:37:05.862164] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (3.85 seconds). [2025-10-27T17:37:06.014919] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-27T17:37:06.160239] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T17:37:06.297594] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T17:37:06.590976] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T17:37:06.814951] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-27T17:37:07.334461] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:37:07.614939] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-27T17:37:08.049698] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:37:08.414913] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-27T17:37:08.537004] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T17:37:09.214947] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-27T17:37:09.960754] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:37:10.014927] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-27T17:37:10.096590] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:37:10.814935] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-27T17:37:11.508545] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T17:37:11.614936] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-27T17:37:12.257512] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:37:12.414953] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-27T17:37:13.015146] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:37:13.214971] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-27T17:37:13.639898] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T17:37:14.014984] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-27T17:37:14.675480] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T17:37:14.814912] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-27T17:37:15.426948] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:15.614937] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-27T17:37:16.372263] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:37:16.414931] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-27T17:37:17.169516] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:37:17.214914] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-27T17:37:17.585468] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T17:37:18.014950] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-27T17:37:18.608308] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:37:18.618103] [INFO ] [REMOTE ] BLDR: Full fetch complete (74774 records). [2025-10-27T17:37:18.618248] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-27T17:37:18.825104] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-27T17:37:19.015380] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-27T17:37:19.015481] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-27T17:37:19.016454] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-27T17:37:19.016535] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-27T17:37:19.018150] [DEBUG] [LOCAL ] BLDR: Trimmed 74774 records to 51805 (keeping 200 days of data) [2025-10-27T17:37:19.333007] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T17:37:19.359094] [DEBUG] [LOCAL ] BLDR: Primary data saved (51805 records). [2025-10-27T17:37:19.359242] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-27T17:37:19.359343] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLDR took 36.5s. Estimated remaining: 4h 18m 40s. Rate: 8.0 symbols/min [2025-10-27T17:37:19.536399] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:19.536570] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-27T17:37:19.536625] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-27T17:37:19.536765] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-27T17:37:19.536808] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-27T17:37:19.536850] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-27T17:37:19.536883] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-27T17:37:19.620022] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-27T17:37:19.894418] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:20.162248] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:37:20.172048] [INFO ] [REMOTE ] BLND: Full fetch complete (72204 records). [2025-10-27T17:37:20.172174] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-27T17:37:20.415636] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-27T17:37:20.487043] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:37:20.586606] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-27T17:37:20.586726] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-27T17:37:20.587573] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-27T17:37:20.587637] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-27T17:37:20.589139] [DEBUG] [LOCAL ] BLND: Trimmed 72204 records to 49191 (keeping 200 days of data) [2025-10-27T17:37:20.857429] [DEBUG] [LOCAL ] BLND: Primary data saved (49191 records). [2025-10-27T17:37:20.857577] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-27T17:37:20.857683] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLND took 25.1s. Estimated remaining: 4h 17m 51s. Rate: 8.0 symbols/min [2025-10-27T17:37:20.889586] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:37:20.927860] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-27T17:37:20.938758] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:37:20.949784] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-27T17:37:20.958111] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:37:20.960567] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-27T17:37:20.960704] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-27T17:37:20.961068] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-27T17:37:20.976760] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-27T17:37:20.981994] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLSH took 1.6s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-27T17:37:21.110722] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:21.214911] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:21.220529] [DEBUG] [LOCAL ] BLW: Loaded 13127 existing records from primary storage. [2025-10-27T17:37:21.220132] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-27T17:37:21.222004] [INFO ] [MAIN ] BLW: Loaded 13127 existing records. [2025-10-27T17:37:21.400104] [DEBUG] [LOCAL ] BLX: Loaded 15597 existing records from primary storage. [2025-10-27T17:37:21.421702] [INFO ] [MAIN ] BLX: Loaded 15597 existing records. [2025-10-27T17:37:21.421566] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:21.495148] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-27T17:37:21.510747] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-27T17:37:21.521246] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-27T17:37:21.531801] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-27T17:37:21.702224] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:21.702471] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-27T17:37:21.702550] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-27T17:37:21.708332] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-27T17:37:21.713529] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-27T17:37:22.024537] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-27T17:37:22.167939] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T17:37:22.263559] [INFO ] [REMOTE ] BLE: Full fetch complete (19543 records). [2025-10-27T17:37:22.309949] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:22.320679] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-27T17:37:22.451385] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:22.733052] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-27T17:37:22.733124] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-27T17:37:22.733465] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-27T17:37:22.733503] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-27T17:37:22.734043] [DEBUG] [LOCAL ] BLE: Trimmed 19543 records to 13448 (keeping 200 days of data) [2025-10-27T17:37:22.811052] [DEBUG] [LOCAL ] BLE: Primary data saved (13448 records). [2025-10-27T17:37:22.811182] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-27T17:37:22.811260] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLE took 30.5s. Estimated remaining: 4h 16m 6s. Rate: 8.1 symbols/min [2025-10-27T17:37:22.822707] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-27T17:37:22.979093] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:23.011862] [DEBUG] [LOCAL ] BMA: Loaded 37210 existing records from primary storage. [2025-10-27T17:37:23.012133] [INFO ] [MAIN ] BMA: Loaded 37210 existing records. [2025-10-27T17:37:23.187469] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:23.187746] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-27T17:37:23.187798] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-27T17:37:23.188142] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-27T17:37:23.188198] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-27T17:37:23.535071] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:23.614915] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-27T17:37:23.659849] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:37:23.758612] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:37:24.284680] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T17:37:24.414971] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-27T17:37:25.062289] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:37:25.214930] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-27T17:37:26.014998] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-27T17:37:26.814946] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-27T17:37:26.867766] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T17:37:26.871221] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:37:27.614938] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-27T17:37:27.820685] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:37:28.165290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T17:37:28.414963] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-27T17:37:29.062974] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T17:37:29.214977] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-27T17:37:30.014996] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-27T17:37:30.146668] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T17:37:30.814917] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-27T17:37:31.165476] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:37:31.466706] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:37:31.614939] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-27T17:37:32.414926] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-27T17:37:32.971930] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:37:33.214935] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-27T17:37:33.827086] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T17:37:34.014930] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-27T17:37:34.626405] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T17:37:34.814904] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-27T17:37:35.192472] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T17:37:35.614954] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-27T17:37:36.215765] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:37:36.333893] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T17:37:36.414902] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-27T17:37:37.132630] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:37:37.214896] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-27T17:37:37.850431] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:37:38.014991] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-27T17:37:38.814957] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-27T17:37:39.497494] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T17:37:39.614954] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-27T17:37:40.414944] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-27T17:37:40.817298] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T17:37:41.214903] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-27T17:37:41.231686] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T17:37:41.234895] [INFO ] [REMOTE ] BLX: Full fetch complete (22366 records). [2025-10-27T17:37:41.234966] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-27T17:37:41.574048] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-27T17:37:41.629463] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-27T17:37:41.629545] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-27T17:37:41.630005] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-27T17:37:41.630068] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-27T17:37:41.630760] [DEBUG] [LOCAL ] BLX: Trimmed 22366 records to 14966 (keeping 200 days of data) [2025-10-27T17:37:41.727798] [DEBUG] [LOCAL ] BLX: Primary data saved (14966 records). [2025-10-27T17:37:41.727940] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-27T17:37:41.728020] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLX took 20.7s. Estimated remaining: 4h 17m 17s. Rate: 8.0 symbols/min [2025-10-27T17:37:41.920931] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:41.933076] [DEBUG] [LOCAL ] BME: Loaded 11345 existing records from primary storage. [2025-10-27T17:37:41.933330] [INFO ] [MAIN ] BME: Loaded 11345 existing records. [2025-10-27T17:37:42.023416] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-27T17:37:42.110485] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:42.110715] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-27T17:37:42.110781] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-27T17:37:42.110948] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-27T17:37:42.111002] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-27T17:37:42.480464] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:42.824933] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-27T17:37:42.827201] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:37:42.834713] [INFO ] [REMOTE ] BLK: Full fetch complete (52786 records). [2025-10-27T17:37:42.834844] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-27T17:37:43.232000] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-27T17:37:43.232142] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-27T17:37:43.232821] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-27T17:37:43.232903] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-27T17:37:43.234067] [DEBUG] [LOCAL ] BLK: Trimmed 52786 records to 33685 (keeping 200 days of data) [2025-10-27T17:37:43.365837] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T17:37:43.481907] [DEBUG] [LOCAL ] BLK: Primary data saved (33685 records). [2025-10-27T17:37:43.482023] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-27T17:37:43.482093] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLK took 49.3s. Estimated remaining: 4h 16m 31s. Rate: 8.0 symbols/min [2025-10-27T17:37:43.624763] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-27T17:37:43.650287] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:43.660735] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:37:43.686672] [DEBUG] [LOCAL ] BMEZ: Loaded 25339 existing records from primary storage. [2025-10-27T17:37:43.686927] [INFO ] [MAIN ] BMEZ: Loaded 25339 existing records. [2025-10-27T17:37:43.863875] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:43.864057] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-27T17:37:43.864102] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-27T17:37:43.864289] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-27T17:37:43.864343] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-27T17:37:44.210252] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:44.402714] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:37:44.414901] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-27T17:37:45.026184] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:37:45.214962] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-27T17:37:46.014939] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-27T17:37:46.352745] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:37:46.814920] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-27T17:37:47.250433] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:37:47.336456] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T17:37:47.614932] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-27T17:37:48.414950] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-27T17:37:48.723117] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:37:49.214973] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-27T17:37:49.515940] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:37:49.754181] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T17:37:50.015097] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-27T17:37:50.556406] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T17:37:50.814939] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-27T17:37:51.614970] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-27T17:37:51.628185] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:37:52.248007] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:37:52.415008] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-27T17:37:53.214979] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-27T17:37:53.824159] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T17:37:53.832815] [INFO ] [REMOTE ] BMA: Full fetch complete (52574 records). [2025-10-27T17:37:53.832992] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-27T17:37:54.020983] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-27T17:37:54.219454] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-27T17:37:54.219558] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-27T17:37:54.220312] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-27T17:37:54.220391] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-27T17:37:54.221674] [DEBUG] [LOCAL ] BMA: Trimmed 52574 records to 36661 (keeping 200 days of data) [2025-10-27T17:37:54.240758] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:37:54.466714] [DEBUG] [LOCAL ] BMA: Primary data saved (36661 records). [2025-10-27T17:37:54.466874] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-27T17:37:54.466956] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BMA took 31.7s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-27T17:37:54.634523] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:37:54.659702] [DEBUG] [LOCAL ] BMI: Loaded 25241 existing records from primary storage. [2025-10-27T17:37:54.659974] [INFO ] [MAIN ] BMI: Loaded 25241 existing records. [2025-10-27T17:37:54.816857] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-27T17:37:54.842406] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:37:54.842669] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-27T17:37:54.842732] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-27T17:37:54.843034] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-27T17:37:54.843075] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-27T17:37:55.004452] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:37:55.262448] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:37:55.614972] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-27T17:37:56.164381] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:37:56.414985] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-27T17:37:56.759743] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T17:37:57.214947] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-27T17:37:57.238149] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:37:58.014927] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-27T17:37:58.343089] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:37:58.507940] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T17:37:58.814957] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-27T17:37:59.614951] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-27T17:37:59.925847] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T17:38:00.415023] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-27T17:38:00.987841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:38:01.214960] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-27T17:38:02.015045] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-27T17:38:02.814989] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-27T17:38:03.340997] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-10-27T17:38:03.614982] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-27T17:38:04.067944] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T17:38:04.226628] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T17:38:04.231529] [INFO ] [REMOTE ] BLW: Full fetch complete (19150 records). [2025-10-27T17:38:04.231710] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-27T17:38:04.420157] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-27T17:38:04.595545] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-27T17:38:04.595620] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-27T17:38:04.595996] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-27T17:38:04.596049] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-27T17:38:04.596558] [DEBUG] [LOCAL ] BLW: Trimmed 19150 records to 12668 (keeping 200 days of data) [2025-10-27T17:38:04.672760] [DEBUG] [LOCAL ] BLW: Primary data saved (12668 records). [2025-10-27T17:38:04.672996] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-27T17:38:04.673093] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BLW took 43.8s. Estimated remaining: 4h 16m 58s. Rate: 8.0 symbols/min [2025-10-27T17:38:04.853052] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:04.862412] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T17:38:04.870989] [DEBUG] [LOCAL ] BMN: Loaded 2676 existing records from primary storage. [2025-10-27T17:38:04.871160] [INFO ] [MAIN ] BMN: Loaded 2676 existing records. [2025-10-27T17:38:05.041501] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:05.041731] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-27T17:38:05.041784] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-27T17:38:05.041910] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-27T17:38:05.041947] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-27T17:38:05.224113] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-27T17:38:05.388138] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:05.453264] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T17:38:05.610758] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:38:06.014949] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-27T17:38:06.663062] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:38:06.815011] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-27T17:38:07.186049] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T17:38:07.614942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-27T17:38:07.941113] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:38:08.395180] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:38:08.414908] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-27T17:38:09.214961] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-27T17:38:09.393916] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:38:10.014945] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-27T17:38:10.232618] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:38:10.235288] [INFO ] [REMOTE ] BME: Full fetch complete (15573 records). [2025-10-27T17:38:10.235356] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-27T17:38:10.593390] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-27T17:38:10.593461] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-27T17:38:10.593783] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-27T17:38:10.593844] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-27T17:38:10.594327] [DEBUG] [LOCAL ] BME: Trimmed 15573 records to 11046 (keeping 200 days of data) [2025-10-27T17:38:10.645007] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T17:38:10.664060] [DEBUG] [LOCAL ] BME: Primary data saved (11046 records). [2025-10-27T17:38:10.664149] [INFO ] [MAIN ] BME: Full history saved. [2025-10-27T17:38:10.664219] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BME took 28.9s. Estimated remaining: 4h 16m 41s. Rate: 8.0 symbols/min [2025-10-27T17:38:10.827460] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-27T17:38:10.830971] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:10.868912] [DEBUG] [LOCAL ] BMO: Loaded 41424 existing records from primary storage. [2025-10-27T17:38:10.869194] [INFO ] [MAIN ] BMO: Loaded 41424 existing records. [2025-10-27T17:38:11.049215] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:11.049428] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-27T17:38:11.049473] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-27T17:38:11.049773] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-27T17:38:11.049830] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-27T17:38:11.400162] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:11.614952] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-27T17:38:11.727288] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:38:12.414951] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-27T17:38:13.214959] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-27T17:38:13.342589] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T17:38:13.536057] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T17:38:13.672177] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T17:38:14.014925] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-27T17:38:14.814954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-27T17:38:15.345257] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T17:38:15.614965] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-27T17:38:15.965122] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T17:38:15.970393] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39067 records). [2025-10-27T17:38:15.970535] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-27T17:38:16.353137] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-27T17:38:16.353213] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-27T17:38:16.353755] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-27T17:38:16.353819] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-27T17:38:16.354676] [DEBUG] [LOCAL ] BMEZ: Trimmed 39067 records to 24659 (keeping 200 days of data) [2025-10-27T17:38:16.441159] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-27T17:38:16.503852] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24659 records). [2025-10-27T17:38:16.503987] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-27T17:38:16.504068] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMEZ took 33.0s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min [2025-10-27T17:38:16.672299] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:16.724800] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-27T17:38:16.725106] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-10-27T17:38:16.933701] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:16.934061] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T17:38:16.934285] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-27T17:38:16.934499] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-27T17:38:16.936283] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-27T17:38:16.936363] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-27T17:38:17.229107] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-27T17:38:17.249837] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:38:17.333888] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:17.637072] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T17:38:18.014942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-27T17:38:18.814998] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-27T17:38:19.017466] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:38:19.022910] [INFO ] [REMOTE ] BMI: Full fetch complete (34176 records). [2025-10-27T17:38:19.022994] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-27T17:38:19.304076] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T17:38:19.386831] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-27T17:38:19.386894] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-27T17:38:19.387337] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-27T17:38:19.387397] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-27T17:38:19.388124] [DEBUG] [LOCAL ] BMI: Trimmed 34176 records to 24626 (keeping 200 days of data) [2025-10-27T17:38:19.533430] [DEBUG] [LOCAL ] BMI: Primary data saved (24626 records). [2025-10-27T17:38:19.533552] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-27T17:38:19.533625] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 25.1s. Estimated remaining: 4h 15m 45s. Rate: 8.0 symbols/min [2025-10-27T17:38:19.620154] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-27T17:38:19.705169] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:19.752598] [DEBUG] [LOCAL ] BN: Loaded 53759 existing records from primary storage. [2025-10-27T17:38:19.752941] [INFO ] [MAIN ] BN: Loaded 53759 existing records. [2025-10-27T17:38:19.923856] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:19.924078] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-27T17:38:19.924134] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-27T17:38:19.924421] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-27T17:38:19.924476] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-27T17:38:20.266729] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:20.414919] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-27T17:38:20.855608] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:38:21.214981] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-27T17:38:21.881231] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T17:38:22.014973] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-27T17:38:22.814983] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-27T17:38:22.900609] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T17:38:23.270636] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T17:38:23.614960] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-27T17:38:24.351118] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-27T17:38:24.414962] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-27T17:38:24.756194] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T17:38:24.942833] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T17:38:25.214915] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-27T17:38:25.603310] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T17:38:26.014932] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-27T17:38:26.377905] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T17:38:26.814943] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-27T17:38:27.614930] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-27T17:38:28.044597] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:38:28.414979] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-27T17:38:28.521835] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:38:29.214926] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-27T17:38:29.804031] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:38:30.014917] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-27T17:38:30.233844] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:38:30.814939] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-27T17:38:31.323674] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T17:38:31.324763] [INFO ] [REMOTE ] BMN: Full fetch complete (3718 records). [2025-10-27T17:38:31.324831] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-27T17:38:31.620051] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-27T17:38:31.683167] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-27T17:38:31.683387] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-27T17:38:31.683600] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-27T17:38:31.683707] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-27T17:38:31.684087] [DEBUG] [LOCAL ] BMN: Trimmed 3718 records to 2612 (keeping 200 days of data) [2025-10-27T17:38:31.701253] [DEBUG] [LOCAL ] BMN: Primary data saved (2612 records). [2025-10-27T17:38:31.701331] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-27T17:38:31.701412] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 27.0s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-27T17:38:31.877802] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:31.903335] [DEBUG] [LOCAL ] BNED: Loaded 28526 existing records from primary storage. [2025-10-27T17:38:31.903584] [INFO ] [MAIN ] BNED: Loaded 28526 existing records. [2025-10-27T17:38:32.099079] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:32.112762] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-27T17:38:32.117943] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-27T17:38:32.131928] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-27T17:38:32.134822] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-27T17:38:32.200619] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T17:38:32.420755] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-27T17:38:32.503723] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:33.214945] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-27T17:38:34.014967] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-27T17:38:34.041833] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:38:34.132953] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-27T17:38:34.820330] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-27T17:38:34.822234] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T17:38:35.614968] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-27T17:38:35.661688] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T17:38:36.415004] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-27T17:38:36.675218] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:38:37.175944] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T17:38:37.214897] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-27T17:38:37.959721] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T17:38:38.014918] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-27T17:38:38.389842] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:38:38.397337] [INFO ] [REMOTE ] BMO: Full fetch complete (59745 records). [2025-10-27T17:38:38.397442] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-27T17:38:38.773119] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-27T17:38:38.773192] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-27T17:38:38.773858] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-27T17:38:38.773919] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-27T17:38:38.775062] [DEBUG] [LOCAL ] BMO: Trimmed 59745 records to 40521 (keeping 200 days of data) [2025-10-27T17:38:38.828404] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-27T17:38:39.020561] [DEBUG] [LOCAL ] BMO: Primary data saved (40521 records). [2025-10-27T17:38:39.020713] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-27T17:38:39.020798] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 28.4s. Estimated remaining: 4h 16m 1s. Rate: 8.0 symbols/min [2025-10-27T17:38:39.188507] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:39.194501] [DEBUG] [LOCAL ] BNH: Loaded 4742 existing records from primary storage. [2025-10-27T17:38:39.194693] [INFO ] [MAIN ] BNH: Loaded 4742 existing records. [2025-10-27T17:38:39.369478] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:39.369689] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-27T17:38:39.369746] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-27T17:38:39.369882] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-27T17:38:39.369920] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-27T17:38:39.617097] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-27T17:38:39.727304] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:39.870452] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T17:38:40.414946] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-27T17:38:40.511826] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:38:40.579783] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T17:38:41.214947] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-27T17:38:41.706356] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T17:38:42.014966] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-27T17:38:42.331109] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T17:38:42.417636] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T17:38:42.814969] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-27T17:38:43.614950] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-27T17:38:44.415011] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-27T17:38:44.732003] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T17:38:45.050110] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:38:45.214973] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-27T17:38:45.999622] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T17:38:46.014906] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-27T17:38:46.814916] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-27T17:38:47.169966] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T17:38:47.300673] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T17:38:47.614945] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-27T17:38:47.740426] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T17:38:48.027446] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T17:38:48.415011] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-27T17:38:49.214973] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-27T17:38:49.579898] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T17:38:49.772701] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T17:38:50.014964] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-27T17:38:50.814950] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-27T17:38:51.419457] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:38:51.614949] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-27T17:38:51.779540] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T17:38:52.335763] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T17:38:52.414963] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-27T17:38:53.214959] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-27T17:38:54.015025] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-27T17:38:54.156885] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:38:54.169285] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-27T17:38:54.169520] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-27T17:38:54.599868] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T17:38:54.645922] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:38:54.651719] [INFO ] [REMOTE ] BN: Full fetch complete (76951 records). [2025-10-27T17:38:54.674167] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-27T17:38:54.822262] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-27T17:38:54.816190] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-27T17:38:54.838380] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-27T17:38:54.844930] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-27T17:38:54.856426] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-27T17:38:54.917189] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-27T17:38:55.255472] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-27T17:38:55.257320] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-27T17:38:55.262457] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-27T17:38:55.265613] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T17:38:55.265686] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-27T17:38:55.286497] [DEBUG] [LOCAL ] BN: Trimmed 76951 records to 52973 (keeping 200 days of data) [2025-10-27T17:38:55.618292] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-27T17:38:55.726954] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-27T17:38:55.729757] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-27T17:38:55.733538] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BMY took 39.2s. Estimated remaining: 4h 16m 54s. Rate: 8.0 symbols/min [2025-10-27T17:38:55.981184] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:55.996278] [DEBUG] [LOCAL ] BN: Primary data saved (52973 records). [2025-10-27T17:38:55.996691] [INFO ] [MAIN ] BN: Full history saved. [2025-10-27T17:38:55.997109] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BN took 36.5s. Estimated remaining: 4h 15m 59s. Rate: 8.0 symbols/min [2025-10-27T17:38:56.082889] [DEBUG] [LOCAL ] BNJ: Loaded 2516 existing records from primary storage. [2025-10-27T17:38:56.104990] [INFO ] [MAIN ] BNJ: Loaded 2516 existing records. [2025-10-27T17:38:56.310340] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:56.334710] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:38:56.353875] [INFO ] [REMOTE ] BNH: Full fetch complete (6864 records). [2025-10-27T17:38:56.376078] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-27T17:38:56.381214] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:56.387417] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-27T17:38:56.393864] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-27T17:38:56.431743] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-27T17:38:56.426217] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-27T17:38:56.432057] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-27T17:38:56.735809] [DEBUG] [LOCAL ] BNL: Loaded 47664 existing records from primary storage. [2025-10-27T17:38:56.816475] [INFO ] [MAIN ] BNL: Loaded 47664 existing records. [2025-10-27T17:38:57.413978] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:57.419554] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:57.420021] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-27T17:38:57.420595] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-27T17:38:57.420224] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-27T17:38:57.420748] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-27T17:38:57.421721] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-27T17:38:57.422014] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-27T17:38:57.422059] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-27T17:38:57.423048] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-27T17:38:57.423261] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-27T17:38:57.423191] [DEBUG] [LOCAL ] BNH: Trimmed 6864 records to 4511 (keeping 200 days of data) [2025-10-27T17:38:57.562682] [DEBUG] [LOCAL ] BNH: Primary data saved (4511 records). [2025-10-27T17:38:57.568411] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-27T17:38:57.568543] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BNH took 18.5s. Estimated remaining: 4h 15m 13s. Rate: 8.0 symbols/min [2025-10-27T17:38:57.907349] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:38:58.017535] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:58.037923] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T17:38:58.045398] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-27T17:38:58.048763] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:38:58.091813] [DEBUG] [LOCAL ] BNS: Loaded 52124 existing records from primary storage. [2025-10-27T17:38:58.092130] [INFO ] [MAIN ] BNS: Loaded 52124 existing records. [2025-10-27T17:38:58.265631] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:38:58.265850] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-27T17:38:58.265897] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-27T17:38:58.266071] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-27T17:38:58.266108] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-27T17:38:58.555678] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T17:38:58.627297] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:38:58.814982] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-27T17:38:59.614941] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-27T17:39:00.323962] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:39:00.414914] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-27T17:39:01.214990] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-27T17:39:01.358195] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T17:39:02.014948] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-27T17:39:02.814986] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-27T17:39:03.314836] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T17:39:03.614971] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-27T17:39:04.049964] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (3.64 seconds). [2025-10-27T17:39:04.166345] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:39:04.276142] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T17:39:04.414906] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-27T17:39:04.929584] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (3.71 seconds). [2025-10-27T17:39:05.215039] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-27T17:39:05.610676] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:39:06.014973] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-27T17:39:06.420770] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T17:39:06.585868] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T17:39:06.814969] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-27T17:39:07.615000] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-27T17:39:08.203494] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T17:39:08.360677] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T17:39:08.414895] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-27T17:39:09.214945] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-27T17:39:09.524920] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:39:09.740530] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T17:39:10.015000] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-27T17:39:10.814961] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-27T17:39:10.882565] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T17:39:11.614945] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-27T17:39:12.120504] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:39:12.419992] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-27T17:39:12.428572] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:39:12.923184] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T17:39:13.214939] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-27T17:39:14.014996] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-27T17:39:14.513391] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:39:14.814955] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-27T17:39:15.125501] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-27T17:39:15.504880] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:39:15.614915] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-27T17:39:16.414962] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-27T17:39:17.049236] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T17:39:17.204668] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T17:39:17.208962] [INFO ] [REMOTE ] BNED: Full fetch complete (41504 records). [2025-10-27T17:39:17.209048] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-27T17:39:17.220199] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-27T17:39:17.590969] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-27T17:39:17.591044] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-27T17:39:17.591539] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-27T17:39:17.591578] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-27T17:39:17.592418] [DEBUG] [LOCAL ] BNED: Trimmed 41504 records to 27853 (keeping 200 days of data) [2025-10-27T17:39:17.745810] [DEBUG] [LOCAL ] BNED: Primary data saved (27853 records). [2025-10-27T17:39:17.745932] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-27T17:39:17.746027] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 46.0s. Estimated remaining: 4h 16m 29s. Rate: 8.0 symbols/min [2025-10-27T17:39:17.913823] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:17.920109] [DEBUG] [LOCAL ] BNT: Loaded 3567 existing records from primary storage. [2025-10-27T17:39:17.920278] [INFO ] [MAIN ] BNT: Loaded 3567 existing records. [2025-10-27T17:39:18.018285] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-27T17:39:18.098914] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:18.099108] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-27T17:39:18.099181] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-27T17:39:18.099301] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-27T17:39:18.099342] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-27T17:39:18.456209] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:18.629733] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T17:39:18.630820] [INFO ] [REMOTE ] BNJ: Full fetch complete (3866 records). [2025-10-27T17:39:18.630887] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-27T17:39:18.817327] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-27T17:39:18.833282] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T17:39:19.033063] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-27T17:39:19.033140] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-27T17:39:19.033272] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-27T17:39:19.033311] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-27T17:39:19.033668] [DEBUG] [LOCAL ] BNJ: Trimmed 3866 records to 2407 (keeping 200 days of data) [2025-10-27T17:39:19.047882] [DEBUG] [LOCAL ] BNJ: Primary data saved (2407 records). [2025-10-27T17:39:19.047941] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-27T17:39:19.048005] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 23.3s. Estimated remaining: 4h 15m 41s. Rate: 8.0 symbols/min [2025-10-27T17:39:19.225135] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:19.233898] [DEBUG] [LOCAL ] BNY: Loaded 7303 existing records from primary storage. [2025-10-27T17:39:19.234097] [INFO ] [MAIN ] BNY: Loaded 7303 existing records. [2025-10-27T17:39:19.410085] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:19.410263] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-27T17:39:19.410309] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-27T17:39:19.410484] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-27T17:39:19.410527] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-27T17:39:19.620087] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-27T17:39:19.767328] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:20.090194] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T17:39:20.414922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-27T17:39:20.730542] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T17:39:21.069284] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:39:21.214924] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-27T17:39:22.014939] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-27T17:39:22.814925] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-27T17:39:22.893576] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T17:39:23.298399] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T17:39:23.564434] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:39:23.614953] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-27T17:39:23.962137] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T17:39:24.414927] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-27T17:39:25.078089] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T17:39:25.214919] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-27T17:39:26.014979] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-27T17:39:26.696844] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T17:39:26.816971] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-27T17:39:26.820828] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T17:39:27.433732] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T17:39:27.615150] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-27T17:39:28.415001] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-27T17:39:28.831302] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T17:39:29.046491] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:39:29.214980] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-27T17:39:29.898808] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T17:39:30.014965] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-27T17:39:30.314940] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T17:39:30.814994] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-27T17:39:31.614914] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-27T17:39:31.826438] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:39:32.219055] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T17:39:32.414918] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-27T17:39:32.843493] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T17:39:33.214922] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-27T17:39:33.560926] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:39:34.014952] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-27T17:39:34.523422] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:39:34.814938] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-27T17:39:35.591066] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T17:39:35.614902] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-27T17:39:36.335162] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T17:39:36.414941] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-27T17:39:37.214943] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-27T17:39:37.736189] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:39:37.746345] [INFO ] [REMOTE ] BNL: Full fetch complete (67241 records). [2025-10-27T17:39:37.746556] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-27T17:39:38.020709] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-27T17:39:38.164519] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-27T17:39:38.164640] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-27T17:39:38.165713] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-27T17:39:38.165780] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-27T17:39:38.167753] [DEBUG] [LOCAL ] BNL: Trimmed 67241 records to 46837 (keeping 200 days of data) [2025-10-27T17:39:38.473637] [DEBUG] [LOCAL ] BNL: Primary data saved (46837 records). [2025-10-27T17:39:38.474130] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-27T17:39:38.474321] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNL took 42.5s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-10-27T17:39:38.597556] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:39:38.677244] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:38.701781] [DEBUG] [LOCAL ] BOC: Loaded 18411 existing records from primary storage. [2025-10-27T17:39:38.702198] [INFO ] [MAIN ] BOC: Loaded 18411 existing records. [2025-10-27T17:39:38.823897] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-27T17:39:38.944220] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:38.944548] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-27T17:39:38.944601] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-27T17:39:38.944897] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-27T17:39:38.944956] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-27T17:39:39.380109] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T17:39:39.404208] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:39.405247] [INFO ] [REMOTE ] BNS: Full fetch complete (74560 records). [2025-10-27T17:39:39.405446] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-27T17:39:39.537828] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T17:39:39.573172] [INFO ] [REMOTE ] BNY: Full fetch complete (10378 records). [2025-10-27T17:39:39.588503] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-27T17:39:39.625175] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-27T17:39:40.078510] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-27T17:39:40.090213] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-27T17:39:40.099457] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-27T17:39:40.102010] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-27T17:39:40.185231] [DEBUG] [LOCAL ] BNS: Trimmed 74560 records to 51296 (keeping 200 days of data) [2025-10-27T17:39:40.185480] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-27T17:39:40.185881] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-27T17:39:40.186082] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-27T17:39:40.186163] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-27T17:39:40.187797] [DEBUG] [LOCAL ] BNY: Trimmed 10378 records to 7109 (keeping 200 days of data) [2025-10-27T17:39:40.318768] [DEBUG] [LOCAL ] BNY: Primary data saved (7109 records). [2025-10-27T17:39:40.326695] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-27T17:39:40.329101] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNY took 21.3s. Estimated remaining: 4h 16m 7s. Rate: 8.0 symbols/min [2025-10-27T17:39:40.416544] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-27T17:39:40.563045] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:39:40.574769] [DEBUG] [LOCAL ] BNS: Primary data saved (51296 records). [2025-10-27T17:39:40.574896] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-27T17:39:40.574981] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNS took 43.0s. Estimated remaining: 4h 15m 12s. Rate: 8.0 symbols/min [2025-10-27T17:39:41.019303] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:39:41.214983] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-27T17:39:41.818048] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T17:39:42.014955] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-27T17:39:42.814940] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-27T17:39:42.845466] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:39:43.524843] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T17:39:43.527058] [INFO ] [REMOTE ] BNT: Full fetch complete (4847 records). [2025-10-27T17:39:43.527147] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-27T17:39:43.621695] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-27T17:39:43.906962] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-27T17:39:43.907034] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-27T17:39:43.907154] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-27T17:39:43.907215] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-27T17:39:43.907575] [DEBUG] [LOCAL ] BNT: Trimmed 4847 records to 3318 (keeping 200 days of data) [2025-10-27T17:39:43.926789] [DEBUG] [LOCAL ] BNT: Primary data saved (3318 records). [2025-10-27T17:39:43.926849] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-27T17:39:43.926912] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNT took 26.2s. Estimated remaining: 4h 14m 38s. Rate: 8.0 symbols/min [2025-10-27T17:39:44.371416] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:39:44.414923] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-27T17:39:45.510520] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T17:39:45.515705] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-27T17:39:46.113164] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T17:39:46.116868] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-27T17:39:46.980805] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T17:39:46.986897] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-27T17:39:47.644772] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:39:47.651847] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-27T17:39:48.638897] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T17:39:48.643844] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-27T17:39:49.252188] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T17:39:49.256460] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-27T17:39:50.350376] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:39:50.353993] [INFO ] [REMOTE ] BOC: Full fetch complete (25644 records). [2025-10-27T17:39:50.354119] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-27T17:39:50.354573] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:39:50.354683] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:39:50.354736] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:39:50.354801] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-27T17:39:50.354863] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-27T17:39:50.354899] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-10-27T17:39:50.355041] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-10-27T17:39:50.355128] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 11.9s. Estimated remaining: 4h 14m 24s. Rate: 8.0 symbols/min [2025-10-27T17:39:51.045526] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.101100] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.057339] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.102370] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:39:51.162409] [DEBUG] [LOCAL ] BOE: Loaded 18258 existing records from primary storage. [2025-10-27T17:39:51.163090] [DEBUG] [LOCAL ] BOND: Loaded 32905 existing records from primary storage. [2025-10-27T17:39:51.173025] [INFO ] [MAIN ] BOND: Loaded 32905 existing records. [2025-10-27T17:39:51.173598] [DEBUG] [LOCAL ] BOH: Loaded 31145 existing records from primary storage. [2025-10-27T17:39:51.184509] [INFO ] [MAIN ] BOH: Loaded 31145 existing records. [2025-10-27T17:39:51.218878] [INFO ] [MAIN ] BOE: Loaded 18258 existing records. [2025-10-27T17:39:51.353448] [DEBUG] [LOCAL ] BOOT: Loaded 39928 existing records from primary storage. [2025-10-27T17:39:51.435690] [INFO ] [MAIN ] BOOT: Loaded 39928 existing records. [2025-10-27T17:39:51.679287] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.843497] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.853977] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.862749] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:51.872080] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.872260] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-27T17:39:51.872449] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-27T17:39:51.878124] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-27T17:39:51.888804] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-27T17:39:51.883619] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-27T17:39:51.888952] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-27T17:39:51.899370] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-27T17:39:51.918139] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-27T17:39:51.918386] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-27T17:39:51.918223] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-27T17:39:52.038304] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:39:52.152431] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-27T17:39:52.253249] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-27T17:39:52.275900] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-27T17:39:52.417820] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-27T17:39:53.069721] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.089525] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.105621] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-27T17:39:53.129581] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-27T17:39:53.270464] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.313987] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-27T17:39:53.416710] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:39:53.416933] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-27T17:39:53.997804] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T17:39:54.002203] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-27T17:39:54.265583] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:39:54.273099] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-27T17:39:54.604142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:39:54.624991] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T17:39:54.646250] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T17:39:54.814907] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-27T17:39:55.066490] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T17:39:55.614964] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-27T17:39:55.864174] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T17:39:56.414985] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-27T17:39:56.893609] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T17:39:57.214932] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-27T17:39:57.764970] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T17:39:57.970116] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T17:39:58.014966] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-27T17:39:58.703000] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:39:58.814911] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-27T17:39:59.614922] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-27T17:40:00.264508] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T17:40:00.414982] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-27T17:40:01.129870] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T17:40:01.214904] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-27T17:40:02.014953] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-27T17:40:02.814998] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-27T17:40:03.206778] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T17:40:03.298607] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-27T17:40:03.614935] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-27T17:40:03.715515] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-27T17:40:04.414947] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-27T17:40:04.931430] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T17:40:05.214985] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-27T17:40:05.314934] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:40:05.658759] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:40:06.014946] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-27T17:40:06.688498] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:40:06.814978] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-27T17:40:07.188682] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:40:07.517900] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:40:07.614963] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-27T17:40:08.414941] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-27T17:40:08.987239] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:40:09.214947] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-27T17:40:09.827979] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T17:40:10.013288] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T17:40:10.018737] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-27T17:40:10.641477] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:40:10.814948] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-27T17:40:11.614941] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-27T17:40:11.693436] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:40:12.414950] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-27T17:40:12.915044] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:40:13.214981] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-27T17:40:13.448944] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T17:40:14.014940] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-27T17:40:14.386583] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:40:14.391150] [INFO ] [REMOTE ] BOE: Full fetch complete (26717 records). [2025-10-27T17:40:14.391280] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-27T17:40:14.773688] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-27T17:40:14.773783] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-27T17:40:14.774191] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-27T17:40:14.774253] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-27T17:40:14.774954] [DEBUG] [LOCAL ] BOE: Trimmed 26717 records to 17571 (keeping 200 days of data) [2025-10-27T17:40:14.820006] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-27T17:40:14.884994] [DEBUG] [LOCAL ] BOE: Primary data saved (17571 records). [2025-10-27T17:40:14.885158] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-27T17:40:14.885295] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOE took 24.5s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-10-27T17:40:15.060258] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:15.079373] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:40:15.128433] [DEBUG] [LOCAL ] BORR: Loaded 51836 existing records from primary storage. [2025-10-27T17:40:15.128752] [INFO ] [MAIN ] BORR: Loaded 51836 existing records. [2025-10-27T17:40:15.303326] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:15.303546] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-27T17:40:15.303601] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-27T17:40:15.303854] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-27T17:40:15.303922] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-27T17:40:15.623296] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-27T17:40:15.654500] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:16.303308] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:40:16.414940] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-27T17:40:16.857676] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T17:40:17.214992] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-27T17:40:18.014992] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-27T17:40:18.334684] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T17:40:18.341163] [INFO ] [REMOTE ] BOH: Full fetch complete (45513 records). [2025-10-27T17:40:18.341248] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-27T17:40:18.713745] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-27T17:40:18.713826] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-27T17:40:18.714426] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-27T17:40:18.714466] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-27T17:40:18.715385] [DEBUG] [LOCAL ] BOH: Trimmed 45513 records to 30475 (keeping 200 days of data) [2025-10-27T17:40:18.816708] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-27T17:40:18.917968] [DEBUG] [LOCAL ] BOH: Primary data saved (30475 records). [2025-10-27T17:40:18.918408] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-27T17:40:18.918619] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOH took 28.6s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-27T17:40:19.087154] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:19.109061] [DEBUG] [LOCAL ] BOW: Loaded 23072 existing records from primary storage. [2025-10-27T17:40:19.109313] [INFO ] [MAIN ] BOW: Loaded 23072 existing records. [2025-10-27T17:40:19.292809] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:19.293033] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-27T17:40:19.293083] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-27T17:40:19.293246] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-27T17:40:19.293285] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-27T17:40:19.655192] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:19.673186] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-27T17:40:19.675847] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:40:19.713525] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (3.30 seconds). [2025-10-27T17:40:20.414973] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-27T17:40:20.607773] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T17:40:20.624992] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T17:40:21.214934] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-27T17:40:21.453735] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:40:22.014970] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-27T17:40:22.072054] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:40:22.814997] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-27T17:40:23.614916] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-27T17:40:23.735574] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T17:40:23.821487] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T17:40:24.414940] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-27T17:40:24.694717] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T17:40:24.702335] [INFO ] [REMOTE ] BOND: Full fetch complete (46631 records). [2025-10-27T17:40:24.702443] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-27T17:40:25.139180] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-27T17:40:25.139253] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-27T17:40:25.139881] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-27T17:40:25.139945] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-27T17:40:25.141069] [DEBUG] [LOCAL ] BOND: Trimmed 46631 records to 32267 (keeping 200 days of data) [2025-10-27T17:40:25.232917] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-27T17:40:25.348890] [DEBUG] [LOCAL ] BOND: Primary data saved (32267 records). [2025-10-27T17:40:25.349058] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-27T17:40:25.349155] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOND took 35.0s. Estimated remaining: 4h 15m 22s. Rate: 8.0 symbols/min [2025-10-27T17:40:25.520265] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:25.571442] [DEBUG] [LOCAL ] BOX: Loaded 50788 existing records from primary storage. [2025-10-27T17:40:25.571802] [INFO ] [MAIN ] BOX: Loaded 50788 existing records. [2025-10-27T17:40:25.737566] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:40:25.782129] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:25.782548] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-27T17:40:25.782309] [INFO ] [REMOTE ] BOOT: Full fetch complete (59757 records). [2025-10-27T17:40:25.782754] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-27T17:40:25.782855] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-27T17:40:25.783140] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-27T17:40:25.783222] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-27T17:40:26.021076] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-27T17:40:26.489840] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:26.584372] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-27T17:40:26.584510] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-27T17:40:26.585297] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-27T17:40:26.585376] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-27T17:40:26.604284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T17:40:26.610893] [DEBUG] [LOCAL ] BOOT: Trimmed 59757 records to 39109 (keeping 200 days of data) [2025-10-27T17:40:26.815152] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-27T17:40:26.847418] [DEBUG] [LOCAL ] BOOT: Primary data saved (39109 records). [2025-10-27T17:40:26.847574] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-27T17:40:26.847681] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 36.5s. Estimated remaining: 4h 14m 36s. Rate: 8.0 symbols/min [2025-10-27T17:40:27.013800] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:27.061292] [DEBUG] [LOCAL ] BP: Loaded 54486 existing records from primary storage. [2025-10-27T17:40:27.061611] [INFO ] [MAIN ] BP: Loaded 54486 existing records. [2025-10-27T17:40:27.236294] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:27.236541] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-27T17:40:27.236586] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-27T17:40:27.236863] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-27T17:40:27.236920] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-27T17:40:27.611598] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:27.614901] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-27T17:40:27.673515] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:40:27.932226] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:40:28.415023] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-27T17:40:29.214934] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-27T17:40:29.352799] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:40:29.653475] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:40:30.014934] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-27T17:40:30.571321] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T17:40:30.814951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-27T17:40:31.527720] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:40:31.614897] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-27T17:40:32.414918] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-27T17:40:32.536911] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T17:40:33.214927] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-27T17:40:33.378268] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:40:33.573867] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T17:40:34.015021] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-27T17:40:34.088274] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T17:40:34.815018] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-27T17:40:35.299081] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:40:35.478144] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T17:40:35.614933] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-27T17:40:36.317454] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:40:36.414926] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-27T17:40:37.220168] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-27T17:40:37.222999] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T17:40:38.014971] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-27T17:40:38.814920] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-27T17:40:39.260370] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T17:40:39.395167] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:40:39.614949] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-27T17:40:40.213581] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T17:40:40.367347] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T17:40:40.414979] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-27T17:40:41.214946] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-27T17:40:41.901302] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T17:40:42.014955] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-27T17:40:42.815020] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-27T17:40:43.021164] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:40:43.174681] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T17:40:43.614966] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-27T17:40:44.414960] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-27T17:40:44.519815] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:40:44.525078] [INFO ] [REMOTE ] BOW: Full fetch complete (32109 records). [2025-10-27T17:40:44.525172] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-27T17:40:44.929317] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-27T17:40:44.929472] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-27T17:40:44.930038] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-27T17:40:44.930114] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-27T17:40:44.931124] [DEBUG] [LOCAL ] BOW: Trimmed 32109 records to 22536 (keeping 200 days of data) [2025-10-27T17:40:45.095006] [DEBUG] [LOCAL ] BOW: Primary data saved (22536 records). [2025-10-27T17:40:45.095938] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-27T17:40:45.098919] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOW took 26.2s. Estimated remaining: 4h 15m 37s. Rate: 8.0 symbols/min [2025-10-27T17:40:45.098748] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T17:40:45.220030] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-27T17:40:45.285074] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:45.318303] [DEBUG] [LOCAL ] BR: Loaded 35008 existing records from primary storage. [2025-10-27T17:40:45.318572] [INFO ] [MAIN ] BR: Loaded 35008 existing records. [2025-10-27T17:40:45.490934] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:45.491147] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-27T17:40:45.491193] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-27T17:40:45.491542] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-27T17:40:45.491598] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-27T17:40:45.859052] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:45.924085] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:40:46.014903] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-27T17:40:46.814953] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-27T17:40:47.326596] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T17:40:47.614965] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-27T17:40:47.844399] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T17:40:48.001918] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:40:48.414958] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-27T17:40:49.137579] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T17:40:49.214907] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-27T17:40:49.647873] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T17:40:50.014991] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-27T17:40:50.814914] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-27T17:40:51.323111] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T17:40:51.448253] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:40:51.614947] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-27T17:40:52.067118] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:40:52.414993] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-27T17:40:52.862259] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T17:40:53.214966] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-27T17:40:53.908546] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T17:40:53.918289] [INFO ] [REMOTE ] BOX: Full fetch complete (72303 records). [2025-10-27T17:40:53.918417] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-27T17:40:54.019253] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-27T17:40:54.313162] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-27T17:40:54.313249] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-27T17:40:54.314046] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-27T17:40:54.314109] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-27T17:40:54.315499] [DEBUG] [LOCAL ] BOX: Trimmed 72303 records to 49989 (keeping 200 days of data) [2025-10-27T17:40:54.598694] [DEBUG] [LOCAL ] BOX: Primary data saved (49989 records). [2025-10-27T17:40:54.598916] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-27T17:40:54.599019] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BOX took 29.2s. Estimated remaining: 4h 15m 41s. Rate: 8.0 symbols/min [2025-10-27T17:40:54.800422] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T17:40:54.802800] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:54.814898] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-27T17:40:54.861916] [DEBUG] [LOCAL ] BRBR: Loaded 52567 existing records from primary storage. [2025-10-27T17:40:54.862214] [INFO ] [MAIN ] BRBR: Loaded 52567 existing records. [2025-10-27T17:40:55.056626] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:55.056853] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-27T17:40:55.056900] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-27T17:40:55.057082] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-27T17:40:55.057120] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-27T17:40:55.409920] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:55.465209] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:40:55.614978] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-27T17:40:56.414957] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-27T17:40:56.697925] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:40:56.707971] [INFO ] [REMOTE ] BORR: Full fetch complete (74544 records). [2025-10-27T17:40:56.708163] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-27T17:40:57.104722] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-27T17:40:57.104839] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-27T17:40:57.105786] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-27T17:40:57.105968] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-27T17:40:57.107483] [DEBUG] [LOCAL ] BORR: Trimmed 74544 records to 51047 (keeping 200 days of data) [2025-10-27T17:40:57.219591] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-27T17:40:57.340040] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:40:57.434962] [DEBUG] [LOCAL ] BORR: Primary data saved (51047 records). [2025-10-27T17:40:57.435108] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-27T17:40:57.436310] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BORR took 42.6s. Estimated remaining: 4h 15m 5s. Rate: 8.0 symbols/min [2025-10-27T17:40:57.615413] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:40:57.633843] [DEBUG] [LOCAL ] BRC: Loaded 18498 existing records from primary storage. [2025-10-27T17:40:57.634081] [INFO ] [MAIN ] BRC: Loaded 18498 existing records. [2025-10-27T17:40:57.811509] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:40:57.811751] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-27T17:40:57.811804] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-27T17:40:57.811969] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-27T17:40:57.812008] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-27T17:40:58.025757] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-27T17:40:58.203076] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:40:58.231441] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T17:40:58.814931] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-27T17:40:58.992703] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:40:59.373334] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T17:40:59.615385] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-27T17:40:59.616075] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:41:00.414971] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-27T17:41:01.214967] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-27T17:41:02.014924] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-27T17:41:02.082179] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-27T17:41:02.814983] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-27T17:41:03.337534] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-27T17:41:03.614991] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-27T17:41:04.587948] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T17:41:04.594092] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-27T17:41:04.792183] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-27T17:41:05.214937] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-27T17:41:05.808417] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-27T17:41:06.014912] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-27T17:41:06.150267] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (5.74 seconds). [2025-10-27T17:41:06.166241] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-27T17:41:06.174136] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-27T17:41:06.174623] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:41:06.563584] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-27T17:41:06.563765] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-27T17:41:06.564597] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-27T17:41:06.564689] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-27T17:41:06.566115] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-10-27T17:41:06.843481] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-27T17:41:06.894956] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-10-27T17:41:06.895116] [INFO ] [MAIN ] BP: Full history saved. [2025-10-27T17:41:06.896038] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BP took 40.0s. Estimated remaining: 4h 15m 9s. Rate: 8.0 symbols/min [2025-10-27T17:41:07.037838] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:41:07.122171] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:07.147970] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T17:41:07.193929] [DEBUG] [LOCAL ] BRCC: Loaded 40534 existing records from primary storage. [2025-10-27T17:41:07.194204] [INFO ] [MAIN ] BRCC: Loaded 40534 existing records. [2025-10-27T17:41:07.368948] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:07.369219] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-27T17:41:07.369289] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-27T17:41:07.369538] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-27T17:41:07.369637] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-27T17:41:07.622675] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-27T17:41:07.731591] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:07.819870] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:41:08.414928] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-27T17:41:08.931621] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:41:08.938720] [INFO ] [REMOTE ] BR: Full fetch complete (49964 records). [2025-10-27T17:41:08.938868] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-27T17:41:09.218830] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-27T17:41:09.353041] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T17:41:09.355718] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-27T17:41:09.360072] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-27T17:41:09.361409] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-27T17:41:09.361844] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-27T17:41:09.362888] [DEBUG] [LOCAL ] BR: Trimmed 49964 records to 34300 (keeping 200 days of data) [2025-10-27T17:41:09.570222] [DEBUG] [LOCAL ] BR: Primary data saved (34300 records). [2025-10-27T17:41:09.570350] [INFO ] [MAIN ] BR: Full history saved. [2025-10-27T17:41:09.570424] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BR took 24.5s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-27T17:41:09.742039] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:09.742207] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-27T17:41:09.742243] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-27T17:41:09.742360] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-27T17:41:09.742400] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-27T17:41:09.742442] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-27T17:41:09.742508] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-27T17:41:10.022023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-27T17:41:10.111270] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:10.663956] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T17:41:10.814979] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-27T17:41:10.838388] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T17:41:11.614960] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-27T17:41:12.127080] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T17:41:12.239303] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T17:41:12.414938] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-27T17:41:13.214998] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-27T17:41:13.418181] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:13.418473] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-27T17:41:13.418561] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:13.418607] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-27T17:41:13.418690] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:13.418761] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-27T17:41:13.418822] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-27T17:41:13.418860] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-27T17:41:13.418900] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-27T17:41:13.418946] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRCE took 3.8s. Estimated remaining: 4h 14m 2s. Rate: 8.0 symbols/min [2025-10-27T17:41:13.592429] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:13.592588] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-27T17:41:13.592625] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-27T17:41:13.592761] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-27T17:41:13.592803] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-27T17:41:13.592843] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-27T17:41:13.592876] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-27T17:41:13.976814] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:14.007190] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:41:14.016798] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-27T17:41:14.814944] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-27T17:41:15.054171] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T17:41:15.614950] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-27T17:41:15.835269] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:15.835575] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-27T17:41:15.835685] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:15.835752] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-27T17:41:15.835820] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:15.835891] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-27T17:41:15.835956] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-27T17:41:15.835990] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-27T17:41:15.836028] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-27T17:41:15.836073] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRIE took 2.4s. Estimated remaining: 4h 13m 23s. Rate: 8.0 symbols/min [2025-10-27T17:41:16.008511] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:16.057493] [DEBUG] [LOCAL ] BRO: Loaded 52866 existing records from primary storage. [2025-10-27T17:41:16.057859] [INFO ] [MAIN ] BRO: Loaded 52866 existing records. [2025-10-27T17:41:16.235924] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:16.236202] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-27T17:41:16.236336] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-27T17:41:16.236530] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-27T17:41:16.236572] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-27T17:41:16.416298] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-27T17:41:16.643714] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:16.638403] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T17:41:17.215005] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-27T17:41:17.626077] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:41:18.014999] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-27T17:41:18.816413] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-27T17:41:18.819925] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:41:19.101847] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:41:19.614989] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-27T17:41:20.199609] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:41:20.414914] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-27T17:41:20.780272] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T17:41:20.783877] [INFO ] [REMOTE ] BRC: Full fetch complete (28229 records). [2025-10-27T17:41:20.783949] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-27T17:41:21.164860] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-27T17:41:21.164925] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-27T17:41:21.165401] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-27T17:41:21.165462] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-27T17:41:21.166301] [DEBUG] [LOCAL ] BRC: Trimmed 28229 records to 17909 (keeping 200 days of data) [2025-10-27T17:41:21.221188] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-27T17:41:21.277553] [DEBUG] [LOCAL ] BRC: Primary data saved (17909 records). [2025-10-27T17:41:21.277701] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-27T17:41:21.277789] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRC took 23.8s. Estimated remaining: 4h 13m 3s. Rate: 8.0 symbols/min [2025-10-27T17:41:21.452386] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:21.503168] [DEBUG] [LOCAL ] BROS: Loaded 54077 existing records from primary storage. [2025-10-27T17:41:21.503506] [INFO ] [MAIN ] BROS: Loaded 54077 existing records. [2025-10-27T17:41:21.686186] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:21.686493] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-27T17:41:21.686590] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-27T17:41:21.686881] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-27T17:41:21.686936] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-27T17:41:22.023130] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-27T17:41:22.092215] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:22.094343] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T17:41:22.814931] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-27T17:41:22.857086] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:41:23.263047] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:41:23.614940] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-27T17:41:24.414982] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-27T17:41:24.720494] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:41:25.214926] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-27T17:41:25.442229] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T17:41:25.916496] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:41:26.014951] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-27T17:41:26.814930] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-27T17:41:27.274747] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:41:27.555484] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:41:27.614924] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-27T17:41:28.417050] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-27T17:41:28.419730] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:41:28.983269] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T17:41:29.214933] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-27T17:41:30.014947] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-27T17:41:30.017460] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T17:41:30.814907] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-27T17:41:30.863814] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T17:41:31.173313] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T17:41:31.614994] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-27T17:41:32.267471] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:41:32.414927] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-27T17:41:33.215239] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-27T17:41:33.221406] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:41:33.916520] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T17:41:34.014916] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-27T17:41:34.814995] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-27T17:41:35.011070] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:41:35.021169] [INFO ] [REMOTE ] BRBR: Full fetch complete (73305 records). [2025-10-27T17:41:35.021307] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-27T17:41:35.410628] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-27T17:41:35.410744] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-27T17:41:35.411622] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-27T17:41:35.411698] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-27T17:41:35.413164] [DEBUG] [LOCAL ] BRBR: Trimmed 73305 records to 51815 (keeping 200 days of data) [2025-10-27T17:41:35.558320] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:41:35.621000] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-27T17:41:35.749077] [DEBUG] [LOCAL ] BRBR: Primary data saved (51815 records). [2025-10-27T17:41:35.749678] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-27T17:41:35.749822] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRBR took 41.2s. Estimated remaining: 4h 13m 39s. Rate: 8.0 symbols/min [2025-10-27T17:41:35.927007] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:35.927226] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-27T17:41:35.927279] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-27T17:41:35.927389] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-27T17:41:35.927448] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-27T17:41:35.927490] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-27T17:41:35.927522] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-27T17:41:36.309593] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:36.414913] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-27T17:41:36.518003] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:41:37.214980] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-27T17:41:37.502515] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T17:41:37.512836] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:41:37.513526] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-27T17:41:37.513617] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:41:37.513710] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-27T17:41:37.513815] [INFO ] [REMOTE ] BRCC: Full fetch complete (57311 records). [2025-10-27T17:41:37.513881] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:41:37.514082] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-27T17:41:37.514153] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-27T17:41:37.514455] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-27T17:41:37.514572] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-27T17:41:37.514680] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-27T17:41:37.545797] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRSL took 1.8s. Estimated remaining: 4h 12m 57s. Rate: 8.0 symbols/min [2025-10-27T17:41:38.013837] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-27T17:41:38.036043] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-27T17:41:38.011999] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:38.135787] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-27T17:41:38.135869] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-27T17:41:38.136488] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-27T17:41:38.140520] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-27T17:41:38.142074] [DEBUG] [LOCAL ] BRCC: Trimmed 57311 records to 39939 (keeping 200 days of data) [2025-10-27T17:41:38.271052] [DEBUG] [LOCAL ] BRSP: Loaded 36936 existing records from primary storage. [2025-10-27T17:41:38.273676] [INFO ] [MAIN ] BRSP: Loaded 36936 existing records. [2025-10-27T17:41:38.553270] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:38.570607] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-27T17:41:38.580011] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-27T17:41:38.579912] [DEBUG] [LOCAL ] BRCC: Primary data saved (39939 records). [2025-10-27T17:41:38.580192] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-27T17:41:38.580285] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRCC took 31.7s. Estimated remaining: 4h 12m 10s. Rate: 8.1 symbols/min [2025-10-27T17:41:38.580349] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-27T17:41:38.580440] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-27T17:41:38.819858] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-27T17:41:38.968690] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:39.098968] [DEBUG] [LOCAL ] BRT: Loaded 5335 existing records from primary storage. [2025-10-27T17:41:39.118805] [INFO ] [MAIN ] BRT: Loaded 5335 existing records. [2025-10-27T17:41:39.118668] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:39.319625] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:39.319836] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-27T17:41:39.320049] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-27T17:41:39.320266] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-27T17:41:39.320378] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-27T17:41:39.618238] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-27T17:41:39.686660] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:39.705804] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:41:40.414956] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-27T17:41:40.755368] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T17:41:41.169354] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T17:41:41.214928] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-27T17:41:41.872546] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T17:41:42.014924] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-27T17:41:42.722071] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:41:42.814949] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-27T17:41:43.338096] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:41:43.419005] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T17:41:43.615007] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-27T17:41:43.924157] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T17:41:44.414950] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-27T17:41:45.214984] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-27T17:41:45.920539] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T17:41:46.014996] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-27T17:41:46.814984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-27T17:41:47.183173] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T17:41:47.281029] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T17:41:47.290796] [INFO ] [REMOTE ] BRO: Full fetch complete (75153 records). [2025-10-27T17:41:47.290905] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-27T17:41:47.623769] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-27T17:41:47.670433] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-27T17:41:47.670494] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-27T17:41:47.671274] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-27T17:41:47.671336] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-27T17:41:47.672625] [DEBUG] [LOCAL ] BRO: Trimmed 75153 records to 52099 (keeping 200 days of data) [2025-10-27T17:41:48.012993] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:41:48.035081] [DEBUG] [LOCAL ] BRO: Primary data saved (52099 records). [2025-10-27T17:41:48.035228] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-27T17:41:48.035320] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRO took 32.2s. Estimated remaining: 4h 12m 15s. Rate: 8.0 symbols/min [2025-10-27T17:41:48.199461] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:48.219428] [DEBUG] [LOCAL ] BRW: Loaded 21283 existing records from primary storage. [2025-10-27T17:41:48.219685] [INFO ] [MAIN ] BRW: Loaded 21283 existing records. [2025-10-27T17:41:48.391148] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:48.391305] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-27T17:41:48.391350] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-27T17:41:48.391506] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-27T17:41:48.391543] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-27T17:41:48.421315] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-27T17:41:48.827266] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:48.869940] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T17:41:49.129825] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:41:49.214941] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-27T17:41:50.015002] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-27T17:41:50.451158] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:41:50.723463] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:41:50.814940] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-27T17:41:51.614947] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-27T17:41:52.176580] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:41:52.414984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-27T17:41:52.893542] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:41:52.976065] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T17:41:52.986087] [INFO ] [REMOTE ] BROS: Full fetch complete (77281 records). [2025-10-27T17:41:52.986197] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-27T17:41:53.220112] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-27T17:41:53.370894] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-27T17:41:53.370971] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-27T17:41:53.371769] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-27T17:41:53.371830] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-27T17:41:53.373206] [DEBUG] [LOCAL ] BROS: Trimmed 77281 records to 53298 (keeping 200 days of data) [2025-10-27T17:41:53.677392] [DEBUG] [LOCAL ] BROS: Primary data saved (53298 records). [2025-10-27T17:41:53.677519] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-27T17:41:53.678616] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BROS took 32.4s. Estimated remaining: 4h 11m 56s. Rate: 8.1 symbols/min [2025-10-27T17:41:53.846502] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:53.893971] [DEBUG] [LOCAL ] BRX: Loaded 52579 existing records from primary storage. [2025-10-27T17:41:53.894269] [INFO ] [MAIN ] BRX: Loaded 52579 existing records. [2025-10-27T17:41:54.020044] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-27T17:41:54.082732] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T17:41:54.082445] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:54.083012] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-27T17:41:54.085357] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-27T17:41:54.085747] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-27T17:41:54.085809] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-27T17:41:54.436083] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:54.814998] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-27T17:41:55.070814] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:41:55.614991] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-27T17:41:56.234846] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:41:56.279620] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T17:41:56.414970] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-27T17:41:57.214940] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-27T17:41:57.741006] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T17:41:57.742899] [INFO ] [REMOTE ] BRT: Full fetch complete (7143 records). [2025-10-27T17:41:57.742967] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-27T17:41:58.031919] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:41:58.020580] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-27T17:41:58.138473] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-27T17:41:58.138542] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-27T17:41:58.138738] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-27T17:41:58.138799] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-27T17:41:58.139177] [DEBUG] [LOCAL ] BRT: Trimmed 7143 records to 5162 (keeping 200 days of data) [2025-10-27T17:41:58.170584] [DEBUG] [LOCAL ] BRT: Primary data saved (5162 records). [2025-10-27T17:41:58.170709] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-27T17:41:58.170793] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRT took 19.6s. Estimated remaining: 4h 11m 31s. Rate: 8.1 symbols/min [2025-10-27T17:41:58.338570] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:41:58.371109] [DEBUG] [LOCAL ] BSAC: Loaded 33212 existing records from primary storage. [2025-10-27T17:41:58.371366] [INFO ] [MAIN ] BSAC: Loaded 33212 existing records. [2025-10-27T17:41:58.577722] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:41:58.577921] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-27T17:41:58.577969] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-27T17:41:58.578143] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-27T17:41:58.578183] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-27T17:41:58.820184] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-27T17:41:58.896558] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T17:41:58.976957] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:41:59.614992] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-27T17:41:59.915611] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:42:00.414931] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-27T17:42:01.214949] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-27T17:42:01.578393] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:42:02.015003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-27T17:42:02.815010] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-27T17:42:03.415286] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-10-27T17:42:03.615036] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-27T17:42:04.179550] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T17:42:04.196513] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T17:42:04.414954] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-27T17:42:04.761892] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (3.55 seconds). [2025-10-27T17:42:05.215084] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-27T17:42:05.278771] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:42:05.707808] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:42:06.015001] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-27T17:42:06.126952] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:42:06.814994] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-27T17:42:07.460471] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T17:42:07.614956] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-27T17:42:07.657613] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:42:08.414934] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-27T17:42:08.509964] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T17:42:09.214993] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-27T17:42:09.815154] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T17:42:10.014918] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-27T17:42:10.125467] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:42:10.814938] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-27T17:42:11.355049] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:42:11.614968] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-27T17:42:11.794859] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T17:42:12.415003] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-27T17:42:12.823038] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:42:13.214973] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-27T17:42:13.873428] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T17:42:14.014905] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-27T17:42:14.658586] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T17:42:14.665697] [INFO ] [REMOTE ] BRSP: Full fetch complete (53689 records). [2025-10-27T17:42:14.665869] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-27T17:42:14.666555] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:14.666671] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:14.666729] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:14.666795] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-27T17:42:14.666857] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-27T17:42:14.666892] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-27T17:42:14.667013] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-27T17:42:14.667086] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BRSP took 37.1s. Estimated remaining: 4h 12m 18s. Rate: 8.0 symbols/min [2025-10-27T17:42:14.814966] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-27T17:42:14.834598] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:14.865752] [DEBUG] [LOCAL ] BSBR: Loaded 36230 existing records from primary storage. [2025-10-27T17:42:14.866011] [INFO ] [MAIN ] BSBR: Loaded 36230 existing records. [2025-10-27T17:42:15.038213] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:15.038389] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-27T17:42:15.038435] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-27T17:42:15.038633] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-27T17:42:15.038716] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-27T17:42:15.390757] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:15.514585] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T17:42:15.614918] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-27T17:42:15.734006] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T17:42:16.414947] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-27T17:42:16.695345] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:42:17.214929] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-27T17:42:17.572006] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:42:18.014916] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-27T17:42:18.423485] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T17:42:18.814950] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-27T17:42:19.614923] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-27T17:42:19.687872] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T17:42:20.211413] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T17:42:20.315544] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:42:20.414977] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-27T17:42:21.214941] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-27T17:42:21.490158] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:42:21.910052] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:42:22.014929] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-27T17:42:22.814946] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-27T17:42:23.620042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-27T17:42:23.634250] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T17:42:23.645706] [INFO ] [REMOTE ] BRX: Full fetch complete (75159 records). [2025-10-27T17:42:23.645840] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-27T17:42:24.002025] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T17:42:24.035844] [INFO ] [REMOTE ] BRW: Full fetch complete (30161 records). [2025-10-27T17:42:24.062065] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-27T17:42:24.094337] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-27T17:42:24.137605] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-27T17:42:24.170947] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-27T17:42:24.187343] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-27T17:42:24.220236] [DEBUG] [LOCAL ] BRX: Trimmed 75159 records to 51796 (keeping 200 days of data) [2025-10-27T17:42:24.418726] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-27T17:42:24.623928] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-27T17:42:24.624064] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-27T17:42:24.626541] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-27T17:42:24.629098] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-27T17:42:24.632980] [DEBUG] [LOCAL ] BRW: Trimmed 30161 records to 20882 (keeping 200 days of data) [2025-10-27T17:42:24.866159] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:42:24.944926] [DEBUG] [LOCAL ] BRW: Primary data saved (20882 records). [2025-10-27T17:42:24.950739] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-27T17:42:24.956054] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 36.9s. Estimated remaining: 4h 12m 27s. Rate: 8.0 symbols/min [2025-10-27T17:42:25.038175] [DEBUG] [LOCAL ] BRX: Primary data saved (51796 records). [2025-10-27T17:42:25.050918] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-27T17:42:25.056818] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BRX took 31.4s. Estimated remaining: 4h 11m 36s. Rate: 8.0 symbols/min [2025-10-27T17:42:25.256098] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:25.229609] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-27T17:42:25.330499] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:25.335010] [DEBUG] [LOCAL ] BSL: Loaded 8034 existing records from primary storage. [2025-10-27T17:42:25.335269] [INFO ] [MAIN ] BSL: Loaded 8034 existing records. [2025-10-27T17:42:25.548871] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:25.549876] [DEBUG] [LOCAL ] BSM: Loaded 32602 existing records from primary storage. [2025-10-27T17:42:25.550130] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-27T17:42:25.550216] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-27T17:42:25.561773] [INFO ] [MAIN ] BSM: Loaded 32602 existing records. [2025-10-27T17:42:25.582557] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-27T17:42:25.591994] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-27T17:42:25.692368] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T17:42:25.898840] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:25.909299] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-27T17:42:25.921943] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-27T17:42:25.940954] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-27T17:42:25.957432] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-27T17:42:26.064015] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-27T17:42:26.311041] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:26.539744] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:42:26.572113] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:26.814958] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-27T17:42:27.017818] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:42:27.614934] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-27T17:42:27.835376] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T17:42:28.414934] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-27T17:42:28.647011] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:42:28.653789] [INFO ] [REMOTE ] BSAC: Full fetch complete (45368 records). [2025-10-27T17:42:28.653902] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-27T17:42:29.062106] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-27T17:42:29.062187] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-27T17:42:29.062861] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-27T17:42:29.062962] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-27T17:42:29.064209] [DEBUG] [LOCAL ] BSAC: Trimmed 45368 records to 32455 (keeping 200 days of data) [2025-10-27T17:42:29.218685] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-27T17:42:29.259360] [DEBUG] [LOCAL ] BSAC: Primary data saved (32455 records). [2025-10-27T17:42:29.259466] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-27T17:42:29.259562] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSAC took 31.1s. Estimated remaining: 4h 11m 9s. Rate: 8.1 symbols/min [2025-10-27T17:42:29.438959] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:29.458235] [DEBUG] [LOCAL ] BST: Loaded 18604 existing records from primary storage. [2025-10-27T17:42:29.458501] [INFO ] [MAIN ] BST: Loaded 18604 existing records. [2025-10-27T17:42:29.636257] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:29.636429] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-27T17:42:29.636606] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-27T17:42:29.636825] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-27T17:42:29.636875] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-27T17:42:29.960064] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:42:30.020121] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-27T17:42:30.024303] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:30.692628] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T17:42:30.814941] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-27T17:42:30.886457] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:42:31.310090] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:42:31.614971] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-27T17:42:32.414911] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-27T17:42:32.767710] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:42:33.214952] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-27T17:42:33.499974] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:42:34.015000] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-27T17:42:34.084525] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T17:42:34.814957] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-27T17:42:35.127998] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:42:35.334748] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T17:42:35.614982] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-27T17:42:36.414961] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-27T17:42:36.904816] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T17:42:37.183496] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T17:42:37.214940] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-27T17:42:38.014973] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-27T17:42:38.155461] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:42:38.535913] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T17:42:38.814951] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-27T17:42:39.614965] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-27T17:42:40.050168] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T17:42:40.411913] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T17:42:40.419559] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-27T17:42:41.214969] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-27T17:42:41.563036] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:42:41.987105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T17:42:42.014926] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-27T17:42:42.814967] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-27T17:42:42.995850] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:42:43.002298] [INFO ] [REMOTE ] BSBR: Full fetch complete (50629 records). [2025-10-27T17:42:43.002418] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-27T17:42:43.003095] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:43.003188] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:43.003230] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:43.003312] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-27T17:42:43.003394] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-27T17:42:43.003443] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-10-27T17:42:43.003788] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-10-27T17:42:43.003897] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BSBR took 28.3s. Estimated remaining: 4h 11m 39s. Rate: 8.0 symbols/min [2025-10-27T17:42:43.181345] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:43.203917] [DEBUG] [LOCAL ] BSTZ: Loaded 24689 existing records from primary storage. [2025-10-27T17:42:43.204204] [INFO ] [MAIN ] BSTZ: Loaded 24689 existing records. [2025-10-27T17:42:43.388908] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:43.389097] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-27T17:42:43.389144] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-27T17:42:43.389327] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-27T17:42:43.389390] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-27T17:42:43.624820] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-27T17:42:43.749051] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:43.850496] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T17:42:44.295664] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T17:42:44.414951] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-27T17:42:45.208773] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T17:42:45.214895] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-27T17:42:46.014926] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-27T17:42:46.191792] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T17:42:46.814933] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-27T17:42:46.825082] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:42:47.615060] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-27T17:42:48.282541] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T17:42:48.343901] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:42:48.346277] [INFO ] [REMOTE ] BSL: Full fetch complete (12907 records). [2025-10-27T17:42:48.346345] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-27T17:42:48.346780] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:42:48.346862] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:42:48.346903] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:42:48.346967] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-27T17:42:48.347028] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-27T17:42:48.347062] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-27T17:42:48.347217] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-27T17:42:48.347318] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSL took 23.4s. Estimated remaining: 4h 11m 19s. Rate: 8.0 symbols/min [2025-10-27T17:42:48.420111] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-27T17:42:48.514833] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:48.564387] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-27T17:42:48.564711] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-10-27T17:42:48.740244] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:48.740423] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-27T17:42:48.740466] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-27T17:42:48.740665] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-27T17:42:48.740722] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-27T17:42:49.089134] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:49.214926] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-27T17:42:49.801274] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T17:42:50.014944] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-27T17:42:50.814923] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-27T17:42:50.947939] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T17:42:51.010192] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T17:42:51.519526] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T17:42:51.615020] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-27T17:42:52.414928] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-27T17:42:52.712875] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:42:53.214941] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-27T17:42:53.650844] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:42:54.014954] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-27T17:42:54.163447] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:42:54.689988] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T17:42:54.814974] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-27T17:42:55.614955] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-27T17:42:55.973289] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T17:42:56.375152] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:42:56.414955] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-27T17:42:57.142034] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:42:57.146099] [INFO ] [REMOTE ] BST: Full fetch complete (28237 records). [2025-10-27T17:42:57.146208] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-27T17:42:57.220036] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-27T17:42:57.531948] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-27T17:42:57.532023] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-27T17:42:57.532410] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-27T17:42:57.532448] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-27T17:42:57.533182] [DEBUG] [LOCAL ] BST: Trimmed 28237 records to 17979 (keeping 200 days of data) [2025-10-27T17:42:57.638195] [DEBUG] [LOCAL ] BST: Primary data saved (17979 records). [2025-10-27T17:42:57.638322] [INFO ] [MAIN ] BST: Full history saved. [2025-10-27T17:42:57.638397] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 28.4s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-10-27T17:42:57.809565] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:42:57.816261] [DEBUG] [LOCAL ] BTA: Loaded 5808 existing records from primary storage. [2025-10-27T17:42:57.816441] [INFO ] [MAIN ] BTA: Loaded 5808 existing records. [2025-10-27T17:42:57.988481] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:42:57.988728] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-27T17:42:57.988781] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-27T17:42:57.988909] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-27T17:42:57.988945] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-27T17:42:58.020122] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-27T17:42:58.347679] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:42:58.366392] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:42:58.814955] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-27T17:42:59.208834] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:42:59.521474] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:42:59.614917] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-27T17:43:00.415001] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-27T17:43:01.214942] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-27T17:43:01.979302] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-27T17:43:02.014958] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-27T17:43:02.356829] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-27T17:43:02.814941] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-27T17:43:03.615009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-27T17:43:04.410009] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T17:43:04.414887] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-27T17:43:04.632892] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-27T17:43:04.757558] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-27T17:43:05.096329] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T17:43:05.214925] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-27T17:43:05.371823] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T17:43:06.014941] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-27T17:43:06.259220] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:43:06.265502] [INFO ] [REMOTE ] BSM: Full fetch complete (46365 records). [2025-10-27T17:43:06.265637] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-27T17:43:06.266359] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:43:06.266444] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:43:06.266486] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:43:06.266548] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-27T17:43:06.266611] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-27T17:43:06.266670] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-27T17:43:06.266845] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-27T17:43:06.266932] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BSM took 41.2s. Estimated remaining: 4h 11m 22s. Rate: 8.0 symbols/min [2025-10-27T17:43:06.431782] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:06.480878] [DEBUG] [LOCAL ] BTE: Loaded 53462 existing records from primary storage. [2025-10-27T17:43:06.481185] [INFO ] [MAIN ] BTE: Loaded 53462 existing records. [2025-10-27T17:43:06.652903] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:06.653099] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-27T17:43:06.653145] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-27T17:43:06.653309] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-27T17:43:06.653346] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-27T17:43:06.822405] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-27T17:43:07.005548] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:07.371840] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:43:07.594728] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:43:07.614915] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-27T17:43:08.415012] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-27T17:43:08.864172] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:43:09.214935] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-27T17:43:09.672555] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T17:43:09.720219] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T17:43:10.014966] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-27T17:43:10.424926] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T17:43:10.814991] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-27T17:43:11.614946] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-27T17:43:12.325590] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:43:12.326952] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:43:12.414918] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-27T17:43:13.214937] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-27T17:43:13.902026] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:43:13.941738] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T17:43:14.014906] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-27T17:43:14.814963] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-27T17:43:15.095698] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T17:43:15.614987] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-27T17:43:16.389972] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T17:43:16.392536] [INFO ] [REMOTE ] BTA: Full fetch complete (9065 records). [2025-10-27T17:43:16.392672] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-27T17:43:16.416615] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-27T17:43:16.557202] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:43:16.810897] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-27T17:43:16.810968] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-27T17:43:16.811192] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-27T17:43:16.811231] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-27T17:43:16.811634] [DEBUG] [LOCAL ] BTA: Trimmed 9065 records to 5673 (keeping 200 days of data) [2025-10-27T17:43:16.843773] [DEBUG] [LOCAL ] BTA: Primary data saved (5673 records). [2025-10-27T17:43:16.843879] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-27T17:43:16.843970] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BTA took 19.2s. Estimated remaining: 4h 11m 32s. Rate: 8.0 symbols/min [2025-10-27T17:43:17.014051] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:17.063612] [DEBUG] [LOCAL ] BTI: Loaded 54367 existing records from primary storage. [2025-10-27T17:43:17.063922] [INFO ] [MAIN ] BTI: Loaded 54367 existing records. [2025-10-27T17:43:17.238901] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-27T17:43:17.244383] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:17.245282] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-27T17:43:17.245353] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-27T17:43:17.245574] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-27T17:43:17.245629] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-27T17:43:17.617951] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:17.764780] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:43:17.769703] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36236 records). [2025-10-27T17:43:17.769823] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-27T17:43:18.024040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-27T17:43:18.150404] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-27T17:43:18.150477] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-27T17:43:18.150980] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-27T17:43:18.151053] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-27T17:43:18.151817] [DEBUG] [LOCAL ] BSTZ: Trimmed 36236 records to 24166 (keeping 200 days of data) [2025-10-27T17:43:18.294087] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24166 records). [2025-10-27T17:43:18.294203] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-27T17:43:18.294288] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BSTZ took 35.3s. Estimated remaining: 4h 10m 50s. Rate: 8.0 symbols/min [2025-10-27T17:43:18.463155] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:18.472426] [DEBUG] [LOCAL ] BTO: Loaded 8816 existing records from primary storage. [2025-10-27T17:43:18.472616] [INFO ] [MAIN ] BTO: Loaded 8816 existing records. [2025-10-27T17:43:18.646063] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:18.646256] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-27T17:43:18.646337] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-27T17:43:18.646586] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-27T17:43:18.646684] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-27T17:43:18.820869] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-27T17:43:19.029151] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:19.090100] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:43:19.620072] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-27T17:43:19.635690] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T17:43:20.243956] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T17:43:20.414936] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-27T17:43:20.909670] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T17:43:21.141482] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:43:21.214933] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-27T17:43:21.966115] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:43:22.014899] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-27T17:43:22.814930] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-27T17:43:23.223476] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T17:43:23.573343] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T17:43:23.614917] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-27T17:43:24.392728] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:43:24.414909] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-27T17:43:25.214983] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-27T17:43:26.015546] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-27T17:43:26.066426] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:43:26.095780] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:43:26.814963] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-27T17:43:27.404545] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:43:27.614905] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-27T17:43:28.414913] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-27T17:43:28.585397] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T17:43:28.884687] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T17:43:28.921116] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:43:29.214915] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-27T17:43:30.014955] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-27T17:43:30.791815] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:43:30.814928] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-27T17:43:31.614938] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-27T17:43:31.819877] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:43:31.924916] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:43:32.414949] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-27T17:43:33.214922] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-27T17:43:33.325461] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T17:43:34.014919] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-27T17:43:34.222694] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:43:34.232781] [INFO ] [REMOTE ] BTE: Full fetch complete (76354 records). [2025-10-27T17:43:34.232923] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-27T17:43:34.623768] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-27T17:43:34.623863] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-27T17:43:34.624689] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-27T17:43:34.624833] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-27T17:43:34.626315] [DEBUG] [LOCAL ] BTE: Trimmed 76354 records to 52671 (keeping 200 days of data) [2025-10-27T17:43:34.833620] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-27T17:43:34.956550] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:43:34.975490] [DEBUG] [LOCAL ] BTE: Primary data saved (52671 records). [2025-10-27T17:43:34.975606] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-27T17:43:34.977295] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTE took 28.7s. Estimated remaining: 4h 11m 36s. Rate: 8.0 symbols/min [2025-10-27T17:43:35.148978] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:35.166213] [DEBUG] [LOCAL ] BTT: Loaded 15596 existing records from primary storage. [2025-10-27T17:43:35.166450] [INFO ] [MAIN ] BTT: Loaded 15596 existing records. [2025-10-27T17:43:35.339734] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:35.339943] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-27T17:43:35.340003] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-27T17:43:35.340156] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-27T17:43:35.340205] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-27T17:43:35.616587] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-27T17:43:35.705108] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:35.707725] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T17:43:35.785096] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:43:36.414909] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-27T17:43:37.214906] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-27T17:43:37.261586] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T17:43:37.529901] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T17:43:38.014949] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-27T17:43:38.821857] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-27T17:43:38.827389] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:43:39.340779] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T17:43:39.392212] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:43:39.614934] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-27T17:43:40.036944] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:43:40.414942] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-27T17:43:41.214998] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-27T17:43:42.014925] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-27T17:43:42.087241] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:43:42.089633] [INFO ] [REMOTE ] BTO: Full fetch complete (13268 records). [2025-10-27T17:43:42.089730] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-27T17:43:42.457616] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-27T17:43:42.457752] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-27T17:43:42.458272] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-27T17:43:42.458355] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-27T17:43:42.459115] [DEBUG] [LOCAL ] BTO: Trimmed 13268 records to 8609 (keeping 200 days of data) [2025-10-27T17:43:42.513660] [DEBUG] [LOCAL ] BTO: Primary data saved (8609 records). [2025-10-27T17:43:42.513896] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-27T17:43:42.514050] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTO took 24.2s. Estimated remaining: 4h 11m 29s. Rate: 8.0 symbols/min [2025-10-27T17:43:42.719572] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T17:43:42.717084] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:42.741945] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:43:42.792254] [DEBUG] [LOCAL ] BTU: Loaded 54106 existing records from primary storage. [2025-10-27T17:43:42.792546] [INFO ] [MAIN ] BTU: Loaded 54106 existing records. [2025-10-27T17:43:42.821109] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-27T17:43:42.972040] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:42.972259] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-27T17:43:42.972314] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-27T17:43:42.972581] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-27T17:43:42.972631] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-27T17:43:43.331770] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:43.614983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-27T17:43:44.414977] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-27T17:43:44.678772] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T17:43:45.214963] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-27T17:43:45.467057] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T17:43:45.520180] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T17:43:46.014938] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-27T17:43:46.814965] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-27T17:43:47.120158] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:43:47.620440] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-27T17:43:47.641851] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T17:43:47.681380] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T17:43:47.691823] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-27T17:43:47.691951] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-27T17:43:48.111807] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-27T17:43:48.111886] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-27T17:43:48.112758] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-27T17:43:48.112822] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-27T17:43:48.114234] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-27T17:43:48.417185] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-27T17:43:48.432729] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-27T17:43:48.432841] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-27T17:43:48.432937] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BSX took 1m 0s. Estimated remaining: 4h 11m 12s. Rate: 8.0 symbols/min [2025-10-27T17:43:48.609986] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:48.610162] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-27T17:43:48.610217] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-27T17:43:48.610329] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-27T17:43:48.610371] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-27T17:43:48.610414] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-27T17:43:48.610447] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-27T17:43:48.971501] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:49.220067] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-27T17:43:49.233147] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T17:43:50.014951] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-27T17:43:50.296150] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:43:50.662296] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-27T17:43:50.672682] [INFO ] [REMOTE ] BTI: Full fetch complete (77658 records). [2025-10-27T17:43:50.672839] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-27T17:43:50.820162] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-27T17:43:51.065907] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-27T17:43:51.065998] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-27T17:43:51.066838] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-27T17:43:51.066905] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-27T17:43:51.068479] [DEBUG] [LOCAL ] BTI: Trimmed 77658 records to 53583 (keeping 200 days of data) [2025-10-27T17:43:51.393710] [DEBUG] [LOCAL ] BTI: Primary data saved (53583 records). [2025-10-27T17:43:51.393880] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-27T17:43:51.394771] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTI took 34.6s. Estimated remaining: 4h 10m 39s. Rate: 8.0 symbols/min [2025-10-27T17:43:51.584472] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:51.608081] [DEBUG] [LOCAL ] BTZ: Loaded 22639 existing records from primary storage. [2025-10-27T17:43:51.608321] [INFO ] [MAIN ] BTZ: Loaded 22639 existing records. [2025-10-27T17:43:51.628687] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-27T17:43:51.820247] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T17:43:51.823833] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:51.845970] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-27T17:43:51.846420] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-27T17:43:51.845871] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T17:43:51.850096] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-27T17:43:51.850242] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-27T17:43:51.914121] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:43:51.930773] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-27T17:43:51.952675] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:43:51.954880] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-27T17:43:51.954977] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:43:51.955102] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-27T17:43:51.960911] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-27T17:43:51.966123] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-27T17:43:51.971370] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-27T17:43:51.995152] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTX took 3.6s. Estimated remaining: 4h 9m 52s. Rate: 8.1 symbols/min [2025-10-27T17:43:52.398131] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:43:52.418161] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-27T17:43:52.418088] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:52.469770] [DEBUG] [LOCAL ] BUD: Loaded 53363 existing records from primary storage. [2025-10-27T17:43:52.470138] [INFO ] [MAIN ] BUD: Loaded 53363 existing records. [2025-10-27T17:43:52.658089] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:43:52.658332] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-27T17:43:52.658399] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-27T17:43:52.658742] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-27T17:43:52.658802] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-27T17:43:53.012563] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:43:53.214935] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-27T17:43:53.906942] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T17:43:54.014916] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-27T17:43:54.132322] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T17:43:54.814921] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-27T17:43:54.997177] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:43:55.614973] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-27T17:43:56.414932] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-27T17:43:56.427611] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:43:56.749537] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:43:57.214935] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-27T17:43:57.259924] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:43:58.014998] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-27T17:43:58.814984] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-27T17:43:58.905217] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T17:43:59.373110] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T17:43:59.375927] [INFO ] [REMOTE ] BTT: Full fetch complete (22493 records). [2025-10-27T17:43:59.375999] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-27T17:43:59.577737] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:43:59.617561] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-27T17:43:59.791553] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-27T17:43:59.791627] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-27T17:43:59.792021] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-27T17:43:59.792071] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-27T17:43:59.792750] [DEBUG] [LOCAL ] BTT: Trimmed 22493 records to 15124 (keeping 200 days of data) [2025-10-27T17:43:59.882177] [DEBUG] [LOCAL ] BTT: Primary data saved (15124 records). [2025-10-27T17:43:59.882310] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-27T17:43:59.882389] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTT took 24.9s. Estimated remaining: 4h 9m 47s. Rate: 8.1 symbols/min [2025-10-27T17:44:00.046281] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:00.058083] [DEBUG] [LOCAL ] BUI: Loaded 11930 existing records from primary storage. [2025-10-27T17:44:00.058376] [INFO ] [MAIN ] BUI: Loaded 11930 existing records. [2025-10-27T17:44:00.231708] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:00.232005] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-27T17:44:00.232057] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-27T17:44:00.232212] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-27T17:44:00.232249] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-27T17:44:00.420245] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-27T17:44:00.622614] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:01.214931] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-27T17:44:01.998098] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T17:44:02.015182] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-27T17:44:02.814975] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-27T17:44:04.038609] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-27T17:44:04.041475] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-27T17:44:04.615831] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T17:44:04.620734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-27T17:44:04.797007] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (4.38 seconds). [2025-10-27T17:44:04.978960] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:44:05.052882] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-27T17:44:05.214944] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-27T17:44:06.015003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-27T17:44:06.329948] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T17:44:06.650621] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:44:06.814985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-27T17:44:07.326629] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T17:44:07.469474] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T17:44:07.614942] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-27T17:44:08.414943] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-27T17:44:08.886850] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T17:44:09.120621] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T17:44:09.214934] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-27T17:44:10.014922] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-27T17:44:10.322478] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T17:44:10.814990] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-27T17:44:11.614924] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-27T17:44:11.937716] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:44:11.962523] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T17:44:12.414992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-27T17:44:12.923035] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T17:44:13.037080] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T17:44:13.214945] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-27T17:44:14.014998] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-27T17:44:14.814966] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-27T17:44:14.881391] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T17:44:15.614960] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-27T17:44:15.852357] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T17:44:16.290903] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T17:44:16.301755] [INFO ] [REMOTE ] BTU: Full fetch complete (77303 records). [2025-10-27T17:44:16.301907] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-27T17:44:16.420040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-27T17:44:16.711578] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-27T17:44:16.711674] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-27T17:44:16.712499] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-27T17:44:16.712561] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-27T17:44:16.714159] [DEBUG] [LOCAL ] BTU: Trimmed 77303 records to 53318 (keeping 200 days of data) [2025-10-27T17:44:17.025960] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-27T17:44:17.026089] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-27T17:44:17.026165] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTU took 34.5s. Estimated remaining: 4h 10m 35s. Rate: 8.0 symbols/min [2025-10-27T17:44:17.197034] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:17.222794] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-27T17:44:17.248335] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T17:44:17.290945] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:44:17.296783] [DEBUG] [LOCAL ] BUR: Loaded 46177 existing records from primary storage. [2025-10-27T17:44:17.297616] [INFO ] [MAIN ] BUR: Loaded 46177 existing records. [2025-10-27T17:44:17.470090] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:17.470326] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-27T17:44:17.470392] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-27T17:44:17.470622] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-27T17:44:17.470730] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-27T17:44:17.818927] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:17.899272] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T17:44:18.014953] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-27T17:44:18.765742] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:44:18.814923] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-27T17:44:19.614967] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-27T17:44:19.770121] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T17:44:20.414990] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-27T17:44:21.099112] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:44:21.214952] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-27T17:44:21.980514] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T17:44:22.014940] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-27T17:44:22.197630] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:44:22.814975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-27T17:44:23.614916] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-27T17:44:23.915882] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T17:44:24.099446] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T17:44:24.211632] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T17:44:24.214446] [INFO ] [REMOTE ] BUI: Full fetch complete (16479 records). [2025-10-27T17:44:24.214548] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-27T17:44:24.420080] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-27T17:44:24.629768] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-27T17:44:24.629923] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-27T17:44:24.630444] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-27T17:44:24.630490] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-27T17:44:24.631253] [DEBUG] [LOCAL ] BUI: Trimmed 16479 records to 11639 (keeping 200 days of data) [2025-10-27T17:44:24.712083] [DEBUG] [LOCAL ] BUI: Primary data saved (11639 records). [2025-10-27T17:44:24.712294] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-27T17:44:24.712405] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BUI took 24.8s. Estimated remaining: 4h 10m 28s. Rate: 8.0 symbols/min [2025-10-27T17:44:24.889756] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:24.938628] [DEBUG] [LOCAL ] BURL: Loaded 45994 existing records from primary storage. [2025-10-27T17:44:24.939095] [INFO ] [MAIN ] BURL: Loaded 45994 existing records. [2025-10-27T17:44:25.120197] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:25.120389] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-27T17:44:25.120438] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-27T17:44:25.121028] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-27T17:44:25.121304] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-27T17:44:25.223345] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-27T17:44:25.504036] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:25.566232] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:44:26.014332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T17:44:26.019793] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-27T17:44:26.814952] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-27T17:44:27.343701] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:44:27.353778] [INFO ] [REMOTE ] BUD: Full fetch complete (76483 records). [2025-10-27T17:44:27.353911] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-27T17:44:27.620092] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-27T17:44:27.742351] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-27T17:44:27.742438] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-27T17:44:27.743327] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-27T17:44:27.743390] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-27T17:44:27.744873] [DEBUG] [LOCAL ] BUD: Trimmed 76483 records to 52580 (keeping 200 days of data) [2025-10-27T17:44:27.962288] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:44:28.064000] [DEBUG] [LOCAL ] BUD: Primary data saved (52580 records). [2025-10-27T17:44:28.064131] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-27T17:44:28.064207] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUD took 36.1s. Estimated remaining: 4h 9m 58s. Rate: 8.0 symbols/min [2025-10-27T17:44:28.414915] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-27T17:44:29.214977] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-27T17:44:29.290390] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:44:29.341494] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T17:44:29.346135] [INFO ] [REMOTE ] BTZ: Full fetch complete (33191 records). [2025-10-27T17:44:29.346211] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-27T17:44:29.709963] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-27T17:44:29.710044] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-27T17:44:29.710495] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-27T17:44:29.710534] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-27T17:44:29.711428] [DEBUG] [LOCAL ] BTZ: Trimmed 33191 records to 22002 (keeping 200 days of data) [2025-10-27T17:44:29.840851] [DEBUG] [LOCAL ] BTZ: Primary data saved (22002 records). [2025-10-27T17:44:29.840973] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-27T17:44:29.841047] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BTZ took 38.4s. Estimated remaining: 4h 9m 18s. Rate: 8.1 symbols/min [2025-10-27T17:44:30.014944] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-27T17:44:30.238295] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T17:44:30.814907] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-27T17:44:31.101190] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:44:31.614991] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-27T17:44:32.022864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T17:44:32.415035] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-27T17:44:32.856034] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:44:33.214932] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-27T17:44:33.892486] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T17:44:34.015000] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-27T17:44:34.677810] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T17:44:34.814973] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-27T17:44:35.507166] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T17:44:35.614965] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-27T17:44:36.197305] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:44:36.414983] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-27T17:44:36.925330] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T17:44:37.214944] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-27T17:44:37.929967] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:44:38.014939] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-27T17:44:38.538709] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:44:38.547855] [INFO ] [REMOTE ] BUR: Full fetch complete (64749 records). [2025-10-27T17:44:38.547972] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-27T17:44:38.933704] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-27T17:44:38.933790] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-27T17:44:38.934474] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-27T17:44:38.934516] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-27T17:44:38.935821] [DEBUG] [LOCAL ] BUR: Trimmed 64749 records to 45425 (keeping 200 days of data) [2025-10-27T17:44:39.216782] [DEBUG] [LOCAL ] BUR: Primary data saved (45425 records). [2025-10-27T17:44:39.216929] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-27T17:44:39.217060] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 22.2s. Estimated remaining: 4h 9m 22s. Rate: 8.0 symbols/min [2025-10-27T17:44:39.732939] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T17:44:39.742949] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-27T17:44:41.068098] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T17:44:41.079287] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-27T17:44:42.457894] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T17:44:42.467507] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-27T17:44:43.741856] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T17:44:43.750557] [INFO ] [REMOTE ] BURL: Full fetch complete (65746 records). [2025-10-27T17:44:43.750743] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-27T17:44:44.151951] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-27T17:44:44.152066] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-27T17:44:44.152821] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-27T17:44:44.152940] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-27T17:44:44.154227] [DEBUG] [LOCAL ] BURL: Trimmed 65746 records to 45188 (keeping 200 days of data) [2025-10-27T17:44:44.423910] [DEBUG] [LOCAL ] BURL: Primary data saved (45188 records). [2025-10-27T17:44:44.424047] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-27T17:44:44.424123] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BURL took 19.7s. Estimated remaining: 4h 9m 2s. Rate: 8.1 symbols/min [2025-10-27T17:44:45.099557] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.104163] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.156574] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.155556] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:44:45.173252] [DEBUG] [LOCAL ] BUXX: Loaded 15540 existing records from primary storage. [2025-10-27T17:44:45.173494] [INFO ] [MAIN ] BUXX: Loaded 15540 existing records. [2025-10-27T17:44:45.315858] [DEBUG] [LOCAL ] BV: Loaded 39038 existing records from primary storage. [2025-10-27T17:44:45.316456] [INFO ] [MAIN ] BV: Loaded 39038 existing records. [2025-10-27T17:44:45.550678] [DEBUG] [LOCAL ] BVN: Loaded 45245 existing records from primary storage. [2025-10-27T17:44:45.476132] [DEBUG] [LOCAL ] BW: Loaded 40994 existing records from primary storage. [2025-10-27T17:44:45.551156] [INFO ] [MAIN ] BVN: Loaded 45245 existing records. [2025-10-27T17:44:45.539235] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:45.580605] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-27T17:44:45.580496] [INFO ] [MAIN ] BW: Loaded 40994 existing records. [2025-10-27T17:44:45.601910] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-27T17:44:45.655840] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-27T17:44:45.690322] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-27T17:44:45.881280] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:45.904740] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-27T17:44:45.940274] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-27T17:44:46.015922] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-27T17:44:46.104244] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-27T17:44:46.079609] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:46.162789] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-27T17:44:46.162591] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:44:46.229243] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-27T17:44:46.250373] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-27T17:44:46.265899] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-27T17:44:46.324106] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-27T17:44:46.324219] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-27T17:44:46.349615] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-27T17:44:46.386508] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-27T17:44:46.940947] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:46.977978] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-27T17:44:47.358443] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.383344] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-27T17:44:47.518387] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.524112] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-27T17:44:47.563438] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:44:47.564139] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-27T17:44:47.759081] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:44:47.761919] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-27T17:44:48.513148] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:44:48.515804] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-27T17:44:48.727798] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T17:44:48.736844] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-27T17:44:48.939363] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:44:48.946082] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-27T17:44:49.167692] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T17:44:49.175967] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-27T17:44:49.352293] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T17:44:49.357062] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-27T17:44:49.792962] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:44:49.800684] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-27T17:44:49.938046] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T17:44:50.014907] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-27T17:44:50.056205] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T17:44:50.493290] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:44:50.814932] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-27T17:44:50.872219] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T17:44:50.927610] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T17:44:51.614919] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-27T17:44:51.766830] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T17:44:52.414950] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-27T17:44:53.112279] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:44:53.214915] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-27T17:44:54.020065] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-27T17:44:54.042761] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:44:54.205156] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:44:54.814971] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-27T17:44:55.119628] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T17:44:55.367600] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T17:44:55.614981] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-27T17:44:56.186591] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T17:44:56.414969] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-27T17:44:57.215067] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-27T17:44:57.236709] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T17:44:58.014933] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-27T17:44:58.348223] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:44:58.814957] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-27T17:44:59.159838] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:44:59.614960] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-27T17:45:00.367965] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T17:45:00.415068] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-27T17:45:01.138248] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T17:45:01.214952] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-27T17:45:02.015056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-27T17:45:02.815060] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-27T17:45:03.365603] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-10-27T17:45:03.614963] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-27T17:45:03.795957] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T17:45:04.227893] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-27T17:45:04.414936] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-27T17:45:04.483915] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-27T17:45:05.214965] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-27T17:45:05.358816] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T17:45:05.444506] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T17:45:06.015023] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-27T17:45:06.442045] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:45:06.815044] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-27T17:45:07.530152] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:45:07.533125] [INFO ] [REMOTE ] BUXX: Full fetch complete (20695 records). [2025-10-27T17:45:07.533199] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-27T17:45:07.534608] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:07.534906] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:07.534957] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:07.535008] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-27T17:45:07.535085] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-27T17:45:07.535125] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-27T17:45:07.535405] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-10-27T17:45:07.535543] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BUXX took 23.1s. Estimated remaining: 4h 10m 21s. Rate: 8.0 symbols/min [2025-10-27T17:45:07.615295] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-27T17:45:07.718833] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T17:45:07.754862] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:07.756238] [INFO ] [REMOTE ] BV: Full fetch complete (54875 records). [2025-10-27T17:45:07.756528] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-27T17:45:07.757499] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:07.757592] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:07.757636] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:07.757742] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-27T17:45:07.757826] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-27T17:45:07.757932] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-27T17:45:07.758176] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-27T17:45:07.758276] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BV took 23.3s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-27T17:45:07.929126] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:07.976003] [DEBUG] [LOCAL ] BWA: Loaded 52824 existing records from primary storage. [2025-10-27T17:45:07.976434] [INFO ] [MAIN ] BWA: Loaded 52824 existing records. [2025-10-27T17:45:08.054335] [DEBUG] [LOCAL ] BWG: Loaded 12755 existing records from primary storage. [2025-10-27T17:45:08.075731] [INFO ] [MAIN ] BWG: Loaded 12755 existing records. [2025-10-27T17:45:08.375688] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:08.380916] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:08.381296] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-27T17:45:08.381515] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-27T17:45:08.381605] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-27T17:45:08.381796] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-27T17:45:08.382106] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-27T17:45:08.382202] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-27T17:45:08.413169] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-27T17:45:08.444630] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-27T17:45:08.444415] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-27T17:45:09.048700] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:09.129057] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:09.162976] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:45:09.214905] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-27T17:45:09.840846] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:45:10.014974] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-27T17:45:10.814956] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-27T17:45:10.854409] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T17:45:11.541612] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-27T17:45:11.614907] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-27T17:45:12.101559] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T17:45:12.415009] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-27T17:45:13.214961] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-27T17:45:13.550086] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T17:45:13.559121] [INFO ] [REMOTE ] BW: Full fetch complete (59300 records). [2025-10-27T17:45:13.559247] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-27T17:45:13.958365] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-27T17:45:13.958545] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-27T17:45:13.959233] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-27T17:45:13.959324] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-27T17:45:13.960984] [DEBUG] [LOCAL ] BW: Trimmed 59300 records to 40358 (keeping 200 days of data) [2025-10-27T17:45:14.016383] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-27T17:45:14.104337] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T17:45:14.226023] [DEBUG] [LOCAL ] BW: Primary data saved (40358 records). [2025-10-27T17:45:14.226144] [INFO ] [MAIN ] BW: Full history saved. [2025-10-27T17:45:14.226216] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BW took 29.8s. Estimated remaining: 4h 9m 20s. Rate: 8.0 symbols/min [2025-10-27T17:45:14.400710] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:14.429127] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:45:14.472935] [DEBUG] [LOCAL ] BWLP: Loaded 32471 existing records from primary storage. [2025-10-27T17:45:14.473224] [INFO ] [MAIN ] BWLP: Loaded 32471 existing records. [2025-10-27T17:45:14.664053] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:45:14.669205] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:14.672241] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-27T17:45:14.672297] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-27T17:45:14.672448] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-27T17:45:14.672487] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-27T17:45:14.822866] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-27T17:45:15.035536] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:15.386868] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:45:15.614972] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-27T17:45:16.401294] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T17:45:16.414890] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-27T17:45:17.214942] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-27T17:45:17.471705] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T17:45:18.015007] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-27T17:45:18.699413] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:45:18.814967] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-27T17:45:19.426498] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:45:19.614997] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-27T17:45:20.415008] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-27T17:45:20.626234] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:45:20.635389] [INFO ] [REMOTE ] BVN: Full fetch complete (63310 records). [2025-10-27T17:45:20.635532] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-27T17:45:20.636262] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:20.636351] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:20.636393] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:20.636431] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-27T17:45:20.636486] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-27T17:45:20.636520] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-10-27T17:45:20.636674] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-10-27T17:45:20.636763] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BVN took 36.2s. Estimated remaining: 4h 9m 7s. Rate: 8.0 symbols/min [2025-10-27T17:45:20.809670] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:20.820343] [DEBUG] [LOCAL ] BWMX: Loaded 7964 existing records from primary storage. [2025-10-27T17:45:20.820566] [INFO ] [MAIN ] BWMX: Loaded 7964 existing records. [2025-10-27T17:45:21.004744] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:21.005043] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-27T17:45:21.005209] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-27T17:45:21.005425] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-27T17:45:21.005495] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-27T17:45:21.222526] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-27T17:45:21.384910] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T17:45:21.422339] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:21.956738] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:45:21.981757] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:45:22.014900] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-27T17:45:22.814967] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-27T17:45:23.055189] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T17:45:23.374570] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T17:45:23.614981] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-27T17:45:23.947808] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T17:45:24.415001] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-27T17:45:25.142825] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T17:45:25.214945] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-27T17:45:26.014955] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-27T17:45:26.459507] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T17:45:26.820221] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-27T17:45:26.833737] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T17:45:27.614944] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-27T17:45:28.326540] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:45:28.414904] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-27T17:45:28.513837] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T17:45:29.214945] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-27T17:45:29.777827] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T17:45:29.817335] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:45:30.014935] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-27T17:45:30.603207] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T17:45:30.814903] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-27T17:45:31.614965] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-27T17:45:32.052047] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T17:45:32.418288] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-27T17:45:32.424030] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T17:45:32.864325] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:45:33.214949] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-27T17:45:34.014925] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-27T17:45:34.037883] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T17:45:34.040032] [INFO ] [REMOTE ] BWG: Full fetch complete (17581 records). [2025-10-27T17:45:34.040122] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-27T17:45:34.405549] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-27T17:45:34.405631] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-27T17:45:34.406003] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-27T17:45:34.406050] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-27T17:45:34.406745] [DEBUG] [LOCAL ] BWG: Trimmed 17581 records to 12426 (keeping 200 days of data) [2025-10-27T17:45:34.476665] [DEBUG] [LOCAL ] BWG: Primary data saved (12426 records). [2025-10-27T17:45:34.476799] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-27T17:45:34.476875] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 26.7s. Estimated remaining: 4h 9m 35s. Rate: 8.0 symbols/min [2025-10-27T17:45:34.642510] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:34.648136] [DEBUG] [LOCAL ] BWNB: Loaded 4083 existing records from primary storage. [2025-10-27T17:45:34.648323] [INFO ] [MAIN ] BWNB: Loaded 4083 existing records. [2025-10-27T17:45:34.821968] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-27T17:45:34.827066] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:34.828143] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-27T17:45:34.828199] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-27T17:45:34.828323] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-27T17:45:34.828360] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-27T17:45:35.194007] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:35.483673] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:45:35.614986] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-27T17:45:35.918069] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T17:45:36.306482] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:45:36.414926] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-27T17:45:37.214991] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-27T17:45:37.655981] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:45:38.014980] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-27T17:45:38.473156] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:45:38.490719] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:45:38.815008] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-27T17:45:39.614951] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-27T17:45:40.414972] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-27T17:45:40.584993] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T17:45:40.630817] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T17:45:40.640745] [INFO ] [REMOTE ] BWA: Full fetch complete (75881 records). [2025-10-27T17:45:40.640879] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-27T17:45:40.838019] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T17:45:41.044838] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-27T17:45:41.044925] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-27T17:45:41.045729] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-27T17:45:41.045790] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-27T17:45:41.047107] [DEBUG] [LOCAL ] BWA: Trimmed 75881 records to 52031 (keeping 200 days of data) [2025-10-27T17:45:41.217384] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-27T17:45:41.355882] [DEBUG] [LOCAL ] BWA: Primary data saved (52031 records). [2025-10-27T17:45:41.356014] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-27T17:45:41.356087] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWA took 33.8s. Estimated remaining: 4h 9m 24s. Rate: 8.0 symbols/min [2025-10-27T17:45:41.522716] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:41.528771] [DEBUG] [LOCAL ] BWSN: Loaded 5117 existing records from primary storage. [2025-10-27T17:45:41.528943] [INFO ] [MAIN ] BWSN: Loaded 5117 existing records. [2025-10-27T17:45:41.727002] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:41.727220] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-27T17:45:41.727276] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-27T17:45:41.727410] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-27T17:45:41.727446] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-27T17:45:42.020096] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-27T17:45:42.079395] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:42.269960] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T17:45:42.748082] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T17:45:42.814969] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-27T17:45:43.425549] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T17:45:43.614954] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-27T17:45:44.194538] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T17:45:44.414970] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-27T17:45:44.838363] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T17:45:45.214941] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-27T17:45:45.713935] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T17:45:46.014996] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-27T17:45:46.654620] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T17:45:46.814952] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-27T17:45:47.614992] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-27T17:45:48.283222] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T17:45:48.302680] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:45:48.414918] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-27T17:45:49.215045] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-27T17:45:49.471489] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T17:45:49.598889] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T17:45:50.014992] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-27T17:45:50.814975] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-27T17:45:50.824255] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T17:45:50.826157] [INFO ] [REMOTE ] BWMX: Full fetch complete (10000 records). [2025-10-27T17:45:50.826248] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-27T17:45:51.192139] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-27T17:45:51.192218] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-27T17:45:51.192447] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-27T17:45:51.192487] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-27T17:45:51.192925] [DEBUG] [LOCAL ] BWMX: Trimmed 10000 records to 7931 (keeping 200 days of data) [2025-10-27T17:45:51.239916] [DEBUG] [LOCAL ] BWMX: Primary data saved (7931 records). [2025-10-27T17:45:51.240039] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-27T17:45:51.240132] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWMX took 30.6s. Estimated remaining: 4h 9m 29s. Rate: 8.0 symbols/min [2025-10-27T17:45:51.406177] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:51.442807] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:45:51.458758] [DEBUG] [LOCAL ] BWXT: Loaded 47929 existing records from primary storage. [2025-10-27T17:45:51.459077] [INFO ] [MAIN ] BWXT: Loaded 47929 existing records. [2025-10-27T17:45:51.626435] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-27T17:45:51.631484] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:51.632403] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-27T17:45:51.632453] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-27T17:45:51.632756] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-27T17:45:51.632812] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-27T17:45:51.986830] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:52.202672] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T17:45:52.414928] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-27T17:45:53.214987] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-27T17:45:53.308834] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T17:45:53.617440] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:45:54.014990] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-27T17:45:54.310560] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-27T17:45:54.814946] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-27T17:45:55.614981] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-27T17:45:56.286841] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:45:56.414987] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-27T17:45:56.500518] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:45:57.214988] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-27T17:45:57.353773] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T17:45:57.360290] [INFO ] [REMOTE ] BWLP: Full fetch complete (47595 records). [2025-10-27T17:45:57.360456] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-27T17:45:57.361169] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:45:57.361290] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:45:57.361358] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:45:57.361405] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-27T17:45:57.361462] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-27T17:45:57.361719] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-10-27T17:45:57.361870] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-10-27T17:45:57.361943] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWLP took 43.1s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-10-27T17:45:57.537705] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:45:57.594782] [DEBUG] [LOCAL ] BX: Loaded 54263 existing records from primary storage. [2025-10-27T17:45:57.595282] [INFO ] [MAIN ] BX: Loaded 54263 existing records. [2025-10-27T17:45:57.741324] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T17:45:57.795977] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:45:57.796213] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-27T17:45:57.796259] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-27T17:45:57.796445] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-27T17:45:57.796482] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-27T17:45:58.021442] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-27T17:45:58.146049] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:45:58.814992] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-27T17:45:59.448586] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T17:45:59.614945] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-27T17:46:00.414930] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-27T17:46:00.535388] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:46:01.214988] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-27T17:46:01.873261] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-27T17:46:02.014967] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-27T17:46:02.815045] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-27T17:46:03.874374] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-27T17:46:03.875882] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-27T17:46:04.043489] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-10-27T17:46:04.415001] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-27T17:46:04.834623] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T17:46:05.110171] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-10-27T17:46:05.207351] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-27T17:46:05.217957] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-27T17:46:05.620005] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:46:05.621350] [INFO ] [REMOTE ] BWNB: Full fetch complete (5587 records). [2025-10-27T17:46:05.621442] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-27T17:46:06.008223] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-27T17:46:06.008344] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-27T17:46:06.008527] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-27T17:46:06.008569] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-27T17:46:06.009008] [DEBUG] [LOCAL ] BWNB: Trimmed 5587 records to 4033 (keeping 200 days of data) [2025-10-27T17:46:06.019287] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-27T17:46:06.034087] [DEBUG] [LOCAL ] BWNB: Primary data saved (4033 records). [2025-10-27T17:46:06.034162] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-27T17:46:06.034235] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWNB took 31.6s. Estimated remaining: 4h 9m 13s. Rate: 8.0 symbols/min [2025-10-27T17:46:06.211920] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:06.213539] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:46:06.215834] [INFO ] [REMOTE ] BWSN: Full fetch complete (6430 records). [2025-10-27T17:46:06.215965] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-27T17:46:06.357807] [DEBUG] [LOCAL ] BXC: Loaded 13507 existing records from primary storage. [2025-10-27T17:46:06.368556] [INFO ] [MAIN ] BXC: Loaded 13507 existing records. [2025-10-27T17:46:06.734856] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:06.745447] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-27T17:46:06.750722] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-27T17:46:06.784149] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-27T17:46:06.791025] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-27T17:46:06.825356] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-27T17:46:06.825556] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-27T17:46:06.846394] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-27T17:46:06.852770] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-27T17:46:06.879315] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-27T17:46:06.917908] [DEBUG] [LOCAL ] BWSN: Trimmed 6430 records to 5047 (keeping 200 days of data) [2025-10-27T17:46:07.019340] [DEBUG] [LOCAL ] BWSN: Primary data saved (5047 records). [2025-10-27T17:46:07.040540] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-27T17:46:07.071591] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWSN took 25.7s. Estimated remaining: 4h 8m 31s. Rate: 8.0 symbols/min [2025-10-27T17:46:07.360871] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:07.387149] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:07.428377] [DEBUG] [LOCAL ] BXMT: Loaded 47958 existing records from primary storage. [2025-10-27T17:46:07.428693] [INFO ] [MAIN ] BXMT: Loaded 47958 existing records. [2025-10-27T17:46:07.606215] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:07.606416] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-27T17:46:07.606461] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-27T17:46:07.606722] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-27T17:46:07.606777] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-27T17:46:07.637011] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-27T17:46:07.958397] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:08.415010] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-27T17:46:08.558380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:46:08.600634] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-27T17:46:08.624050] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:46:09.214990] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-27T17:46:09.774420] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:46:10.014962] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-27T17:46:10.642678] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T17:46:10.814988] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-27T17:46:11.252833] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:46:11.614999] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-27T17:46:12.176939] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T17:46:12.414941] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-27T17:46:12.444825] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:46:13.214991] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-27T17:46:13.774945] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:46:14.014934] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-27T17:46:14.506576] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T17:46:14.814978] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-27T17:46:15.614933] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-27T17:46:15.618078] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T17:46:16.415016] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-27T17:46:17.062582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-27T17:46:17.085247] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T17:46:17.220517] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-27T17:46:17.225685] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:46:18.014983] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-27T17:46:18.654605] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T17:46:18.814936] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-27T17:46:19.400032] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T17:46:19.614952] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-27T17:46:20.384498] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:46:20.414906] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-27T17:46:21.028469] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T17:46:21.132125] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:46:21.214907] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-27T17:46:21.794095] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T17:46:22.014932] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-27T17:46:22.815000] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-27T17:46:23.614936] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-27T17:46:23.970615] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T17:46:24.179263] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T17:46:24.387353] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T17:46:24.396515] [INFO ] [REMOTE ] BWXT: Full fetch complete (67748 records). [2025-10-27T17:46:24.396633] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-27T17:46:24.397391] [FATAL] [VALIDATOR ] BWXT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:46:24.397478] [FATAL] [MAIN ] BWXT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:46:24.397522] [WARN ] [MAIN ] BWXT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:46:24.397599] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-27T17:46:24.397687] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-27T17:46:24.397761] [INFO ] [LOCAL ] BWXT: Starting deletion of derivative data. [2025-10-27T17:46:24.397947] [DEBUG] [LOCAL ] BWXT: Deleted derivative data file. [2025-10-27T17:46:24.398039] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWXT took 33.2s. Estimated remaining: 4h 9m 17s. Rate: 8.0 symbols/min [2025-10-27T17:46:24.420055] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-27T17:46:24.577054] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:24.596626] [DEBUG] [LOCAL ] BXMX: Loaded 19411 existing records from primary storage. [2025-10-27T17:46:24.596909] [INFO ] [MAIN ] BXMX: Loaded 19411 existing records. [2025-10-27T17:46:24.774126] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:24.774292] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-27T17:46:24.774339] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-27T17:46:24.774509] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-27T17:46:24.774549] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-27T17:46:25.123618] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:25.214937] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-27T17:46:25.946681] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:46:25.980831] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:46:26.014904] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-27T17:46:26.814951] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-27T17:46:27.614907] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-27T17:46:27.841559] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:46:27.924628] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T17:46:28.414959] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-27T17:46:28.846212] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:46:29.215001] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-27T17:46:30.018252] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-27T17:46:30.024266] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:46:30.035121] [INFO ] [REMOTE ] BX: Full fetch complete (77613 records). [2025-10-27T17:46:30.035274] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-27T17:46:30.440790] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-27T17:46:30.440874] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-27T17:46:30.441689] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-27T17:46:30.441753] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-27T17:46:30.443261] [DEBUG] [LOCAL ] BX: Trimmed 77613 records to 53483 (keeping 200 days of data) [2025-10-27T17:46:30.770718] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-27T17:46:30.770989] [INFO ] [MAIN ] BX: Full history saved. [2025-10-27T17:46:30.771890] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BX took 33.4s. Estimated remaining: 4h 9m 3s. Rate: 8.0 symbols/min [2025-10-27T17:46:30.835263] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-27T17:46:30.944188] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:30.956309] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:46:30.988943] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T17:46:31.037241] [DEBUG] [LOCAL ] BXP: Loaded 50526 existing records from primary storage. [2025-10-27T17:46:31.037544] [INFO ] [MAIN ] BXP: Loaded 50526 existing records. [2025-10-27T17:46:31.219576] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:31.219828] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-27T17:46:31.219875] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-27T17:46:31.220109] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-27T17:46:31.220147] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-27T17:46:31.582389] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:31.596024] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T17:46:31.614903] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-27T17:46:32.414930] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-27T17:46:32.977872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:46:33.220044] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-27T17:46:33.232128] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T17:46:34.014937] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-27T17:46:34.728139] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T17:46:34.814996] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-27T17:46:34.872358] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T17:46:35.464896] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:46:35.614981] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-27T17:46:36.351304] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T17:46:36.354009] [INFO ] [REMOTE ] BXC: Full fetch complete (18227 records). [2025-10-27T17:46:36.354084] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-27T17:46:36.354489] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:46:36.354592] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:46:36.354674] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:46:36.354739] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-27T17:46:36.354797] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-27T17:46:36.354832] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-10-27T17:46:36.354968] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-10-27T17:46:36.355055] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXC took 30.3s. Estimated remaining: 4h 8m 46s. Rate: 8.0 symbols/min [2025-10-27T17:46:36.425358] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-27T17:46:36.544474] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:36.588545] [DEBUG] [LOCAL ] BXSL: Loaded 48967 existing records from primary storage. [2025-10-27T17:46:36.588941] [INFO ] [MAIN ] BXSL: Loaded 48967 existing records. [2025-10-27T17:46:36.786838] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:36.787028] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-27T17:46:36.787100] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-27T17:46:36.787322] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-27T17:46:36.787369] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-27T17:46:37.172745] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:37.214898] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-27T17:46:38.014923] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-27T17:46:38.165112] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:46:38.699534] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:46:38.814969] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-27T17:46:39.401458] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T17:46:39.614957] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-27T17:46:39.930320] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:46:40.414939] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-27T17:46:41.214935] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-27T17:46:41.396746] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T17:46:41.961022] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:46:42.014900] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-27T17:46:42.439862] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T17:46:42.815061] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-27T17:46:43.614923] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-27T17:46:43.839990] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:46:43.851233] [INFO ] [REMOTE ] BXMT: Full fetch complete (69841 records). [2025-10-27T17:46:43.851395] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-27T17:46:44.339162] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-27T17:46:44.339239] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-27T17:46:44.340109] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-27T17:46:44.340185] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-27T17:46:44.341721] [DEBUG] [LOCAL ] BXMT: Trimmed 69841 records to 47144 (keeping 200 days of data) [2025-10-27T17:46:44.415020] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-27T17:46:44.596397] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:46:44.673935] [DEBUG] [LOCAL ] BXMT: Primary data saved (47144 records). [2025-10-27T17:46:44.674053] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-27T17:46:44.674126] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMT took 37.6s. Estimated remaining: 4h 8m 42s. Rate: 8.0 symbols/min [2025-10-27T17:46:44.839729] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:44.860873] [DEBUG] [LOCAL ] BY: Loaded 22005 existing records from primary storage. [2025-10-27T17:46:44.861105] [INFO ] [MAIN ] BY: Loaded 22005 existing records. [2025-10-27T17:46:45.043130] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:45.043329] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-27T17:46:45.043377] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-27T17:46:45.043570] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-27T17:46:45.043694] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-27T17:46:45.231576] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-27T17:46:45.410259] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:45.438756] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:46:45.455072] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T17:46:46.014996] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-27T17:46:46.612735] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T17:46:46.809221] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T17:46:46.814887] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-27T17:46:47.614942] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-27T17:46:47.657927] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T17:46:48.414979] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-27T17:46:48.918441] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:46:49.214998] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-27T17:46:49.761429] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T17:46:50.014962] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-27T17:46:50.205551] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:46:50.814996] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-27T17:46:51.607415] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:46:51.616964] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-27T17:46:52.299628] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T17:46:52.414944] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-27T17:46:52.643842] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:46:53.215035] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-27T17:46:53.438570] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T17:46:53.858558] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:46:54.015026] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-27T17:46:54.814989] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-27T17:46:55.240727] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T17:46:55.245789] [INFO ] [REMOTE ] BXMX: Full fetch complete (28556 records). [2025-10-27T17:46:55.245939] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-27T17:46:55.448948] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T17:46:55.616707] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-27T17:46:55.652454] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-27T17:46:55.652715] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-27T17:46:55.653267] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-27T17:46:55.653328] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-27T17:46:55.654192] [DEBUG] [LOCAL ] BXMX: Trimmed 28556 records to 18764 (keeping 200 days of data) [2025-10-27T17:46:55.766486] [DEBUG] [LOCAL ] BXMX: Primary data saved (18764 records). [2025-10-27T17:46:55.766675] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-27T17:46:55.766779] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BXMX took 31.4s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-10-27T17:46:55.934399] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:46:55.975692] [DEBUG] [LOCAL ] BYD: Loaded 45697 existing records from primary storage. [2025-10-27T17:46:55.975977] [INFO ] [MAIN ] BYD: Loaded 45697 existing records. [2025-10-27T17:46:56.161317] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:46:56.161538] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-27T17:46:56.161584] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-27T17:46:56.161847] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-27T17:46:56.161903] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-27T17:46:56.421421] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-27T17:46:56.514990] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:46:56.752609] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:46:57.214941] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-27T17:46:57.719578] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:46:58.015018] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-27T17:46:58.814980] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-27T17:46:59.174753] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T17:46:59.245525] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T17:46:59.615007] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-27T17:46:59.774586] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T17:47:00.414942] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-27T17:47:01.215025] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-27T17:47:02.015034] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-27T17:47:02.043010] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T17:47:02.814930] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-27T17:47:03.677202] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-10-27T17:47:03.681902] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-27T17:47:04.186395] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-27T17:47:04.197007] [INFO ] [REMOTE ] BXP: Full fetch complete (71851 records). [2025-10-27T17:47:04.197314] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-27T17:47:04.200189] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:04.200401] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:04.200449] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:04.200495] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-27T17:47:04.200561] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-27T17:47:04.200598] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-10-27T17:47:04.200760] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-10-27T17:47:04.201447] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXP took 33.4s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-27T17:47:04.466114] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:04.485977] [DEBUG] [LOCAL ] BYM: Loaded 11502 existing records from primary storage. [2025-10-27T17:47:04.486345] [INFO ] [MAIN ] BYM: Loaded 11502 existing records. [2025-10-27T17:47:04.745309] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-10-27T17:47:04.792749] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:04.793743] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-27T17:47:04.794058] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-27T17:47:04.794885] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-27T17:47:04.795094] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-27T17:47:04.795164] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-27T17:47:05.194732] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:05.218311] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-27T17:47:05.223694] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T17:47:05.542148] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T17:47:05.904738] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:47:06.014944] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-27T17:47:06.544856] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T17:47:06.545785] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T17:47:06.814964] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-27T17:47:07.614938] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-27T17:47:08.414962] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-27T17:47:08.626880] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T17:47:08.630973] [INFO ] [REMOTE ] BY: Full fetch complete (29556 records). [2025-10-27T17:47:08.631051] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-27T17:47:08.631529] [FATAL] [VALIDATOR ] BY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:08.631621] [FATAL] [MAIN ] BY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:08.631699] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:08.631749] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-27T17:47:08.631805] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-27T17:47:08.631841] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-10-27T17:47:08.632002] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-10-27T17:47:08.632096] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BY took 24.0s. Estimated remaining: 4h 8m 28s. Rate: 8.0 symbols/min [2025-10-27T17:47:08.811124] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:08.840377] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T17:47:08.875228] [DEBUG] [LOCAL ] BZH: Loaded 32434 existing records from primary storage. [2025-10-27T17:47:08.875508] [INFO ] [MAIN ] BZH: Loaded 32434 existing records. [2025-10-27T17:47:09.055176] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:09.055402] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-27T17:47:09.055451] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-27T17:47:09.055677] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-27T17:47:09.055735] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-27T17:47:09.232208] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-27T17:47:09.352293] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T17:47:09.437823] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:10.014985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-27T17:47:10.540670] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T17:47:10.814906] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-27T17:47:10.868710] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:47:11.614934] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-27T17:47:12.079799] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:47:12.415010] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-27T17:47:12.740134] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T17:47:13.214937] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-27T17:47:14.014939] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-27T17:47:14.467877] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:47:14.565677] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T17:47:14.575245] [INFO ] [REMOTE ] BXSL: Full fetch complete (69765 records). [2025-10-27T17:47:14.575362] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-27T17:47:14.576111] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:14.576200] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:14.576243] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:14.576314] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-27T17:47:14.576394] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-27T17:47:14.576441] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-27T17:47:14.576699] [DEBUG] [LOCAL ] BXSL: Deleted derivative data file. [2025-10-27T17:47:14.577193] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BXSL took 38.2s. Estimated remaining: 4h 8m 12s. Rate: 8.0 symbols/min [2025-10-27T17:47:14.742927] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:14.793695] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-10-27T17:47:14.793992] [INFO ] [MAIN ] C: Loaded 54521 existing records. [2025-10-27T17:47:14.824178] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-27T17:47:14.971480] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:14.971714] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-27T17:47:14.971785] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-27T17:47:14.972004] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-27T17:47:14.972060] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-27T17:47:15.356411] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:15.381158] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:47:15.541030] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T17:47:15.614921] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-27T17:47:16.414968] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-27T17:47:16.511065] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T17:47:17.214939] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-27T17:47:17.745627] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T17:47:18.014932] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-27T17:47:18.363393] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T17:47:18.597480] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:47:18.814945] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-27T17:47:19.615004] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-27T17:47:20.252072] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:47:20.414972] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-27T17:47:20.470053] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T17:47:20.472493] [INFO ] [REMOTE ] BYM: Full fetch complete (17196 records). [2025-10-27T17:47:20.472563] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-27T17:47:20.833923] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-27T17:47:20.833999] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-27T17:47:20.834378] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-27T17:47:20.834416] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-27T17:47:20.834949] [DEBUG] [LOCAL ] BYM: Trimmed 17196 records to 11121 (keeping 200 days of data) [2025-10-27T17:47:20.900439] [DEBUG] [LOCAL ] BYM: Primary data saved (11121 records). [2025-10-27T17:47:20.900566] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-27T17:47:20.900660] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 16.7s. Estimated remaining: 4h 7m 59s. Rate: 8.0 symbols/min [2025-10-27T17:47:21.064548] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:21.086279] [DEBUG] [LOCAL ] CAAP: Loaded 20243 existing records from primary storage. [2025-10-27T17:47:21.086520] [INFO ] [MAIN ] CAAP: Loaded 20243 existing records. [2025-10-27T17:47:21.222154] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-27T17:47:21.261953] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:21.262151] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-27T17:47:21.262208] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-27T17:47:21.262436] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-27T17:47:21.262492] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-27T17:47:21.605300] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:21.839920] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T17:47:22.014958] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-27T17:47:22.814916] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-27T17:47:22.865587] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:47:23.597818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T17:47:23.614903] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-27T17:47:23.851214] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T17:47:24.414984] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-27T17:47:24.885021] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:47:25.214944] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-27T17:47:26.014937] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-27T17:47:26.367854] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T17:47:26.658843] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T17:47:26.727079] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T17:47:26.814920] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-27T17:47:27.614998] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-27T17:47:28.138115] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T17:47:28.293909] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T17:47:28.414939] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-27T17:47:29.214938] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-27T17:47:29.323213] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T17:47:30.014977] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-27T17:47:30.106067] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T17:47:30.815015] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-27T17:47:31.532035] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T17:47:31.614913] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-27T17:47:31.673698] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T17:47:32.414985] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-27T17:47:32.653343] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:47:33.214991] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-27T17:47:33.767338] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T17:47:33.775636] [INFO ] [REMOTE ] BYD: Full fetch complete (65248 records). [2025-10-27T17:47:33.775781] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-27T17:47:33.776450] [FATAL] [VALIDATOR ] BYD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:33.776531] [FATAL] [MAIN ] BYD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:33.776573] [WARN ] [MAIN ] BYD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:33.776609] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-27T17:47:33.776691] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-27T17:47:33.776744] [INFO ] [LOCAL ] BYD: Starting deletion of derivative data. [2025-10-27T17:47:33.776899] [DEBUG] [LOCAL ] BYD: Deleted derivative data file. [2025-10-27T17:47:33.776981] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BYD took 38.0s. Estimated remaining: 4h 8m 19s. Rate: 8.0 symbols/min [2025-10-27T17:47:33.944567] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:33.961021] [DEBUG] [LOCAL ] CABO: Loaded 16835 existing records from primary storage. [2025-10-27T17:47:33.961246] [INFO ] [MAIN ] CABO: Loaded 16835 existing records. [2025-10-27T17:47:34.022414] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-27T17:47:34.140678] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:34.140959] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-27T17:47:34.141017] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-27T17:47:34.141199] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-27T17:47:34.141257] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-27T17:47:34.307344] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:47:34.523153] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:34.804938] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T17:47:34.814906] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-27T17:47:35.614978] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-27T17:47:35.700151] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:47:36.414949] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-27T17:47:37.084854] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T17:47:37.215002] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-27T17:47:37.927747] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:47:38.014924] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-27T17:47:38.814997] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-27T17:47:39.240807] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:47:39.357214] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T17:47:39.471695] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T17:47:39.614937] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-27T17:47:40.414976] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-27T17:47:41.214933] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-27T17:47:41.333577] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:47:41.354920] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T17:47:42.014992] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-27T17:47:42.363497] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T17:47:42.816299] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-27T17:47:42.818472] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T17:47:43.614937] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-27T17:47:44.414953] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-27T17:47:44.455150] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T17:47:44.459525] [INFO ] [REMOTE ] CAAP: Full fetch complete (27822 records). [2025-10-27T17:47:44.459603] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-27T17:47:44.460073] [FATAL] [VALIDATOR ] CAAP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:47:44.460153] [FATAL] [MAIN ] CAAP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:47:44.460200] [WARN ] [MAIN ] CAAP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:47:44.460254] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-27T17:47:44.460345] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-27T17:47:44.460393] [INFO ] [LOCAL ] CAAP: Starting deletion of derivative data. [2025-10-27T17:47:44.460583] [DEBUG] [LOCAL ] CAAP: Deleted derivative data file. [2025-10-27T17:47:44.460706] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. CAAP took 23.6s. Estimated remaining: 4h 8m 28s. Rate: 8.0 symbols/min [2025-10-27T17:47:44.630694] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:44.651687] [DEBUG] [LOCAL ] CACI: Loaded 22875 existing records from primary storage. [2025-10-27T17:47:44.651928] [INFO ] [MAIN ] CACI: Loaded 22875 existing records. [2025-10-27T17:47:44.833885] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:44.834229] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-27T17:47:44.834334] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-27T17:47:44.834548] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-27T17:47:44.834754] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-27T17:47:44.988610] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T17:47:45.223384] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-27T17:47:45.268245] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:45.733992] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T17:47:45.739576] [INFO ] [REMOTE ] BZH: Full fetch complete (47102 records). [2025-10-27T17:47:45.739705] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-27T17:47:46.020629] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-27T17:47:46.115088] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-27T17:47:46.115170] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-27T17:47:46.115791] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-27T17:47:46.115854] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-27T17:47:46.116900] [DEBUG] [LOCAL ] BZH: Trimmed 47102 records to 31712 (keeping 200 days of data) [2025-10-27T17:47:46.293580] [DEBUG] [LOCAL ] BZH: Primary data saved (31712 records). [2025-10-27T17:47:46.293740] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-27T17:47:46.293821] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. BZH took 37.7s. Estimated remaining: 4h 7m 51s. Rate: 8.0 symbols/min [2025-10-27T17:47:46.463769] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:46.504381] [DEBUG] [LOCAL ] CADE: Loaded 50431 existing records from primary storage. [2025-10-27T17:47:46.504690] [INFO ] [MAIN ] CADE: Loaded 50431 existing records. [2025-10-27T17:47:46.678897] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:46.679238] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-27T17:47:46.679358] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-27T17:47:46.679682] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-27T17:47:46.679741] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-27T17:47:46.843268] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-27T17:47:46.876989] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:47:47.046503] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:47.615000] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-27T17:47:47.664966] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:47:47.675129] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-27T17:47:47.675253] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-27T17:47:48.068722] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-27T17:47:48.068821] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-27T17:47:48.069703] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-27T17:47:48.069768] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-27T17:47:48.071191] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 53741 (keeping 200 days of data) [2025-10-27T17:47:48.392518] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-27T17:47:48.392667] [INFO ] [MAIN ] C: Full history saved. [2025-10-27T17:47:48.393119] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. C took 33.8s. Estimated remaining: 4h 7m 16s. Rate: 8.0 symbols/min [2025-10-27T17:47:48.423584] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-27T17:47:48.520621] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:47:48.591784] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:47:48.628463] [DEBUG] [LOCAL ] CAE: Loaded 39531 existing records from primary storage. [2025-10-27T17:47:48.628762] [INFO ] [MAIN ] CAE: Loaded 39531 existing records. [2025-10-27T17:47:48.815240] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:47:48.815506] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-27T17:47:48.815582] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-27T17:47:48.815817] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-27T17:47:48.815944] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-27T17:47:49.007529] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T17:47:49.215900] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:47:49.216050] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-27T17:47:49.567848] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T17:47:50.014960] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-27T17:47:50.758134] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T17:47:50.814939] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-27T17:47:51.614929] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-27T17:47:51.847631] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T17:47:52.145973] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T17:47:52.414949] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-27T17:47:52.598625] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T17:47:53.214947] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-27T17:47:54.014931] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-27T17:47:54.046870] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:47:54.704102] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:47:54.744593] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T17:47:54.815004] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-27T17:47:55.614928] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-27T17:47:55.654947] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T17:47:56.414951] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-27T17:47:56.845232] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T17:47:57.214985] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-27T17:47:57.975308] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:47:58.014907] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-27T17:47:58.169490] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T17:47:58.814983] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-27T17:47:59.056093] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T17:47:59.434131] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T17:47:59.614963] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-27T17:48:00.414946] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-27T17:48:01.214954] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-27T17:48:01.315358] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T17:48:02.015009] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-27T17:48:02.731442] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-27T17:48:02.814958] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-27T17:48:03.615000] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-27T17:48:05.354926] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (4.14 seconds). [2025-10-27T17:48:05.359989] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-27T17:48:05.370496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-27T17:48:05.374546] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-27T17:48:05.491876] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-10-27T17:48:06.015038] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-27T17:48:06.495017] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T17:48:06.623307] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T17:48:06.814979] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-27T17:48:06.941291] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-10-27T17:48:07.603062] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T17:48:07.614897] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-27T17:48:08.046344] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:48:08.414931] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-27T17:48:08.903001] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:48:09.214992] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-27T17:48:09.857356] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T17:48:10.014917] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-27T17:48:10.047087] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T17:48:10.814944] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-27T17:48:11.124777] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T17:48:11.615017] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-27T17:48:11.812316] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T17:48:11.818783] [INFO ] [REMOTE ] CACI: Full fetch complete (38533 records). [2025-10-27T17:48:11.819015] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-27T17:48:12.186745] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-27T17:48:12.186829] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-27T17:48:12.187389] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-27T17:48:12.187451] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-27T17:48:12.188259] [DEBUG] [LOCAL ] CACI: Trimmed 38533 records to 22047 (keeping 200 days of data) [2025-10-27T17:48:12.315968] [DEBUG] [LOCAL ] CACI: Primary data saved (22047 records). [2025-10-27T17:48:12.316088] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-27T17:48:12.316162] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CACI took 27.9s. Estimated remaining: 4h 8m 33s. Rate: 8.0 symbols/min [2025-10-27T17:48:12.418321] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-27T17:48:12.487970] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:12.492777] [DEBUG] [LOCAL ] CAF: Loaded 3518 existing records from primary storage. [2025-10-27T17:48:12.492951] [INFO ] [MAIN ] CAF: Loaded 3518 existing records. [2025-10-27T17:48:12.675021] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:12.675228] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-27T17:48:12.675273] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-27T17:48:12.675424] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-27T17:48:12.675482] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-27T17:48:13.031254] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:13.220000] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-27T17:48:13.238302] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T17:48:13.718606] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:48:13.945864] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T17:48:13.948296] [INFO ] [REMOTE ] CABO: Full fetch complete (23181 records). [2025-10-27T17:48:13.948366] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-27T17:48:14.020049] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-27T17:48:14.308840] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-27T17:48:14.308917] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-27T17:48:14.309290] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-27T17:48:14.309329] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-27T17:48:14.309968] [DEBUG] [LOCAL ] CABO: Trimmed 23181 records to 16486 (keeping 200 days of data) [2025-10-27T17:48:14.405518] [DEBUG] [LOCAL ] CABO: Primary data saved (16486 records). [2025-10-27T17:48:14.405671] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-27T17:48:14.405768] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CABO took 40.6s. Estimated remaining: 4h 7m 58s. Rate: 8.0 symbols/min [2025-10-27T17:48:14.571133] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:14.619780] [DEBUG] [LOCAL ] CAG: Loaded 54446 existing records from primary storage. [2025-10-27T17:48:14.620072] [INFO ] [MAIN ] CAG: Loaded 54446 existing records. [2025-10-27T17:48:14.795515] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:14.795732] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-27T17:48:14.795838] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-27T17:48:14.796025] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-27T17:48:14.796064] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-27T17:48:14.826032] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-27T17:48:15.142937] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:15.308534] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:48:15.316090] [INFO ] [REMOTE ] CAE: Full fetch complete (56564 records). [2025-10-27T17:48:15.316184] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-27T17:48:15.620132] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-27T17:48:15.692732] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-27T17:48:15.692812] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-27T17:48:15.693441] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-27T17:48:15.693534] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-27T17:48:15.695045] [DEBUG] [LOCAL ] CAE: Trimmed 56564 records to 38731 (keeping 200 days of data) [2025-10-27T17:48:15.915348] [DEBUG] [LOCAL ] CAE: Primary data saved (38731 records). [2025-10-27T17:48:15.915484] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-27T17:48:15.915559] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAE took 27.5s. Estimated remaining: 4h 7m 19s. Rate: 8.0 symbols/min [2025-10-27T17:48:16.080470] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:16.130966] [DEBUG] [LOCAL ] CAH: Loaded 52161 existing records from primary storage. [2025-10-27T17:48:16.131390] [INFO ] [MAIN ] CAH: Loaded 52161 existing records. [2025-10-27T17:48:16.308871] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:16.309117] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-27T17:48:16.309182] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-27T17:48:16.309503] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-27T17:48:16.309574] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-27T17:48:16.416705] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-27T17:48:16.689855] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:16.716815] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T17:48:17.175926] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T17:48:17.193048] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T17:48:17.214931] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-27T17:48:18.014954] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-27T17:48:18.814978] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-27T17:48:18.889333] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T17:48:19.205235] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T17:48:19.614975] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-27T17:48:19.688465] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:48:20.414948] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-27T17:48:21.004383] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T17:48:21.214936] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-27T17:48:22.014940] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-27T17:48:22.103394] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T17:48:22.644548] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T17:48:22.814900] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-27T17:48:23.212540] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T17:48:23.465988] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T17:48:23.614933] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-27T17:48:24.262166] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T17:48:24.414950] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-27T17:48:25.214972] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-27T17:48:25.758840] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T17:48:25.769454] [INFO ] [REMOTE ] CADE: Full fetch complete (70822 records). [2025-10-27T17:48:25.769596] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-27T17:48:26.020216] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-27T17:48:26.179443] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-27T17:48:26.179521] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-27T17:48:26.180318] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-27T17:48:26.180379] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-27T17:48:26.181690] [DEBUG] [LOCAL ] CADE: Trimmed 70822 records to 49705 (keeping 200 days of data) [2025-10-27T17:48:26.476323] [DEBUG] [LOCAL ] CADE: Primary data saved (49705 records). [2025-10-27T17:48:26.476624] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-27T17:48:26.476770] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CADE took 40.2s. Estimated remaining: 4h 7m 28s. Rate: 8.0 symbols/min [2025-10-27T17:48:26.648494] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:26.678823] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T17:48:26.719075] [DEBUG] [LOCAL ] CAL: Loaded 43308 existing records from primary storage. [2025-10-27T17:48:26.719363] [INFO ] [MAIN ] CAL: Loaded 43308 existing records. [2025-10-27T17:48:26.820750] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-27T17:48:26.900120] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:26.900286] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-27T17:48:26.900367] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-27T17:48:26.900637] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-27T17:48:26.900726] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-27T17:48:27.260991] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:27.376741] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T17:48:27.620035] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-27T17:48:27.641606] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T17:48:27.973190] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:48:28.414939] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-27T17:48:28.764381] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T17:48:29.214964] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-27T17:48:30.014933] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-27T17:48:30.814910] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-27T17:48:31.084324] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T17:48:31.268802] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T17:48:31.615007] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-27T17:48:32.420522] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-27T17:48:32.425815] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T17:48:32.755982] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T17:48:32.954893] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:48:33.214943] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-27T17:48:34.014938] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-27T17:48:34.511094] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:48:34.735948] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:48:34.737391] [INFO ] [REMOTE ] CAF: Full fetch complete (5567 records). [2025-10-27T17:48:34.737462] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-27T17:48:34.820150] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-27T17:48:35.106154] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-27T17:48:35.106229] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-27T17:48:35.106395] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-27T17:48:35.106431] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-27T17:48:35.106829] [DEBUG] [LOCAL ] CAF: Trimmed 5567 records to 3393 (keeping 200 days of data) [2025-10-27T17:48:35.126148] [DEBUG] [LOCAL ] CAF: Primary data saved (3393 records). [2025-10-27T17:48:35.126219] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-27T17:48:35.126288] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CAF took 22.8s. Estimated remaining: 4h 7m 26s. Rate: 8.0 symbols/min [2025-10-27T17:48:35.333450] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:35.371606] [DEBUG] [LOCAL ] CALX: Loaded 37702 existing records from primary storage. [2025-10-27T17:48:35.372013] [INFO ] [MAIN ] CALX: Loaded 37702 existing records. [2025-10-27T17:48:35.573949] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:35.574139] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-27T17:48:35.574186] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-27T17:48:35.574380] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-27T17:48:35.574438] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-27T17:48:35.620631] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-27T17:48:35.969695] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:36.414985] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-27T17:48:36.797549] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T17:48:37.214924] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-27T17:48:37.248688] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T17:48:37.355243] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T17:48:38.014966] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-27T17:48:38.656693] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T17:48:38.814904] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-27T17:48:38.884253] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T17:48:39.614943] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-27T17:48:40.414926] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-27T17:48:40.730073] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T17:48:41.186673] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T17:48:41.214898] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-27T17:48:41.616884] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:48:42.014944] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-27T17:48:42.317816] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T17:48:42.814937] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-27T17:48:43.614944] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-27T17:48:43.760289] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T17:48:43.770042] [INFO ] [REMOTE ] CAG: Full fetch complete (77437 records). [2025-10-27T17:48:43.770167] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-27T17:48:43.770961] [FATAL] [VALIDATOR ] CAG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:48:43.771051] [FATAL] [MAIN ] CAG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:48:43.771092] [WARN ] [MAIN ] CAG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:48:43.771138] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-27T17:48:43.771193] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-27T17:48:43.771227] [INFO ] [LOCAL ] CAG: Starting deletion of derivative data. [2025-10-27T17:48:43.771346] [DEBUG] [LOCAL ] CAG: Deleted derivative data file. [2025-10-27T17:48:43.771415] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAG took 29.4s. Estimated remaining: 4h 7m 24s. Rate: 8.0 symbols/min [2025-10-27T17:48:43.948215] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:43.974953] [DEBUG] [LOCAL ] CANG: Loaded 27307 existing records from primary storage. [2025-10-27T17:48:43.975211] [INFO ] [MAIN ] CANG: Loaded 27307 existing records. [2025-10-27T17:48:44.180534] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:48:44.184435] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:44.193617] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-27T17:48:44.193715] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-27T17:48:44.194248] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-27T17:48:44.194310] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-27T17:48:44.425189] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-27T17:48:44.588597] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:45.216964] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-27T17:48:45.219747] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T17:48:45.532502] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T17:48:46.014954] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-27T17:48:46.619576] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T17:48:46.814963] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-27T17:48:47.614962] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-27T17:48:47.744485] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T17:48:47.783034] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T17:48:48.415005] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-27T17:48:48.739951] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:48:49.215006] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-27T17:48:49.651178] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T17:48:50.015004] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-27T17:48:50.318108] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T17:48:50.814950] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-27T17:48:51.169840] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T17:48:51.178304] [INFO ] [REMOTE ] CAL: Full fetch complete (61854 records). [2025-10-27T17:48:51.178449] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-27T17:48:51.601935] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-27T17:48:51.602021] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-27T17:48:51.602840] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-27T17:48:51.602914] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-27T17:48:51.604220] [DEBUG] [LOCAL ] CAL: Trimmed 61854 records to 42457 (keeping 200 days of data) [2025-10-27T17:48:51.657325] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-27T17:48:51.867253] [DEBUG] [LOCAL ] CAL: Primary data saved (42457 records). [2025-10-27T17:48:51.867399] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-27T17:48:51.867484] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAL took 25.4s. Estimated remaining: 4h 7m 20s. Rate: 8.0 symbols/min [2025-10-27T17:48:52.040361] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:48:52.048303] [DEBUG] [LOCAL ] CAPL: Loaded 5468 existing records from primary storage. [2025-10-27T17:48:52.048498] [INFO ] [MAIN ] CAPL: Loaded 5468 existing records. [2025-10-27T17:48:52.231866] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:48:52.232123] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-27T17:48:52.232200] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-27T17:48:52.232453] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-27T17:48:52.232511] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-27T17:48:52.424348] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-27T17:48:52.626211] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:48:52.633219] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T17:48:52.662795] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T17:48:53.214946] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-27T17:48:53.936827] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T17:48:54.014919] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-27T17:48:54.685443] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:48:54.814945] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-27T17:48:55.443554] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T17:48:55.614951] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-27T17:48:56.169681] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T17:48:56.312454] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:48:56.414921] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-27T17:48:57.215004] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-27T17:48:58.015032] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-27T17:48:58.053260] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:48:58.302104] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T17:48:58.814944] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-27T17:48:59.519486] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T17:48:59.566033] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:48:59.614898] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-27T17:49:00.414994] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-27T17:49:01.215028] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-27T17:49:01.809124] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-27T17:49:02.015005] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-27T17:49:02.815003] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-27T17:49:03.247735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-27T17:49:03.257747] [INFO ] [REMOTE ] CAH: Full fetch complete (74852 records). [2025-10-27T17:49:03.257871] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-27T17:49:03.657981] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-27T17:49:03.658063] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-27T17:49:03.658917] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-27T17:49:03.658981] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-27T17:49:03.660360] [DEBUG] [LOCAL ] CAH: Trimmed 74852 records to 51367 (keeping 200 days of data) [2025-10-27T17:49:03.980348] [DEBUG] [LOCAL ] CAH: Primary data saved (51367 records). [2025-10-27T17:49:03.984713] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-27T17:49:03.986507] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAH took 48.1s. Estimated remaining: 4h 7m 36s. Rate: 8.0 symbols/min [2025-10-27T17:49:04.018943] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-27T17:49:04.060959] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-27T17:49:04.164222] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:04.210970] [DEBUG] [LOCAL ] CARR: Loaded 54382 existing records from primary storage. [2025-10-27T17:49:04.211330] [INFO ] [MAIN ] CARR: Loaded 54382 existing records. [2025-10-27T17:49:04.389600] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:04.389825] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-27T17:49:04.389874] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-27T17:49:04.390126] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-27T17:49:04.390180] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-27T17:49:04.773434] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:49:04.778795] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-27T17:49:04.781964] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T17:49:04.839954] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:04.841826] [INFO ] [REMOTE ] CALX: Full fetch complete (53776 records). [2025-10-27T17:49:04.841595] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-27T17:49:04.842765] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-27T17:49:04.850681] [FATAL] [VALIDATOR ] CALX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:04.850807] [FATAL] [MAIN ] CALX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:04.850878] [WARN ] [MAIN ] CALX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:04.850958] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-27T17:49:04.851037] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-10-27T17:49:04.851080] [INFO ] [LOCAL ] CALX: Starting deletion of derivative data. [2025-10-27T17:49:04.851272] [DEBUG] [LOCAL ] CALX: Deleted derivative data file. [2025-10-27T17:49:04.851387] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CALX took 29.7s. Estimated remaining: 4h 6m 54s. Rate: 8.0 symbols/min [2025-10-27T17:49:05.028917] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:05.073534] [DEBUG] [LOCAL ] CARS: Loaded 40381 existing records from primary storage. [2025-10-27T17:49:05.073930] [INFO ] [MAIN ] CARS: Loaded 40381 existing records. [2025-10-27T17:49:05.222925] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-27T17:49:05.254253] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:05.254473] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-27T17:49:05.254523] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-27T17:49:05.254773] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-27T17:49:05.254829] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-27T17:49:05.555987] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:49:05.644714] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:06.014994] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-27T17:49:06.814980] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-27T17:49:06.877503] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:49:07.149627] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T17:49:07.528997] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:49:07.614945] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-27T17:49:08.415004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-27T17:49:08.717299] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T17:49:08.861741] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:49:09.214947] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-27T17:49:10.014994] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-27T17:49:10.335606] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:49:10.814953] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-27T17:49:11.614924] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-27T17:49:11.825970] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T17:49:12.217424] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:49:12.314571] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T17:49:12.414909] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-27T17:49:13.214940] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-27T17:49:13.769159] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T17:49:14.015035] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-27T17:49:14.814963] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-27T17:49:14.958019] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T17:49:15.033332] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:49:15.038856] [INFO ] [REMOTE ] CANG: Full fetch complete (39170 records). [2025-10-27T17:49:15.038941] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-27T17:49:15.334417] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:49:15.424093] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-27T17:49:15.424168] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-27T17:49:15.424675] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-27T17:49:15.424736] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-27T17:49:15.425525] [DEBUG] [LOCAL ] CANG: Trimmed 39170 records to 26993 (keeping 200 days of data) [2025-10-27T17:49:15.568177] [DEBUG] [LOCAL ] CANG: Primary data saved (26993 records). [2025-10-27T17:49:15.568291] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-27T17:49:15.568369] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CANG took 31.8s. Estimated remaining: 4h 7m 3s. Rate: 8.0 symbols/min [2025-10-27T17:49:15.620692] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-27T17:49:15.737279] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:15.788319] [DEBUG] [LOCAL ] CAT: Loaded 53692 existing records from primary storage. [2025-10-27T17:49:15.788623] [INFO ] [MAIN ] CAT: Loaded 53692 existing records. [2025-10-27T17:49:15.975480] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:15.975713] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-27T17:49:15.975769] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-27T17:49:15.975976] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-27T17:49:15.976046] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-27T17:49:16.326932] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:16.414905] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-27T17:49:16.961142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T17:49:17.214947] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-27T17:49:18.014916] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-27T17:49:18.387472] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:49:18.529462] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T17:49:18.814983] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-27T17:49:19.314928] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T17:49:19.614940] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-27T17:49:20.415026] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-27T17:49:20.758719] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T17:49:21.105487] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-27T17:49:21.214933] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-27T17:49:22.014986] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-27T17:49:22.524211] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:49:22.643850] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T17:49:22.815002] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-27T17:49:22.866365] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T17:49:23.188849] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T17:49:23.614998] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-27T17:49:24.414920] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-27T17:49:25.099598] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T17:49:25.101136] [INFO ] [REMOTE ] CAPL: Full fetch complete (8700 records). [2025-10-27T17:49:25.101207] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-27T17:49:25.101576] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:25.101680] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:25.101734] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:25.101774] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-27T17:49:25.101825] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-27T17:49:25.101859] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-10-27T17:49:25.101980] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-10-27T17:49:25.102044] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CAPL took 33.2s. Estimated remaining: 4h 7m 6s. Rate: 8.0 symbols/min [2025-10-27T17:49:25.223381] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-27T17:49:25.287917] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:25.329300] [DEBUG] [LOCAL ] CATO: Loaded 6701 existing records from primary storage. [2025-10-27T17:49:25.333771] [INFO ] [MAIN ] CATO: Loaded 6701 existing records. [2025-10-27T17:49:25.398597] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T17:49:25.521815] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:25.522030] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-27T17:49:25.522095] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-27T17:49:25.522249] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-27T17:49:25.522304] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-27T17:49:25.877894] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:26.014938] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-27T17:49:26.373262] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T17:49:26.814906] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-27T17:49:26.822014] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:49:27.615037] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-27T17:49:28.106189] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T17:49:28.372700] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:49:28.414946] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-27T17:49:29.214965] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-27T17:49:29.859008] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T17:49:30.014975] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-27T17:49:30.517623] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:49:30.814897] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-27T17:49:31.035080] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:49:31.614940] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-27T17:49:32.088193] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T17:49:32.414922] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-27T17:49:32.450709] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T17:49:33.214930] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-27T17:49:34.014963] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-27T17:49:34.477801] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T17:49:34.487868] [INFO ] [REMOTE ] CARR: Full fetch complete (77381 records). [2025-10-27T17:49:34.488033] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-27T17:49:34.489095] [FATAL] [VALIDATOR ] CARR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:34.489255] [FATAL] [MAIN ] CARR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:34.489304] [WARN ] [MAIN ] CARR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:34.489376] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-27T17:49:34.489451] [DEBUG] [LOCAL ] CARR: No primary data file found to delete. [2025-10-27T17:49:34.489494] [INFO ] [LOCAL ] CARR: Starting deletion of derivative data. [2025-10-27T17:49:34.489699] [DEBUG] [LOCAL ] CARR: Deleted derivative data file. [2025-10-27T17:49:34.489815] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CARR took 30.5s. Estimated remaining: 4h 7m 8s. Rate: 8.0 symbols/min [2025-10-27T17:49:34.658289] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:34.709914] [DEBUG] [LOCAL ] CAVA: Loaded 54321 existing records from primary storage. [2025-10-27T17:49:34.710232] [INFO ] [MAIN ] CAVA: Loaded 54321 existing records. [2025-10-27T17:49:34.820183] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-27T17:49:34.889169] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:34.889390] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-27T17:49:34.889440] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-27T17:49:34.889634] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-27T17:49:34.889742] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-27T17:49:35.259313] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:35.505392] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:49:35.575623] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-27T17:49:35.605665] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:49:35.614901] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-27T17:49:36.246351] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T17:49:36.414941] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-27T17:49:37.075275] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:49:37.214983] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-27T17:49:38.015010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-27T17:49:38.426024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T17:49:38.433908] [INFO ] [REMOTE ] CARS: Full fetch complete (56400 records). [2025-10-27T17:49:38.434031] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-27T17:49:38.434939] [FATAL] [VALIDATOR ] CARS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:49:38.435029] [FATAL] [MAIN ] CARS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:49:38.435073] [WARN ] [MAIN ] CARS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:49:38.435110] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-27T17:49:38.435166] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-27T17:49:38.435201] [INFO ] [LOCAL ] CARS: Starting deletion of derivative data. [2025-10-27T17:49:38.435349] [DEBUG] [LOCAL ] CARS: Deleted derivative data file. [2025-10-27T17:49:38.435449] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CARS took 33.6s. Estimated remaining: 4h 6m 42s. Rate: 8.0 symbols/min [2025-10-27T17:49:38.604429] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:49:38.656860] [DEBUG] [LOCAL ] CB: Loaded 50705 existing records from primary storage. [2025-10-27T17:49:38.657187] [INFO ] [MAIN ] CB: Loaded 50705 existing records. [2025-10-27T17:49:38.816244] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-27T17:49:38.838152] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:49:38.838481] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-27T17:49:38.838534] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-27T17:49:38.838756] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-27T17:49:38.838814] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-27T17:49:39.193312] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:49:39.327346] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:49:39.532382] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T17:49:39.614975] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-27T17:49:40.414967] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-27T17:49:41.214917] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-27T17:49:41.673230] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:49:41.936496] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T17:49:42.014924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-27T17:49:42.194442] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:49:42.814940] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-27T17:49:43.336468] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:49:43.338309] [INFO ] [REMOTE ] CATO: Full fetch complete (10547 records). [2025-10-27T17:49:43.338378] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-27T17:49:43.622136] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-27T17:49:43.709743] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-27T17:49:43.709837] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-27T17:49:43.710235] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-27T17:49:43.710314] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-27T17:49:43.711076] [DEBUG] [LOCAL ] CATO: Trimmed 10547 records to 6605 (keeping 200 days of data) [2025-10-27T17:49:43.749260] [DEBUG] [LOCAL ] CATO: Primary data saved (6605 records). [2025-10-27T17:49:43.749406] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-27T17:49:43.749589] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CATO took 18.6s. Estimated remaining: 4h 6m 24s. Rate: 8.0 symbols/min [2025-10-27T17:49:43.837300] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T17:49:44.414951] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-27T17:49:45.215008] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-27T17:49:45.569581] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T17:49:46.014958] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-27T17:49:46.084809] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T17:49:46.815006] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-27T17:49:47.391281] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T17:49:47.614924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-27T17:49:48.203136] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T17:49:48.415138] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-27T17:49:48.449362] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:49:49.214980] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-27T17:49:49.550809] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T17:49:49.967690] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:49:50.014911] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-27T17:49:50.611623] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:49:50.814978] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-27T17:49:51.614943] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-27T17:49:51.783954] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T17:49:52.171485] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T17:49:52.414932] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-27T17:49:53.214956] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-27T17:49:53.403790] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T17:49:54.014924] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-27T17:49:54.082906] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T17:49:54.814950] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-27T17:49:55.552389] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T17:49:55.582521] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T17:49:55.592969] [INFO ] [REMOTE ] CAT: Full fetch complete (76860 records). [2025-10-27T17:49:55.593109] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-27T17:49:55.624455] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-27T17:49:55.975725] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-27T17:49:55.975810] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-27T17:49:55.976620] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-27T17:49:55.976694] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-27T17:49:55.978191] [DEBUG] [LOCAL ] CAT: Trimmed 76860 records to 52903 (keeping 200 days of data) [2025-10-27T17:49:56.316334] [DEBUG] [LOCAL ] CAT: Primary data saved (52903 records). [2025-10-27T17:49:56.316484] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-27T17:49:56.317887] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CAT took 40.7s. Estimated remaining: 4h 6m 41s. Rate: 8.0 symbols/min [2025-10-27T17:49:56.345308] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:49:56.414912] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-27T17:49:57.617444] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T17:49:57.631020] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-27T17:49:58.172037] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T17:49:58.184449] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-27T17:49:59.368035] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T17:49:59.380149] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-27T17:50:00.181135] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T17:50:00.192222] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-27T17:50:02.101151] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-27T17:50:02.111573] [INFO ] [REMOTE ] CAVA: Full fetch complete (77457 records). [2025-10-27T17:50:02.111735] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-27T17:50:02.514934] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-27T17:50:02.515021] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-27T17:50:02.515858] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-27T17:50:02.515920] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-27T17:50:02.517525] [DEBUG] [LOCAL ] CAVA: Trimmed 77457 records to 53539 (keeping 200 days of data) [2025-10-27T17:50:02.827942] [DEBUG] [LOCAL ] CAVA: Primary data saved (53539 records). [2025-10-27T17:50:02.828070] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-27T17:50:02.828453] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CAVA took 28.3s. Estimated remaining: 4h 6m 29s. Rate: 8.0 symbols/min [2025-10-27T17:50:04.293518] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (4.10 seconds). [2025-10-27T17:50:04.304529] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-27T17:50:06.724323] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T17:50:06.734137] [INFO ] [REMOTE ] CB: Full fetch complete (72857 records). [2025-10-27T17:50:06.734266] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-27T17:50:07.109407] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-27T17:50:07.109505] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-27T17:50:07.110270] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-27T17:50:07.110332] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-27T17:50:07.111712] [DEBUG] [LOCAL ] CB: Trimmed 72857 records to 49917 (keeping 200 days of data) [2025-10-27T17:50:07.413981] [DEBUG] [LOCAL ] CB: Primary data saved (49917 records). [2025-10-27T17:50:07.414119] [INFO ] [MAIN ] CB: Full history saved. [2025-10-27T17:50:07.415320] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CB took 29.0s. Estimated remaining: 4h 6m 7s. Rate: 8.0 symbols/min [2025-10-27T17:50:08.160823] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.152565] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.135621] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.184030] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-27T17:50:08.186818] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-27T17:50:08.187961] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:08.188538] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-27T17:50:08.188912] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-27T17:50:08.189006] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-27T17:50:08.189597] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-27T17:50:08.311015] [DEBUG] [LOCAL ] CBL: Loaded 16198 existing records from primary storage. [2025-10-27T17:50:08.302613] [DEBUG] [LOCAL ] CBAN: Loaded 10315 existing records from primary storage. [2025-10-27T17:50:08.302292] [DEBUG] [LOCAL ] CBNA: Loaded 2868 existing records from primary storage. [2025-10-27T17:50:08.311365] [INFO ] [MAIN ] CBAN: Loaded 10315 existing records. [2025-10-27T17:50:08.316843] [INFO ] [MAIN ] CBNA: Loaded 2868 existing records. [2025-10-27T17:50:08.311474] [INFO ] [MAIN ] CBL: Loaded 16198 existing records. [2025-10-27T17:50:08.993412] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:08.997306] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:09.021116] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.007679] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.044776] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-27T17:50:09.066347] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-27T17:50:09.082170] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:09.095018] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-27T17:50:09.095066] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-27T17:50:09.134722] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:09.134985] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-27T17:50:09.135250] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-27T17:50:09.129718] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-27T17:50:09.135343] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-27T17:50:09.147486] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-27T17:50:09.147587] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-27T17:50:09.147740] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-27T17:50:09.727673] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:50:09.815753] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-27T17:50:09.890544] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:50:09.952136] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-27T17:50:09.990763] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:50:10.000928] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-27T17:50:10.014840] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-27T17:50:10.025581] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-27T17:50:10.043459] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-27T17:50:10.081226] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.7s. Estimated remaining: 4h 5m 36s. Rate: 8.0 symbols/min [2025-10-27T17:50:10.130875] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.248590] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-27T17:50:10.278718] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.298480] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-27T17:50:10.301317] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.313021] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-27T17:50:10.407308] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:10.456147] [DEBUG] [LOCAL ] CBRE: Loaded 51042 existing records from primary storage. [2025-10-27T17:50:10.456428] [INFO ] [MAIN ] CBRE: Loaded 51042 existing records. [2025-10-27T17:50:10.626917] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:10.627072] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-27T17:50:10.627137] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-27T17:50:10.627424] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-27T17:50:10.627479] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-27T17:50:10.971484] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:10.972152] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-27T17:50:11.009531] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:50:11.011200] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-27T17:50:11.041958] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:50:11.050251] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-27T17:50:11.057191] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:50:11.061296] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-27T17:50:11.589000] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:50:11.590301] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-27T17:50:11.799504] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T17:50:11.804167] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-27T17:50:11.973897] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T17:50:11.974997] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-27T17:50:11.992187] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:50:11.996258] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-27T17:50:12.335442] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:50:12.345547] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-27T17:50:12.471616] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T17:50:12.472946] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-27T17:50:12.755386] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:50:12.759248] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-27T17:50:12.892067] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T17:50:12.913343] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T17:50:13.214983] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-27T17:50:13.297583] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T17:50:13.370137] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T17:50:14.014910] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-27T17:50:14.187036] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T17:50:14.801712] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T17:50:14.814908] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-27T17:50:15.398389] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T17:50:15.615003] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-27T17:50:15.983221] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T17:50:16.414929] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-27T17:50:16.925757] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T17:50:17.215023] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-27T17:50:18.014988] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-27T17:50:18.237225] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T17:50:18.814963] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-27T17:50:18.985320] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:50:19.589370] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T17:50:19.614901] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-27T17:50:20.414923] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-27T17:50:20.511295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T17:50:21.214909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-27T17:50:21.434549] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T17:50:21.681183] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T17:50:22.014930] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-27T17:50:22.814926] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-27T17:50:23.056822] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T17:50:23.294633] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T17:50:23.614933] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-27T17:50:24.205585] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T17:50:24.208135] [INFO ] [REMOTE ] CBAN: Full fetch complete (16346 records). [2025-10-27T17:50:24.208266] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-27T17:50:24.424014] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-27T17:50:24.603420] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-27T17:50:24.603539] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-27T17:50:24.604069] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-27T17:50:24.604137] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-27T17:50:24.604878] [DEBUG] [LOCAL ] CBAN: Trimmed 16346 records to 10025 (keeping 200 days of data) [2025-10-27T17:50:24.671406] [DEBUG] [LOCAL ] CBAN: Primary data saved (10025 records). [2025-10-27T17:50:24.671609] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-27T17:50:24.671745] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBAN took 17.3s. Estimated remaining: 4h 6m 3s. Rate: 8.0 symbols/min [2025-10-27T17:50:24.851758] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:24.885706] [DEBUG] [LOCAL ] CBT: Loaded 31300 existing records from primary storage. [2025-10-27T17:50:24.886084] [INFO ] [MAIN ] CBT: Loaded 31300 existing records. [2025-10-27T17:50:25.076969] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:25.077346] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-27T17:50:25.077406] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-27T17:50:25.077693] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-27T17:50:25.077754] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-27T17:50:25.219627] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-27T17:50:25.432864] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:25.442873] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T17:50:25.544729] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T17:50:26.014959] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-27T17:50:26.636472] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T17:50:26.639628] [INFO ] [REMOTE ] CBL: Full fetch complete (24620 records). [2025-10-27T17:50:26.639722] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-27T17:50:26.820159] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-27T17:50:26.998858] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-27T17:50:26.998932] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-27T17:50:26.999334] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-27T17:50:26.999373] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-27T17:50:27.000016] [DEBUG] [LOCAL ] CBL: Trimmed 24620 records to 15649 (keeping 200 days of data) [2025-10-27T17:50:27.093698] [DEBUG] [LOCAL ] CBL: Primary data saved (15649 records). [2025-10-27T17:50:27.093834] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-27T17:50:27.093933] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBL took 19.7s. Estimated remaining: 4h 5m 30s. Rate: 8.0 symbols/min [2025-10-27T17:50:27.259266] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:27.279213] [DEBUG] [LOCAL ] CBU: Loaded 22844 existing records from primary storage. [2025-10-27T17:50:27.279424] [INFO ] [MAIN ] CBU: Loaded 22844 existing records. [2025-10-27T17:50:27.452220] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:27.452423] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-27T17:50:27.452471] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-27T17:50:27.452633] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-27T17:50:27.452721] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-27T17:50:27.620123] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-27T17:50:27.809009] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:28.098568] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T17:50:28.099730] [INFO ] [REMOTE ] CBNA: Full fetch complete (4194 records). [2025-10-27T17:50:28.099857] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-27T17:50:28.417471] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-27T17:50:28.422791] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T17:50:28.509235] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-27T17:50:28.509318] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-27T17:50:28.509468] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-27T17:50:28.509507] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-27T17:50:28.509895] [DEBUG] [LOCAL ] CBNA: Trimmed 4194 records to 2817 (keeping 200 days of data) [2025-10-27T17:50:28.527027] [DEBUG] [LOCAL ] CBNA: Primary data saved (2817 records). [2025-10-27T17:50:28.527242] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-27T17:50:28.527334] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBNA took 21.1s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-27T17:50:28.694589] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:28.694798] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-27T17:50:28.694841] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-27T17:50:28.694960] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-27T17:50:28.695029] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-27T17:50:28.695106] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-27T17:50:28.695153] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-27T17:50:29.041635] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:29.214947] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-27T17:50:29.310463] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T17:50:30.014906] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-27T17:50:30.046158] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T17:50:30.814934] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-27T17:50:31.059378] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T17:50:31.615006] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-27T17:50:31.921524] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T17:50:32.414984] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-27T17:50:33.214955] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-27T17:50:33.528855] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T17:50:33.606019] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:50:34.014993] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-27T17:50:34.198914] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:50:34.315820] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:50:34.316161] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-27T17:50:34.316249] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:50:34.316317] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-27T17:50:34.316384] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:50:34.316455] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-27T17:50:34.316520] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-27T17:50:34.316557] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-27T17:50:34.316597] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-27T17:50:34.316678] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBX took 5.8s. Estimated remaining: 4h 4m 38s. Rate: 8.0 symbols/min [2025-10-27T17:50:34.496150] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:34.527446] [DEBUG] [LOCAL ] CBZ: Loaded 34714 existing records from primary storage. [2025-10-27T17:50:34.527749] [INFO ] [MAIN ] CBZ: Loaded 34714 existing records. [2025-10-27T17:50:34.712216] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:34.712423] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-27T17:50:34.712471] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-27T17:50:34.712718] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-27T17:50:34.712778] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-27T17:50:34.817879] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-27T17:50:35.069137] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:35.614989] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-27T17:50:36.375413] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T17:50:36.414937] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-27T17:50:36.471543] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:50:37.214941] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-27T17:50:37.267668] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:50:38.014960] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-27T17:50:38.207053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T17:50:38.814956] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-27T17:50:39.416562] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T17:50:39.614956] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-27T17:50:39.637164] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:50:40.414962] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-27T17:50:41.215005] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-27T17:50:41.352208] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T17:50:41.755345] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T17:50:42.014980] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-27T17:50:42.377043] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T17:50:42.814958] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-27T17:50:43.598087] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T17:50:43.614899] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-27T17:50:44.202082] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T17:50:44.414973] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-27T17:50:45.095023] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T17:50:45.215012] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-27T17:50:45.808274] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:50:45.814320] [INFO ] [REMOTE ] CBT: Full fetch complete (45765 records). [2025-10-27T17:50:45.814437] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-27T17:50:46.021071] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-27T17:50:46.201116] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-27T17:50:46.201203] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-27T17:50:46.201829] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-27T17:50:46.201895] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-27T17:50:46.203031] [DEBUG] [LOCAL ] CBT: Trimmed 45765 records to 30570 (keeping 200 days of data) [2025-10-27T17:50:46.387802] [DEBUG] [LOCAL ] CBT: Primary data saved (30570 records). [2025-10-27T17:50:46.387973] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-27T17:50:46.388065] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBT took 21.7s. Estimated remaining: 4h 4m 52s. Rate: 8.0 symbols/min [2025-10-27T17:50:46.560102] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:46.609832] [DEBUG] [LOCAL ] CC: Loaded 53764 existing records from primary storage. [2025-10-27T17:50:46.610214] [INFO ] [MAIN ] CC: Loaded 53764 existing records. [2025-10-27T17:50:46.789751] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:46.789945] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-27T17:50:46.789990] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-27T17:50:46.790165] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-27T17:50:46.790202] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-27T17:50:46.820575] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-27T17:50:47.228503] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:47.232483] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T17:50:47.564283] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:50:47.614949] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-27T17:50:47.808518] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T17:50:48.414948] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-27T17:50:49.214989] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-27T17:50:49.333761] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:50:49.649315] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:50:50.014904] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-27T17:50:50.108429] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T17:50:50.814938] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-27T17:50:51.166150] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T17:50:51.614934] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-27T17:50:52.019494] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T17:50:52.415035] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-27T17:50:52.745463] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:50:53.197522] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T17:50:53.214909] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-27T17:50:54.014950] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-27T17:50:54.208384] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T17:50:54.814996] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-27T17:50:55.615025] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-27T17:50:55.716205] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:50:55.959394] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T17:50:55.969094] [INFO ] [REMOTE ] CBRE: Full fetch complete (73752 records). [2025-10-27T17:50:55.969239] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-27T17:50:56.355371] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-27T17:50:56.355457] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-27T17:50:56.356291] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-27T17:50:56.356352] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-27T17:50:56.357839] [DEBUG] [LOCAL ] CBRE: Trimmed 73752 records to 50256 (keeping 200 days of data) [2025-10-27T17:50:56.416418] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-27T17:50:56.649898] [DEBUG] [LOCAL ] CBRE: Primary data saved (50256 records). [2025-10-27T17:50:56.650022] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-27T17:50:56.650581] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBRE took 46.5s. Estimated remaining: 4h 4m 58s. Rate: 8.0 symbols/min [2025-10-27T17:50:56.816592] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:56.866849] [DEBUG] [LOCAL ] CCI: Loaded 53881 existing records from primary storage. [2025-10-27T17:50:56.867182] [INFO ] [MAIN ] CCI: Loaded 53881 existing records. [2025-10-27T17:50:57.045844] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:50:57.046059] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-27T17:50:57.046112] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-27T17:50:57.046566] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-27T17:50:57.046623] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-27T17:50:57.215768] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-27T17:50:57.460019] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:57.505793] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T17:50:57.849633] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T17:50:58.014921] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-27T17:50:58.527483] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T17:50:58.532031] [INFO ] [REMOTE ] CBU: Full fetch complete (32644 records). [2025-10-27T17:50:58.532102] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-27T17:50:58.817158] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-27T17:50:58.902329] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-27T17:50:58.902405] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-27T17:50:58.902868] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-27T17:50:58.902929] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-27T17:50:58.903719] [DEBUG] [LOCAL ] CBU: Trimmed 32644 records to 22333 (keeping 200 days of data) [2025-10-27T17:50:59.035765] [DEBUG] [LOCAL ] CBU: Primary data saved (22333 records). [2025-10-27T17:50:59.035892] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-27T17:50:59.035967] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBU took 31.9s. Estimated remaining: 4h 4m 26s. Rate: 8.0 symbols/min [2025-10-27T17:50:59.203978] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:50:59.204142] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-27T17:50:59.204178] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-27T17:50:59.204288] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-27T17:50:59.204328] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-27T17:50:59.204373] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-27T17:50:59.204431] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-27T17:50:59.555859] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:50:59.614910] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-27T17:51:00.028774] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T17:51:00.134978] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T17:51:00.210125] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:51:00.414940] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-27T17:51:01.214937] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-27T17:51:02.015017] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-27T17:51:02.814996] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-27T17:51:04.406204] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T17:51:04.407493] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-27T17:51:05.028795] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (4.61 seconds). [2025-10-27T17:51:05.039777] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-27T17:51:05.077478] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-27T17:51:05.214937] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-27T17:51:05.464548] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T17:51:05.665898] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (4.45 seconds). [2025-10-27T17:51:06.014970] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-27T17:51:06.352194] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T17:51:06.636395] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:51:06.814951] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-27T17:51:07.437277] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T17:51:07.614947] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-27T17:51:07.876619] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-27T17:51:08.032078] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T17:51:08.414956] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-27T17:51:09.214968] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-27T17:51:09.618448] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:51:09.625844] [INFO ] [REMOTE ] CBZ: Full fetch complete (46632 records). [2025-10-27T17:51:09.625940] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-27T17:51:09.772078] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T17:51:10.030033] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-27T17:51:10.050160] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-27T17:51:10.050257] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-27T17:51:10.050971] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-27T17:51:10.051039] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-27T17:51:10.052464] [DEBUG] [LOCAL ] CBZ: Trimmed 46632 records to 34157 (keeping 200 days of data) [2025-10-27T17:51:10.270158] [DEBUG] [LOCAL ] CBZ: Primary data saved (34157 records). [2025-10-27T17:51:10.270304] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-27T17:51:10.270384] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CBZ took 36.0s. Estimated remaining: 4h 4m 37s. Rate: 8.0 symbols/min [2025-10-27T17:51:10.436297] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:10.450262] [DEBUG] [LOCAL ] CCIF: Loaded 15444 existing records from primary storage. [2025-10-27T17:51:10.450472] [INFO ] [MAIN ] CCIF: Loaded 15444 existing records. [2025-10-27T17:51:10.637289] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:10.637489] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-27T17:51:10.637537] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-27T17:51:10.637736] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-27T17:51:10.637792] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-27T17:51:10.817735] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-27T17:51:10.999135] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:11.290126] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T17:51:11.614941] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-27T17:51:11.779661] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T17:51:12.414940] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-27T17:51:13.214921] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-27T17:51:13.522224] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T17:51:13.601341] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T17:51:13.602367] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T17:51:14.014947] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-27T17:51:14.814990] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-27T17:51:15.615016] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-27T17:51:15.750309] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T17:51:16.121239] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T17:51:16.342975] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T17:51:16.414926] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-27T17:51:17.214960] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-27T17:51:17.930575] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T17:51:18.014913] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-27T17:51:18.221439] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T17:51:18.814984] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-27T17:51:19.615003] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-27T17:51:19.834029] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T17:51:20.176767] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T17:51:20.414962] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-27T17:51:20.515706] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T17:51:21.214929] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-27T17:51:21.396403] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T17:51:22.014934] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-27T17:51:22.814934] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-27T17:51:23.045031] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:51:23.161478] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T17:51:23.171440] [INFO ] [REMOTE ] CC: Full fetch complete (76204 records). [2025-10-27T17:51:23.171552] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-27T17:51:23.601893] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-27T17:51:23.601988] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-27T17:51:23.602822] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-27T17:51:23.602885] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-27T17:51:23.604279] [DEBUG] [LOCAL ] CC: Trimmed 76204 records to 52972 (keeping 200 days of data) [2025-10-27T17:51:23.655537] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-27T17:51:23.919916] [DEBUG] [LOCAL ] CC: Primary data saved (52972 records). [2025-10-27T17:51:23.920146] [INFO ] [MAIN ] CC: Full history saved. [2025-10-27T17:51:23.920247] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CC took 37.5s. Estimated remaining: 4h 4m 58s. Rate: 8.0 symbols/min [2025-10-27T17:51:24.092929] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:24.141919] [DEBUG] [LOCAL ] CCJ: Loaded 54470 existing records from primary storage. [2025-10-27T17:51:24.142288] [INFO ] [MAIN ] CCJ: Loaded 54470 existing records. [2025-10-27T17:51:24.327403] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:24.327824] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-27T17:51:24.328028] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-27T17:51:24.338446] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-27T17:51:24.344669] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-27T17:51:24.420917] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T17:51:24.418755] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-27T17:51:24.724369] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:24.826942] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T17:51:24.829471] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T17:51:25.214914] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-27T17:51:26.014986] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-27T17:51:26.536443] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:51:26.537445] [INFO ] [REMOTE ] CCIA: Full fetch complete (2189 records). [2025-10-27T17:51:26.537536] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-27T17:51:26.713295] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T17:51:26.713473] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:51:26.713517] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:51:26.713578] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-27T17:51:26.713639] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-27T17:51:26.713723] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-27T17:51:26.713769] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-27T17:51:26.713822] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIA took 27.7s. Estimated remaining: 4h 4m 28s. Rate: 8.0 symbols/min [2025-10-27T17:51:26.820071] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-27T17:51:26.882908] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:26.923972] [DEBUG] [LOCAL ] CCK: Loaded 47246 existing records from primary storage. [2025-10-27T17:51:26.924252] [INFO ] [MAIN ] CCK: Loaded 47246 existing records. [2025-10-27T17:51:27.101620] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:27.101871] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-27T17:51:27.101936] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-27T17:51:27.102286] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-27T17:51:27.102453] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-27T17:51:27.462086] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T17:51:27.493632] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:27.614931] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-27T17:51:28.414923] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-27T17:51:28.655639] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:51:28.961713] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:51:29.215011] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-27T17:51:30.020067] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-27T17:51:30.042043] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:51:30.814928] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-27T17:51:30.844876] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T17:51:30.892345] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T17:51:31.614999] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-27T17:51:32.226384] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T17:51:32.414924] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-27T17:51:32.515410] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T17:51:33.214998] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-27T17:51:33.888167] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T17:51:34.014957] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-27T17:51:34.291842] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T17:51:34.814945] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-27T17:51:35.054799] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:51:35.057872] [INFO ] [REMOTE ] CCIF: Full fetch complete (22004 records). [2025-10-27T17:51:35.057943] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-27T17:51:35.408559] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-27T17:51:35.408632] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-27T17:51:35.408996] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-27T17:51:35.409042] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-27T17:51:35.409590] [DEBUG] [LOCAL ] CCIF: Trimmed 22004 records to 15071 (keeping 200 days of data) [2025-10-27T17:51:35.499951] [DEBUG] [LOCAL ] CCIF: Primary data saved (15071 records). [2025-10-27T17:51:35.500140] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-27T17:51:35.500230] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCIF took 25.2s. Estimated remaining: 4h 4m 27s. Rate: 8.0 symbols/min [2025-10-27T17:51:35.620205] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-27T17:51:35.666199] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:35.715701] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-27T17:51:35.716000] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-10-27T17:51:35.889595] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:35.889811] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-27T17:51:35.889857] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-27T17:51:35.890036] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-27T17:51:35.890073] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-27T17:51:36.233567] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:36.414961] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-27T17:51:36.633044] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:51:37.214937] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-27T17:51:37.416930] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:51:37.427897] [INFO ] [REMOTE ] CCI: Full fetch complete (77093 records). [2025-10-27T17:51:37.428018] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-27T17:51:37.817367] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-27T17:51:37.817546] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-27T17:51:37.818564] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-27T17:51:37.818681] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-27T17:51:37.820296] [DEBUG] [LOCAL ] CCI: Trimmed 77093 records to 53098 (keeping 200 days of data) [2025-10-27T17:51:38.022739] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-27T17:51:38.085447] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:51:38.214141] [DEBUG] [LOCAL ] CCI: Primary data saved (53098 records). [2025-10-27T17:51:38.214304] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-27T17:51:38.215370] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCI took 41.6s. Estimated remaining: 4h 3m 57s. Rate: 8.0 symbols/min [2025-10-27T17:51:38.390795] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:38.437774] [DEBUG] [LOCAL ] CCO: Loaded 49282 existing records from primary storage. [2025-10-27T17:51:38.438115] [INFO ] [MAIN ] CCO: Loaded 49282 existing records. [2025-10-27T17:51:38.617134] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:38.617360] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-27T17:51:38.617407] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-27T17:51:38.617576] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-27T17:51:38.617613] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-27T17:51:38.827131] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-27T17:51:38.976589] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:39.340395] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T17:51:39.475762] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:51:39.614938] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-27T17:51:40.414920] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-27T17:51:40.682499] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T17:51:41.214983] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-27T17:51:41.725881] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:51:41.819947] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-27T17:51:42.014982] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-27T17:51:42.814909] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-27T17:51:43.000711] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T17:51:43.614947] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-27T17:51:43.765335] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:51:44.076180] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T17:51:44.414971] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-27T17:51:45.214927] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-27T17:51:45.598264] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T17:51:46.014949] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-27T17:51:46.628801] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:51:46.667499] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-27T17:51:46.814951] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-27T17:51:47.236307] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T17:51:47.615036] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-27T17:51:48.420046] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-27T17:51:48.435316] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T17:51:49.214941] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-27T17:51:49.815973] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T17:51:49.880725] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T17:51:50.014935] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-27T17:51:50.403138] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T17:51:50.814994] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-27T17:51:51.567249] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T17:51:51.614901] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-27T17:51:52.414916] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-27T17:51:52.593557] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T17:51:53.214987] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-27T17:51:53.348812] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:51:53.811398] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T17:51:54.014962] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-27T17:51:54.814944] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-27T17:51:55.310207] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-27T17:51:55.614936] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-27T17:51:56.414938] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-27T17:51:56.454321] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T17:51:56.541768] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-27T17:51:56.551930] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-27T17:51:56.552055] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-27T17:51:56.930908] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-27T17:51:56.930989] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-27T17:51:56.931809] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-27T17:51:56.931873] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-27T17:51:56.933276] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-27T17:51:57.220674] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-27T17:51:57.244049] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-27T17:51:57.244178] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-27T17:51:57.244275] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCJ took 33.3s. Estimated remaining: 4h 4m 44s. Rate: 8.0 symbols/min [2025-10-27T17:51:57.410394] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:57.420002] [DEBUG] [LOCAL ] CCRD: Loaded 9672 existing records from primary storage. [2025-10-27T17:51:57.420198] [INFO ] [MAIN ] CCRD: Loaded 9672 existing records. [2025-10-27T17:51:57.600545] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:57.601135] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-27T17:51:57.601384] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-27T17:51:57.601638] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-27T17:51:57.601729] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-27T17:51:57.947898] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:51:58.024623] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:58.025987] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-27T17:51:58.058304] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T17:51:58.595256] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T17:51:58.604289] [INFO ] [REMOTE ] CCK: Full fetch complete (67870 records). [2025-10-27T17:51:58.604450] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-27T17:51:58.605222] [FATAL] [VALIDATOR ] CCK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:51:58.605331] [FATAL] [MAIN ] CCK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:51:58.605400] [WARN ] [MAIN ] CCK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:51:58.605485] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-27T17:51:58.605564] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-27T17:51:58.605601] [INFO ] [LOCAL ] CCK: Starting deletion of derivative data. [2025-10-27T17:51:58.605762] [DEBUG] [LOCAL ] CCK: Deleted derivative data file. [2025-10-27T17:51:58.605851] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCK took 31.9s. Estimated remaining: 4h 4m 7s. Rate: 8.0 symbols/min [2025-10-27T17:51:58.774037] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:51:58.806019] [DEBUG] [LOCAL ] CCS: Loaded 30380 existing records from primary storage. [2025-10-27T17:51:58.806972] [INFO ] [MAIN ] CCS: Loaded 30380 existing records. [2025-10-27T17:51:58.820356] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-27T17:51:58.903145] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T17:51:58.997634] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:51:58.998076] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-27T17:51:58.998135] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-27T17:51:58.998719] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-27T17:51:58.998779] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-27T17:51:59.340973] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:51:59.614948] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-27T17:52:00.414967] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-27T17:52:00.483962] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:52:01.214994] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-27T17:52:01.807376] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-27T17:52:02.015002] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-27T17:52:02.815007] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-27T17:52:03.766795] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-27T17:52:03.768415] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-27T17:52:04.438830] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T17:52:04.445629] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-27T17:52:05.173420] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (4.76 seconds). [2025-10-27T17:52:05.214904] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-27T17:52:05.410583] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-27T17:52:05.513491] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T17:52:06.014926] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-27T17:52:06.103211] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T17:52:06.649870] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T17:52:06.814940] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-27T17:52:07.329025] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T17:52:07.366742] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T17:52:07.614941] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-27T17:52:08.414945] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-27T17:52:09.189669] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T17:52:09.214939] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-27T17:52:09.829163] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-27T17:52:09.839614] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-27T17:52:09.839793] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-27T17:52:10.029568] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-27T17:52:10.251681] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-27T17:52:10.251768] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-27T17:52:10.252579] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-27T17:52:10.252639] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-27T17:52:10.254043] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-27T17:52:10.476704] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T17:52:10.601251] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-27T17:52:10.601385] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-27T17:52:10.601983] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCL took 35.1s. Estimated remaining: 4h 4m 21s. Rate: 8.0 symbols/min [2025-10-27T17:52:10.768244] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:10.788915] [DEBUG] [LOCAL ] CCU: Loaded 21859 existing records from primary storage. [2025-10-27T17:52:10.789149] [INFO ] [MAIN ] CCU: Loaded 21859 existing records. [2025-10-27T17:52:10.820028] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-27T17:52:10.962969] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:10.963165] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-27T17:52:10.963213] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-27T17:52:10.963469] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-27T17:52:10.963518] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-27T17:52:11.311356] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:11.614941] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-27T17:52:11.766620] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T17:52:11.776895] [INFO ] [REMOTE ] CCO: Full fetch complete (67494 records). [2025-10-27T17:52:11.777141] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-27T17:52:12.181497] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-27T17:52:12.191325] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-27T17:52:12.194329] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-27T17:52:12.195137] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-27T17:52:12.196106] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:52:12.205617] [DEBUG] [LOCAL ] CCO: Trimmed 67494 records to 48691 (keeping 200 days of data) [2025-10-27T17:52:12.416202] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-27T17:52:12.480165] [DEBUG] [LOCAL ] CCO: Primary data saved (48691 records). [2025-10-27T17:52:12.480466] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-27T17:52:12.480639] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCO took 34.3s. Estimated remaining: 4h 3m 47s. Rate: 8.0 symbols/min [2025-10-27T17:52:12.644709] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T17:52:12.681815] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:12.681978] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-27T17:52:12.682015] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-27T17:52:12.682128] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-27T17:52:12.682169] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-27T17:52:12.682210] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-27T17:52:12.682245] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-27T17:52:13.079843] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:13.087698] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T17:52:13.214985] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-27T17:52:13.535305] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T17:52:14.014942] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-27T17:52:14.615398] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T17:52:14.814939] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-27T17:52:15.589712] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T17:52:15.614918] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-27T17:52:16.258718] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T17:52:16.260787] [INFO ] [REMOTE ] CCRD: Full fetch complete (11713 records). [2025-10-27T17:52:16.260855] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-27T17:52:16.429108] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-27T17:52:16.646798] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-27T17:52:16.646873] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-27T17:52:16.647155] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-27T17:52:16.647213] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-27T17:52:16.647706] [DEBUG] [LOCAL ] CCRD: Trimmed 11713 records to 9616 (keeping 200 days of data) [2025-10-27T17:52:16.701138] [DEBUG] [LOCAL ] CCRD: Primary data saved (9616 records). [2025-10-27T17:52:16.701260] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-27T17:52:16.701334] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCRD took 19.5s. Estimated remaining: 4h 3m 24s. Rate: 8.0 symbols/min [2025-10-27T17:52:16.864475] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:16.912377] [DEBUG] [LOCAL ] CDE: Loaded 54424 existing records from primary storage. [2025-10-27T17:52:16.912700] [INFO ] [MAIN ] CDE: Loaded 54424 existing records. [2025-10-27T17:52:17.085535] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:17.085782] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-27T17:52:17.085829] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-27T17:52:17.085996] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-27T17:52:17.086034] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-27T17:52:17.220765] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-27T17:52:17.436910] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:17.572149] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T17:52:18.015027] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-27T17:52:18.154251] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T17:52:18.317838] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T17:52:18.814939] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-27T17:52:19.033205] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-27T17:52:19.614945] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-27T17:52:20.414949] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-27T17:52:20.924783] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:52:21.214941] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-27T17:52:21.481077] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T17:52:22.014950] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-27T17:52:22.814931] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-27T17:52:23.042114] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T17:52:23.246684] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T17:52:23.614942] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-27T17:52:23.997221] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T17:52:24.414951] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-27T17:52:24.529512] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T17:52:25.214948] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-27T17:52:26.014954] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-27T17:52:26.147073] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T17:52:26.199040] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T17:52:26.814916] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-27T17:52:26.880186] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T17:52:27.614976] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-27T17:52:28.016324] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T17:52:28.414991] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-27T17:52:28.832256] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:52:28.837488] [INFO ] [REMOTE ] CCS: Full fetch complete (44749 records). [2025-10-27T17:52:28.837617] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-27T17:52:29.217931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-27T17:52:29.218163] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-27T17:52:29.218241] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-27T17:52:29.219731] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-27T17:52:29.219815] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-27T17:52:29.220852] [DEBUG] [LOCAL ] CCS: Trimmed 44749 records to 29822 (keeping 200 days of data) [2025-10-27T17:52:29.397549] [DEBUG] [LOCAL ] CCS: Primary data saved (29822 records). [2025-10-27T17:52:29.397700] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-27T17:52:29.397789] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCS took 30.8s. Estimated remaining: 4h 3m 41s. Rate: 8.0 symbols/min [2025-10-27T17:52:29.566149] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:29.577770] [DEBUG] [LOCAL ] CDLR: Loaded 10348 existing records from primary storage. [2025-10-27T17:52:29.577974] [INFO ] [MAIN ] CDLR: Loaded 10348 existing records. [2025-10-27T17:52:29.751019] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:29.751213] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-27T17:52:29.751291] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-27T17:52:29.751503] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-27T17:52:29.751568] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-27T17:52:30.019745] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-27T17:52:30.123359] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:30.138440] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T17:52:30.362164] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T17:52:30.494000] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:52:30.814920] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-27T17:52:31.614962] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-27T17:52:32.219733] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:52:32.391577] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:52:32.414905] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-27T17:52:33.214907] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-27T17:52:33.609973] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T17:52:33.613603] [INFO ] [REMOTE ] CCU: Full fetch complete (32277 records). [2025-10-27T17:52:33.613713] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-27T17:52:33.747324] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T17:52:33.995713] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-27T17:52:33.995806] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-27T17:52:33.996260] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-27T17:52:33.996300] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-27T17:52:33.997007] [DEBUG] [LOCAL ] CCU: Trimmed 32277 records to 21160 (keeping 200 days of data) [2025-10-27T17:52:34.043693] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-27T17:52:34.117915] [DEBUG] [LOCAL ] CCU: Primary data saved (21160 records). [2025-10-27T17:52:34.118018] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-27T17:52:34.118088] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCU took 23.5s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-10-27T17:52:34.291238] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:34.330356] [DEBUG] [LOCAL ] CDP: Loaded 42901 existing records from primary storage. [2025-10-27T17:52:34.330636] [INFO ] [MAIN ] CDP: Loaded 42901 existing records. [2025-10-27T17:52:34.505776] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:34.505997] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-27T17:52:34.506055] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-27T17:52:34.506227] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-27T17:52:34.506266] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-27T17:52:34.620138] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T17:52:34.820160] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-27T17:52:34.877293] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:35.171918] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T17:52:35.614942] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-27T17:52:35.926463] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:52:35.926830] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-27T17:52:35.926931] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:52:35.927045] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-27T17:52:35.927148] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:52:35.927230] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-27T17:52:35.927305] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-27T17:52:35.927347] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-27T17:52:35.927396] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-27T17:52:35.927449] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CCZ took 23.4s. Estimated remaining: 4h 2m 47s. Rate: 8.0 symbols/min [2025-10-27T17:52:36.105304] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:36.127308] [DEBUG] [LOCAL ] CDRE: Loaded 24976 existing records from primary storage. [2025-10-27T17:52:36.127568] [INFO ] [MAIN ] CDRE: Loaded 24976 existing records. [2025-10-27T17:52:36.301799] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:36.301987] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-27T17:52:36.302032] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-27T17:52:36.302221] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-27T17:52:36.302259] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-27T17:52:36.420170] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-27T17:52:36.658004] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:37.214945] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-27T17:52:38.015074] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-27T17:52:38.074407] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T17:52:38.704322] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T17:52:38.794424] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T17:52:38.815002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-27T17:52:39.614984] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-27T17:52:40.369346] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T17:52:40.414897] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-27T17:52:41.143923] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T17:52:41.214902] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-27T17:52:41.727748] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T17:52:42.014965] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-27T17:52:42.217990] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:52:42.814946] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-27T17:52:43.614980] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-27T17:52:43.967518] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T17:52:44.177827] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T17:52:44.424878] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-27T17:52:44.430023] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T17:52:45.214990] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-27T17:52:45.943616] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T17:52:46.014968] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-27T17:52:46.425335] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T17:52:46.814949] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-27T17:52:47.253702] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T17:52:47.615031] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-27T17:52:48.415012] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-27T17:52:49.029433] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T17:52:49.183777] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T17:52:49.214902] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-27T17:52:49.253449] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:52:49.267336] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-27T17:52:49.267489] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-27T17:52:49.651816] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-27T17:52:49.651892] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-27T17:52:49.652702] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-27T17:52:49.652765] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-27T17:52:49.654138] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 53644 (keeping 200 days of data) [2025-10-27T17:52:49.965497] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-27T17:52:49.965699] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-27T17:52:49.965804] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDE took 33.3s. Estimated remaining: 4h 3m 9s. Rate: 8.0 symbols/min [2025-10-27T17:52:50.021905] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-27T17:52:50.138672] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:52:50.182966] [DEBUG] [LOCAL ] CE: Loaded 51959 existing records from primary storage. [2025-10-27T17:52:50.183282] [INFO ] [MAIN ] CE: Loaded 51959 existing records. [2025-10-27T17:52:50.362959] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:52:50.363193] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-27T17:52:50.363240] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-27T17:52:50.363501] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-27T17:52:50.363538] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-27T17:52:50.726025] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:52:50.750954] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T17:52:50.814949] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-27T17:52:51.283389] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T17:52:51.615000] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-27T17:52:52.053080] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T17:52:52.414928] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-27T17:52:52.924895] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:52:53.215001] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-27T17:52:53.567152] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:52:53.819738] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T17:52:54.014969] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-27T17:52:54.814947] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-27T17:52:54.836522] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:52:55.614940] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-27T17:52:55.645909] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T17:52:56.415004] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-27T17:52:56.870585] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T17:52:57.034448] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T17:52:57.214943] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-27T17:52:58.014953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-27T17:52:58.395615] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T17:52:58.814909] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-27T17:52:59.400774] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T17:52:59.614982] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-27T17:52:59.663908] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T17:53:00.414960] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-27T17:53:01.214971] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-27T17:53:02.014958] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-27T17:53:02.593212] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-27T17:53:02.815009] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-27T17:53:05.212759] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (4.80 seconds). [2025-10-27T17:53:05.221821] [INFO ] [REMOTE ] CDP: Full fetch complete (62217 records). [2025-10-27T17:53:05.221969] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-27T17:53:05.421787] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (4.21 seconds). [2025-10-27T17:53:05.466038] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-27T17:53:05.684874] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-27T17:53:05.684985] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-27T17:53:05.685695] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-27T17:53:05.685899] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-27T17:53:05.687410] [DEBUG] [LOCAL ] CDP: Trimmed 62217 records to 42185 (keeping 200 days of data) [2025-10-27T17:53:05.814547] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-27T17:53:05.858124] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-27T17:53:06.004325] [DEBUG] [LOCAL ] CDP: Primary data saved (42185 records). [2025-10-27T17:53:06.013046] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-27T17:53:06.013849] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDP took 31.9s. Estimated remaining: 4h 3m 41s. Rate: 8.0 symbols/min [2025-10-27T17:53:06.045905] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (4.03 seconds). [2025-10-27T17:53:06.073297] [INFO ] [REMOTE ] CDLR: Full fetch complete (14367 records). [2025-10-27T17:53:06.087626] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-27T17:53:06.352003] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:06.495032] [DEBUG] [LOCAL ] CEE: Loaded 5157 existing records from primary storage. [2025-10-27T17:53:06.498404] [INFO ] [MAIN ] CEE: Loaded 5157 existing records. [2025-10-27T17:53:06.741681] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-27T17:53:06.761335] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:06.761918] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-27T17:53:06.762006] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-27T17:53:06.761614] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-27T17:53:06.762732] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-27T17:53:06.762819] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-27T17:53:06.763038] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-27T17:53:06.762960] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-27T17:53:06.806992] [DEBUG] [LOCAL ] CDLR: Trimmed 14367 records to 10141 (keeping 200 days of data) [2025-10-27T17:53:06.953075] [DEBUG] [LOCAL ] CDLR: Primary data saved (10141 records). [2025-10-27T17:53:06.963576] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-27T17:53:06.983440] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDLR took 37.6s. Estimated remaining: 4h 3m 3s. Rate: 8.0 symbols/min [2025-10-27T17:53:07.020164] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T17:53:07.111563] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-27T17:53:07.392305] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:07.398060] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:07.398785] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-27T17:53:07.425881] [DEBUG] [LOCAL ] CEPU: Loaded 27514 existing records from primary storage. [2025-10-27T17:53:07.426196] [INFO ] [MAIN ] CEPU: Loaded 27514 existing records. [2025-10-27T17:53:07.610425] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:07.610702] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-27T17:53:07.610773] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-27T17:53:07.610951] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-27T17:53:07.610991] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-27T17:53:07.983454] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:07.983902] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-27T17:53:08.124417] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:53:08.125993] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-27T17:53:08.233589] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T17:53:08.301837] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T17:53:08.414909] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-27T17:53:09.013336] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:53:09.078621] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T17:53:09.214953] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-27T17:53:09.566660] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T17:53:10.014974] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-27T17:53:10.204300] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T17:53:10.665374] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T17:53:10.814947] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-27T17:53:11.615044] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-27T17:53:12.050435] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T17:53:12.055026] [INFO ] [REMOTE ] CDRE: Full fetch complete (34961 records). [2025-10-27T17:53:12.055115] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-27T17:53:12.346084] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T17:53:12.420055] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-27T17:53:12.433262] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-27T17:53:12.433318] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-27T17:53:12.433808] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-27T17:53:12.433873] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-27T17:53:12.434822] [DEBUG] [LOCAL ] CDRE: Trimmed 34961 records to 24420 (keeping 200 days of data) [2025-10-27T17:53:12.575521] [DEBUG] [LOCAL ] CDRE: Primary data saved (24420 records). [2025-10-27T17:53:12.575665] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-27T17:53:12.575761] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CDRE took 36.6s. Estimated remaining: 4h 2m 47s. Rate: 8.0 symbols/min [2025-10-27T17:53:12.760850] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:12.805909] [DEBUG] [LOCAL ] CF: Loaded 52842 existing records from primary storage. [2025-10-27T17:53:12.806207] [INFO ] [MAIN ] CF: Loaded 52842 existing records. [2025-10-27T17:53:12.979415] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:12.979610] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-27T17:53:12.979682] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-27T17:53:12.979978] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-27T17:53:12.980017] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-27T17:53:13.223791] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-27T17:53:13.351088] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:13.545162] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T17:53:14.014939] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-27T17:53:14.472218] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T17:53:14.814944] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-27T17:53:15.109192] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T17:53:15.615009] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-27T17:53:16.414932] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-27T17:53:16.690742] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T17:53:16.740121] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T17:53:17.214945] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-27T17:53:17.610370] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:53:18.011594] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T17:53:18.021541] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-27T17:53:18.782082] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T17:53:18.814898] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-27T17:53:19.614977] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-27T17:53:19.637466] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T17:53:20.414942] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-27T17:53:20.801019] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T17:53:21.214924] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-27T17:53:21.363568] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T17:53:21.633528] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T17:53:21.634722] [INFO ] [REMOTE ] CEE: Full fetch complete (10120 records). [2025-10-27T17:53:21.634795] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-27T17:53:22.028882] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-27T17:53:22.020461] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-27T17:53:22.029098] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-27T17:53:22.029616] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-27T17:53:22.030342] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-27T17:53:22.030812] [DEBUG] [LOCAL ] CEE: Trimmed 10120 records to 4934 (keeping 200 days of data) [2025-10-27T17:53:22.060053] [DEBUG] [LOCAL ] CEE: Primary data saved (4934 records). [2025-10-27T17:53:22.060149] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-27T17:53:22.060222] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CEE took 16.0s. Estimated remaining: 4h 2m 49s. Rate: 8.0 symbols/min [2025-10-27T17:53:22.231079] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:22.282044] [DEBUG] [LOCAL ] CFG: Loaded 54402 existing records from primary storage. [2025-10-27T17:53:22.282379] [INFO ] [MAIN ] CFG: Loaded 54402 existing records. [2025-10-27T17:53:22.455479] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:22.455727] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-27T17:53:22.455781] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-27T17:53:22.455981] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-27T17:53:22.456045] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-27T17:53:22.799157] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:22.815115] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-27T17:53:23.220881] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T17:53:23.614992] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-27T17:53:24.396047] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T17:53:24.414917] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-27T17:53:24.979584] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T17:53:25.214951] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-27T17:53:26.014922] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-27T17:53:26.121870] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:53:26.132751] [INFO ] [REMOTE ] CE: Full fetch complete (74745 records). [2025-10-27T17:53:26.132923] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-27T17:53:26.494074] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T17:53:26.722782] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-27T17:53:26.722888] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-27T17:53:26.723807] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-27T17:53:26.723877] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-27T17:53:26.725538] [DEBUG] [LOCAL ] CE: Trimmed 74745 records to 51167 (keeping 200 days of data) [2025-10-27T17:53:26.822849] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-27T17:53:27.056406] [DEBUG] [LOCAL ] CE: Primary data saved (51167 records). [2025-10-27T17:53:27.056548] [INFO ] [MAIN ] CE: Full history saved. [2025-10-27T17:53:27.056628] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CE took 37.1s. Estimated remaining: 4h 2m 30s. Rate: 8.0 symbols/min [2025-10-27T17:53:27.234179] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:27.234362] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-27T17:53:27.234410] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-27T17:53:27.234520] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-27T17:53:27.234564] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-27T17:53:27.234604] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-27T17:53:27.234681] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-27T17:53:27.583481] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:27.614897] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-27T17:53:27.688076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T17:53:27.805812] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:53:27.806064] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-27T17:53:27.806162] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:53:27.806233] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-27T17:53:27.806268] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:53:27.806307] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-27T17:53:27.806362] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-27T17:53:27.806397] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-27T17:53:27.806435] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-27T17:53:27.806481] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CFND took 0.7s. Estimated remaining: 4h 1m 52s. Rate: 8.0 symbols/min [2025-10-27T17:53:27.972803] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:28.002999] [DEBUG] [LOCAL ] CFR: Loaded 32889 existing records from primary storage. [2025-10-27T17:53:28.003262] [INFO ] [MAIN ] CFR: Loaded 32889 existing records. [2025-10-27T17:53:28.179731] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:28.180112] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-27T17:53:28.180258] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-27T17:53:28.187417] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-27T17:53:28.197200] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-27T17:53:28.262014] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:53:28.420233] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-27T17:53:28.557884] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:29.214988] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-27T17:53:29.976402] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:53:30.014905] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-27T17:53:30.808689] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T17:53:30.818492] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-27T17:53:31.274620] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T17:53:31.615029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-27T17:53:32.290349] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T17:53:32.414930] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-27T17:53:32.548229] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:53:33.214944] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-27T17:53:34.014976] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-27T17:53:34.268549] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:53:34.804421] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T17:53:34.815031] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-27T17:53:35.412327] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T17:53:35.614954] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-27T17:53:36.102605] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T17:53:36.414927] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-27T17:53:36.811180] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T17:53:37.214947] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-27T17:53:37.834326] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T17:53:38.014960] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-27T17:53:38.393575] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:53:38.814938] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-27T17:53:39.614949] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-27T17:53:39.996832] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T17:53:40.414963] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-27T17:53:40.665352] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T17:53:40.726202] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T17:53:41.214969] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-27T17:53:41.781363] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:53:42.014910] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-27T17:53:42.080545] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:53:42.486235] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T17:53:42.496629] [INFO ] [REMOTE ] CF: Full fetch complete (75589 records). [2025-10-27T17:53:42.496809] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-27T17:53:42.820042] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-27T17:53:42.905261] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-27T17:53:42.905336] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-27T17:53:42.906132] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-27T17:53:42.906193] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-27T17:53:42.907775] [DEBUG] [LOCAL ] CF: Trimmed 75589 records to 52070 (keeping 200 days of data) [2025-10-27T17:53:43.211889] [DEBUG] [LOCAL ] CF: Primary data saved (52070 records). [2025-10-27T17:53:43.212010] [INFO ] [MAIN ] CF: Full history saved. [2025-10-27T17:53:43.212714] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CF took 30.6s. Estimated remaining: 4h 2m 20s. Rate: 8.0 symbols/min [2025-10-27T17:53:43.377680] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:43.418568] [DEBUG] [LOCAL ] CGAU: Loaded 44606 existing records from primary storage. [2025-10-27T17:53:43.418895] [INFO ] [MAIN ] CGAU: Loaded 44606 existing records. [2025-10-27T17:53:43.597160] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:43.597366] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-27T17:53:43.597412] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-27T17:53:43.597743] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-27T17:53:43.597798] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-27T17:53:43.620042] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-27T17:53:43.963886] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:44.013819] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T17:53:44.414936] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-27T17:53:45.214938] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-27T17:53:45.346217] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:53:45.413747] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:53:46.014998] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-27T17:53:46.291706] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T17:53:46.814934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-27T17:53:47.488930] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:53:47.614911] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-27T17:53:47.924162] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T17:53:48.414993] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-27T17:53:49.218074] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-27T17:53:49.233306] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:53:49.449026] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T17:53:50.014956] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-27T17:53:50.132683] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T17:53:50.814951] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-27T17:53:51.461257] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T17:53:51.614921] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-27T17:53:52.340293] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T17:53:52.354510] [INFO ] [REMOTE ] CEPU: Full fetch complete (39710 records). [2025-10-27T17:53:52.354776] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-27T17:53:52.420465] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-27T17:53:52.729092] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-27T17:53:52.729164] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-27T17:53:52.729712] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-27T17:53:52.729773] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-27T17:53:52.730569] [DEBUG] [LOCAL ] CEPU: Trimmed 39710 records to 27156 (keeping 200 days of data) [2025-10-27T17:53:52.878520] [DEBUG] [LOCAL ] CEPU: Primary data saved (27156 records). [2025-10-27T17:53:52.878638] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-27T17:53:52.878757] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CEPU took 45.9s. Estimated remaining: 4h 2m 22s. Rate: 8.0 symbols/min [2025-10-27T17:53:53.045557] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:53.049262] [DEBUG] [LOCAL ] CGV: Loaded 1374 existing records from primary storage. [2025-10-27T17:53:53.049398] [INFO ] [MAIN ] CGV: Loaded 1374 existing records. [2025-10-27T17:53:53.216700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-27T17:53:53.236866] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:53.237758] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-27T17:53:53.237807] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-27T17:53:53.237916] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-27T17:53:53.237958] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-27T17:53:53.605941] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:53.633567] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T17:53:53.643835] [INFO ] [REMOTE ] CFG: Full fetch complete (77780 records). [2025-10-27T17:53:53.643958] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-27T17:53:54.021303] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-27T17:53:54.041140] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-27T17:53:54.041222] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-27T17:53:54.042093] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-27T17:53:54.042362] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-27T17:53:54.044310] [DEBUG] [LOCAL ] CFG: Trimmed 77780 records to 53622 (keeping 200 days of data) [2025-10-27T17:53:54.179328] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T17:53:54.406982] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-27T17:53:54.425068] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-27T17:53:54.425280] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFG took 32.4s. Estimated remaining: 4h 1m 48s. Rate: 8.0 symbols/min [2025-10-27T17:53:54.426710] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T17:53:54.481817] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T17:53:54.612873] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:53:54.636557] [DEBUG] [LOCAL ] CHCT: Loaded 24555 existing records from primary storage. [2025-10-27T17:53:54.636849] [INFO ] [MAIN ] CHCT: Loaded 24555 existing records. [2025-10-27T17:53:54.817432] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:53:54.817493] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-27T17:53:54.817851] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-27T17:53:54.818722] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-27T17:53:54.819092] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-27T17:53:54.819150] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-27T17:53:55.177917] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:53:55.411801] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T17:53:55.614990] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-27T17:53:56.414916] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-27T17:53:56.713767] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T17:53:56.768162] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T17:53:57.214990] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-27T17:53:57.684371] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T17:53:58.015000] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-27T17:53:58.814926] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-27T17:53:59.154446] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T17:53:59.614952] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-27T17:53:59.655631] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T17:54:00.039440] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T17:54:00.414979] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-27T17:54:01.214980] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-27T17:54:02.014977] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-27T17:54:02.815016] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-27T17:54:03.469598] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-27T17:54:03.614944] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-27T17:54:05.129936] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (3.91 seconds). [2025-10-27T17:54:05.141174] [INFO ] [REMOTE ] CFR: Full fetch complete (48433 records). [2025-10-27T17:54:05.147848] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-27T17:54:05.148948] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-27T17:54:05.153884] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:05.154678] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-27T17:54:05.154388] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:05.155422] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:05.155510] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-27T17:54:05.155592] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-27T17:54:05.155692] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-27T17:54:05.155842] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-27T17:54:05.155913] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CFR took 37.3s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-10-27T17:54:05.271771] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:54:05.273047] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-27T17:54:05.345287] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:05.390555] [DEBUG] [LOCAL ] CHD: Loaded 53076 existing records from primary storage. [2025-10-27T17:54:05.390903] [INFO ] [MAIN ] CHD: Loaded 53076 existing records. [2025-10-27T17:54:05.564389] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:05.564575] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-27T17:54:05.564622] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-27T17:54:05.564920] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-27T17:54:05.564974] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-27T17:54:05.826951] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T17:54:05.914440] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:06.014908] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-27T17:54:06.699394] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (4.68 seconds). [2025-10-27T17:54:06.814937] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-27T17:54:07.122228] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T17:54:07.614998] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-27T17:54:07.989287] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:54:08.259856] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:54:08.369993] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T17:54:08.414966] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-27T17:54:09.214962] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-27T17:54:09.995961] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:54:10.014903] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-27T17:54:10.814959] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-27T17:54:10.875499] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T17:54:11.337737] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T17:54:11.338575] [INFO ] [REMOTE ] CGV: Full fetch complete (2198 records). [2025-10-27T17:54:11.338667] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-27T17:54:11.619891] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-27T17:54:11.652492] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T17:54:11.772199] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-27T17:54:11.772285] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-27T17:54:11.772415] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-27T17:54:11.772485] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-27T17:54:11.772863] [DEBUG] [LOCAL ] CGV: Trimmed 2198 records to 1306 (keeping 200 days of data) [2025-10-27T17:54:11.781051] [DEBUG] [LOCAL ] CGV: Primary data saved (1306 records). [2025-10-27T17:54:11.781115] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-27T17:54:11.781180] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CGV took 18.9s. Estimated remaining: 4h 1m 43s. Rate: 8.0 symbols/min [2025-10-27T17:54:11.956998] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:11.973209] [DEBUG] [LOCAL ] CHE: Loaded 15561 existing records from primary storage. [2025-10-27T17:54:11.973444] [INFO ] [MAIN ] CHE: Loaded 15561 existing records. [2025-10-27T17:54:12.161351] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:12.161556] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-27T17:54:12.161617] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-27T17:54:12.161836] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-27T17:54:12.161900] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-27T17:54:12.420187] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-27T17:54:12.611781] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:54:12.617121] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:13.214964] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-27T17:54:14.020534] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-27T17:54:14.039401] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T17:54:14.292679] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:54:14.733827] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T17:54:14.814948] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-27T17:54:15.614938] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-27T17:54:16.061050] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T17:54:16.415020] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-27T17:54:17.214944] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-27T17:54:17.331860] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T17:54:17.350789] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T17:54:18.014951] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-27T17:54:18.118036] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T17:54:18.586266] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T17:54:18.814987] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-27T17:54:19.621181] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-27T17:54:19.623500] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T17:54:20.327157] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T17:54:20.414926] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-27T17:54:21.214930] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-27T17:54:21.438569] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:54:21.443098] [INFO ] [REMOTE ] CHCT: Full fetch complete (34544 records). [2025-10-27T17:54:21.443185] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-27T17:54:21.443709] [FATAL] [VALIDATOR ] CHCT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:21.443794] [FATAL] [MAIN ] CHCT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:21.443835] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:21.443897] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-27T17:54:21.443957] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-27T17:54:21.443991] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-27T17:54:21.444110] [DEBUG] [LOCAL ] CHCT: Deleted derivative data file. [2025-10-27T17:54:21.444173] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 27.0s. Estimated remaining: 4h 1m 45s. Rate: 8.0 symbols/min [2025-10-27T17:54:21.607778] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:21.649249] [DEBUG] [LOCAL ] CHGG: Loaded 48084 existing records from primary storage. [2025-10-27T17:54:21.649533] [INFO ] [MAIN ] CHGG: Loaded 48084 existing records. [2025-10-27T17:54:21.823041] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:21.823236] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-27T17:54:21.823282] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-27T17:54:21.823523] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-27T17:54:21.823560] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-27T17:54:22.026367] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-27T17:54:22.177708] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:22.817937] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-27T17:54:22.823133] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:54:22.833708] [INFO ] [REMOTE ] CGAU: Full fetch complete (62307 records). [2025-10-27T17:54:22.833896] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-27T17:54:23.142476] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T17:54:23.237724] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-27T17:54:23.237815] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-27T17:54:23.238535] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-27T17:54:23.238577] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-27T17:54:23.240348] [DEBUG] [LOCAL ] CGAU: Trimmed 62307 records to 43897 (keeping 200 days of data) [2025-10-27T17:54:23.518252] [DEBUG] [LOCAL ] CGAU: Primary data saved (43897 records). [2025-10-27T17:54:23.518416] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-27T17:54:23.518527] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CGAU took 40.3s. Estimated remaining: 4h 1m 14s. Rate: 8.0 symbols/min [2025-10-27T17:54:23.618931] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-27T17:54:23.690739] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:23.724789] [DEBUG] [LOCAL ] CHH: Loaded 32762 existing records from primary storage. [2025-10-27T17:54:23.725043] [INFO ] [MAIN ] CHH: Loaded 32762 existing records. [2025-10-27T17:54:23.900092] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:23.900281] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-27T17:54:23.900327] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-27T17:54:23.900626] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-27T17:54:23.900717] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-27T17:54:24.253413] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:24.420032] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-27T17:54:24.439091] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T17:54:24.489616] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T17:54:25.214968] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-27T17:54:26.014948] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-27T17:54:26.241113] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:54:26.393485] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T17:54:26.815053] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-27T17:54:27.011923] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:54:27.614939] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-27T17:54:28.264618] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T17:54:28.414966] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-27T17:54:29.214971] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-27T17:54:29.267955] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T17:54:29.416244] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T17:54:29.857311] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T17:54:30.014981] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-27T17:54:30.814981] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-27T17:54:31.349368] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T17:54:31.615001] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-27T17:54:32.121065] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T17:54:32.414913] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-27T17:54:32.678551] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T17:54:33.214945] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-27T17:54:34.014983] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-27T17:54:34.086121] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:54:34.602592] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:54:34.606133] [INFO ] [REMOTE ] CHE: Full fetch complete (20653 records). [2025-10-27T17:54:34.606204] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-27T17:54:34.825129] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-27T17:54:35.003078] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-27T17:54:35.003155] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-27T17:54:35.003513] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-27T17:54:35.003551] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-27T17:54:35.004182] [DEBUG] [LOCAL ] CHE: Trimmed 20653 records to 15307 (keeping 200 days of data) [2025-10-27T17:54:35.104633] [DEBUG] [LOCAL ] CHE: Primary data saved (15307 records). [2025-10-27T17:54:35.104801] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-27T17:54:35.104881] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHE took 23.3s. Estimated remaining: 4h 1m 24s. Rate: 8.0 symbols/min [2025-10-27T17:54:35.272455] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:35.294599] [DEBUG] [LOCAL ] CHMI: Loaded 21387 existing records from primary storage. [2025-10-27T17:54:35.294901] [INFO ] [MAIN ] CHMI: Loaded 21387 existing records. [2025-10-27T17:54:35.474956] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:35.475218] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-27T17:54:35.475278] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-27T17:54:35.475504] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-27T17:54:35.475607] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-27T17:54:35.620018] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-27T17:54:35.841162] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:35.871829] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T17:54:36.420956] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-27T17:54:36.425942] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T17:54:36.963368] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T17:54:37.214947] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-27T17:54:37.245607] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T17:54:38.014954] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-27T17:54:38.368484] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T17:54:38.814988] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-27T17:54:39.614963] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-27T17:54:39.839385] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T17:54:40.196444] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T17:54:40.415018] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-27T17:54:41.062670] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T17:54:41.214925] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-27T17:54:41.331240] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:54:42.014999] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-27T17:54:42.755026] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:54:42.814987] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-27T17:54:43.614974] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-27T17:54:43.693815] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T17:54:43.803393] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T17:54:44.414956] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-27T17:54:44.903491] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T17:54:44.912820] [INFO ] [REMOTE ] CHD: Full fetch complete (74625 records). [2025-10-27T17:54:44.912937] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-27T17:54:44.913700] [FATAL] [VALIDATOR ] CHD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:44.913784] [FATAL] [MAIN ] CHD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:44.913825] [WARN ] [MAIN ] CHD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:44.913863] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-27T17:54:44.913918] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-27T17:54:44.913951] [INFO ] [LOCAL ] CHD: Starting deletion of derivative data. [2025-10-27T17:54:44.914098] [DEBUG] [LOCAL ] CHD: Deleted derivative data file. [2025-10-27T17:54:44.914184] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHD took 39.8s. Estimated remaining: 4h 1m 27s. Rate: 8.0 symbols/min [2025-10-27T17:54:45.214946] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-27T17:54:45.351249] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T17:54:46.014993] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-27T17:54:46.488248] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T17:54:46.815003] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-27T17:54:47.354718] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T17:54:47.614938] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-27T17:54:47.713286] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:54:48.414949] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-27T17:54:48.987930] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T17:54:49.214936] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-27T17:54:49.710433] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T17:54:50.014981] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-27T17:54:50.662437] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T17:54:50.669330] [INFO ] [REMOTE ] CHH: Full fetch complete (47668 records). [2025-10-27T17:54:50.669422] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-27T17:54:50.842404] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-27T17:54:51.065313] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-27T17:54:51.065423] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-27T17:54:51.066378] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-27T17:54:51.066476] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-27T17:54:51.067721] [DEBUG] [LOCAL ] CHH: Trimmed 47668 records to 32110 (keeping 200 days of data) [2025-10-27T17:54:51.210187] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:54:51.303403] [DEBUG] [LOCAL ] CHH: Primary data saved (32110 records). [2025-10-27T17:54:51.303551] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-27T17:54:51.303662] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHH took 27.8s. Estimated remaining: 4h 1m 15s. Rate: 8.0 symbols/min [2025-10-27T17:54:51.615000] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-27T17:54:52.353308] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:54:52.414905] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-27T17:54:52.578551] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T17:54:53.214913] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-27T17:54:54.308947] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T17:54:54.314355] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-27T17:54:54.549403] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T17:54:54.558119] [INFO ] [REMOTE ] CHGG: Full fetch complete (69759 records). [2025-10-27T17:54:54.558252] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-27T17:54:54.942339] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-27T17:54:54.942416] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-27T17:54:54.943228] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-27T17:54:54.943291] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-27T17:54:54.944591] [DEBUG] [LOCAL ] CHGG: Trimmed 69759 records to 47346 (keeping 200 days of data) [2025-10-27T17:54:55.227786] [DEBUG] [LOCAL ] CHGG: Primary data saved (47346 records). [2025-10-27T17:54:55.227975] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-27T17:54:55.228609] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHGG took 33.8s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-10-27T17:54:55.338697] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:54:55.343284] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-27T17:54:56.376890] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T17:54:56.381958] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-27T17:54:57.181203] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T17:54:57.185669] [INFO ] [REMOTE ] CHMI: Full fetch complete (31043 records). [2025-10-27T17:54:57.185812] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-27T17:54:57.186408] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:54:57.186501] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:54:57.186546] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:54:57.186589] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-27T17:54:57.186680] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-27T17:54:57.186739] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-27T17:54:57.186960] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-27T17:54:57.187074] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHMI took 22.1s. Estimated remaining: 4h 0m 20s. Rate: 8.0 symbols/min [2025-10-27T17:54:57.873092] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.919266] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.968004] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.989047] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:54:57.997788] [DEBUG] [LOCAL ] CHN: Loaded 5088 existing records from primary storage. [2025-10-27T17:54:57.998270] [INFO ] [MAIN ] CHN: Loaded 5088 existing records. [2025-10-27T17:54:58.119368] [DEBUG] [LOCAL ] CHT: Loaded 19441 existing records from primary storage. [2025-10-27T17:54:58.135218] [INFO ] [MAIN ] CHT: Loaded 19441 existing records. [2025-10-27T17:54:58.301466] [DEBUG] [LOCAL ] CHPT: Loaded 47410 existing records from primary storage. [2025-10-27T17:54:58.299836] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.332531] [INFO ] [MAIN ] CHPT: Loaded 47410 existing records. [2025-10-27T17:54:58.321135] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.360501] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-27T17:54:58.432347] [DEBUG] [LOCAL ] CHWY: Loaded 54434 existing records from primary storage. [2025-10-27T17:54:58.411071] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-27T17:54:58.465912] [INFO ] [MAIN ] CHWY: Loaded 54434 existing records. [2025-10-27T17:54:58.482701] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-27T17:54:58.783026] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.843354] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:58.843855] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.843780] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-27T17:54:58.854361] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-27T17:54:58.859667] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-27T17:54:58.875950] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-27T17:54:58.941445] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-27T17:54:58.941550] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-27T17:54:59.047756] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-27T17:54:59.042458] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:54:59.054141] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-27T17:54:59.091382] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-27T17:54:59.166030] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-27T17:54:59.319959] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-27T17:54:59.926982] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:54:59.966294] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-27T17:55:00.218899] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.272005] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-27T17:55:00.321434] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.343611] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-27T17:55:00.422143] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:00.422427] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-27T17:55:02.401225] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-27T17:55:02.403616] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-27T17:55:03.401778] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-10-27T17:55:03.406031] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-27T17:55:03.477127] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T17:55:03.479405] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-27T17:55:03.735622] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (3.31 seconds). [2025-10-27T17:55:03.746186] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-27T17:55:04.360356] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T17:55:04.366449] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-27T17:55:04.568764] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T17:55:04.570702] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-27T17:55:04.604734] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (4.33 seconds). [2025-10-27T17:55:04.615219] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-27T17:55:05.610061] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T17:55:05.616369] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-27T17:55:05.765324] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-27T17:55:05.849896] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:55:06.014954] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-27T17:55:06.620459] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T17:55:06.814968] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-27T17:55:07.168199] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T17:55:07.297942] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T17:55:07.615011] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-27T17:55:08.157623] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T17:55:08.263842] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T17:55:08.414966] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-27T17:55:09.214974] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-27T17:55:09.574984] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T17:55:10.014980] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-27T17:55:10.608379] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:55:10.814945] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-27T17:55:11.614995] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-27T17:55:12.253524] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T17:55:12.414988] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-27T17:55:12.460465] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-27T17:55:12.576304] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T17:55:13.215344] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-27T17:55:13.250276] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:55:14.014950] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-27T17:55:14.814941] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-27T17:55:15.073008] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T17:55:15.614919] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-27T17:55:15.746345] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T17:55:15.830717] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T17:55:16.136605] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:55:16.414929] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-27T17:55:17.214931] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-27T17:55:17.694762] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T17:55:18.014941] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-27T17:55:18.121681] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T17:55:18.814942] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-27T17:55:19.205691] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T17:55:19.614927] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-27T17:55:19.841256] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T17:55:20.414921] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-27T17:55:20.591084] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T17:55:21.214937] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-27T17:55:21.990801] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T17:55:21.992326] [INFO ] [REMOTE ] CHN: Full fetch complete (7547 records). [2025-10-27T17:55:21.992393] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-27T17:55:21.992799] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:55:21.992901] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:55:21.992943] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:55:21.992979] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-27T17:55:21.993031] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-27T17:55:21.993066] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-27T17:55:21.993357] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-10-27T17:55:21.993420] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHN took 24.8s. Estimated remaining: 4h 1m 28s. Rate: 8.0 symbols/min [2025-10-27T17:55:22.022714] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-27T17:55:22.165839] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:22.208614] [DEBUG] [LOCAL ] CI: Loaded 50262 existing records from primary storage. [2025-10-27T17:55:22.208940] [INFO ] [MAIN ] CI: Loaded 50262 existing records. [2025-10-27T17:55:22.352550] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T17:55:22.430155] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:22.430439] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-27T17:55:22.430508] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-27T17:55:22.430846] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-27T17:55:22.430906] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-27T17:55:22.784460] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:22.814903] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-27T17:55:23.238440] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T17:55:23.242263] [INFO ] [REMOTE ] CHT: Full fetch complete (27682 records). [2025-10-27T17:55:23.242412] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-27T17:55:23.620155] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-27T17:55:23.621357] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-27T17:55:23.621439] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-27T17:55:23.621923] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-27T17:55:23.621986] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-27T17:55:23.622695] [DEBUG] [LOCAL ] CHT: Trimmed 27682 records to 19042 (keeping 200 days of data) [2025-10-27T17:55:23.737541] [DEBUG] [LOCAL ] CHT: Primary data saved (19042 records). [2025-10-27T17:55:23.737665] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-27T17:55:23.737762] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 26.5s. Estimated remaining: 4h 0m 55s. Rate: 8.0 symbols/min [2025-10-27T17:55:23.908438] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:23.923730] [DEBUG] [LOCAL ] CIA: Loaded 16617 existing records from primary storage. [2025-10-27T17:55:23.923979] [INFO ] [MAIN ] CIA: Loaded 16617 existing records. [2025-10-27T17:55:24.106788] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:24.107117] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-27T17:55:24.107251] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-27T17:55:24.107460] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-27T17:55:24.107502] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-27T17:55:24.418171] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-27T17:55:24.492312] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:24.518600] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T17:55:25.163976] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T17:55:25.214925] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-27T17:55:26.015624] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-27T17:55:26.021188] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T17:55:26.334006] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T17:55:26.814946] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-27T17:55:26.825710] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T17:55:27.614958] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-27T17:55:28.414955] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-27T17:55:29.054125] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-27T17:55:29.064252] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-27T17:55:29.064372] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-27T17:55:29.216414] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-27T17:55:29.317405] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T17:55:29.482759] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-27T17:55:29.482870] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-27T17:55:29.483732] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-27T17:55:29.483815] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-27T17:55:29.485398] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 53654 (keeping 200 days of data) [2025-10-27T17:55:29.601500] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T17:55:29.833827] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-27T17:55:29.833955] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-27T17:55:29.834032] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 32.6s. Estimated remaining: 4h 0m 41s. Rate: 8.0 symbols/min [2025-10-27T17:55:30.002149] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:30.018633] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-27T17:55:30.032042] [DEBUG] [LOCAL ] CIB: Loaded 30705 existing records from primary storage. [2025-10-27T17:55:30.032293] [INFO ] [MAIN ] CIB: Loaded 30705 existing records. [2025-10-27T17:55:30.208991] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:30.209263] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-27T17:55:30.209316] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-27T17:55:30.209500] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-27T17:55:30.209555] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-27T17:55:30.550575] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:30.814922] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-27T17:55:30.883552] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T17:55:31.611183] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T17:55:31.619132] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-27T17:55:31.767968] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T17:55:32.414935] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-27T17:55:33.012703] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T17:55:33.178957] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T17:55:33.214899] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-27T17:55:34.015007] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-27T17:55:34.709370] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T17:55:34.814968] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-27T17:55:35.013208] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T17:55:35.614953] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-27T17:55:36.238302] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T17:55:36.415007] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-27T17:55:36.510024] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:55:37.215023] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-27T17:55:38.014942] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-27T17:55:38.101324] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T17:55:38.134349] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T17:55:38.814950] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-27T17:55:39.408846] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:55:39.416084] [INFO ] [REMOTE ] CHPT: Full fetch complete (70605 records). [2025-10-27T17:55:39.416197] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-27T17:55:39.624399] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-27T17:55:39.797099] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-27T17:55:39.797195] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-27T17:55:39.798005] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-27T17:55:39.798068] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-27T17:55:39.799464] [DEBUG] [LOCAL ] CHPT: Trimmed 70605 records to 46484 (keeping 200 days of data) [2025-10-27T17:55:40.072171] [DEBUG] [LOCAL ] CHPT: Primary data saved (46484 records). [2025-10-27T17:55:40.072411] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-27T17:55:40.072524] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CHPT took 42.9s. Estimated remaining: 4h 0m 46s. Rate: 8.0 symbols/min [2025-10-27T17:55:40.242835] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:40.243034] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-27T17:55:40.243101] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-27T17:55:40.243302] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-27T17:55:40.243388] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-27T17:55:40.243503] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-27T17:55:40.243552] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-27T17:55:40.377306] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T17:55:40.438954] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-27T17:55:40.615124] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T17:55:40.679329] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:41.215005] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-27T17:55:41.373557] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T17:55:41.745847] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T17:55:42.014978] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-27T17:55:42.487015] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T17:55:42.814969] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-27T17:55:43.223580] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T17:55:43.614958] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-27T17:55:44.414938] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-27T17:55:45.074400] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T17:55:45.171697] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:55:45.214919] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-27T17:55:46.014986] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-27T17:55:46.638776] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T17:55:46.706268] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T17:55:46.814914] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-27T17:55:47.614938] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-27T17:55:47.710414] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T17:55:47.719896] [INFO ] [REMOTE ] CI: Full fetch complete (72037 records). [2025-10-27T17:55:47.720073] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-27T17:55:48.123052] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-27T17:55:48.123139] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-27T17:55:48.123979] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-27T17:55:48.124044] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-27T17:55:48.125421] [DEBUG] [LOCAL ] CI: Trimmed 72037 records to 49475 (keeping 200 days of data) [2025-10-27T17:55:48.372018] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T17:55:48.383324] [INFO ] [REMOTE ] CIA: Full fetch complete (23147 records). [2025-10-27T17:55:48.387754] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-27T17:55:48.420015] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-27T17:55:48.554585] [DEBUG] [LOCAL ] CI: Primary data saved (49475 records). [2025-10-27T17:55:48.555030] [INFO ] [MAIN ] CI: Full history saved. [2025-10-27T17:55:48.560827] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CI took 26.6s. Estimated remaining: 4h 0m 42s. Rate: 8.0 symbols/min [2025-10-27T17:55:48.919317] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:49.011680] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-27T17:55:49.011764] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-27T17:55:49.012140] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-27T17:55:49.012178] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-27T17:55:49.012937] [DEBUG] [LOCAL ] CIA: Trimmed 23147 records to 16250 (keeping 200 days of data) [2025-10-27T17:55:49.117455] [DEBUG] [LOCAL ] CIA: Primary data saved (16250 records). [2025-10-27T17:55:49.117668] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-27T17:55:49.117782] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CIA took 25.4s. Estimated remaining: 4h 0m 5s. Rate: 8.0 symbols/min [2025-10-27T17:55:49.230628] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-27T17:55:49.245938] [DEBUG] [LOCAL ] CIEN: Loaded 52880 existing records from primary storage. [2025-10-27T17:55:49.250693] [INFO ] [MAIN ] CIEN: Loaded 52880 existing records. [2025-10-27T17:55:49.419409] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:55:49.488243] [DEBUG] [LOCAL ] CIF: Loaded 4015 existing records from primary storage. [2025-10-27T17:55:49.504932] [INFO ] [MAIN ] CIF: Loaded 4015 existing records. [2025-10-27T17:55:49.549529] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:49.575453] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-27T17:55:49.583977] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-27T17:55:49.598004] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-27T17:55:49.609451] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-27T17:55:49.800917] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T17:55:49.833979] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:55:49.894007] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-27T17:55:49.917381] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-27T17:55:49.949982] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-27T17:55:49.968377] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-27T17:55:50.025078] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-27T17:55:50.149887] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T17:55:50.247716] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:50.442856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T17:55:50.529754] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:55:50.814949] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-27T17:55:51.615409] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-27T17:55:51.616875] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T17:55:52.414954] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-27T17:55:52.881909] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T17:55:53.106848] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T17:55:53.214945] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-27T17:55:53.636813] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T17:55:54.014947] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-27T17:55:54.398900] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T17:55:54.814942] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-27T17:55:55.614945] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-27T17:55:56.414919] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-27T17:55:56.787432] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T17:55:56.842232] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T17:55:56.943283] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:55:57.214956] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-27T17:55:58.015002] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-27T17:55:58.123919] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T17:55:58.286588] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-27T17:55:58.814974] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-27T17:55:59.120605] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-27T17:55:59.614943] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-27T17:55:59.932223] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T17:56:00.414948] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-27T17:56:01.214952] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-27T17:56:02.015014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-27T17:56:02.815072] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-27T17:56:02.837980] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T17:56:02.838803] [INFO ] [REMOTE ] CICB: Full fetch complete (1911 records). [2025-10-27T17:56:02.838873] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-27T17:56:03.013572] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T17:56:03.013799] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:03.013869] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:03.013943] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-27T17:56:03.014008] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-27T17:56:03.014064] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-27T17:56:03.014105] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-27T17:56:03.014158] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CICB took 22.9s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-10-27T17:56:03.177357] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:03.216864] [DEBUG] [LOCAL ] CIG: Loaded 45103 existing records from primary storage. [2025-10-27T17:56:03.217192] [INFO ] [MAIN ] CIG: Loaded 45103 existing records. [2025-10-27T17:56:03.394674] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:03.394906] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-27T17:56:03.394954] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-27T17:56:03.395204] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-27T17:56:03.395262] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-27T17:56:03.749639] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:03.749982] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-27T17:56:04.629354] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (3.41 seconds). [2025-10-27T17:56:04.635228] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-27T17:56:04.778454] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T17:56:04.864905] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-27T17:56:05.214950] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-27T17:56:05.492950] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T17:56:05.887446] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T17:56:06.014917] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-27T17:56:06.629324] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T17:56:06.814974] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-27T17:56:06.860434] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T17:56:07.219330] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T17:56:07.614939] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-27T17:56:08.414943] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-27T17:56:08.597497] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T17:56:08.603199] [INFO ] [REMOTE ] CIB: Full fetch complete (45300 records). [2025-10-27T17:56:08.603286] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-27T17:56:08.603821] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:56:08.603901] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:08.603962] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:08.604046] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-27T17:56:08.604150] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-27T17:56:08.604214] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-27T17:56:08.604383] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-27T17:56:08.604485] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIB took 38.8s. Estimated remaining: 4h 0m 9s. Rate: 8.0 symbols/min [2025-10-27T17:56:08.782695] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:08.798602] [DEBUG] [LOCAL ] CII: Loaded 15310 existing records from primary storage. [2025-10-27T17:56:08.798874] [INFO ] [MAIN ] CII: Loaded 15310 existing records. [2025-10-27T17:56:08.969633] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:08.969840] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-27T17:56:08.969885] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-27T17:56:08.970051] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-27T17:56:08.970106] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-27T17:56:09.220195] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-27T17:56:09.314312] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:10.014928] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-27T17:56:10.076179] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T17:56:10.102160] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T17:56:10.814935] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-27T17:56:11.363724] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T17:56:11.506932] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T17:56:11.614922] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-27T17:56:12.045188] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T17:56:12.414953] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-27T17:56:12.943243] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T17:56:12.944434] [INFO ] [REMOTE ] CIF: Full fetch complete (6541 records). [2025-10-27T17:56:12.944503] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-27T17:56:13.220032] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-27T17:56:13.302881] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-27T17:56:13.302952] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-27T17:56:13.303119] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-27T17:56:13.303156] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-27T17:56:13.303525] [DEBUG] [LOCAL ] CIF: Trimmed 6541 records to 3862 (keeping 200 days of data) [2025-10-27T17:56:13.325558] [DEBUG] [LOCAL ] CIF: Primary data saved (3862 records). [2025-10-27T17:56:13.325665] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-27T17:56:13.325767] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CIF took 24.2s. Estimated remaining: 3h 59m 50s. Rate: 8.0 symbols/min [2025-10-27T17:56:13.492065] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:13.528029] [DEBUG] [LOCAL ] CIM: Loaded 37903 existing records from primary storage. [2025-10-27T17:56:13.528311] [INFO ] [MAIN ] CIM: Loaded 37903 existing records. [2025-10-27T17:56:13.705681] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:13.705899] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-27T17:56:13.705954] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-27T17:56:13.706184] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-27T17:56:13.706244] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-27T17:56:14.020864] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-27T17:56:14.060975] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:14.545005] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T17:56:14.717567] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T17:56:14.814943] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-27T17:56:15.614950] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-27T17:56:16.414945] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-27T17:56:16.684030] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T17:56:16.798614] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T17:56:17.215010] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-27T17:56:17.442874] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T17:56:18.014986] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-27T17:56:18.753528] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:56:18.814974] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-27T17:56:19.275619] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T17:56:19.614944] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-27T17:56:19.943816] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T17:56:20.414947] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-27T17:56:21.129789] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T17:56:21.214935] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-27T17:56:21.442941] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T17:56:22.014949] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-27T17:56:22.524717] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T17:56:22.814936] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-27T17:56:23.314954] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T17:56:23.614955] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-27T17:56:24.117860] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T17:56:24.414973] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-27T17:56:24.912060] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:56:25.214947] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-27T17:56:25.947212] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T17:56:26.014965] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-27T17:56:26.080088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T17:56:26.814958] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-27T17:56:27.171344] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T17:56:27.614948] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-27T17:56:28.414973] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-27T17:56:28.518466] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T17:56:28.696630] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T17:56:28.706724] [INFO ] [REMOTE ] CIEN: Full fetch complete (75842 records). [2025-10-27T17:56:28.706880] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-27T17:56:29.087925] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-27T17:56:29.088006] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-27T17:56:29.088815] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-27T17:56:29.088879] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-27T17:56:29.090289] [DEBUG] [LOCAL ] CIEN: Trimmed 75842 records to 52090 (keeping 200 days of data) [2025-10-27T17:56:29.252362] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-27T17:56:29.391298] [DEBUG] [LOCAL ] CIEN: Primary data saved (52090 records). [2025-10-27T17:56:29.391414] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-27T17:56:29.391491] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIEN took 40.8s. Estimated remaining: 4h 0m 19s. Rate: 8.0 symbols/min [2025-10-27T17:56:29.557898] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:29.562702] [DEBUG] [LOCAL ] CIMN: Loaded 2724 existing records from primary storage. [2025-10-27T17:56:29.562850] [INFO ] [MAIN ] CIMN: Loaded 2724 existing records. [2025-10-27T17:56:29.743725] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:29.744053] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-27T17:56:29.744135] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-27T17:56:29.744624] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-27T17:56:29.744750] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-27T17:56:29.892382] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T17:56:29.980256] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T17:56:30.022734] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-27T17:56:30.172749] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:30.814971] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-27T17:56:31.478741] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T17:56:31.507765] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T17:56:31.614906] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-27T17:56:32.202286] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T17:56:32.414931] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-27T17:56:32.993244] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:56:33.214947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-27T17:56:33.647430] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T17:56:34.014943] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-27T17:56:34.540726] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T17:56:34.814983] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-27T17:56:35.615009] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-27T17:56:35.931330] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T17:56:36.315426] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T17:56:36.414943] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-27T17:56:37.214991] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-27T17:56:37.496027] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T17:56:38.015051] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-27T17:56:38.639784] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:56:38.649490] [INFO ] [REMOTE ] CIG: Full fetch complete (62908 records). [2025-10-27T17:56:38.649596] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-27T17:56:38.822676] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-27T17:56:39.046510] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-27T17:56:39.047189] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-27T17:56:39.048005] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-27T17:56:39.047063] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T17:56:39.048208] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-27T17:56:39.052549] [INFO ] [REMOTE ] CII: Full fetch complete (22819 records). [2025-10-27T17:56:39.052865] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-27T17:56:39.086777] [DEBUG] [LOCAL ] CIG: Trimmed 62908 records to 44462 (keeping 200 days of data) [2025-10-27T17:56:39.287034] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T17:56:39.616496] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-27T17:56:39.695960] [DEBUG] [LOCAL ] CIG: Primary data saved (44462 records). [2025-10-27T17:56:39.696846] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-27T17:56:39.697012] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-27T17:56:39.696952] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-27T17:56:39.697528] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-27T17:56:39.697765] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-27T17:56:39.697715] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIG took 36.7s. Estimated remaining: 4h 0m 23s. Rate: 8.0 symbols/min [2025-10-27T17:56:39.777256] [DEBUG] [LOCAL ] CII: Trimmed 22819 records to 14625 (keeping 200 days of data) [2025-10-27T17:56:39.942492] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:39.955633] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-27T17:56:39.955741] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-27T17:56:39.955884] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-27T17:56:39.955948] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-27T17:56:39.955528] [DEBUG] [LOCAL ] CII: Primary data saved (14625 records). [2025-10-27T17:56:39.956024] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-27T17:56:39.956234] [INFO ] [MAIN ] CII: Full history saved. [2025-10-27T17:56:39.956158] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-27T17:56:39.956385] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CII took 31.4s. Estimated remaining: 3h 59m 45s. Rate: 8.0 symbols/min [2025-10-27T17:56:40.308061] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:40.321204] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-27T17:56:40.347708] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-27T17:56:40.379766] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-27T17:56:40.392965] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-27T17:56:40.393060] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-27T17:56:40.408214] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-27T17:56:40.428856] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-27T17:56:40.720750] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:40.904016] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:40.908708] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T17:56:41.167404] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T17:56:41.214955] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-27T17:56:41.828435] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T17:56:42.014935] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-27T17:56:42.284380] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T17:56:42.814946] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-27T17:56:43.312868] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T17:56:43.614963] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-27T17:56:44.138469] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T17:56:44.414932] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-27T17:56:44.783533] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-27T17:56:45.214946] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-27T17:56:45.438351] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:56:45.438737] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-27T17:56:45.438846] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:56:45.438943] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-27T17:56:45.439014] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:56:45.439086] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-27T17:56:45.439149] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-27T17:56:45.439186] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-27T17:56:45.439227] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-27T17:56:45.439296] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIMP took 5.5s. Estimated remaining: 3h 59m 28s. Rate: 8.0 symbols/min [2025-10-27T17:56:45.610879] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:45.630332] [DEBUG] [LOCAL ] CINT: Loaded 20869 existing records from primary storage. [2025-10-27T17:56:45.630561] [INFO ] [MAIN ] CINT: Loaded 20869 existing records. [2025-10-27T17:56:45.803778] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:45.803977] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-27T17:56:45.804024] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-27T17:56:45.804180] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-27T17:56:45.804219] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-27T17:56:46.020081] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-27T17:56:46.165715] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:46.814951] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-27T17:56:47.319075] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T17:56:47.451913] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T17:56:47.615003] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-27T17:56:47.956289] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T17:56:48.414931] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-27T17:56:49.214958] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-27T17:56:49.473021] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T17:56:49.512534] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-27T17:56:50.014976] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-27T17:56:50.390398] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T17:56:50.814941] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-27T17:56:51.614946] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-27T17:56:52.024602] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T17:56:52.414962] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-27T17:56:52.868528] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T17:56:53.177317] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T17:56:53.214896] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-27T17:56:54.014971] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-27T17:56:54.693581] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T17:56:54.725019] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T17:56:54.814941] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-27T17:56:55.614952] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-27T17:56:56.217719] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T17:56:56.414947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-27T17:56:56.525353] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T17:56:56.534185] [INFO ] [REMOTE ] CIM: Full fetch complete (54793 records). [2025-10-27T17:56:56.534453] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-27T17:56:56.924482] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-27T17:56:56.924606] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-27T17:56:56.925426] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-27T17:56:56.925491] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-27T17:56:56.926764] [DEBUG] [LOCAL ] CIM: Trimmed 54793 records to 37039 (keeping 200 days of data) [2025-10-27T17:56:56.995965] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T17:56:57.156840] [DEBUG] [LOCAL ] CIM: Primary data saved (37039 records). [2025-10-27T17:56:57.156978] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-27T17:56:57.157058] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIM took 43.8s. Estimated remaining: 3h 59m 39s. Rate: 8.0 symbols/min [2025-10-27T17:56:57.224981] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-27T17:56:57.369404] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:57.392285] [DEBUG] [LOCAL ] CIO: Loaded 21650 existing records from primary storage. [2025-10-27T17:56:57.392560] [INFO ] [MAIN ] CIO: Loaded 21650 existing records. [2025-10-27T17:56:57.570200] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:57.573887] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-27T17:56:57.573989] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-27T17:56:57.573745] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T17:56:57.575671] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-27T17:56:57.575735] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-27T17:56:57.928679] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:58.014947] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-27T17:56:58.525703] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T17:56:58.526790] [INFO ] [REMOTE ] CIMN: Full fetch complete (3859 records). [2025-10-27T17:56:58.526860] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-27T17:56:58.527317] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:56:58.527398] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:56:58.527480] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:56:58.527561] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-27T17:56:58.527636] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-27T17:56:58.527731] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-27T17:56:58.527932] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-27T17:56:58.528034] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CIMN took 29.1s. Estimated remaining: 3h 59m 5s. Rate: 8.0 symbols/min [2025-10-27T17:56:58.697944] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:56:58.722553] [DEBUG] [LOCAL ] CION: Loaded 28391 existing records from primary storage. [2025-10-27T17:56:58.722856] [INFO ] [MAIN ] CION: Loaded 28391 existing records. [2025-10-27T17:56:58.820117] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-27T17:56:58.903064] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:56:58.903275] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-27T17:56:58.903330] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-27T17:56:58.903510] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-27T17:56:58.903550] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-27T17:56:59.255768] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:56:59.555105] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T17:56:59.614912] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-27T17:57:00.231776] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T17:57:00.414916] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-27T17:57:01.215010] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-27T17:57:02.014974] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-27T17:57:02.815016] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-27T17:57:03.968085] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-27T17:57:03.973573] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-27T17:57:04.028492] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (3.61 seconds). [2025-10-27T17:57:04.071854] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T17:57:04.415020] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-27T17:57:04.470288] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T17:57:05.123565] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T17:57:05.214999] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-27T17:57:05.277065] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T17:57:05.664541] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T17:57:05.665665] [INFO ] [REMOTE ] CIMO: Full fetch complete (4519 records). [2025-10-27T17:57:05.665737] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-27T17:57:05.666125] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:57:05.666206] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:57:05.666248] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:57:05.666312] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-27T17:57:05.666374] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-27T17:57:05.666409] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-27T17:57:05.666448] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-27T17:57:05.666498] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIMO took 26.0s. Estimated remaining: 3h 58m 56s. Rate: 8.0 symbols/min [2025-10-27T17:57:05.829518] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:05.877561] [DEBUG] [LOCAL ] CIVI: Loaded 53474 existing records from primary storage. [2025-10-27T17:57:05.877889] [INFO ] [MAIN ] CIVI: Loaded 53474 existing records. [2025-10-27T17:57:06.020177] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-27T17:57:06.085924] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:06.086140] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-27T17:57:06.086189] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-27T17:57:06.086391] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-27T17:57:06.086448] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-27T17:57:06.490497] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:06.814954] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-27T17:57:07.076234] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T17:57:07.614945] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-27T17:57:08.321182] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T17:57:08.387492] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T17:57:08.414968] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-27T17:57:09.214949] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-27T17:57:09.412798] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T17:57:09.958420] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T17:57:10.014977] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-27T17:57:10.814955] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-27T17:57:11.255077] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T17:57:11.614983] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-27T17:57:12.004996] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T17:57:12.392999] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T17:57:12.414907] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-27T17:57:13.214954] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-27T17:57:13.835438] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T17:57:13.842500] [INFO ] [REMOTE ] CINT: Full fetch complete (28809 records). [2025-10-27T17:57:13.842626] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-27T17:57:14.020044] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-27T17:57:14.292730] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T17:57:14.342889] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-27T17:57:14.343014] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-27T17:57:14.343784] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-27T17:57:14.343854] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-27T17:57:14.345176] [DEBUG] [LOCAL ] CINT: Trimmed 28809 records to 20484 (keeping 200 days of data) [2025-10-27T17:57:14.468297] [DEBUG] [LOCAL ] CINT: Primary data saved (20484 records). [2025-10-27T17:57:14.468495] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-27T17:57:14.468628] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CINT took 29.0s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-27T17:57:14.651200] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:14.713216] [DEBUG] [LOCAL ] CL: Loaded 54429 existing records from primary storage. [2025-10-27T17:57:14.713966] [INFO ] [MAIN ] CL: Loaded 54429 existing records. [2025-10-27T17:57:14.820186] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-27T17:57:14.918142] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:14.918456] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-27T17:57:14.918509] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-27T17:57:14.918809] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-27T17:57:14.918866] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-27T17:57:15.303541] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:15.416857] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T17:57:15.614950] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-27T17:57:15.880481] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T17:57:16.414946] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-27T17:57:17.043529] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T17:57:17.214968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-27T17:57:17.634927] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T17:57:18.014959] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-27T17:57:18.795135] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T17:57:18.814925] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-27T17:57:18.841857] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T17:57:19.614943] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-27T17:57:20.414976] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-27T17:57:20.460063] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T17:57:20.741193] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T17:57:21.178783] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T17:57:21.214939] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-27T17:57:22.014982] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-27T17:57:22.478236] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T17:57:22.814992] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-27T17:57:23.455036] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T17:57:23.614959] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-27T17:57:24.391172] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T17:57:24.414911] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-27T17:57:25.209034] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T17:57:25.219590] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-27T17:57:25.771785] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T17:57:26.014949] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-27T17:57:26.434565] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T17:57:26.814976] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-27T17:57:27.614949] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-27T17:57:27.848402] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T17:57:28.015479] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T17:57:28.414954] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-27T17:57:28.727130] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T17:57:28.732940] [INFO ] [REMOTE ] CIO: Full fetch complete (29925 records). [2025-10-27T17:57:28.733021] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-27T17:57:29.112365] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-27T17:57:29.112439] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-27T17:57:29.112915] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-27T17:57:29.112992] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-27T17:57:29.113750] [DEBUG] [LOCAL ] CIO: Trimmed 29925 records to 21195 (keeping 200 days of data) [2025-10-27T17:57:29.216680] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-27T17:57:29.230760] [DEBUG] [LOCAL ] CIO: Primary data saved (21195 records). [2025-10-27T17:57:29.230851] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-27T17:57:29.230930] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIO took 32.1s. Estimated remaining: 3h 59m 17s. Rate: 8.0 symbols/min [2025-10-27T17:57:29.405184] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:29.442825] [DEBUG] [LOCAL ] CLB: Loaded 34120 existing records from primary storage. [2025-10-27T17:57:29.443089] [INFO ] [MAIN ] CLB: Loaded 34120 existing records. [2025-10-27T17:57:29.661552] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:29.671033] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-27T17:57:29.671599] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-27T17:57:29.672143] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T17:57:29.678142] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-27T17:57:29.678419] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-27T17:57:30.024700] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-27T17:57:30.045734] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:30.503835] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T17:57:30.814952] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-27T17:57:31.614992] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-27T17:57:31.860402] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T17:57:32.335600] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T17:57:32.414979] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-27T17:57:32.655358] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T17:57:32.660907] [INFO ] [REMOTE ] CION: Full fetch complete (40354 records). [2025-10-27T17:57:32.661061] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-27T17:57:32.661690] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:57:32.661781] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:57:32.661827] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:57:32.661901] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-27T17:57:32.661970] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-27T17:57:32.662005] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-27T17:57:32.662175] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-27T17:57:32.662268] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CION took 34.1s. Estimated remaining: 3h 58m 52s. Rate: 8.0 symbols/min [2025-10-27T17:57:32.837108] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:32.850976] [DEBUG] [LOCAL ] CLCO: Loaded 13397 existing records from primary storage. [2025-10-27T17:57:32.851177] [INFO ] [MAIN ] CLCO: Loaded 13397 existing records. [2025-10-27T17:57:33.025435] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:33.025626] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-27T17:57:33.025703] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-27T17:57:33.025861] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-27T17:57:33.025899] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-27T17:57:33.221600] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-27T17:57:33.384273] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:33.403123] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T17:57:34.014956] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-27T17:57:34.814998] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-27T17:57:35.372410] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-27T17:57:35.614939] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-27T17:57:35.833888] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T17:57:35.921424] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T17:57:36.414922] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-27T17:57:37.214909] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-27T17:57:37.342367] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T17:57:38.015000] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-27T17:57:38.251733] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T17:57:38.337421] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T17:57:38.814962] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-27T17:57:39.167449] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T17:57:39.614979] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-27T17:57:40.414926] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-27T17:57:40.640699] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T17:57:40.650950] [INFO ] [REMOTE ] CIVI: Full fetch complete (76096 records). [2025-10-27T17:57:40.651098] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-27T17:57:40.846923] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T17:57:41.063771] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-27T17:57:41.063854] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-27T17:57:41.064669] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-27T17:57:41.064732] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-27T17:57:41.066199] [DEBUG] [LOCAL ] CIVI: Trimmed 76096 records to 52668 (keeping 200 days of data) [2025-10-27T17:57:41.237761] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-27T17:57:41.380089] [DEBUG] [LOCAL ] CIVI: Primary data saved (52668 records). [2025-10-27T17:57:41.380214] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-27T17:57:41.381029] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CIVI took 35.7s. Estimated remaining: 3h 58m 50s. Rate: 8.0 symbols/min [2025-10-27T17:57:41.546282] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:41.573711] [DEBUG] [LOCAL ] CLDT: Loaded 25525 existing records from primary storage. [2025-10-27T17:57:41.573957] [INFO ] [MAIN ] CLDT: Loaded 25525 existing records. [2025-10-27T17:57:41.757973] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:41.758207] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-27T17:57:41.758264] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-27T17:57:41.758425] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-27T17:57:41.758464] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-27T17:57:42.018393] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-27T17:57:42.123039] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:42.138424] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T17:57:42.218980] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:57:42.229353] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-27T17:57:42.229493] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-27T17:57:42.628032] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-27T17:57:42.628133] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-27T17:57:42.629054] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-27T17:57:42.629123] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-27T17:57:42.630566] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-27T17:57:42.839435] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-27T17:57:42.958755] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-27T17:57:42.958882] [INFO ] [MAIN ] CL: Full history saved. [2025-10-27T17:57:42.958959] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CL took 28.5s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-27T17:57:43.128318] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:57:43.154242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:57:43.206836] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-27T17:57:43.207184] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-10-27T17:57:43.390244] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:57:43.390484] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-27T17:57:43.390543] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-27T17:57:43.390772] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-27T17:57:43.390828] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-27T17:57:43.630321] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-27T17:57:43.751362] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:57:43.764278] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T17:57:44.414957] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-27T17:57:44.696359] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T17:57:45.214960] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-27T17:57:45.467285] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T17:57:46.014993] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-27T17:57:46.033767] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T17:57:46.815000] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-27T17:57:47.508187] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T17:57:47.614922] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-27T17:57:47.905900] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T17:57:48.414901] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-27T17:57:48.463675] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T17:57:49.185303] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T17:57:49.214916] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-27T17:57:50.014958] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-27T17:57:50.496296] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:57:50.814949] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-27T17:57:51.615012] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-27T17:57:51.987731] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T17:57:52.096263] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T17:57:52.184147] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-27T17:57:52.414951] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-27T17:57:53.116669] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T17:57:53.214955] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-27T17:57:54.014975] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-27T17:57:54.303267] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T17:57:54.645253] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T17:57:54.814942] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-27T17:57:55.615604] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-27T17:57:55.618086] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T17:57:56.414956] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-27T17:57:57.215000] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-27T17:57:57.321005] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T17:57:57.412148] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T17:57:57.825792] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T17:57:58.015008] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-27T17:57:58.717713] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T17:57:58.814923] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-27T17:57:59.614948] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-27T17:57:59.835546] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T17:57:59.841154] [INFO ] [REMOTE ] CLDT: Full fetch complete (37709 records). [2025-10-27T17:57:59.841284] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-27T17:58:00.215455] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-27T17:58:00.215538] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-27T17:58:00.216073] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-27T17:58:00.216135] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-27T17:58:00.217001] [DEBUG] [LOCAL ] CLDT: Trimmed 37709 records to 24789 (keeping 200 days of data) [2025-10-27T17:58:00.356225] [DEBUG] [LOCAL ] CLDT: Primary data saved (24789 records). [2025-10-27T17:58:00.356359] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-27T17:58:00.356458] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLDT took 19.0s. Estimated remaining: 3h 58m 51s. Rate: 8.0 symbols/min [2025-10-27T17:58:00.421861] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-27T17:58:00.541284] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:00.568116] [DEBUG] [LOCAL ] CLH: Loaded 28008 existing records from primary storage. [2025-10-27T17:58:00.568395] [INFO ] [MAIN ] CLH: Loaded 28008 existing records. [2025-10-27T17:58:00.745035] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:00.745225] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-27T17:58:00.745272] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-27T17:58:00.745471] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-27T17:58:00.745527] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-27T17:58:01.129901] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:01.215006] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-27T17:58:01.847913] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-27T17:58:02.014976] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-27T17:58:02.814949] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-27T17:58:03.600033] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T17:58:03.604422] [INFO ] [REMOTE ] CLCO: Full fetch complete (22758 records). [2025-10-27T17:58:03.604500] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-27T17:58:03.982548] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-27T17:58:03.982693] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-27T17:58:03.983312] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-27T17:58:03.983396] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-27T17:58:03.984425] [DEBUG] [LOCAL ] CLCO: Trimmed 22758 records to 12926 (keeping 200 days of data) [2025-10-27T17:58:04.058488] [DEBUG] [LOCAL ] CLCO: Primary data saved (12926 records). [2025-10-27T17:58:04.058611] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-27T17:58:04.058714] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLCO took 31.4s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-27T17:58:04.222063] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:04.233027] [DEBUG] [LOCAL ] CLPR: Loaded 10085 existing records from primary storage. [2025-10-27T17:58:04.233256] [INFO ] [MAIN ] CLPR: Loaded 10085 existing records. [2025-10-27T17:58:04.406217] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:04.406415] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-27T17:58:04.406461] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-27T17:58:04.406605] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-27T17:58:04.406663] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-27T17:58:04.767946] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:04.768763] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-27T17:58:04.789707] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-27T17:58:04.796293] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-27T17:58:04.847517] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T17:58:04.887274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (4.47 seconds). [2025-10-27T17:58:05.214994] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-27T17:58:05.400985] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T17:58:05.825695] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T17:58:06.014945] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-27T17:58:06.814948] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-27T17:58:06.948307] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T17:58:07.355260] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-27T17:58:07.355696] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T17:58:07.615042] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-27T17:58:08.414958] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-27T17:58:09.214967] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-27T17:58:09.331631] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T17:58:09.778551] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-27T17:58:10.015005] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-27T17:58:10.230515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:58:10.814942] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-27T17:58:11.615002] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-27T17:58:11.887022] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T17:58:11.959160] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T17:58:12.414960] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-27T17:58:13.214961] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-27T17:58:13.305772] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T17:58:13.415523] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T17:58:13.426373] [INFO ] [REMOTE ] CLB: Full fetch complete (47761 records). [2025-10-27T17:58:13.426632] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-27T17:58:13.807733] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-27T17:58:13.807821] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-27T17:58:13.808440] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-27T17:58:13.808481] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-27T17:58:13.809581] [DEBUG] [LOCAL ] CLB: Trimmed 47761 records to 33471 (keeping 200 days of data) [2025-10-27T17:58:14.004519] [DEBUG] [LOCAL ] CLB: Primary data saved (33471 records). [2025-10-27T17:58:14.004671] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-27T17:58:14.004765] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLB took 44.8s. Estimated remaining: 3h 58m 30s. Rate: 8.0 symbols/min [2025-10-27T17:58:14.020087] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-27T17:58:14.180385] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:14.202342] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T17:58:14.252664] [DEBUG] [LOCAL ] CLS: Loaded 54326 existing records from primary storage. [2025-10-27T17:58:14.253038] [INFO ] [MAIN ] CLS: Loaded 54326 existing records. [2025-10-27T17:58:14.429627] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:14.429888] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-27T17:58:14.429943] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-27T17:58:14.430163] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-27T17:58:14.430218] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-27T17:58:14.784381] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:14.814898] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-27T17:58:15.614970] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-27T17:58:15.766730] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T17:58:16.304069] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:58:16.414913] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-27T17:58:16.493141] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T17:58:17.220131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-27T17:58:17.227935] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T17:58:18.014994] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-27T17:58:18.814931] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-27T17:58:18.851001] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T17:58:19.614910] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-27T17:58:19.658176] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T17:58:19.668544] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-27T17:58:19.668688] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-27T17:58:20.061490] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-27T17:58:20.061816] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-27T17:58:20.062748] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-27T17:58:20.062812] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-27T17:58:20.064279] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-27T17:58:20.368701] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-27T17:58:20.368823] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-27T17:58:20.368898] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLF took 37.4s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-27T17:58:20.422747] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-27T17:58:20.563735] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:20.617458] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T17:58:20.642918] [DEBUG] [LOCAL ] CLVT: Loaded 52626 existing records from primary storage. [2025-10-27T17:58:20.643193] [INFO ] [MAIN ] CLVT: Loaded 52626 existing records. [2025-10-27T17:58:20.827255] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:20.827478] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-27T17:58:20.827592] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-27T17:58:20.827999] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-27T17:58:20.828073] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-27T17:58:20.927013] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T17:58:21.192342] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T17:58:21.217169] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-27T17:58:21.220786] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:22.014936] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-27T17:58:22.814933] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-27T17:58:23.145057] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T17:58:23.388014] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T17:58:23.614930] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-27T17:58:23.738500] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T17:58:24.414945] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-27T17:58:24.496832] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T17:58:25.214969] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-27T17:58:25.506206] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T17:58:26.014929] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-27T17:58:26.285940] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T17:58:26.291967] [INFO ] [REMOTE ] CLH: Full fetch complete (42233 records). [2025-10-27T17:58:26.292049] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-27T17:58:26.666848] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-27T17:58:26.666923] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-27T17:58:26.667514] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-27T17:58:26.667577] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-27T17:58:26.668443] [DEBUG] [LOCAL ] CLH: Trimmed 42233 records to 27306 (keeping 200 days of data) [2025-10-27T17:58:26.818687] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-27T17:58:26.832473] [DEBUG] [LOCAL ] CLH: Primary data saved (27306 records). [2025-10-27T17:58:26.833997] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-27T17:58:26.834183] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLH took 26.5s. Estimated remaining: 3h 58m 6s. Rate: 8.0 symbols/min [2025-10-27T17:58:27.026526] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:27.023477] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T17:58:27.049106] [DEBUG] [LOCAL ] CLW: Loaded 21485 existing records from primary storage. [2025-10-27T17:58:27.049346] [INFO ] [MAIN ] CLW: Loaded 21485 existing records. [2025-10-27T17:58:27.232181] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:27.232351] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-27T17:58:27.232400] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-27T17:58:27.232560] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-27T17:58:27.232618] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-27T17:58:27.597937] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:27.614900] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-27T17:58:28.414953] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-27T17:58:29.214995] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-27T17:58:29.302611] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:58:29.400375] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-27T17:58:30.014986] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-27T17:58:30.062422] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T17:58:30.095397] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T17:58:30.814993] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-27T17:58:30.873132] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T17:58:31.199432] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T17:58:31.614946] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-27T17:58:32.415010] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-27T17:58:33.186111] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T17:58:33.214933] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-27T17:58:33.465320] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T17:58:34.014948] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-27T17:58:34.442908] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T17:58:34.550865] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T17:58:34.552674] [INFO ] [REMOTE ] CLPR: Full fetch complete (15731 records). [2025-10-27T17:58:34.552744] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-27T17:58:34.820165] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-27T17:58:34.909088] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-27T17:58:34.909157] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-27T17:58:34.909485] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-27T17:58:34.909523] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-27T17:58:34.910004] [DEBUG] [LOCAL ] CLPR: Trimmed 15731 records to 9660 (keeping 200 days of data) [2025-10-27T17:58:34.963570] [DEBUG] [LOCAL ] CLPR: Primary data saved (9660 records). [2025-10-27T17:58:34.963711] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-27T17:58:34.963799] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLPR took 30.9s. Estimated remaining: 3h 58m 1s. Rate: 8.0 symbols/min [2025-10-27T17:58:35.127315] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:35.174463] [DEBUG] [LOCAL ] CLX: Loaded 52564 existing records from primary storage. [2025-10-27T17:58:35.174799] [INFO ] [MAIN ] CLX: Loaded 52564 existing records. [2025-10-27T17:58:35.346375] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:35.346551] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-27T17:58:35.346595] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-27T17:58:35.346856] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-27T17:58:35.346910] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-27T17:58:35.619313] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-27T17:58:35.696955] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:36.414968] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-27T17:58:36.667576] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T17:58:36.772886] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T17:58:37.214957] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-27T17:58:37.852716] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T17:58:38.014977] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-27T17:58:38.186353] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T17:58:38.814992] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-27T17:58:39.614929] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-27T17:58:39.859999] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T17:58:40.414971] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-27T17:58:40.502904] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T17:58:41.215014] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-27T17:58:41.704628] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T17:58:41.785278] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T17:58:42.014939] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-27T17:58:42.412898] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T17:58:42.814939] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-27T17:58:43.614949] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-27T17:58:43.980708] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T17:58:44.284990] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T17:58:44.414945] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-27T17:58:45.208947] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T17:58:45.220419] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-27T17:58:45.686518] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T17:58:46.014962] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-27T17:58:46.074477] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T17:58:46.814953] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-27T17:58:47.560336] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T17:58:47.614961] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-27T17:58:47.956576] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T17:58:48.414972] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-27T17:58:49.220094] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-27T17:58:49.224992] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T17:58:49.234916] [INFO ] [REMOTE ] CLVT: Full fetch complete (75369 records). [2025-10-27T17:58:49.235062] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-27T17:58:49.621516] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-27T17:58:49.621597] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-27T17:58:49.622411] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-27T17:58:49.622475] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-27T17:58:49.623872] [DEBUG] [LOCAL ] CLVT: Trimmed 75369 records to 51854 (keeping 200 days of data) [2025-10-27T17:58:49.905193] [DEBUG] [LOCAL ] CLVT: Primary data saved (51854 records). [2025-10-27T17:58:49.905323] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-27T17:58:49.905399] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLVT took 29.5s. Estimated remaining: 3h 58m 24s. Rate: 8.0 symbols/min [2025-10-27T17:58:50.020091] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-27T17:58:50.082898] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:50.128963] [DEBUG] [LOCAL ] CM: Loaded 48983 existing records from primary storage. [2025-10-27T17:58:50.129316] [INFO ] [MAIN ] CM: Loaded 48983 existing records. [2025-10-27T17:58:50.311767] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:50.312004] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-27T17:58:50.312090] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-27T17:58:50.312301] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-27T17:58:50.312357] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-27T17:58:50.479060] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T17:58:50.700848] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:50.820049] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-27T17:58:50.830848] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T17:58:51.626511] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-27T17:58:51.632261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T17:58:52.414910] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-27T17:58:52.504026] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T17:58:52.508336] [INFO ] [REMOTE ] CLW: Full fetch complete (33412 records). [2025-10-27T17:58:52.508422] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-27T17:58:52.930118] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-27T17:58:52.930281] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-27T17:58:52.932414] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T17:58:52.931344] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-27T17:58:52.932549] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-27T17:58:52.943822] [DEBUG] [LOCAL ] CLW: Trimmed 33412 records to 20956 (keeping 200 days of data) [2025-10-27T17:58:53.074067] [DEBUG] [LOCAL ] CLW: Primary data saved (20956 records). [2025-10-27T17:58:53.074228] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-27T17:58:53.074344] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLW took 26.2s. Estimated remaining: 3h 57m 58s. Rate: 8.0 symbols/min [2025-10-27T17:58:53.225328] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-27T17:58:53.246325] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:58:53.294247] [DEBUG] [LOCAL ] CMA: Loaded 50940 existing records from primary storage. [2025-10-27T17:58:53.294548] [INFO ] [MAIN ] CMA: Loaded 50940 existing records. [2025-10-27T17:58:53.469288] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:58:53.469487] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-27T17:58:53.469532] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-27T17:58:53.469807] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-27T17:58:53.469863] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-27T17:58:53.831766] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:58:53.856991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T17:58:54.014943] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-27T17:58:54.710469] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T17:58:54.814977] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-27T17:58:55.499542] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T17:58:55.614948] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-27T17:58:56.414989] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-27T17:58:56.806757] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:58:57.048029] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T17:58:57.214929] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-27T17:58:57.606675] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T17:58:58.014927] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-27T17:58:58.814918] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-27T17:58:58.933982] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T17:58:59.614935] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-27T17:59:00.014945] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T17:59:00.355535] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-27T17:59:00.365604] [INFO ] [REMOTE ] CLS: Full fetch complete (77704 records). [2025-10-27T17:59:00.365759] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-27T17:59:00.421339] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-27T17:59:00.759077] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-27T17:59:00.759169] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-27T17:59:00.759996] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-27T17:59:00.760060] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-27T17:59:00.761478] [DEBUG] [LOCAL ] CLS: Trimmed 77704 records to 53546 (keeping 200 days of data) [2025-10-27T17:59:01.078365] [DEBUG] [LOCAL ] CLS: Primary data saved (53546 records). [2025-10-27T17:59:01.078496] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-27T17:59:01.079509] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CLS took 47.1s. Estimated remaining: 3h 57m 53s. Rate: 8.0 symbols/min [2025-10-27T17:59:01.226341] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-27T17:59:01.258443] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:01.292973] [DEBUG] [LOCAL ] CMBT: Loaded 28286 existing records from primary storage. [2025-10-27T17:59:01.293345] [INFO ] [MAIN ] CMBT: Loaded 28286 existing records. [2025-10-27T17:59:01.489532] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:01.489811] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-27T17:59:01.489869] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-27T17:59:01.490045] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-27T17:59:01.490085] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-27T17:59:01.850083] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:01.946579] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T17:59:02.014937] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-27T17:59:02.814954] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-27T17:59:04.155903] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (3.73 seconds). [2025-10-27T17:59:04.166888] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-27T17:59:04.321680] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T17:59:04.420138] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-27T17:59:04.441529] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-27T17:59:04.885109] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T17:59:04.894610] [INFO ] [REMOTE ] CLX: Full fetch complete (73576 records). [2025-10-27T17:59:04.894765] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-27T17:59:04.895692] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T17:59:04.895786] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T17:59:04.895861] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T17:59:04.895948] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-27T17:59:04.896108] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-27T17:59:04.896176] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-10-27T17:59:04.896392] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-10-27T17:59:04.896508] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CLX took 29.9s. Estimated remaining: 3h 57m 30s. Rate: 8.0 symbols/min [2025-10-27T17:59:05.067014] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:05.109557] [DEBUG] [LOCAL ] CMC: Loaded 46265 existing records from primary storage. [2025-10-27T17:59:05.109984] [INFO ] [MAIN ] CMC: Loaded 46265 existing records. [2025-10-27T17:59:05.223471] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-27T17:59:05.305816] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:05.306893] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T17:59:05.307152] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-27T17:59:05.310959] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-27T17:59:05.311266] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-27T17:59:05.311322] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-27T17:59:05.679627] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:05.708805] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (4.48 seconds). [2025-10-27T17:59:06.014976] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-27T17:59:06.531378] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T17:59:06.765231] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T17:59:06.814933] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-27T17:59:07.614932] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-27T17:59:07.628161] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T17:59:08.414932] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-27T17:59:09.214940] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-27T17:59:09.615897] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T17:59:09.949486] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T17:59:09.999102] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T17:59:10.014911] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-27T17:59:10.623780] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T17:59:10.814945] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-27T17:59:11.614953] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-27T17:59:12.313436] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T17:59:12.414906] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-27T17:59:12.487218] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T17:59:13.214935] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-27T17:59:13.657039] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T17:59:14.015001] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-27T17:59:14.544363] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T17:59:14.814962] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-27T17:59:15.614947] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-27T17:59:15.826855] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T17:59:16.414911] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-27T17:59:16.513374] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T17:59:16.861628] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T17:59:17.215009] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-27T17:59:18.014950] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-27T17:59:18.268898] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T17:59:18.283240] [INFO ] [REMOTE ] CMBT: Full fetch complete (34737 records). [2025-10-27T17:59:18.283469] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-27T17:59:18.672295] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-27T17:59:18.672381] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-27T17:59:18.672930] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-27T17:59:18.672995] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-27T17:59:18.673854] [DEBUG] [LOCAL ] CMBT: Trimmed 34737 records to 28308 (keeping 200 days of data) [2025-10-27T17:59:18.816546] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-27T17:59:18.846503] [DEBUG] [LOCAL ] CMBT: Primary data saved (28308 records). [2025-10-27T17:59:18.846963] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-27T17:59:18.848133] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMBT took 17.8s. Estimated remaining: 3h 57m 49s. Rate: 8.0 symbols/min [2025-10-27T17:59:19.020920] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:19.066513] [DEBUG] [LOCAL ] CMCM: Loaded 4882 existing records from primary storage. [2025-10-27T17:59:19.063062] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T17:59:19.078442] [INFO ] [MAIN ] CMCM: Loaded 4882 existing records. [2025-10-27T17:59:19.254805] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:19.255013] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-27T17:59:19.255061] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-27T17:59:19.255187] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-27T17:59:19.255224] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-27T17:59:19.621556] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:19.617592] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-27T17:59:19.661384] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T17:59:20.008079] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T17:59:20.414966] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-27T17:59:21.214917] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-27T17:59:21.288298] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T17:59:21.886467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T17:59:22.014911] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-27T17:59:22.672663] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T17:59:22.682968] [INFO ] [REMOTE ] CM: Full fetch complete (69717 records). [2025-10-27T17:59:22.683117] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-27T17:59:22.820101] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-27T17:59:23.067394] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-27T17:59:23.067485] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-27T17:59:23.068253] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-27T17:59:23.068315] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-27T17:59:23.069563] [DEBUG] [LOCAL ] CM: Trimmed 69717 records to 48138 (keeping 200 days of data) [2025-10-27T17:59:23.353902] [DEBUG] [LOCAL ] CM: Primary data saved (48138 records). [2025-10-27T17:59:23.354017] [INFO ] [MAIN ] CM: Full history saved. [2025-10-27T17:59:23.354090] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CM took 33.4s. Estimated remaining: 3h 57m 29s. Rate: 8.0 symbols/min [2025-10-27T17:59:23.511207] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T17:59:23.527555] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:23.527787] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-27T17:59:23.529138] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-27T17:59:23.529356] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-27T17:59:23.529421] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-27T17:59:23.529598] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-27T17:59:23.529686] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-27T17:59:23.625724] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-27T17:59:23.670351] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T17:59:23.930112] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:24.065479] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T17:59:24.414952] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-27T17:59:25.214949] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-27T17:59:25.919375] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T17:59:25.938815] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T17:59:26.014919] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-27T17:59:26.814964] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-27T17:59:27.567023] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T17:59:27.614959] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-27T17:59:28.250524] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T17:59:28.305909] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T17:59:28.414935] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-27T17:59:29.214990] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-27T17:59:29.642410] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T17:59:30.014976] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-27T17:59:30.256428] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T17:59:30.256791] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-27T17:59:30.256879] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T17:59:30.256929] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-27T17:59:30.256982] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T17:59:30.257032] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-27T17:59:30.257125] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-27T17:59:30.257177] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-27T17:59:30.257219] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-27T17:59:30.257266] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMDB took 6.9s. Estimated remaining: 3h 57m 19s. Rate: 8.0 symbols/min [2025-10-27T17:59:30.423618] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:30.471509] [DEBUG] [LOCAL ] CMG: Loaded 54502 existing records from primary storage. [2025-10-27T17:59:30.471874] [INFO ] [MAIN ] CMG: Loaded 54502 existing records. [2025-10-27T17:59:30.643045] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:30.643245] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-27T17:59:30.643291] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-27T17:59:30.643567] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-27T17:59:30.643605] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-27T17:59:30.818542] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-27T17:59:31.002082] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:31.077691] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T17:59:31.088153] [INFO ] [REMOTE ] CMA: Full fetch complete (73530 records). [2025-10-27T17:59:31.088304] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-27T17:59:31.385957] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T17:59:31.496372] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-27T17:59:31.496454] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-27T17:59:31.497446] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-27T17:59:31.497514] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-27T17:59:31.498963] [DEBUG] [LOCAL ] CMA: Trimmed 73530 records to 50157 (keeping 200 days of data) [2025-10-27T17:59:31.618359] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-27T17:59:31.800363] [DEBUG] [LOCAL ] CMA: Primary data saved (50157 records). [2025-10-27T17:59:31.800486] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-27T17:59:31.801323] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMA took 38.7s. Estimated remaining: 3h 56m 48s. Rate: 8.0 symbols/min [2025-10-27T17:59:31.965340] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:32.004462] [DEBUG] [LOCAL ] CMI: Loaded 42162 existing records from primary storage. [2025-10-27T17:59:32.004769] [INFO ] [MAIN ] CMI: Loaded 42162 existing records. [2025-10-27T17:59:32.176606] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:32.176847] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-27T17:59:32.176904] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-27T17:59:32.177197] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-27T17:59:32.177267] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-27T17:59:32.420218] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-27T17:59:32.531427] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:33.125428] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T17:59:33.214966] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-27T17:59:33.527331] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T17:59:33.730346] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T17:59:34.014938] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-27T17:59:34.815028] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-27T17:59:35.500891] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T17:59:35.614925] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-27T17:59:36.415004] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-27T17:59:36.713137] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T17:59:36.976540] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T17:59:37.214916] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-27T17:59:37.726899] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T17:59:38.014940] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-27T17:59:38.814970] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-27T17:59:39.463733] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T17:59:39.535603] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T17:59:39.614948] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-27T17:59:40.414928] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-27T17:59:40.620306] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T17:59:40.629612] [INFO ] [REMOTE ] CMC: Full fetch complete (67230 records). [2025-10-27T17:59:40.629789] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-27T17:59:41.022601] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-27T17:59:41.022752] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-27T17:59:41.023560] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-27T17:59:41.023632] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-27T17:59:41.025174] [DEBUG] [LOCAL ] CMC: Trimmed 67230 records to 45505 (keeping 200 days of data) [2025-10-27T17:59:41.157155] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T17:59:41.226260] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-27T17:59:41.322760] [DEBUG] [LOCAL ] CMC: Primary data saved (45505 records). [2025-10-27T17:59:41.322873] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-27T17:59:41.322944] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMC took 36.4s. Estimated remaining: 3h 56m 48s. Rate: 8.0 symbols/min [2025-10-27T17:59:41.490116] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T17:59:41.521421] [DEBUG] [LOCAL ] CMP: Loaded 36035 existing records from primary storage. [2025-10-27T17:59:41.521706] [INFO ] [MAIN ] CMP: Loaded 36035 existing records. [2025-10-27T17:59:41.699495] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T17:59:41.699756] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-27T17:59:41.699814] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-27T17:59:41.699988] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-27T17:59:41.700042] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-27T17:59:42.020208] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-27T17:59:42.058040] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T17:59:42.231298] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T17:59:42.502454] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T17:59:42.677038] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T17:59:42.814969] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-27T17:59:43.458118] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T17:59:43.614937] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-27T17:59:44.415009] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-27T17:59:44.785040] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T17:59:45.215009] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-27T17:59:45.618464] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T17:59:46.014956] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-27T17:59:46.814922] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-27T17:59:47.387346] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T17:59:47.599558] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T17:59:47.614899] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-27T17:59:48.194233] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T17:59:48.414972] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-27T17:59:49.058349] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T17:59:49.060214] [INFO ] [REMOTE ] CMCM: Full fetch complete (7089 records). [2025-10-27T17:59:49.060341] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-27T17:59:49.240362] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-27T17:59:49.436009] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-27T17:59:49.436109] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-27T17:59:49.436436] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-27T17:59:49.436514] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-27T17:59:49.437274] [DEBUG] [LOCAL ] CMCM: Trimmed 7089 records to 4809 (keeping 200 days of data) [2025-10-27T17:59:49.490847] [DEBUG] [LOCAL ] CMCM: Primary data saved (4809 records). [2025-10-27T17:59:49.490947] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-27T17:59:49.491023] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMCM took 30.6s. Estimated remaining: 3h 56m 43s. Rate: 8.0 symbols/min [2025-10-27T17:59:49.493702] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T17:59:50.014935] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-27T17:59:50.814906] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-27T17:59:50.983860] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T17:59:51.032552] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T17:59:51.614941] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-27T17:59:52.415046] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-27T17:59:53.002741] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T17:59:53.214976] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-27T17:59:53.251637] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T17:59:53.648166] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T17:59:54.015040] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-27T17:59:54.818635] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-27T17:59:54.821100] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T17:59:55.209943] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T17:59:55.614951] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-27T17:59:56.415018] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-27T17:59:56.743903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T17:59:57.000524] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T17:59:57.013902] [INFO ] [REMOTE ] CMI: Full fetch complete (61172 records). [2025-10-27T17:59:57.014106] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-27T17:59:57.223045] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-27T17:59:57.503485] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-27T17:59:57.503559] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-27T17:59:57.504294] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-27T17:59:57.504355] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-27T17:59:57.505443] [DEBUG] [LOCAL ] CMI: Trimmed 61172 records to 41324 (keeping 200 days of data) [2025-10-27T17:59:57.776972] [DEBUG] [LOCAL ] CMI: Primary data saved (41324 records). [2025-10-27T17:59:57.777116] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-27T17:59:57.777203] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMI took 26.0s. Estimated remaining: 3h 56m 39s. Rate: 8.0 symbols/min [2025-10-27T17:59:57.978789] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T17:59:58.014910] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-27T17:59:58.966413] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T17:59:58.974964] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-27T17:59:59.292280] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-27T17:59:59.614996] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-27T17:59:59.930891] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:00:00.172484] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:00:00.182667] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-27T18:00:00.182807] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-27T18:00:00.425451] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-27T18:00:00.578705] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-27T18:00:00.578786] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-27T18:00:00.579616] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-27T18:00:00.579684] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-27T18:00:00.581087] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53723 (keeping 200 days of data) [2025-10-27T18:00:00.899476] [DEBUG] [LOCAL ] CMG: Primary data saved (53723 records). [2025-10-27T18:00:00.899691] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-27T18:00:00.899783] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMG took 30.6s. Estimated remaining: 3h 56m 14s. Rate: 8.0 symbols/min [2025-10-27T18:00:03.598980] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-10-27T18:00:03.605334] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-27T18:00:06.126738] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T18:00:06.132479] [INFO ] [REMOTE ] CMP: Full fetch complete (51381 records). [2025-10-27T18:00:06.132616] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-27T18:00:06.518338] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-27T18:00:06.518440] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-27T18:00:06.519103] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-27T18:00:06.519165] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-27T18:00:06.520377] [DEBUG] [LOCAL ] CMP: Trimmed 51381 records to 35271 (keeping 200 days of data) [2025-10-27T18:00:06.717096] [DEBUG] [LOCAL ] CMP: Primary data saved (35271 records). [2025-10-27T18:00:06.717239] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-27T18:00:06.717333] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMP took 25.4s. Estimated remaining: 3h 55m 60s. Rate: 8.0 symbols/min [2025-10-27T18:00:07.316964] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.356171] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.433258] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.436703] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:07.443013] [DEBUG] [LOCAL ] CMSA: Loaded 3514 existing records from primary storage. [2025-10-27T18:00:07.443186] [INFO ] [MAIN ] CMSA: Loaded 3514 existing records. [2025-10-27T18:00:07.680304] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:07.680771] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-27T18:00:07.680849] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-27T18:00:07.681231] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-27T18:00:07.681311] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-27T18:00:07.782566] [DEBUG] [LOCAL ] CMRE: Loaded 36133 existing records from primary storage. [2025-10-27T18:00:07.804032] [DEBUG] [LOCAL ] CMPO: Loaded 38765 existing records from primary storage. [2025-10-27T18:00:07.821272] [INFO ] [MAIN ] CMRE: Loaded 36133 existing records. [2025-10-27T18:00:07.827837] [DEBUG] [LOCAL ] CMS: Loaded 53289 existing records from primary storage. [2025-10-27T18:00:07.821573] [INFO ] [MAIN ] CMPO: Loaded 38765 existing records. [2025-10-27T18:00:07.879137] [INFO ] [MAIN ] CMS: Loaded 53289 existing records. [2025-10-27T18:00:08.382098] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.484692] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.510140] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-27T18:00:08.569148] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-27T18:00:08.596276] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.599549] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-27T18:00:08.641210] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:08.599384] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:08.655603] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-27T18:00:08.636043] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.655332] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-27T18:00:08.662201] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-27T18:00:08.685518] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-27T18:00:08.720059] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-27T18:00:08.729397] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-27T18:00:08.724106] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-27T18:00:08.739802] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-27T18:00:09.525901] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.542963] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-27T18:00:09.714810] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.733980] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:09.734249] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-27T18:00:09.734480] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-27T18:00:09.776763] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:00:09.778294] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-27T18:00:10.586574] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:00:10.587802] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-27T18:00:10.811593] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:00:10.817929] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-27T18:00:11.979489] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:00:11.989891] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-27T18:00:12.232359] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:00:12.239503] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-27T18:00:12.243243] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:00:12.244432] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-27T18:00:12.450377] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-27T18:00:12.459477] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-27T18:00:13.373581] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T18:00:13.381813] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-27T18:00:13.450033] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:00:13.451547] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-27T18:00:13.707133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T18:00:13.715532] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-27T18:00:14.073904] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:00:14.075404] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-27T18:00:14.252258] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-27T18:00:14.262089] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-27T18:00:15.281865] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T18:00:15.283547] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-27T18:00:15.543387] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:00:15.603667] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:00:15.614900] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-27T18:00:15.677078] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T18:00:15.778187] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:00:15.969828] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:00:16.414875] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-27T18:00:17.214958] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-27T18:00:17.840182] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:00:18.014913] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-27T18:00:18.401609] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:00:18.814980] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-27T18:00:19.607453] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:00:19.615762] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-27T18:00:20.181256] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:00:20.415029] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-27T18:00:21.215030] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-27T18:00:21.343285] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:00:21.911889] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:00:22.014953] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-27T18:00:22.321683] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:00:22.815003] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-27T18:00:23.218577] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:00:23.614966] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-27T18:00:24.414926] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-27T18:00:24.682765] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-27T18:00:25.049365] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:00:25.214951] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-27T18:00:25.376379] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:00:26.014988] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-27T18:00:26.528545] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T18:00:26.756289] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:00:26.814915] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-27T18:00:27.614984] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-27T18:00:28.323910] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:00:28.414916] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-27T18:00:28.537218] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:00:29.214989] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-27T18:00:29.454958] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:00:29.461499] [INFO ] [REMOTE ] CMPO: Full fetch complete (57855 records). [2025-10-27T18:00:29.461603] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-27T18:00:29.868017] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-27T18:00:29.868108] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-27T18:00:29.868854] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-27T18:00:29.868920] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-27T18:00:29.870138] [DEBUG] [LOCAL ] CMPO: Trimmed 57855 records to 37974 (keeping 200 days of data) [2025-10-27T18:00:30.031435] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-27T18:00:30.094216] [DEBUG] [LOCAL ] CMPO: Primary data saved (37974 records). [2025-10-27T18:00:30.094356] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-27T18:00:30.094435] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMPO took 23.4s. Estimated remaining: 3h 56m 54s. Rate: 8.0 symbols/min [2025-10-27T18:00:30.268622] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:30.291076] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:00:30.301323] [DEBUG] [LOCAL ] CMSC: Loaded 4846 existing records from primary storage. [2025-10-27T18:00:30.301765] [INFO ] [MAIN ] CMSC: Loaded 4846 existing records. [2025-10-27T18:00:30.301528] [INFO ] [REMOTE ] CMRE: Full fetch complete (51153 records). [2025-10-27T18:00:30.357565] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-27T18:00:30.606439] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:30.634671] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-27T18:00:30.590163] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:00:30.636040] [INFO ] [REMOTE ] CMSA: Full fetch complete (4788 records). [2025-10-27T18:00:30.636134] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-27T18:00:30.646532] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-27T18:00:30.663888] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:00:30.664037] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:00:30.663367] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-27T18:00:30.692684] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-27T18:00:30.692789] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:00:30.717853] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-27T18:00:30.820022] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-27T18:00:30.845906] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-27T18:00:30.857104] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-27T18:00:30.885409] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-27T18:00:30.896321] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMSA took 24.2s. Estimated remaining: 3h 56m 21s. Rate: 8.0 symbols/min [2025-10-27T18:00:31.325844] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-27T18:00:31.351017] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-27T18:00:31.371541] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-27T18:00:31.370617] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:31.376930] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-27T18:00:31.453294] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:31.454279] [DEBUG] [LOCAL ] CMRE: Trimmed 51153 records to 35264 (keeping 200 days of data) [2025-10-27T18:00:31.508316] [DEBUG] [LOCAL ] CMSD: Loaded 7687 existing records from primary storage. [2025-10-27T18:00:31.516868] [INFO ] [MAIN ] CMSD: Loaded 7687 existing records. [2025-10-27T18:00:31.622300] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-27T18:00:31.762749] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:31.766203] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-27T18:00:31.766316] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-27T18:00:31.766511] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-27T18:00:31.766578] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-27T18:00:32.088279] [DEBUG] [LOCAL ] CMRE: Primary data saved (35264 records). [2025-10-27T18:00:32.114107] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-27T18:00:32.119978] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMRE took 25.4s. Estimated remaining: 3h 55m 48s. Rate: 8.0 symbols/min [2025-10-27T18:00:32.342622] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:32.355363] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T18:00:32.417912] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:32.418019] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-27T18:00:32.453570] [DEBUG] [LOCAL ] CMTG: Loaded 35511 existing records from primary storage. [2025-10-27T18:00:32.453912] [INFO ] [MAIN ] CMTG: Loaded 35511 existing records. [2025-10-27T18:00:32.650597] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:32.669427] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-27T18:00:32.672895] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-27T18:00:32.673217] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-27T18:00:32.673850] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-27T18:00:32.708748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:00:32.965350] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:00:33.050926] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:33.214917] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-27T18:00:34.014986] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-27T18:00:34.363116] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:00:34.814918] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-27T18:00:35.615010] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-27T18:00:35.814338] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T18:00:35.833179] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:00:36.420038] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-27T18:00:36.431055] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T18:00:36.826463] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:00:37.214980] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-27T18:00:37.648233] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:00:38.014992] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-27T18:00:38.814966] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-27T18:00:39.247875] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T18:00:39.432246] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:00:39.614927] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-27T18:00:40.414940] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-27T18:00:40.873787] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:00:40.984201] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:00:41.214962] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-27T18:00:41.911267] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T18:00:42.015017] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-27T18:00:42.797494] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:00:42.814907] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-27T18:00:43.574053] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T18:00:43.614996] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-27T18:00:44.415014] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-27T18:00:44.805085] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:00:45.215007] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-27T18:00:45.296869] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:00:45.307739] [INFO ] [REMOTE ] CMS: Full fetch complete (76280 records). [2025-10-27T18:00:45.307936] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-27T18:00:45.653894] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:00:45.736836] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-27T18:00:45.736921] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-27T18:00:45.737860] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-27T18:00:45.737926] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-27T18:00:45.739357] [DEBUG] [LOCAL ] CMS: Trimmed 76280 records to 52509 (keeping 200 days of data) [2025-10-27T18:00:46.019389] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-27T18:00:46.057391] [DEBUG] [LOCAL ] CMS: Primary data saved (52509 records). [2025-10-27T18:00:46.057687] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-27T18:00:46.057813] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 39.3s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-27T18:00:46.227384] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:00:46.235709] [DEBUG] [LOCAL ] CMU: Loaded 6365 existing records from primary storage. [2025-10-27T18:00:46.235911] [INFO ] [MAIN ] CMU: Loaded 6365 existing records. [2025-10-27T18:00:46.412895] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:00:46.413095] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-27T18:00:46.413143] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-27T18:00:46.413282] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-27T18:00:46.413322] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-27T18:00:46.769793] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:00:46.814908] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-27T18:00:47.457927] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:00:47.587704] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T18:00:47.614896] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-27T18:00:48.164668] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:00:48.414934] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-27T18:00:49.214964] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-27T18:00:49.336298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:00:49.803695] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:00:50.014948] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-27T18:00:50.814990] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-27T18:00:50.848154] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T18:00:51.614950] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-27T18:00:52.152780] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:00:52.241732] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T18:00:52.414925] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-27T18:00:52.853856] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:00:53.214990] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-27T18:00:53.655974] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:00:54.014962] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-27T18:00:54.399007] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T18:00:54.814945] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-27T18:00:55.614949] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-27T18:00:55.902074] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:00:55.955381] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T18:00:56.414918] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-27T18:00:57.214978] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-27T18:00:57.622316] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T18:00:57.859054] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:00:58.014956] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-27T18:00:58.573985] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T18:00:58.814924] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-27T18:00:59.472364] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:00:59.614964] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-27T18:01:00.158003] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T18:01:00.159672] [INFO ] [REMOTE ] CMSD: Full fetch complete (11403 records). [2025-10-27T18:01:00.159746] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-27T18:01:00.420220] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-27T18:01:00.516853] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-27T18:01:00.516929] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-27T18:01:00.517196] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-27T18:01:00.517255] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-27T18:01:00.517717] [DEBUG] [LOCAL ] CMSD: Trimmed 11403 records to 7446 (keeping 200 days of data) [2025-10-27T18:01:00.561298] [DEBUG] [LOCAL ] CMSD: Primary data saved (7446 records). [2025-10-27T18:01:00.561380] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-27T18:01:00.561450] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMSD took 29.7s. Estimated remaining: 3h 56m 25s. Rate: 8.0 symbols/min [2025-10-27T18:01:00.726118] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:00.755987] [DEBUG] [LOCAL ] CNA: Loaded 32892 existing records from primary storage. [2025-10-27T18:01:00.756232] [INFO ] [MAIN ] CNA: Loaded 32892 existing records. [2025-10-27T18:01:00.930639] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:00.930862] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-27T18:01:00.930907] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-27T18:01:00.931090] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-27T18:01:00.931144] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-27T18:01:01.220126] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-27T18:01:01.277049] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:02.015164] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-27T18:01:02.814995] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-27T18:01:04.876948] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (4.46 seconds). [2025-10-27T18:01:04.879929] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-27T18:01:06.292676] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (4.28 seconds). [2025-10-27T18:01:06.293973] [INFO ] [REMOTE ] CMSC: Full fetch complete (6856 records). [2025-10-27T18:01:06.294042] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-27T18:01:06.294392] [FATAL] [VALIDATOR ] CMSC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:06.294471] [FATAL] [MAIN ] CMSC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:06.294512] [WARN ] [MAIN ] CMSC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:06.294549] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-27T18:01:06.294602] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-27T18:01:06.294634] [INFO ] [LOCAL ] CMSC: Starting deletion of derivative data. [2025-10-27T18:01:06.294806] [DEBUG] [LOCAL ] CMSC: Deleted derivative data file. [2025-10-27T18:01:06.294874] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMSC took 36.2s. Estimated remaining: 3h 56m 11s. Rate: 8.0 symbols/min [2025-10-27T18:01:06.414847] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T18:01:06.432912] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-27T18:01:06.500893] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (5.28 seconds). [2025-10-27T18:01:06.499327] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:06.509864] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-27T18:01:06.551242] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (3.74 seconds). [2025-10-27T18:01:06.556882] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-27T18:01:06.573823] [DEBUG] [LOCAL ] CNC: Loaded 54559 existing records from primary storage. [2025-10-27T18:01:06.574155] [INFO ] [MAIN ] CNC: Loaded 54559 existing records. [2025-10-27T18:01:06.752069] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:06.752270] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-27T18:01:06.752316] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-27T18:01:06.752595] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-27T18:01:06.752632] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-27T18:01:06.909667] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T18:01:06.980453] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-27T18:01:07.127456] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:07.551516] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:01:07.552744] [INFO ] [REMOTE ] CMU: Full fetch complete (9443 records). [2025-10-27T18:01:07.552811] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-27T18:01:07.620152] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-27T18:01:07.767725] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:01:07.831195] [INFO ] [REMOTE ] CMTG: Full fetch complete (52429 records). [2025-10-27T18:01:07.842787] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-27T18:01:07.866623] [FATAL] [VALIDATOR ] CMTG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:07.887572] [FATAL] [MAIN ] CMTG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:07.926167] [WARN ] [MAIN ] CMTG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:07.951363] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-27T18:01:07.951604] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-27T18:01:07.951955] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-27T18:01:07.952155] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-27T18:01:07.943010] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-27T18:01:07.965204] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-27T18:01:07.952844] [DEBUG] [LOCAL ] CMU: Trimmed 9443 records to 6086 (keeping 200 days of data) [2025-10-27T18:01:07.968002] [INFO ] [LOCAL ] CMTG: Starting deletion of derivative data. [2025-10-27T18:01:07.973298] [DEBUG] [LOCAL ] CMTG: Deleted derivative data file. [2025-10-27T18:01:07.973983] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CMTG took 35.8s. Estimated remaining: 3h 55m 41s. Rate: 8.0 symbols/min [2025-10-27T18:01:08.006739] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:01:08.091957] [DEBUG] [LOCAL ] CMU: Primary data saved (6086 records). [2025-10-27T18:01:08.123330] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-27T18:01:08.133714] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CMU took 22.1s. Estimated remaining: 3h 55m 5s. Rate: 8.0 symbols/min [2025-10-27T18:01:08.327544] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:08.378418] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:08.387248] [DEBUG] [LOCAL ] CNF: Loaded 10649 existing records from primary storage. [2025-10-27T18:01:08.387598] [INFO ] [MAIN ] CNF: Loaded 10649 existing records. [2025-10-27T18:01:08.418690] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-27T18:01:08.588392] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:08.588693] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-27T18:01:08.588754] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-27T18:01:08.588896] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-27T18:01:08.588935] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-27T18:01:08.734028] [DEBUG] [LOCAL ] CNH: Loaded 54321 existing records from primary storage. [2025-10-27T18:01:08.750123] [INFO ] [MAIN ] CNH: Loaded 54321 existing records. [2025-10-27T18:01:09.099098] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:09.124760] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-27T18:01:09.155019] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-27T18:01:09.192557] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-27T18:01:09.192767] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-27T18:01:09.196359] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:09.220013] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-27T18:01:09.603410] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:09.606559] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T18:01:09.633744] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:01:09.679325] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T18:01:10.014950] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-27T18:01:10.814994] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-27T18:01:11.402302] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:01:11.614942] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-27T18:01:12.411934] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T18:01:12.421634] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-27T18:01:13.010051] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:01:13.214935] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-27T18:01:13.532431] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T18:01:14.014919] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-27T18:01:14.739274] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:01:14.814913] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-27T18:01:14.901918] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:01:15.614927] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-27T18:01:16.041622] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:01:16.216806] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:01:16.414966] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-27T18:01:17.214971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-27T18:01:18.014939] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-27T18:01:18.128152] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:01:18.156144] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:01:18.814974] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-27T18:01:18.837230] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T18:01:19.614940] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-27T18:01:20.018035] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:01:20.414984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-27T18:01:21.026596] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:01:21.203552] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:01:21.214899] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-27T18:01:22.014885] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-27T18:01:22.598426] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T18:01:22.814948] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-27T18:01:23.584794] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:01:23.614901] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-27T18:01:24.124470] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:01:24.414939] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-27T18:01:25.214932] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-27T18:01:25.286416] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:01:26.014942] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-27T18:01:26.533033] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:01:26.814946] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-27T18:01:27.140973] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T18:01:27.614920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-27T18:01:27.737507] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:01:27.806639] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:01:28.087976] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T18:01:28.415001] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-27T18:01:29.215027] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-27T18:01:29.848414] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:01:30.015003] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-27T18:01:30.674665] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:01:30.814937] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-27T18:01:31.614956] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-27T18:01:31.834171] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:01:31.862164] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T18:01:31.868096] [INFO ] [REMOTE ] CNA: Full fetch complete (46175 records). [2025-10-27T18:01:31.868216] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-27T18:01:32.259130] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-27T18:01:32.259203] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-27T18:01:32.259793] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-27T18:01:32.259854] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-27T18:01:32.260759] [DEBUG] [LOCAL ] CNA: Trimmed 46175 records to 32238 (keeping 200 days of data) [2025-10-27T18:01:32.426606] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-27T18:01:32.447831] [DEBUG] [LOCAL ] CNA: Primary data saved (32238 records). [2025-10-27T18:01:32.447941] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-27T18:01:32.448014] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNA took 31.9s. Estimated remaining: 3h 56m 2s. Rate: 8.0 symbols/min [2025-10-27T18:01:32.612602] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:32.658056] [DEBUG] [LOCAL ] CNI: Loaded 52378 existing records from primary storage. [2025-10-27T18:01:32.658381] [INFO ] [MAIN ] CNI: Loaded 52378 existing records. [2025-10-27T18:01:32.835115] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:32.835324] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-27T18:01:32.835379] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-27T18:01:32.835673] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-27T18:01:32.835744] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-27T18:01:33.204017] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:33.220039] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-27T18:01:33.240269] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:01:33.473310] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:01:34.014963] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-27T18:01:34.814920] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-27T18:01:34.966375] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:01:35.614985] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-27T18:01:35.627531] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:01:35.906793] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T18:01:36.414997] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-27T18:01:37.144338] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:01:37.215015] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-27T18:01:37.970941] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:01:38.014992] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-27T18:01:38.286365] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T18:01:38.288893] [INFO ] [REMOTE ] CNF: Full fetch complete (12939 records). [2025-10-27T18:01:38.288996] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-27T18:01:38.664406] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-27T18:01:38.664490] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-27T18:01:38.664797] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-27T18:01:38.664857] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-27T18:01:38.665355] [DEBUG] [LOCAL ] CNF: Trimmed 12939 records to 10606 (keeping 200 days of data) [2025-10-27T18:01:38.721787] [DEBUG] [LOCAL ] CNF: Primary data saved (10606 records). [2025-10-27T18:01:38.721914] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-27T18:01:38.722008] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNF took 30.7s. Estimated remaining: 3h 55m 49s. Rate: 8.0 symbols/min [2025-10-27T18:01:38.820045] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-27T18:01:38.918899] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:38.969129] [DEBUG] [LOCAL ] CNK: Loaded 53674 existing records from primary storage. [2025-10-27T18:01:38.969451] [INFO ] [MAIN ] CNK: Loaded 53674 existing records. [2025-10-27T18:01:39.141894] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:39.142062] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-27T18:01:39.142107] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-27T18:01:39.142376] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-27T18:01:39.142440] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-27T18:01:39.561669] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:39.619022] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-27T18:01:39.624894] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:01:39.635920] [INFO ] [REMOTE ] CNC: Full fetch complete (77864 records). [2025-10-27T18:01:39.654050] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-27T18:01:39.702694] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:01:40.079198] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-27T18:01:40.079275] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-27T18:01:40.080100] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-27T18:01:40.080170] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-27T18:01:40.081545] [DEBUG] [LOCAL ] CNC: Trimmed 77864 records to 53779 (keeping 200 days of data) [2025-10-27T18:01:40.393557] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-27T18:01:40.393732] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-27T18:01:40.393823] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNC took 34.1s. Estimated remaining: 3h 55m 19s. Rate: 8.0 symbols/min [2025-10-27T18:01:40.424212] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-27T18:01:40.574627] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:40.621129] [DEBUG] [LOCAL ] CNM: Loaded 51731 existing records from primary storage. [2025-10-27T18:01:40.621466] [INFO ] [MAIN ] CNM: Loaded 51731 existing records. [2025-10-27T18:01:40.804725] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:40.804929] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-27T18:01:40.804979] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-27T18:01:40.805151] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-27T18:01:40.805231] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-27T18:01:41.189053] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:41.214919] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-27T18:01:41.246832] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T18:01:42.014637] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T18:01:42.023430] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-27T18:01:42.025674] [INFO ] [REMOTE ] CNH: Full fetch complete (77313 records). [2025-10-27T18:01:42.025817] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-27T18:01:42.026772] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:01:42.026859] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:01:42.026945] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:01:42.027017] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-27T18:01:42.027127] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-27T18:01:42.027178] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-27T18:01:42.027324] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-27T18:01:42.027416] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNH took 33.9s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-10-27T18:01:42.197007] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:42.227563] [DEBUG] [LOCAL ] CNMD: Loaded 32565 existing records from primary storage. [2025-10-27T18:01:42.227905] [INFO ] [MAIN ] CNMD: Loaded 32565 existing records. [2025-10-27T18:01:42.402951] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:42.403154] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-27T18:01:42.403202] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-27T18:01:42.403374] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-27T18:01:42.403416] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-27T18:01:42.769398] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:42.814926] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-27T18:01:43.038959] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:01:43.522181] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:01:43.614935] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-27T18:01:43.917944] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T18:01:44.414932] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-27T18:01:45.214921] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-27T18:01:45.314414] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:01:45.940105] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:01:46.014969] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-27T18:01:46.643129] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:01:46.814948] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-27T18:01:47.615475] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-27T18:01:47.618293] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:01:48.414970] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-27T18:01:48.661202] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T18:01:48.989122] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:01:49.215012] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-27T18:01:49.742574] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:01:50.014954] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-27T18:01:50.524764] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:01:50.814931] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-27T18:01:51.614987] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-27T18:01:51.857695] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:01:52.364187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:01:52.414940] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-27T18:01:52.788508] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:01:53.214915] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-27T18:01:54.014977] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-27T18:01:54.088587] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T18:01:54.814926] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-27T18:01:54.860020] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:01:55.614917] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-27T18:01:55.941491] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T18:01:56.262668] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:01:56.414931] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-27T18:01:56.751061] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:01:57.214944] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-27T18:01:58.014949] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-27T18:01:58.062829] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:01:58.072503] [INFO ] [REMOTE ] CNI: Full fetch complete (74844 records). [2025-10-27T18:01:58.072666] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-27T18:01:58.461844] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-27T18:01:58.461986] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-27T18:01:58.462892] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-27T18:01:58.462955] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-27T18:01:58.464383] [DEBUG] [LOCAL ] CNI: Trimmed 74844 records to 51583 (keeping 200 days of data) [2025-10-27T18:01:58.574775] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:01:58.795452] [DEBUG] [LOCAL ] CNI: Primary data saved (51583 records). [2025-10-27T18:01:58.795580] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-27T18:01:58.795678] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNI took 26.3s. Estimated remaining: 3h 55m 17s. Rate: 8.0 symbols/min [2025-10-27T18:01:58.826232] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-27T18:01:58.969276] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:01:59.002813] [DEBUG] [LOCAL ] CNNE: Loaded 36187 existing records from primary storage. [2025-10-27T18:01:59.003123] [INFO ] [MAIN ] CNNE: Loaded 36187 existing records. [2025-10-27T18:01:59.175964] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:01:59.176191] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-27T18:01:59.176236] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-27T18:01:59.176408] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-27T18:01:59.176446] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-27T18:01:59.528253] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:01:59.588404] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:01:59.614922] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-27T18:02:00.414921] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-27T18:02:00.660410] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:02:01.214997] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-27T18:02:02.014987] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-27T18:02:02.214057] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-27T18:02:02.814983] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-27T18:02:03.994323] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-27T18:02:04.005083] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-27T18:02:04.240759] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (3.83 seconds). [2025-10-27T18:02:04.414952] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-27T18:02:04.988480] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-27T18:02:05.214964] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-27T18:02:05.952369] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:02:06.014901] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-27T18:02:06.058804] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-10-27T18:02:06.175813] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T18:02:06.699255] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T18:02:06.814946] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-27T18:02:07.614994] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-27T18:02:08.265935] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-27T18:02:08.335520] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:02:08.414928] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-27T18:02:08.756365] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:02:09.214939] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-27T18:02:09.592046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:02:09.598208] [INFO ] [REMOTE ] CNMD: Full fetch complete (47450 records). [2025-10-27T18:02:09.598308] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-27T18:02:09.970521] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-27T18:02:09.970601] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-27T18:02:09.971204] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-27T18:02:09.971267] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-27T18:02:09.972263] [DEBUG] [LOCAL ] CNMD: Trimmed 47450 records to 31736 (keeping 200 days of data) [2025-10-27T18:02:10.023116] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-27T18:02:10.159159] [DEBUG] [LOCAL ] CNMD: Primary data saved (31736 records). [2025-10-27T18:02:10.159293] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-27T18:02:10.159369] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNMD took 28.1s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-27T18:02:10.324442] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:10.358758] [DEBUG] [LOCAL ] CNO: Loaded 40807 existing records from primary storage. [2025-10-27T18:02:10.359028] [INFO ] [MAIN ] CNO: Loaded 40807 existing records. [2025-10-27T18:02:10.537521] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:10.537754] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-27T18:02:10.537826] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-27T18:02:10.538223] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-27T18:02:10.538260] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-27T18:02:10.825057] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-27T18:02:10.929118] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T18:02:10.933009] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:11.614917] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-27T18:02:11.816336] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:02:12.031148] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:02:12.414991] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-27T18:02:12.500426] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:02:13.215007] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-27T18:02:13.714680] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:02:14.014932] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-27T18:02:14.814958] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-27T18:02:14.873095] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:02:14.883062] [INFO ] [REMOTE ] CNK: Full fetch complete (76342 records). [2025-10-27T18:02:14.883173] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-27T18:02:15.296919] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-27T18:02:15.297001] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-27T18:02:15.298320] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-27T18:02:15.298384] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-27T18:02:15.299839] [DEBUG] [LOCAL ] CNK: Trimmed 76342 records to 52892 (keeping 200 days of data) [2025-10-27T18:02:15.420939] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:02:15.620825] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-27T18:02:15.641826] [DEBUG] [LOCAL ] CNK: Primary data saved (52892 records). [2025-10-27T18:02:15.641905] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-27T18:02:15.642804] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNK took 36.9s. Estimated remaining: 3h 55m 9s. Rate: 8.0 symbols/min [2025-10-27T18:02:15.811469] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:15.860922] [DEBUG] [LOCAL ] CNP: Loaded 54255 existing records from primary storage. [2025-10-27T18:02:15.861283] [INFO ] [MAIN ] CNP: Loaded 54255 existing records. [2025-10-27T18:02:16.037174] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:16.037374] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-27T18:02:16.037453] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-27T18:02:16.037758] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-27T18:02:16.037822] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-27T18:02:16.404115] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:16.414896] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-27T18:02:16.706074] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:02:16.715927] [INFO ] [REMOTE ] CNM: Full fetch complete (73761 records). [2025-10-27T18:02:16.716058] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-27T18:02:17.121384] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-27T18:02:17.121494] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-27T18:02:17.122450] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-27T18:02:17.122639] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-27T18:02:17.139466] [DEBUG] [LOCAL ] CNM: Trimmed 73761 records to 50952 (keeping 200 days of data) [2025-10-27T18:02:17.156127] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T18:02:17.219459] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-27T18:02:17.481930] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T18:02:17.498130] [DEBUG] [LOCAL ] CNM: Primary data saved (50952 records). [2025-10-27T18:02:17.498230] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-27T18:02:17.499066] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNM took 37.1s. Estimated remaining: 3h 54m 40s. Rate: 8.0 symbols/min [2025-10-27T18:02:17.668288] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:17.717284] [DEBUG] [LOCAL ] CNQ: Loaded 54361 existing records from primary storage. [2025-10-27T18:02:17.717594] [INFO ] [MAIN ] CNQ: Loaded 54361 existing records. [2025-10-27T18:02:17.897613] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:17.897992] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-27T18:02:17.898038] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-27T18:02:17.898525] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-27T18:02:17.898562] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-27T18:02:18.020111] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-27T18:02:18.260811] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:18.814971] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-27T18:02:18.977820] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T18:02:19.062680] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:02:19.614934] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-27T18:02:20.414914] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-27T18:02:20.750624] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T18:02:21.090949] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:02:21.215098] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-27T18:02:21.579549] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:02:22.015022] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-27T18:02:22.326579] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:02:22.814943] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-27T18:02:23.614926] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-27T18:02:24.020724] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T18:02:24.209888] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T18:02:24.414991] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-27T18:02:24.874979] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:02:25.215024] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-27T18:02:25.540952] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:02:26.015063] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-27T18:02:26.252635] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:02:26.259015] [INFO ] [REMOTE ] CNNE: Full fetch complete (50430 records). [2025-10-27T18:02:26.259124] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-27T18:02:26.259730] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:26.259818] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:26.259862] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:26.259930] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-27T18:02:26.259993] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-27T18:02:26.260029] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-27T18:02:26.260156] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-27T18:02:26.260227] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNNE took 27.5s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-27T18:02:26.432235] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:26.432365] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-27T18:02:26.432403] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-27T18:02:26.432511] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-27T18:02:26.432552] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-27T18:02:26.432594] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-27T18:02:26.432625] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-27T18:02:26.787040] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:26.814906] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-27T18:02:27.430462] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T18:02:27.614937] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-27T18:02:27.770360] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:02:28.415002] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-27T18:02:29.023931] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:02:29.214938] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-27T18:02:29.884755] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:02:30.014973] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-27T18:02:30.421769] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T18:02:30.814955] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-27T18:02:31.530365] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:02:31.614998] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-27T18:02:32.065339] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:02:32.414930] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-27T18:02:32.989046] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T18:02:33.215028] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-27T18:02:33.958739] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:02:34.014923] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-27T18:02:34.724781] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:02:34.814980] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-27T18:02:35.614916] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-27T18:02:35.931418] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:02:36.363537] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T18:02:36.414904] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-27T18:02:37.075377] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:02:37.214959] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-27T18:02:38.014988] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-27T18:02:38.049203] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T18:02:38.056304] [INFO ] [REMOTE ] CNO: Full fetch complete (60455 records). [2025-10-27T18:02:38.056417] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-27T18:02:38.057097] [FATAL] [VALIDATOR ] CNO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:38.057204] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:38.057247] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:38.057285] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-27T18:02:38.057344] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-27T18:02:38.057379] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-10-27T18:02:38.057528] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-10-27T18:02:38.057639] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNO took 27.9s. Estimated remaining: 3h 54m 45s. Rate: 8.0 symbols/min [2025-10-27T18:02:38.222103] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:38.242128] [DEBUG] [LOCAL ] CNS: Loaded 21673 existing records from primary storage. [2025-10-27T18:02:38.242356] [INFO ] [MAIN ] CNS: Loaded 21673 existing records. [2025-10-27T18:02:38.416085] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:38.416421] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-27T18:02:38.416474] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-27T18:02:38.416674] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-27T18:02:38.416731] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-27T18:02:38.790919] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:38.816939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-27T18:02:38.837718] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T18:02:39.614960] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-27T18:02:39.732149] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T18:02:40.414954] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-27T18:02:40.613015] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:02:40.861585] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:02:41.215025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-27T18:02:41.885918] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:02:41.997295] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:02:42.014900] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-27T18:02:42.814980] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-27T18:02:43.614929] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-27T18:02:43.675122] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:02:43.686052] [INFO ] [REMOTE ] CNP: Full fetch complete (77556 records). [2025-10-27T18:02:43.686231] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-27T18:02:44.115009] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-27T18:02:44.115194] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-27T18:02:44.116207] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-27T18:02:44.116330] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-27T18:02:44.132712] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:02:44.139619] [DEBUG] [LOCAL ] CNP: Trimmed 77556 records to 53474 (keeping 200 days of data) [2025-10-27T18:02:44.427006] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-27T18:02:44.472404] [DEBUG] [LOCAL ] CNP: Primary data saved (53474 records). [2025-10-27T18:02:44.472534] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-27T18:02:44.473147] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNP took 28.8s. Estimated remaining: 3h 54m 34s. Rate: 8.0 symbols/min [2025-10-27T18:02:44.641531] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:44.688986] [DEBUG] [LOCAL ] CNX: Loaded 52059 existing records from primary storage. [2025-10-27T18:02:44.689285] [INFO ] [MAIN ] CNX: Loaded 52059 existing records. [2025-10-27T18:02:44.863971] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:44.864170] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-27T18:02:44.864218] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-27T18:02:44.864454] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-27T18:02:44.864493] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-27T18:02:45.241302] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-27T18:02:45.246192] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:45.376241] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T18:02:46.014941] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-27T18:02:46.164170] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T18:02:46.452886] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:02:46.814950] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-27T18:02:47.289098] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:02:47.614928] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-27T18:02:47.758176] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:02:48.414925] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-27T18:02:49.177039] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T18:02:49.214935] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-27T18:02:50.014958] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-27T18:02:50.455790] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:02:50.618762] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T18:02:50.814993] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-27T18:02:51.226010] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T18:02:51.614949] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-27T18:02:52.414978] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-27T18:02:52.590012] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:02:53.128465] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:02:53.214910] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-27T18:02:53.328505] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T18:02:54.014969] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-27T18:02:54.814982] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-27T18:02:54.896634] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:02:55.615007] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-27T18:02:55.764443] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:02:56.313608] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:02:56.371398] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T18:02:56.414908] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-27T18:02:57.214952] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-27T18:02:58.014964] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-27T18:02:58.097101] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:02:58.108205] [INFO ] [REMOTE ] CNQ: Full fetch complete (77352 records). [2025-10-27T18:02:58.108371] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-27T18:02:58.109319] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:02:58.109416] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:02:58.109467] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:02:58.109530] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-27T18:02:58.109596] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-27T18:02:58.109632] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-10-27T18:02:58.109897] [DEBUG] [LOCAL ] CNQ: Deleted derivative data file. [2025-10-27T18:02:58.110383] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNQ took 40.6s. Estimated remaining: 3h 54m 49s. Rate: 7.9 symbols/min [2025-10-27T18:02:58.282138] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:02:58.322375] [DEBUG] [LOCAL ] CODI: Loaded 42561 existing records from primary storage. [2025-10-27T18:02:58.322688] [INFO ] [MAIN ] CODI: Loaded 42561 existing records. [2025-10-27T18:02:58.511246] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:02:58.511695] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-27T18:02:58.511823] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-27T18:02:58.512160] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-27T18:02:58.512248] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-27T18:02:58.815582] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-27T18:02:58.840270] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:02:58.927550] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:02:59.250564] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:02:59.582941] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T18:02:59.614898] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-27T18:03:00.414930] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-27T18:03:01.215046] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-27T18:03:01.996747] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-27T18:03:02.003770] [INFO ] [REMOTE ] CNS: Full fetch complete (31666 records). [2025-10-27T18:03:02.003976] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-27T18:03:02.039090] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-27T18:03:02.397235] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-27T18:03:02.397329] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-27T18:03:02.397972] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-27T18:03:02.398036] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-27T18:03:02.398966] [DEBUG] [LOCAL ] CNS: Trimmed 31666 records to 21224 (keeping 200 days of data) [2025-10-27T18:03:02.529159] [DEBUG] [LOCAL ] CNS: Primary data saved (21224 records). [2025-10-27T18:03:02.529281] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-27T18:03:02.529356] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNS took 24.5s. Estimated remaining: 3h 54m 30s. Rate: 8.0 symbols/min [2025-10-27T18:03:02.699468] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:02.750162] [DEBUG] [LOCAL ] COF: Loaded 54405 existing records from primary storage. [2025-10-27T18:03:02.750466] [INFO ] [MAIN ] COF: Loaded 54405 existing records. [2025-10-27T18:03:02.926281] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:02.926502] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-27T18:03:02.926549] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-27T18:03:02.926777] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-27T18:03:02.926835] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-27T18:03:03.275286] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:03.275588] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-27T18:03:06.098701] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (5.68 seconds). [2025-10-27T18:03:06.110129] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-27T18:03:06.139325] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (4.10 seconds). [2025-10-27T18:03:06.148519] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-27T18:03:06.652986] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (3.38 seconds). [2025-10-27T18:03:06.663413] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-27T18:03:07.382824] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T18:03:07.394802] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-27T18:03:07.830356] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:03:07.840993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-27T18:03:08.355875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:03:08.365774] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-27T18:03:09.070120] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:03:09.078446] [INFO ] [REMOTE ] CNR: Full fetch complete (63485 records). [2025-10-27T18:03:09.078550] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-27T18:03:09.079255] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:03:09.079339] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:03:09.079380] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:03:09.079417] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-27T18:03:09.079471] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-27T18:03:09.079505] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-27T18:03:09.079542] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-27T18:03:09.079594] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNR took 42.8s. Estimated remaining: 3h 54m 18s. Rate: 8.0 symbols/min [2025-10-27T18:03:09.260361] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:09.278004] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (8.06 seconds). [2025-10-27T18:03:09.283558] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-27T18:03:09.338877] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:03:09.366257] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-27T18:03:09.369423] [DEBUG] [LOCAL ] COHR: Loaded 54156 existing records from primary storage. [2025-10-27T18:03:09.369912] [INFO ] [MAIN ] COHR: Loaded 54156 existing records. [2025-10-27T18:03:09.555686] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:09.555887] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-27T18:03:09.555935] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-27T18:03:09.556123] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-27T18:03:09.556163] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-27T18:03:09.918048] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:09.982126] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:03:10.014928] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-27T18:03:10.194160] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:03:10.824192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-27T18:03:10.828447] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:03:11.201395] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T18:03:11.211092] [INFO ] [REMOTE ] CNX: Full fetch complete (74887 records). [2025-10-27T18:03:11.211208] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-27T18:03:11.602479] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-27T18:03:11.602574] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-27T18:03:11.603560] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-27T18:03:11.603623] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-27T18:03:11.605210] [DEBUG] [LOCAL ] CNX: Trimmed 74887 records to 51282 (keeping 200 days of data) [2025-10-27T18:03:11.652127] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-27T18:03:11.896123] [DEBUG] [LOCAL ] CNX: Primary data saved (51282 records). [2025-10-27T18:03:11.896253] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-27T18:03:11.896926] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CNX took 27.4s. Estimated remaining: 3h 53m 53s. Rate: 8.0 symbols/min [2025-10-27T18:03:12.065434] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:12.117725] [DEBUG] [LOCAL ] COLD: Loaded 53264 existing records from primary storage. [2025-10-27T18:03:12.118054] [INFO ] [MAIN ] COLD: Loaded 53264 existing records. [2025-10-27T18:03:12.296095] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:12.296314] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-27T18:03:12.296360] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-27T18:03:12.296543] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-27T18:03:12.296582] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-27T18:03:12.420048] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-27T18:03:12.665911] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:12.756051] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T18:03:13.149039] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:03:13.214965] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-27T18:03:14.014967] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-27T18:03:14.360510] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:03:14.582926] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T18:03:14.814925] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-27T18:03:15.627165] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-27T18:03:15.629929] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:03:16.414980] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-27T18:03:17.221666] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-27T18:03:17.224196] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-27T18:03:17.434727] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:03:18.014916] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-27T18:03:18.152045] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T18:03:18.530099] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:03:18.814963] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-27T18:03:19.442967] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:03:19.614954] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-27T18:03:20.414966] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-27T18:03:20.765684] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:03:21.214918] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-27T18:03:21.274271] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:03:22.014940] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-27T18:03:22.113062] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:03:22.814959] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-27T18:03:23.061486] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:03:23.614907] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-27T18:03:23.879314] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:03:24.236359] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T18:03:24.415002] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-27T18:03:25.214985] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-27T18:03:25.685956] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T18:03:25.845978] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:03:26.014929] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-27T18:03:26.421310] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:03:26.814926] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-27T18:03:27.143844] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:03:27.154076] [INFO ] [REMOTE ] COF: Full fetch complete (77718 records). [2025-10-27T18:03:27.154263] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-27T18:03:27.551920] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-27T18:03:27.552050] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-27T18:03:27.553022] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-27T18:03:27.553096] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-27T18:03:27.554689] [DEBUG] [LOCAL ] COF: Trimmed 77718 records to 53625 (keeping 200 days of data) [2025-10-27T18:03:27.621753] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-27T18:03:27.888980] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-27T18:03:27.889118] [INFO ] [MAIN ] COF: Full history saved. [2025-10-27T18:03:27.889867] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COF took 25.4s. Estimated remaining: 3h 54m 17s. Rate: 7.9 symbols/min [2025-10-27T18:03:28.068063] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:28.121891] [DEBUG] [LOCAL ] COMP: Loaded 54183 existing records from primary storage. [2025-10-27T18:03:28.122224] [INFO ] [MAIN ] COMP: Loaded 54183 existing records. [2025-10-27T18:03:28.307497] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:28.307965] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-27T18:03:28.308104] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-27T18:03:28.308418] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-27T18:03:28.308479] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-27T18:03:28.439312] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-27T18:03:28.436090] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:03:28.699751] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:29.084409] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:03:29.214916] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-27T18:03:30.014915] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-27T18:03:30.227033] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T18:03:30.450812] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T18:03:30.814977] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-27T18:03:31.260348] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:03:31.615036] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-27T18:03:32.348830] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:03:32.357711] [INFO ] [REMOTE ] CODI: Full fetch complete (54332 records). [2025-10-27T18:03:32.357842] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-27T18:03:32.420219] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-27T18:03:32.748591] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-27T18:03:32.748710] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-27T18:03:32.749361] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-27T18:03:32.749403] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-27T18:03:32.750564] [DEBUG] [LOCAL ] CODI: Trimmed 54332 records to 41978 (keeping 200 days of data) [2025-10-27T18:03:33.017723] [DEBUG] [LOCAL ] CODI: Primary data saved (41978 records). [2025-10-27T18:03:33.018283] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-27T18:03:33.019543] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. CODI took 34.9s. Estimated remaining: 3h 54m 1s. Rate: 8.0 symbols/min [2025-10-27T18:03:33.019358] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:03:33.205154] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:33.215015] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-27T18:03:33.244562] [DEBUG] [LOCAL ] CON: Loaded 39266 existing records from primary storage. [2025-10-27T18:03:33.244871] [INFO ] [MAIN ] CON: Loaded 39266 existing records. [2025-10-27T18:03:33.433543] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:33.433761] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-27T18:03:33.433809] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-27T18:03:33.434051] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-27T18:03:33.434115] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-27T18:03:33.798326] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:34.014946] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-27T18:03:34.133057] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:03:34.815011] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-27T18:03:34.877573] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:03:35.311814] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:03:35.615027] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-27T18:03:36.414962] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-27T18:03:36.735530] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:03:36.824303] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:03:37.214935] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-27T18:03:37.819155] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:03:38.014985] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-27T18:03:38.764397] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T18:03:38.814933] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-27T18:03:39.167771] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:03:39.614946] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-27T18:03:40.414999] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-27T18:03:41.103009] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:03:41.214966] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-27T18:03:41.272998] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-27T18:03:41.283379] [INFO ] [REMOTE ] COHR: Full fetch complete (77475 records). [2025-10-27T18:03:41.283546] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-27T18:03:41.671987] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-27T18:03:41.672069] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-27T18:03:41.672939] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-27T18:03:41.673001] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-27T18:03:41.674354] [DEBUG] [LOCAL ] COHR: Trimmed 77475 records to 53376 (keeping 200 days of data) [2025-10-27T18:03:41.986946] [DEBUG] [LOCAL ] COHR: Primary data saved (53376 records). [2025-10-27T18:03:41.987140] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-27T18:03:41.987278] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COHR took 32.9s. Estimated remaining: 3h 53m 58s. Rate: 7.9 symbols/min [2025-10-27T18:03:42.029714] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-27T18:03:42.193727] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T18:03:42.191954] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:42.226617] [DEBUG] [LOCAL ] COOK: Loaded 25105 existing records from primary storage. [2025-10-27T18:03:42.226892] [INFO ] [MAIN ] COOK: Loaded 25105 existing records. [2025-10-27T18:03:42.400299] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:42.400487] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-27T18:03:42.400532] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-27T18:03:42.400744] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-27T18:03:42.400799] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-27T18:03:42.777931] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:42.800558] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:03:42.814903] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-27T18:03:43.614961] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-27T18:03:44.149436] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T18:03:44.415037] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-27T18:03:44.561839] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T18:03:45.215026] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-27T18:03:45.804792] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T18:03:45.815097] [INFO ] [REMOTE ] COLD: Full fetch complete (75002 records). [2025-10-27T18:03:45.815219] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-27T18:03:46.020203] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-27T18:03:46.161307] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:03:46.236035] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-27T18:03:46.236166] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-27T18:03:46.237011] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-27T18:03:46.237104] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-27T18:03:46.238794] [DEBUG] [LOCAL ] COLD: Trimmed 75002 records to 52495 (keeping 200 days of data) [2025-10-27T18:03:46.473550] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:03:46.592390] [DEBUG] [LOCAL ] COLD: Primary data saved (52495 records). [2025-10-27T18:03:46.592530] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-27T18:03:46.593246] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. COLD took 34.7s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-27T18:03:46.769306] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:46.818137] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-27T18:03:46.820264] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-27T18:03:46.820749] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-10-27T18:03:47.007886] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:47.008091] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-27T18:03:47.008142] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-27T18:03:47.008446] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-27T18:03:47.008507] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-27T18:03:47.374623] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:47.614936] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-27T18:03:47.902535] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T18:03:48.087785] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:03:48.414936] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-27T18:03:49.214942] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-27T18:03:49.501740] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T18:03:49.721009] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:03:50.014991] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-27T18:03:50.814906] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-27T18:03:50.914215] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:03:51.339313] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:03:51.614914] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-27T18:03:51.823922] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:03:52.414913] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-27T18:03:52.866949] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:03:53.214945] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-27T18:03:54.014940] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-27T18:03:54.132150] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:03:54.242212] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:03:54.814998] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-27T18:03:55.556241] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:03:55.614947] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-27T18:03:55.926847] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:03:56.414933] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-27T18:03:57.214981] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-27T18:03:57.254181] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T18:03:57.261534] [INFO ] [REMOTE ] CON: Full fetch complete (56596 records). [2025-10-27T18:03:57.261667] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-27T18:03:57.633041] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-27T18:03:57.633127] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-27T18:03:57.633924] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-27T18:03:57.633989] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-27T18:03:57.635197] [DEBUG] [LOCAL ] CON: Trimmed 56596 records to 38586 (keeping 200 days of data) [2025-10-27T18:03:57.862350] [DEBUG] [LOCAL ] CON: Primary data saved (38586 records). [2025-10-27T18:03:57.862522] [INFO ] [MAIN ] CON: Full history saved. [2025-10-27T18:03:57.862631] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. CON took 24.8s. Estimated remaining: 3h 53m 46s. Rate: 7.9 symbols/min [2025-10-27T18:03:58.019865] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-27T18:03:58.050839] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:03:58.068560] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:03:58.122033] [DEBUG] [LOCAL ] COR: Loaded 46834 existing records from primary storage. [2025-10-27T18:03:58.122364] [INFO ] [MAIN ] COR: Loaded 46834 existing records. [2025-10-27T18:03:58.299299] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:03:58.299498] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-27T18:03:58.299544] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-27T18:03:58.299873] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-27T18:03:58.299929] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-27T18:03:58.630470] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T18:03:58.674947] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:03:58.814910] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-27T18:03:59.614941] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-27T18:04:00.113277] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T18:04:00.258213] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:04:00.414916] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-27T18:04:01.215024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-27T18:04:02.015147] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-27T18:04:02.095514] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T18:04:02.814980] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-27T18:04:05.493029] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-27T18:04:05.499272] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-27T18:04:05.647210] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (5.23 seconds). [2025-10-27T18:04:05.659530] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-27T18:04:06.168930] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (4.15 seconds). [2025-10-27T18:04:06.180221] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-27T18:04:06.314701] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (5.10 seconds). [2025-10-27T18:04:06.323986] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-27T18:04:07.694564] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-27T18:04:07.706115] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-27T18:04:07.926164] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T18:04:07.938563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-27T18:04:07.966790] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:04:08.414969] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-27T18:04:08.567417] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-27T18:04:08.705533] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:04:09.214953] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-27T18:04:09.948391] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:04:10.014953] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-27T18:04:10.116819] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-27T18:04:10.814949] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-27T18:04:10.945750] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:04:10.956334] [INFO ] [REMOTE ] COMP: Full fetch complete (77413 records). [2025-10-27T18:04:10.956475] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-27T18:04:11.344055] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-27T18:04:11.344134] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-27T18:04:11.344966] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-27T18:04:11.345029] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-27T18:04:11.346512] [DEBUG] [LOCAL ] COMP: Trimmed 77413 records to 53399 (keeping 200 days of data) [2025-10-27T18:04:11.626032] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-27T18:04:11.649234] [DEBUG] [LOCAL ] COMP: Primary data saved (53399 records). [2025-10-27T18:04:11.650727] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-27T18:04:11.650833] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COMP took 43.8s. Estimated remaining: 3h 54m 1s. Rate: 7.9 symbols/min [2025-10-27T18:04:11.825452] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:11.902459] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:04:11.904746] [DEBUG] [LOCAL ] COTY: Loaded 54031 existing records from primary storage. [2025-10-27T18:04:11.915162] [INFO ] [MAIN ] COTY: Loaded 54031 existing records. [2025-10-27T18:04:12.093853] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:12.094056] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-27T18:04:12.094104] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-27T18:04:12.094304] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-27T18:04:12.094358] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-27T18:04:12.423165] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-27T18:04:12.446872] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:12.769058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:04:12.773840] [INFO ] [REMOTE ] COOK: Full fetch complete (32999 records). [2025-10-27T18:04:12.773919] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-27T18:04:12.774398] [FATAL] [VALIDATOR ] COOK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:12.774479] [FATAL] [MAIN ] COOK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:12.774521] [WARN ] [MAIN ] COOK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:12.774558] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-27T18:04:12.774612] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-27T18:04:12.774668] [INFO ] [LOCAL ] COOK: Starting deletion of derivative data. [2025-10-27T18:04:12.774816] [DEBUG] [LOCAL ] COOK: Deleted derivative data file. [2025-10-27T18:04:12.774882] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COOK took 30.8s. Estimated remaining: 3h 53m 30s. Rate: 7.9 symbols/min [2025-10-27T18:04:12.944096] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:12.976125] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:04:13.025308] [DEBUG] [LOCAL ] COUR: Loaded 50179 existing records from primary storage. [2025-10-27T18:04:13.025622] [INFO ] [MAIN ] COUR: Loaded 50179 existing records. [2025-10-27T18:04:13.201103] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:13.201299] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-27T18:04:13.201345] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-27T18:04:13.201520] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-27T18:04:13.201560] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-27T18:04:13.221541] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-27T18:04:13.553044] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:14.014971] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-27T18:04:14.163106] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:04:14.814974] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-27T18:04:15.296554] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T18:04:15.615167] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-27T18:04:15.618045] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T18:04:16.332304] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:04:16.414952] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-27T18:04:17.214919] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-27T18:04:17.406450] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T18:04:17.776810] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:04:17.789842] [INFO ] [REMOTE ] COP: Full fetch complete (77516 records). [2025-10-27T18:04:17.790013] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-27T18:04:17.790940] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:17.791057] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:17.791150] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:17.791241] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-27T18:04:17.791325] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-27T18:04:17.791362] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-27T18:04:17.791478] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-10-27T18:04:17.791972] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 31.2s. Estimated remaining: 3h 53m 14s. Rate: 8.0 symbols/min [2025-10-27T18:04:17.983984] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:18.014951] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-27T18:04:18.037373] [DEBUG] [LOCAL ] CP: Loaded 53992 existing records from primary storage. [2025-10-27T18:04:18.037769] [INFO ] [MAIN ] CP: Loaded 53992 existing records. [2025-10-27T18:04:18.221203] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:18.221587] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-27T18:04:18.221710] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-27T18:04:18.222046] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-27T18:04:18.222104] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-27T18:04:18.487937] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-27T18:04:18.642724] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:18.814918] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-27T18:04:19.257842] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T18:04:19.614993] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-27T18:04:20.307556] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:04:20.414928] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-27T18:04:21.188451] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:04:21.214902] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-27T18:04:21.840351] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:04:22.014938] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-27T18:04:22.675768] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:04:22.814963] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-27T18:04:23.614978] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-27T18:04:23.672857] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:04:24.196887] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:04:24.414931] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-27T18:04:25.214926] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-27T18:04:25.278712] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:04:26.015027] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-27T18:04:26.821322] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-27T18:04:26.827748] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:04:27.447485] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-10-27T18:04:27.533006] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:04:27.615009] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-27T18:04:28.267823] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:04:28.414951] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-27T18:04:29.215000] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-27T18:04:29.441331] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:04:29.512413] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:04:30.015010] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-27T18:04:30.815003] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-27T18:04:31.191325] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:04:31.613030] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:04:31.616955] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-27T18:04:32.085229] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:04:32.093995] [INFO ] [REMOTE ] COR: Full fetch complete (68235 records). [2025-10-27T18:04:32.094187] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-27T18:04:32.420192] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-27T18:04:32.503636] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-27T18:04:32.503797] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-27T18:04:32.504891] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-27T18:04:32.504965] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-27T18:04:32.507080] [DEBUG] [LOCAL ] COR: Trimmed 68235 records to 45968 (keeping 200 days of data) [2025-10-27T18:04:32.846472] [DEBUG] [LOCAL ] COR: Primary data saved (45968 records). [2025-10-27T18:04:32.846931] [INFO ] [MAIN ] COR: Full history saved. [2025-10-27T18:04:32.847843] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. COR took 35.0s. Estimated remaining: 3h 53m 33s. Rate: 7.9 symbols/min [2025-10-27T18:04:33.007358] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:04:33.090240] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:33.121855] [DEBUG] [LOCAL ] CPA: Loaded 28029 existing records from primary storage. [2025-10-27T18:04:33.122212] [INFO ] [MAIN ] CPA: Loaded 28029 existing records. [2025-10-27T18:04:33.224046] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-27T18:04:33.311869] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:33.312210] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-27T18:04:33.312263] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-27T18:04:33.312705] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-27T18:04:33.312766] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-27T18:04:33.690131] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:34.014921] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-27T18:04:34.267193] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:04:34.671419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:04:34.814939] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-27T18:04:35.614933] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-27T18:04:35.843471] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:04:36.204771] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:04:36.414983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-27T18:04:37.214915] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-27T18:04:37.543566] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T18:04:37.971761] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:04:38.014908] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-27T18:04:38.682849] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:04:38.814928] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-27T18:04:39.553707] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T18:04:39.563289] [INFO ] [REMOTE ] CP: Full fetch complete (76900 records). [2025-10-27T18:04:39.563404] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-27T18:04:39.564190] [FATAL] [VALIDATOR ] CP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:04:39.564279] [FATAL] [MAIN ] CP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:04:39.564320] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:04:39.564383] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-27T18:04:39.564446] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-27T18:04:39.564480] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-27T18:04:39.564633] [DEBUG] [LOCAL ] CP: Deleted derivative data file. [2025-10-27T18:04:39.565130] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. CP took 21.8s. Estimated remaining: 3h 53m 23s. Rate: 7.9 symbols/min [2025-10-27T18:04:39.627013] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-27T18:04:39.733104] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:39.733260] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-27T18:04:39.733296] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-27T18:04:39.733402] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-27T18:04:39.733441] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-27T18:04:39.733480] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-27T18:04:39.733511] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-27T18:04:40.079508] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:40.414970] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-27T18:04:40.828989] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-27T18:04:40.839601] [INFO ] [REMOTE ] COUR: Full fetch complete (71310 records). [2025-10-27T18:04:40.839806] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-27T18:04:41.216239] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-27T18:04:41.237892] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-27T18:04:41.237978] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-27T18:04:41.238807] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-27T18:04:41.238972] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-27T18:04:41.240444] [DEBUG] [LOCAL ] COUR: Trimmed 71310 records to 49420 (keeping 200 days of data) [2025-10-27T18:04:41.426939] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:04:41.543349] [DEBUG] [LOCAL ] COUR: Primary data saved (49420 records). [2025-10-27T18:04:41.543491] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-27T18:04:41.543574] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. COUR took 28.8s. Estimated remaining: 3h 52m 55s. Rate: 8.0 symbols/min [2025-10-27T18:04:41.717619] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:41.747763] [DEBUG] [LOCAL ] CPAY: Loaded 30364 existing records from primary storage. [2025-10-27T18:04:41.748313] [INFO ] [MAIN ] CPAY: Loaded 30364 existing records. [2025-10-27T18:04:41.793452] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:04:41.933406] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:41.933989] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-27T18:04:41.934263] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-27T18:04:41.935224] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-27T18:04:41.935283] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-27T18:04:42.020075] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-27T18:04:42.073751] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-27T18:04:42.330586] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:42.470018] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:04:42.814974] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-27T18:04:43.614968] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-27T18:04:43.902296] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:04:44.415003] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-27T18:04:44.776734] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T18:04:45.057633] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:04:45.214913] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-27T18:04:46.014998] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-27T18:04:46.782419] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:04:46.794260] [INFO ] [REMOTE ] COTY: Full fetch complete (77278 records). [2025-10-27T18:04:46.794422] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-27T18:04:46.825255] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-27T18:04:47.194570] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-27T18:04:47.194691] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-27T18:04:47.195603] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-27T18:04:47.195746] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-27T18:04:47.213207] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:04:47.219941] [DEBUG] [LOCAL ] COTY: Trimmed 77278 records to 53247 (keeping 200 days of data) [2025-10-27T18:04:47.506000] [DEBUG] [LOCAL ] COTY: Primary data saved (53247 records). [2025-10-27T18:04:47.506130] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-27T18:04:47.506207] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. COTY took 35.9s. Estimated remaining: 3h 52m 42s. Rate: 8.0 symbols/min [2025-10-27T18:04:47.620109] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-27T18:04:47.685507] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:04:47.700256] [DEBUG] [LOCAL ] CPF: Loaded 15344 existing records from primary storage. [2025-10-27T18:04:47.700499] [INFO ] [MAIN ] CPF: Loaded 15344 existing records. [2025-10-27T18:04:47.918961] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:04:47.919519] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-27T18:04:47.919747] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-27T18:04:47.920115] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-27T18:04:47.920181] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-27T18:04:48.094730] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:04:48.292167] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:04:48.414949] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-27T18:04:48.841293] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:04:49.012275] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:04:49.214944] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-27T18:04:50.014988] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-27T18:04:50.379570] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:04:50.814958] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-27T18:04:51.372719] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T18:04:51.390969] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:04:51.614956] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-27T18:04:52.414985] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-27T18:04:52.632982] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T18:04:52.869566] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T18:04:53.214956] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-27T18:04:54.015000] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-27T18:04:54.339847] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:04:54.381719] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:04:54.814992] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-27T18:04:55.417218] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:04:55.614997] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-27T18:04:56.414990] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-27T18:04:56.443114] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:04:57.214937] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-27T18:04:57.559704] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:04:57.560857] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:04:58.014961] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-27T18:04:58.814948] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-27T18:04:59.374079] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:04:59.555124] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:04:59.614937] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-27T18:05:00.414978] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-27T18:05:01.214924] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-27T18:05:01.526975] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T18:05:02.014955] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-27T18:05:02.814991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-27T18:05:02.934667] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T18:05:02.935565] [INFO ] [REMOTE ] CPAC: Full fetch complete (1799 records). [2025-10-27T18:05:02.935633] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-27T18:05:03.134239] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T18:05:03.134430] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:05:03.134498] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:05:03.134569] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-27T18:05:03.134633] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-27T18:05:03.134716] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-27T18:05:03.134806] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-27T18:05:03.134898] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAC took 23.6s. Estimated remaining: 3h 53m 3s. Rate: 7.9 symbols/min [2025-10-27T18:05:03.321602] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:03.338859] [DEBUG] [LOCAL ] CPK: Loaded 14093 existing records from primary storage. [2025-10-27T18:05:03.339100] [INFO ] [MAIN ] CPK: Loaded 14093 existing records. [2025-10-27T18:05:03.518263] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:03.518466] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-27T18:05:03.518511] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-27T18:05:03.518703] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-27T18:05:03.518758] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-27T18:05:03.874137] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:03.874470] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-27T18:05:04.085264] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-27T18:05:04.102929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T18:05:04.414948] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-27T18:05:04.978596] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-27T18:05:05.214953] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-27T18:05:05.558318] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T18:05:05.583673] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:05:06.014986] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-27T18:05:06.606611] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:05:06.814963] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-27T18:05:07.493707] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:05:07.507239] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T18:05:07.614936] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-27T18:05:08.414950] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-27T18:05:08.665879] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T18:05:09.214909] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-27T18:05:09.283563] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:05:10.014910] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-27T18:05:10.178446] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:05:10.785606] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T18:05:10.814898] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-27T18:05:11.614915] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-27T18:05:11.758952] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T18:05:12.414905] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-27T18:05:12.507726] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:05:13.214930] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-27T18:05:13.426329] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T18:05:13.431111] [INFO ] [REMOTE ] CPA: Full fetch complete (40990 records). [2025-10-27T18:05:13.431207] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-27T18:05:13.820758] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-27T18:05:13.820834] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-27T18:05:13.821362] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-27T18:05:13.821401] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-27T18:05:13.822339] [DEBUG] [LOCAL ] CPA: Trimmed 40990 records to 27383 (keeping 200 days of data) [2025-10-27T18:05:13.990099] [DEBUG] [LOCAL ] CPA: Primary data saved (27383 records). [2025-10-27T18:05:13.990284] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-27T18:05:13.990373] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPA took 41.1s. Estimated remaining: 3h 53m 7s. Rate: 7.9 symbols/min [2025-10-27T18:05:14.014998] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-27T18:05:14.122251] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:05:14.723637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:05:14.814990] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-27T18:05:15.476089] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:05:15.614956] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-27T18:05:16.139251] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:05:16.415013] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-27T18:05:17.214954] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-27T18:05:17.783981] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T18:05:17.822128] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:05:18.014905] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-27T18:05:18.814930] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-27T18:05:19.035377] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T18:05:19.614899] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-27T18:05:19.897511] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:05:19.900939] [INFO ] [REMOTE ] CPF: Full fetch complete (23129 records). [2025-10-27T18:05:19.901011] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-27T18:05:20.256588] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-27T18:05:20.256712] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-27T18:05:20.257119] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-27T18:05:20.257177] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-27T18:05:20.257758] [DEBUG] [LOCAL ] CPF: Trimmed 23129 records to 14882 (keeping 200 days of data) [2025-10-27T18:05:20.343286] [DEBUG] [LOCAL ] CPF: Primary data saved (14882 records). [2025-10-27T18:05:20.343417] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-27T18:05:20.343495] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPF took 32.8s. Estimated remaining: 3h 52m 55s. Rate: 7.9 symbols/min [2025-10-27T18:05:20.414984] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-27T18:05:20.480691] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T18:05:20.484235] [INFO ] [REMOTE ] CPK: Full fetch complete (18867 records). [2025-10-27T18:05:20.484305] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-27T18:05:20.834779] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-27T18:05:20.834851] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-27T18:05:20.835163] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-27T18:05:20.835200] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-27T18:05:20.835729] [DEBUG] [LOCAL ] CPK: Trimmed 18867 records to 13687 (keeping 200 days of data) [2025-10-27T18:05:20.917442] [DEBUG] [LOCAL ] CPK: Primary data saved (13687 records). [2025-10-27T18:05:20.917566] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-27T18:05:20.917639] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPK took 17.8s. Estimated remaining: 3h 52m 23s. Rate: 7.9 symbols/min [2025-10-27T18:05:21.835675] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:05:21.842489] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-27T18:05:23.178235] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:05:23.183599] [INFO ] [REMOTE ] CPAY: Full fetch complete (44488 records). [2025-10-27T18:05:23.183718] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-27T18:05:23.566778] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-27T18:05:23.566851] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-27T18:05:23.567438] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-27T18:05:23.567499] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-27T18:05:23.568370] [DEBUG] [LOCAL ] CPAY: Trimmed 44488 records to 29565 (keeping 200 days of data) [2025-10-27T18:05:23.738145] [DEBUG] [LOCAL ] CPAY: Primary data saved (29565 records). [2025-10-27T18:05:23.738269] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-27T18:05:23.738344] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPAY took 42.2s. Estimated remaining: 3h 51m 59s. Rate: 8.0 symbols/min [2025-10-27T18:05:24.310592] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.439185] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.436355] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.440618] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:24.467168] [DEBUG] [LOCAL ] CPS: Loaded 25186 existing records from primary storage. [2025-10-27T18:05:24.467587] [INFO ] [MAIN ] CPS: Loaded 25186 existing records. [2025-10-27T18:05:24.630141] [DEBUG] [LOCAL ] CPRI: Loaded 53146 existing records from primary storage. [2025-10-27T18:05:24.682194] [INFO ] [MAIN ] CPRI: Loaded 53146 existing records. [2025-10-27T18:05:24.706061] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:24.718249] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-27T18:05:24.738610] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-27T18:05:24.780635] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-27T18:05:24.787031] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-27T18:05:24.862760] [DEBUG] [LOCAL ] CPNG: Loaded 54459 existing records from primary storage. [2025-10-27T18:05:24.899457] [INFO ] [MAIN ] CPNG: Loaded 54459 existing records. [2025-10-27T18:05:24.894163] [DEBUG] [LOCAL ] CPT: Loaded 45157 existing records from primary storage. [2025-10-27T18:05:24.968266] [INFO ] [MAIN ] CPT: Loaded 45157 existing records. [2025-10-27T18:05:25.293129] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.397838] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.428038] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.428168] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-27T18:05:25.445496] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.459535] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-27T18:05:25.459619] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-27T18:05:25.480434] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-27T18:05:25.501125] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-27T18:05:25.522494] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-27T18:05:25.693034] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:25.771755] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-27T18:05:25.803772] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-27T18:05:25.841924] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-27T18:05:25.899468] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-27T18:05:26.097869] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.158808] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-27T18:05:26.722250] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.727897] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-27T18:05:26.794219] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.852009] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:26.852511] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-27T18:05:26.846836] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-27T18:05:27.578308] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:05:27.583365] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-27T18:05:28.119622] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:05:28.128253] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-27T18:05:28.418410] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:05:28.429404] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-27T18:05:28.445370] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:05:28.451157] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-27T18:05:28.590374] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:05:28.600507] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-27T18:05:29.301397] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:05:29.307557] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-27T18:05:29.824087] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:05:30.014964] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-27T18:05:30.140818] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:05:30.206252] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T18:05:30.677549] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T18:05:30.814914] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-27T18:05:31.614922] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-27T18:05:31.657731] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:05:32.206954] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:05:32.414949] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-27T18:05:32.708161] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:05:33.214946] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-27T18:05:34.014920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-27T18:05:34.339110] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T18:05:34.377920] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:05:34.814954] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-27T18:05:35.536172] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:05:35.559681] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T18:05:35.614920] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-27T18:05:36.414946] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-27T18:05:37.150462] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T18:05:37.214903] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-27T18:05:37.270336] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T18:05:38.015245] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-27T18:05:38.020042] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:05:38.814994] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-27T18:05:39.621462] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-27T18:05:39.626219] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:05:40.319789] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:05:40.414912] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-27T18:05:41.214994] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-27T18:05:41.706932] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T18:05:41.711184] [INFO ] [REMOTE ] CPS: Full fetch complete (36476 records). [2025-10-27T18:05:41.711264] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-27T18:05:42.029494] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-27T18:05:42.138742] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-27T18:05:42.138873] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-27T18:05:42.149583] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-27T18:05:42.151305] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-27T18:05:42.151859] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-27T18:05:42.153512] [DEBUG] [LOCAL ] CPS: Trimmed 36476 records to 24342 (keeping 200 days of data) [2025-10-27T18:05:42.320923] [DEBUG] [LOCAL ] CPS: Primary data saved (24342 records). [2025-10-27T18:05:42.321070] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-27T18:05:42.321154] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CPS took 18.6s. Estimated remaining: 3h 52m 30s. Rate: 7.9 symbols/min [2025-10-27T18:05:42.497840] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:42.516428] [DEBUG] [LOCAL ] CQP: Loaded 18984 existing records from primary storage. [2025-10-27T18:05:42.516706] [INFO ] [MAIN ] CQP: Loaded 18984 existing records. [2025-10-27T18:05:42.705329] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:05:42.738956] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:42.739719] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-27T18:05:42.739798] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-27T18:05:42.740184] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-27T18:05:42.740252] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-27T18:05:42.820030] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-27T18:05:43.106482] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:43.615023] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-27T18:05:43.657540] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:05:44.414972] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-27T18:05:44.705333] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:05:45.040592] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:05:45.214957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-27T18:05:45.764925] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T18:05:46.014926] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-27T18:05:46.814992] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-27T18:05:47.367344] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:05:47.469775] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:05:47.614907] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-27T18:05:48.180523] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:05:48.414946] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-27T18:05:49.084386] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:05:49.214988] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-27T18:05:49.483674] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T18:05:50.015019] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-27T18:05:50.815553] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-27T18:05:51.022605] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:05:51.031007] [INFO ] [REMOTE ] CPT: Full fetch complete (64737 records). [2025-10-27T18:05:51.031113] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-27T18:05:51.413541] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-27T18:05:51.413629] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-27T18:05:51.414429] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-27T18:05:51.414484] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-27T18:05:51.415806] [DEBUG] [LOCAL ] CPT: Trimmed 64737 records to 44324 (keeping 200 days of data) [2025-10-27T18:05:51.623417] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-27T18:05:51.684757] [DEBUG] [LOCAL ] CPT: Primary data saved (44324 records). [2025-10-27T18:05:51.684886] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-27T18:05:51.684966] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPT took 27.9s. Estimated remaining: 3h 52m 29s. Rate: 7.9 symbols/min [2025-10-27T18:05:51.856429] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:51.878463] [DEBUG] [LOCAL ] CR: Loaded 24331 existing records from primary storage. [2025-10-27T18:05:51.878729] [INFO ] [MAIN ] CR: Loaded 24331 existing records. [2025-10-27T18:05:52.057267] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:52.057584] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-27T18:05:52.057687] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-27T18:05:52.057896] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-27T18:05:52.057940] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-27T18:05:52.451325] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:52.451714] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-27T18:05:52.455102] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-27T18:05:52.545614] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:05:52.914451] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T18:05:53.215010] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-27T18:05:53.342677] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T18:05:54.014961] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-27T18:05:54.640426] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T18:05:54.650933] [INFO ] [REMOTE ] CPRI: Full fetch complete (76197 records). [2025-10-27T18:05:54.651056] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-27T18:05:54.815164] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-27T18:05:54.998950] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T18:05:55.096535] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-27T18:05:55.096616] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-27T18:05:55.097502] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-27T18:05:55.097565] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-27T18:05:55.098978] [DEBUG] [LOCAL ] CPRI: Trimmed 76197 records to 52365 (keeping 200 days of data) [2025-10-27T18:05:55.391828] [DEBUG] [LOCAL ] CPRI: Primary data saved (52365 records). [2025-10-27T18:05:55.391953] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-27T18:05:55.392028] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPRI took 31.7s. Estimated remaining: 3h 52m 8s. Rate: 7.9 symbols/min [2025-10-27T18:05:55.556632] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:05:55.567239] [DEBUG] [LOCAL ] CRBD: Loaded 8822 existing records from primary storage. [2025-10-27T18:05:55.567439] [INFO ] [MAIN ] CRBD: Loaded 8822 existing records. [2025-10-27T18:05:55.627944] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-27T18:05:55.742712] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:05:55.742902] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-27T18:05:55.742947] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-27T18:05:55.743125] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-27T18:05:55.743182] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-27T18:05:56.092226] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:05:56.102897] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:05:56.414990] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-27T18:05:56.622479] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:05:57.214976] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-27T18:05:57.284133] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:05:58.014921] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-27T18:05:58.328371] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:05:58.814999] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-27T18:05:59.614927] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-27T18:05:59.654939] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:06:00.098174] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:06:00.131385] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:06:00.414933] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-27T18:06:01.215005] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-27T18:06:02.014954] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-27T18:06:02.815020] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-27T18:06:05.258401] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (4.84 seconds). [2025-10-27T18:06:05.263928] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-27T18:06:05.917028] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-10-27T18:06:05.919476] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-27T18:06:06.655807] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (5.44 seconds). [2025-10-27T18:06:06.662300] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-27T18:06:07.050775] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:06:07.054185] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-27T18:06:07.590630] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:06:07.593192] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-27T18:06:08.041330] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:06:08.044574] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-27T18:06:08.094177] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (5.28 seconds). [2025-10-27T18:06:08.342916] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:06:08.414957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-27T18:06:08.739180] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-27T18:06:08.848612] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:06:08.851957] [INFO ] [REMOTE ] CQP: Full fetch complete (29388 records). [2025-10-27T18:06:08.852074] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-27T18:06:08.852570] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:06:08.852690] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:06:08.852745] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:06:08.852813] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-27T18:06:08.852876] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-27T18:06:08.852911] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-27T18:06:08.853031] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-27T18:06:08.853096] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CQP took 26.5s. Estimated remaining: 3h 52m 21s. Rate: 7.9 symbols/min [2025-10-27T18:06:09.034574] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:09.082986] [DEBUG] [LOCAL ] CRBG: Loaded 53347 existing records from primary storage. [2025-10-27T18:06:09.083336] [INFO ] [MAIN ] CRBG: Loaded 53347 existing records. [2025-10-27T18:06:09.220118] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-27T18:06:09.258267] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:09.258445] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-27T18:06:09.258509] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-27T18:06:09.258755] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-27T18:06:09.258814] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-27T18:06:09.608022] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:10.014946] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-27T18:06:10.253672] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T18:06:10.570868] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T18:06:10.774062] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T18:06:10.814911] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-27T18:06:11.594854] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:06:11.614903] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-27T18:06:12.153500] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T18:06:12.414940] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-27T18:06:12.875318] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T18:06:13.214937] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-27T18:06:14.015008] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-27T18:06:14.814967] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-27T18:06:15.183155] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T18:06:15.437606] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T18:06:15.447398] [INFO ] [REMOTE ] CPNG: Full fetch complete (77402 records). [2025-10-27T18:06:15.447558] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-27T18:06:15.448442] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:06:15.448543] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:06:15.448585] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:06:15.448622] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-27T18:06:15.448731] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-27T18:06:15.448785] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-10-27T18:06:15.448914] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-10-27T18:06:15.449464] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CPNG took 51.7s. Estimated remaining: 3h 52m 10s. Rate: 7.9 symbols/min [2025-10-27T18:06:15.624477] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:15.620745] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-27T18:06:15.668301] [DEBUG] [LOCAL ] CRC: Loaded 44669 existing records from primary storage. [2025-10-27T18:06:15.668582] [INFO ] [MAIN ] CRC: Loaded 44669 existing records. [2025-10-27T18:06:15.844996] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:15.845193] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-27T18:06:15.845241] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-27T18:06:15.845416] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-27T18:06:15.845456] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-27T18:06:16.226413] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:16.256945] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:06:16.415849] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-27T18:06:16.417753] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T18:06:16.420677] [INFO ] [REMOTE ] CRBD: Full fetch complete (12865 records). [2025-10-27T18:06:16.420767] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-27T18:06:16.772155] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-27T18:06:16.772238] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-27T18:06:16.772566] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-27T18:06:16.772682] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-27T18:06:16.773144] [DEBUG] [LOCAL ] CRBD: Trimmed 12865 records to 8602 (keeping 200 days of data) [2025-10-27T18:06:16.823015] [DEBUG] [LOCAL ] CRBD: Primary data saved (8602 records). [2025-10-27T18:06:16.823128] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-27T18:06:16.823207] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 21.4s. Estimated remaining: 3h 51m 41s. Rate: 7.9 symbols/min [2025-10-27T18:06:16.986623] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:16.986819] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-27T18:06:16.986861] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-27T18:06:16.986965] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-27T18:06:16.987025] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-27T18:06:16.987107] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-27T18:06:16.987146] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-27T18:06:17.221786] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-27T18:06:17.334526] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:17.804953] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:06:18.014915] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-27T18:06:18.268993] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:06:18.814942] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-27T18:06:19.614922] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-27T18:06:19.668833] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:06:20.192880] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:06:20.414940] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-27T18:06:21.214939] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-27T18:06:21.531474] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T18:06:22.014995] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-27T18:06:22.223928] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T18:06:22.228805] [INFO ] [REMOTE ] CR: Full fetch complete (34917 records). [2025-10-27T18:06:22.228887] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-27T18:06:22.435249] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T18:06:22.647952] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-27T18:06:22.648037] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-27T18:06:22.648543] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-27T18:06:22.648603] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-27T18:06:22.649339] [DEBUG] [LOCAL ] CR: Trimmed 34917 records to 23894 (keeping 200 days of data) [2025-10-27T18:06:22.790326] [DEBUG] [LOCAL ] CR: Primary data saved (23894 records). [2025-10-27T18:06:22.790455] [INFO ] [MAIN ] CR: Full history saved. [2025-10-27T18:06:22.790531] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CR took 31.1s. Estimated remaining: 3h 51m 28s. Rate: 7.9 symbols/min [2025-10-27T18:06:22.820786] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-27T18:06:22.960685] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:23.004671] [DEBUG] [LOCAL ] CRGY: Loaded 53270 existing records from primary storage. [2025-10-27T18:06:23.004969] [INFO ] [MAIN ] CRGY: Loaded 53270 existing records. [2025-10-27T18:06:23.185719] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:23.186032] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-27T18:06:23.186209] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-27T18:06:23.186720] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-27T18:06:23.186856] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-27T18:06:23.584859] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:23.580690] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:06:23.614895] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-27T18:06:24.336103] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:06:24.414901] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-27T18:06:25.047610] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:06:25.214914] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-27T18:06:25.520568] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:06:25.520993] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-27T18:06:25.521106] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:06:25.521190] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-27T18:06:25.521270] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:06:25.521357] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-27T18:06:25.521440] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-27T18:06:25.521499] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-27T18:06:25.521562] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-27T18:06:25.521630] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRCL took 8.7s. Estimated remaining: 3h 51m 4s. Rate: 8.0 symbols/min [2025-10-27T18:06:25.704335] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:25.758322] [DEBUG] [LOCAL ] CRH: Loaded 54172 existing records from primary storage. [2025-10-27T18:06:25.758684] [INFO ] [MAIN ] CRH: Loaded 54172 existing records. [2025-10-27T18:06:25.944956] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:25.945257] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-27T18:06:25.955832] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-27T18:06:25.973235] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-27T18:06:25.973389] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-27T18:06:26.019377] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-27T18:06:26.051130] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:06:26.345567] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:26.814941] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-27T18:06:27.614933] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-27T18:06:27.821025] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:06:28.391797] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:06:28.414902] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-27T18:06:29.177322] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:06:29.214896] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-27T18:06:29.931104] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T18:06:30.014947] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-27T18:06:30.814910] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-27T18:06:31.160797] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T18:06:31.313900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T18:06:31.615003] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-27T18:06:32.089608] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:06:32.414981] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-27T18:06:33.214918] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-27T18:06:33.508503] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T18:06:34.014911] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-27T18:06:34.487900] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:06:34.530782] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-27T18:06:34.814941] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-27T18:06:35.415473] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T18:06:35.614945] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-27T18:06:36.414931] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-27T18:06:36.535412] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:06:37.214930] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-27T18:06:37.298902] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:06:38.014919] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-27T18:06:38.066933] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:06:38.490259] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:06:38.814941] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-27T18:06:39.628879] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-27T18:06:39.631586] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T18:06:40.105067] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T18:06:40.414922] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-27T18:06:41.214946] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-27T18:06:41.676457] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:06:41.749161] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-27T18:06:42.014954] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-27T18:06:42.814943] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-27T18:06:42.884607] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:06:43.404994] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:06:43.615001] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-27T18:06:44.178556] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T18:06:44.414952] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-27T18:06:45.214930] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-27T18:06:45.569171] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:06:46.014935] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-27T18:06:46.159277] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T18:06:46.639150] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T18:06:46.647525] [INFO ] [REMOTE ] CRC: Full fetch complete (62938 records). [2025-10-27T18:06:46.647676] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-27T18:06:46.820920] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-27T18:06:47.060827] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-27T18:06:47.060923] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-27T18:06:47.061693] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-27T18:06:47.061757] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-27T18:06:47.063170] [DEBUG] [LOCAL ] CRC: Trimmed 62938 records to 43808 (keeping 200 days of data) [2025-10-27T18:06:47.319327] [DEBUG] [LOCAL ] CRC: Primary data saved (43808 records). [2025-10-27T18:06:47.319477] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-27T18:06:47.319586] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRC took 31.9s. Estimated remaining: 3h 51m 45s. Rate: 7.9 symbols/min [2025-10-27T18:06:47.510054] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:47.556311] [DEBUG] [LOCAL ] CRI: Loaded 50239 existing records from primary storage. [2025-10-27T18:06:47.556608] [INFO ] [MAIN ] CRI: Loaded 50239 existing records. [2025-10-27T18:06:47.630819] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-27T18:06:47.763916] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:06:47.767523] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:47.777083] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-27T18:06:47.777352] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-27T18:06:47.777679] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-27T18:06:47.777738] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-27T18:06:47.809501] [INFO ] [REMOTE ] CRBG: Full fetch complete (76048 records). [2025-10-27T18:06:47.841021] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-27T18:06:48.456228] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:48.483310] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-27T18:06:48.568302] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-27T18:06:48.568445] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-27T18:06:48.569534] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-27T18:06:48.569677] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-27T18:06:48.571816] [DEBUG] [LOCAL ] CRBG: Trimmed 76048 records to 52566 (keeping 200 days of data) [2025-10-27T18:06:48.719378] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:06:48.934173] [DEBUG] [LOCAL ] CRBG: Primary data saved (52566 records). [2025-10-27T18:06:48.934302] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-27T18:06:48.935328] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRBG took 40.1s. Estimated remaining: 3h 51m 17s. Rate: 7.9 symbols/min [2025-10-27T18:06:49.099664] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:49.150377] [DEBUG] [LOCAL ] CRK: Loaded 52984 existing records from primary storage. [2025-10-27T18:06:49.150713] [INFO ] [MAIN ] CRK: Loaded 52984 existing records. [2025-10-27T18:06:49.219140] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-27T18:06:49.331691] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:49.331996] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-27T18:06:49.332138] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-27T18:06:49.332520] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-27T18:06:49.332596] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-27T18:06:49.705368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-27T18:06:49.726726] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:49.768303] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:06:50.014974] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-27T18:06:50.814954] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-27T18:06:51.000538] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T18:06:51.010865] [INFO ] [REMOTE ] CRGY: Full fetch complete (76165 records). [2025-10-27T18:06:51.011009] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-27T18:06:51.406833] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-27T18:06:51.406949] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-27T18:06:51.408160] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-27T18:06:51.408244] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-27T18:06:51.409735] [DEBUG] [LOCAL ] CRGY: Trimmed 76165 records to 52486 (keeping 200 days of data) [2025-10-27T18:06:51.641177] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-27T18:06:51.649116] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T18:06:51.771003] [DEBUG] [LOCAL ] CRGY: Primary data saved (52486 records). [2025-10-27T18:06:51.771221] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-27T18:06:51.771333] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRGY took 29.0s. Estimated remaining: 3h 50m 53s. Rate: 7.9 symbols/min [2025-10-27T18:06:51.958633] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:52.004288] [DEBUG] [LOCAL ] CRL: Loaded 43277 existing records from primary storage. [2025-10-27T18:06:52.004741] [INFO ] [MAIN ] CRL: Loaded 43277 existing records. [2025-10-27T18:06:52.200737] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:52.201018] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-27T18:06:52.201071] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-27T18:06:52.201309] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-27T18:06:52.201368] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-27T18:06:52.428309] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-27T18:06:52.592124] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:52.814150] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:06:53.214951] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-27T18:06:53.507629] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T18:06:54.015021] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-27T18:06:54.244337] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T18:06:54.815008] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-27T18:06:55.065238] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:06:55.364587] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:06:55.614936] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-27T18:06:56.414909] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-27T18:06:56.544696] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:06:56.554919] [INFO ] [REMOTE ] CRH: Full fetch complete (77518 records). [2025-10-27T18:06:56.555056] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-27T18:06:56.939631] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-27T18:06:56.939754] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-27T18:06:56.940693] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-27T18:06:56.940757] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-27T18:06:56.942280] [DEBUG] [LOCAL ] CRH: Trimmed 77518 records to 53392 (keeping 200 days of data) [2025-10-27T18:06:57.219948] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-27T18:06:57.266116] [DEBUG] [LOCAL ] CRH: Primary data saved (53392 records). [2025-10-27T18:06:57.266267] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-27T18:06:57.266377] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRH took 31.7s. Estimated remaining: 3h 50m 39s. Rate: 8.0 symbols/min [2025-10-27T18:06:57.440058] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:06:57.488763] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-27T18:06:57.489201] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-10-27T18:06:57.670996] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T18:06:57.700505] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:06:57.711854] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-27T18:06:57.711917] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-27T18:06:57.712202] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-27T18:06:57.712241] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-27T18:06:58.024231] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-27T18:06:58.065884] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:06:58.191777] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T18:06:58.784178] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:06:58.814899] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-27T18:06:59.370990] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:06:59.614941] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-27T18:07:00.056221] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T18:07:00.415012] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-27T18:07:01.214963] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-27T18:07:01.769481] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:07:02.014968] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-27T18:07:02.815004] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-27T18:07:03.074927] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-27T18:07:03.434723] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-27T18:07:03.614930] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-27T18:07:04.414978] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-27T18:07:04.551270] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:07:04.718843] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-27T18:07:05.114557] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:07:05.214922] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-27T18:07:05.668605] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:07:06.014945] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-27T18:07:06.781795] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T18:07:06.814911] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-27T18:07:07.466518] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:07:07.614917] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-27T18:07:08.168485] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:07:08.414994] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-27T18:07:09.214933] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-27T18:07:09.491981] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T18:07:10.014992] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-27T18:07:10.513889] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-27T18:07:10.814922] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-27T18:07:11.170318] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T18:07:11.536038] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:07:11.614923] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-27T18:07:12.414913] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-27T18:07:12.866572] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T18:07:13.214931] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-27T18:07:13.361030] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:07:13.370083] [INFO ] [REMOTE ] CRI: Full fetch complete (71070 records). [2025-10-27T18:07:13.370256] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-27T18:07:13.844369] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-27T18:07:13.844555] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-27T18:07:13.846145] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-27T18:07:13.846380] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-27T18:07:13.879850] [DEBUG] [LOCAL ] CRI: Trimmed 71070 records to 49480 (keeping 200 days of data) [2025-10-27T18:07:13.882971] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:07:14.017730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-27T18:07:14.318606] [DEBUG] [LOCAL ] CRI: Primary data saved (49480 records). [2025-10-27T18:07:14.318810] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-27T18:07:14.319313] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRI took 27.0s. Estimated remaining: 3h 51m 4s. Rate: 7.9 symbols/min [2025-10-27T18:07:14.551747] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:14.599636] [DEBUG] [LOCAL ] CRS: Loaded 43864 existing records from primary storage. [2025-10-27T18:07:14.600467] [INFO ] [MAIN ] CRS: Loaded 43864 existing records. [2025-10-27T18:07:14.772804] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:07:14.829007] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-27T18:07:14.869986] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:14.870171] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-27T18:07:14.870219] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-27T18:07:14.870414] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-27T18:07:14.870455] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-27T18:07:15.223171] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:15.614942] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-27T18:07:16.075716] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T18:07:16.263448] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T18:07:16.414977] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-27T18:07:17.214973] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-27T18:07:17.306566] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:07:17.316474] [INFO ] [REMOTE ] CRK: Full fetch complete (75758 records). [2025-10-27T18:07:17.316586] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-27T18:07:17.704217] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-27T18:07:17.704296] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-27T18:07:17.705110] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-27T18:07:17.705171] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-27T18:07:17.706469] [DEBUG] [LOCAL ] CRK: Trimmed 75758 records to 52167 (keeping 200 days of data) [2025-10-27T18:07:18.010728] [DEBUG] [LOCAL ] CRK: Primary data saved (52167 records). [2025-10-27T18:07:18.010864] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-27T18:07:18.010982] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRK took 29.1s. Estimated remaining: 3h 50m 43s. Rate: 7.9 symbols/min [2025-10-27T18:07:18.022721] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-27T18:07:18.187393] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:18.213584] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T18:07:18.225070] [DEBUG] [LOCAL ] CRT: Loaded 4898 existing records from primary storage. [2025-10-27T18:07:18.225813] [INFO ] [MAIN ] CRT: Loaded 4898 existing records. [2025-10-27T18:07:18.414498] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:18.414768] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-27T18:07:18.414821] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-27T18:07:18.414959] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-27T18:07:18.414996] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-27T18:07:18.769002] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:18.814963] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-27T18:07:19.015312] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:07:19.420525] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:07:19.610979] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:07:19.614891] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-27T18:07:20.415030] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-27T18:07:20.875479] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T18:07:21.214981] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-27T18:07:22.014980] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-27T18:07:22.245187] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-27T18:07:22.440194] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:07:22.815008] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-27T18:07:23.362176] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:07:23.370399] [INFO ] [REMOTE ] CRL: Full fetch complete (63742 records). [2025-10-27T18:07:23.370502] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-27T18:07:23.492355] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:07:23.620131] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-27T18:07:23.783130] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-27T18:07:23.783211] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-27T18:07:23.783954] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-27T18:07:23.784017] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-27T18:07:23.785283] [DEBUG] [LOCAL ] CRL: Trimmed 63742 records to 42476 (keeping 200 days of data) [2025-10-27T18:07:24.026740] [DEBUG] [LOCAL ] CRL: Primary data saved (42476 records). [2025-10-27T18:07:24.026856] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-27T18:07:24.026928] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRL took 32.3s. Estimated remaining: 3h 50m 30s. Rate: 7.9 symbols/min [2025-10-27T18:07:24.195193] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:24.232025] [DEBUG] [LOCAL ] CSAN: Loaded 42874 existing records from primary storage. [2025-10-27T18:07:24.232296] [INFO ] [MAIN ] CSAN: Loaded 42874 existing records. [2025-10-27T18:07:24.404960] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:24.405113] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-27T18:07:24.405159] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-27T18:07:24.405315] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-27T18:07:24.405353] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-27T18:07:24.425547] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-27T18:07:24.753520] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:24.931787] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T18:07:25.214923] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-27T18:07:25.430170] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:07:26.014924] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-27T18:07:26.814963] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-27T18:07:26.851352] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T18:07:27.614917] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-27T18:07:27.661726] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:07:28.414995] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-27T18:07:28.644455] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:07:28.822605] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T18:07:29.214984] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-27T18:07:29.916509] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:07:30.014917] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-27T18:07:30.815011] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-27T18:07:31.252537] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T18:07:31.614970] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-27T18:07:31.813061] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:07:31.848515] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T18:07:32.415019] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-27T18:07:33.214976] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-27T18:07:33.316953] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:07:33.993021] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T18:07:34.014919] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-27T18:07:34.547486] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:07:34.558676] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-27T18:07:34.558934] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-27T18:07:34.697059] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:07:34.820048] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-27T18:07:34.992235] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-27T18:07:34.992312] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-27T18:07:34.993161] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-27T18:07:34.993224] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-27T18:07:34.994630] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-10-27T18:07:35.323598] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:07:35.336399] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-27T18:07:35.336535] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-27T18:07:35.337550] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRM took 38.1s. Estimated remaining: 3h 50m 36s. Rate: 7.9 symbols/min [2025-10-27T18:07:35.507326] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:35.541334] [DEBUG] [LOCAL ] CSL: Loaded 31561 existing records from primary storage. [2025-10-27T18:07:35.541592] [INFO ] [MAIN ] CSL: Loaded 31561 existing records. [2025-10-27T18:07:35.620137] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-27T18:07:35.720178] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:35.720379] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-27T18:07:35.720456] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-27T18:07:35.720824] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-27T18:07:35.720885] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-27T18:07:36.066616] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:36.265584] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T18:07:36.414972] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-27T18:07:37.214938] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-27T18:07:37.884526] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:07:38.014931] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-27T18:07:38.462374] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:07:38.703208] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:07:38.814988] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-27T18:07:39.614951] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-27T18:07:40.156126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:07:40.167558] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T18:07:40.414952] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-27T18:07:41.214955] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-27T18:07:41.717563] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:07:42.014961] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-27T18:07:42.733771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:07:42.766594] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T18:07:42.768326] [INFO ] [REMOTE ] CRT: Full fetch complete (7427 records). [2025-10-27T18:07:42.768397] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-27T18:07:42.824317] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-27T18:07:43.162418] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-27T18:07:43.162493] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-27T18:07:43.162745] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-27T18:07:43.162829] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-27T18:07:43.163261] [DEBUG] [LOCAL ] CRT: Trimmed 7427 records to 4799 (keeping 200 days of data) [2025-10-27T18:07:43.192739] [DEBUG] [LOCAL ] CRT: Primary data saved (4799 records). [2025-10-27T18:07:43.192840] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-27T18:07:43.192932] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CRT took 25.2s. Estimated remaining: 3h 50m 29s. Rate: 7.9 symbols/min [2025-10-27T18:07:43.362340] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:43.377387] [DEBUG] [LOCAL ] CSR: Loaded 13551 existing records from primary storage. [2025-10-27T18:07:43.377618] [INFO ] [MAIN ] CSR: Loaded 13551 existing records. [2025-10-27T18:07:43.570615] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:43.570827] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-27T18:07:43.570873] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-27T18:07:43.571051] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-27T18:07:43.571107] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-27T18:07:43.620273] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-27T18:07:43.943434] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:44.121019] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T18:07:44.129216] [INFO ] [REMOTE ] CRS: Full fetch complete (62830 records). [2025-10-27T18:07:44.129337] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-27T18:07:44.420052] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-27T18:07:44.503292] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-27T18:07:44.503372] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-27T18:07:44.504103] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-27T18:07:44.504164] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-27T18:07:44.505383] [DEBUG] [LOCAL ] CRS: Trimmed 62830 records to 43082 (keeping 200 days of data) [2025-10-27T18:07:44.768969] [DEBUG] [LOCAL ] CRS: Primary data saved (43082 records). [2025-10-27T18:07:44.769164] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-27T18:07:44.769344] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CRS took 30.4s. Estimated remaining: 3h 50m 1s. Rate: 7.9 symbols/min [2025-10-27T18:07:44.928771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:07:44.985428] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:07:45.030575] [DEBUG] [LOCAL ] CSTM: Loaded 48134 existing records from primary storage. [2025-10-27T18:07:45.030907] [INFO ] [MAIN ] CSTM: Loaded 48134 existing records. [2025-10-27T18:07:45.219447] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:07:45.215060] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:07:45.215881] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-27T18:07:45.219816] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-27T18:07:45.219902] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-27T18:07:45.223844] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-27T18:07:45.223905] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-27T18:07:45.568899] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:07:46.014987] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-27T18:07:46.325925] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:07:46.784316] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:07:46.814916] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-27T18:07:47.493688] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:07:47.614936] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-27T18:07:48.414948] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-27T18:07:48.984328] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:07:49.214961] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-27T18:07:49.824083] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:07:50.014987] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-27T18:07:50.231823] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:07:50.815005] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-27T18:07:51.379616] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:07:51.614953] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-27T18:07:52.000752] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:07:52.415008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-27T18:07:52.983721] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:07:53.214947] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-27T18:07:53.693038] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:07:54.014926] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-27T18:07:54.466074] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:07:54.814984] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-27T18:07:55.011567] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:07:55.614966] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-27T18:07:56.185095] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T18:07:56.389565] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:07:56.414902] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-27T18:07:57.214998] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-27T18:07:57.602460] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:07:58.014991] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-27T18:07:58.587547] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:07:58.814952] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-27T18:07:59.402913] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:07:59.614960] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-27T18:07:59.713488] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:08:00.414941] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-27T18:08:01.215071] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-27T18:08:01.406008] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:08:02.015026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-27T18:08:02.678884] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-27T18:08:02.814960] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-27T18:08:03.531126] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T18:08:03.614951] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-27T18:08:03.903107] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:08:03.910866] [INFO ] [REMOTE ] CSAN: Full fetch complete (60322 records). [2025-10-27T18:08:03.910972] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-27T18:08:04.279190] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:08:04.301607] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-27T18:08:04.302059] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-27T18:08:04.302902] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-27T18:08:04.302995] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-27T18:08:04.304166] [DEBUG] [LOCAL ] CSAN: Trimmed 60322 records to 42109 (keeping 200 days of data) [2025-10-27T18:08:04.452545] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-27T18:08:04.531745] [DEBUG] [LOCAL ] CSAN: Primary data saved (42109 records). [2025-10-27T18:08:04.531870] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-27T18:08:04.531950] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSAN took 40.5s. Estimated remaining: 3h 50m 35s. Rate: 7.9 symbols/min [2025-10-27T18:08:04.694110] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:04.707102] [DEBUG] [LOCAL ] CSV: Loaded 12542 existing records from primary storage. [2025-10-27T18:08:04.707313] [INFO ] [MAIN ] CSV: Loaded 12542 existing records. [2025-10-27T18:08:04.885742] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:04.885982] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-27T18:08:04.886084] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-27T18:08:04.886318] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-27T18:08:04.886427] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-27T18:08:05.026871] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T18:08:05.065706] [INFO ] [REMOTE ] CSL: Full fetch complete (45764 records). [2025-10-27T18:08:05.089199] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-27T18:08:05.215470] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-27T18:08:05.423549] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:05.531355] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:08:05.683812] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-27T18:08:05.683905] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-27T18:08:05.684616] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-27T18:08:05.684688] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-27T18:08:05.685847] [DEBUG] [LOCAL ] CSL: Trimmed 45764 records to 30902 (keeping 200 days of data) [2025-10-27T18:08:05.882616] [DEBUG] [LOCAL ] CSL: Primary data saved (30902 records). [2025-10-27T18:08:05.882809] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-27T18:08:05.882902] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSL took 30.5s. Estimated remaining: 3h 50m 6s. Rate: 7.9 symbols/min [2025-10-27T18:08:06.027950] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-27T18:08:06.061840] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:06.062020] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-27T18:08:06.062108] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-27T18:08:06.062192] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-27T18:08:06.062231] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-27T18:08:06.062272] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-27T18:08:06.062304] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-27T18:08:06.433541] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:06.805998] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T18:08:06.814936] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-27T18:08:06.880223] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T18:08:07.501975] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T18:08:07.614952] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-27T18:08:07.823145] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:08:07.823400] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-27T18:08:07.823488] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:08:07.823535] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-27T18:08:07.823569] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:08:07.823632] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-27T18:08:07.823739] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-27T18:08:07.823778] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-27T18:08:07.823822] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-27T18:08:07.823865] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSW took 1.9s. Estimated remaining: 3h 49m 40s. Rate: 7.9 symbols/min [2025-10-27T18:08:07.997142] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:08.005917] [DEBUG] [LOCAL ] CTBB: Loaded 6473 existing records from primary storage. [2025-10-27T18:08:08.006111] [INFO ] [MAIN ] CTBB: Loaded 6473 existing records. [2025-10-27T18:08:08.179042] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:08.179220] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-27T18:08:08.179266] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-27T18:08:08.179404] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-27T18:08:08.179441] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-27T18:08:08.420261] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-27T18:08:08.524780] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:09.215003] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-27T18:08:09.278039] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:08:09.281443] [INFO ] [REMOTE ] CSR: Full fetch complete (17965 records). [2025-10-27T18:08:09.281518] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-27T18:08:09.647217] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-27T18:08:09.647310] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-27T18:08:09.647757] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-27T18:08:09.647820] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-27T18:08:09.648450] [DEBUG] [LOCAL ] CSR: Trimmed 17965 records to 13284 (keeping 200 days of data) [2025-10-27T18:08:09.730258] [DEBUG] [LOCAL ] CSR: Primary data saved (13284 records). [2025-10-27T18:08:09.730393] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-27T18:08:09.730473] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSR took 26.5s. Estimated remaining: 3h 49m 13s. Rate: 8.0 symbols/min [2025-10-27T18:08:09.900083] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:09.906623] [DEBUG] [LOCAL ] CTDD: Loaded 5184 existing records from primary storage. [2025-10-27T18:08:09.906827] [INFO ] [MAIN ] CTDD: Loaded 5184 existing records. [2025-10-27T18:08:10.020016] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-27T18:08:10.083673] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:10.083815] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-27T18:08:10.083864] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-27T18:08:10.083999] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-27T18:08:10.084038] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-27T18:08:10.440233] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:10.498983] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:08:10.615382] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:08:10.814920] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-27T18:08:11.614994] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-27T18:08:12.415502] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-27T18:08:12.416263] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:08:12.494466] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T18:08:13.214923] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-27T18:08:13.225796] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:08:13.797219] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:08:14.014927] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-27T18:08:14.528948] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:08:14.814937] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-27T18:08:15.614957] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-27T18:08:16.053014] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:08:16.318553] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T18:08:16.414932] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-27T18:08:17.214998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-27T18:08:17.721502] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T18:08:18.015000] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-27T18:08:18.489167] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-27T18:08:18.614611] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T18:08:18.814930] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-27T18:08:19.395610] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:08:19.614927] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-27T18:08:20.007539] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T18:08:20.414948] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-27T18:08:21.214947] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-27T18:08:21.547084] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T18:08:21.643148] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:08:22.014930] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-27T18:08:22.814987] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-27T18:08:22.861760] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T18:08:23.614926] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-27T18:08:23.896906] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T18:08:23.975744] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T18:08:24.414948] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-27T18:08:24.820418] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:08:25.214979] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-27T18:08:26.014916] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-27T18:08:26.503037] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T18:08:26.814990] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-27T18:08:26.929227] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:08:26.939217] [INFO ] [REMOTE ] CSTM: Full fetch complete (69579 records). [2025-10-27T18:08:26.939393] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-27T18:08:27.326278] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-27T18:08:27.326391] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-27T18:08:27.327228] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-27T18:08:27.327290] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-27T18:08:27.328626] [DEBUG] [LOCAL ] CSTM: Trimmed 69579 records to 47323 (keeping 200 days of data) [2025-10-27T18:08:27.433501] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:08:27.602195] [DEBUG] [LOCAL ] CSTM: Primary data saved (47323 records). [2025-10-27T18:08:27.602319] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-27T18:08:27.602393] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CSTM took 42.8s. Estimated remaining: 3h 49m 40s. Rate: 7.9 symbols/min [2025-10-27T18:08:27.620130] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-27T18:08:27.769776] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:27.769901] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-27T18:08:27.769937] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-27T18:08:27.770055] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-27T18:08:27.770095] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-27T18:08:27.770136] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-27T18:08:27.770167] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-27T18:08:28.110349] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:28.414894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-27T18:08:28.622728] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:08:28.631791] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:08:28.632409] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-27T18:08:28.632527] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:08:28.632606] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-27T18:08:28.632703] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:08:28.632783] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-27T18:08:28.632861] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-27T18:08:28.632904] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-27T18:08:28.632947] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-27T18:08:28.633001] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CTEV took 1.0s. Estimated remaining: 3h 49m 11s. Rate: 7.9 symbols/min [2025-10-27T18:08:28.817995] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:28.847363] [DEBUG] [LOCAL ] CTO: Loaded 27737 existing records from primary storage. [2025-10-27T18:08:28.847753] [INFO ] [MAIN ] CTO: Loaded 27737 existing records. [2025-10-27T18:08:29.040557] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:29.040870] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-27T18:08:29.040923] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-27T18:08:29.041203] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-27T18:08:29.041259] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-27T18:08:29.226299] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-27T18:08:29.488287] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:29.832710] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:08:29.834263] [INFO ] [REMOTE ] CTBB: Full fetch complete (10052 records). [2025-10-27T18:08:29.834335] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-27T18:08:30.020014] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-27T18:08:30.199132] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-27T18:08:30.199207] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-27T18:08:30.199492] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-27T18:08:30.199544] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-27T18:08:30.199986] [DEBUG] [LOCAL ] CTBB: Trimmed 10052 records to 6201 (keeping 200 days of data) [2025-10-27T18:08:30.236317] [DEBUG] [LOCAL ] CTBB: Primary data saved (6201 records). [2025-10-27T18:08:30.236419] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-27T18:08:30.236502] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTBB took 22.4s. Estimated remaining: 3h 48m 44s. Rate: 8.0 symbols/min [2025-10-27T18:08:30.404845] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:30.443474] [DEBUG] [LOCAL ] CTOS: Loaded 37815 existing records from primary storage. [2025-10-27T18:08:30.443791] [INFO ] [MAIN ] CTOS: Loaded 37815 existing records. [2025-10-27T18:08:30.621399] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:30.621594] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-27T18:08:30.621659] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-27T18:08:30.621893] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-27T18:08:30.621949] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-27T18:08:30.790480] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:08:30.822560] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-27T18:08:30.986779] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:31.526548] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:08:31.614959] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-27T18:08:32.116765] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-27T18:08:32.414936] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-27T18:08:33.214937] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-27T18:08:33.313784] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:08:33.667588] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T18:08:34.014947] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-27T18:08:34.814965] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-27T18:08:35.509100] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T18:08:35.584134] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:08:35.614907] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-27T18:08:36.414992] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-27T18:08:36.922402] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:08:37.214969] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-27T18:08:37.387244] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:08:37.389695] [INFO ] [REMOTE ] CSV: Full fetch complete (18888 records). [2025-10-27T18:08:37.389768] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-27T18:08:37.752733] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-27T18:08:37.752811] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-27T18:08:37.753189] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-27T18:08:37.753227] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-27T18:08:37.753764] [DEBUG] [LOCAL ] CSV: Trimmed 18888 records to 12119 (keeping 200 days of data) [2025-10-27T18:08:37.829297] [DEBUG] [LOCAL ] CSV: Primary data saved (12119 records). [2025-10-27T18:08:37.829708] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-27T18:08:37.829812] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CSV took 33.3s. Estimated remaining: 3h 48m 36s. Rate: 8.0 symbols/min [2025-10-27T18:08:37.999604] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:38.025082] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-27T18:08:38.047634] [DEBUG] [LOCAL ] CTRA: Loaded 54427 existing records from primary storage. [2025-10-27T18:08:38.047970] [INFO ] [MAIN ] CTRA: Loaded 54427 existing records. [2025-10-27T18:08:38.224681] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:38.225023] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-27T18:08:38.225097] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-27T18:08:38.225777] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-27T18:08:38.225838] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-27T18:08:38.560373] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T18:08:38.629520] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:38.814953] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-27T18:08:39.210359] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:08:39.615000] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-27T18:08:40.245899] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:08:40.247220] [INFO ] [REMOTE ] CTDD: Full fetch complete (7919 records). [2025-10-27T18:08:40.247290] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-27T18:08:40.423501] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-27T18:08:40.618582] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-27T18:08:40.618723] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-27T18:08:40.619086] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-27T18:08:40.619150] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-27T18:08:40.619549] [DEBUG] [LOCAL ] CTDD: Trimmed 7919 records to 5011 (keeping 200 days of data) [2025-10-27T18:08:40.648832] [DEBUG] [LOCAL ] CTDD: Primary data saved (5011 records). [2025-10-27T18:08:40.648910] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-27T18:08:40.648981] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTDD took 30.9s. Estimated remaining: 3h 48m 13s. Rate: 8.0 symbols/min [2025-10-27T18:08:40.819174] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:08:40.849385] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T18:08:40.899832] [DEBUG] [LOCAL ] CTRE: Loaded 50162 existing records from primary storage. [2025-10-27T18:08:40.900140] [INFO ] [MAIN ] CTRE: Loaded 50162 existing records. [2025-10-27T18:08:41.079286] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:08:41.079497] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-27T18:08:41.079555] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-27T18:08:41.079773] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-27T18:08:41.079835] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-27T18:08:41.220066] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-27T18:08:41.443525] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:08:42.014996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-27T18:08:42.061660] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:08:42.540412] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:08:42.814983] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-27T18:08:43.614940] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-27T18:08:43.705626] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:08:43.882089] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:08:44.414939] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-27T18:08:44.661048] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T18:08:45.214948] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-27T18:08:45.711100] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:08:46.014985] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-27T18:08:46.809683] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:08:46.820184] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-27T18:08:47.330143] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:08:47.614936] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-27T18:08:47.762582] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:08:48.414967] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-27T18:08:49.188487] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:08:49.214941] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-27T18:08:49.366427] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:08:50.014997] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-27T18:08:50.767282] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T18:08:50.814898] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-27T18:08:50.899965] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T18:08:51.614968] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-27T18:08:52.164767] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:08:52.414965] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-27T18:08:52.877203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:08:53.214938] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-27T18:08:53.953728] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T18:08:54.014905] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-27T18:08:54.647399] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:08:54.815009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-27T18:08:55.351621] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:08:55.615001] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-27T18:08:56.414949] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-27T18:08:56.462170] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:08:57.143980] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:08:57.214927] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-27T18:08:57.326188] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:08:58.014982] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-27T18:08:58.585783] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:08:58.814940] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-27T18:08:59.153157] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:08:59.614984] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-27T18:09:00.311399] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:09:00.317316] [INFO ] [REMOTE ] CTO: Full fetch complete (41456 records). [2025-10-27T18:09:00.317396] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-27T18:09:00.420171] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-27T18:09:00.686088] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-27T18:09:00.686161] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-27T18:09:00.686704] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-27T18:09:00.686765] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-27T18:09:00.687578] [DEBUG] [LOCAL ] CTO: Trimmed 41456 records to 27078 (keeping 200 days of data) [2025-10-27T18:09:00.841919] [DEBUG] [LOCAL ] CTO: Primary data saved (27078 records). [2025-10-27T18:09:00.842038] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-27T18:09:00.842112] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTO took 32.2s. Estimated remaining: 3h 48m 47s. Rate: 7.9 symbols/min [2025-10-27T18:09:01.011054] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:01.053105] [DEBUG] [LOCAL ] CTRI: Loaded 41493 existing records from primary storage. [2025-10-27T18:09:01.053421] [INFO ] [MAIN ] CTRI: Loaded 41493 existing records. [2025-10-27T18:09:01.230987] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-27T18:09:01.237707] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:01.238001] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-27T18:09:01.238049] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-27T18:09:01.238253] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-27T18:09:01.238308] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-27T18:09:01.598305] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:01.726378] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-27T18:09:02.015008] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-27T18:09:02.815060] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-27T18:09:03.851247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T18:09:03.862335] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-27T18:09:04.341157] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-10-27T18:09:04.414930] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-27T18:09:05.386616] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (3.37 seconds). [2025-10-27T18:09:05.392899] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-27T18:09:05.422056] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:09:05.513214] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-27T18:09:05.521125] [INFO ] [REMOTE ] CTOS: Full fetch complete (53978 records). [2025-10-27T18:09:05.521205] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-27T18:09:05.900149] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-27T18:09:05.900221] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-27T18:09:05.900881] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-27T18:09:05.900942] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-27T18:09:05.901960] [DEBUG] [LOCAL ] CTOS: Trimmed 53978 records to 37098 (keeping 200 days of data) [2025-10-27T18:09:06.015139] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-27T18:09:06.110008] [DEBUG] [LOCAL ] CTOS: Primary data saved (37098 records). [2025-10-27T18:09:06.110228] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-27T18:09:06.110337] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTOS took 35.9s. Estimated remaining: 3h 48m 32s. Rate: 8.0 symbols/min [2025-10-27T18:09:06.280541] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:06.298995] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:09:06.318246] [DEBUG] [LOCAL ] CTS: Loaded 19809 existing records from primary storage. [2025-10-27T18:09:06.318450] [INFO ] [MAIN ] CTS: Loaded 19809 existing records. [2025-10-27T18:09:06.509395] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:06.521680] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-27T18:09:06.521744] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-27T18:09:06.522251] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-27T18:09:06.523229] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T18:09:06.523275] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-27T18:09:06.820035] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-27T18:09:06.882679] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:07.614987] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-27T18:09:07.755882] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T18:09:07.765452] [INFO ] [REMOTE ] CTRE: Full fetch complete (71353 records). [2025-10-27T18:09:07.765577] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-27T18:09:08.152301] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-27T18:09:08.152380] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-27T18:09:08.153182] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-27T18:09:08.153244] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-27T18:09:08.154594] [DEBUG] [LOCAL ] CTRE: Trimmed 71353 records to 49379 (keeping 200 days of data) [2025-10-27T18:09:08.424478] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-27T18:09:08.454775] [DEBUG] [LOCAL ] CTRE: Primary data saved (49379 records). [2025-10-27T18:09:08.454915] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-27T18:09:08.455416] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRE took 27.8s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-27T18:09:08.633171] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:08.684254] [DEBUG] [LOCAL ] CTVA: Loaded 54078 existing records from primary storage. [2025-10-27T18:09:08.684679] [INFO ] [MAIN ] CTVA: Loaded 54078 existing records. [2025-10-27T18:09:08.899831] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:08.902367] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T18:09:08.902583] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-27T18:09:08.913734] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-27T18:09:08.919617] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-27T18:09:08.922828] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-27T18:09:08.970019] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:09:09.220009] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-27T18:09:09.283224] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:09.391746] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:09:10.015002] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-27T18:09:10.717316] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:09:10.814914] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-27T18:09:11.272521] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T18:09:11.614909] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-27T18:09:11.836136] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:09:12.414956] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-27T18:09:13.214976] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-27T18:09:13.311357] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T18:09:13.625823] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:09:14.014929] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-27T18:09:14.343787] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T18:09:14.814999] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-27T18:09:15.615012] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-27T18:09:16.007373] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:09:16.017430] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-27T18:09:16.017534] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-27T18:09:16.204630] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:09:16.424464] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-27T18:09:16.429189] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-27T18:09:16.429262] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-27T18:09:16.430230] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-27T18:09:16.430439] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-27T18:09:16.431940] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-27T18:09:16.767755] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-27T18:09:16.767915] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-27T18:09:16.768001] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTRA took 38.9s. Estimated remaining: 3h 48m 3s. Rate: 8.0 symbols/min [2025-10-27T18:09:16.957400] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:16.957621] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-27T18:09:16.957725] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-27T18:09:16.957865] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-27T18:09:16.957997] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-27T18:09:16.958151] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-27T18:09:16.958223] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-27T18:09:17.128368] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:09:17.225804] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-27T18:09:17.393517] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:18.014977] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-27T18:09:18.070727] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:09:18.427160] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T18:09:18.511088] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:09:18.814973] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-27T18:09:19.485226] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:09:19.614937] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-27T18:09:19.872462] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-27T18:09:20.414959] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-27T18:09:21.214942] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-27T18:09:22.014950] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-27T18:09:22.275602] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:09:22.650041] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:09:22.814917] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-27T18:09:23.052617] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:09:23.614914] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-27T18:09:23.778283] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:09:24.414918] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-27T18:09:24.658539] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:09:24.668159] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-27T18:09:25.214935] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-27T18:09:26.014938] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-27T18:09:26.433888] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T18:09:26.814921] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-27T18:09:26.889992] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:09:27.614945] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-27T18:09:27.906522] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T18:09:27.996467] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:09:28.414933] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-27T18:09:29.214970] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-27T18:09:29.762638] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T18:09:30.014956] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-27T18:09:30.474384] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:09:30.815004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-27T18:09:31.203146] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:09:31.588397] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:09:31.597855] [INFO ] [REMOTE ] CTRI: Full fetch complete (54979 records). [2025-10-27T18:09:31.597966] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-27T18:09:31.620195] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-27T18:09:31.969390] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:09:31.989071] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-27T18:09:31.989127] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-27T18:09:31.989804] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-27T18:09:31.989866] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-27T18:09:31.990938] [DEBUG] [LOCAL ] CTRI: Trimmed 54979 records to 41068 (keeping 200 days of data) [2025-10-27T18:09:32.222676] [DEBUG] [LOCAL ] CTRI: Primary data saved (41068 records). [2025-10-27T18:09:32.222805] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-27T18:09:32.222879] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTRI took 31.4s. Estimated remaining: 3h 48m 21s. Rate: 7.9 symbols/min [2025-10-27T18:09:32.397757] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:32.422861] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-27T18:09:32.443977] [DEBUG] [LOCAL ] CUBE: Loaded 51622 existing records from primary storage. [2025-10-27T18:09:32.444295] [INFO ] [MAIN ] CUBE: Loaded 51622 existing records. [2025-10-27T18:09:32.624251] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:32.624467] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-27T18:09:32.624515] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-27T18:09:32.624899] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-27T18:09:32.624957] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-27T18:09:32.977482] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:33.214937] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-27T18:09:33.292355] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:09:34.014944] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-27T18:09:34.784508] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:09:34.788829] [INFO ] [REMOTE ] CTS: Full fetch complete (27466 records). [2025-10-27T18:09:34.788918] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-27T18:09:34.819921] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-27T18:09:35.176765] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:09:35.198232] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-27T18:09:35.198339] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:09:35.198555] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-27T18:09:35.200324] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-27T18:09:35.200373] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-27T18:09:35.201023] [DEBUG] [LOCAL ] CTS: Trimmed 27466 records to 19302 (keeping 200 days of data) [2025-10-27T18:09:35.316133] [DEBUG] [LOCAL ] CTS: Primary data saved (19302 records). [2025-10-27T18:09:35.316290] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-27T18:09:35.316375] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CTS took 29.2s. Estimated remaining: 3h 47m 59s. Rate: 8.0 symbols/min [2025-10-27T18:09:35.481696] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:35.505890] [DEBUG] [LOCAL ] CUBI: Loaded 27498 existing records from primary storage. [2025-10-27T18:09:35.506144] [INFO ] [MAIN ] CUBI: Loaded 27498 existing records. [2025-10-27T18:09:35.620022] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-27T18:09:35.679871] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:35.680482] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-27T18:09:35.680529] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-27T18:09:35.680699] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-27T18:09:35.680755] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-27T18:09:36.027785] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:36.414981] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-27T18:09:36.846829] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:09:37.214998] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-27T18:09:37.741889] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:09:38.015022] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-27T18:09:38.276317] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T18:09:38.446223] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:09:38.814927] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-27T18:09:39.159925] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-27T18:09:39.160670] [INFO ] [REMOTE ] CUBB: Full fetch complete (963 records). [2025-10-27T18:09:39.160761] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-27T18:09:39.333664] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-27T18:09:39.333837] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:09:39.333882] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:09:39.333954] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-27T18:09:39.334014] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-27T18:09:39.334048] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-27T18:09:39.334086] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-27T18:09:39.334139] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CUBB took 22.6s. Estimated remaining: 3h 47m 40s. Rate: 8.0 symbols/min [2025-10-27T18:09:39.499980] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:09:39.546076] [DEBUG] [LOCAL ] CUK: Loaded 51820 existing records from primary storage. [2025-10-27T18:09:39.546393] [INFO ] [MAIN ] CUK: Loaded 51820 existing records. [2025-10-27T18:09:39.620078] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-27T18:09:39.721274] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:09:39.721468] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-27T18:09:39.721515] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-27T18:09:39.721732] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-27T18:09:39.721787] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-27T18:09:40.065170] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:09:40.414955] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-27T18:09:40.744375] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:09:41.214931] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-27T18:09:41.769781] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:09:41.988627] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T18:09:42.014918] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-27T18:09:42.815004] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-27T18:09:43.394791] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:09:43.615003] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-27T18:09:44.414912] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-27T18:09:44.489873] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:09:44.640253] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:09:45.215006] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-27T18:09:45.989614] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:09:46.014916] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-27T18:09:46.667538] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T18:09:46.814926] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-27T18:09:47.444582] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:09:47.614939] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-27T18:09:48.369362] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T18:09:48.414951] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-27T18:09:49.115753] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T18:09:49.214975] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-27T18:09:49.837074] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:09:50.014953] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-27T18:09:50.502371] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T18:09:50.814907] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-27T18:09:51.318368] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:09:51.547997] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:09:51.614932] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-27T18:09:52.415001] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-27T18:09:52.919127] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:09:53.214955] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-27T18:09:54.014915] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-27T18:09:54.375232] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T18:09:54.814935] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-27T18:09:54.934526] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T18:09:55.472378] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T18:09:55.614942] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-27T18:09:56.185694] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:09:56.414936] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-27T18:09:56.860423] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:09:57.214931] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-27T18:09:57.905688] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:09:57.978729] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T18:09:58.014903] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-27T18:09:58.814996] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-27T18:09:59.322404] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T18:09:59.614955] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-27T18:10:00.196680] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T18:10:00.414994] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-27T18:10:01.214974] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-27T18:10:02.014950] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-27T18:10:02.083715] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-27T18:10:02.095117] [INFO ] [REMOTE ] CTVA: Full fetch complete (77237 records). [2025-10-27T18:10:02.095294] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-27T18:10:02.517024] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-27T18:10:02.517116] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-27T18:10:02.518022] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-27T18:10:02.518087] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-27T18:10:02.519527] [DEBUG] [LOCAL ] CTVA: Trimmed 77237 records to 53299 (keeping 200 days of data) [2025-10-27T18:10:02.845811] [DEBUG] [LOCAL ] CTVA: Primary data saved (53299 records). [2025-10-27T18:10:02.845910] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-27T18:10:02.846746] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTVA took 54.4s. Estimated remaining: 3h 48m 24s. Rate: 7.9 symbols/min [2025-10-27T18:10:03.019351] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:03.024062] [DEBUG] [LOCAL ] CULP: Loaded 2867 existing records from primary storage. [2025-10-27T18:10:03.024233] [INFO ] [MAIN ] CULP: Loaded 2867 existing records. [2025-10-27T18:10:03.197122] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:03.197307] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-27T18:10:03.197353] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-27T18:10:03.197503] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-27T18:10:03.197560] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-27T18:10:03.547851] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-27T18:10:03.567214] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:03.572385] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-27T18:10:03.573452] [INFO ] [REMOTE ] CUBI: Full fetch complete (39222 records). [2025-10-27T18:10:03.573526] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-27T18:10:03.982814] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-27T18:10:03.982888] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-27T18:10:03.983412] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-27T18:10:03.983450] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-27T18:10:03.984241] [DEBUG] [LOCAL ] CUBI: Trimmed 39222 records to 26871 (keeping 200 days of data) [2025-10-27T18:10:04.138987] [DEBUG] [LOCAL ] CUBI: Primary data saved (26871 records). [2025-10-27T18:10:04.139111] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-27T18:10:04.139189] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUBI took 28.8s. Estimated remaining: 3h 47m 56s. Rate: 7.9 symbols/min [2025-10-27T18:10:04.267198] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:10:04.279311] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-27T18:10:04.324702] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:04.356750] [DEBUG] [LOCAL ] CURB: Loaded 33391 existing records from primary storage. [2025-10-27T18:10:04.357035] [INFO ] [MAIN ] CURB: Loaded 33391 existing records. [2025-10-27T18:10:04.536605] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:04.536876] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-27T18:10:04.536949] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-27T18:10:04.537197] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-27T18:10:04.537263] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-27T18:10:04.868135] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:10:04.869606] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-27T18:10:04.883449] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (3.67 seconds). [2025-10-27T18:10:04.934202] [INFO ] [REMOTE ] CUBE: Full fetch complete (72956 records). [2025-10-27T18:10:04.940117] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-27T18:10:04.961124] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:04.957582] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:10:04.961838] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:10:04.962059] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:10:04.962401] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-27T18:10:04.962529] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-27T18:10:04.962575] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-27T18:10:04.962726] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-10-27T18:10:04.963153] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUBE took 32.7s. Estimated remaining: 3h 47m 27s. Rate: 8.0 symbols/min [2025-10-27T18:10:05.067057] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-27T18:10:05.214945] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-27T18:10:05.320185] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T18:10:06.014935] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-27T18:10:06.814941] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-27T18:10:07.213432] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:10:07.249307] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:10:07.278912] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:10:07.614924] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-27T18:10:08.412425] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T18:10:08.418147] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-27T18:10:08.968288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:10:09.214951] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-27T18:10:10.015023] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-27T18:10:10.511848] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:10:10.630532] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T18:10:10.814960] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-27T18:10:11.614960] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-27T18:10:11.821206] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:10:12.415011] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-27T18:10:12.847723] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T18:10:13.214942] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-27T18:10:13.680042] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T18:10:13.689899] [INFO ] [REMOTE ] CUK: Full fetch complete (74390 records). [2025-10-27T18:10:13.690059] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-27T18:10:13.922934] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T18:10:14.030017] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-27T18:10:14.086671] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-27T18:10:14.086844] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-27T18:10:14.087706] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-27T18:10:14.087776] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-27T18:10:14.089166] [DEBUG] [LOCAL ] CUK: Trimmed 74390 records to 51033 (keeping 200 days of data) [2025-10-27T18:10:14.377311] [DEBUG] [LOCAL ] CUK: Primary data saved (51033 records). [2025-10-27T18:10:14.377447] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-27T18:10:14.377524] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CUK took 35.0s. Estimated remaining: 3h 47m 26s. Rate: 7.9 symbols/min [2025-10-27T18:10:14.814976] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-27T18:10:14.868065] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:10:15.615008] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-27T18:10:16.026794] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:10:16.154948] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T18:10:16.155951] [INFO ] [REMOTE ] CULP: Full fetch complete (4426 records). [2025-10-27T18:10:16.156049] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-27T18:10:16.428461] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-27T18:10:16.522558] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-27T18:10:16.522628] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-27T18:10:16.522815] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-27T18:10:16.522862] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-27T18:10:16.523208] [DEBUG] [LOCAL ] CULP: Trimmed 4426 records to 2757 (keeping 200 days of data) [2025-10-27T18:10:16.538112] [DEBUG] [LOCAL ] CULP: Primary data saved (2757 records). [2025-10-27T18:10:16.538176] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-27T18:10:16.538244] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CULP took 13.7s. Estimated remaining: 3h 47m 1s. Rate: 8.0 symbols/min [2025-10-27T18:10:19.735930] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-10-27T18:10:19.743094] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-27T18:10:20.671481] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:10:20.678761] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-27T18:10:22.144390] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:10:22.151938] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-27T18:10:23.530052] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:10:23.537751] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-27T18:10:24.801611] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:10:24.809295] [INFO ] [REMOTE ] CURB: Full fetch complete (47699 records). [2025-10-27T18:10:24.809411] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-27T18:10:25.234423] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-27T18:10:25.234501] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-27T18:10:25.235188] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-27T18:10:25.235253] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-27T18:10:25.236275] [DEBUG] [LOCAL ] CURB: Trimmed 47699 records to 32698 (keeping 200 days of data) [2025-10-27T18:10:25.439170] [DEBUG] [LOCAL ] CURB: Primary data saved (32698 records). [2025-10-27T18:10:25.439382] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-27T18:10:25.439491] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CURB took 21.3s. Estimated remaining: 3h 46m 57s. Rate: 8.0 symbols/min [2025-10-27T18:10:26.129107] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.121708] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.167044] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.187167] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:26.202809] [DEBUG] [LOCAL ] CVEO: Loaded 15335 existing records from primary storage. [2025-10-27T18:10:26.207243] [INFO ] [MAIN ] CVEO: Loaded 15335 existing records. [2025-10-27T18:10:26.352313] [DEBUG] [LOCAL ] CURV: Loaded 27627 existing records from primary storage. [2025-10-27T18:10:26.397100] [INFO ] [MAIN ] CURV: Loaded 27627 existing records. [2025-10-27T18:10:26.558438] [DEBUG] [LOCAL ] CUZ: Loaded 50093 existing records from primary storage. [2025-10-27T18:10:26.539250] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:26.580965] [INFO ] [MAIN ] CUZ: Loaded 50093 existing records. [2025-10-27T18:10:26.581242] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-27T18:10:26.582239] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-27T18:10:26.582108] [DEBUG] [LOCAL ] CVE: Loaded 54346 existing records from primary storage. [2025-10-27T18:10:26.612094] [INFO ] [MAIN ] CVE: Loaded 54346 existing records. [2025-10-27T18:10:26.648794] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-27T18:10:26.754420] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-27T18:10:26.847242] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:26.905140] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-27T18:10:26.910616] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-27T18:10:26.959776] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-27T18:10:26.986175] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-27T18:10:27.193057] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:27.363334] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-27T18:10:27.490029] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-27T18:10:27.564277] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-27T18:10:27.550977] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:27.569808] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-27T18:10:27.632010] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-27T18:10:27.694463] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-27T18:10:27.841554] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-27T18:10:27.933790] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-27T18:10:27.964772] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:27.987376] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-27T18:10:28.278666] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.300992] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-27T18:10:28.588919] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.589300] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-27T18:10:28.669564] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:28.669943] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-27T18:10:28.791964] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:10:28.794156] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-27T18:10:29.276453] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:10:29.282061] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-27T18:10:29.586495] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:10:29.589563] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-27T18:10:30.201524] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:10:30.212454] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-27T18:10:30.292684] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:10:30.325613] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:10:30.324676] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-27T18:10:30.327629] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:10:30.343835] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-27T18:10:30.343606] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-27T18:10:31.055713] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:10:31.061767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-27T18:10:31.240559] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T18:10:31.244165] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-27T18:10:31.479346] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:10:31.489537] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-27T18:10:31.922848] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T18:10:31.932426] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-27T18:10:32.101715] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:10:32.201224] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T18:10:32.414913] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-27T18:10:33.210770] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T18:10:33.221178] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-27T18:10:33.399523] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:10:33.575012] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:10:33.869976] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:10:34.015009] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-27T18:10:34.814969] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-27T18:10:35.238668] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T18:10:35.614940] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-27T18:10:36.414915] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-27T18:10:36.636452] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:10:36.704448] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:10:37.214934] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-27T18:10:37.940414] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T18:10:38.014905] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-27T18:10:38.744464] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T18:10:38.814906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-27T18:10:39.330195] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:10:39.614930] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-27T18:10:40.155525] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:10:40.414943] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-27T18:10:40.946007] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:10:41.101131] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:10:41.214930] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-27T18:10:42.014938] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-27T18:10:42.064494] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:10:42.814941] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-27T18:10:43.614948] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-27T18:10:43.775158] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:10:43.778694] [INFO ] [REMOTE ] CVEO: Full fetch complete (20966 records). [2025-10-27T18:10:43.778778] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-27T18:10:44.131074] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:10:44.201255] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-27T18:10:44.201327] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-27T18:10:44.201942] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-27T18:10:44.202010] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-27T18:10:44.202596] [DEBUG] [LOCAL ] CVEO: Trimmed 20966 records to 15001 (keeping 200 days of data) [2025-10-27T18:10:44.286811] [DEBUG] [LOCAL ] CVEO: Primary data saved (15001 records). [2025-10-27T18:10:44.286947] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-27T18:10:44.287084] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 18.8s. Estimated remaining: 3h 47m 26s. Rate: 7.9 symbols/min [2025-10-27T18:10:44.425537] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-27T18:10:44.458010] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:44.498038] [DEBUG] [LOCAL ] CVI: Loaded 47376 existing records from primary storage. [2025-10-27T18:10:44.498827] [INFO ] [MAIN ] CVI: Loaded 47376 existing records. [2025-10-27T18:10:44.681127] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:44.681357] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-27T18:10:44.681564] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-27T18:10:44.681921] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-27T18:10:44.681982] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-27T18:10:44.806797] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:10:45.068550] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:45.214919] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-27T18:10:45.732532] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T18:10:46.014941] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-27T18:10:46.814946] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-27T18:10:46.914048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:10:46.951197] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:10:47.614951] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-27T18:10:48.414926] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-27T18:10:48.675832] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:10:48.989613] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:10:49.214954] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-27T18:10:49.498735] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:10:50.014957] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-27T18:10:50.213569] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:10:50.219967] [INFO ] [REMOTE ] CURV: Full fetch complete (39108 records). [2025-10-27T18:10:50.220065] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-27T18:10:50.587050] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-27T18:10:50.587130] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-27T18:10:50.587706] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-27T18:10:50.587766] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-27T18:10:50.588563] [DEBUG] [LOCAL ] CURV: Trimmed 39108 records to 27358 (keeping 200 days of data) [2025-10-27T18:10:50.734932] [DEBUG] [LOCAL ] CURV: Primary data saved (27358 records). [2025-10-27T18:10:50.735056] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-27T18:10:50.735131] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CURV took 25.3s. Estimated remaining: 3h 47m 15s. Rate: 7.9 symbols/min [2025-10-27T18:10:50.824340] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-27T18:10:50.904590] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:50.919560] [DEBUG] [LOCAL ] CVLG: Loaded 15515 existing records from primary storage. [2025-10-27T18:10:50.919826] [INFO ] [MAIN ] CVLG: Loaded 15515 existing records. [2025-10-27T18:10:51.092844] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:51.093034] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-27T18:10:51.093079] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-27T18:10:51.093374] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-27T18:10:51.093430] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-27T18:10:51.459779] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:51.521464] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:10:51.614904] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-27T18:10:52.230198] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:10:52.415028] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-27T18:10:53.215020] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-27T18:10:53.336552] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:10:53.798387] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:10:53.900054] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:10:54.015027] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-27T18:10:54.565577] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:10:54.814938] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-27T18:10:55.614939] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-27T18:10:56.155767] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T18:10:56.414935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-27T18:10:56.990497] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T18:10:57.000551] [INFO ] [REMOTE ] CVE: Full fetch complete (77712 records). [2025-10-27T18:10:57.000699] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-27T18:10:57.222953] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-27T18:10:57.413520] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-27T18:10:57.414545] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:10:57.414089] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-27T18:10:57.420380] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-27T18:10:57.420739] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-27T18:10:57.422000] [DEBUG] [LOCAL ] CVE: Trimmed 77712 records to 53560 (keeping 200 days of data) [2025-10-27T18:10:57.735158] [DEBUG] [LOCAL ] CVE: Primary data saved (53560 records). [2025-10-27T18:10:57.735280] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-27T18:10:57.736200] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CVE took 32.3s. Estimated remaining: 3h 47m 6s. Rate: 7.9 symbols/min [2025-10-27T18:10:57.904412] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:10:57.955490] [DEBUG] [LOCAL ] CVNA: Loaded 53603 existing records from primary storage. [2025-10-27T18:10:57.955808] [INFO ] [MAIN ] CVNA: Loaded 53603 existing records. [2025-10-27T18:10:58.020153] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-27T18:10:58.130570] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:10:58.130746] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-27T18:10:58.130793] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-27T18:10:58.130973] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-27T18:10:58.131009] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-27T18:10:58.475268] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:10:58.814964] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-27T18:10:59.029503] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T18:10:59.111893] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:10:59.121155] [INFO ] [REMOTE ] CUZ: Full fetch complete (70802 records). [2025-10-27T18:10:59.121272] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-27T18:10:59.512872] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-27T18:10:59.512950] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-27T18:10:59.513757] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-27T18:10:59.513823] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-27T18:10:59.515239] [DEBUG] [LOCAL ] CUZ: Trimmed 70802 records to 49312 (keeping 200 days of data) [2025-10-27T18:10:59.618477] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-27T18:10:59.806306] [DEBUG] [LOCAL ] CUZ: Primary data saved (49312 records). [2025-10-27T18:10:59.806429] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-27T18:10:59.806503] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CUZ took 34.3s. Estimated remaining: 3h 46m 41s. Rate: 7.9 symbols/min [2025-10-27T18:10:59.976350] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:00.023960] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-27T18:11:00.024257] [INFO ] [MAIN ] CVS: Loaded 54474 existing records. [2025-10-27T18:11:00.198442] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:00.198692] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-27T18:11:00.198755] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-27T18:11:00.198934] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-27T18:11:00.198992] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-27T18:11:00.422529] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-27T18:11:00.560662] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:01.099494] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T18:11:01.214917] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-27T18:11:01.980549] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-27T18:11:02.014949] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-27T18:11:02.815002] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-27T18:11:03.850879] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (3.43 seconds). [2025-10-27T18:11:03.854994] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-27T18:11:04.046001] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T18:11:04.152330] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-27T18:11:04.414928] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-27T18:11:04.514542] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:11:04.774687] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:11:05.214937] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-27T18:11:06.014958] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-27T18:11:06.341590] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:11:06.505767] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:11:06.669488] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T18:11:06.814942] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-27T18:11:07.614933] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-27T18:11:08.414971] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-27T18:11:08.725281] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:11:08.905058] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T18:11:09.214937] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-27T18:11:10.014942] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-27T18:11:10.396125] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:11:10.433523] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-27T18:11:10.814964] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-27T18:11:10.872597] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:11:11.614935] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-27T18:11:12.338056] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T18:11:12.341086] [INFO ] [REMOTE ] CVLG: Full fetch complete (21371 records). [2025-10-27T18:11:12.341186] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-27T18:11:12.420035] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-27T18:11:12.699170] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-27T18:11:12.699245] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-27T18:11:12.699717] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-27T18:11:12.699777] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-27T18:11:12.700334] [DEBUG] [LOCAL ] CVLG: Trimmed 21371 records to 15185 (keeping 200 days of data) [2025-10-27T18:11:12.791270] [DEBUG] [LOCAL ] CVLG: Primary data saved (15185 records). [2025-10-27T18:11:12.791414] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-27T18:11:12.791490] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVLG took 22.1s. Estimated remaining: 3h 46m 51s. Rate: 7.9 symbols/min [2025-10-27T18:11:12.957710] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:13.009615] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-10-27T18:11:13.010031] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-10-27T18:11:13.197901] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:13.198235] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-27T18:11:13.198400] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-27T18:11:13.198625] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-27T18:11:13.198719] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-27T18:11:13.230981] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-27T18:11:13.541469] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-27T18:11:13.628440] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:13.883404] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:11:14.014917] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-27T18:11:14.648932] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:11:14.814983] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-27T18:11:15.614973] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-27T18:11:15.941182] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T18:11:16.415022] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-27T18:11:16.698681] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T18:11:17.214943] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-27T18:11:17.436350] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:11:17.447020] [INFO ] [REMOTE ] CVI: Full fetch complete (67183 records). [2025-10-27T18:11:17.447201] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-27T18:11:17.880156] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-27T18:11:17.880271] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-27T18:11:17.881146] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-27T18:11:17.881215] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-27T18:11:17.882677] [DEBUG] [LOCAL ] CVI: Trimmed 67183 records to 46550 (keeping 200 days of data) [2025-10-27T18:11:18.060145] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-27T18:11:18.177986] [DEBUG] [LOCAL ] CVI: Primary data saved (46550 records). [2025-10-27T18:11:18.178184] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-27T18:11:18.178301] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVI took 33.9s. Estimated remaining: 3h 46m 36s. Rate: 7.9 symbols/min [2025-10-27T18:11:18.372087] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:18.393693] [DEBUG] [LOCAL ] CW: Loaded 22175 existing records from primary storage. [2025-10-27T18:11:18.393968] [INFO ] [MAIN ] CW: Loaded 22175 existing records. [2025-10-27T18:11:18.566908] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-27T18:11:18.644209] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:18.644476] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-27T18:11:18.644548] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-27T18:11:18.644782] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-27T18:11:18.644839] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-27T18:11:18.824928] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-27T18:11:19.032195] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:19.100467] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:11:19.614943] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-27T18:11:19.695677] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:11:20.414920] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-27T18:11:20.482024] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:11:21.144056] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-27T18:11:21.214966] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-27T18:11:21.993010] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:11:22.014905] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-27T18:11:22.328358] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:11:22.814994] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-27T18:11:23.614988] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-27T18:11:24.178436] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:11:24.414953] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-27T18:11:25.029039] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T18:11:25.214921] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-27T18:11:25.726049] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:11:25.854509] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-27T18:11:26.014941] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-27T18:11:26.814921] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-27T18:11:27.306902] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T18:11:27.614940] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-27T18:11:28.336039] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T18:11:28.414907] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-27T18:11:28.996226] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:11:29.220318] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-27T18:11:29.236923] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:11:30.014973] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-27T18:11:30.416349] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T18:11:30.428906] [INFO ] [REMOTE ] CVNA: Full fetch complete (76711 records). [2025-10-27T18:11:30.429105] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-27T18:11:30.822779] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-27T18:11:30.877696] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-27T18:11:30.877904] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-27T18:11:30.878850] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-27T18:11:30.878915] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-27T18:11:30.880309] [DEBUG] [LOCAL ] CVNA: Trimmed 76711 records to 52806 (keeping 200 days of data) [2025-10-27T18:11:31.104696] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:11:31.216563] [DEBUG] [LOCAL ] CVNA: Primary data saved (52806 records). [2025-10-27T18:11:31.216743] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-27T18:11:31.216829] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVNA took 33.5s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-27T18:11:31.393998] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:31.442945] [DEBUG] [LOCAL ] CWAN: Loaded 53447 existing records from primary storage. [2025-10-27T18:11:31.443251] [INFO ] [MAIN ] CWAN: Loaded 53447 existing records. [2025-10-27T18:11:31.625928] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-27T18:11:31.631597] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:31.632563] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-27T18:11:31.632620] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-27T18:11:31.632946] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-27T18:11:31.632994] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-27T18:11:31.994976] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:32.036832] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:11:32.047792] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-27T18:11:32.048145] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-27T18:11:32.179506] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-27T18:11:32.421891] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-27T18:11:32.481889] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-27T18:11:32.481965] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-27T18:11:32.482883] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-27T18:11:32.482945] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-27T18:11:32.484356] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-27T18:11:32.810141] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:11:32.830124] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-27T18:11:32.830212] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-27T18:11:32.830280] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVS took 33.0s. Estimated remaining: 3h 46m 20s. Rate: 7.9 symbols/min [2025-10-27T18:11:32.996201] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:33.032978] [DEBUG] [LOCAL ] CWEN: Loaded 45920 existing records from primary storage. [2025-10-27T18:11:33.033253] [INFO ] [MAIN ] CWEN: Loaded 45920 existing records. [2025-10-27T18:11:33.209169] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:33.209395] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-27T18:11:33.209447] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-27T18:11:33.209761] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-27T18:11:33.209830] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-27T18:11:33.220739] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-27T18:11:33.557791] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:34.014960] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-27T18:11:34.661062] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-27T18:11:34.814900] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-27T18:11:34.878987] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:11:35.394004] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T18:11:35.614940] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-27T18:11:36.414941] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-27T18:11:36.803940] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T18:11:37.114895] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T18:11:37.214910] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-27T18:11:37.517310] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:11:38.014958] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-27T18:11:38.815058] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-27T18:11:39.004820] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:11:39.614915] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-27T18:11:39.688743] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:11:39.922105] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:11:40.415017] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-27T18:11:41.214995] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-27T18:11:41.660896] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T18:11:41.746520] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:11:42.014995] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-27T18:11:42.814947] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-27T18:11:43.339315] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:11:43.390126] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T18:11:43.614899] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-27T18:11:43.699199] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:11:44.414996] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-27T18:11:44.878919] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T18:11:45.214963] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-27T18:11:46.014942] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-27T18:11:46.815016] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-27T18:11:46.921763] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T18:11:46.933052] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-27T18:11:46.933211] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-27T18:11:47.236209] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:11:47.379375] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-27T18:11:47.379504] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-27T18:11:47.380433] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-27T18:11:47.380626] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-27T18:11:47.382143] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-27T18:11:47.510127] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:11:47.616884] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-27T18:11:47.762750] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-27T18:11:47.762894] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-27T18:11:47.763469] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CVX took 35.0s. Estimated remaining: 3h 46m 35s. Rate: 7.9 symbols/min [2025-10-27T18:11:47.934913] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:47.988838] [DEBUG] [LOCAL ] CWH: Loaded 52001 existing records from primary storage. [2025-10-27T18:11:47.989192] [INFO ] [MAIN ] CWH: Loaded 52001 existing records. [2025-10-27T18:11:48.173130] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:48.178634] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-27T18:11:48.178744] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-27T18:11:48.185137] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-27T18:11:48.185205] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-27T18:11:48.218003] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T18:11:48.272258] [INFO ] [REMOTE ] CW: Full fetch complete (32830 records). [2025-10-27T18:11:48.293315] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-27T18:11:48.427841] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-27T18:11:48.820504] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:48.941243] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-27T18:11:48.941348] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-27T18:11:48.942060] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-27T18:11:48.942145] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-27T18:11:48.943154] [DEBUG] [LOCAL ] CW: Trimmed 32830 records to 21509 (keeping 200 days of data) [2025-10-27T18:11:49.056853] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:11:49.110500] [DEBUG] [LOCAL ] CW: Primary data saved (21509 records). [2025-10-27T18:11:49.110622] [INFO ] [MAIN ] CW: Full history saved. [2025-10-27T18:11:49.110731] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CW took 30.9s. Estimated remaining: 3h 46m 8s. Rate: 7.9 symbols/min [2025-10-27T18:11:49.220112] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-27T18:11:49.280504] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:11:49.326194] [DEBUG] [LOCAL ] CWK: Loaded 50403 existing records from primary storage. [2025-10-27T18:11:49.326484] [INFO ] [MAIN ] CWK: Loaded 50403 existing records. [2025-10-27T18:11:49.499661] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:11:49.499853] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-27T18:11:49.499899] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-27T18:11:49.500065] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-27T18:11:49.500128] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-27T18:11:49.852951] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:11:49.881832] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:11:50.014967] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-27T18:11:50.656122] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:11:50.814940] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-27T18:11:51.614917] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-27T18:11:51.878726] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:11:52.044302] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:11:52.414982] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-27T18:11:52.976791] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:11:53.214941] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-27T18:11:53.625931] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T18:11:54.014952] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-27T18:11:54.490130] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T18:11:54.814926] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-27T18:11:55.156789] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:11:55.614985] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-27T18:11:56.175443] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:11:56.414984] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-27T18:11:57.002165] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:11:57.214979] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-27T18:11:57.946326] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:11:58.014924] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-27T18:11:58.352730] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:11:58.814937] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-27T18:11:59.378746] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:11:59.387947] [INFO ] [REMOTE ] CWEN: Full fetch complete (65719 records). [2025-10-27T18:11:59.388056] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-27T18:11:59.621845] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-27T18:11:59.772924] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-27T18:11:59.773003] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-27T18:11:59.773772] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-27T18:11:59.773836] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-27T18:11:59.775122] [DEBUG] [LOCAL ] CWEN: Trimmed 65719 records to 45119 (keeping 200 days of data) [2025-10-27T18:12:00.040060] [DEBUG] [LOCAL ] CWEN: Primary data saved (45119 records). [2025-10-27T18:12:00.040205] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-27T18:12:00.040290] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWEN took 27.2s. Estimated remaining: 3h 46m 11s. Rate: 7.9 symbols/min [2025-10-27T18:12:00.211520] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:00.240860] [DEBUG] [LOCAL ] CWT: Loaded 28471 existing records from primary storage. [2025-10-27T18:12:00.241161] [INFO ] [MAIN ] CWT: Loaded 28471 existing records. [2025-10-27T18:12:00.417740] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-27T18:12:00.424838] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:00.425205] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-27T18:12:00.425300] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-27T18:12:00.425549] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-27T18:12:00.425837] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-27T18:12:00.714224] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T18:12:00.881094] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:01.214946] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-27T18:12:02.015007] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-27T18:12:02.247786] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-27T18:12:02.814933] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-27T18:12:04.479114] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-10-27T18:12:04.490421] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-27T18:12:04.588420] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T18:12:04.594406] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-27T18:12:05.175954] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (4.76 seconds). [2025-10-27T18:12:05.214895] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-27T18:12:05.253111] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-27T18:12:06.015191] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-27T18:12:06.454308] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T18:12:06.814939] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-27T18:12:07.010015] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T18:12:07.160535] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:12:07.438213] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T18:12:07.448797] [INFO ] [REMOTE ] CWAN: Full fetch complete (75647 records). [2025-10-27T18:12:07.448934] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-27T18:12:07.633253] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-27T18:12:07.850318] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-27T18:12:07.850393] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-27T18:12:07.851242] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-27T18:12:07.851305] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-27T18:12:07.852741] [DEBUG] [LOCAL ] CWAN: Trimmed 75647 records to 52664 (keeping 200 days of data) [2025-10-27T18:12:08.166095] [DEBUG] [LOCAL ] CWAN: Primary data saved (52664 records). [2025-10-27T18:12:08.166285] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-27T18:12:08.167923] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWAN took 37.0s. Estimated remaining: 3h 46m 5s. Rate: 7.9 symbols/min [2025-10-27T18:12:08.344266] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:08.371409] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T18:12:08.422257] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-27T18:12:08.425178] [DEBUG] [LOCAL ] CX: Loaded 53576 existing records from primary storage. [2025-10-27T18:12:08.425577] [INFO ] [MAIN ] CX: Loaded 53576 existing records. [2025-10-27T18:12:08.607281] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:08.607682] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-27T18:12:08.607802] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-27T18:12:08.608163] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-27T18:12:08.608240] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-27T18:12:08.879616] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:12:08.990099] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:09.214959] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-27T18:12:10.014932] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-27T18:12:10.084072] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:12:10.634865] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:12:10.814972] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-27T18:12:11.336504] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:12:11.615035] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-27T18:12:12.095733] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:12:12.414983] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-27T18:12:12.670616] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:12:13.214955] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-27T18:12:13.719077] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:12:14.014999] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-27T18:12:14.814986] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-27T18:12:15.158627] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T18:12:15.614979] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-27T18:12:15.649568] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T18:12:16.303134] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:12:16.414939] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-27T18:12:17.014213] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:12:17.214941] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-27T18:12:17.845194] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:12:18.014994] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-27T18:12:18.814915] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-27T18:12:19.027274] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:12:19.036882] [INFO ] [REMOTE ] CWK: Full fetch complete (71398 records). [2025-10-27T18:12:19.037022] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-27T18:12:19.426459] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-27T18:12:19.426552] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-27T18:12:19.427598] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-27T18:12:19.427707] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-27T18:12:19.429057] [DEBUG] [LOCAL ] CWK: Trimmed 71398 records to 49600 (keeping 200 days of data) [2025-10-27T18:12:19.625240] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-27T18:12:19.738254] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:12:19.754991] [DEBUG] [LOCAL ] CWK: Primary data saved (49600 records). [2025-10-27T18:12:19.755203] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-27T18:12:19.755285] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWK took 30.6s. Estimated remaining: 3h 46m 10s. Rate: 7.9 symbols/min [2025-10-27T18:12:19.766542] [INFO ] [REMOTE ] CWH: Full fetch complete (73261 records). [2025-10-27T18:12:19.785863] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-27T18:12:20.027709] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:20.231178] [DEBUG] [LOCAL ] CXE: Loaded 6478 existing records from primary storage. [2025-10-27T18:12:20.248033] [INFO ] [MAIN ] CXE: Loaded 6478 existing records. [2025-10-27T18:12:20.249006] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T18:12:20.415830] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-27T18:12:20.470520] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-27T18:12:20.475790] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-27T18:12:20.496969] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-27T18:12:20.514734] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-27T18:12:20.538079] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:20.538367] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-27T18:12:20.538536] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-27T18:12:20.538908] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-27T18:12:20.538979] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-27T18:12:20.553161] [DEBUG] [LOCAL ] CWH: Trimmed 73261 records to 51204 (keeping 200 days of data) [2025-10-27T18:12:21.113744] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:21.207485] [DEBUG] [LOCAL ] CWH: Primary data saved (51204 records). [2025-10-27T18:12:21.207610] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-27T18:12:21.208118] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CWH took 33.4s. Estimated remaining: 3h 45m 44s. Rate: 7.9 symbols/min [2025-10-27T18:12:21.228448] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-27T18:12:21.403585] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:21.421879] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:12:21.450077] [DEBUG] [LOCAL ] CXH: Loaded 4406 existing records from primary storage. [2025-10-27T18:12:21.451814] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:12:21.451106] [INFO ] [MAIN ] CXH: Loaded 4406 existing records. [2025-10-27T18:12:21.633979] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:21.634166] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-27T18:12:21.634214] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-27T18:12:21.634340] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-27T18:12:21.634377] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-27T18:12:22.000701] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:22.014904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-27T18:12:22.189855] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:12:22.814943] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-27T18:12:23.027113] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:12:23.614948] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-27T18:12:24.414947] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-27T18:12:24.511893] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:12:24.942939] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T18:12:25.079751] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:12:25.214931] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-27T18:12:26.014919] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-27T18:12:26.322461] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:12:26.455239] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:12:26.814971] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-27T18:12:27.332569] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:12:27.614961] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-27T18:12:28.414918] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-27T18:12:28.761581] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:12:28.778162] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T18:12:29.214966] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-27T18:12:29.734922] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:12:30.014942] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-27T18:12:30.814955] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-27T18:12:31.071956] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T18:12:31.077754] [INFO ] [REMOTE ] CWT: Full fetch complete (41331 records). [2025-10-27T18:12:31.077867] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-27T18:12:31.447335] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-27T18:12:31.447420] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-27T18:12:31.448006] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-27T18:12:31.448068] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-27T18:12:31.448963] [DEBUG] [LOCAL ] CWT: Trimmed 41331 records to 27782 (keeping 200 days of data) [2025-10-27T18:12:31.607747] [DEBUG] [LOCAL ] CWT: Primary data saved (27782 records). [2025-10-27T18:12:31.607875] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-27T18:12:31.607967] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CWT took 31.6s. Estimated remaining: 3h 45m 45s. Rate: 7.9 symbols/min [2025-10-27T18:12:31.620806] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-27T18:12:31.781688] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:31.821601] [DEBUG] [LOCAL ] CXM: Loaded 47965 existing records from primary storage. [2025-10-27T18:12:31.821915] [INFO ] [MAIN ] CXM: Loaded 47965 existing records. [2025-10-27T18:12:32.004527] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:32.004760] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-27T18:12:32.004811] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-27T18:12:32.005004] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-27T18:12:32.005062] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-27T18:12:32.289773] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T18:12:32.369211] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:32.414899] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-27T18:12:32.703842] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:12:33.214985] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-27T18:12:33.490589] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:12:33.763536] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T18:12:34.014966] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-27T18:12:34.432259] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:12:34.814943] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-27T18:12:35.615026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-27T18:12:35.966592] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:12:36.414976] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-27T18:12:36.446634] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:12:37.115874] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T18:12:37.214968] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-27T18:12:38.014969] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-27T18:12:38.498230] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T18:12:38.708580] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:12:38.815004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-27T18:12:39.614936] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-27T18:12:39.900545] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T18:12:40.415000] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-27T18:12:41.038116] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:12:41.214962] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-27T18:12:41.584421] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-27T18:12:42.014996] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-27T18:12:42.500051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:12:42.814995] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-27T18:12:43.205708] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T18:12:43.614925] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-27T18:12:43.949412] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:12:43.959604] [INFO ] [REMOTE ] CX: Full fetch complete (76553 records). [2025-10-27T18:12:43.959767] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-27T18:12:44.352782] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-27T18:12:44.352865] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-27T18:12:44.353835] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-27T18:12:44.353900] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-27T18:12:44.355380] [DEBUG] [LOCAL ] CX: Trimmed 76553 records to 52770 (keeping 200 days of data) [2025-10-27T18:12:44.449787] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-27T18:12:44.494588] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:12:44.694353] [DEBUG] [LOCAL ] CX: Primary data saved (52770 records). [2025-10-27T18:12:44.694502] [INFO ] [MAIN ] CX: Full history saved. [2025-10-27T18:12:44.695266] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CX took 36.5s. Estimated remaining: 3h 45m 55s. Rate: 7.9 symbols/min [2025-10-27T18:12:44.863701] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:44.896201] [DEBUG] [LOCAL ] CXT: Loaded 31071 existing records from primary storage. [2025-10-27T18:12:44.896500] [INFO ] [MAIN ] CXT: Loaded 31071 existing records. [2025-10-27T18:12:45.077148] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:45.077338] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-27T18:12:45.077385] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-27T18:12:45.077584] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-27T18:12:45.077664] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-27T18:12:45.220131] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-27T18:12:45.274284] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:12:45.442104] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:45.849595] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:12:45.851329] [INFO ] [REMOTE ] CXE: Full fetch complete (11016 records). [2025-10-27T18:12:45.851397] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-27T18:12:46.020828] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-27T18:12:46.204138] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-27T18:12:46.204209] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-27T18:12:46.204459] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-27T18:12:46.204495] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-27T18:12:46.204928] [DEBUG] [LOCAL ] CXE: Trimmed 11016 records to 6300 (keeping 200 days of data) [2025-10-27T18:12:46.239741] [DEBUG] [LOCAL ] CXE: Primary data saved (6300 records). [2025-10-27T18:12:46.239821] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-27T18:12:46.239892] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXE took 26.5s. Estimated remaining: 3h 45m 28s. Rate: 7.9 symbols/min [2025-10-27T18:12:46.408180] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:46.447274] [DEBUG] [LOCAL ] CXW: Loaded 44181 existing records from primary storage. [2025-10-27T18:12:46.447580] [INFO ] [MAIN ] CXW: Loaded 44181 existing records. [2025-10-27T18:12:46.621039] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:46.621245] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-27T18:12:46.621339] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-27T18:12:46.621517] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-27T18:12:46.621554] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-27T18:12:46.822345] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-27T18:12:46.968089] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:47.572363] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:12:47.614895] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-27T18:12:47.960193] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:12:48.414947] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-27T18:12:48.509134] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:12:49.214954] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-27T18:12:49.463206] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T18:12:50.014953] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-27T18:12:50.437929] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:12:50.814956] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-27T18:12:51.179941] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T18:12:51.220444] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T18:12:51.615000] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-27T18:12:52.415002] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-27T18:12:52.957749] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:12:53.214920] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-27T18:12:53.484621] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:12:54.014939] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-27T18:12:54.698863] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T18:12:54.814927] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-27T18:12:55.294090] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T18:12:55.294196] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T18:12:55.301952] [INFO ] [REMOTE ] CXH: Full fetch complete (5303 records). [2025-10-27T18:12:55.302147] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-27T18:12:55.620096] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-27T18:12:55.661381] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-27T18:12:55.661454] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-27T18:12:55.661625] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-27T18:12:55.661710] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-27T18:12:55.662107] [DEBUG] [LOCAL ] CXH: Trimmed 5303 records to 4349 (keeping 200 days of data) [2025-10-27T18:12:55.687081] [DEBUG] [LOCAL ] CXH: Primary data saved (4349 records). [2025-10-27T18:12:55.687194] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-27T18:12:55.687273] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXH took 34.5s. Estimated remaining: 3h 45m 27s. Rate: 7.9 symbols/min [2025-10-27T18:12:55.858298] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:55.884152] [DEBUG] [LOCAL ] CYD: Loaded 27715 existing records from primary storage. [2025-10-27T18:12:55.884406] [INFO ] [MAIN ] CYD: Loaded 27715 existing records. [2025-10-27T18:12:56.066825] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:56.067046] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-27T18:12:56.067104] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-27T18:12:56.067288] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-27T18:12:56.067326] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-27T18:12:56.421272] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:12:56.417720] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-27T18:12:56.940461] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:12:57.214940] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-27T18:12:57.585954] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:12:58.014941] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-27T18:12:58.384269] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T18:12:58.392821] [INFO ] [REMOTE ] CXM: Full fetch complete (68382 records). [2025-10-27T18:12:58.392957] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-27T18:12:58.770301] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-27T18:12:58.770377] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-27T18:12:58.771169] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-27T18:12:58.771230] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-27T18:12:58.772499] [DEBUG] [LOCAL ] CXM: Trimmed 68382 records to 47108 (keeping 200 days of data) [2025-10-27T18:12:58.817324] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-27T18:12:59.035076] [DEBUG] [LOCAL ] CXM: Primary data saved (47108 records). [2025-10-27T18:12:59.035197] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-27T18:12:59.035283] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXM took 27.4s. Estimated remaining: 3h 45m 6s. Rate: 7.9 symbols/min [2025-10-27T18:12:59.203307] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:12:59.242229] [DEBUG] [LOCAL ] CYH: Loaded 48377 existing records from primary storage. [2025-10-27T18:12:59.242518] [INFO ] [MAIN ] CYH: Loaded 48377 existing records. [2025-10-27T18:12:59.446352] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:12:59.446675] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-27T18:12:59.446805] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-27T18:12:59.447217] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-27T18:12:59.447326] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-27T18:12:59.556826] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:12:59.577212] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T18:12:59.622243] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-27T18:12:59.842164] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:00.414939] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-27T18:13:01.214954] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-27T18:13:01.595424] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T18:13:02.014949] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-27T18:13:02.814974] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-27T18:13:04.412867] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T18:13:04.420096] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-27T18:13:04.829460] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T18:13:04.834490] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-27T18:13:04.874972] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-10-27T18:13:04.916552] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (4.50 seconds). [2025-10-27T18:13:05.214953] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-27T18:13:05.804442] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:13:06.010475] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:13:06.016789] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-27T18:13:06.409165] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:13:06.814962] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-27T18:13:07.356959] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:13:07.614983] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-27T18:13:08.414959] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-27T18:13:08.518759] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:13:09.182017] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:13:09.188638] [INFO ] [REMOTE ] CXT: Full fetch complete (45576 records). [2025-10-27T18:13:09.188862] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-27T18:13:09.221172] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-27T18:13:09.591523] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-27T18:13:09.601398] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-27T18:13:09.603304] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:13:09.602472] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-27T18:13:09.608993] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-27T18:13:09.610556] [DEBUG] [LOCAL ] CXT: Trimmed 45576 records to 30425 (keeping 200 days of data) [2025-10-27T18:13:09.791886] [DEBUG] [LOCAL ] CXT: Primary data saved (30425 records). [2025-10-27T18:13:09.792031] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-27T18:13:09.792111] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CXT took 25.1s. Estimated remaining: 3h 45m 8s. Rate: 7.9 symbols/min [2025-10-27T18:13:09.957688] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:10.009884] [DEBUG] [LOCAL ] D: Loaded 54429 existing records from primary storage. [2025-10-27T18:13:10.010247] [INFO ] [MAIN ] D: Loaded 54429 existing records. [2025-10-27T18:13:10.021357] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-27T18:13:10.206857] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:10.207103] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-27T18:13:10.207163] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-27T18:13:10.207351] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-27T18:13:10.207390] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-27T18:13:10.564062] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:10.814952] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-27T18:13:10.860381] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:13:11.614980] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-27T18:13:11.711269] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:13:11.933991] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:13:12.414969] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-27T18:13:13.214961] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-27T18:13:13.282411] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:13:13.753408] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:13:14.014966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-27T18:13:14.814970] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-27T18:13:14.915819] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:13:15.521489] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:13:15.615117] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-27T18:13:15.662687] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:13:16.414971] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-27T18:13:16.822443] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:13:17.214974] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-27T18:13:17.797198] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:13:18.015017] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-27T18:13:18.484068] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:13:18.814994] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-27T18:13:19.382384] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:13:19.614973] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-27T18:13:19.960312] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:13:20.414992] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-27T18:13:21.215005] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-27T18:13:21.334274] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T18:13:21.595440] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:13:22.015055] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-27T18:13:22.814948] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-27T18:13:22.838240] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T18:13:22.846462] [INFO ] [REMOTE ] CXW: Full fetch complete (64636 records). [2025-10-27T18:13:22.846581] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-27T18:13:23.275866] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:13:23.279365] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-27T18:13:23.285533] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-27T18:13:23.287019] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-27T18:13:23.287098] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-27T18:13:23.289015] [DEBUG] [LOCAL ] CXW: Trimmed 64636 records to 43394 (keeping 200 days of data) [2025-10-27T18:13:23.535484] [DEBUG] [LOCAL ] CXW: Primary data saved (43394 records). [2025-10-27T18:13:23.535603] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-27T18:13:23.535699] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CXW took 37.3s. Estimated remaining: 3h 45m 20s. Rate: 7.9 symbols/min [2025-10-27T18:13:23.620137] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-27T18:13:23.706942] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:23.719200] [DEBUG] [LOCAL ] DAC: Loaded 12491 existing records from primary storage. [2025-10-27T18:13:23.719436] [INFO ] [MAIN ] DAC: Loaded 12491 existing records. [2025-10-27T18:13:23.900175] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:23.900404] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-27T18:13:23.900471] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-27T18:13:23.900634] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-27T18:13:23.900720] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-27T18:13:24.261743] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:24.414948] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-27T18:13:24.822206] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:13:25.058165] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T18:13:25.214958] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-27T18:13:25.338127] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:13:26.014950] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-27T18:13:26.656724] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:13:26.814931] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-27T18:13:26.891603] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T18:13:27.614978] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-27T18:13:27.928113] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T18:13:27.934264] [INFO ] [REMOTE ] CYD: Full fetch complete (36512 records). [2025-10-27T18:13:27.934341] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-27T18:13:28.311363] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-27T18:13:28.311440] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-27T18:13:28.312024] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-27T18:13:28.312089] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-27T18:13:28.312944] [DEBUG] [LOCAL ] CYD: Trimmed 36512 records to 27069 (keeping 200 days of data) [2025-10-27T18:13:28.416379] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-27T18:13:28.476398] [DEBUG] [LOCAL ] CYD: Primary data saved (27069 records). [2025-10-27T18:13:28.476548] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-27T18:13:28.476672] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CYD took 32.8s. Estimated remaining: 3h 45m 4s. Rate: 7.9 symbols/min [2025-10-27T18:13:28.650810] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:28.703115] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-27T18:13:28.703443] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-10-27T18:13:28.882562] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:28.882774] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-27T18:13:28.882823] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-27T18:13:28.883011] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-27T18:13:28.883051] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-27T18:13:29.220634] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-27T18:13:29.251776] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:29.454862] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:13:29.887124] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T18:13:30.015001] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-27T18:13:30.152390] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T18:13:30.674730] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T18:13:30.814936] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-27T18:13:31.614941] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-27T18:13:32.414925] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-27T18:13:32.476353] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:13:33.214931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-27T18:13:33.465026] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T18:13:33.465378] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T18:13:34.014955] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-27T18:13:34.533697] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T18:13:34.814931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-27T18:13:35.580778] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:13:35.614949] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-27T18:13:35.904108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:13:36.414931] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-27T18:13:36.557449] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:13:37.214967] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-27T18:13:37.603899] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T18:13:37.615486] [INFO ] [REMOTE ] CYH: Full fetch complete (69881 records). [2025-10-27T18:13:37.615638] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-27T18:13:38.016030] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-27T18:13:38.055625] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-27T18:13:38.055744] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-27T18:13:38.056606] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-27T18:13:38.056817] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-27T18:13:38.058152] [DEBUG] [LOCAL ] CYH: Trimmed 69881 records to 47628 (keeping 200 days of data) [2025-10-27T18:13:38.324366] [DEBUG] [LOCAL ] CYH: Primary data saved (47628 records). [2025-10-27T18:13:38.324604] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-27T18:13:38.324736] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. CYH took 39.3s. Estimated remaining: 3h 45m 4s. Rate: 7.9 symbols/min [2025-10-27T18:13:38.498359] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:38.539740] [DEBUG] [LOCAL ] DAN: Loaded 50100 existing records from primary storage. [2025-10-27T18:13:38.540037] [INFO ] [MAIN ] DAN: Loaded 50100 existing records. [2025-10-27T18:13:38.713554] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:38.713890] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-27T18:13:38.713976] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-27T18:13:38.714448] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-27T18:13:38.714561] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-27T18:13:38.819691] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-27T18:13:39.003201] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T18:13:39.083527] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:39.113300] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:13:39.614987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-27T18:13:40.415018] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-27T18:13:40.629484] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:13:40.893039] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T18:13:40.902536] [INFO ] [REMOTE ] D: Full fetch complete (77422 records). [2025-10-27T18:13:40.902664] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-27T18:13:40.903418] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:13:40.903504] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:13:40.903546] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:13:40.903610] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-27T18:13:40.903707] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-27T18:13:40.903768] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-27T18:13:40.903896] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-27T18:13:40.904551] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. D took 31.1s. Estimated remaining: 3h 44m 41s. Rate: 7.9 symbols/min [2025-10-27T18:13:41.077449] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:41.096182] [DEBUG] [LOCAL ] DAO: Loaded 20203 existing records from primary storage. [2025-10-27T18:13:41.096406] [INFO ] [MAIN ] DAO: Loaded 20203 existing records. [2025-10-27T18:13:41.217707] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-27T18:13:41.275588] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:41.275955] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-27T18:13:41.276092] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-27T18:13:41.276275] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-27T18:13:41.276331] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-27T18:13:41.477197] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:13:41.663274] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:41.813592] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:13:42.014954] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-27T18:13:42.814938] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-27T18:13:43.102764] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T18:13:43.614923] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-27T18:13:43.667559] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:13:44.414943] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-27T18:13:45.214959] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-27T18:13:45.274683] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:13:45.277801] [INFO ] [REMOTE ] DAC: Full fetch complete (18950 records). [2025-10-27T18:13:45.277885] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-27T18:13:45.422520] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:13:45.672632] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-27T18:13:45.672751] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-27T18:13:45.673138] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-27T18:13:45.673177] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-27T18:13:45.673715] [DEBUG] [LOCAL ] DAC: Trimmed 18950 records to 11984 (keeping 200 days of data) [2025-10-27T18:13:45.743600] [DEBUG] [LOCAL ] DAC: Primary data saved (11984 records). [2025-10-27T18:13:45.743754] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-27T18:13:45.743836] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAC took 22.2s. Estimated remaining: 3h 44m 25s. Rate: 7.9 symbols/min [2025-10-27T18:13:45.907105] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:13:45.951918] [DEBUG] [LOCAL ] DAR: Loaded 52770 existing records from primary storage. [2025-10-27T18:13:45.952212] [INFO ] [MAIN ] DAR: Loaded 52770 existing records. [2025-10-27T18:13:46.024620] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-27T18:13:46.128896] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:13:46.129067] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-27T18:13:46.129112] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-27T18:13:46.129358] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-27T18:13:46.129396] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-27T18:13:46.492551] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:13:46.492081] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:13:46.814992] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-27T18:13:47.626465] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-27T18:13:47.629462] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:13:48.414975] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-27T18:13:48.469446] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:13:48.663735] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:13:49.214947] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-27T18:13:50.014969] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-27T18:13:50.205197] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:13:50.231202] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T18:13:50.814941] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-27T18:13:51.182081] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:13:51.614980] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-27T18:13:52.381367] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T18:13:52.414897] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-27T18:13:52.662528] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:13:53.214940] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-27T18:13:53.942223] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T18:13:54.014900] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-27T18:13:54.098876] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:13:54.814947] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-27T18:13:55.324478] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:13:55.614918] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-27T18:13:56.162364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T18:13:56.414994] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-27T18:13:57.118365] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:13:57.214937] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-27T18:13:57.753249] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T18:13:57.781515] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T18:13:58.014950] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-27T18:13:58.814922] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-27T18:13:59.055710] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:13:59.614940] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-27T18:14:00.165741] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:14:00.414951] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-27T18:14:01.214942] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-27T18:14:02.014953] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-27T18:14:02.263228] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-27T18:14:02.814969] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-27T18:14:04.386082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-27T18:14:04.391318] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-27T18:14:04.869789] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (4.45 seconds). [2025-10-27T18:14:04.882255] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-27T18:14:05.619902] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-27T18:14:05.630372] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-27T18:14:06.274023] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (5.06 seconds). [2025-10-27T18:14:06.285072] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-27T18:14:06.371553] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:14:06.376055] [INFO ] [REMOTE ] DAO: Full fetch complete (32700 records). [2025-10-27T18:14:06.376131] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-27T18:14:06.770093] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-27T18:14:06.770171] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-27T18:14:06.770668] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-27T18:14:06.770732] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-27T18:14:06.771409] [DEBUG] [LOCAL ] DAO: Trimmed 32700 records to 19588 (keeping 200 days of data) [2025-10-27T18:14:06.896455] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T18:14:06.916084] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-27T18:14:06.920832] [DEBUG] [LOCAL ] DAO: Primary data saved (19588 records). [2025-10-27T18:14:06.921076] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-27T18:14:06.921225] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAO took 26.0s. Estimated remaining: 3h 44m 59s. Rate: 7.9 symbols/min [2025-10-27T18:14:07.100713] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:07.138862] [DEBUG] [LOCAL ] DAVA: Loaded 42531 existing records from primary storage. [2025-10-27T18:14:07.139279] [INFO ] [MAIN ] DAVA: Loaded 42531 existing records. [2025-10-27T18:14:07.282252] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T18:14:07.369871] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:07.370065] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-27T18:14:07.370111] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-27T18:14:07.370328] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-27T18:14:07.370365] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-27T18:14:07.621458] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-27T18:14:07.733612] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:08.417246] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-27T18:14:08.420562] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T18:14:08.661223] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T18:14:09.184918] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:14:09.194388] [INFO ] [REMOTE ] DAN: Full fetch complete (71396 records). [2025-10-27T18:14:09.194499] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-27T18:14:09.225757] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-27T18:14:09.623294] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-27T18:14:09.623456] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-27T18:14:09.624364] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-27T18:14:09.624451] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-27T18:14:09.645769] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T18:14:09.652286] [DEBUG] [LOCAL ] DAN: Trimmed 71396 records to 49315 (keeping 200 days of data) [2025-10-27T18:14:09.936402] [DEBUG] [LOCAL ] DAN: Primary data saved (49315 records). [2025-10-27T18:14:09.936525] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-27T18:14:09.936597] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAN took 31.6s. Estimated remaining: 3h 44m 37s. Rate: 7.9 symbols/min [2025-10-27T18:14:10.020094] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-27T18:14:10.108853] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:10.151422] [DEBUG] [LOCAL ] DAY: Loaded 49840 existing records from primary storage. [2025-10-27T18:14:10.151760] [INFO ] [MAIN ] DAY: Loaded 49840 existing records. [2025-10-27T18:14:10.329820] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:10.330033] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-27T18:14:10.330082] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-27T18:14:10.330289] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-27T18:14:10.330345] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-27T18:14:10.699046] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:10.814932] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-27T18:14:11.081531] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:14:11.599303] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:14:11.614919] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-27T18:14:12.414947] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-27T18:14:12.482284] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:14:13.214958] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-27T18:14:13.933898] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:14:14.014935] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-27T18:14:14.114553] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-27T18:14:14.124464] [INFO ] [REMOTE ] DAR: Full fetch complete (75206 records). [2025-10-27T18:14:14.124604] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-27T18:14:14.539029] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-27T18:14:14.539155] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-27T18:14:14.540085] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-27T18:14:14.540161] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-27T18:14:14.541906] [DEBUG] [LOCAL ] DAR: Trimmed 75206 records to 51980 (keeping 200 days of data) [2025-10-27T18:14:14.676716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T18:14:14.696728] [INFO ] [REMOTE ] DAL: Full fetch complete (77541 records). [2025-10-27T18:14:14.696899] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-27T18:14:14.698293] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:14:14.761414] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:14:14.796867] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:14:14.810817] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-27T18:14:14.811520] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-27T18:14:14.813231] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-10-27T18:14:14.813712] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-10-27T18:14:14.817380] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAL took 46.3s. Estimated remaining: 3h 44m 22s. Rate: 7.9 symbols/min [2025-10-27T18:14:14.816662] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-27T18:14:15.101577] [DEBUG] [LOCAL ] DAR: Primary data saved (51980 records). [2025-10-27T18:14:15.096757] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:15.101956] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-27T18:14:15.102536] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAR took 29.4s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-27T18:14:15.124931] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T18:14:15.288169] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:15.328149] [DEBUG] [LOCAL ] DB: Loaded 53198 existing records from primary storage. [2025-10-27T18:14:15.328522] [INFO ] [MAIN ] DB: Loaded 53198 existing records. [2025-10-27T18:14:15.439543] [DEBUG] [LOCAL ] DBD: Loaded 24906 existing records from primary storage. [2025-10-27T18:14:15.440088] [INFO ] [MAIN ] DBD: Loaded 24906 existing records. [2025-10-27T18:14:15.621088] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-27T18:14:15.624383] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:15.629855] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-27T18:14:15.640995] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-27T18:14:15.665708] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-27T18:14:15.679625] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-27T18:14:15.740766] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:15.783084] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-27T18:14:15.806496] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-27T18:14:15.823931] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-10-27T18:14:15.834355] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-27T18:14:16.379959] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:16.417765] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-27T18:14:16.471215] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:16.490593] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:14:16.993812] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:14:17.214964] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-27T18:14:17.944881] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:14:18.014911] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-27T18:14:18.063455] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T18:14:18.814963] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-27T18:14:19.453817] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:14:19.477815] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:14:19.614923] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-27T18:14:20.414979] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-27T18:14:20.661107] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T18:14:21.214965] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-27T18:14:21.750155] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:14:22.020236] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-27T18:14:22.028585] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:14:22.814942] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-27T18:14:23.248701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T18:14:23.614969] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-27T18:14:24.275220] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:14:24.326942] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:14:24.414980] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-27T18:14:25.214945] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-27T18:14:25.883597] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:14:26.014953] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-27T18:14:26.804700] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:14:26.814899] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-27T18:14:27.597511] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:14:27.614894] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-27T18:14:28.394310] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:14:28.414901] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-27T18:14:28.541620] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T18:14:29.214976] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-27T18:14:30.014923] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-27T18:14:30.278397] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:14:30.583859] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:14:30.815230] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-27T18:14:31.032238] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:14:31.615039] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-27T18:14:32.155027] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:14:32.414987] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-27T18:14:32.672530] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:14:33.215017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-27T18:14:33.829873] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:14:34.014933] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-27T18:14:34.775325] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T18:14:34.814968] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-27T18:14:34.941761] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:14:35.614954] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-27T18:14:36.414920] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-27T18:14:36.602682] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:14:36.702368] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T18:14:37.214936] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-27T18:14:37.648249] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T18:14:38.014913] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-27T18:14:38.261683] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:14:38.814965] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-27T18:14:39.360262] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T18:14:39.614931] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-27T18:14:40.414944] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-27T18:14:40.632601] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T18:14:40.980785] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:14:40.989785] [INFO ] [REMOTE ] DAVA: Full fetch complete (57407 records). [2025-10-27T18:14:40.989932] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-27T18:14:41.220026] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-27T18:14:41.341630] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T18:14:41.381831] [INFO ] [REMOTE ] DBD: Full fetch complete (32137 records). [2025-10-27T18:14:41.398301] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-27T18:14:41.417618] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-27T18:14:41.418099] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-27T18:14:41.418015] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:14:41.418937] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-27T18:14:41.419018] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-27T18:14:41.419193] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:14:41.419264] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:14:41.419333] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-27T18:14:41.419555] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-27T18:14:41.419663] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-27T18:14:41.419910] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-10-27T18:14:41.420030] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DBD took 26.3s. Estimated remaining: 3h 44m 41s. Rate: 7.9 symbols/min [2025-10-27T18:14:41.451870] [DEBUG] [LOCAL ] DAVA: Trimmed 57407 records to 41895 (keeping 200 days of data) [2025-10-27T18:14:41.712295] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:41.862946] [DEBUG] [LOCAL ] DAVA: Primary data saved (41895 records). [2025-10-27T18:14:41.863072] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-27T18:14:41.863964] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DAVA took 34.9s. Estimated remaining: 3h 44m 12s. Rate: 7.9 symbols/min [2025-10-27T18:14:41.896312] [DEBUG] [LOCAL ] DBI: Loaded 43873 existing records from primary storage. [2025-10-27T18:14:41.933822] [INFO ] [MAIN ] DBI: Loaded 43873 existing records. [2025-10-27T18:14:42.029117] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-27T18:14:42.195749] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:42.225159] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:42.225431] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-27T18:14:42.225478] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-27T18:14:42.225729] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-27T18:14:42.225785] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-27T18:14:42.332151] [DEBUG] [LOCAL ] DBL: Loaded 9473 existing records from primary storage. [2025-10-27T18:14:42.343081] [INFO ] [MAIN ] DBL: Loaded 9473 existing records. [2025-10-27T18:14:42.693999] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:42.694430] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-27T18:14:42.694511] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-27T18:14:42.705161] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-27T18:14:42.715421] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-27T18:14:42.895434] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:42.900879] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-27T18:14:43.135329] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:43.285112] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T18:14:43.295101] [INFO ] [REMOTE ] DB: Full fetch complete (75710 records). [2025-10-27T18:14:43.295222] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-27T18:14:43.621748] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-27T18:14:43.678830] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-27T18:14:43.679066] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-27T18:14:43.680042] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-27T18:14:43.680105] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-27T18:14:43.681463] [DEBUG] [LOCAL ] DB: Trimmed 75710 records to 52404 (keeping 200 days of data) [2025-10-27T18:14:43.988167] [DEBUG] [LOCAL ] DB: Primary data saved (52404 records). [2025-10-27T18:14:43.988282] [INFO ] [MAIN ] DB: Full history saved. [2025-10-27T18:14:43.988770] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DB took 29.2s. Estimated remaining: 3h 43m 48s. Rate: 7.9 symbols/min [2025-10-27T18:14:44.168300] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T18:14:44.197259] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:44.247229] [DEBUG] [LOCAL ] DBRG: Loaded 50733 existing records from primary storage. [2025-10-27T18:14:44.247512] [INFO ] [MAIN ] DBRG: Loaded 50733 existing records. [2025-10-27T18:14:44.426816] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:44.427341] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-27T18:14:44.427402] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-27T18:14:44.423777] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-27T18:14:44.428174] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-27T18:14:44.428232] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-27T18:14:44.532409] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:14:44.754932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:14:44.846984] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:45.214993] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-27T18:14:45.706114] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:14:45.744756] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:14:46.014934] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-27T18:14:46.814998] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-27T18:14:47.325768] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:14:47.614973] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-27T18:14:47.909585] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:14:47.918521] [INFO ] [REMOTE ] DAY: Full fetch complete (71898 records). [2025-10-27T18:14:47.918628] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-27T18:14:48.290977] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T18:14:48.315418] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-27T18:14:48.315489] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-27T18:14:48.316291] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-27T18:14:48.316353] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-27T18:14:48.317625] [DEBUG] [LOCAL ] DAY: Trimmed 71898 records to 49047 (keeping 200 days of data) [2025-10-27T18:14:48.414922] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-27T18:14:48.597381] [DEBUG] [LOCAL ] DAY: Primary data saved (49047 records). [2025-10-27T18:14:48.597516] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-27T18:14:48.597614] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DAY took 38.7s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-10-27T18:14:48.764510] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:48.798351] [DEBUG] [LOCAL ] DCI: Loaded 37402 existing records from primary storage. [2025-10-27T18:14:48.798623] [INFO ] [MAIN ] DCI: Loaded 37402 existing records. [2025-10-27T18:14:48.988370] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:48.988571] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-27T18:14:48.988617] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-27T18:14:48.988814] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-27T18:14:48.988863] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-27T18:14:49.220128] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-27T18:14:49.349216] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:50.014904] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-27T18:14:50.103968] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:14:50.679030] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:14:50.814946] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-27T18:14:51.279749] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:14:51.614992] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-27T18:14:52.225723] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T18:14:52.414997] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-27T18:14:52.670486] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:14:53.149609] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:14:53.214917] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-27T18:14:53.848383] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:14:54.014905] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-27T18:14:54.814932] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-27T18:14:55.156828] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:14:55.347446] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T18:14:55.614924] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-27T18:14:56.414941] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-27T18:14:56.885676] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T18:14:57.121279] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:14:57.214929] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-27T18:14:58.014946] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-27T18:14:58.073544] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T18:14:58.075666] [INFO ] [REMOTE ] DBL: Full fetch complete (12810 records). [2025-10-27T18:14:58.075739] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-27T18:14:58.430110] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-27T18:14:58.430185] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-27T18:14:58.430475] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-27T18:14:58.430512] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-27T18:14:58.430987] [DEBUG] [LOCAL ] DBL: Trimmed 12810 records to 9267 (keeping 200 days of data) [2025-10-27T18:14:58.486411] [DEBUG] [LOCAL ] DBL: Primary data saved (9267 records). [2025-10-27T18:14:58.486533] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-27T18:14:58.486607] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBL took 16.6s. Estimated remaining: 3h 43m 31s. Rate: 7.9 symbols/min [2025-10-27T18:14:58.652538] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:14:58.670693] [DEBUG] [LOCAL ] DCO: Loaded 15231 existing records from primary storage. [2025-10-27T18:14:58.670930] [INFO ] [MAIN ] DCO: Loaded 15231 existing records. [2025-10-27T18:14:58.820087] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-27T18:14:58.848438] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:14:58.848780] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-27T18:14:58.848839] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-27T18:14:58.848995] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-27T18:14:58.849034] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-27T18:14:59.229908] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:14:59.290372] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:14:59.614984] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-27T18:15:00.414991] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-27T18:15:00.501436] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:15:01.214935] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-27T18:15:01.601051] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:15:02.014925] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-27T18:15:02.814959] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-27T18:15:03.936024] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (3.52 seconds). [2025-10-27T18:15:03.938625] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-27T18:15:04.886932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (3.67 seconds). [2025-10-27T18:15:04.898371] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-27T18:15:04.982084] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:15:05.214979] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-27T18:15:05.554560] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (3.54 seconds). [2025-10-27T18:15:06.014946] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-27T18:15:06.129614] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-10-27T18:15:06.504926] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:15:06.522246] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T18:15:06.814952] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-27T18:15:07.379879] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T18:15:07.614937] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-27T18:15:08.311171] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-27T18:15:08.414904] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-27T18:15:09.214930] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-27T18:15:09.269987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T18:15:09.888896] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:15:10.014955] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-27T18:15:10.353511] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T18:15:10.814944] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-27T18:15:11.348551] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:15:11.615009] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-27T18:15:12.414980] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-27T18:15:12.495136] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:15:13.214957] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-27T18:15:13.292286] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:15:13.411196] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:15:14.014988] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-27T18:15:14.134326] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:15:14.814953] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-27T18:15:15.491688] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:15:15.614939] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-27T18:15:16.034042] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T18:15:16.041272] [INFO ] [REMOTE ] DBI: Full fetch complete (64528 records). [2025-10-27T18:15:16.041439] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-27T18:15:16.424606] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-27T18:15:16.445831] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-27T18:15:16.445911] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-27T18:15:16.446729] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-27T18:15:16.446793] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-27T18:15:16.448062] [DEBUG] [LOCAL ] DBI: Trimmed 64528 records to 43009 (keeping 200 days of data) [2025-10-27T18:15:16.689768] [DEBUG] [LOCAL ] DBI: Primary data saved (43009 records). [2025-10-27T18:15:16.689893] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-27T18:15:16.689969] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DBI took 35.3s. Estimated remaining: 3h 43m 55s. Rate: 7.9 symbols/min [2025-10-27T18:15:16.864010] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:16.931819] [DEBUG] [LOCAL ] DD: Loaded 53685 existing records from primary storage. [2025-10-27T18:15:16.932618] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:15:16.940680] [INFO ] [MAIN ] DD: Loaded 53685 existing records. [2025-10-27T18:15:17.112480] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:17.112705] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-27T18:15:17.112761] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-27T18:15:17.112968] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-27T18:15:17.113023] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-27T18:15:17.220131] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-27T18:15:17.464703] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:17.570894] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:15:18.014978] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-27T18:15:18.232889] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:15:18.815023] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-27T18:15:19.480106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:15:19.614939] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-27T18:15:20.192559] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:15:20.414949] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-27T18:15:21.218562] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-27T18:15:21.221354] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T18:15:22.007954] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T18:15:22.017685] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-27T18:15:22.265180] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T18:15:22.814935] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-27T18:15:23.371713] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:15:23.378429] [INFO ] [REMOTE ] DCI: Full fetch complete (53773 records). [2025-10-27T18:15:23.378514] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-27T18:15:23.620182] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-27T18:15:23.756999] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-27T18:15:23.757100] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-27T18:15:23.757857] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-27T18:15:23.757918] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-27T18:15:23.758951] [DEBUG] [LOCAL ] DCI: Trimmed 53773 records to 36620 (keeping 200 days of data) [2025-10-27T18:15:23.965754] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:15:23.990081] [DEBUG] [LOCAL ] DCI: Primary data saved (36620 records). [2025-10-27T18:15:23.990544] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-27T18:15:23.990632] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 35.4s. Estimated remaining: 3h 43m 47s. Rate: 7.9 symbols/min [2025-10-27T18:15:24.153256] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:24.198635] [DEBUG] [LOCAL ] DDD: Loaded 51686 existing records from primary storage. [2025-10-27T18:15:24.198947] [INFO ] [MAIN ] DDD: Loaded 51686 existing records. [2025-10-27T18:15:24.374340] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:24.374552] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-27T18:15:24.374607] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-27T18:15:24.374808] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-27T18:15:24.374861] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-27T18:15:24.420136] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-27T18:15:24.720574] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:25.214936] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-27T18:15:25.565845] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:15:25.717546] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:15:25.727463] [INFO ] [REMOTE ] DBRG: Full fetch complete (72626 records). [2025-10-27T18:15:25.727591] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-27T18:15:26.020059] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-27T18:15:26.119179] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-27T18:15:26.119266] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-27T18:15:26.120168] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-27T18:15:26.120239] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-27T18:15:26.121807] [DEBUG] [LOCAL ] DBRG: Trimmed 72626 records to 49964 (keeping 200 days of data) [2025-10-27T18:15:26.413862] [DEBUG] [LOCAL ] DBRG: Primary data saved (49964 records). [2025-10-27T18:15:26.413983] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-27T18:15:26.414412] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DBRG took 42.4s. Estimated remaining: 3h 43m 24s. Rate: 7.9 symbols/min [2025-10-27T18:15:26.814943] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-27T18:15:26.854328] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T18:15:27.361691] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:15:27.365597] [INFO ] [REMOTE ] DCO: Full fetch complete (19739 records). [2025-10-27T18:15:27.365731] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-27T18:15:27.366167] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:15:27.366249] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:15:27.366290] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:15:27.366355] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-27T18:15:27.366418] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-27T18:15:27.366452] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-27T18:15:27.366613] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-27T18:15:27.366737] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DCO took 28.9s. Estimated remaining: 3h 42m 56s. Rate: 7.9 symbols/min [2025-10-27T18:15:27.614934] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-27T18:15:28.814821] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T18:15:28.824576] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-27T18:15:29.185253] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:15:29.214988] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-27T18:15:30.460263] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:15:30.469710] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-27T18:15:30.647939] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T18:15:30.814998] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-27T18:15:31.938547] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:15:31.949432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-27T18:15:32.108381] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:15:32.415056] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-27T18:15:33.472225] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:15:33.482729] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-27T18:15:33.878830] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:15:34.014989] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-27T18:15:35.305668] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T18:15:35.316871] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-27T18:15:35.877534] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:15:35.888682] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-27T18:15:36.672976] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:15:36.683276] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-27T18:15:37.836277] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:15:37.847603] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-27T18:15:38.167230] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:15:38.178047] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-27T18:15:38.378806] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:15:38.389603] [INFO ] [REMOTE ] DD: Full fetch complete (76619 records). [2025-10-27T18:15:38.389813] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-27T18:15:38.792196] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-27T18:15:38.792290] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-27T18:15:38.793216] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-27T18:15:38.793310] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-27T18:15:38.794860] [DEBUG] [LOCAL ] DD: Trimmed 76619 records to 52906 (keeping 200 days of data) [2025-10-27T18:15:39.109739] [DEBUG] [LOCAL ] DD: Primary data saved (52906 records). [2025-10-27T18:15:39.109875] [INFO ] [MAIN ] DD: Full history saved. [2025-10-27T18:15:39.109952] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DD took 22.4s. Estimated remaining: 3h 43m 1s. Rate: 7.9 symbols/min [2025-10-27T18:15:39.839790] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:15:39.850288] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-27T18:15:41.156606] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T18:15:41.167432] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-27T18:15:43.011361] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T18:15:43.021549] [INFO ] [REMOTE ] DDD: Full fetch complete (74003 records). [2025-10-27T18:15:43.021761] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-27T18:15:43.409096] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-27T18:15:43.409180] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-27T18:15:43.409999] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-27T18:15:43.410067] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-27T18:15:43.411473] [DEBUG] [LOCAL ] DDD: Trimmed 74003 records to 50909 (keeping 200 days of data) [2025-10-27T18:15:43.692955] [DEBUG] [LOCAL ] DDD: Primary data saved (50909 records). [2025-10-27T18:15:43.693124] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-27T18:15:43.693215] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDD took 19.7s. Estimated remaining: 3h 42m 45s. Rate: 7.9 symbols/min [2025-10-27T18:15:44.288308] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.375125] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.384169] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.415290] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:44.422435] [DEBUG] [LOCAL ] DDT: Loaded 1881 existing records from primary storage. [2025-10-27T18:15:44.422721] [INFO ] [MAIN ] DDT: Loaded 1881 existing records. [2025-10-27T18:15:44.458543] [DEBUG] [LOCAL ] DDS: Loaded 12448 existing records from primary storage. [2025-10-27T18:15:44.468094] [INFO ] [MAIN ] DDS: Loaded 12448 existing records. [2025-10-27T18:15:44.821092] [DEBUG] [LOCAL ] DDL: Loaded 37701 existing records from primary storage. [2025-10-27T18:15:44.851751] [INFO ] [MAIN ] DDL: Loaded 37701 existing records. [2025-10-27T18:15:44.915679] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:44.889845] [DEBUG] [LOCAL ] DE: Loaded 48206 existing records from primary storage. [2025-10-27T18:15:44.943551] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-27T18:15:44.943482] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:44.954343] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-27T18:15:44.943693] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-27T18:15:44.954562] [INFO ] [MAIN ] DE: Loaded 48206 existing records. [2025-10-27T18:15:44.959913] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-27T18:15:44.975877] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-27T18:15:44.981067] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-27T18:15:45.004436] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-27T18:15:44.999105] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-27T18:15:45.385306] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:45.418051] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-27T18:15:45.537283] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-27T18:15:45.597067] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:45.621319] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-27T18:15:45.631413] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-27T18:15:45.670091] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-27T18:15:45.678168] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-27T18:15:45.813313] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-27T18:15:45.956999] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-27T18:15:46.202983] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.222437] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-27T18:15:46.278111] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.348766] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-27T18:15:46.714841] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.730774] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-27T18:15:46.761913] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T18:15:46.773161] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-27T18:15:46.794572] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:15:46.795151] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-27T18:15:47.110003] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T18:15:47.111108] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-27T18:15:47.132303] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T18:15:47.135220] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-27T18:15:47.625949] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:15:47.627227] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-27T18:15:47.654864] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:15:47.661701] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-27T18:15:47.760249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:15:47.764967] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-27T18:15:48.203943] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:15:48.407335] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:15:48.414897] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-27T18:15:48.521021] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:15:48.814989] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:15:49.120320] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T18:15:49.214977] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-27T18:15:49.775607] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T18:15:50.014944] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-27T18:15:50.533483] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:15:50.814953] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-27T18:15:51.614934] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-27T18:15:51.967798] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:15:52.338798] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:15:52.414954] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-27T18:15:53.214987] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-27T18:15:53.970892] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T18:15:54.014902] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-27T18:15:54.113480] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:15:54.462543] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:15:54.814986] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-27T18:15:55.614949] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-27T18:15:56.050226] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:15:56.377639] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:15:56.414915] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-27T18:15:57.214968] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-27T18:15:57.818231] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:15:58.013492] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:15:58.016716] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-27T18:15:58.625135] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:15:58.626032] [INFO ] [REMOTE ] DDT: Full fetch complete (2819 records). [2025-10-27T18:15:58.626099] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-27T18:15:58.820942] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-27T18:15:59.020158] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-27T18:15:59.020250] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-27T18:15:59.020375] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-27T18:15:59.020417] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-27T18:15:59.020783] [DEBUG] [LOCAL ] DDT: Trimmed 2819 records to 1794 (keeping 200 days of data) [2025-10-27T18:15:59.031815] [DEBUG] [LOCAL ] DDT: Primary data saved (1794 records). [2025-10-27T18:15:59.031876] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-27T18:15:59.031945] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 15.3s. Estimated remaining: 3h 43m 0s. Rate: 7.9 symbols/min [2025-10-27T18:15:59.209856] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:15:59.245557] [DEBUG] [LOCAL ] DEA: Loaded 40577 existing records from primary storage. [2025-10-27T18:15:59.245872] [INFO ] [MAIN ] DEA: Loaded 40577 existing records. [2025-10-27T18:15:59.424508] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:15:59.424737] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-27T18:15:59.424791] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-27T18:15:59.425038] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-27T18:15:59.425095] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-27T18:15:59.624267] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-27T18:15:59.779435] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:00.415163] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-27T18:16:00.656113] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T18:16:01.214967] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-27T18:16:02.014942] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-27T18:16:02.204310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-27T18:16:02.814949] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-27T18:16:03.175597] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-27T18:16:03.614945] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-27T18:16:04.753522] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T18:16:04.756833] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-27T18:16:05.242672] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (3.23 seconds). [2025-10-27T18:16:05.254027] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-27T18:16:05.279890] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-27T18:16:05.320428] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (4.11 seconds). [2025-10-27T18:16:05.350712] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T18:16:06.014933] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-27T18:16:06.711465] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:16:06.814913] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-27T18:16:06.872714] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:16:07.614932] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-27T18:16:08.348872] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:16:08.414911] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-27T18:16:08.764992] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:16:09.214931] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-27T18:16:10.014953] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-27T18:16:10.149152] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:16:10.158481] [INFO ] [REMOTE ] DE: Full fetch complete (69915 records). [2025-10-27T18:16:10.158637] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-27T18:16:10.564331] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-27T18:16:10.564416] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-27T18:16:10.565199] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-27T18:16:10.565261] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-27T18:16:10.566563] [DEBUG] [LOCAL ] DE: Trimmed 69915 records to 47383 (keeping 200 days of data) [2025-10-27T18:16:10.815905] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-27T18:16:10.870187] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:16:10.965060] [DEBUG] [LOCAL ] DE: Primary data saved (47383 records). [2025-10-27T18:16:10.965499] [INFO ] [MAIN ] DE: Full history saved. [2025-10-27T18:16:10.965686] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DE took 27.3s. Estimated remaining: 3h 43m 5s. Rate: 7.9 symbols/min [2025-10-27T18:16:11.159317] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-27T18:16:11.241050] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:11.281997] [DEBUG] [LOCAL ] DEC: Loaded 30623 existing records from primary storage. [2025-10-27T18:16:11.282377] [INFO ] [MAIN ] DEC: Loaded 30623 existing records. [2025-10-27T18:16:11.544730] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:11.544972] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-27T18:16:11.545024] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-27T18:16:11.545293] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-27T18:16:11.545353] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-27T18:16:11.620211] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-27T18:16:11.775574] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:16:11.819066] [INFO ] [REMOTE ] DDS: Full fetch complete (18297 records). [2025-10-27T18:16:11.840851] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-27T18:16:12.311179] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:12.420157] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-27T18:16:12.534773] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-27T18:16:12.534866] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-27T18:16:12.535286] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-27T18:16:12.535328] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-27T18:16:12.535926] [DEBUG] [LOCAL ] DDS: Trimmed 18297 records to 11957 (keeping 200 days of data) [2025-10-27T18:16:12.611100] [DEBUG] [LOCAL ] DDS: Primary data saved (11957 records). [2025-10-27T18:16:12.611228] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-27T18:16:12.611308] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DDS took 28.9s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:16:12.791175] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:12.844843] [DEBUG] [LOCAL ] DECK: Loaded 54081 existing records from primary storage. [2025-10-27T18:16:12.845180] [INFO ] [MAIN ] DECK: Loaded 54081 existing records. [2025-10-27T18:16:13.036005] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:13.036205] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-27T18:16:13.036279] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-27T18:16:13.036489] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-27T18:16:13.036531] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-27T18:16:13.222722] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-27T18:16:13.411772] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:13.448831] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:16:13.997310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T18:16:14.014905] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-27T18:16:14.129252] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:16:14.814953] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-27T18:16:15.582528] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T18:16:15.614905] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-27T18:16:16.414999] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-27T18:16:16.791457] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:16:16.799445] [INFO ] [REMOTE ] DDL: Full fetch complete (53298 records). [2025-10-27T18:16:16.799574] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-27T18:16:16.800285] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:16:16.800372] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:16:16.800414] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:16:16.800481] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-27T18:16:16.800544] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-27T18:16:16.800579] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-27T18:16:16.800723] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-27T18:16:16.800837] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DDL took 33.1s. Estimated remaining: 3h 42m 23s. Rate: 7.9 symbols/min [2025-10-27T18:16:16.934721] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T18:16:17.008364] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:17.050937] [DEBUG] [LOCAL ] DEI: Loaded 48983 existing records from primary storage. [2025-10-27T18:16:17.051237] [INFO ] [MAIN ] DEI: Loaded 48983 existing records. [2025-10-27T18:16:17.221934] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-27T18:16:17.227119] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:17.228207] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-27T18:16:17.228266] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-27T18:16:17.228500] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-27T18:16:17.228549] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-27T18:16:17.590886] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:17.639495] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:16:18.014931] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-27T18:16:18.814998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-27T18:16:19.361381] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T18:16:19.614989] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-27T18:16:19.826563] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:16:20.346093] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:16:20.414919] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-27T18:16:21.214929] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-27T18:16:21.449444] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:16:21.621347] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T18:16:22.014971] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-27T18:16:22.745210] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:16:22.814958] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-27T18:16:23.401375] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:16:23.614935] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-27T18:16:23.771487] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T18:16:24.414966] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-27T18:16:24.672223] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:16:25.214995] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-27T18:16:26.014948] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-27T18:16:26.114267] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:16:26.331107] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T18:16:26.814958] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-27T18:16:27.365452] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:16:27.614972] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-27T18:16:28.414946] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-27T18:16:28.887915] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T18:16:29.220825] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-27T18:16:29.232673] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:16:30.015000] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-27T18:16:30.107211] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:16:30.825144] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-27T18:16:30.830368] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T18:16:31.614961] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-27T18:16:31.764130] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:16:31.803563] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T18:16:31.811164] [INFO ] [REMOTE ] DEA: Full fetch complete (61500 records). [2025-10-27T18:16:31.811270] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-27T18:16:32.204091] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-27T18:16:32.204170] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-27T18:16:32.204933] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-27T18:16:32.204994] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-27T18:16:32.206133] [DEBUG] [LOCAL ] DEA: Trimmed 61500 records to 39763 (keeping 200 days of data) [2025-10-27T18:16:32.415134] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-27T18:16:32.440587] [DEBUG] [LOCAL ] DEA: Primary data saved (39763 records). [2025-10-27T18:16:32.440716] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-27T18:16:32.440800] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DEA took 33.4s. Estimated remaining: 3h 42m 39s. Rate: 7.9 symbols/min [2025-10-27T18:16:32.608810] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:32.666739] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-27T18:16:32.667078] [INFO ] [MAIN ] DELL: Loaded 54516 existing records. [2025-10-27T18:16:32.852850] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:32.853174] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-27T18:16:32.853311] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-27T18:16:32.853700] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-27T18:16:32.853828] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-27T18:16:33.152469] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T18:16:33.221695] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-27T18:16:33.252238] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:33.451490] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:16:34.015041] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-27T18:16:34.548104] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:16:34.815006] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-27T18:16:35.614976] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-27T18:16:36.149461] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T18:16:36.414978] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-27T18:16:36.529207] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T18:16:36.622772] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T18:16:37.214967] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-27T18:16:38.014926] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-27T18:16:38.288894] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T18:16:38.814923] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-27T18:16:39.423338] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T18:16:39.614937] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-27T18:16:40.013926] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:16:40.060958] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T18:16:40.414985] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-27T18:16:40.639812] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:16:41.214950] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-27T18:16:42.015000] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-27T18:16:42.339737] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T18:16:42.346493] [INFO ] [REMOTE ] DEC: Full fetch complete (44644 records). [2025-10-27T18:16:42.346711] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-27T18:16:42.594115] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-27T18:16:42.791821] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-27T18:16:42.791903] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-27T18:16:42.792535] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-27T18:16:42.792596] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-27T18:16:42.793548] [DEBUG] [LOCAL ] DEC: Trimmed 44644 records to 29884 (keeping 200 days of data) [2025-10-27T18:16:42.844065] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-27T18:16:42.968291] [DEBUG] [LOCAL ] DEC: Primary data saved (29884 records). [2025-10-27T18:16:42.968417] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-27T18:16:42.968503] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DEC took 32.0s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:16:43.132695] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:43.177289] [DEBUG] [LOCAL ] DEO: Loaded 49926 existing records from primary storage. [2025-10-27T18:16:43.177576] [INFO ] [MAIN ] DEO: Loaded 49926 existing records. [2025-10-27T18:16:43.352170] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:43.352387] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-27T18:16:43.352441] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-27T18:16:43.352630] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-27T18:16:43.352729] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-27T18:16:43.615889] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-27T18:16:43.720712] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:43.749378] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:16:44.414935] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-27T18:16:44.926269] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T18:16:45.215003] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-27T18:16:45.402391] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T18:16:45.416556] [INFO ] [REMOTE ] DECK: Full fetch complete (76832 records). [2025-10-27T18:16:45.417574] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-27T18:16:45.418502] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:16:45.418627] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:16:45.418732] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:16:45.418781] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-27T18:16:45.418854] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-27T18:16:45.418911] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-27T18:16:45.419712] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-10-27T18:16:45.420538] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DECK took 32.8s. Estimated remaining: 3h 42m 17s. Rate: 7.9 symbols/min [2025-10-27T18:16:45.593804] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:45.627966] [DEBUG] [LOCAL ] DFH: Loaded 31992 existing records from primary storage. [2025-10-27T18:16:45.628239] [INFO ] [MAIN ] DFH: Loaded 31992 existing records. [2025-10-27T18:16:45.810881] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:45.811202] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-27T18:16:45.811357] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-27T18:16:45.811555] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-27T18:16:45.811595] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-27T18:16:46.029115] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-27T18:16:46.192999] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:16:46.235484] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:46.814954] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-27T18:16:47.347242] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T18:16:47.615000] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-27T18:16:47.932500] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:16:48.054782] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T18:16:48.414943] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-27T18:16:49.214984] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-27T18:16:49.593325] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:16:49.758847] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T18:16:50.014999] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-27T18:16:50.626635] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:16:50.814921] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-27T18:16:51.614973] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-27T18:16:51.974301] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:16:52.310676] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:16:52.322861] [INFO ] [REMOTE ] DEI: Full fetch complete (69911 records). [2025-10-27T18:16:52.322999] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-27T18:16:52.421033] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-27T18:16:52.702406] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-27T18:16:52.702492] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-27T18:16:52.703293] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-27T18:16:52.703355] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-27T18:16:52.704749] [DEBUG] [LOCAL ] DEI: Trimmed 69911 records to 48162 (keeping 200 days of data) [2025-10-27T18:16:52.985888] [DEBUG] [LOCAL ] DEI: Primary data saved (48162 records). [2025-10-27T18:16:52.985999] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-27T18:16:52.986077] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEI took 36.2s. Estimated remaining: 3h 42m 10s. Rate: 7.9 symbols/min [2025-10-27T18:16:53.154690] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:16:53.175899] [DEBUG] [LOCAL ] DFIN: Loaded 22669 existing records from primary storage. [2025-10-27T18:16:53.176159] [INFO ] [MAIN ] DFIN: Loaded 22669 existing records. [2025-10-27T18:16:53.238636] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-27T18:16:53.358081] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:16:53.358268] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-27T18:16:53.358315] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-27T18:16:53.358461] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-27T18:16:53.358500] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-27T18:16:53.714812] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:16:53.774343] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T18:16:53.951499] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:16:54.014904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-27T18:16:54.475403] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T18:16:54.814982] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-27T18:16:55.614975] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-27T18:16:55.629353] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:16:55.684623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:16:56.414994] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-27T18:16:57.051490] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:16:57.214916] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-27T18:16:57.477935] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T18:16:58.014976] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-27T18:16:58.416441] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T18:16:58.814958] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-27T18:16:58.907370] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:16:59.614947] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-27T18:17:00.415001] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-27T18:17:01.215017] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-27T18:17:01.759004] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-27T18:17:01.905899] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (3.09 seconds). [2025-10-27T18:17:02.014963] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-27T18:17:02.814919] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-27T18:17:03.859035] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-27T18:17:03.867202] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-27T18:17:05.200058] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-27T18:17:05.205231] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-27T18:17:05.367549] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (4.15 seconds). [2025-10-27T18:17:05.378117] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-27T18:17:05.448019] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (3.43 seconds). [2025-10-27T18:17:06.014945] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-27T18:17:06.141963] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T18:17:06.486408] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:17:06.814949] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-27T18:17:07.068723] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:17:07.614949] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-27T18:17:07.841303] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:17:07.969601] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:17:08.414994] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-27T18:17:08.628338] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:17:09.214360] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:17:09.218866] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-27T18:17:10.014930] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-27T18:17:10.726451] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:17:10.814962] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-27T18:17:11.184909] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T18:17:11.614942] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-27T18:17:12.414940] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-27T18:17:12.889545] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T18:17:13.215000] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-27T18:17:13.264955] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T18:17:13.269748] [INFO ] [REMOTE ] DFIN: Full fetch complete (33497 records). [2025-10-27T18:17:13.269864] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-27T18:17:13.661173] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-27T18:17:13.661250] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-27T18:17:13.661764] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-27T18:17:13.661825] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-27T18:17:13.662573] [DEBUG] [LOCAL ] DFIN: Trimmed 33497 records to 22124 (keeping 200 days of data) [2025-10-27T18:17:13.818487] [DEBUG] [LOCAL ] DFIN: Primary data saved (22124 records). [2025-10-27T18:17:13.820449] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T18:17:13.819103] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-27T18:17:13.820616] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFIN took 20.8s. Estimated remaining: 3h 42m 40s. Rate: 7.9 symbols/min [2025-10-27T18:17:13.887627] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-27T18:17:13.902014] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-27T18:17:14.020029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-27T18:17:14.149835] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:14.298145] [DEBUG] [LOCAL ] DFP: Loaded 11137 existing records from primary storage. [2025-10-27T18:17:14.354452] [INFO ] [MAIN ] DFP: Loaded 11137 existing records. [2025-10-27T18:17:14.604201] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:17:14.722877] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-27T18:17:14.726021] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-27T18:17:14.730159] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-27T18:17:14.730286] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-27T18:17:14.753495] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:14.753837] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-27T18:17:14.754065] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-27T18:17:14.754572] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-27T18:17:14.754636] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-27T18:17:14.786137] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-27T18:17:14.819220] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-27T18:17:15.517148] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:15.530639] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-27T18:17:15.530848] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-27T18:17:15.530945] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DELL took 43.1s. Estimated remaining: 3h 42m 16s. Rate: 7.9 symbols/min [2025-10-27T18:17:15.621309] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-27T18:17:15.701210] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:15.754975] [DEBUG] [LOCAL ] DG: Loaded 54007 existing records from primary storage. [2025-10-27T18:17:15.755359] [INFO ] [MAIN ] DG: Loaded 54007 existing records. [2025-10-27T18:17:15.935904] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:15.936469] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-27T18:17:15.936752] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-27T18:17:15.937326] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-27T18:17:15.937454] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-27T18:17:16.246034] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T18:17:16.268490] [INFO ] [REMOTE ] DFH: Full fetch complete (47151 records). [2025-10-27T18:17:16.293137] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-27T18:17:16.402584] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:16.437623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T18:17:16.433403] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-27T18:17:16.712075] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:17:16.816886] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-27T18:17:16.817018] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-27T18:17:16.818135] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-27T18:17:16.818203] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-27T18:17:16.819462] [DEBUG] [LOCAL ] DFH: Trimmed 47151 records to 31185 (keeping 200 days of data) [2025-10-27T18:17:17.017831] [DEBUG] [LOCAL ] DFH: Primary data saved (31185 records). [2025-10-27T18:17:17.018052] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-27T18:17:17.018162] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFH took 31.6s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-10-27T18:17:17.191124] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:17.222444] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-27T18:17:17.244925] [DEBUG] [LOCAL ] DGX: Loaded 45266 existing records from primary storage. [2025-10-27T18:17:17.245409] [INFO ] [MAIN ] DGX: Loaded 45266 existing records. [2025-10-27T18:17:17.429983] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:17.430351] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-27T18:17:17.430408] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-27T18:17:17.430758] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-27T18:17:17.430836] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-27T18:17:17.817864] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:18.014928] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-27T18:17:18.067573] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T18:17:18.814940] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-27T18:17:18.837949] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T18:17:19.264334] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T18:17:19.275880] [INFO ] [REMOTE ] DEO: Full fetch complete (71748 records). [2025-10-27T18:17:19.276130] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-27T18:17:19.620211] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-27T18:17:19.706094] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-27T18:17:19.706274] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-27T18:17:19.707746] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-27T18:17:19.707875] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-27T18:17:19.709857] [DEBUG] [LOCAL ] DEO: Trimmed 71748 records to 49158 (keeping 200 days of data) [2025-10-27T18:17:20.045315] [DEBUG] [LOCAL ] DEO: Primary data saved (49158 records). [2025-10-27T18:17:20.045740] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-27T18:17:20.045889] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DEO took 37.1s. Estimated remaining: 3h 41m 30s. Rate: 7.9 symbols/min [2025-10-27T18:17:20.230614] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:20.270535] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:17:20.287872] [DEBUG] [LOCAL ] DHF: Loaded 21021 existing records from primary storage. [2025-10-27T18:17:20.288221] [INFO ] [MAIN ] DHF: Loaded 21021 existing records. [2025-10-27T18:17:20.420118] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-27T18:17:20.476183] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:20.476498] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-27T18:17:20.476553] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-27T18:17:20.476841] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-27T18:17:20.476900] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-27T18:17:20.862931] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:21.108034] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:17:21.214946] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-27T18:17:22.014925] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-27T18:17:22.102803] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T18:17:22.129227] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T18:17:22.536227] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:17:22.814950] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-27T18:17:23.614989] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-27T18:17:24.190131] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:17:24.414956] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-27T18:17:24.737879] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T18:17:25.214991] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-27T18:17:25.567074] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:17:26.014989] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-27T18:17:26.814939] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-27T18:17:27.466542] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T18:17:27.504829] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-27T18:17:27.614920] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-27T18:17:27.952463] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:17:28.414944] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-27T18:17:29.208060] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T18:17:29.214888] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-27T18:17:29.256511] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:17:30.014931] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-27T18:17:30.256929] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T18:17:30.814943] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-27T18:17:31.060206] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T18:17:31.504920] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T18:17:31.614979] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-27T18:17:32.410434] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:17:32.414894] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-27T18:17:32.928804] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:17:33.214941] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-27T18:17:33.833993] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:17:34.014939] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-27T18:17:34.815005] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-27T18:17:35.615543] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T18:17:35.615007] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-27T18:17:35.779570] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T18:17:36.215158] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:17:36.414986] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-27T18:17:37.214923] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-27T18:17:37.598765] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:17:38.014950] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-27T18:17:38.820232] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-27T18:17:38.832273] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:17:38.961448] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T18:17:39.614946] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-27T18:17:40.237158] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:17:40.332029] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T18:17:40.335614] [INFO ] [REMOTE ] DHF: Full fetch complete (29963 records). [2025-10-27T18:17:40.335711] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-27T18:17:40.420064] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-27T18:17:40.711583] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-27T18:17:40.711717] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-27T18:17:40.712471] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-27T18:17:40.712537] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-27T18:17:40.713393] [DEBUG] [LOCAL ] DHF: Trimmed 29963 records to 20579 (keeping 200 days of data) [2025-10-27T18:17:40.832716] [DEBUG] [LOCAL ] DHF: Primary data saved (20579 records). [2025-10-27T18:17:40.832879] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-27T18:17:40.832975] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DHF took 20.8s. Estimated remaining: 3h 42m 0s. Rate: 7.9 symbols/min [2025-10-27T18:17:41.000548] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:41.050498] [DEBUG] [LOCAL ] DHI: Loaded 54132 existing records from primary storage. [2025-10-27T18:17:41.050827] [INFO ] [MAIN ] DHI: Loaded 54132 existing records. [2025-10-27T18:17:41.219213] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-27T18:17:41.222872] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:41.224146] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-27T18:17:41.224208] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-27T18:17:41.224406] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-27T18:17:41.224461] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-27T18:17:41.586779] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:42.014926] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-27T18:17:42.104877] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T18:17:42.685073] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T18:17:42.814921] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-27T18:17:42.858554] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:17:43.614963] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-27T18:17:44.414987] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-27T18:17:44.793999] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T18:17:45.023143] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T18:17:45.214929] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-27T18:17:46.014929] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-27T18:17:46.213370] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:17:46.743178] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:17:46.814952] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-27T18:17:47.540836] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T18:17:47.614991] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-27T18:17:48.240265] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:17:48.414961] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-27T18:17:48.455807] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T18:17:48.458118] [INFO ] [REMOTE ] DFP: Full fetch complete (15803 records). [2025-10-27T18:17:48.458193] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-27T18:17:48.838096] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-27T18:17:48.838178] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-27T18:17:48.838659] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-27T18:17:48.838722] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-27T18:17:48.839222] [DEBUG] [LOCAL ] DFP: Trimmed 15803 records to 10752 (keeping 200 days of data) [2025-10-27T18:17:48.902891] [DEBUG] [LOCAL ] DFP: Primary data saved (10752 records). [2025-10-27T18:17:48.903035] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-27T18:17:48.903117] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DFP took 35.1s. Estimated remaining: 3h 41m 54s. Rate: 7.9 symbols/min [2025-10-27T18:17:49.070469] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:49.127898] [DEBUG] [LOCAL ] DHR: Loaded 54150 existing records from primary storage. [2025-10-27T18:17:49.128253] [INFO ] [MAIN ] DHR: Loaded 54150 existing records. [2025-10-27T18:17:49.222510] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-27T18:17:49.311314] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:49.311523] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-27T18:17:49.311568] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-27T18:17:49.311828] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-27T18:17:49.311884] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-27T18:17:49.665035] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:49.693081] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:17:49.702021] [INFO ] [REMOTE ] DGX: Full fetch complete (65729 records). [2025-10-27T18:17:49.702167] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-27T18:17:50.020201] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-27T18:17:50.105532] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-27T18:17:50.105629] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-27T18:17:50.106511] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-27T18:17:50.106564] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-27T18:17:50.108079] [DEBUG] [LOCAL ] DGX: Trimmed 65729 records to 44445 (keeping 200 days of data) [2025-10-27T18:17:50.390428] [DEBUG] [LOCAL ] DGX: Primary data saved (44445 records). [2025-10-27T18:17:50.390592] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-27T18:17:50.391614] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DGX took 33.4s. Estimated remaining: 3h 41m 29s. Rate: 7.9 symbols/min [2025-10-27T18:17:50.563812] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:50.614841] [DEBUG] [LOCAL ] DHT: Loaded 48572 existing records from primary storage. [2025-10-27T18:17:50.615199] [INFO ] [MAIN ] DHT: Loaded 48572 existing records. [2025-10-27T18:17:50.820962] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-27T18:17:50.826615] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:50.829794] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T18:17:50.829978] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-27T18:17:50.840384] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-27T18:17:50.841351] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-27T18:17:50.841410] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-27T18:17:51.206784] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:51.548110] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:17:51.614914] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-27T18:17:51.876692] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T18:17:51.887354] [INFO ] [REMOTE ] DG: Full fetch complete (77301 records). [2025-10-27T18:17:51.887537] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-27T18:17:52.276404] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-27T18:17:52.276489] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-27T18:17:52.277381] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-27T18:17:52.277446] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-27T18:17:52.278913] [DEBUG] [LOCAL ] DG: Trimmed 77301 records to 53220 (keeping 200 days of data) [2025-10-27T18:17:52.464727] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-27T18:17:52.626537] [DEBUG] [LOCAL ] DG: Primary data saved (53220 records). [2025-10-27T18:17:52.626879] [INFO ] [MAIN ] DG: Full history saved. [2025-10-27T18:17:52.627587] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DG took 37.1s. Estimated remaining: 3h 41m 6s. Rate: 7.9 symbols/min [2025-10-27T18:17:52.798438] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:17:52.814820] [DEBUG] [LOCAL ] DHX: Loaded 13435 existing records from primary storage. [2025-10-27T18:17:52.815044] [INFO ] [MAIN ] DHX: Loaded 13435 existing records. [2025-10-27T18:17:52.997874] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:17:52.998158] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-27T18:17:52.998206] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-27T18:17:52.998375] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-27T18:17:52.998430] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-27T18:17:53.217795] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-27T18:17:53.355788] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:17:53.387699] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T18:17:54.020478] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-27T18:17:54.050339] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:17:54.641181] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:17:54.815012] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-27T18:17:55.614979] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-27T18:17:55.974263] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:17:56.414926] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-27T18:17:56.697463] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:17:57.144553] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:17:57.214897] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-27T18:17:57.346417] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:17:58.014959] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-27T18:17:58.735051] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:17:58.814918] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-27T18:17:58.862341] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:17:59.614952] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-27T18:18:00.414950] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-27T18:18:00.622432] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T18:18:01.215039] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-27T18:18:01.798006] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:18:02.014944] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-27T18:18:02.378565] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:18:02.814987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-27T18:18:03.614942] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-27T18:18:04.082531] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-27T18:18:04.174427] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T18:18:04.414913] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-27T18:18:04.490059] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T18:18:05.061204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:18:05.215001] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-27T18:18:05.634195] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:18:05.830319] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T18:18:06.014948] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-27T18:18:06.814945] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-27T18:18:07.614940] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-27T18:18:08.067500] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T18:18:08.326273] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T18:18:08.414949] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-27T18:18:08.543961] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:18:09.214944] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-27T18:18:09.684895] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:18:10.011148] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:18:10.014892] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-27T18:18:10.815021] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-27T18:18:10.991229] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:18:11.614987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-27T18:18:11.989839] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:18:12.289583] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T18:18:12.295124] [INFO ] [REMOTE ] DHX: Full fetch complete (21485 records). [2025-10-27T18:18:12.295269] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-27T18:18:12.420032] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-27T18:18:12.675036] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-27T18:18:12.675117] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-27T18:18:12.675529] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-27T18:18:12.675570] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-27T18:18:12.676196] [DEBUG] [LOCAL ] DHX: Trimmed 21485 records to 13037 (keeping 200 days of data) [2025-10-27T18:18:12.744664] [DEBUG] [LOCAL ] DHX: Primary data saved (13037 records). [2025-10-27T18:18:12.744793] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-27T18:18:12.744870] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHX took 20.1s. Estimated remaining: 3h 41m 34s. Rate: 7.9 symbols/min [2025-10-27T18:18:12.910115] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:12.924526] [DEBUG] [LOCAL ] DIAX: Loaded 12871 existing records from primary storage. [2025-10-27T18:18:12.924794] [INFO ] [MAIN ] DIAX: Loaded 12871 existing records. [2025-10-27T18:18:13.108019] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:13.108254] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-27T18:18:13.108314] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-27T18:18:13.108484] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-27T18:18:13.108539] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-27T18:18:13.220122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-27T18:18:13.455139] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:14.014974] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-27T18:18:14.125543] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T18:18:14.814966] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-27T18:18:14.916058] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T18:18:15.326802] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:18:15.615000] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-27T18:18:16.414998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-27T18:18:16.547507] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T18:18:16.558032] [INFO ] [REMOTE ] DHT: Full fetch complete (70341 records). [2025-10-27T18:18:16.558206] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-27T18:18:16.858456] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:18:16.978000] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-27T18:18:16.978088] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-27T18:18:16.978915] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-27T18:18:16.978979] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-27T18:18:16.980357] [DEBUG] [LOCAL ] DHT: Trimmed 70341 records to 47756 (keeping 200 days of data) [2025-10-27T18:18:17.231018] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-27T18:18:17.259633] [DEBUG] [LOCAL ] DHT: Primary data saved (47756 records). [2025-10-27T18:18:17.259838] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-27T18:18:17.260514] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHT took 26.9s. Estimated remaining: 3h 41m 18s. Rate: 7.9 symbols/min [2025-10-27T18:18:17.434215] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:17.469465] [DEBUG] [LOCAL ] DIN: Loaded 37212 existing records from primary storage. [2025-10-27T18:18:17.469756] [INFO ] [MAIN ] DIN: Loaded 37212 existing records. [2025-10-27T18:18:17.642389] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:17.642584] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-27T18:18:17.642629] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-27T18:18:17.642896] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-27T18:18:17.642952] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-27T18:18:17.777357] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:18:18.008985] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:18.014905] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-27T18:18:18.205501] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T18:18:18.814940] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-27T18:18:19.558887] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:18:19.614910] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-27T18:18:19.684596] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:18:20.194843] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:18:20.414935] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-27T18:18:21.214970] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-27T18:18:21.923177] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:18:22.014977] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-27T18:18:22.814977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-27T18:18:23.165106] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:18:23.547611] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:18:23.614967] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-27T18:18:23.705225] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:18:24.414954] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-27T18:18:25.214978] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-27T18:18:25.565801] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T18:18:25.841166] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-27T18:18:25.851072] [INFO ] [REMOTE ] DHI: Full fetch complete (77018 records). [2025-10-27T18:18:25.851235] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-27T18:18:25.851950] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:18:25.852037] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:25.852078] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:25.852116] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-27T18:18:25.852173] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-27T18:18:25.852206] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-27T18:18:25.852338] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-27T18:18:25.852422] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHI took 45.0s. Estimated remaining: 3h 41m 13s. Rate: 7.9 symbols/min [2025-10-27T18:18:26.020169] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-27T18:18:26.023793] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:26.073479] [DEBUG] [LOCAL ] DINO: Loaded 53591 existing records from primary storage. [2025-10-27T18:18:26.073846] [INFO ] [MAIN ] DINO: Loaded 53591 existing records. [2025-10-27T18:18:26.258467] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:26.258874] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-27T18:18:26.258946] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-27T18:18:26.259346] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-27T18:18:26.259433] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-27T18:18:26.609161] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:26.814999] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-27T18:18:27.183921] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T18:18:27.472506] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:18:27.614993] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-27T18:18:28.210491] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:18:28.414969] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-27T18:18:28.628964] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T18:18:29.214928] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-27T18:18:29.289351] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:18:30.014942] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-27T18:18:30.580012] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T18:18:30.811828] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T18:18:30.821845] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-27T18:18:31.338563] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:18:31.614942] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-27T18:18:32.414952] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-27T18:18:33.051390] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:18:33.072332] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:18:33.214920] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-27T18:18:34.014964] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-27T18:18:34.730238] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T18:18:34.814940] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-27T18:18:35.103090] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:18:35.614931] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-27T18:18:36.394703] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:18:36.414905] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-27T18:18:36.659735] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:18:36.663032] [INFO ] [REMOTE ] DIAX: Full fetch complete (17551 records). [2025-10-27T18:18:36.663173] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-27T18:18:36.663625] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:18:36.663733] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:36.663774] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:36.663811] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-27T18:18:36.663864] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-27T18:18:36.663898] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-10-27T18:18:36.664042] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-10-27T18:18:36.664130] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIAX took 23.9s. Estimated remaining: 3h 41m 14s. Rate: 7.9 symbols/min [2025-10-27T18:18:36.835288] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:36.889176] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-27T18:18:36.889503] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-10-27T18:18:37.070959] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:37.071170] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-27T18:18:37.071216] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-27T18:18:37.071501] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-27T18:18:37.071538] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-27T18:18:37.221772] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-27T18:18:37.434482] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:37.824912] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:18:37.835322] [INFO ] [REMOTE ] DHR: Full fetch complete (77442 records). [2025-10-27T18:18:37.835483] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-27T18:18:38.031423] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-27T18:18:38.224567] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-27T18:18:38.224736] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-27T18:18:38.225609] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-27T18:18:38.225712] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-27T18:18:38.227305] [DEBUG] [LOCAL ] DHR: Trimmed 77442 records to 53369 (keeping 200 days of data) [2025-10-27T18:18:38.383783] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T18:18:38.599050] [DEBUG] [LOCAL ] DHR: Primary data saved (53369 records). [2025-10-27T18:18:38.599190] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-27T18:18:38.599725] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DHR took 49.7s. Estimated remaining: 3h 40m 51s. Rate: 7.9 symbols/min [2025-10-27T18:18:38.766083] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:38.766230] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-27T18:18:38.766266] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-27T18:18:38.766370] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-27T18:18:38.766409] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-27T18:18:38.766449] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-27T18:18:38.766498] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-27T18:18:38.827446] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-27T18:18:39.117049] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:39.210914] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:18:39.614968] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-27T18:18:40.213830] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:18:40.258999] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:18:40.414976] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-27T18:18:40.699156] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T18:18:41.214992] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-27T18:18:42.014975] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-27T18:18:42.718697] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:18:42.814999] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-27T18:18:43.615005] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-27T18:18:43.880971] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T18:18:44.007780] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T18:18:44.015775] [INFO ] [REMOTE ] DIN: Full fetch complete (54455 records). [2025-10-27T18:18:44.015953] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-27T18:18:44.420923] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-27T18:18:44.435271] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-27T18:18:44.436369] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-27T18:18:44.437447] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-27T18:18:44.437526] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-27T18:18:44.439442] [DEBUG] [LOCAL ] DIN: Trimmed 54455 records to 36358 (keeping 200 days of data) [2025-10-27T18:18:44.684078] [DEBUG] [LOCAL ] DIN: Primary data saved (36358 records). [2025-10-27T18:18:44.684292] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-27T18:18:44.684397] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIN took 27.4s. Estimated remaining: 3h 40m 39s. Rate: 7.9 symbols/min [2025-10-27T18:18:44.885710] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:44.939950] [DEBUG] [LOCAL ] DK: Loaded 49930 existing records from primary storage. [2025-10-27T18:18:44.940182] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:18:44.940738] [INFO ] [MAIN ] DK: Loaded 49930 existing records. [2025-10-27T18:18:45.136915] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:45.137374] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-27T18:18:45.137572] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-27T18:18:45.150322] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-27T18:18:45.167719] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-27T18:18:45.230808] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-27T18:18:45.220300] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T18:18:45.571802] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:46.014940] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-27T18:18:46.425742] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:18:46.814990] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-27T18:18:47.056597] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-27T18:18:47.132514] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T18:18:47.614949] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-27T18:18:48.414991] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-27T18:18:49.214998] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-27T18:18:49.812959] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:18:50.014916] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-27T18:18:50.148966] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-27T18:18:50.587616] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:18:50.814953] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-27T18:18:51.085524] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T18:18:51.614929] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-27T18:18:51.943026] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:18:52.414947] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-27T18:18:52.934077] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:18:53.017118] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-27T18:18:53.214914] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-27T18:18:54.014946] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-27T18:18:54.617117] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:18:54.815003] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-27T18:18:55.614953] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-27T18:18:55.902359] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-27T18:18:56.030294] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T18:18:56.156570] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:18:56.414931] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-27T18:18:57.214973] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-27T18:18:58.015035] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-27T18:18:58.522360] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:18:58.523228] [INFO ] [REMOTE ] DIVY: Full fetch complete (1672 records). [2025-10-27T18:18:58.523302] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-27T18:18:58.748113] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T18:18:58.748856] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:18:58.750999] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-27T18:18:58.751491] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:18:58.762515] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-27T18:18:58.762907] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-27T18:18:58.762986] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-27T18:18:58.763101] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-27T18:18:58.763434] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIVY took 20.2s. Estimated remaining: 3h 40m 50s. Rate: 7.9 symbols/min [2025-10-27T18:18:58.820175] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-27T18:18:58.951165] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:18:58.972419] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:18:58.997839] [DEBUG] [LOCAL ] DKL: Loaded 16962 existing records from primary storage. [2025-10-27T18:18:58.998123] [INFO ] [MAIN ] DKL: Loaded 16962 existing records. [2025-10-27T18:18:59.173049] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:18:59.173248] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-27T18:18:59.173293] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-27T18:18:59.173498] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-27T18:18:59.173555] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-27T18:18:59.528784] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:18:59.614934] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-27T18:19:00.414927] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-27T18:19:01.214986] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-27T18:19:01.299330] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T18:19:01.948064] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-27T18:19:02.014939] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-27T18:19:02.815000] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-27T18:19:03.594433] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:19:03.614925] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-27T18:19:04.158416] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-27T18:19:04.414918] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-27T18:19:04.463929] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (4.05 seconds). [2025-10-27T18:19:05.214988] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-27T18:19:05.451340] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:19:05.550018] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (3.54 seconds). [2025-10-27T18:19:06.014899] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-27T18:19:06.100408] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:19:06.110298] [INFO ] [REMOTE ] DINO: Full fetch complete (76693 records). [2025-10-27T18:19:06.110412] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-27T18:19:06.517759] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-27T18:19:06.517891] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-27T18:19:06.518845] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-27T18:19:06.518910] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-27T18:19:06.520335] [DEBUG] [LOCAL ] DINO: Trimmed 76693 records to 52788 (keeping 200 days of data) [2025-10-27T18:19:06.764404] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:19:06.827951] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-27T18:19:06.873098] [DEBUG] [LOCAL ] DINO: Primary data saved (52788 records). [2025-10-27T18:19:06.873233] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-27T18:19:06.873342] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DINO took 41.0s. Estimated remaining: 3h 40m 43s. Rate: 7.9 symbols/min [2025-10-27T18:19:07.047881] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:07.093663] [DEBUG] [LOCAL ] DKS: Loaded 49852 existing records from primary storage. [2025-10-27T18:19:07.093976] [INFO ] [MAIN ] DKS: Loaded 49852 existing records. [2025-10-27T18:19:07.293063] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:07.293257] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-27T18:19:07.293303] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-27T18:19:07.293487] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-27T18:19:07.293542] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-27T18:19:07.620732] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-27T18:19:07.652552] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:07.853294] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T18:19:08.019167] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:19:08.414962] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-27T18:19:08.907607] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T18:19:09.214940] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-27T18:19:09.976716] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:19:10.014892] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-27T18:19:10.277763] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:19:10.814968] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-27T18:19:11.164337] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:19:11.614977] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-27T18:19:12.318634] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:19:12.414963] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-27T18:19:12.929500] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:19:12.940561] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-27T18:19:12.940735] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-27T18:19:13.222149] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-27T18:19:13.385591] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-27T18:19:13.395308] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:19:13.395024] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-27T18:19:13.396377] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-27T18:19:13.399855] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-27T18:19:13.401327] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-27T18:19:13.733488] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-27T18:19:13.733619] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-27T18:19:13.734469] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DIS took 37.1s. Estimated remaining: 3h 40m 34s. Rate: 7.9 symbols/min [2025-10-27T18:19:13.897574] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:13.929877] [DEBUG] [LOCAL ] DLB: Loaded 32686 existing records from primary storage. [2025-10-27T18:19:13.930163] [INFO ] [MAIN ] DLB: Loaded 32686 existing records. [2025-10-27T18:19:14.023684] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-27T18:19:14.108708] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:14.108935] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-27T18:19:14.108997] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-27T18:19:14.109192] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-27T18:19:14.109249] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-27T18:19:14.457009] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:14.814923] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-27T18:19:15.090690] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T18:19:15.518278] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T18:19:15.604052] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T18:19:15.614889] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-27T18:19:16.414971] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-27T18:19:17.086479] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:19:17.095591] [INFO ] [REMOTE ] DK: Full fetch complete (70802 records). [2025-10-27T18:19:17.095791] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-27T18:19:17.220072] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-27T18:19:17.513910] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-27T18:19:17.514099] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-27T18:19:17.515212] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-27T18:19:17.515292] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-27T18:19:17.516874] [DEBUG] [LOCAL ] DK: Trimmed 70802 records to 49105 (keeping 200 days of data) [2025-10-27T18:19:17.827675] [DEBUG] [LOCAL ] DK: Primary data saved (49105 records). [2025-10-27T18:19:17.827973] [INFO ] [MAIN ] DK: Full history saved. [2025-10-27T18:19:17.828939] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DK took 33.1s. Estimated remaining: 3h 40m 16s. Rate: 7.9 symbols/min [2025-10-27T18:19:18.017358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-27T18:19:18.020685] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:19:18.050427] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:18.069199] [DEBUG] [LOCAL ] DLNG: Loaded 6143 existing records from primary storage. [2025-10-27T18:19:18.069446] [INFO ] [MAIN ] DLNG: Loaded 6143 existing records. [2025-10-27T18:19:18.261589] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:18.261865] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-27T18:19:18.261913] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-27T18:19:18.262059] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-27T18:19:18.262105] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-27T18:19:18.553588] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:19:18.627153] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:18.814927] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-27T18:19:19.620162] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-27T18:19:19.637669] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:19:19.816738] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T18:19:20.414973] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-27T18:19:20.515198] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T18:19:20.517763] [INFO ] [REMOTE ] DKL: Full fetch complete (27385 records). [2025-10-27T18:19:20.517852] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-27T18:19:20.518375] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:19:20.518456] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:19:20.518498] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:19:20.518537] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-27T18:19:20.518590] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-27T18:19:20.518623] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-10-27T18:19:20.518794] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-10-27T18:19:20.518881] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DKL took 21.8s. Estimated remaining: 3h 39m 55s. Rate: 7.9 symbols/min [2025-10-27T18:19:20.688047] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:20.737531] [DEBUG] [LOCAL ] DLR: Loaded 51364 existing records from primary storage. [2025-10-27T18:19:20.737895] [INFO ] [MAIN ] DLR: Loaded 51364 existing records. [2025-10-27T18:19:20.911667] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:20.911853] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-27T18:19:20.911897] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-27T18:19:20.912107] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-27T18:19:20.912174] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-27T18:19:21.215535] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-27T18:19:21.274046] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:21.275340] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:19:22.014948] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-27T18:19:22.727450] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:19:22.814956] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-27T18:19:23.116515] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T18:19:23.615016] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-27T18:19:23.783718] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:19:24.415022] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-27T18:19:25.144134] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:19:25.214905] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-27T18:19:25.234939] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:19:26.014990] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-27T18:19:26.698073] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:19:26.814938] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-27T18:19:27.614974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-27T18:19:27.644708] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T18:19:28.254954] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:19:28.399016] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:19:28.414895] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-27T18:19:28.888268] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T18:19:29.214987] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-27T18:19:30.014961] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-27T18:19:30.814921] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-27T18:19:31.498290] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-27T18:19:31.513276] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:19:31.614905] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-27T18:19:31.780154] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:19:32.414954] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-27T18:19:33.214935] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-27T18:19:33.503110] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:19:33.531884] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:19:33.579279] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:19:34.014928] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-27T18:19:34.814934] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-27T18:19:35.496059] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:19:35.614903] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-27T18:19:36.414973] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-27T18:19:36.558686] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:19:37.214992] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-27T18:19:37.504071] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:19:37.952902] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T18:19:38.014921] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-27T18:19:38.814914] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-27T18:19:38.865168] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:19:38.906220] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:19:39.212891] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T18:19:39.615019] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-27T18:19:40.414989] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-27T18:19:41.215004] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-27T18:19:41.439222] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:19:41.914785] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:19:41.916418] [INFO ] [REMOTE ] DLNG: Full fetch complete (11016 records). [2025-10-27T18:19:41.916491] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-27T18:19:42.016914] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-27T18:19:42.279119] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-27T18:19:42.279269] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-27T18:19:42.279543] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-27T18:19:42.279613] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-27T18:19:42.280340] [DEBUG] [LOCAL ] DLNG: Trimmed 11016 records to 5896 (keeping 200 days of data) [2025-10-27T18:19:42.335414] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:19:42.354289] [DEBUG] [LOCAL ] DLNG: Primary data saved (5896 records). [2025-10-27T18:19:42.354483] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-27T18:19:42.354579] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DLNG took 24.5s. Estimated remaining: 3h 40m 27s. Rate: 7.9 symbols/min [2025-10-27T18:19:42.520925] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:42.549824] [DEBUG] [LOCAL ] DLX: Loaded 28400 existing records from primary storage. [2025-10-27T18:19:42.550100] [INFO ] [MAIN ] DLX: Loaded 28400 existing records. [2025-10-27T18:19:42.723410] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:42.723613] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-27T18:19:42.723686] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-27T18:19:42.723901] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-27T18:19:42.723956] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-27T18:19:42.820346] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-27T18:19:43.082735] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:43.100015] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T18:19:43.614986] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-27T18:19:44.226279] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:19:44.414935] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-27T18:19:44.996897] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:19:45.214912] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-27T18:19:45.772032] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:19:45.781619] [INFO ] [REMOTE ] DLR: Full fetch complete (74187 records). [2025-10-27T18:19:45.781806] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-27T18:19:46.024108] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-27T18:19:46.189702] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-27T18:19:46.189858] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-27T18:19:46.190892] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-27T18:19:46.190968] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-27T18:19:46.192503] [DEBUG] [LOCAL ] DLR: Trimmed 74187 records to 50574 (keeping 200 days of data) [2025-10-27T18:19:46.328083] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T18:19:46.342730] [INFO ] [REMOTE ] DKS: Full fetch complete (71393 records). [2025-10-27T18:19:46.348966] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-27T18:19:46.822314] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-27T18:19:46.877584] [DEBUG] [LOCAL ] DLR: Primary data saved (50574 records). [2025-10-27T18:19:46.929548] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-27T18:19:46.952717] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-27T18:19:46.953357] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLR took 26.4s. Estimated remaining: 3h 40m 11s. Rate: 7.9 symbols/min [2025-10-27T18:19:46.953853] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-27T18:19:46.960317] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-27T18:19:46.967729] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-27T18:19:47.061177] [DEBUG] [LOCAL ] DKS: Trimmed 71393 records to 49014 (keeping 200 days of data) [2025-10-27T18:19:47.150672] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T18:19:47.256863] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:47.402002] [DEBUG] [LOCAL ] DLY: Loaded 21112 existing records from primary storage. [2025-10-27T18:19:47.405376] [INFO ] [MAIN ] DLY: Loaded 21112 existing records. [2025-10-27T18:19:47.655369] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:47.656163] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-27T18:19:47.656035] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-27T18:19:47.657364] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-27T18:19:47.661960] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-27T18:19:47.662050] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-27T18:19:47.781230] [DEBUG] [LOCAL ] DKS: Primary data saved (49014 records). [2025-10-27T18:19:47.787126] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-27T18:19:47.797496] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DKS took 40.9s. Estimated remaining: 3h 39m 45s. Rate: 7.9 symbols/min [2025-10-27T18:19:48.150128] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:48.228948] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:48.252681] [DEBUG] [LOCAL ] DMA: Loaded 4751 existing records from primary storage. [2025-10-27T18:19:48.250153] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T18:19:48.259273] [INFO ] [MAIN ] DMA: Loaded 4751 existing records. [2025-10-27T18:19:48.429780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-27T18:19:48.434406] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:48.435268] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-27T18:19:48.435319] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-27T18:19:48.435471] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-27T18:19:48.435526] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-27T18:19:48.794084] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:48.812251] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T18:19:49.214954] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-27T18:19:49.643231] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:19:50.014966] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-27T18:19:50.212836] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T18:19:50.687617] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:19:50.815013] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-27T18:19:51.428169] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:19:51.614995] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-27T18:19:52.190458] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:19:52.414946] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-27T18:19:53.214948] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-27T18:19:53.915921] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:19:53.922466] [INFO ] [REMOTE ] DLB: Full fetch complete (47582 records). [2025-10-27T18:19:53.922585] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-27T18:19:54.020189] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-27T18:19:54.305141] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-27T18:19:54.305222] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-27T18:19:54.305900] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-27T18:19:54.305962] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-27T18:19:54.307013] [DEBUG] [LOCAL ] DLB: Trimmed 47582 records to 32098 (keeping 200 days of data) [2025-10-27T18:19:54.508706] [DEBUG] [LOCAL ] DLB: Primary data saved (32098 records). [2025-10-27T18:19:54.508910] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-27T18:19:54.509011] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLB took 40.8s. Estimated remaining: 3h 39m 35s. Rate: 7.9 symbols/min [2025-10-27T18:19:54.646964] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:19:54.654508] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:19:54.733544] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:19:54.746169] [DEBUG] [LOCAL ] DMB: Loaded 10587 existing records from primary storage. [2025-10-27T18:19:54.746387] [INFO ] [MAIN ] DMB: Loaded 10587 existing records. [2025-10-27T18:19:54.820139] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-27T18:19:54.926192] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:19:54.926418] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-27T18:19:54.926469] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-27T18:19:54.926759] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-27T18:19:54.926819] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-27T18:19:55.262353] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:19:55.331917] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:19:55.614958] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-27T18:19:56.205383] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:19:56.414940] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-27T18:19:56.820341] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T18:19:57.214942] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-27T18:19:57.563307] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:19:58.015059] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-27T18:19:58.814992] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-27T18:19:59.410228] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:19:59.614955] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-27T18:19:59.786707] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:19:59.966579] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:20:00.414942] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-27T18:20:01.214947] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-27T18:20:02.014994] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-27T18:20:02.249902] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T18:20:02.382420] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:20:02.814953] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-27T18:20:03.293887] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:20:03.614949] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-27T18:20:03.797252] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T18:20:04.360514] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T18:20:04.414901] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-27T18:20:05.036595] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:20:05.214956] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-27T18:20:05.989940] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:20:06.014971] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-27T18:20:06.548454] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:20:06.814935] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-27T18:20:07.603689] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:20:07.605072] [INFO ] [REMOTE ] DMA: Full fetch complete (6584 records). [2025-10-27T18:20:07.605139] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-27T18:20:07.620018] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-27T18:20:07.980509] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-27T18:20:07.980592] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-27T18:20:07.980795] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-27T18:20:07.980858] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-27T18:20:07.981253] [DEBUG] [LOCAL ] DMA: Trimmed 6584 records to 4689 (keeping 200 days of data) [2025-10-27T18:20:08.011346] [DEBUG] [LOCAL ] DMA: Primary data saved (4689 records). [2025-10-27T18:20:08.011457] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-27T18:20:08.011537] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 20.2s. Estimated remaining: 3h 39m 43s. Rate: 7.9 symbols/min [2025-10-27T18:20:08.183787] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:08.195148] [DEBUG] [LOCAL ] DMO: Loaded 9879 existing records from primary storage. [2025-10-27T18:20:08.195328] [INFO ] [MAIN ] DMO: Loaded 9879 existing records. [2025-10-27T18:20:08.373236] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:08.373421] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-27T18:20:08.373469] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-27T18:20:08.373610] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-27T18:20:08.373682] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-27T18:20:08.426035] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-27T18:20:08.833966] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:08.851927] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:20:09.214970] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-27T18:20:09.695503] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:20:10.014922] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-27T18:20:10.300511] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T18:20:10.814951] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-27T18:20:10.962676] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:20:11.614933] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-27T18:20:12.384255] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:20:12.414908] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-27T18:20:13.214921] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-27T18:20:13.287032] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-27T18:20:13.302170] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:20:14.014931] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-27T18:20:14.279296] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:20:14.814908] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-27T18:20:15.179546] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:20:15.359254] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T18:20:15.614927] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-27T18:20:16.414933] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-27T18:20:16.764671] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T18:20:17.173551] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T18:20:17.214895] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-27T18:20:18.014929] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-27T18:20:18.066462] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:20:18.512690] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:20:18.814947] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-27T18:20:19.614917] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-27T18:20:19.908247] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:20:20.134834] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T18:20:20.415006] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-27T18:20:21.214943] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-27T18:20:21.548543] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:20:21.554202] [INFO ] [REMOTE ] DLY: Full fetch complete (28868 records). [2025-10-27T18:20:21.554291] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-27T18:20:21.878978] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:20:21.960572] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-27T18:20:21.960699] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-27T18:20:21.961590] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-27T18:20:21.961680] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-27T18:20:21.962885] [DEBUG] [LOCAL ] DLY: Trimmed 28868 records to 20602 (keeping 200 days of data) [2025-10-27T18:20:22.016818] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-27T18:20:22.094878] [DEBUG] [LOCAL ] DLY: Primary data saved (20602 records). [2025-10-27T18:20:22.095017] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-27T18:20:22.095097] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DLY took 35.1s. Estimated remaining: 3h 39m 54s. Rate: 7.9 symbols/min [2025-10-27T18:20:22.280731] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:22.327418] [DEBUG] [LOCAL ] DNA: Loaded 49222 existing records from primary storage. [2025-10-27T18:20:22.327782] [INFO ] [MAIN ] DNA: Loaded 49222 existing records. [2025-10-27T18:20:22.526847] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:22.527127] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-27T18:20:22.527191] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-27T18:20:22.527462] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-27T18:20:22.527518] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-27T18:20:22.816376] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-27T18:20:22.887516] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:20:22.945278] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:23.614933] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-27T18:20:24.398556] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:20:24.403220] [INFO ] [REMOTE ] DLX: Full fetch complete (41227 records). [2025-10-27T18:20:24.403325] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-27T18:20:24.404150] [FATAL] [VALIDATOR ] DLX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:20:24.404233] [FATAL] [MAIN ] DLX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:20:24.404275] [WARN ] [MAIN ] DLX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:20:24.404348] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-27T18:20:24.404409] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-27T18:20:24.404444] [INFO ] [LOCAL ] DLX: Starting deletion of derivative data. [2025-10-27T18:20:24.404562] [DEBUG] [LOCAL ] DLX: Deleted derivative data file. [2025-10-27T18:20:24.404662] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DLX took 42.0s. Estimated remaining: 3h 39m 31s. Rate: 7.9 symbols/min [2025-10-27T18:20:24.425034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-27T18:20:24.564930] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T18:20:24.590388] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:24.630840] [DEBUG] [LOCAL ] DNOW: Loaded 44389 existing records from primary storage. [2025-10-27T18:20:24.631126] [INFO ] [MAIN ] DNOW: Loaded 44389 existing records. [2025-10-27T18:20:24.803786] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:24.804017] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-27T18:20:24.804063] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-27T18:20:24.804288] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-27T18:20:24.804325] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-27T18:20:25.157766] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:25.214901] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-27T18:20:26.014991] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-27T18:20:26.207717] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:20:26.210280] [INFO ] [REMOTE ] DMB: Full fetch complete (14513 records). [2025-10-27T18:20:26.210363] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-27T18:20:26.537034] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T18:20:26.616767] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-27T18:20:26.616851] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-27T18:20:26.617184] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-27T18:20:26.617244] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-27T18:20:26.617922] [DEBUG] [LOCAL ] DMB: Trimmed 14513 records to 10487 (keeping 200 days of data) [2025-10-27T18:20:26.679320] [DEBUG] [LOCAL ] DMB: Primary data saved (10487 records). [2025-10-27T18:20:26.679453] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-27T18:20:26.679531] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DMB took 32.2s. Estimated remaining: 3h 39m 9s. Rate: 7.9 symbols/min [2025-10-27T18:20:26.821436] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-27T18:20:26.847081] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:26.879055] [DEBUG] [LOCAL ] DNP: Loaded 33548 existing records from primary storage. [2025-10-27T18:20:26.879362] [INFO ] [MAIN ] DNP: Loaded 33548 existing records. [2025-10-27T18:20:27.090333] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:27.090734] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-27T18:20:27.090810] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-27T18:20:27.091105] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-27T18:20:27.091238] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-27T18:20:27.290467] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:20:27.478745] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:27.614931] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-27T18:20:28.414911] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-27T18:20:28.544188] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T18:20:29.069894] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T18:20:29.116872] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:20:29.214988] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-27T18:20:30.014950] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-27T18:20:30.412971] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:20:30.814995] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-27T18:20:30.968047] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:20:31.305921] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:20:31.614971] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-27T18:20:32.415010] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-27T18:20:32.912945] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:20:33.214939] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-27T18:20:33.430011] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T18:20:34.014992] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-27T18:20:34.382956] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:20:34.814954] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-27T18:20:35.385961] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:20:35.614987] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-27T18:20:35.938598] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:20:36.415010] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-27T18:20:37.214918] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-27T18:20:37.476778] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:20:37.990300] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:20:37.992469] [INFO ] [REMOTE ] DMO: Full fetch complete (14330 records). [2025-10-27T18:20:37.992542] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-27T18:20:38.023800] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-27T18:20:38.418055] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T18:20:38.462847] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-27T18:20:38.462953] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-27T18:20:38.463738] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-27T18:20:38.463804] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-27T18:20:38.464453] [DEBUG] [LOCAL ] DMO: Trimmed 14330 records to 9505 (keeping 200 days of data) [2025-10-27T18:20:38.536135] [DEBUG] [LOCAL ] DMO: Primary data saved (9505 records). [2025-10-27T18:20:38.536321] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-27T18:20:38.536446] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DMO took 30.5s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-27T18:20:38.780127] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:20:38.817767] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-27T18:20:38.853050] [DEBUG] [LOCAL ] DOC: Loaded 54334 existing records from primary storage. [2025-10-27T18:20:38.853924] [INFO ] [MAIN ] DOC: Loaded 54334 existing records. [2025-10-27T18:20:39.080776] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:20:39.081068] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-27T18:20:39.081128] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-27T18:20:39.081468] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-27T18:20:39.081532] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-27T18:20:39.509145] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:20:39.614973] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-27T18:20:39.777978] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T18:20:39.904213] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T18:20:40.414940] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-27T18:20:41.005028] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T18:20:41.214962] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-27T18:20:42.014976] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-27T18:20:42.157682] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:20:42.536065] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:20:42.814952] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-27T18:20:42.958878] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:20:43.614934] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-27T18:20:43.965763] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:20:44.414937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-27T18:20:44.581216] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T18:20:45.214965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-27T18:20:45.860479] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:20:46.014944] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-27T18:20:46.582373] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T18:20:46.814980] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-27T18:20:47.434102] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T18:20:47.614929] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-27T18:20:48.397466] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:20:48.414905] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-27T18:20:48.503556] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:20:49.215018] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-27T18:20:49.565310] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:20:49.571809] [INFO ] [REMOTE ] DNP: Full fetch complete (48469 records). [2025-10-27T18:20:49.571914] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-27T18:20:49.943416] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-27T18:20:49.943491] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-27T18:20:49.944147] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-27T18:20:49.944208] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-27T18:20:49.945156] [DEBUG] [LOCAL ] DNP: Trimmed 48469 records to 32861 (keeping 200 days of data) [2025-10-27T18:20:50.030396] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-27T18:20:50.147856] [DEBUG] [LOCAL ] DNP: Primary data saved (32861 records). [2025-10-27T18:20:50.148286] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-27T18:20:50.148403] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNP took 23.5s. Estimated remaining: 3h 39m 17s. Rate: 7.9 symbols/min [2025-10-27T18:20:50.469611] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:20:50.814994] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-27T18:20:51.521192] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:20:51.614951] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-27T18:20:52.325019] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:20:52.414905] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-27T18:20:53.214988] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-27T18:20:53.387864] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:20:53.396277] [INFO ] [REMOTE ] DNOW: Full fetch complete (63501 records). [2025-10-27T18:20:53.396415] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-27T18:20:53.397394] [FATAL] [VALIDATOR ] DNOW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:20:53.397501] [FATAL] [MAIN ] DNOW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:20:53.397552] [WARN ] [MAIN ] DNOW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:20:53.397618] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-27T18:20:53.397721] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-27T18:20:53.397770] [INFO ] [LOCAL ] DNOW: Starting deletion of derivative data. [2025-10-27T18:20:53.398095] [DEBUG] [LOCAL ] DNOW: Deleted derivative data file. [2025-10-27T18:20:53.398778] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DNOW took 29.0s. Estimated remaining: 3h 38m 57s. Rate: 7.9 symbols/min [2025-10-27T18:20:54.176819] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T18:20:54.187899] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-27T18:20:55.087688] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T18:20:55.098525] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-27T18:20:55.915336] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T18:20:55.925891] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-27T18:20:57.051067] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T18:20:57.061173] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-27T18:20:57.462496] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T18:20:57.474093] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-27T18:20:58.584728] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:20:58.595224] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-27T18:20:59.315072] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T18:20:59.326236] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-27T18:21:00.923267] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-27T18:21:00.932731] [INFO ] [REMOTE ] DNA: Full fetch complete (71120 records). [2025-10-27T18:21:00.932851] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-27T18:21:01.318746] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-27T18:21:01.318830] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-27T18:21:01.319723] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-27T18:21:01.319787] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-27T18:21:01.321201] [DEBUG] [LOCAL ] DNA: Trimmed 71120 records to 48413 (keeping 200 days of data) [2025-10-27T18:21:01.593378] [DEBUG] [LOCAL ] DNA: Primary data saved (48413 records). [2025-10-27T18:21:01.593501] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-27T18:21:01.594028] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DNA took 39.5s. Estimated remaining: 3h 38m 51s. Rate: 7.9 symbols/min [2025-10-27T18:21:01.973500] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-27T18:21:01.985041] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-27T18:21:04.342267] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-27T18:21:04.352516] [INFO ] [REMOTE ] DOC: Full fetch complete (77599 records). [2025-10-27T18:21:04.352669] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-27T18:21:04.743175] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-27T18:21:04.743257] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-27T18:21:04.744110] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-27T18:21:04.744195] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-27T18:21:04.745697] [DEBUG] [LOCAL ] DOC: Trimmed 77599 records to 53554 (keeping 200 days of data) [2025-10-27T18:21:05.066212] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-27T18:21:05.066345] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-27T18:21:05.066453] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOC took 26.5s. Estimated remaining: 3h 38m 32s. Rate: 7.9 symbols/min [2025-10-27T18:21:05.681098] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.709213] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.752185] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.797419] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:05.869264] [DEBUG] [LOCAL ] DOUG: Loaded 34109 existing records from primary storage. [2025-10-27T18:21:05.869777] [INFO ] [MAIN ] DOUG: Loaded 34109 existing records. [2025-10-27T18:21:05.918180] [DEBUG] [LOCAL ] DOCS: Loaded 50950 existing records from primary storage. [2025-10-27T18:21:05.918700] [INFO ] [MAIN ] DOCS: Loaded 50950 existing records. [2025-10-27T18:21:06.068968] [DEBUG] [LOCAL ] DOLE: Loaded 39659 existing records from primary storage. [2025-10-27T18:21:06.079696] [INFO ] [MAIN ] DOLE: Loaded 39659 existing records. [2025-10-27T18:21:06.107108] [DEBUG] [LOCAL ] DOCN: Loaded 51866 existing records from primary storage. [2025-10-27T18:21:06.135362] [INFO ] [MAIN ] DOCN: Loaded 51866 existing records. [2025-10-27T18:21:06.468428] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.481236] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.538425] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.569094] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-27T18:21:06.582223] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.619062] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-27T18:21:06.624259] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-27T18:21:06.618947] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.653706] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-27T18:21:06.653832] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-27T18:21:06.653626] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-27T18:21:06.702385] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.740732] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-27T18:21:06.771975] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-27T18:21:06.760311] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:06.791181] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-27T18:21:06.806479] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-27T18:21:06.806528] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-27T18:21:06.881281] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-27T18:21:06.893669] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-27T18:21:07.948219] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:07.969455] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-27T18:21:08.008108] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.038333] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-27T18:21:08.110191] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.136032] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-27T18:21:08.179312] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:08.179778] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-27T18:21:09.603309] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:21:09.610979] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-27T18:21:09.699120] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:21:09.707544] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-27T18:21:09.736898] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T18:21:09.746621] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-27T18:21:09.793698] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:21:09.803302] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-27T18:21:10.518818] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:21:10.526425] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-27T18:21:11.012362] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T18:21:11.018714] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-27T18:21:11.199320] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:21:11.209685] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-27T18:21:11.682145] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T18:21:11.691571] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-27T18:21:11.750955] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:21:11.758444] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-27T18:21:12.433810] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:21:12.441116] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-27T18:21:12.708635] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:21:12.716005] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-27T18:21:12.779817] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T18:21:12.790825] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-27T18:21:13.279439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:21:13.289464] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-27T18:21:13.505460] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:21:14.014928] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-27T18:21:14.174244] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:21:14.248937] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:21:14.814977] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-27T18:21:14.944141] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:21:15.113420] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:21:15.614929] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-27T18:21:16.410877] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T18:21:16.420839] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-27T18:21:16.633311] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:21:17.214945] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-27T18:21:17.760470] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:21:18.015021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-27T18:21:18.558704] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:21:18.814948] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-27T18:21:19.483239] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:21:19.614919] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-27T18:21:20.414979] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-27T18:21:20.626181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T18:21:20.888580] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:21:21.214955] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-27T18:21:21.911752] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T18:21:22.014982] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-27T18:21:22.814979] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-27T18:21:23.088736] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T18:21:23.474380] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T18:21:23.614935] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-27T18:21:24.300503] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:21:24.414949] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-27T18:21:25.214969] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-27T18:21:25.591375] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T18:21:25.963222] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:21:26.014903] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-27T18:21:26.700941] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:21:26.814913] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-27T18:21:26.951745] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T18:21:27.614927] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-27T18:21:28.414956] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-27T18:21:28.463316] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:21:28.554380] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:21:29.215007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-27T18:21:29.665891] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:21:29.673830] [INFO ] [REMOTE ] DOLE: Full fetch complete (54382 records). [2025-10-27T18:21:29.673967] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-27T18:21:29.674840] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:21:29.674960] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:21:29.675021] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:21:29.675065] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-27T18:21:29.675122] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-27T18:21:29.675159] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-27T18:21:29.675322] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-10-27T18:21:29.675399] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOLE took 24.6s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-10-27T18:21:29.854389] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:29.899467] [DEBUG] [LOCAL ] DOV: Loaded 46328 existing records from primary storage. [2025-10-27T18:21:29.899837] [INFO ] [MAIN ] DOV: Loaded 46328 existing records. [2025-10-27T18:21:30.020212] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-27T18:21:30.081611] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:30.081787] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-27T18:21:30.081831] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-27T18:21:30.082004] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-27T18:21:30.082041] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-27T18:21:30.439830] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:30.571619] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:21:30.577083] [INFO ] [REMOTE ] DOUG: Full fetch complete (49593 records). [2025-10-27T18:21:30.577170] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-27T18:21:30.824593] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-27T18:21:30.951741] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-27T18:21:30.951913] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-27T18:21:30.952596] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-27T18:21:30.952638] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-27T18:21:30.953714] [DEBUG] [LOCAL ] DOUG: Trimmed 49593 records to 33433 (keeping 200 days of data) [2025-10-27T18:21:31.132026] [DEBUG] [LOCAL ] DOUG: Primary data saved (33433 records). [2025-10-27T18:21:31.132155] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-27T18:21:31.132659] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOUG took 26.1s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-10-27T18:21:31.301480] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:31.348807] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-27T18:21:31.349107] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-10-27T18:21:31.523214] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:31.523347] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-27T18:21:31.523389] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-27T18:21:31.523630] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-27T18:21:31.523739] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-27T18:21:31.620222] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-27T18:21:31.895638] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:32.064901] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T18:21:32.073888] [INFO ] [REMOTE ] DOCS: Full fetch complete (73634 records). [2025-10-27T18:21:32.074004] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-27T18:21:32.437265] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-27T18:21:32.459450] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-27T18:21:32.459561] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-27T18:21:32.460511] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-27T18:21:32.460729] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-27T18:21:32.462776] [DEBUG] [LOCAL ] DOCS: Trimmed 73634 records to 50150 (keeping 200 days of data) [2025-10-27T18:21:32.688992] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T18:21:32.789823] [DEBUG] [LOCAL ] DOCS: Primary data saved (50150 records). [2025-10-27T18:21:32.789946] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-27T18:21:32.790020] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOCS took 27.7s. Estimated remaining: 3h 38m 23s. Rate: 7.9 symbols/min [2025-10-27T18:21:32.963934] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:32.978758] [DEBUG] [LOCAL ] DPG: Loaded 13476 existing records from primary storage. [2025-10-27T18:21:32.978978] [INFO ] [MAIN ] DPG: Loaded 13476 existing records. [2025-10-27T18:21:33.123266] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:21:33.197375] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:33.197571] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-27T18:21:33.197617] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-27T18:21:33.197809] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-27T18:21:33.197858] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-27T18:21:33.220125] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-27T18:21:33.556365] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:34.014951] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-27T18:21:34.584632] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-27T18:21:34.814957] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-27T18:21:35.356242] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T18:21:35.367638] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:21:35.375938] [INFO ] [REMOTE ] DOCN: Full fetch complete (73125 records). [2025-10-27T18:21:35.376418] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-27T18:21:35.560138] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T18:21:35.617179] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-27T18:21:35.783382] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-27T18:21:35.783478] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-27T18:21:35.784329] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-27T18:21:35.784403] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-27T18:21:35.785952] [DEBUG] [LOCAL ] DOCN: Trimmed 73125 records to 51095 (keeping 200 days of data) [2025-10-27T18:21:36.077442] [DEBUG] [LOCAL ] DOCN: Primary data saved (51095 records). [2025-10-27T18:21:36.077574] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-27T18:21:36.077691] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOCN took 31.0s. Estimated remaining: 3h 38m 4s. Rate: 7.9 symbols/min [2025-10-27T18:21:36.243606] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:21:36.282798] [DEBUG] [LOCAL ] DQ: Loaded 44422 existing records from primary storage. [2025-10-27T18:21:36.283203] [INFO ] [MAIN ] DQ: Loaded 44422 existing records. [2025-10-27T18:21:36.425715] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-27T18:21:36.462082] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:21:36.469440] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:21:36.469546] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-27T18:21:36.472452] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-27T18:21:36.472638] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-27T18:21:36.472737] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-27T18:21:36.825157] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:21:37.214941] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-27T18:21:37.894056] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:21:38.014938] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-27T18:21:38.679978] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T18:21:38.814922] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-27T18:21:39.351436] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:21:39.614913] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-27T18:21:40.414952] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-27T18:21:40.596104] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:21:40.746259] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T18:21:41.214986] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-27T18:21:41.358986] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T18:21:42.015004] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-27T18:21:42.704949] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:21:42.814926] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-27T18:21:43.548466] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:21:43.614899] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-27T18:21:43.787985] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T18:21:44.414981] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-27T18:21:45.055021] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:21:45.214964] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-27T18:21:45.720364] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T18:21:46.014937] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-27T18:21:46.814987] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-27T18:21:47.167953] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:21:47.399585] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T18:21:47.614907] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-27T18:21:47.680169] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:21:48.414962] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-27T18:21:48.556615] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T18:21:49.214943] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-27T18:21:49.781624] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:21:50.015016] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-27T18:21:50.427827] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:21:50.814951] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-27T18:21:51.614999] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-27T18:21:52.212849] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T18:21:52.277359] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:21:52.293289] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:21:52.414932] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-27T18:21:53.214973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-27T18:21:53.321523] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:21:54.014996] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-27T18:21:54.640356] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:21:54.814944] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-27T18:21:55.614955] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-27T18:21:55.890973] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T18:21:56.320914] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:21:56.414920] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-27T18:21:56.965154] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:21:57.214948] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-27T18:21:57.952763] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:21:58.014931] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-27T18:21:58.814919] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-27T18:21:59.067109] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T18:21:59.300878] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:21:59.614937] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-27T18:21:59.994876] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:22:00.414953] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-27T18:22:00.658038] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:22:01.214969] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-27T18:22:02.014993] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-27T18:22:02.176445] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:22:02.180231] [INFO ] [REMOTE ] DPG: Full fetch complete (19001 records). [2025-10-27T18:22:02.180393] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-27T18:22:02.579584] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T18:22:02.646288] [INFO ] [REMOTE ] DQ: Full fetch complete (63693 records). [2025-10-27T18:22:02.655069] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-27T18:22:02.655286] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-27T18:22:02.655242] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-27T18:22:02.655900] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-27T18:22:02.655986] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-27T18:22:02.721828] [DEBUG] [LOCAL ] DPG: Trimmed 19001 records to 13105 (keeping 200 days of data) [2025-10-27T18:22:02.819761] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-27T18:22:03.044630] [DEBUG] [LOCAL ] DPG: Primary data saved (13105 records). [2025-10-27T18:22:03.055256] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-27T18:22:03.060496] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 30.3s. Estimated remaining: 3h 38m 48s. Rate: 7.9 symbols/min [2025-10-27T18:22:03.216786] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-27T18:22:03.230078] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-27T18:22:03.249828] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-27T18:22:03.262702] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-27T18:22:03.308207] [DEBUG] [LOCAL ] DQ: Trimmed 63693 records to 43643 (keeping 200 days of data) [2025-10-27T18:22:03.342583] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:03.587147] [DEBUG] [LOCAL ] DRD: Loaded 38484 existing records from primary storage. [2025-10-27T18:22:03.588162] [INFO ] [MAIN ] DRD: Loaded 38484 existing records. [2025-10-27T18:22:03.733132] [DEBUG] [LOCAL ] DQ: Primary data saved (43643 records). [2025-10-27T18:22:03.748575] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-27T18:22:03.754389] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DQ took 27.7s. Estimated remaining: 3h 38m 22s. Rate: 7.9 symbols/min [2025-10-27T18:22:03.856629] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:03.868873] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-27T18:22:03.882763] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-27T18:22:03.904601] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-27T18:22:03.915123] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-27T18:22:04.069810] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:04.430931] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:04.445639] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-27T18:22:04.476404] [DEBUG] [LOCAL ] DRH: Loaded 50932 existing records from primary storage. [2025-10-27T18:22:04.477018] [INFO ] [MAIN ] DRH: Loaded 50932 existing records. [2025-10-27T18:22:04.491046] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-27T18:22:04.577758] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-27T18:22:04.590138] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-27T18:22:04.746098] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:22:04.810692] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:04.826863] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-27T18:22:04.837522] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-27T18:22:04.838000] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-27T18:22:04.839222] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-27T18:22:04.844779] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-27T18:22:05.414943] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-27T18:22:05.429048] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-27T18:22:05.435325] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-27T18:22:05.443757] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-27T18:22:05.545881] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:05.546086] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-27T18:22:05.546550] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-27T18:22:05.566933] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:22:05.900354] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-27T18:22:05.900484] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-27T18:22:05.900561] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DOW took 34.8s. Estimated remaining: 3h 37m 60s. Rate: 7.9 symbols/min [2025-10-27T18:22:06.020165] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-27T18:22:06.071419] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:06.115089] [DEBUG] [LOCAL ] DRI: Loaded 48148 existing records from primary storage. [2025-10-27T18:22:06.115409] [INFO ] [MAIN ] DRI: Loaded 48148 existing records. [2025-10-27T18:22:06.289054] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:06.289260] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-27T18:22:06.289308] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-27T18:22:06.289502] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-27T18:22:06.289559] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-27T18:22:06.637349] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:06.705365] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:22:06.714310] [INFO ] [REMOTE ] DOV: Full fetch complete (66001 records). [2025-10-27T18:22:06.714450] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-27T18:22:06.715199] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:22:06.715291] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:22:06.715363] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:22:06.715449] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-27T18:22:06.715527] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-27T18:22:06.715566] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-10-27T18:22:06.715732] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-10-27T18:22:06.716046] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DOV took 37.0s. Estimated remaining: 3h 37m 34s. Rate: 7.9 symbols/min [2025-10-27T18:22:06.815432] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-27T18:22:06.885496] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:06.897285] [DEBUG] [LOCAL ] DRLL: Loaded 8701 existing records from primary storage. [2025-10-27T18:22:06.897504] [INFO ] [MAIN ] DRLL: Loaded 8701 existing records. [2025-10-27T18:22:07.082784] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:07.083273] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-27T18:22:07.083375] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-27T18:22:07.083745] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-27T18:22:07.083872] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-27T18:22:07.281459] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T18:22:07.471638] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T18:22:07.509534] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:07.614899] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-27T18:22:08.260733] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:22:08.414945] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-27T18:22:08.621424] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:22:09.214940] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-27T18:22:09.449984] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:22:10.014945] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-27T18:22:10.573427] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:22:10.814967] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-27T18:22:11.332267] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:22:11.614940] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-27T18:22:12.404388] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:22:12.414904] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-27T18:22:13.205768] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:22:13.214828] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-27T18:22:13.859015] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:22:14.014948] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-27T18:22:14.551978] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:22:14.745763] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:22:14.814907] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-27T18:22:15.614980] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-27T18:22:16.414992] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-27T18:22:16.469502] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:22:16.950582] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:22:17.215119] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-27T18:22:17.872997] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T18:22:18.014928] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-27T18:22:18.808876] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:22:18.818921] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-27T18:22:19.534342] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:22:19.614931] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-27T18:22:19.971403] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:22:20.414970] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-27T18:22:20.909477] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:22:21.214953] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-27T18:22:21.548263] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T18:22:22.014951] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-27T18:22:22.616387] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:22:22.814985] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-27T18:22:23.458981] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:22:23.521399] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:22:23.614939] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-27T18:22:24.414970] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-27T18:22:24.852069] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:22:25.214951] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-27T18:22:26.014921] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-27T18:22:26.272793] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:22:26.281490] [INFO ] [REMOTE ] DRD: Full fetch complete (52539 records). [2025-10-27T18:22:26.281600] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-27T18:22:26.680005] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-27T18:22:26.680223] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-27T18:22:26.682189] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:22:26.683164] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-27T18:22:26.683747] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-27T18:22:26.689298] [DEBUG] [LOCAL ] DRD: Trimmed 52539 records to 37947 (keeping 200 days of data) [2025-10-27T18:22:26.816100] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-27T18:22:26.829839] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T18:22:26.969437] [DEBUG] [LOCAL ] DRD: Primary data saved (37947 records). [2025-10-27T18:22:26.969621] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-27T18:22:26.969751] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRD took 23.9s. Estimated remaining: 3h 37m 60s. Rate: 7.9 symbols/min [2025-10-27T18:22:27.133195] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:27.162885] [DEBUG] [LOCAL ] DSL: Loaded 29390 existing records from primary storage. [2025-10-27T18:22:27.163144] [INFO ] [MAIN ] DSL: Loaded 29390 existing records. [2025-10-27T18:22:27.333938] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:27.334163] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-27T18:22:27.334211] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-27T18:22:27.334394] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-27T18:22:27.334431] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-27T18:22:27.620153] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-27T18:22:27.682772] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:27.733160] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:22:28.414998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-27T18:22:29.024929] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:22:29.214948] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-27T18:22:29.688004] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:22:30.015095] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-27T18:22:30.819458] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-27T18:22:30.822400] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T18:22:30.984440] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:22:31.614957] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-27T18:22:31.646559] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:22:32.414938] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-27T18:22:33.214944] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-27T18:22:33.282839] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:22:33.313308] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:22:33.802697] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T18:22:34.014993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-27T18:22:34.814951] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-27T18:22:34.937427] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T18:22:35.614986] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-27T18:22:36.414955] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-27T18:22:36.519399] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:22:36.803614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:22:36.812495] [INFO ] [REMOTE ] DRI: Full fetch complete (69424 records). [2025-10-27T18:22:36.812601] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-27T18:22:37.023387] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T18:22:37.211614] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-27T18:22:37.211714] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-27T18:22:37.212485] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-27T18:22:37.212525] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-27T18:22:37.213812] [DEBUG] [LOCAL ] DRI: Trimmed 69424 records to 47373 (keeping 200 days of data) [2025-10-27T18:22:37.215007] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-27T18:22:37.515172] [DEBUG] [LOCAL ] DRI: Primary data saved (47373 records). [2025-10-27T18:22:37.515351] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-27T18:22:37.515444] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRI took 31.6s. Estimated remaining: 3h 38m 0s. Rate: 7.9 symbols/min [2025-10-27T18:22:37.766277] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:37.788391] [DEBUG] [LOCAL ] DSM: Loaded 14316 existing records from primary storage. [2025-10-27T18:22:37.788784] [INFO ] [MAIN ] DSM: Loaded 14316 existing records. [2025-10-27T18:22:37.993899] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:22:38.036554] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-27T18:22:38.097049] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:38.099031] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-27T18:22:38.099143] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-27T18:22:38.099400] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-27T18:22:38.099473] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-27T18:22:38.598318] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:38.815004] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-27T18:22:38.831532] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:22:38.833478] [INFO ] [REMOTE ] DRLL: Full fetch complete (14432 records). [2025-10-27T18:22:38.833557] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-27T18:22:39.250658] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-27T18:22:39.250742] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-27T18:22:39.251050] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-27T18:22:39.251085] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-27T18:22:39.251529] [DEBUG] [LOCAL ] DRLL: Trimmed 14432 records to 8444 (keeping 200 days of data) [2025-10-27T18:22:39.302516] [DEBUG] [LOCAL ] DRLL: Primary data saved (8444 records). [2025-10-27T18:22:39.302618] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-27T18:22:39.302721] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DRLL took 32.6s. Estimated remaining: 3h 37m 37s. Rate: 7.9 symbols/min [2025-10-27T18:22:39.467487] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:39.470735] [DEBUG] [LOCAL ] DSMC: Loaded 1800 existing records from primary storage. [2025-10-27T18:22:39.470875] [INFO ] [MAIN ] DSMC: Loaded 1800 existing records. [2025-10-27T18:22:39.620255] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-27T18:22:39.649887] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:39.650066] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-27T18:22:39.650111] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-27T18:22:39.650241] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-27T18:22:39.650279] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-27T18:22:40.002087] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:40.018243] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:22:40.414964] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-27T18:22:40.879556] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T18:22:41.214966] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-27T18:22:41.738593] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T18:22:42.014963] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-27T18:22:42.701508] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:22:42.814910] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-27T18:22:42.932869] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:22:42.942158] [INFO ] [REMOTE ] DRH: Full fetch complete (71895 records). [2025-10-27T18:22:42.942284] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-27T18:22:43.323897] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-27T18:22:43.323984] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-27T18:22:43.324867] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-27T18:22:43.324965] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-27T18:22:43.326843] [DEBUG] [LOCAL ] DRH: Trimmed 71895 records to 50096 (keeping 200 days of data) [2025-10-27T18:22:43.612332] [DEBUG] [LOCAL ] DRH: Primary data saved (50096 records). [2025-10-27T18:22:43.612466] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-27T18:22:43.612557] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DRH took 39.8s. Estimated remaining: 3h 37m 21s. Rate: 7.9 symbols/min [2025-10-27T18:22:43.623610] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-27T18:22:43.784727] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:43.801849] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:22:43.826570] [DEBUG] [LOCAL ] DSU: Loaded 23142 existing records from primary storage. [2025-10-27T18:22:43.826837] [INFO ] [MAIN ] DSU: Loaded 23142 existing records. [2025-10-27T18:22:44.009692] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:44.009907] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-27T18:22:44.009971] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-27T18:22:44.010190] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-27T18:22:44.010237] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-27T18:22:44.274672] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:22:44.370401] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:44.414925] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-27T18:22:45.214941] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-27T18:22:45.721587] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T18:22:46.014964] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-27T18:22:46.311999] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:22:46.390473] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:22:46.814996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-27T18:22:47.614991] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-27T18:22:47.912410] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T18:22:48.159015] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:22:48.415000] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-27T18:22:49.130162] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:22:49.214907] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-27T18:22:50.014921] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-27T18:22:50.082638] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T18:22:50.802511] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:22:50.814917] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-27T18:22:51.614944] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-27T18:22:51.962777] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:22:51.965702] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T18:22:51.973842] [INFO ] [REMOTE ] DSL: Full fetch complete (41908 records). [2025-10-27T18:22:51.973923] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-27T18:22:52.344824] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-27T18:22:52.344900] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-27T18:22:52.345479] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-27T18:22:52.345519] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-27T18:22:52.346362] [DEBUG] [LOCAL ] DSL: Trimmed 41908 records to 28643 (keeping 200 days of data) [2025-10-27T18:22:52.431363] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-27T18:22:52.523898] [DEBUG] [LOCAL ] DSL: Primary data saved (28643 records). [2025-10-27T18:22:52.524041] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-27T18:22:52.524125] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSL took 25.6s. Estimated remaining: 3h 37m 17s. Rate: 7.9 symbols/min [2025-10-27T18:22:52.696038] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:22:52.717274] [DEBUG] [LOCAL ] DSX: Loaded 23770 existing records from primary storage. [2025-10-27T18:22:52.717529] [INFO ] [MAIN ] DSX: Loaded 23770 existing records. [2025-10-27T18:22:52.896200] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T18:22:52.901531] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:22:52.903777] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-27T18:22:52.903827] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-27T18:22:52.904077] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-27T18:22:52.904136] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-27T18:22:53.218608] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-27T18:22:53.254210] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:22:53.932501] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:22:54.015003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-27T18:22:54.814951] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-27T18:22:55.009036] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:22:55.205465] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:22:55.614935] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-27T18:22:56.414992] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-27T18:22:56.590280] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:22:56.750339] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:22:57.214933] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-27T18:22:57.954546] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T18:22:58.014953] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-27T18:22:58.537697] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:22:58.814939] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-27T18:22:59.614957] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-27T18:23:00.414952] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-27T18:23:01.214981] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-27T18:23:04.099844] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (3.68 seconds). [2025-10-27T18:23:04.101382] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-27T18:23:04.927082] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (5.31 seconds). [2025-10-27T18:23:04.932823] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-27T18:23:05.651333] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (6.84 seconds). [2025-10-27T18:23:05.654736] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-27T18:23:05.977379] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T18:23:05.984985] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-27T18:23:06.108305] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T18:23:06.109580] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-27T18:23:06.200428] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T18:23:06.204108] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-27T18:23:06.351495] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (5.14 seconds). [2025-10-27T18:23:06.814897] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-27T18:23:06.922540] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:23:07.118663] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T18:23:07.121194] [INFO ] [REMOTE ] DSM: Full fetch complete (23854 records). [2025-10-27T18:23:07.121278] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-27T18:23:07.121841] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:07.121943] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:07.121985] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:07.122023] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-27T18:23:07.122091] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-27T18:23:07.122145] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-27T18:23:07.122613] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-27T18:23:07.122734] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSM took 29.6s. Estimated remaining: 3h 37m 27s. Rate: 7.9 symbols/min [2025-10-27T18:23:07.291370] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:07.339471] [DEBUG] [LOCAL ] DT: Loaded 53703 existing records from primary storage. [2025-10-27T18:23:07.339792] [INFO ] [MAIN ] DT: Loaded 53703 existing records. [2025-10-27T18:23:07.518159] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:07.518327] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-27T18:23:07.518372] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-27T18:23:07.519047] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-27T18:23:07.519198] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-27T18:23:07.616401] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-27T18:23:07.706614] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T18:23:07.723813] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:23:07.737976] [INFO ] [REMOTE ] DSMC: Full fetch complete (2884 records). [2025-10-27T18:23:07.760290] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-27T18:23:08.108759] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:08.254003] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-27T18:23:08.254071] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-27T18:23:08.254165] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-27T18:23:08.254221] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-27T18:23:08.254591] [DEBUG] [LOCAL ] DSMC: Trimmed 2884 records to 1704 (keeping 200 days of data) [2025-10-27T18:23:08.265344] [DEBUG] [LOCAL ] DSMC: Primary data saved (1704 records). [2025-10-27T18:23:08.265421] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-27T18:23:08.265494] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSMC took 29.0s. Estimated remaining: 3h 37m 3s. Rate: 7.9 symbols/min [2025-10-27T18:23:08.433354] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-27T18:23:08.437173] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:08.445398] [DEBUG] [LOCAL ] DTB: Loaded 4934 existing records from primary storage. [2025-10-27T18:23:08.445593] [INFO ] [MAIN ] DTB: Loaded 4934 existing records. [2025-10-27T18:23:08.627522] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:08.627789] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-27T18:23:08.627839] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-27T18:23:08.627969] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-27T18:23:08.628006] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-27T18:23:08.768639] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T18:23:09.000893] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:09.214917] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-27T18:23:09.704912] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:23:10.014913] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-27T18:23:10.316263] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:23:10.814947] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-27T18:23:11.172033] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:23:11.614950] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-27T18:23:12.275306] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T18:23:12.311033] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:23:12.414943] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-27T18:23:13.214949] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-27T18:23:13.616709] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T18:23:13.673962] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T18:23:14.015000] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-27T18:23:14.814961] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-27T18:23:15.342475] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:23:15.614914] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-27T18:23:15.804971] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:23:16.414937] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-27T18:23:17.214912] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-27T18:23:17.451295] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:23:17.494577] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:23:18.014939] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-27T18:23:18.120686] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T18:23:18.636317] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:23:18.814999] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-27T18:23:19.493352] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T18:23:19.614906] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-27T18:23:20.414931] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-27T18:23:20.881818] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:23:20.886236] [INFO ] [REMOTE ] DSX: Full fetch complete (35223 records). [2025-10-27T18:23:20.886326] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-27T18:23:21.071685] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T18:23:21.221081] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-27T18:23:21.269450] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-27T18:23:21.269529] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-27T18:23:21.270117] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-27T18:23:21.270182] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-27T18:23:21.271022] [DEBUG] [LOCAL ] DSX: Trimmed 35223 records to 23205 (keeping 200 days of data) [2025-10-27T18:23:21.404878] [DEBUG] [LOCAL ] DSX: Primary data saved (23205 records). [2025-10-27T18:23:21.405000] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-27T18:23:21.405073] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSX took 28.9s. Estimated remaining: 3h 37m 9s. Rate: 7.9 symbols/min [2025-10-27T18:23:21.572811] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:21.619252] [DEBUG] [LOCAL ] DTE: Loaded 47740 existing records from primary storage. [2025-10-27T18:23:21.619553] [INFO ] [MAIN ] DTE: Loaded 47740 existing records. [2025-10-27T18:23:21.801072] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:21.801331] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-27T18:23:21.801386] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-27T18:23:21.801560] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-27T18:23:21.801601] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-27T18:23:22.020049] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-27T18:23:22.156210] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:22.191894] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:23:22.196332] [INFO ] [REMOTE ] DSU: Full fetch complete (32790 records). [2025-10-27T18:23:22.196406] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-27T18:23:22.196978] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:22.197061] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:22.197104] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:22.197166] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-27T18:23:22.197227] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-27T18:23:22.197263] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-10-27T18:23:22.197392] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-10-27T18:23:22.197476] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DSU took 38.6s. Estimated remaining: 3h 36m 44s. Rate: 7.9 symbols/min [2025-10-27T18:23:22.362192] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:22.362347] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-27T18:23:22.362384] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-27T18:23:22.362491] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-27T18:23:22.362533] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-27T18:23:22.362573] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-27T18:23:22.362605] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-27T18:23:22.641835] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T18:23:22.718781] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:22.814946] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-27T18:23:23.144502] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T18:23:23.614946] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-27T18:23:24.414957] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-27T18:23:25.214978] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-27T18:23:25.289807] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T18:23:25.641891] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T18:23:26.015111] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-27T18:23:26.285074] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T18:23:26.814942] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-27T18:23:27.174150] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T18:23:27.515475] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T18:23:27.614983] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-27T18:23:28.067302] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T18:23:28.414987] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-27T18:23:29.215004] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-27T18:23:29.778993] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:23:30.014985] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-27T18:23:30.521351] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:23:30.815017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-27T18:23:31.374030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T18:23:31.620065] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-27T18:23:31.640492] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:23:32.138630] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:23:32.414997] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-27T18:23:33.194724] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:23:33.214897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-27T18:23:33.846445] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:23:34.015042] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-27T18:23:34.814947] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-27T18:23:35.464161] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:23:35.614961] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-27T18:23:36.065979] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T18:23:36.157134] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:23:36.414961] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-27T18:23:37.214952] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-27T18:23:37.769887] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:23:38.007525] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:23:38.008758] [INFO ] [REMOTE ] DTB: Full fetch complete (6481 records). [2025-10-27T18:23:38.008828] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-27T18:23:38.009254] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:23:38.009337] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:38.009379] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:38.009417] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-27T18:23:38.009472] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-27T18:23:38.009508] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-27T18:23:38.009661] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-27T18:23:38.009750] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DTB took 29.7s. Estimated remaining: 3h 36m 58s. Rate: 7.9 symbols/min [2025-10-27T18:23:38.020128] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-27T18:23:38.179182] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:38.186313] [DEBUG] [LOCAL ] DTG: Loaded 5731 existing records from primary storage. [2025-10-27T18:23:38.187117] [INFO ] [MAIN ] DTG: Loaded 5731 existing records. [2025-10-27T18:23:38.359055] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:38.359263] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-27T18:23:38.359312] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-27T18:23:38.359448] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-27T18:23:38.359484] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-27T18:23:38.543942] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:23:38.731682] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:38.814926] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-27T18:23:39.146521] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:23:39.614991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-27T18:23:40.073831] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T18:23:40.414960] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-27T18:23:41.104698] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T18:23:41.214962] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-27T18:23:42.014941] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-27T18:23:42.386047] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T18:23:42.814998] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-27T18:23:42.990544] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:23:43.256686] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:23:43.614948] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-27T18:23:44.415022] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-27T18:23:44.918393] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T18:23:45.101622] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:23:45.214913] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-27T18:23:46.014997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-27T18:23:46.814922] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-27T18:23:46.895256] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:23:47.384969] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:23:47.385784] [INFO ] [REMOTE ] DTF: Full fetch complete (1734 records). [2025-10-27T18:23:47.385872] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-27T18:23:47.580538] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T18:23:47.580819] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:23:47.580905] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:23:47.581020] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-27T18:23:47.581085] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-27T18:23:47.581122] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-27T18:23:47.581162] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-27T18:23:47.581219] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTF took 25.4s. Estimated remaining: 3h 36m 55s. Rate: 7.9 symbols/min [2025-10-27T18:23:47.620055] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-27T18:23:47.766309] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:47.766490] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-27T18:23:47.766629] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-27T18:23:47.766940] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-27T18:23:47.766999] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-27T18:23:47.767044] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-27T18:23:47.767078] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-27T18:23:48.134628] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:48.165362] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-27T18:23:48.414953] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-27T18:23:48.610171] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:23:48.610468] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-27T18:23:48.610554] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:23:48.610598] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-27T18:23:48.610678] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:23:48.610748] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-27T18:23:48.610809] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-27T18:23:48.610877] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-27T18:23:48.610938] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-27T18:23:48.610985] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTK took 1.0s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-27T18:23:48.783880] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:48.827560] [DEBUG] [LOCAL ] DTM: Loaded 44410 existing records from primary storage. [2025-10-27T18:23:48.827907] [INFO ] [MAIN ] DTM: Loaded 44410 existing records. [2025-10-27T18:23:49.014600] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:49.014957] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-27T18:23:49.015055] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-27T18:23:49.015441] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-27T18:23:49.015518] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-27T18:23:49.223297] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-27T18:23:49.296824] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:23:49.366236] [INFO ] [REMOTE ] DTE: Full fetch complete (68848 records). [2025-10-27T18:23:49.369608] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-27T18:23:49.556203] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:49.837237] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-27T18:23:49.837313] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-27T18:23:49.838144] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-27T18:23:49.838207] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-27T18:23:49.839531] [DEBUG] [LOCAL ] DTE: Trimmed 68848 records to 46946 (keeping 200 days of data) [2025-10-27T18:23:50.022301] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-27T18:23:50.123736] [DEBUG] [LOCAL ] DTE: Primary data saved (46946 records). [2025-10-27T18:23:50.123874] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-27T18:23:50.124629] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTE took 28.7s. Estimated remaining: 3h 36m 7s. Rate: 7.9 symbols/min [2025-10-27T18:23:50.289385] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:23:50.296995] [DEBUG] [LOCAL ] DTW: Loaded 4751 existing records from primary storage. [2025-10-27T18:23:50.297239] [INFO ] [MAIN ] DTW: Loaded 4751 existing records. [2025-10-27T18:23:50.471832] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:23:50.472020] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-27T18:23:50.472067] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-27T18:23:50.472198] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-27T18:23:50.472235] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-27T18:23:50.838837] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:23:50.834111] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-27T18:23:50.913415] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T18:23:51.398633] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T18:23:51.413788] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:23:51.614944] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-27T18:23:52.414946] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-27T18:23:52.641082] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:23:53.057172] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:23:53.214980] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-27T18:23:54.014951] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-27T18:23:54.594047] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:23:54.814923] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-27T18:23:55.350669] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T18:23:55.614967] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-27T18:23:55.713224] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:23:56.016123] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:23:56.414973] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-27T18:23:56.790073] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T18:23:57.214926] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-27T18:23:57.806073] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T18:23:58.015016] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-27T18:23:58.687810] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T18:23:58.814954] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-27T18:23:59.265796] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:23:59.614941] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-27T18:24:00.259275] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T18:24:00.414953] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-27T18:24:01.214954] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-27T18:24:02.014952] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-27T18:24:02.185245] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:24:02.186871] [INFO ] [REMOTE ] DTG: Full fetch complete (8495 records). [2025-10-27T18:24:02.186989] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-27T18:24:02.546508] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-27T18:24:02.546589] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-27T18:24:02.546828] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-27T18:24:02.546888] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-27T18:24:02.547334] [DEBUG] [LOCAL ] DTG: Trimmed 8495 records to 5634 (keeping 200 days of data) [2025-10-27T18:24:02.580144] [DEBUG] [LOCAL ] DTG: Primary data saved (5634 records). [2025-10-27T18:24:02.580239] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-27T18:24:02.580317] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTG took 24.6s. Estimated remaining: 3h 36m 12s. Rate: 7.9 symbols/min [2025-10-27T18:24:02.692242] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T18:24:02.757467] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:02.808070] [DEBUG] [LOCAL ] DUK: Loaded 54202 existing records from primary storage. [2025-10-27T18:24:02.808384] [INFO ] [MAIN ] DUK: Loaded 54202 existing records. [2025-10-27T18:24:02.820830] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-27T18:24:02.987284] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:02.987506] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-27T18:24:02.987554] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-27T18:24:02.987765] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-27T18:24:02.987820] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-27T18:24:03.346990] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:03.354117] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:24:03.524097] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-27T18:24:03.614921] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-27T18:24:04.414984] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-27T18:24:05.214973] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-27T18:24:05.697080] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T18:24:05.706971] [INFO ] [REMOTE ] DT: Full fetch complete (76876 records). [2025-10-27T18:24:05.707079] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-27T18:24:06.017291] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-27T18:24:06.116851] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-27T18:24:06.117000] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-27T18:24:06.117896] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-27T18:24:06.117969] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-27T18:24:06.119474] [DEBUG] [LOCAL ] DT: Trimmed 76876 records to 52910 (keeping 200 days of data) [2025-10-27T18:24:06.259841] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:24:06.451452] [DEBUG] [LOCAL ] DT: Primary data saved (52910 records). [2025-10-27T18:24:06.451584] [INFO ] [MAIN ] DT: Full history saved. [2025-10-27T18:24:06.451686] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DT took 59.3s. Estimated remaining: 3h 35m 55s. Rate: 7.9 symbols/min [2025-10-27T18:24:06.583692] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:24:06.631574] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:06.639170] [DEBUG] [LOCAL ] DUKB: Loaded 6185 existing records from primary storage. [2025-10-27T18:24:06.639358] [INFO ] [MAIN ] DUKB: Loaded 6185 existing records. [2025-10-27T18:24:06.815869] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-27T18:24:06.819255] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:06.820172] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-27T18:24:06.820235] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-27T18:24:06.820400] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-27T18:24:06.820457] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-27T18:24:07.182866] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:07.211132] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T18:24:07.614927] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-27T18:24:08.175311] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:24:08.239095] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T18:24:08.414931] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-27T18:24:09.214984] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-27T18:24:09.804638] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:24:09.832264] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:24:10.015003] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-27T18:24:10.672508] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:24:10.814940] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-27T18:24:11.169735] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:24:11.614938] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-27T18:24:12.414980] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-27T18:24:12.830726] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T18:24:13.214946] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-27T18:24:13.994196] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T18:24:14.014898] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-27T18:24:14.370907] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T18:24:14.427726] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:24:14.814935] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-27T18:24:15.477156] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:24:15.614940] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-27T18:24:16.414950] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-27T18:24:17.226549] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-27T18:24:17.229254] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:24:17.950683] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T18:24:18.015003] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-27T18:24:18.416288] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T18:24:18.558101] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T18:24:18.815027] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-27T18:24:19.614966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-27T18:24:20.100598] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T18:24:20.101902] [INFO ] [REMOTE ] DTW: Full fetch complete (6913 records). [2025-10-27T18:24:20.101971] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-27T18:24:20.426353] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-27T18:24:20.470360] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-27T18:24:20.470460] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-27T18:24:20.470715] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-27T18:24:20.470874] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-27T18:24:20.471276] [DEBUG] [LOCAL ] DTW: Trimmed 6913 records to 4638 (keeping 200 days of data) [2025-10-27T18:24:20.499720] [DEBUG] [LOCAL ] DTW: Primary data saved (4638 records). [2025-10-27T18:24:20.499817] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-27T18:24:20.499893] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 30.4s. Estimated remaining: 3h 36m 4s. Rate: 7.9 symbols/min [2025-10-27T18:24:20.673838] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:20.724364] [DEBUG] [LOCAL ] DV: Loaded 52001 existing records from primary storage. [2025-10-27T18:24:20.735836] [INFO ] [MAIN ] DV: Loaded 52001 existing records. [2025-10-27T18:24:20.872672] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-27T18:24:20.959238] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:20.960018] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-27T18:24:20.960071] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-27T18:24:20.960274] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-27T18:24:20.960330] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-27T18:24:21.220226] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-27T18:24:21.319935] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:22.014966] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-27T18:24:22.244875] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:24:22.253992] [INFO ] [REMOTE ] DTM: Full fetch complete (65291 records). [2025-10-27T18:24:22.254143] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-27T18:24:22.688079] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-27T18:24:22.688168] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-27T18:24:22.689010] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-27T18:24:22.689074] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-27T18:24:22.690403] [DEBUG] [LOCAL ] DTM: Trimmed 65291 records to 43642 (keeping 200 days of data) [2025-10-27T18:24:22.814949] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-27T18:24:22.960255] [DEBUG] [LOCAL ] DTM: Primary data saved (43642 records). [2025-10-27T18:24:22.960533] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-27T18:24:22.960672] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DTM took 34.3s. Estimated remaining: 3h 35m 43s. Rate: 7.9 symbols/min [2025-10-27T18:24:23.133351] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:23.172120] [DEBUG] [LOCAL ] DVA: Loaded 41227 existing records from primary storage. [2025-10-27T18:24:23.172442] [INFO ] [MAIN ] DVA: Loaded 41227 existing records. [2025-10-27T18:24:23.388036] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:23.389057] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-27T18:24:23.389574] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-27T18:24:23.391534] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-27T18:24:23.402057] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-27T18:24:23.402723] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-27T18:24:23.601021] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T18:24:23.617316] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-27T18:24:23.794245] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:24:23.835699] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:24.414931] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-27T18:24:25.214925] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-27T18:24:25.423815] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T18:24:25.533762] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T18:24:26.014952] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-27T18:24:26.322857] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:24:26.814924] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-27T18:24:27.574493] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T18:24:27.614917] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-27T18:24:28.013093] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T18:24:28.414988] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-27T18:24:29.108208] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:24:29.214920] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-27T18:24:29.784901] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:24:30.014945] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-27T18:24:30.814960] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-27T18:24:30.901850] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:24:31.340300] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:24:31.536362] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T18:24:31.615020] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-27T18:24:31.998792] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T18:24:32.414984] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-27T18:24:33.215013] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-27T18:24:33.971935] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:24:34.014908] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-27T18:24:34.711173] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:24:34.814931] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-27T18:24:35.607775] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:24:35.620539] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-27T18:24:36.123050] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:24:36.124374] [INFO ] [REMOTE ] DUKB: Full fetch complete (8916 records). [2025-10-27T18:24:36.124445] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-27T18:24:36.125342] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:36.125426] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:36.125492] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:36.125562] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-27T18:24:36.125629] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-27T18:24:36.125700] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-27T18:24:36.125847] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-27T18:24:36.125933] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DUKB took 29.7s. Estimated remaining: 3h 35m 49s. Rate: 7.9 symbols/min [2025-10-27T18:24:36.291769] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:36.341033] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-10-27T18:24:36.341351] [INFO ] [MAIN ] DVN: Loaded 54479 existing records. [2025-10-27T18:24:36.415050] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-27T18:24:36.521594] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:36.521880] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-27T18:24:36.522045] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-27T18:24:36.522310] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-27T18:24:36.522401] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-27T18:24:36.844625] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T18:24:36.892163] [INFO ] [REMOTE ] DUK: Full fetch complete (77170 records). [2025-10-27T18:24:36.906705] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-27T18:24:36.911262] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:36.912138] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:36.912241] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:36.912283] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:36.912323] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-27T18:24:36.912375] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-27T18:24:36.912409] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-27T18:24:36.912529] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-27T18:24:36.912595] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DUK took 34.3s. Estimated remaining: 3h 35m 24s. Rate: 7.9 symbols/min [2025-10-27T18:24:37.078396] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:37.129085] [DEBUG] [LOCAL ] DX: Loaded 53303 existing records from primary storage. [2025-10-27T18:24:37.129375] [INFO ] [MAIN ] DX: Loaded 53303 existing records. [2025-10-27T18:24:37.224504] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-27T18:24:37.304408] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:37.304576] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-27T18:24:37.304629] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-27T18:24:37.304864] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-27T18:24:37.304909] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-27T18:24:37.658698] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:38.014922] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-27T18:24:38.087750] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:24:38.814976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-27T18:24:39.082104] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:24:39.614949] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-27T18:24:40.279494] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-27T18:24:40.414908] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-27T18:24:40.598860] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:24:40.956527] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T18:24:41.214958] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-27T18:24:42.014917] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-27T18:24:42.122300] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:24:42.601216] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T18:24:42.815016] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-27T18:24:43.362468] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:24:43.614935] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-27T18:24:44.372637] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:24:44.414909] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-27T18:24:44.859888] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:24:45.215075] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-27T18:24:46.014945] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-27T18:24:46.614203] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-27T18:24:46.814899] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-27T18:24:47.078616] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T18:24:47.506711] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:24:47.614906] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-27T18:24:48.414926] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-27T18:24:48.528252] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T18:24:49.214921] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-27T18:24:49.342115] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T18:24:49.582907] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:24:50.014934] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-27T18:24:50.814911] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-27T18:24:50.866085] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:24:50.876025] [INFO ] [REMOTE ] DV: Full fetch complete (73906 records). [2025-10-27T18:24:50.876144] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-27T18:24:51.257097] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-27T18:24:51.257175] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-27T18:24:51.258097] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-27T18:24:51.258163] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-27T18:24:51.259490] [DEBUG] [LOCAL ] DV: Trimmed 73906 records to 51235 (keeping 200 days of data) [2025-10-27T18:24:51.557008] [DEBUG] [LOCAL ] DV: Primary data saved (51235 records). [2025-10-27T18:24:51.557167] [INFO ] [MAIN ] DV: Full history saved. [2025-10-27T18:24:51.557958] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DV took 31.1s. Estimated remaining: 3h 35m 35s. Rate: 7.9 symbols/min [2025-10-27T18:24:51.620252] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-27T18:24:51.739812] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:51.801003] [DEBUG] [LOCAL ] DXC: Loaded 50620 existing records from primary storage. [2025-10-27T18:24:51.801389] [INFO ] [MAIN ] DXC: Loaded 50620 existing records. [2025-10-27T18:24:51.990826] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:51.991206] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-27T18:24:51.991318] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-27T18:24:51.991599] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-27T18:24:51.991759] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-27T18:24:52.143476] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-27T18:24:52.389357] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:52.414901] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-27T18:24:52.696262] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:24:53.055330] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T18:24:53.214943] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-27T18:24:53.452150] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T18:24:54.014961] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-27T18:24:54.748199] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:24:54.755125] [INFO ] [REMOTE ] DVA: Full fetch complete (59341 records). [2025-10-27T18:24:54.755213] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-27T18:24:54.755864] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:24:54.755944] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:24:54.755986] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:24:54.756022] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-27T18:24:54.756077] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-27T18:24:54.756111] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-27T18:24:54.756229] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-10-27T18:24:54.756309] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DVA took 31.8s. Estimated remaining: 3h 35m 16s. Rate: 7.9 symbols/min [2025-10-27T18:24:54.820069] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-27T18:24:54.923630] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:24:54.959537] [DEBUG] [LOCAL ] DXYZ: Loaded 37529 existing records from primary storage. [2025-10-27T18:24:54.959867] [INFO ] [MAIN ] DXYZ: Loaded 37529 existing records. [2025-10-27T18:24:55.143957] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:24:55.144168] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-27T18:24:55.144216] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-27T18:24:55.144397] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-27T18:24:55.144436] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-27T18:24:55.512880] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:24:55.614924] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-27T18:24:55.717092] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:24:56.351208] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:24:56.414956] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-27T18:24:57.214949] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-27T18:24:57.721796] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T18:24:57.786287] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T18:24:58.014927] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-27T18:24:58.814917] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-27T18:24:59.319522] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T18:24:59.391396] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:24:59.614937] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-27T18:25:00.414924] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-27T18:25:00.830853] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T18:25:01.214923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-27T18:25:01.258142] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:25:02.015005] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-27T18:25:02.391918] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T18:25:02.814957] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-27T18:25:03.130854] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:25:03.442188] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:25:03.614930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-27T18:25:04.414920] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-27T18:25:04.670865] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:25:05.104190] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:25:05.214937] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-27T18:25:06.014961] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-27T18:25:06.194780] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:25:06.814927] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-27T18:25:06.860404] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:25:07.614932] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-27T18:25:07.735788] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:25:08.414911] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-27T18:25:08.736291] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:25:08.917804] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:25:09.214925] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-27T18:25:10.014943] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-27T18:25:10.522711] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:25:10.533013] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-27T18:25:10.533139] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-27T18:25:10.821378] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-27T18:25:10.936330] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-27T18:25:10.936677] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-27T18:25:10.938199] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-27T18:25:10.938353] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-27T18:25:10.968494] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:25:10.979370] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-10-27T18:25:11.329568] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-27T18:25:11.329805] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-27T18:25:11.329991] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DVN took 35.2s. Estimated remaining: 3h 35m 31s. Rate: 7.9 symbols/min [2025-10-27T18:25:11.522441] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:11.548006] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:25:11.557804] [INFO ] [REMOTE ] DXC: Full fetch complete (70454 records). [2025-10-27T18:25:11.557943] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-27T18:25:11.620073] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-27T18:25:11.739745] [DEBUG] [LOCAL ] DY: Loaded 28284 existing records from primary storage. [2025-10-27T18:25:11.774682] [INFO ] [MAIN ] DY: Loaded 28284 existing records. [2025-10-27T18:25:12.156456] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:12.159965] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-27T18:25:12.160092] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-27T18:25:12.160043] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-27T18:25:12.160998] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-27T18:25:12.160175] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-27T18:25:12.161120] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-27T18:25:12.161300] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-27T18:25:12.161356] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-27T18:25:12.263079] [DEBUG] [LOCAL ] DXC: Trimmed 70454 records to 49831 (keeping 200 days of data) [2025-10-27T18:25:12.690798] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:12.717026] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-27T18:25:12.805600] [DEBUG] [LOCAL ] DXC: Primary data saved (49831 records). [2025-10-27T18:25:12.805751] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-27T18:25:12.806382] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 21.2s. Estimated remaining: 3h 35m 8s. Rate: 7.9 symbols/min [2025-10-27T18:25:12.974777] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:13.006635] [DEBUG] [LOCAL ] E: Loaded 33700 existing records from primary storage. [2025-10-27T18:25:13.006932] [INFO ] [MAIN ] E: Loaded 33700 existing records. [2025-10-27T18:25:13.166432] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T18:25:13.213245] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:13.213683] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-27T18:25:13.213740] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-27T18:25:13.213947] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-27T18:25:13.213984] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-27T18:25:13.244710] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-27T18:25:13.562099] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:13.807997] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T18:25:13.817962] [INFO ] [REMOTE ] DX: Full fetch complete (75562 records). [2025-10-27T18:25:13.818120] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-27T18:25:13.818995] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:25:13.819110] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:25:13.819153] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:25:13.819190] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-27T18:25:13.819246] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-27T18:25:13.819281] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-27T18:25:13.819402] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-27T18:25:13.819866] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DX took 36.9s. Estimated remaining: 3h 34m 44s. Rate: 7.9 symbols/min [2025-10-27T18:25:13.986591] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:14.014957] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-27T18:25:14.028921] [DEBUG] [LOCAL ] EAF: Loaded 41299 existing records from primary storage. [2025-10-27T18:25:14.029217] [INFO ] [MAIN ] EAF: Loaded 41299 existing records. [2025-10-27T18:25:14.230355] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:14.230718] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-27T18:25:14.230780] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-27T18:25:14.230947] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-27T18:25:14.230984] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-27T18:25:14.423418] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:25:14.605790] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:14.814897] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-27T18:25:15.012237] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:25:15.238592] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:25:15.615014] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-27T18:25:16.338072] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:25:16.414950] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-27T18:25:16.464722] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:25:17.214995] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-27T18:25:17.557431] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:25:18.015003] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-27T18:25:18.631355] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:25:18.814994] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-27T18:25:19.198806] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:25:19.614932] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-27T18:25:20.360524] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T18:25:20.414973] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-27T18:25:21.214967] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-27T18:25:21.566555] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T18:25:21.743366] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:25:22.014964] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-27T18:25:22.218712] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T18:25:22.814976] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-27T18:25:23.099533] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:25:23.615027] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-27T18:25:24.414954] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-27T18:25:24.580419] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T18:25:25.035598] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:25:25.214961] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-27T18:25:25.555331] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:25:26.014954] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-27T18:25:26.763399] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:25:26.814901] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-27T18:25:27.136132] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:25:27.614953] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-27T18:25:28.093475] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T18:25:28.415009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-27T18:25:29.020831] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:25:29.214946] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-27T18:25:29.387571] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T18:25:29.995067] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:25:30.014973] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-27T18:25:30.815000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-27T18:25:31.532502] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:25:31.614966] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-27T18:25:32.079507] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:25:32.414960] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-27T18:25:33.214991] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-27T18:25:33.493160] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:25:33.941215] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:25:33.947364] [INFO ] [REMOTE ] E: Full fetch complete (47634 records). [2025-10-27T18:25:33.947462] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-27T18:25:34.016853] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-27T18:25:34.334738] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T18:25:34.357768] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-27T18:25:34.358185] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-27T18:25:34.358956] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-27T18:25:34.359025] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-27T18:25:34.360266] [DEBUG] [LOCAL ] E: Trimmed 47634 records to 32833 (keeping 200 days of data) [2025-10-27T18:25:34.557246] [DEBUG] [LOCAL ] E: Primary data saved (32833 records). [2025-10-27T18:25:34.557380] [INFO ] [MAIN ] E: Full history saved. [2025-10-27T18:25:34.557456] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. E took 21.8s. Estimated remaining: 3h 35m 9s. Rate: 7.9 symbols/min [2025-10-27T18:25:34.724590] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:34.730022] [DEBUG] [LOCAL ] EAI: Loaded 3971 existing records from primary storage. [2025-10-27T18:25:34.730211] [INFO ] [MAIN ] EAI: Loaded 3971 existing records. [2025-10-27T18:25:34.821893] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-27T18:25:34.910986] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:34.911190] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-27T18:25:34.911235] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-27T18:25:34.911435] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-27T18:25:34.911492] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-27T18:25:35.262060] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:35.288216] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:25:35.614918] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-27T18:25:35.940080] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T18:25:36.123101] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:25:36.414917] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-27T18:25:37.214946] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-27T18:25:37.566015] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T18:25:38.014924] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-27T18:25:38.050526] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:25:38.814996] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-27T18:25:39.352246] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:25:39.614932] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-27T18:25:39.982239] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:25:40.414950] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-27T18:25:40.444053] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:25:40.828427] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:25:41.214941] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-27T18:25:41.895940] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T18:25:42.014915] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-27T18:25:42.814915] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-27T18:25:43.221939] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:25:43.226336] [INFO ] [REMOTE ] DY: Full fetch complete (43228 records). [2025-10-27T18:25:43.226422] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-27T18:25:43.590559] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-27T18:25:43.590634] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-27T18:25:43.591267] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-27T18:25:43.591312] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-27T18:25:43.592186] [DEBUG] [LOCAL ] DY: Trimmed 43228 records to 27690 (keeping 200 days of data) [2025-10-27T18:25:43.640537] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-27T18:25:43.754884] [DEBUG] [LOCAL ] DY: Primary data saved (27690 records). [2025-10-27T18:25:43.755002] [INFO ] [MAIN ] DY: Full history saved. [2025-10-27T18:25:43.755076] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. DY took 32.4s. Estimated remaining: 3h 35m 5s. Rate: 7.9 symbols/min [2025-10-27T18:25:43.919909] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:43.945734] [DEBUG] [LOCAL ] EARN: Loaded 28066 existing records from primary storage. [2025-10-27T18:25:43.946077] [INFO ] [MAIN ] EARN: Loaded 28066 existing records. [2025-10-27T18:25:44.054500] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:25:44.135544] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:44.135933] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-27T18:25:44.136098] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-27T18:25:44.136497] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-27T18:25:44.136556] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-27T18:25:44.253717] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:25:44.420156] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-27T18:25:44.514686] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:45.214941] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-27T18:25:46.014946] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-27T18:25:46.404424] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:25:46.412174] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56371 records). [2025-10-27T18:25:46.412289] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-27T18:25:46.699057] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T18:25:46.793300] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-27T18:25:46.793450] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-27T18:25:46.794182] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-27T18:25:46.794244] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-27T18:25:46.795317] [DEBUG] [LOCAL ] DXYZ: Trimmed 56371 records to 36706 (keeping 200 days of data) [2025-10-27T18:25:46.842824] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-27T18:25:47.006634] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T18:25:47.036987] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36706 records). [2025-10-27T18:25:47.037086] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-27T18:25:47.037155] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. DXYZ took 52.3s. Estimated remaining: 3h 34m 47s. Rate: 7.9 symbols/min [2025-10-27T18:25:47.204672] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:47.250458] [DEBUG] [LOCAL ] EAT: Loaded 50437 existing records from primary storage. [2025-10-27T18:25:47.255048] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T18:25:47.257087] [INFO ] [MAIN ] EAT: Loaded 50437 existing records. [2025-10-27T18:25:47.428168] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:47.428353] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-27T18:25:47.428397] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-27T18:25:47.428583] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-27T18:25:47.428637] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-27T18:25:47.625479] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-27T18:25:47.770932] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:48.414958] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-27T18:25:49.154902] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:25:49.214899] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-27T18:25:50.014916] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-27T18:25:50.275609] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:25:50.814914] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-27T18:25:50.882962] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T18:25:51.183780] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T18:25:51.366748] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:25:51.375548] [INFO ] [REMOTE ] EAF: Full fetch complete (61676 records). [2025-10-27T18:25:51.375736] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-27T18:25:51.624571] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-27T18:25:51.765789] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-27T18:25:51.765870] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-27T18:25:51.766608] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-27T18:25:51.766674] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-27T18:25:51.767904] [DEBUG] [LOCAL ] EAF: Trimmed 61676 records to 40545 (keeping 200 days of data) [2025-10-27T18:25:51.988184] [DEBUG] [LOCAL ] EAF: Primary data saved (40545 records). [2025-10-27T18:25:51.988302] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-27T18:25:51.988375] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. EAF took 38.2s. Estimated remaining: 3h 34m 33s. Rate: 7.9 symbols/min [2025-10-27T18:25:52.155971] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:25:52.187447] [DEBUG] [LOCAL ] EB: Loaded 36579 existing records from primary storage. [2025-10-27T18:25:52.187773] [INFO ] [MAIN ] EB: Loaded 36579 existing records. [2025-10-27T18:25:52.359231] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:25:52.359424] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-27T18:25:52.359497] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-27T18:25:52.359788] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-27T18:25:52.359858] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-27T18:25:52.421451] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-27T18:25:52.709038] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:25:53.214931] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-27T18:25:53.299877] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:25:53.301518] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:25:53.303228] [INFO ] [REMOTE ] EAI: Full fetch complete (5771 records). [2025-10-27T18:25:53.311729] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-27T18:25:53.670212] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-27T18:25:53.670298] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-27T18:25:53.670456] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-27T18:25:53.670494] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-27T18:25:53.670931] [DEBUG] [LOCAL ] EAI: Trimmed 5771 records to 3807 (keeping 200 days of data) [2025-10-27T18:25:53.693595] [DEBUG] [LOCAL ] EAI: Primary data saved (3807 records). [2025-10-27T18:25:53.693737] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-27T18:25:53.693839] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EAI took 19.1s. Estimated remaining: 3h 34m 10s. Rate: 7.9 symbols/min [2025-10-27T18:25:54.015007] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-27T18:25:54.774759] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:25:54.814903] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-27T18:25:55.461554] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:25:55.614957] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-27T18:25:56.285951] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T18:25:56.414952] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-27T18:25:56.608719] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:25:57.214943] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-27T18:25:57.874142] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:25:57.948190] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:25:58.014935] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-27T18:25:58.814915] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-27T18:25:59.194205] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T18:25:59.614950] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-27T18:26:00.414974] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-27T18:26:00.650870] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:26:01.102601] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:26:01.214909] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-27T18:26:01.719718] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:26:02.014946] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-27T18:26:02.654688] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:26:02.814957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-27T18:26:03.614921] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-27T18:26:03.818217] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T18:26:03.848142] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T18:26:04.366428] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:26:04.414919] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-27T18:26:05.215008] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-27T18:26:05.692243] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:26:05.697786] [INFO ] [REMOTE ] EARN: Full fetch complete (45017 records). [2025-10-27T18:26:05.697877] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-27T18:26:06.024213] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-27T18:26:06.076162] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-27T18:26:06.076240] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-27T18:26:06.076945] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-27T18:26:06.077009] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-27T18:26:06.078019] [DEBUG] [LOCAL ] EARN: Trimmed 45017 records to 27168 (keeping 200 days of data) [2025-10-27T18:26:06.247458] [DEBUG] [LOCAL ] EARN: Primary data saved (27168 records). [2025-10-27T18:26:06.247626] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-27T18:26:06.247769] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EARN took 22.5s. Estimated remaining: 3h 34m 15s. Rate: 7.9 symbols/min [2025-10-27T18:26:06.679963] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:26:06.814899] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-27T18:26:07.697140] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T18:26:07.705723] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-27T18:26:08.262968] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:26:08.414954] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-27T18:26:08.765134] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:26:09.214937] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-27T18:26:10.255781] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:26:10.266879] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-27T18:26:10.532615] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:26:10.815000] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-27T18:26:12.064539] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:26:12.070936] [INFO ] [REMOTE ] EB: Full fetch complete (54656 records). [2025-10-27T18:26:12.071040] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-27T18:26:12.460720] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-27T18:26:12.487429] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-27T18:26:12.487508] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-27T18:26:12.488464] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-27T18:26:12.488542] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-27T18:26:12.489480] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-27T18:26:12.490795] [DEBUG] [LOCAL ] EB: Trimmed 54656 records to 35786 (keeping 200 days of data) [2025-10-27T18:26:12.682854] [DEBUG] [LOCAL ] EB: Primary data saved (35786 records). [2025-10-27T18:26:12.683017] [INFO ] [MAIN ] EB: Full history saved. [2025-10-27T18:26:12.683137] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EB took 20.7s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-10-27T18:26:13.925600] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T18:26:13.936363] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-27T18:26:15.852429] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T18:26:15.863755] [INFO ] [REMOTE ] EAT: Full fetch complete (72457 records). [2025-10-27T18:26:15.863931] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-27T18:26:16.390774] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-27T18:26:16.390895] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-27T18:26:16.392443] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-27T18:26:16.392533] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-27T18:26:16.394479] [DEBUG] [LOCAL ] EAT: Trimmed 72457 records to 49667 (keeping 200 days of data) [2025-10-27T18:26:16.724590] [DEBUG] [LOCAL ] EAT: Primary data saved (49667 records). [2025-10-27T18:26:16.724771] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-27T18:26:16.724862] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EAT took 29.7s. Estimated remaining: 3h 33m 48s. Rate: 7.9 symbols/min [2025-10-27T18:26:17.373588] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.367530] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.451318] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.452364] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:17.489988] [DEBUG] [LOCAL ] EBF: Loaded 19579 existing records from primary storage. [2025-10-27T18:26:17.509298] [INFO ] [MAIN ] EBF: Loaded 19579 existing records. [2025-10-27T18:26:17.653956] [DEBUG] [LOCAL ] EBS: Loaded 47237 existing records from primary storage. [2025-10-27T18:26:17.654599] [DEBUG] [LOCAL ] EBR: Loaded 43984 existing records from primary storage. [2025-10-27T18:26:17.655559] [DEBUG] [LOCAL ] EC: Loaded 49596 existing records from primary storage. [2025-10-27T18:26:17.666591] [INFO ] [MAIN ] EBS: Loaded 47237 existing records. [2025-10-27T18:26:17.672235] [INFO ] [MAIN ] EBR: Loaded 43984 existing records. [2025-10-27T18:26:17.762368] [INFO ] [MAIN ] EC: Loaded 49596 existing records. [2025-10-27T18:26:17.891342] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.002686] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.052234] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-27T18:26:18.100027] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-27T18:26:18.145319] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-27T18:26:18.295517] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.258326] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.329819] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.340805] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.365146] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-27T18:26:18.387491] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:18.403494] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-27T18:26:18.378379] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-27T18:26:18.412592] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-27T18:26:18.412882] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-27T18:26:18.424274] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-27T18:26:18.424417] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-27T18:26:18.442862] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-27T18:26:18.453574] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-27T18:26:18.579272] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-27T18:26:19.461375] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.555888] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-27T18:26:19.820167] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.842453] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-27T18:26:19.845538] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.846753] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-27T18:26:19.931730] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:19.932133] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-27T18:26:20.869189] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T18:26:20.872931] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-27T18:26:20.998804] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:26:21.007619] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-27T18:26:21.243423] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:26:21.252387] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-27T18:26:21.545700] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:26:21.550063] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-27T18:26:21.869775] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T18:26:21.879494] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-27T18:26:22.011100] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T18:26:22.018691] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-27T18:26:22.385182] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T18:26:22.391150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-27T18:26:22.447664] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T18:26:22.458634] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-27T18:26:23.131180] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:26:23.141419] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-27T18:26:23.243480] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T18:26:23.270420] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T18:26:23.615005] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-27T18:26:23.674182] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:26:24.414956] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-27T18:26:24.674142] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:26:25.129163] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:26:25.214901] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-27T18:26:25.385723] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T18:26:26.014972] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-27T18:26:26.731715] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:26:26.814942] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-27T18:26:27.053582] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:26:27.614986] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-27T18:26:28.191039] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:26:28.414914] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-27T18:26:28.711908] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:26:29.214951] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-27T18:26:29.920421] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:26:30.014919] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-27T18:26:30.376727] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:26:30.814982] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-27T18:26:31.113027] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:26:31.614959] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-27T18:26:32.335288] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:26:32.414903] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-27T18:26:32.604265] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:26:33.214981] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-27T18:26:34.014928] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-27T18:26:34.057200] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:26:34.383806] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T18:26:34.388597] [INFO ] [REMOTE ] EBF: Full fetch complete (28459 records). [2025-10-27T18:26:34.388734] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-27T18:26:34.756544] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-27T18:26:34.756623] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-27T18:26:34.757196] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-27T18:26:34.757257] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-27T18:26:34.757995] [DEBUG] [LOCAL ] EBF: Trimmed 28459 records to 19197 (keeping 200 days of data) [2025-10-27T18:26:34.840038] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-27T18:26:34.876087] [DEBUG] [LOCAL ] EBF: Primary data saved (19197 records). [2025-10-27T18:26:34.876239] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-27T18:26:34.876322] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. EBF took 18.2s. Estimated remaining: 3h 34m 6s. Rate: 7.9 symbols/min [2025-10-27T18:26:35.072332] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:35.112972] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:26:35.132381] [DEBUG] [LOCAL ] ECAT: Loaded 29468 existing records from primary storage. [2025-10-27T18:26:35.132682] [INFO ] [MAIN ] ECAT: Loaded 29468 existing records. [2025-10-27T18:26:35.307274] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:35.307485] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-27T18:26:35.307532] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-27T18:26:35.307775] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-27T18:26:35.307831] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-27T18:26:35.621121] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-27T18:26:35.662468] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:36.414929] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-27T18:26:36.550123] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:26:37.214968] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-27T18:26:37.323595] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T18:26:38.014934] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-27T18:26:38.248833] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T18:26:38.338117] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T18:26:38.814998] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-27T18:26:39.614919] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-27T18:26:39.678096] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T18:26:39.974778] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T18:26:40.415020] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-27T18:26:41.175316] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:26:41.214901] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-27T18:26:41.900787] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T18:26:42.014983] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-27T18:26:42.629839] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:26:42.814915] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-27T18:26:43.315549] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:26:43.614929] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-27T18:26:44.423669] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-27T18:26:44.427371] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:26:44.580483] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:26:44.588923] [INFO ] [REMOTE ] EBR: Full fetch complete (62078 records). [2025-10-27T18:26:44.589025] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-27T18:26:44.589704] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:26:44.589790] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:26:44.589832] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:26:44.589870] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-27T18:26:44.589933] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-10-27T18:26:44.589973] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-10-27T18:26:44.590126] [DEBUG] [LOCAL ] EBR: Deleted derivative data file. [2025-10-27T18:26:44.590212] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. EBR took 27.9s. Estimated remaining: 3h 34m 4s. Rate: 7.9 symbols/min [2025-10-27T18:26:44.756489] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:44.794393] [DEBUG] [LOCAL ] ECC: Loaded 43956 existing records from primary storage. [2025-10-27T18:26:44.794695] [INFO ] [MAIN ] ECC: Loaded 43956 existing records. [2025-10-27T18:26:44.974054] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:44.974294] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-27T18:26:44.974358] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-27T18:26:44.974539] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-27T18:26:44.974578] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-27T18:26:45.220048] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-27T18:26:45.320691] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:46.014916] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-27T18:26:46.324401] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:26:46.333706] [INFO ] [REMOTE ] EC: Full fetch complete (71873 records). [2025-10-27T18:26:46.333839] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-27T18:26:46.755521] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-27T18:26:46.755628] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-27T18:26:46.756578] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-27T18:26:46.756686] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-27T18:26:46.785282] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:26:46.794995] [DEBUG] [LOCAL ] EC: Trimmed 71873 records to 48770 (keeping 200 days of data) [2025-10-27T18:26:46.847336] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-27T18:26:46.994970] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:26:47.110212] [DEBUG] [LOCAL ] EC: Primary data saved (48770 records). [2025-10-27T18:26:47.110367] [INFO ] [MAIN ] EC: Full history saved. [2025-10-27T18:26:47.110462] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 30.4s. Estimated remaining: 3h 33m 44s. Rate: 7.9 symbols/min [2025-10-27T18:26:47.277365] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:47.277529] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-27T18:26:47.277567] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-27T18:26:47.277673] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-27T18:26:47.277730] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-27T18:26:47.277775] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-27T18:26:47.277840] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-27T18:26:47.620055] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-27T18:26:47.624417] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:47.911512] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T18:26:48.415000] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-27T18:26:49.019353] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:26:49.214932] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-27T18:26:49.333583] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T18:26:50.015002] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-27T18:26:50.296265] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-27T18:26:50.297576] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:26:50.814935] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-27T18:26:51.614942] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-27T18:26:51.789669] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T18:26:51.946235] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T18:26:52.414949] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-27T18:26:52.786371] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:26:53.214932] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-27T18:26:53.508390] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T18:26:54.014955] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-27T18:26:54.814946] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-27T18:26:55.257772] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:26:55.279456] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T18:26:55.614959] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-27T18:26:55.972960] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T18:26:56.414936] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-27T18:26:57.214996] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-27T18:26:57.695639] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:26:58.014938] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-27T18:26:58.544636] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T18:26:58.553327] [INFO ] [REMOTE ] EBS: Full fetch complete (67394 records). [2025-10-27T18:26:58.553459] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-27T18:26:58.820089] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-27T18:26:58.946154] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-27T18:26:58.946346] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-27T18:26:58.947243] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-27T18:26:58.947310] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-27T18:26:58.948576] [DEBUG] [LOCAL ] EBS: Trimmed 67394 records to 46495 (keeping 200 days of data) [2025-10-27T18:26:59.163451] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:26:59.205465] [DEBUG] [LOCAL ] EBS: Primary data saved (46495 records). [2025-10-27T18:26:59.205575] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-27T18:26:59.205673] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBS took 42.5s. Estimated remaining: 3h 33m 47s. Rate: 7.9 symbols/min [2025-10-27T18:26:59.375659] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:26:59.379925] [DEBUG] [LOCAL ] ECCU: Loaded 2170 existing records from primary storage. [2025-10-27T18:26:59.380063] [INFO ] [MAIN ] ECCU: Loaded 2170 existing records. [2025-10-27T18:26:59.559130] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:26:59.559489] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-27T18:26:59.559670] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-27T18:26:59.559819] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-27T18:26:59.559861] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-27T18:26:59.620162] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-27T18:26:59.969168] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:26:59.972385] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:26:59.974213] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:27:00.414940] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-27T18:27:01.214939] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-27T18:27:02.014943] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-27T18:27:02.298742] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:27:02.384713] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T18:27:02.447287] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T18:27:02.815001] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-27T18:27:03.614942] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-27T18:27:04.362461] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:27:04.414902] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-27T18:27:04.533685] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:27:05.214952] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-27T18:27:06.014942] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-27T18:27:06.219706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T18:27:06.242972] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:27:06.248398] [INFO ] [REMOTE ] ECAT: Full fetch complete (42872 records). [2025-10-27T18:27:06.248475] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-27T18:27:06.409751] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T18:27:06.631575] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-27T18:27:06.631674] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-27T18:27:06.632340] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-27T18:27:06.632395] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-27T18:27:06.633363] [DEBUG] [LOCAL ] ECAT: Trimmed 42872 records to 28876 (keeping 200 days of data) [2025-10-27T18:27:06.802165] [DEBUG] [LOCAL ] ECAT: Primary data saved (28876 records). [2025-10-27T18:27:06.802285] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-27T18:27:06.802360] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECAT took 31.9s. Estimated remaining: 3h 33m 39s. Rate: 7.9 symbols/min [2025-10-27T18:27:06.820114] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-27T18:27:06.971467] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:06.971589] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-27T18:27:06.971679] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-27T18:27:06.971790] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-27T18:27:06.971831] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-27T18:27:06.971871] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-27T18:27:06.971903] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-27T18:27:07.316520] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:07.324754] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:27:07.325428] [INFO ] [REMOTE ] ECCC: Full fetch complete (1311 records). [2025-10-27T18:27:07.325493] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-27T18:27:07.502998] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T18:27:07.503181] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:07.503230] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:07.503269] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-27T18:27:07.503329] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-27T18:27:07.503365] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-27T18:27:07.503406] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-27T18:27:07.503459] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCC took 20.4s. Estimated remaining: 3h 33m 15s. Rate: 7.9 symbols/min [2025-10-27T18:27:07.620156] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-27T18:27:07.672835] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:07.672953] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-27T18:27:07.672991] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-27T18:27:07.673094] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-27T18:27:07.673136] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-27T18:27:07.673178] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-27T18:27:07.673210] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-27T18:27:08.028729] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:08.268109] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:27:08.414939] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-27T18:27:08.924112] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:27:09.215008] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-27T18:27:09.559255] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T18:27:10.014999] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-27T18:27:10.389342] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T18:27:10.814996] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-27T18:27:11.614948] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-27T18:27:12.055038] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:27:12.387016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:27:12.414899] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-27T18:27:13.214949] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-27T18:27:13.658778] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:27:14.014961] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-27T18:27:14.057297] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T18:27:14.460911] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:27:14.815001] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-27T18:27:15.614999] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-27T18:27:15.992871] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T18:27:16.414973] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-27T18:27:16.718684] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:27:16.726928] [INFO ] [REMOTE ] ECC: Full fetch complete (61363 records). [2025-10-27T18:27:16.727051] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-27T18:27:16.727803] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:27:16.727886] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:16.727928] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:16.727989] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-27T18:27:16.728051] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-27T18:27:16.728084] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-10-27T18:27:16.728348] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-10-27T18:27:16.728436] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECC took 32.1s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-27T18:27:16.901736] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T18:27:16.903883] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:16.934427] [DEBUG] [LOCAL ] ECG: Loaded 33239 existing records from primary storage. [2025-10-27T18:27:16.934700] [INFO ] [MAIN ] ECG: Loaded 33239 existing records. [2025-10-27T18:27:17.116973] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:17.117150] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-27T18:27:17.117197] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-27T18:27:17.117412] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-27T18:27:17.117466] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-27T18:27:17.217537] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-27T18:27:17.478790] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:17.579239] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T18:27:18.014976] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-27T18:27:18.336054] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T18:27:18.814980] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-27T18:27:19.336546] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:27:19.614946] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-27T18:27:20.028363] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:27:20.414950] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-27T18:27:20.855740] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:27:21.214945] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-27T18:27:21.562247] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:27:22.014911] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-27T18:27:22.316857] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T18:27:22.814948] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-27T18:27:23.240072] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T18:27:23.614949] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-27T18:27:24.027060] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T18:27:24.414987] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-27T18:27:25.214998] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-27T18:27:25.624878] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T18:27:25.625633] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-27T18:27:25.625735] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-27T18:27:25.805709] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-27T18:27:25.805901] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:25.805981] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:25.806041] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-27T18:27:25.806114] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-27T18:27:25.806149] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-27T18:27:25.806186] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-27T18:27:25.806238] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCW took 19.0s. Estimated remaining: 3h 33m 7s. Rate: 7.9 symbols/min [2025-10-27T18:27:25.978932] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:26.022685] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-27T18:27:26.025430] [DEBUG] [LOCAL ] ECL: Loaded 47402 existing records from primary storage. [2025-10-27T18:27:26.025769] [INFO ] [MAIN ] ECL: Loaded 47402 existing records. [2025-10-27T18:27:26.147572] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:27:26.230298] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:26.230520] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-27T18:27:26.230577] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-27T18:27:26.230770] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-27T18:27:26.230826] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-27T18:27:26.578935] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:26.630458] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T18:27:26.814946] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-27T18:27:27.252509] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:27:27.614948] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-27T18:27:28.268495] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T18:27:28.415028] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-27T18:27:29.214969] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-27T18:27:29.502028] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T18:27:29.942415] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:27:30.014940] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-27T18:27:30.814990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-27T18:27:31.529770] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T18:27:31.561687] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T18:27:31.614898] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-27T18:27:32.414945] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-27T18:27:32.719587] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T18:27:32.861178] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T18:27:33.214969] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-27T18:27:33.695337] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:27:34.014941] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-27T18:27:34.433161] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T18:27:34.815009] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-27T18:27:35.250314] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T18:27:35.251083] [INFO ] [REMOTE ] ECCX: Full fetch complete (1442 records). [2025-10-27T18:27:35.251171] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-27T18:27:35.429384] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-27T18:27:35.429554] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:27:35.429599] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:27:35.429638] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-27T18:27:35.429734] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-27T18:27:35.429771] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-27T18:27:35.429812] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-27T18:27:35.429918] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECCX took 27.9s. Estimated remaining: 3h 33m 4s. Rate: 7.9 symbols/min [2025-10-27T18:27:35.606300] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:35.615132] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-27T18:27:35.623815] [DEBUG] [LOCAL ] ECO: Loaded 18336 existing records from primary storage. [2025-10-27T18:27:35.624059] [INFO ] [MAIN ] ECO: Loaded 18336 existing records. [2025-10-27T18:27:35.829603] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:35.829854] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-27T18:27:35.829901] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-27T18:27:35.830098] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-27T18:27:35.830154] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-27T18:27:36.128590] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:27:36.145367] [INFO ] [REMOTE ] ECCU: Full fetch complete (4021 records). [2025-10-27T18:27:36.166402] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-27T18:27:36.309577] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:36.420233] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-27T18:27:36.578679] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-27T18:27:36.578761] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-27T18:27:36.578886] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-27T18:27:36.578922] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-27T18:27:36.579247] [DEBUG] [LOCAL ] ECCU: Trimmed 4021 records to 2087 (keeping 200 days of data) [2025-10-27T18:27:36.591751] [DEBUG] [LOCAL ] ECCU: Primary data saved (2087 records). [2025-10-27T18:27:36.591809] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-27T18:27:36.591873] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECCU took 37.4s. Estimated remaining: 3h 32m 41s. Rate: 7.9 symbols/min [2025-10-27T18:27:36.756262] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:36.792261] [DEBUG] [LOCAL ] ECVT: Loaded 43610 existing records from primary storage. [2025-10-27T18:27:36.792539] [INFO ] [MAIN ] ECVT: Loaded 43610 existing records. [2025-10-27T18:27:36.967224] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:27:36.967406] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-27T18:27:36.967450] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-27T18:27:36.967698] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-27T18:27:36.967765] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-27T18:27:37.219998] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-27T18:27:37.319443] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:27:37.893176] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:27:38.014931] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-27T18:27:38.814923] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-27T18:27:38.940694] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:27:38.972371] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:27:39.614987] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-27T18:27:39.888726] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T18:27:40.414942] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-27T18:27:40.780632] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:27:41.214991] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-27T18:27:41.484124] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T18:27:42.015010] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-27T18:27:42.498944] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:27:42.786377] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:27:42.814901] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-27T18:27:43.614931] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-27T18:27:44.096849] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T18:27:44.414950] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-27T18:27:45.012587] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:27:45.118827] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:27:45.214943] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-27T18:27:46.014956] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-27T18:27:46.612381] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:27:46.814958] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-27T18:27:47.622233] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-27T18:27:47.627984] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T18:27:47.904441] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:27:48.385607] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:27:48.414961] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-27T18:27:49.214942] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-27T18:27:49.348346] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T18:27:50.014943] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-27T18:27:50.700095] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:27:50.814972] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-27T18:27:51.112857] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:27:51.614953] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-27T18:27:51.680919] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:27:52.414930] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-27T18:27:53.215000] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-27T18:27:53.444429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:27:53.452569] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:27:53.930692] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:27:54.014900] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-27T18:27:54.815006] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-27T18:27:55.123949] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:27:55.614977] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-27T18:27:55.858320] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:27:56.414940] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-27T18:27:56.757422] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:27:57.215030] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-27T18:27:57.638196] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:27:58.014995] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-27T18:27:58.653529] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:27:58.659885] [INFO ] [REMOTE ] ECG: Full fetch complete (50798 records). [2025-10-27T18:27:58.659995] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-27T18:27:58.818355] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-27T18:27:59.050600] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-27T18:27:59.051205] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-27T18:27:59.051885] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-27T18:27:59.052267] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T18:27:59.052367] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-27T18:27:59.056735] [INFO ] [REMOTE ] ECO: Full fetch complete (28191 records). [2025-10-27T18:27:59.056834] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-27T18:27:59.130955] [DEBUG] [LOCAL ] ECG: Trimmed 50798 records to 32450 (keeping 200 days of data) [2025-10-27T18:27:59.633713] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-27T18:27:59.646926] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-27T18:27:59.647438] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-27T18:27:59.647995] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-27T18:27:59.653892] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-27T18:27:59.670716] [DEBUG] [LOCAL ] ECO: Trimmed 28191 records to 17789 (keeping 200 days of data) [2025-10-27T18:27:59.670579] [DEBUG] [LOCAL ] ECG: Primary data saved (32450 records). [2025-10-27T18:27:59.670889] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-27T18:27:59.671204] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECG took 42.9s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-27T18:27:59.928849] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:27:59.954577] [DEBUG] [LOCAL ] ECO: Primary data saved (17789 records). [2025-10-27T18:27:59.954921] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-27T18:27:59.955042] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECO took 24.5s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-27T18:28:00.150192] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:28:00.165897] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:00.196358] [DEBUG] [LOCAL ] ED: Loaded 53298 existing records from primary storage. [2025-10-27T18:28:00.196750] [INFO ] [MAIN ] ED: Loaded 53298 existing records. [2025-10-27T18:28:00.327881] [DEBUG] [LOCAL ] EDD: Loaded 27595 existing records from primary storage. [2025-10-27T18:28:00.343455] [INFO ] [MAIN ] EDD: Loaded 27595 existing records. [2025-10-27T18:28:00.428902] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-27T18:28:00.472987] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:00.473374] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-27T18:28:00.489691] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-27T18:28:00.500203] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-27T18:28:00.505565] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-27T18:28:00.682887] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:00.683108] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-27T18:28:00.683388] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-27T18:28:00.699126] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-27T18:28:00.709429] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-27T18:28:01.166213] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:01.220024] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-27T18:28:01.341255] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:01.491080] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T18:28:02.014920] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-27T18:28:02.242556] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:28:02.803289] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:28:02.814895] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-27T18:28:02.865227] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T18:28:03.614957] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-27T18:28:04.414957] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-27T18:28:04.487874] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T18:28:04.856689] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:28:04.867887] [INFO ] [REMOTE ] ECVT: Full fetch complete (60404 records). [2025-10-27T18:28:04.868024] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-27T18:28:05.220089] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-27T18:28:05.271079] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-27T18:28:05.271164] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-27T18:28:05.271901] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-27T18:28:05.271963] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-27T18:28:05.273169] [DEBUG] [LOCAL ] ECVT: Trimmed 60404 records to 42785 (keeping 200 days of data) [2025-10-27T18:28:05.511253] [DEBUG] [LOCAL ] ECVT: Primary data saved (42785 records). [2025-10-27T18:28:05.511373] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-27T18:28:05.511473] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ECVT took 28.9s. Estimated remaining: 3h 32m 33s. Rate: 7.9 symbols/min [2025-10-27T18:28:05.676722] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:05.689107] [DEBUG] [LOCAL ] EDF: Loaded 12935 existing records from primary storage. [2025-10-27T18:28:05.689306] [INFO ] [MAIN ] EDF: Loaded 12935 existing records. [2025-10-27T18:28:05.866074] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:05.866318] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-27T18:28:05.866391] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-27T18:28:05.866704] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-27T18:28:05.866806] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-27T18:28:06.015330] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-27T18:28:06.251809] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:06.263695] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:28:06.814915] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-27T18:28:07.182376] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T18:28:07.282599] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:28:07.614977] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-27T18:28:08.414966] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-27T18:28:08.749715] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:28:08.799245] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T18:28:09.214972] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-27T18:28:09.947745] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T18:28:09.983384] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:28:10.014932] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-27T18:28:10.669238] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T18:28:10.814928] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-27T18:28:11.614946] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-27T18:28:11.779185] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:28:12.301232] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:28:12.414961] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-27T18:28:13.214954] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-27T18:28:13.772561] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T18:28:14.014965] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-27T18:28:14.315210] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T18:28:14.814978] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-27T18:28:15.003954] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T18:28:15.614952] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-27T18:28:16.262693] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:28:16.271743] [INFO ] [REMOTE ] ECL: Full fetch complete (68443 records). [2025-10-27T18:28:16.271868] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-27T18:28:16.420097] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-27T18:28:16.671951] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-27T18:28:16.672060] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-27T18:28:16.672892] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-27T18:28:16.672960] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-27T18:28:16.674341] [DEBUG] [LOCAL ] ECL: Trimmed 68443 records to 46631 (keeping 200 days of data) [2025-10-27T18:28:16.975393] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:28:17.012304] [DEBUG] [LOCAL ] ECL: Primary data saved (46631 records). [2025-10-27T18:28:17.013341] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-27T18:28:17.014128] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. ECL took 51.2s. Estimated remaining: 3h 32m 35s. Rate: 7.9 symbols/min [2025-10-27T18:28:17.205077] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:17.217682] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-27T18:28:17.227901] [DEBUG] [LOCAL ] EDN: Loaded 19648 existing records from primary storage. [2025-10-27T18:28:17.228171] [INFO ] [MAIN ] EDN: Loaded 19648 existing records. [2025-10-27T18:28:17.407709] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:17.407925] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-27T18:28:17.407973] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-27T18:28:17.408147] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-27T18:28:17.408202] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-27T18:28:17.770454] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:18.014914] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-27T18:28:18.225517] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T18:28:18.246384] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:28:18.814945] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-27T18:28:19.328273] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:28:19.365966] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:28:19.614977] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-27T18:28:20.298911] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T18:28:20.414933] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-27T18:28:21.214926] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-27T18:28:21.232063] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:28:22.014912] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-27T18:28:22.353811] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:28:22.814923] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-27T18:28:22.835966] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:28:23.614939] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-27T18:28:24.171169] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:28:24.414908] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-27T18:28:24.527905] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T18:28:24.530195] [INFO ] [REMOTE ] EDF: Full fetch complete (19707 records). [2025-10-27T18:28:24.530268] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-27T18:28:24.530726] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:28:24.530822] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:28:24.530887] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:28:24.530956] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-27T18:28:24.531030] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-27T18:28:24.531109] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-27T18:28:24.531255] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-10-27T18:28:24.531338] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDF took 19.0s. Estimated remaining: 3h 32m 27s. Rate: 7.9 symbols/min [2025-10-27T18:28:24.699286] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:24.736619] [DEBUG] [LOCAL ] EDU: Loaded 45389 existing records from primary storage. [2025-10-27T18:28:24.736945] [INFO ] [MAIN ] EDU: Loaded 45389 existing records. [2025-10-27T18:28:24.911479] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:24.911682] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-27T18:28:24.911738] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-27T18:28:24.911952] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-27T18:28:24.911989] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-27T18:28:25.225582] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-27T18:28:25.271376] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:25.700301] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T18:28:26.014999] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-27T18:28:26.655894] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:28:26.814952] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-27T18:28:26.990022] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T18:28:27.614960] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-27T18:28:28.414985] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-27T18:28:28.673489] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T18:28:29.121060] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:28:29.214977] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-27T18:28:29.281285] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T18:28:30.014955] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-27T18:28:30.621812] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:28:30.814937] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-27T18:28:31.189300] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T18:28:31.614974] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-27T18:28:32.296201] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T18:28:32.306059] [INFO ] [REMOTE ] ED: Full fetch complete (76321 records). [2025-10-27T18:28:32.306197] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-27T18:28:32.417138] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-27T18:28:32.718378] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-27T18:28:32.719018] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-27T18:28:32.720605] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-27T18:28:32.719537] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:28:32.724520] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-27T18:28:32.726607] [DEBUG] [LOCAL ] ED: Trimmed 76321 records to 52504 (keeping 200 days of data) [2025-10-27T18:28:33.049176] [DEBUG] [LOCAL ] ED: Primary data saved (52504 records). [2025-10-27T18:28:33.049307] [INFO ] [MAIN ] ED: Full history saved. [2025-10-27T18:28:33.049383] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. ED took 33.4s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-10-27T18:28:33.217079] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-27T18:28:33.216966] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:33.249554] [DEBUG] [LOCAL ] EE: Loaded 32959 existing records from primary storage. [2025-10-27T18:28:33.249848] [INFO ] [MAIN ] EE: Loaded 32959 existing records. [2025-10-27T18:28:33.425123] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:33.425331] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-27T18:28:33.425377] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-27T18:28:33.425617] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-27T18:28:33.425707] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-27T18:28:33.771868] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:33.829536] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:28:33.899195] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T18:28:34.014949] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-27T18:28:34.814923] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-27T18:28:35.077952] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:28:35.615012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-27T18:28:36.414905] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-27T18:28:36.603507] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T18:28:36.810451] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:28:37.207039] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T18:28:37.214896] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-27T18:28:38.014976] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-27T18:28:38.343461] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:28:38.349727] [INFO ] [REMOTE ] EDD: Full fetch complete (38939 records). [2025-10-27T18:28:38.349901] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-27T18:28:38.350454] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:28:38.350540] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:28:38.350582] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:28:38.350619] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-27T18:28:38.350704] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-27T18:28:38.350754] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-10-27T18:28:38.350919] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-10-27T18:28:38.351009] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDD took 38.4s. Estimated remaining: 3h 32m 8s. Rate: 7.9 symbols/min [2025-10-27T18:28:38.518220] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:38.518388] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-27T18:28:38.518423] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-27T18:28:38.518536] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-27T18:28:38.518585] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-27T18:28:38.518636] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-27T18:28:38.518741] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-27T18:28:38.817486] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-27T18:28:38.901311] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:28:38.900361] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:39.614994] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-27T18:28:40.359088] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T18:28:40.414935] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-27T18:28:40.593032] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:28:41.214962] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-27T18:28:41.520081] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T18:28:41.867215] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T18:28:42.014949] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-27T18:28:42.809263] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:28:42.814888] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-27T18:28:43.614928] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-27T18:28:43.716546] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:28:44.414935] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-27T18:28:45.167431] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:28:45.214923] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-27T18:28:45.304535] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:28:45.309820] [INFO ] [REMOTE ] EDN: Full fetch complete (29665 records). [2025-10-27T18:28:45.309946] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-27T18:28:45.603879] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T18:28:45.709841] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-27T18:28:45.709920] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-27T18:28:45.710395] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-27T18:28:45.710435] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-27T18:28:45.711240] [DEBUG] [LOCAL ] EDN: Trimmed 29665 records to 19576 (keeping 200 days of data) [2025-10-27T18:28:45.824896] [DEBUG] [LOCAL ] EDN: Primary data saved (19576 records). [2025-10-27T18:28:45.825064] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-27T18:28:45.825173] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EDN took 28.8s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-10-27T18:28:45.990515] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:28:46.001904] [DEBUG] [LOCAL ] EEX: Loaded 9933 existing records from primary storage. [2025-10-27T18:28:46.002106] [INFO ] [MAIN ] EEX: Loaded 9933 existing records. [2025-10-27T18:28:46.022533] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-27T18:28:46.179836] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:28:46.180057] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-27T18:28:46.180103] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-27T18:28:46.180265] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-27T18:28:46.180321] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-27T18:28:46.544962] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:28:46.814966] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-27T18:28:47.621611] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-27T18:28:47.624079] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:28:48.282967] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T18:28:48.414968] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-27T18:28:48.527285] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T18:28:49.214962] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-27T18:28:49.324072] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:28:49.638523] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T18:28:50.015008] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-27T18:28:50.814962] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-27T18:28:51.339974] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T18:28:51.560762] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:28:51.614902] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-27T18:28:52.414934] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-27T18:28:52.427860] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:28:53.214995] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-27T18:28:53.718892] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:28:53.906723] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:28:54.014963] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-27T18:28:54.516619] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:28:54.814948] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-27T18:28:55.441980] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T18:28:55.614984] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-27T18:28:56.100323] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T18:28:56.414964] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-27T18:28:56.914124] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:28:57.214950] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-27T18:28:58.014958] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-27T18:28:58.617131] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:28:58.814927] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-27T18:28:59.025308] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:28:59.614972] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-27T18:29:00.249864] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:29:00.277580] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T18:29:00.414953] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-27T18:29:01.214975] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-27T18:29:01.268913] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:29:01.855515] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:29:02.014922] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-27T18:29:02.369953] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:29:02.814936] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-27T18:29:03.614945] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-27T18:29:04.337018] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T18:29:04.414990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-27T18:29:05.066317] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:29:05.214956] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-27T18:29:05.378563] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T18:29:05.380563] [INFO ] [REMOTE ] EEX: Full fetch complete (18113 records). [2025-10-27T18:29:05.380632] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-27T18:29:05.381053] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:29:05.381136] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:29:05.381180] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:29:05.381218] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-27T18:29:05.381272] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-27T18:29:05.381306] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-27T18:29:05.381425] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-10-27T18:29:05.381489] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EEX took 19.6s. Estimated remaining: 3h 32m 21s. Rate: 7.9 symbols/min [2025-10-27T18:29:05.550614] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:05.594512] [DEBUG] [LOCAL ] EFC: Loaded 46971 existing records from primary storage. [2025-10-27T18:29:05.594819] [INFO ] [MAIN ] EFC: Loaded 46971 existing records. [2025-10-27T18:29:05.768551] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:05.768769] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-27T18:29:05.768820] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-27T18:29:05.768998] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-27T18:29:05.769036] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-27T18:29:06.020079] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-27T18:29:06.137475] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:06.591500] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:29:06.815002] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-27T18:29:07.421708] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T18:29:07.614987] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-27T18:29:07.770750] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:29:07.779774] [INFO ] [REMOTE ] EDU: Full fetch complete (67167 records). [2025-10-27T18:29:07.779870] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-27T18:29:08.155713] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-27T18:29:08.155791] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-27T18:29:08.156550] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-27T18:29:08.156589] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-27T18:29:08.157836] [DEBUG] [LOCAL ] EDU: Trimmed 67167 records to 44629 (keeping 200 days of data) [2025-10-27T18:29:08.403812] [DEBUG] [LOCAL ] EDU: Primary data saved (44629 records). [2025-10-27T18:29:08.403932] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-27T18:29:08.404009] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EDU took 43.9s. Estimated remaining: 3h 32m 2s. Rate: 7.9 symbols/min [2025-10-27T18:29:08.424345] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-27T18:29:08.578975] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:08.594361] [DEBUG] [LOCAL ] EFR: Loaded 15254 existing records from primary storage. [2025-10-27T18:29:08.594589] [INFO ] [MAIN ] EFR: Loaded 15254 existing records. [2025-10-27T18:29:08.784692] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:08.784912] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-27T18:29:08.784959] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-27T18:29:08.785118] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-27T18:29:08.785155] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-27T18:29:09.017438] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T18:29:09.057237] [INFO ] [REMOTE ] EEA: Full fetch complete (3713 records). [2025-10-27T18:29:09.068377] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-27T18:29:09.231503] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-27T18:29:09.305158] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:09.392520] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T18:29:09.393707] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:29:09.395257] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T18:29:09.395368] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:29:09.402102] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-27T18:29:09.402602] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-27T18:29:09.402693] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-27T18:29:09.402870] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-27T18:29:09.402808] [INFO ] [REMOTE ] EE: Full fetch complete (44597 records). [2025-10-27T18:29:09.403036] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EEA took 31.1s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-27T18:29:09.403182] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-27T18:29:09.748239] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:09.928758] [DEBUG] [LOCAL ] EFT: Loaded 13039 existing records from primary storage. [2025-10-27T18:29:09.950950] [INFO ] [MAIN ] EFT: Loaded 13039 existing records. [2025-10-27T18:29:10.020181] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-27T18:29:10.119540] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-27T18:29:10.120059] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-27T18:29:10.121094] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-27T18:29:10.126707] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-27T18:29:10.205247] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:10.205379] [DEBUG] [LOCAL ] EE: Trimmed 44597 records to 32366 (keeping 200 days of data) [2025-10-27T18:29:10.206014] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-27T18:29:10.206099] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-27T18:29:10.206528] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-27T18:29:10.206590] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-27T18:29:10.681072] [DEBUG] [LOCAL ] EE: Primary data saved (32366 records). [2025-10-27T18:29:10.708704] [INFO ] [MAIN ] EE: Full history saved. [2025-10-27T18:29:10.708888] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EE took 37.7s. Estimated remaining: 3h 31m 16s. Rate: 7.9 symbols/min [2025-10-27T18:29:10.920847] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:10.932128] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-27T18:29:10.976399] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:29:11.026229] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:11.028624] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:29:11.072736] [DEBUG] [LOCAL ] EFX: Loaded 45341 existing records from primary storage. [2025-10-27T18:29:11.073017] [INFO ] [MAIN ] EFX: Loaded 45341 existing records. [2025-10-27T18:29:11.246305] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:11.246547] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-27T18:29:11.246599] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-27T18:29:11.246871] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-27T18:29:11.246948] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-27T18:29:11.594633] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:11.614901] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-27T18:29:11.931586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T18:29:12.414931] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-27T18:29:12.525449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:29:13.214939] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-27T18:29:14.014971] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-27T18:29:14.049610] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T18:29:14.066589] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:29:14.814928] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-27T18:29:15.521898] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T18:29:15.614943] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-27T18:29:16.414976] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-27T18:29:16.490632] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:29:16.781991] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:29:17.008414] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:29:17.214956] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-27T18:29:18.014946] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-27T18:29:18.620763] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:29:18.794023] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:29:18.814914] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-27T18:29:19.572877] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T18:29:19.614908] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-27T18:29:20.134026] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:29:20.414992] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-27T18:29:21.215005] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-27T18:29:21.797860] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:29:21.859290] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:29:22.014966] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-27T18:29:22.724514] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:29:22.814921] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-27T18:29:23.614953] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-27T18:29:24.414962] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-27T18:29:24.550947] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:29:24.576836] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T18:29:25.214997] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-27T18:29:25.937131] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:29:26.014916] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-27T18:29:26.814982] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-27T18:29:26.954305] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T18:29:27.142540] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:29:27.380414] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T18:29:27.614942] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-27T18:29:28.217450] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:29:28.414927] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-27T18:29:29.059061] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T18:29:29.214929] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-27T18:29:29.895907] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T18:29:30.014979] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-27T18:29:30.763325] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T18:29:30.767036] [INFO ] [REMOTE ] EFR: Full fetch complete (19792 records). [2025-10-27T18:29:30.767119] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-27T18:29:30.820145] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-27T18:29:31.128697] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-27T18:29:31.128782] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-27T18:29:31.129207] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-27T18:29:31.129245] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-27T18:29:31.129801] [DEBUG] [LOCAL ] EFR: Trimmed 19792 records to 14825 (keeping 200 days of data) [2025-10-27T18:29:31.216552] [DEBUG] [LOCAL ] EFR: Primary data saved (14825 records). [2025-10-27T18:29:31.216738] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-27T18:29:31.216844] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFR took 22.8s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-27T18:29:31.385412] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:31.413770] [DEBUG] [LOCAL ] EFXT: Loaded 30013 existing records from primary storage. [2025-10-27T18:29:31.414025] [INFO ] [MAIN ] EFXT: Loaded 30013 existing records. [2025-10-27T18:29:31.592789] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:31.593009] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-27T18:29:31.593064] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-27T18:29:31.593245] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-27T18:29:31.593284] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-27T18:29:31.623923] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-27T18:29:31.966218] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:32.414939] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-27T18:29:32.506608] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T18:29:33.214919] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-27T18:29:33.241718] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T18:29:33.435070] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:29:34.014937] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-27T18:29:34.814940] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-27T18:29:35.008815] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T18:29:35.419124] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:29:35.614914] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-27T18:29:35.675158] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T18:29:36.120669] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T18:29:36.414986] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-27T18:29:37.214918] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-27T18:29:37.331119] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:29:37.991192] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:29:38.014905] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-27T18:29:38.701075] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T18:29:38.703989] [INFO ] [REMOTE ] EFT: Full fetch complete (17775 records). [2025-10-27T18:29:38.704061] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-27T18:29:38.820153] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-27T18:29:39.066355] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-27T18:29:39.066429] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-27T18:29:39.066842] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-27T18:29:39.066921] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-27T18:29:39.067435] [DEBUG] [LOCAL ] EFT: Trimmed 17775 records to 12689 (keeping 200 days of data) [2025-10-27T18:29:39.144111] [DEBUG] [LOCAL ] EFT: Primary data saved (12689 records). [2025-10-27T18:29:39.144250] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-27T18:29:39.144330] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFT took 29.7s. Estimated remaining: 3h 31m 32s. Rate: 7.9 symbols/min [2025-10-27T18:29:39.316622] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:39.343940] [DEBUG] [LOCAL ] EG: Loaded 27743 existing records from primary storage. [2025-10-27T18:29:39.344191] [INFO ] [MAIN ] EG: Loaded 27743 existing records. [2025-10-27T18:29:39.520180] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:39.520380] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-27T18:29:39.520427] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-27T18:29:39.520741] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-27T18:29:39.520799] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-27T18:29:39.618841] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-27T18:29:39.864888] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:40.312420] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:29:40.415041] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-27T18:29:40.914435] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:29:41.214993] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-27T18:29:41.861280] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:29:42.014991] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-27T18:29:42.394937] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:29:42.814939] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-27T18:29:43.547479] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:29:43.556468] [INFO ] [REMOTE ] EFC: Full fetch complete (66799 records). [2025-10-27T18:29:43.556598] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-27T18:29:43.620048] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-27T18:29:43.951336] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-27T18:29:43.951418] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-27T18:29:43.952238] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-27T18:29:43.952303] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-27T18:29:43.953625] [DEBUG] [LOCAL ] EFC: Trimmed 66799 records to 46165 (keeping 200 days of data) [2025-10-27T18:29:44.243521] [DEBUG] [LOCAL ] EFC: Primary data saved (46165 records). [2025-10-27T18:29:44.243732] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-27T18:29:44.244582] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFC took 38.9s. Estimated remaining: 3h 31m 18s. Rate: 7.9 symbols/min [2025-10-27T18:29:44.414531] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:44.415208] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-27T18:29:44.486194] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T18:29:44.496509] [DEBUG] [LOCAL ] EGO: Loaded 52493 existing records from primary storage. [2025-10-27T18:29:44.497088] [INFO ] [MAIN ] EGO: Loaded 52493 existing records. [2025-10-27T18:29:44.497226] [INFO ] [REMOTE ] EFX: Full fetch complete (65092 records). [2025-10-27T18:29:44.530202] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-27T18:29:44.864783] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:44.957463] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-27T18:29:44.977874] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-27T18:29:44.993850] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-27T18:29:45.004678] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-27T18:29:45.225511] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-27T18:29:45.226728] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T18:29:45.226939] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-27T18:29:45.228219] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-27T18:29:45.245045] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-27T18:29:45.274213] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-27T18:29:45.384467] [DEBUG] [LOCAL ] EFX: Trimmed 65092 records to 44559 (keeping 200 days of data) [2025-10-27T18:29:45.595964] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:45.791615] [DEBUG] [LOCAL ] EFX: Primary data saved (44559 records). [2025-10-27T18:29:45.791784] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-27T18:29:45.791868] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 35.1s. Estimated remaining: 3h 30m 56s. Rate: 7.9 symbols/min [2025-10-27T18:29:45.943475] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:29:45.998493] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:29:46.017491] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-27T18:29:46.031495] [DEBUG] [LOCAL ] EGP: Loaded 30745 existing records from primary storage. [2025-10-27T18:29:46.031776] [INFO ] [MAIN ] EGP: Loaded 30745 existing records. [2025-10-27T18:29:46.208006] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:29:46.208259] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-27T18:29:46.208312] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-27T18:29:46.208493] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-27T18:29:46.208530] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-27T18:29:46.592035] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:29:46.595817] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:29:46.814949] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-27T18:29:47.452237] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:29:47.614916] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-27T18:29:47.954500] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T18:29:48.414958] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-27T18:29:49.092037] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:29:49.214938] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-27T18:29:49.309105] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T18:29:50.014932] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-27T18:29:50.814957] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-27T18:29:51.400029] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T18:29:51.503106] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:29:51.614940] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-27T18:29:52.414968] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-27T18:29:52.479567] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:29:53.134630] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:29:53.214909] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-27T18:29:54.014997] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-27T18:29:54.170714] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:29:54.815016] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-27T18:29:55.421336] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-27T18:29:55.460241] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:29:55.614939] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-27T18:29:56.300070] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T18:29:56.414915] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-27T18:29:57.193223] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:29:57.214905] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-27T18:29:57.895675] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:29:58.014943] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-27T18:29:58.814943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-27T18:29:58.960262] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:29:59.150590] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T18:29:59.614911] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-27T18:29:59.680502] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T18:30:00.414931] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-27T18:30:01.214960] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-27T18:30:01.283257] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:30:02.014951] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-27T18:30:02.064415] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:30:02.814964] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-27T18:30:02.861199] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:30:03.614936] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-27T18:30:03.691438] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:30:04.286454] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:30:04.414948] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-27T18:30:04.802950] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:30:05.214943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-27T18:30:05.644533] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T18:30:06.014970] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-27T18:30:06.137467] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:30:06.814988] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-27T18:30:07.338597] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:30:07.615134] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-27T18:30:08.020035] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:30:08.027053] [INFO ] [REMOTE ] EFXT: Full fetch complete (44317 records). [2025-10-27T18:30:08.027187] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-27T18:30:08.417190] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-27T18:30:08.432043] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-27T18:30:08.432914] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-27T18:30:08.433623] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-27T18:30:08.433839] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-27T18:30:08.434903] [DEBUG] [LOCAL ] EFXT: Trimmed 44317 records to 29414 (keeping 200 days of data) [2025-10-27T18:30:08.614037] [DEBUG] [LOCAL ] EFXT: Primary data saved (29414 records). [2025-10-27T18:30:08.619697] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-27T18:30:08.629467] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EFXT took 37.4s. Estimated remaining: 3h 31m 25s. Rate: 7.8 symbols/min [2025-10-27T18:30:08.631032] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:30:08.812135] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:08.850319] [DEBUG] [LOCAL ] EGY: Loaded 41776 existing records from primary storage. [2025-10-27T18:30:08.850617] [INFO ] [MAIN ] EGY: Loaded 41776 existing records. [2025-10-27T18:30:09.032036] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:09.032252] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-27T18:30:09.032316] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-27T18:30:09.032576] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-27T18:30:09.032635] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-27T18:30:09.216478] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-27T18:30:09.411127] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:10.020061] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-27T18:30:10.029041] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:30:10.034550] [INFO ] [REMOTE ] EG: Full fetch complete (42515 records). [2025-10-27T18:30:10.034725] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-27T18:30:10.416861] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-27T18:30:10.417176] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-27T18:30:10.418007] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-27T18:30:10.418125] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-27T18:30:10.419371] [DEBUG] [LOCAL ] EG: Trimmed 42515 records to 27095 (keeping 200 days of data) [2025-10-27T18:30:10.605051] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:30:10.627355] [DEBUG] [LOCAL ] EG: Primary data saved (27095 records). [2025-10-27T18:30:10.628203] [INFO ] [MAIN ] EG: Full history saved. [2025-10-27T18:30:10.628333] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EG took 31.5s. Estimated remaining: 3h 31m 4s. Rate: 7.9 symbols/min [2025-10-27T18:30:10.792124] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:10.817274] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-27T18:30:10.817978] [DEBUG] [LOCAL ] EHAB: Loaded 29631 existing records from primary storage. [2025-10-27T18:30:10.819073] [INFO ] [MAIN ] EHAB: Loaded 29631 existing records. [2025-10-27T18:30:10.998544] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:10.998769] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-27T18:30:10.998827] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-27T18:30:10.999035] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-27T18:30:10.999090] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-27T18:30:11.367234] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:11.614961] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-27T18:30:11.766424] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:30:11.777690] [INFO ] [REMOTE ] EGO: Full fetch complete (74332 records). [2025-10-27T18:30:11.777882] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-27T18:30:11.779156] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:30:11.779249] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:30:11.779291] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:30:11.779335] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-27T18:30:11.779403] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-27T18:30:11.779440] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-10-27T18:30:11.779679] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-10-27T18:30:11.780219] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGO took 27.5s. Estimated remaining: 3h 30m 41s. Rate: 7.9 symbols/min [2025-10-27T18:30:11.950358] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:11.998030] [DEBUG] [LOCAL ] EHC: Loaded 41478 existing records from primary storage. [2025-10-27T18:30:11.998439] [INFO ] [MAIN ] EHC: Loaded 41478 existing records. [2025-10-27T18:30:12.185769] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:12.186908] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-27T18:30:12.186990] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-27T18:30:12.187297] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-27T18:30:12.187344] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-27T18:30:12.419519] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-27T18:30:12.536451] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:30:12.625602] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:12.647112] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:30:13.215028] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-27T18:30:13.854111] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:30:14.014987] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-27T18:30:14.814996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-27T18:30:15.281378] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:30:15.614970] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-27T18:30:16.415012] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-27T18:30:17.824035] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:30:17.831926] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-27T18:30:17.941899] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (4.73 seconds). [2025-10-27T18:30:18.014916] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-27T18:30:18.330102] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-27T18:30:18.360823] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (3.55 seconds). [2025-10-27T18:30:18.814958] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-27T18:30:19.158741] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:30:19.509895] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:30:19.614918] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-27T18:30:20.414940] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-27T18:30:20.800594] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T18:30:20.806111] [INFO ] [REMOTE ] EGP: Full fetch complete (45390 records). [2025-10-27T18:30:20.806211] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-27T18:30:20.806930] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:30:20.807018] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:30:20.807061] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:30:20.807098] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-27T18:30:20.807153] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-27T18:30:20.807187] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-27T18:30:20.807303] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-10-27T18:30:20.807372] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EGP took 35.0s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-27T18:30:20.978485] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:20.990207] [DEBUG] [LOCAL ] EHI: Loaded 10648 existing records from primary storage. [2025-10-27T18:30:20.990434] [INFO ] [MAIN ] EHI: Loaded 10648 existing records. [2025-10-27T18:30:21.171203] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:21.171551] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-27T18:30:21.171670] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-27T18:30:21.180420] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-27T18:30:21.193007] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-27T18:30:21.226095] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-27T18:30:21.269776] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:30:21.565636] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:21.859784] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:30:22.015012] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-27T18:30:22.814932] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-27T18:30:22.847612] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T18:30:22.915464] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:30:23.614971] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-27T18:30:24.191497] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:30:24.414904] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-27T18:30:24.523052] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:30:25.214936] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-27T18:30:25.891186] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T18:30:26.014997] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-27T18:30:26.815043] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-27T18:30:26.969129] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:30:27.007859] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T18:30:27.614978] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-27T18:30:28.414960] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-27T18:30:28.449693] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T18:30:28.711513] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:30:29.214956] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-27T18:30:29.706917] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T18:30:30.014923] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-27T18:30:30.061098] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:30:30.814956] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-27T18:30:31.249189] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:30:31.614917] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-27T18:30:31.680176] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T18:30:32.414942] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-27T18:30:33.054423] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:30:33.214932] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-27T18:30:33.476168] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:30:34.014963] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-27T18:30:34.409008] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:30:34.814957] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-27T18:30:35.348780] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:30:35.426002] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:30:35.614927] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-27T18:30:36.414985] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-27T18:30:36.915580] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:30:37.215007] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-27T18:30:37.322795] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T18:30:38.014996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-27T18:30:38.727274] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:30:38.814950] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-27T18:30:39.578922] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:30:39.614920] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-27T18:30:40.414968] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-27T18:30:40.760452] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:30:40.768015] [INFO ] [REMOTE ] EGY: Full fetch complete (60614 records). [2025-10-27T18:30:40.768130] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-27T18:30:41.161174] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-27T18:30:41.172899] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-27T18:30:41.173687] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-27T18:30:41.173788] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-27T18:30:41.175963] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:30:41.184164] [DEBUG] [LOCAL ] EGY: Trimmed 60614 records to 40974 (keeping 200 days of data) [2025-10-27T18:30:41.232194] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-27T18:30:41.421949] [DEBUG] [LOCAL ] EGY: Primary data saved (40974 records). [2025-10-27T18:30:41.422112] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-27T18:30:41.422200] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EGY took 32.8s. Estimated remaining: 3h 30m 59s. Rate: 7.8 symbols/min [2025-10-27T18:30:41.607220] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:41.626818] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:30:41.634398] [INFO ] [REMOTE ] EHAB: Full fetch complete (41124 records). [2025-10-27T18:30:41.634508] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-27T18:30:41.785162] [DEBUG] [LOCAL ] EIC: Loaded 22653 existing records from primary storage. [2025-10-27T18:30:41.806175] [INFO ] [MAIN ] EIC: Loaded 22653 existing records. [2025-10-27T18:30:42.028265] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-27T18:30:42.143570] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:30:42.154295] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-27T18:30:42.154430] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-27T18:30:42.167990] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-27T18:30:42.168289] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-27T18:30:42.354470] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T18:30:42.392741] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-27T18:30:42.393210] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-27T18:30:42.394127] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-27T18:30:42.394208] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-27T18:30:42.450716] [DEBUG] [LOCAL ] EHAB: Trimmed 41124 records to 29072 (keeping 200 days of data) [2025-10-27T18:30:42.844411] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:42.820466] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-27T18:30:42.865260] [DEBUG] [LOCAL ] EHAB: Primary data saved (29072 records). [2025-10-27T18:30:42.865422] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-27T18:30:42.865530] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EHAB took 32.2s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-27T18:30:43.041871] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:43.042080] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-27T18:30:43.042134] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-27T18:30:43.042246] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-27T18:30:43.042287] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-27T18:30:43.042328] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-27T18:30:43.042367] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-27T18:30:43.390735] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:43.443593] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T18:30:43.523548] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:30:43.531592] [INFO ] [REMOTE ] EHC: Full fetch complete (58687 records). [2025-10-27T18:30:43.531805] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-27T18:30:43.620121] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-27T18:30:43.951498] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-27T18:30:43.951601] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-27T18:30:43.952525] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-27T18:30:43.952596] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-27T18:30:43.954308] [DEBUG] [LOCAL ] EHC: Trimmed 58687 records to 40655 (keeping 200 days of data) [2025-10-27T18:30:44.220585] [DEBUG] [LOCAL ] EHC: Primary data saved (40655 records). [2025-10-27T18:30:44.220793] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-27T18:30:44.221621] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EHC took 32.4s. Estimated remaining: 3h 30m 15s. Rate: 7.9 symbols/min [2025-10-27T18:30:44.398489] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:44.398774] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-27T18:30:44.398825] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-27T18:30:44.398958] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-27T18:30:44.399003] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-27T18:30:44.399044] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-27T18:30:44.399079] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-27T18:30:44.421166] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-27T18:30:44.818552] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:30:44.823437] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:30:45.018116] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:30:45.214984] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-27T18:30:45.615830] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T18:30:46.014945] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-27T18:30:46.284457] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T18:30:46.814969] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-27T18:30:47.300769] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:30:47.614935] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-27T18:30:48.142744] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T18:30:48.415047] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-27T18:30:48.883317] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:30:49.214945] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-27T18:30:49.660331] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:30:50.014942] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-27T18:30:50.814959] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-27T18:30:51.071276] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T18:30:51.094054] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-27T18:30:51.614953] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-27T18:30:51.966544] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:30:52.414949] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-27T18:30:53.220066] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-27T18:30:53.229397] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:30:53.525898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-27T18:30:54.014970] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-27T18:30:54.281853] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-27T18:30:54.814943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-27T18:30:55.235153] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:30:55.614938] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-27T18:30:55.904324] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-27T18:30:56.414942] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-27T18:30:57.072554] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T18:30:57.214945] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-27T18:30:57.530804] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-27T18:30:58.014931] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-27T18:30:58.814943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-27T18:30:59.190285] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:30:59.193568] [INFO ] [REMOTE ] EHI: Full fetch complete (15721 records). [2025-10-27T18:30:59.193746] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-27T18:30:59.289805] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T18:30:59.568939] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-27T18:30:59.569018] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-27T18:30:59.569369] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-27T18:30:59.569408] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-27T18:30:59.569930] [DEBUG] [LOCAL ] EHI: Trimmed 15721 records to 10481 (keeping 200 days of data) [2025-10-27T18:30:59.615687] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-27T18:30:59.630792] [DEBUG] [LOCAL ] EHI: Primary data saved (10481 records). [2025-10-27T18:30:59.630877] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-27T18:30:59.630950] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 38.8s. Estimated remaining: 3h 30m 25s. Rate: 7.9 symbols/min [2025-10-27T18:30:59.817849] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:30:59.825575] [DEBUG] [LOCAL ] EICC: Loaded 6243 existing records from primary storage. [2025-10-27T18:30:59.825795] [INFO ] [MAIN ] EICC: Loaded 6243 existing records. [2025-10-27T18:30:59.954364] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:31:00.005244] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:00.005458] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-27T18:31:00.005513] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-27T18:31:00.005691] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-10-27T18:31:00.005750] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-27T18:31:00.356069] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:00.414913] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-27T18:31:00.923902] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T18:31:01.214996] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-27T18:31:01.833155] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:31:02.014954] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-27T18:31:02.535243] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:31:02.536435] [INFO ] [REMOTE ] EICB: Full fetch complete (2623 records). [2025-10-27T18:31:02.536514] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-27T18:31:02.537040] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:02.537139] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:02.537213] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:02.537298] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-27T18:31:02.537377] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-27T18:31:02.537427] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-27T18:31:02.537483] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-27T18:31:02.537554] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICB took 18.3s. Estimated remaining: 3h 30m 7s. Rate: 7.9 symbols/min [2025-10-27T18:31:02.717747] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:02.738052] [DEBUG] [LOCAL ] EIG: Loaded 20281 existing records from primary storage. [2025-10-27T18:31:02.738263] [INFO ] [MAIN ] EIG: Loaded 20281 existing records. [2025-10-27T18:31:02.820038] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-27T18:31:02.921592] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:02.921794] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-27T18:31:02.921848] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-27T18:31:02.922012] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-27T18:31:02.922050] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-27T18:31:03.268320] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:03.614952] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-27T18:31:03.830711] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:31:04.414929] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-27T18:31:04.696300] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:31:04.976113] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T18:31:05.214941] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-27T18:31:06.014946] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-27T18:31:06.051302] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T18:31:06.420989] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:31:06.814975] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-27T18:31:07.614979] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-27T18:31:07.920979] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:31:08.415046] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-27T18:31:08.756576] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T18:31:08.910777] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:31:09.214971] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-27T18:31:09.774274] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:31:09.775084] [INFO ] [REMOTE ] EICA: Full fetch complete (1174 records). [2025-10-27T18:31:09.775173] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-27T18:31:09.775530] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:09.775626] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:09.775727] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:09.775804] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-27T18:31:09.775890] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-27T18:31:09.775937] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-27T18:31:09.775979] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-27T18:31:09.776033] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICA took 26.9s. Estimated remaining: 3h 29m 58s. Rate: 7.9 symbols/min [2025-10-27T18:31:09.946472] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:09.997203] [DEBUG] [LOCAL ] EIX: Loaded 54119 existing records from primary storage. [2025-10-27T18:31:09.997529] [INFO ] [MAIN ] EIX: Loaded 54119 existing records. [2025-10-27T18:31:10.020097] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-27T18:31:10.179165] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:10.179378] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-27T18:31:10.179426] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-27T18:31:10.179632] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-27T18:31:10.179737] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-27T18:31:10.540333] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:10.545829] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:31:10.814984] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-27T18:31:11.614956] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-27T18:31:11.963268] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:31:12.414949] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-27T18:31:12.982083] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-27T18:31:13.214952] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-27T18:31:13.608986] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:31:14.014954] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-27T18:31:14.291858] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T18:31:14.814926] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-27T18:31:15.018951] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:31:15.614976] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-27T18:31:16.100026] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:31:16.414989] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-27T18:31:16.894134] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T18:31:17.215026] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-27T18:31:17.476856] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-27T18:31:18.014975] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-27T18:31:18.061553] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:31:18.814993] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-27T18:31:19.548689] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:31:19.626220] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-27T18:31:19.635198] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:31:20.414915] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-27T18:31:20.674295] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T18:31:21.214965] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-27T18:31:21.797103] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:31:22.014906] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-27T18:31:22.300108] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:31:22.814933] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-27T18:31:23.614910] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-27T18:31:23.730426] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T18:31:23.918237] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T18:31:24.322085] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:31:24.414930] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-27T18:31:25.214905] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-27T18:31:25.250930] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T18:31:26.014938] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-27T18:31:26.294698] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:31:26.814947] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-27T18:31:27.614924] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-27T18:31:27.813081] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T18:31:28.091386] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T18:31:28.343434] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T18:31:28.347051] [INFO ] [REMOTE ] EIC: Full fetch complete (33816 records). [2025-10-27T18:31:28.347126] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-27T18:31:28.347692] [FATAL] [VALIDATOR ] EIC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:28.347767] [FATAL] [MAIN ] EIC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:28.347832] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:28.347898] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-27T18:31:28.347961] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-27T18:31:28.347995] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-10-27T18:31:28.348110] [DEBUG] [LOCAL ] EIC: Deleted derivative data file. [2025-10-27T18:31:28.348174] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EIC took 46.9s. Estimated remaining: 3h 30m 16s. Rate: 7.8 symbols/min [2025-10-27T18:31:28.414908] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-27T18:31:29.214981] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-27T18:31:30.014920] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-27T18:31:30.103402] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:31:30.418847] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T18:31:30.422303] [INFO ] [REMOTE ] EIG: Full fetch complete (27324 records). [2025-10-27T18:31:30.422383] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-27T18:31:30.712521] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:31:30.735462] [INFO ] [REMOTE ] EICC: Full fetch complete (8438 records). [2025-10-27T18:31:30.754380] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-27T18:31:30.773488] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:31:30.799631] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:31:30.801336] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-27T18:31:30.801409] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-27T18:31:30.802000] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-27T18:31:30.802080] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-27T18:31:30.801461] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:31:30.802258] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-27T18:31:30.802324] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-27T18:31:30.802637] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-27T18:31:30.803059] [DEBUG] [LOCAL ] EIG: Trimmed 27324 records to 19836 (keeping 200 days of data) [2025-10-27T18:31:30.802986] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-10-27T18:31:30.803197] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EICC took 31.2s. Estimated remaining: 3h 29m 56s. Rate: 7.9 symbols/min [2025-10-27T18:31:30.852439] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-27T18:31:30.921297] [DEBUG] [LOCAL ] EIG: Primary data saved (19836 records). [2025-10-27T18:31:30.921579] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-27T18:31:30.921758] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EIG took 28.4s. Estimated remaining: 3h 29m 31s. Rate: 7.9 symbols/min [2025-10-27T18:31:32.249404] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:31:32.262181] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-27T18:31:34.424042] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T18:31:34.436224] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-27T18:31:35.572110] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:31:35.583961] [INFO ] [REMOTE ] EIX: Full fetch complete (77450 records). [2025-10-27T18:31:35.584253] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-27T18:31:36.164011] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-27T18:31:36.164128] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-27T18:31:36.165608] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-27T18:31:36.165722] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-27T18:31:36.167800] [DEBUG] [LOCAL ] EIX: Trimmed 77450 records to 53339 (keeping 200 days of data) [2025-10-27T18:31:36.515551] [DEBUG] [LOCAL ] EIX: Primary data saved (53339 records). [2025-10-27T18:31:36.515735] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-27T18:31:36.515849] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 26.7s. Estimated remaining: 3h 29m 19s. Rate: 7.9 symbols/min [2025-10-27T18:31:37.102937] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.209266] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.232971] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.263974] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:37.266801] [DEBUG] [LOCAL ] ELC: Loaded 3490 existing records from primary storage. [2025-10-27T18:31:37.267740] [INFO ] [MAIN ] ELC: Loaded 3490 existing records. [2025-10-27T18:31:37.485583] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:37.514007] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-27T18:31:37.515256] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-27T18:31:37.515563] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-27T18:31:37.515624] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-27T18:31:37.517131] [DEBUG] [LOCAL ] ELF: Loaded 52556 existing records from primary storage. [2025-10-27T18:31:37.547384] [INFO ] [MAIN ] ELF: Loaded 52556 existing records. [2025-10-27T18:31:37.626285] [DEBUG] [LOCAL ] EL: Loaded 54154 existing records from primary storage. [2025-10-27T18:31:37.671636] [INFO ] [MAIN ] EL: Loaded 54154 existing records. [2025-10-27T18:31:37.749513] [DEBUG] [LOCAL ] ELAN: Loaded 54089 existing records from primary storage. [2025-10-27T18:31:37.808546] [INFO ] [MAIN ] ELAN: Loaded 54089 existing records. [2025-10-27T18:31:38.319187] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.360714] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.376587] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.400800] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.433877] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-27T18:31:38.439274] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:38.434117] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-27T18:31:38.440230] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-27T18:31:38.460978] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-27T18:31:38.455791] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-27T18:31:38.466505] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-27T18:31:38.478571] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-27T18:31:38.461120] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-27T18:31:38.528697] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-27T18:31:38.528549] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-27T18:31:38.582470] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:38.641713] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-27T18:31:39.538097] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T18:31:39.554800] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.576398] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-27T18:31:39.578069] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-27T18:31:39.588955] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.609020] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-27T18:31:39.649720] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:39.649959] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-27T18:31:40.172537] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:31:40.173836] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-27T18:31:40.607446] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:31:40.608909] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-27T18:31:41.035832] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:31:41.045946] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-27T18:31:41.186295] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:31:41.187971] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-27T18:31:41.449915] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T18:31:41.459946] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-27T18:31:41.540229] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:31:41.541700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-27T18:31:41.585962] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T18:31:41.943572] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:31:42.014911] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-27T18:31:42.388501] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-27T18:31:42.563340] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:31:42.814953] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-27T18:31:43.041100] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T18:31:43.544906] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T18:31:43.614924] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-27T18:31:44.414958] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-27T18:31:44.656851] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:31:45.214943] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-27T18:31:46.015264] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-27T18:31:46.155450] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T18:31:46.814946] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-27T18:31:47.424288] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:31:47.447451] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-27T18:31:47.614933] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-27T18:31:48.414971] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-27T18:31:48.902994] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T18:31:49.214917] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-27T18:31:49.404710] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T18:31:49.833790] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T18:31:49.834979] [INFO ] [REMOTE ] ELC: Full fetch complete (4906 records). [2025-10-27T18:31:49.835050] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-27T18:31:50.020044] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-27T18:31:50.199897] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-27T18:31:50.199975] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-27T18:31:50.200129] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-27T18:31:50.200168] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-27T18:31:50.200534] [DEBUG] [LOCAL ] ELC: Trimmed 4906 records to 3391 (keeping 200 days of data) [2025-10-27T18:31:50.224097] [DEBUG] [LOCAL ] ELC: Primary data saved (3391 records). [2025-10-27T18:31:50.224209] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-27T18:31:50.224315] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 13.7s. Estimated remaining: 3h 29m 25s. Rate: 7.9 symbols/min [2025-10-27T18:31:50.397875] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:31:50.443025] [DEBUG] [LOCAL ] ELME: Loaded 39892 existing records from primary storage. [2025-10-27T18:31:50.443300] [INFO ] [MAIN ] ELME: Loaded 39892 existing records. [2025-10-27T18:31:50.633158] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:31:50.633471] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-27T18:31:50.633548] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-27T18:31:50.633890] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-27T18:31:50.633946] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-27T18:31:50.819696] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-27T18:31:50.928440] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-27T18:31:51.061732] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:31:51.614912] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-27T18:31:51.972245] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:31:52.414957] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-27T18:31:53.110524] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:31:53.164109] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T18:31:53.214946] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-27T18:31:54.014918] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-27T18:31:54.089041] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:31:54.165012] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:31:54.815004] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-27T18:31:55.583848] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T18:31:55.614907] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-27T18:31:56.272184] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:31:56.414941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-27T18:31:57.214940] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-27T18:31:57.641148] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T18:31:58.014985] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-27T18:31:58.564576] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T18:31:58.814933] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-27T18:31:58.895286] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:31:59.250035] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T18:31:59.614963] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-27T18:32:00.415018] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-27T18:32:00.577454] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T18:32:01.214968] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-27T18:32:02.019928] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-27T18:32:02.023256] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-27T18:32:02.349042] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:32:02.814988] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-27T18:32:02.882816] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T18:32:03.389055] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:32:03.614977] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-27T18:32:04.414971] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-27T18:32:04.867829] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T18:32:05.035287] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T18:32:05.214952] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-27T18:32:06.014936] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-27T18:32:06.125999] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:32:06.136517] [INFO ] [REMOTE ] ELAN: Full fetch complete (77092 records). [2025-10-27T18:32:06.136718] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-27T18:32:06.539074] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-27T18:32:06.539218] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-27T18:32:06.540171] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-27T18:32:06.540250] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-27T18:32:06.542168] [DEBUG] [LOCAL ] ELAN: Trimmed 77092 records to 53308 (keeping 200 days of data) [2025-10-27T18:32:06.782490] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:32:06.815770] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-27T18:32:06.895157] [DEBUG] [LOCAL ] ELAN: Primary data saved (53308 records). [2025-10-27T18:32:06.895308] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-27T18:32:06.895996] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELAN took 30.4s. Estimated remaining: 3h 29m 38s. Rate: 7.8 symbols/min [2025-10-27T18:32:07.075059] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:07.099030] [DEBUG] [LOCAL ] ELP: Loaded 25883 existing records from primary storage. [2025-10-27T18:32:07.099339] [INFO ] [MAIN ] ELP: Loaded 25883 existing records. [2025-10-27T18:32:07.276457] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:07.276716] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-27T18:32:07.276773] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-27T18:32:07.277015] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-27T18:32:07.277073] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-27T18:32:07.619918] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-27T18:32:07.650527] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:08.007244] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T18:32:08.291731] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T18:32:08.414940] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-27T18:32:09.214911] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-27T18:32:09.407486] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:32:09.418929] [INFO ] [REMOTE ] EL: Full fetch complete (77428 records). [2025-10-27T18:32:09.419076] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-27T18:32:09.898093] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-27T18:32:09.900996] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-27T18:32:09.901947] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-27T18:32:09.902181] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-27T18:32:09.904345] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-27T18:32:09.915995] [DEBUG] [LOCAL ] EL: Trimmed 77428 records to 53370 (keeping 200 days of data) [2025-10-27T18:32:10.015735] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-27T18:32:10.251727] [DEBUG] [LOCAL ] EL: Primary data saved (53370 records). [2025-10-27T18:32:10.251861] [INFO ] [MAIN ] EL: Full history saved. [2025-10-27T18:32:10.252454] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. EL took 33.7s. Estimated remaining: 3h 29m 21s. Rate: 7.8 symbols/min [2025-10-27T18:32:10.424779] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:10.424934] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-27T18:32:10.424972] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-27T18:32:10.425081] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-27T18:32:10.425122] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-27T18:32:10.425165] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-27T18:32:10.425215] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-27T18:32:10.780773] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:10.805060] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T18:32:10.814905] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-27T18:32:11.044365] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T18:32:11.614922] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-27T18:32:11.974618] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T18:32:11.989874] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T18:32:12.414990] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-27T18:32:13.214975] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-27T18:32:14.014971] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-27T18:32:14.127246] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:32:14.134869] [INFO ] [REMOTE ] ELME: Full fetch complete (55823 records). [2025-10-27T18:32:14.135008] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-27T18:32:14.135714] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:14.135801] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:14.135877] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:14.135961] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-27T18:32:14.136036] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-27T18:32:14.136087] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-27T18:32:14.136264] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-27T18:32:14.136374] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELME took 23.9s. Estimated remaining: 3h 29m 4s. Rate: 7.9 symbols/min [2025-10-27T18:32:14.307334] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:14.311748] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T18:32:14.355946] [DEBUG] [LOCAL ] ELS: Loaded 50613 existing records from primary storage. [2025-10-27T18:32:14.356247] [INFO ] [MAIN ] ELS: Loaded 50613 existing records. [2025-10-27T18:32:14.528171] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:14.528364] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-27T18:32:14.528410] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-27T18:32:14.528674] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-27T18:32:14.528730] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-27T18:32:14.823073] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-27T18:32:14.879533] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:14.916080] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T18:32:15.615000] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-27T18:32:15.971978] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:32:16.415014] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-27T18:32:16.769779] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T18:32:17.214917] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-27T18:32:17.711551] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:32:17.721056] [INFO ] [REMOTE ] ELF: Full fetch complete (75465 records). [2025-10-27T18:32:17.721176] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-27T18:32:18.019992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-27T18:32:18.135565] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:32:18.135782] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-27T18:32:18.135916] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-27T18:32:18.141989] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-27T18:32:18.142070] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-27T18:32:18.143362] [DEBUG] [LOCAL ] ELF: Trimmed 75465 records to 51744 (keeping 200 days of data) [2025-10-27T18:32:18.460511] [DEBUG] [LOCAL ] ELF: Primary data saved (51744 records). [2025-10-27T18:32:18.460666] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-27T18:32:18.460775] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELF took 41.9s. Estimated remaining: 3h 28m 49s. Rate: 7.9 symbols/min [2025-10-27T18:32:18.571332] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T18:32:18.633865] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:18.679345] [DEBUG] [LOCAL ] ELV: Loaded 51485 existing records from primary storage. [2025-10-27T18:32:18.679660] [INFO ] [MAIN ] ELV: Loaded 51485 existing records. [2025-10-27T18:32:18.820055] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-27T18:32:18.858727] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:18.858928] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-27T18:32:18.858983] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-27T18:32:18.859245] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-27T18:32:18.859283] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-27T18:32:19.206300] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:19.614908] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-27T18:32:19.660522] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T18:32:20.414981] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-27T18:32:21.214972] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-27T18:32:21.396398] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T18:32:21.574371] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T18:32:22.014993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-27T18:32:22.445435] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T18:32:22.787543] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:32:22.814909] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-27T18:32:23.614959] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-27T18:32:23.842741] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T18:32:23.946130] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T18:32:24.414971] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-27T18:32:25.214947] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-27T18:32:25.538082] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T18:32:25.687380] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:32:26.014939] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-27T18:32:26.815000] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-27T18:32:27.076198] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-27T18:32:27.614950] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-27T18:32:27.774479] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T18:32:27.870474] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-27T18:32:28.414968] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-27T18:32:29.214993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-27T18:32:29.570586] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T18:32:29.571528] [INFO ] [REMOTE ] ELPC: Full fetch complete (1285 records). [2025-10-27T18:32:29.571604] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-27T18:32:29.761122] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-27T18:32:29.761297] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:29.761364] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:29.761436] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-27T18:32:29.761499] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-27T18:32:29.761535] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-27T18:32:29.761576] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-27T18:32:29.761632] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. ELPC took 19.5s. Estimated remaining: 3h 28m 50s. Rate: 7.9 symbols/min [2025-10-27T18:32:29.932133] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:29.932476] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-27T18:32:29.932552] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-27T18:32:29.932765] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-27T18:32:29.932863] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-27T18:32:29.933009] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-27T18:32:29.933063] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-27T18:32:30.020202] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-27T18:32:30.321419] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:30.356445] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:32:30.814933] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-27T18:32:31.468038] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T18:32:31.614922] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-27T18:32:32.414922] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-27T18:32:32.461677] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T18:32:32.620172] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:32:32.620488] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-27T18:32:32.620622] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:32:32.620725] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-27T18:32:32.620794] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:32:32.620852] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-27T18:32:32.620912] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-27T18:32:32.620953] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-27T18:32:32.620992] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-27T18:32:32.621042] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. EMA took 2.9s. Estimated remaining: 3h 28m 32s. Rate: 7.9 symbols/min [2025-10-27T18:32:32.810288] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:32.831123] [DEBUG] [LOCAL ] EMD: Loaded 20980 existing records from primary storage. [2025-10-27T18:32:32.831365] [INFO ] [MAIN ] EMD: Loaded 20980 existing records. [2025-10-27T18:32:33.063049] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:33.063250] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-27T18:32:33.063316] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-27T18:32:33.063498] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-27T18:32:33.063554] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-27T18:32:33.223234] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-27T18:32:33.473971] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:33.503786] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T18:32:34.014995] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-27T18:32:34.223402] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:32:34.815060] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-27T18:32:35.492381] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T18:32:35.614926] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-27T18:32:35.700066] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:32:36.414907] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-27T18:32:36.714682] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:32:37.214963] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-27T18:32:37.619126] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:32:38.014926] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-27T18:32:38.236798] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:32:38.814949] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-27T18:32:39.310859] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:32:39.615008] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-27T18:32:39.905514] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:32:40.414951] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-27T18:32:41.199554] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T18:32:41.214899] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-27T18:32:42.012069] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T18:32:42.021631] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-27T18:32:42.814948] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-27T18:32:43.046628] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:32:43.051145] [INFO ] [REMOTE ] ELP: Full fetch complete (36554 records). [2025-10-27T18:32:43.051234] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-27T18:32:43.051813] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:43.051898] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:43.051963] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:43.052046] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-27T18:32:43.052124] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-27T18:32:43.052174] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-27T18:32:43.052335] [DEBUG] [LOCAL ] ELP: Deleted derivative data file. [2025-10-27T18:32:43.052437] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELP took 36.2s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-27T18:32:43.235070] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:43.268037] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T18:32:43.307748] [DEBUG] [LOCAL ] EME: Loaded 31222 existing records from primary storage. [2025-10-27T18:32:43.308097] [INFO ] [MAIN ] EME: Loaded 31222 existing records. [2025-10-27T18:32:43.486718] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:43.486938] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-27T18:32:43.487003] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-27T18:32:43.487217] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-27T18:32:43.487275] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-27T18:32:43.631787] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-27T18:32:43.810499] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:32:43.883498] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:44.414933] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-27T18:32:45.215008] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-27T18:32:45.464995] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:32:45.698556] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:32:46.014988] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-27T18:32:46.815029] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-27T18:32:47.136326] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:32:47.384322] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:32:47.614971] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-27T18:32:48.380438] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:32:48.414971] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-27T18:32:49.215033] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-27T18:32:49.364237] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T18:32:50.015008] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-27T18:32:50.280049] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:32:50.290751] [INFO ] [REMOTE ] ELS: Full fetch complete (71392 records). [2025-10-27T18:32:50.291040] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-27T18:32:50.719951] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-27T18:32:50.720077] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-27T18:32:50.721183] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-27T18:32:50.721254] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-27T18:32:50.723298] [DEBUG] [LOCAL ] ELS: Trimmed 71392 records to 49837 (keeping 200 days of data) [2025-10-27T18:32:50.826517] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-27T18:32:51.076472] [DEBUG] [LOCAL ] ELS: Primary data saved (49837 records). [2025-10-27T18:32:51.076726] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-27T18:32:51.077526] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. ELS took 36.9s. Estimated remaining: 3h 28m 23s. Rate: 7.9 symbols/min [2025-10-27T18:32:51.261024] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:32:51.267376] [DEBUG] [LOCAL ] EMF: Loaded 3134 existing records from primary storage. [2025-10-27T18:32:51.267622] [INFO ] [MAIN ] EMF: Loaded 3134 existing records. [2025-10-27T18:32:51.447378] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:32:51.447679] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-27T18:32:51.447746] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-27T18:32:51.447931] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-27T18:32:51.447990] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-27T18:32:51.871134] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:32:51.873633] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:32:51.874117] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-27T18:32:52.094750] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-27T18:32:52.414994] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-27T18:32:53.214939] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-27T18:32:53.449154] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-27T18:32:53.892717] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T18:32:54.014930] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-27T18:32:54.119969] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:32:54.320454] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T18:32:54.750822] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T18:32:54.814908] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-27T18:32:55.614943] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-27T18:32:55.994298] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T18:32:56.414945] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-27T18:32:56.811228] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T18:32:57.214912] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-27T18:32:57.504997] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:32:57.758018] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:32:58.014942] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-27T18:32:58.814944] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-27T18:32:59.423174] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:32:59.614982] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-27T18:32:59.818535] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T18:32:59.829153] [INFO ] [REMOTE ] ELV: Full fetch complete (72991 records). [2025-10-27T18:32:59.829292] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-27T18:32:59.830128] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:32:59.830234] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:32:59.830278] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:32:59.830346] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-27T18:32:59.830410] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-27T18:32:59.830445] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-27T18:32:59.830605] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-27T18:32:59.830860] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. ELV took 41.4s. Estimated remaining: 3h 28m 18s. Rate: 7.9 symbols/min [2025-10-27T18:33:00.030546] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:00.075910] [DEBUG] [LOCAL ] EMN: Loaded 51587 existing records from primary storage. [2025-10-27T18:33:00.076277] [INFO ] [MAIN ] EMN: Loaded 51587 existing records. [2025-10-27T18:33:00.256977] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:00.257218] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-27T18:33:00.257291] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-27T18:33:00.257581] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-27T18:33:00.257638] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-27T18:33:00.427422] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-27T18:33:00.624117] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:00.634534] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:33:00.638397] [INFO ] [REMOTE ] EMD: Full fetch complete (31675 records). [2025-10-27T18:33:00.638469] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-27T18:33:00.638961] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:33:00.639042] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:33:00.639113] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:33:00.639197] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-27T18:33:00.639271] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-27T18:33:00.639324] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-27T18:33:00.639517] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-27T18:33:00.639604] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMD took 28.0s. Estimated remaining: 3h 27m 55s. Rate: 7.9 symbols/min [2025-10-27T18:33:00.806264] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:00.819948] [DEBUG] [LOCAL ] EMO: Loaded 13551 existing records from primary storage. [2025-10-27T18:33:00.820182] [INFO ] [MAIN ] EMO: Loaded 13551 existing records. [2025-10-27T18:33:00.995717] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:00.995909] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-27T18:33:00.995959] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-27T18:33:00.996111] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-27T18:33:00.996151] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-27T18:33:01.224200] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-27T18:33:01.346270] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:02.014938] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-27T18:33:02.150356] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:33:02.504276] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T18:33:02.814962] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-27T18:33:02.951406] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:33:03.155359] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T18:33:03.614910] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-27T18:33:04.414937] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-27T18:33:04.898234] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:33:05.214999] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-27T18:33:05.756060] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T18:33:06.014962] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-27T18:33:06.110472] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:33:06.814988] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-27T18:33:07.392137] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T18:33:07.615016] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-27T18:33:07.697006] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T18:33:08.415012] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-27T18:33:09.200965] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T18:33:09.214921] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-27T18:33:09.386017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:33:09.822270] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:33:10.015011] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-27T18:33:10.639030] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T18:33:10.814981] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-27T18:33:11.416597] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:33:11.614924] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-27T18:33:12.090562] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:33:12.414972] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-27T18:33:12.740134] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T18:33:13.214943] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-27T18:33:14.014932] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-27T18:33:14.213592] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:33:14.814947] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-27T18:33:15.286587] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T18:33:15.615002] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-27T18:33:15.782403] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T18:33:16.163527] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:33:16.164691] [INFO ] [REMOTE ] EMF: Full fetch complete (5961 records). [2025-10-27T18:33:16.164759] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-27T18:33:16.420252] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-27T18:33:16.513303] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-27T18:33:16.513381] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-27T18:33:16.513537] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-27T18:33:16.513574] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-27T18:33:16.513948] [DEBUG] [LOCAL ] EMF: Trimmed 5961 records to 3001 (keeping 200 days of data) [2025-10-27T18:33:16.532162] [DEBUG] [LOCAL ] EMF: Primary data saved (3001 records). [2025-10-27T18:33:16.532228] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-27T18:33:16.532295] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 25.5s. Estimated remaining: 3h 28m 6s. Rate: 7.9 symbols/min [2025-10-27T18:33:16.696052] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:16.700204] [DEBUG] [LOCAL ] EMP: Loaded 2902 existing records from primary storage. [2025-10-27T18:33:16.700385] [INFO ] [MAIN ] EMP: Loaded 2902 existing records. [2025-10-27T18:33:16.873259] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:16.873457] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-27T18:33:16.873503] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-27T18:33:16.873700] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-27T18:33:16.873757] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-27T18:33:17.219351] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:17.216393] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-27T18:33:17.818028] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T18:33:18.014911] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-27T18:33:18.128430] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:33:18.407321] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T18:33:18.814980] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-27T18:33:19.350677] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T18:33:19.614933] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-27T18:33:20.414923] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-27T18:33:20.507713] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:33:21.214987] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-27T18:33:21.649231] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:33:21.793579] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T18:33:22.014954] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-27T18:33:22.815029] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-27T18:33:23.014067] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:33:23.614998] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-27T18:33:24.415539] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:33:24.415627] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-27T18:33:24.833187] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T18:33:24.836438] [INFO ] [REMOTE ] EMO: Full fetch complete (17654 records). [2025-10-27T18:33:24.836507] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-27T18:33:24.836982] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:33:24.837061] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:33:24.837101] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:33:24.837137] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-27T18:33:24.837189] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-27T18:33:24.837222] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-10-27T18:33:24.837332] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-10-27T18:33:24.837394] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMO took 24.2s. Estimated remaining: 3h 28m 0s. Rate: 7.9 symbols/min [2025-10-27T18:33:24.940326] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T18:33:25.012422] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:25.061485] [DEBUG] [LOCAL ] EMR: Loaded 53907 existing records from primary storage. [2025-10-27T18:33:25.061817] [INFO ] [MAIN ] EMR: Loaded 53907 existing records. [2025-10-27T18:33:25.218505] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-27T18:33:25.238392] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:25.239336] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-27T18:33:25.239386] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-27T18:33:25.239627] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-27T18:33:25.239714] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-27T18:33:25.582695] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:26.014936] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-27T18:33:26.814909] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-27T18:33:27.152110] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:33:27.226757] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:33:27.614955] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-27T18:33:27.706089] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:33:27.712207] [INFO ] [REMOTE ] EME: Full fetch complete (47098 records). [2025-10-27T18:33:27.712301] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-27T18:33:28.077373] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-27T18:33:28.077543] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-27T18:33:28.078229] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-27T18:33:28.078298] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-27T18:33:28.079263] [DEBUG] [LOCAL ] EME: Trimmed 47098 records to 30529 (keeping 200 days of data) [2025-10-27T18:33:28.257565] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T18:33:28.274246] [DEBUG] [LOCAL ] EME: Primary data saved (30529 records). [2025-10-27T18:33:28.274328] [INFO ] [MAIN ] EME: Full history saved. [2025-10-27T18:33:28.274394] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EME took 45.2s. Estimated remaining: 3h 27m 43s. Rate: 7.9 symbols/min [2025-10-27T18:33:28.416301] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-27T18:33:28.438966] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:28.485909] [DEBUG] [LOCAL ] ENB: Loaded 54291 existing records from primary storage. [2025-10-27T18:33:28.486210] [INFO ] [MAIN ] ENB: Loaded 54291 existing records. [2025-10-27T18:33:28.658550] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:28.658746] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-27T18:33:28.658795] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-27T18:33:28.659044] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-27T18:33:28.659081] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-27T18:33:29.005064] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:29.214902] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-27T18:33:30.014979] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-27T18:33:30.097093] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:33:30.419429] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:33:30.630103] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:33:30.814906] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-27T18:33:31.614953] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-27T18:33:32.173892] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T18:33:32.414912] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-27T18:33:32.674409] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-27T18:33:32.752605] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-27T18:33:33.215041] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-27T18:33:34.015069] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-27T18:33:34.613181] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T18:33:34.814978] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-27T18:33:34.867281] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:33:35.367536] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:33:35.368486] [INFO ] [REMOTE ] EMP: Full fetch complete (4046 records). [2025-10-27T18:33:35.368554] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-27T18:33:35.620087] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-27T18:33:35.741337] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-27T18:33:35.741413] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-27T18:33:35.741560] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-27T18:33:35.741616] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-27T18:33:35.742021] [DEBUG] [LOCAL ] EMP: Trimmed 4046 records to 2836 (keeping 200 days of data) [2025-10-27T18:33:35.760399] [DEBUG] [LOCAL ] EMP: Primary data saved (2836 records). [2025-10-27T18:33:35.760508] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-27T18:33:35.760582] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMP took 19.2s. Estimated remaining: 3h 27m 35s. Rate: 7.9 symbols/min [2025-10-27T18:33:35.943113] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:35.977097] [DEBUG] [LOCAL ] ENIC: Loaded 36940 existing records from primary storage. [2025-10-27T18:33:35.977363] [INFO ] [MAIN ] ENIC: Loaded 36940 existing records. [2025-10-27T18:33:36.149025] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:36.149226] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-27T18:33:36.149272] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-27T18:33:36.149429] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-27T18:33:36.149465] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-27T18:33:36.416664] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-27T18:33:36.493607] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:37.214941] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-27T18:33:37.573760] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:33:37.584036] [INFO ] [REMOTE ] EMN: Full fetch complete (72457 records). [2025-10-27T18:33:37.584201] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-27T18:33:38.027967] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-27T18:33:38.033558] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-27T18:33:38.033765] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-27T18:33:38.034899] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-27T18:33:38.035111] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-27T18:33:38.037016] [DEBUG] [LOCAL ] EMN: Trimmed 72457 records to 50796 (keeping 200 days of data) [2025-10-27T18:33:38.383599] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T18:33:38.414130] [DEBUG] [LOCAL ] EMN: Primary data saved (50796 records). [2025-10-27T18:33:38.414597] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-27T18:33:38.414736] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. EMN took 38.6s. Estimated remaining: 3h 27m 16s. Rate: 7.9 symbols/min [2025-10-27T18:33:38.590099] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:33:38.594374] [DEBUG] [LOCAL ] ENO: Loaded 1752 existing records from primary storage. [2025-10-27T18:33:38.594546] [INFO ] [MAIN ] ENO: Loaded 1752 existing records. [2025-10-27T18:33:38.772631] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:33:38.773364] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-27T18:33:38.773483] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-27T18:33:38.773735] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-27T18:33:38.773830] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-27T18:33:38.835755] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-27T18:33:38.954968] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:33:39.155585] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:33:39.614950] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-27T18:33:39.844963] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T18:33:40.414975] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-27T18:33:40.742866] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:33:40.847313] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:33:41.214933] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-27T18:33:42.014924] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-27T18:33:42.138824] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:33:42.443257] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T18:33:42.814940] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-27T18:33:43.614913] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-27T18:33:43.693533] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:33:44.054616] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T18:33:44.314260] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T18:33:44.414920] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-27T18:33:45.214974] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-27T18:33:46.014960] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-27T18:33:46.566682] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-27T18:33:46.581681] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T18:33:46.814925] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-27T18:33:46.901507] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:33:47.275717] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:33:47.614973] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-27T18:33:48.414942] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-27T18:33:48.888110] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:33:49.214951] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-27T18:33:49.566395] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T18:33:50.014992] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-27T18:33:50.814927] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-27T18:33:51.152119] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T18:33:51.169202] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:33:51.412062] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:33:51.614948] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-27T18:33:52.414998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-27T18:33:52.822835] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:33:53.214970] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-27T18:33:53.651264] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T18:33:54.013752] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T18:33:54.021361] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-27T18:33:54.397537] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T18:33:54.814943] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-27T18:33:55.615006] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-27T18:33:56.060265] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:33:56.414933] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-27T18:33:56.621560] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T18:33:57.214990] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-27T18:33:57.413297] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:33:57.518111] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-27T18:33:58.014926] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-27T18:33:58.814944] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-27T18:33:59.469719] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:33:59.614952] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-27T18:34:00.414948] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-27T18:34:01.214988] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-27T18:34:01.381674] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-27T18:34:01.724153] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:34:02.014968] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-27T18:34:02.137354] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T18:34:02.138259] [INFO ] [REMOTE ] ENO: Full fetch complete (2964 records). [2025-10-27T18:34:02.138330] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-27T18:34:02.138711] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:02.138803] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:02.138845] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:02.138908] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-27T18:34:02.138968] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-27T18:34:02.139003] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-27T18:34:02.139150] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-10-27T18:34:02.139233] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. ENO took 23.7s. Estimated remaining: 3h 27m 44s. Rate: 7.8 symbols/min [2025-10-27T18:34:02.323977] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:02.364898] [DEBUG] [LOCAL ] ENOV: Loaded 45142 existing records from primary storage. [2025-10-27T18:34:02.365213] [INFO ] [MAIN ] ENOV: Loaded 45142 existing records. [2025-10-27T18:34:02.535630] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T18:34:02.587198] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:02.587502] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-27T18:34:02.587562] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-27T18:34:02.588208] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-27T18:34:02.588269] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-27T18:34:02.823769] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-27T18:34:02.950593] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:03.614916] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-27T18:34:03.691946] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:34:04.415001] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-27T18:34:04.797899] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T18:34:04.809090] [INFO ] [REMOTE ] EMR: Full fetch complete (77178 records). [2025-10-27T18:34:04.809268] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-27T18:34:05.246675] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-27T18:34:05.268905] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-27T18:34:05.269001] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-27T18:34:05.288990] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-27T18:34:05.290412] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:34:05.290527] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-27T18:34:05.298764] [DEBUG] [LOCAL ] EMR: Trimmed 77178 records to 53121 (keeping 200 days of data) [2025-10-27T18:34:05.626668] [DEBUG] [LOCAL ] EMR: Primary data saved (53121 records). [2025-10-27T18:34:05.626817] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-27T18:34:05.626917] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. EMR took 40.8s. Estimated remaining: 3h 27m 27s. Rate: 7.8 symbols/min [2025-10-27T18:34:05.791796] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:05.830607] [DEBUG] [LOCAL ] ENR: Loaded 44363 existing records from primary storage. [2025-10-27T18:34:05.830916] [INFO ] [MAIN ] ENR: Loaded 44363 existing records. [2025-10-27T18:34:06.002998] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:06.003284] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-27T18:34:06.003347] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-27T18:34:06.003611] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-27T18:34:06.003726] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-27T18:34:06.020018] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-27T18:34:06.382975] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:06.442570] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T18:34:06.452904] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-27T18:34:06.453033] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-27T18:34:06.817405] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-27T18:34:06.840752] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-27T18:34:06.840821] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-27T18:34:06.841732] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-27T18:34:06.841892] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-27T18:34:06.843282] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 53511 (keeping 200 days of data) [2025-10-27T18:34:07.160319] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-27T18:34:07.160440] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-27T18:34:07.160512] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENB took 38.9s. Estimated remaining: 3h 27m 6s. Rate: 7.9 symbols/min [2025-10-27T18:34:07.335325] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:07.364845] [DEBUG] [LOCAL ] ENS: Loaded 30030 existing records from primary storage. [2025-10-27T18:34:07.373376] [INFO ] [MAIN ] ENS: Loaded 30030 existing records. [2025-10-27T18:34:07.491800] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T18:34:07.584839] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:34:07.604080] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:07.610128] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-27T18:34:07.610184] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-27T18:34:07.610303] [INFO ] [REMOTE ] ENIC: Full fetch complete (51016 records). [2025-10-27T18:34:07.610405] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-27T18:34:07.610477] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-27T18:34:07.610377] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-27T18:34:07.621520] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-27T18:34:07.646979] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:07.666775] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:07.681492] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:07.702863] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-27T18:34:07.713304] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-27T18:34:07.713359] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-27T18:34:07.729367] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-27T18:34:07.734581] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENIC took 32.0s. Estimated remaining: 3h 26m 43s. Rate: 7.9 symbols/min [2025-10-27T18:34:08.079464] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:08.136400] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:08.157883] [DEBUG] [LOCAL ] ENVA: Loaded 25717 existing records from primary storage. [2025-10-27T18:34:08.158158] [INFO ] [MAIN ] ENVA: Loaded 25717 existing records. [2025-10-27T18:34:08.337482] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:08.337795] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-27T18:34:08.337903] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-27T18:34:08.338192] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-27T18:34:08.338321] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-27T18:34:08.419030] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-27T18:34:08.538776] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:34:08.733904] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:08.896130] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:34:09.214953] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-27T18:34:10.014957] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-27T18:34:10.153102] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:34:10.156342] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:34:10.814933] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-27T18:34:11.315812] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T18:34:11.614966] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-27T18:34:11.856462] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:34:12.414987] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-27T18:34:13.056360] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:34:13.214916] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-27T18:34:13.697704] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:34:14.014969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-27T18:34:14.813877] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:34:14.822750] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-27T18:34:14.925237] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T18:34:15.614993] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-27T18:34:16.104236] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:34:16.414928] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-27T18:34:17.215170] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-27T18:34:17.609881] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:34:18.014968] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-27T18:34:18.038920] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T18:34:18.689450] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:34:18.814923] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-27T18:34:19.614912] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-27T18:34:19.683197] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T18:34:20.133380] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T18:34:20.414958] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-27T18:34:20.602423] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T18:34:21.214988] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-27T18:34:21.983428] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:34:22.007450] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:34:22.014892] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-27T18:34:22.742908] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:34:22.814905] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-27T18:34:23.615000] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-27T18:34:24.249075] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:34:24.414935] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-27T18:34:25.198894] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:34:25.215058] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-27T18:34:25.264158] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T18:34:26.015030] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-27T18:34:26.814976] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-27T18:34:26.912777] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:34:26.954456] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:34:27.614935] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-27T18:34:28.266362] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T18:34:28.414980] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-27T18:34:29.214941] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-27T18:34:29.374261] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:34:29.463506] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:34:30.015010] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-27T18:34:30.619735] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:34:30.814992] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-27T18:34:31.373586] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:34:31.614987] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-27T18:34:31.845758] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T18:34:32.414997] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-27T18:34:32.721846] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:34:33.214957] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-27T18:34:33.380473] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T18:34:34.014941] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-27T18:34:34.449816] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T18:34:34.457728] [INFO ] [REMOTE ] ENR: Full fetch complete (59701 records). [2025-10-27T18:34:34.457866] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-27T18:34:34.816679] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-27T18:34:34.854049] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-27T18:34:34.854296] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-27T18:34:34.855220] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-27T18:34:34.855289] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-27T18:34:34.856522] [DEBUG] [LOCAL ] ENR: Trimmed 59701 records to 43645 (keeping 200 days of data) [2025-10-27T18:34:35.114412] [DEBUG] [LOCAL ] ENR: Primary data saved (43645 records). [2025-10-27T18:34:35.114529] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-27T18:34:35.115064] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENR took 29.5s. Estimated remaining: 3h 27m 19s. Rate: 7.8 symbols/min [2025-10-27T18:34:35.288107] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:35.303861] [DEBUG] [LOCAL ] EOD: Loaded 15043 existing records from primary storage. [2025-10-27T18:34:35.304083] [INFO ] [MAIN ] EOD: Loaded 15043 existing records. [2025-10-27T18:34:35.447117] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:34:35.508883] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:35.509070] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-27T18:34:35.509117] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-27T18:34:35.509293] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-27T18:34:35.509348] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-27T18:34:35.616907] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-27T18:34:35.877270] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:36.069569] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:34:36.076892] [INFO ] [REMOTE ] ENOV: Full fetch complete (62954 records). [2025-10-27T18:34:36.077000] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-27T18:34:36.077736] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:34:36.077824] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:34:36.077867] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:34:36.077906] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-27T18:34:36.077976] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-27T18:34:36.078022] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-27T18:34:36.078200] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-10-27T18:34:36.078299] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENOV took 33.9s. Estimated remaining: 3h 26m 57s. Rate: 7.8 symbols/min [2025-10-27T18:34:36.246249] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:36.295070] [DEBUG] [LOCAL ] EOG: Loaded 54170 existing records from primary storage. [2025-10-27T18:34:36.295371] [INFO ] [MAIN ] EOG: Loaded 54170 existing records. [2025-10-27T18:34:36.430341] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-27T18:34:36.470375] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:36.471086] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-27T18:34:36.471189] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-27T18:34:36.471529] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-27T18:34:36.471568] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-27T18:34:36.839003] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T18:34:36.838149] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:37.214983] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-27T18:34:37.689972] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:34:37.696335] [INFO ] [REMOTE ] ENS: Full fetch complete (42862 records). [2025-10-27T18:34:37.696421] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-27T18:34:38.023723] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-27T18:34:38.072747] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-27T18:34:38.072837] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-27T18:34:38.073460] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-27T18:34:38.073500] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-27T18:34:38.074397] [DEBUG] [LOCAL ] ENS: Trimmed 42862 records to 29376 (keeping 200 days of data) [2025-10-27T18:34:38.248903] [DEBUG] [LOCAL ] ENS: Primary data saved (29376 records). [2025-10-27T18:34:38.249032] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-27T18:34:38.249105] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. ENS took 31.1s. Estimated remaining: 3h 26m 37s. Rate: 7.9 symbols/min [2025-10-27T18:34:38.426735] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T18:34:38.428183] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:38.441782] [DEBUG] [LOCAL ] EOI: Loaded 10514 existing records from primary storage. [2025-10-27T18:34:38.441985] [INFO ] [MAIN ] EOI: Loaded 10514 existing records. [2025-10-27T18:34:38.618956] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:38.619157] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-27T18:34:38.619213] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-27T18:34:38.619358] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-27T18:34:38.619394] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-27T18:34:38.820389] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-27T18:34:38.966505] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:39.614969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-27T18:34:39.777533] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:34:40.101592] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T18:34:40.414928] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-27T18:34:40.984344] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:34:40.989162] [INFO ] [REMOTE ] ENVA: Full fetch complete (36835 records). [2025-10-27T18:34:40.989257] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-27T18:34:41.222305] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-27T18:34:41.357634] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-27T18:34:41.357746] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-27T18:34:41.358335] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-27T18:34:41.358375] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-27T18:34:41.359258] [DEBUG] [LOCAL ] ENVA: Trimmed 36835 records to 25041 (keeping 200 days of data) [2025-10-27T18:34:41.509466] [DEBUG] [LOCAL ] ENVA: Primary data saved (25041 records). [2025-10-27T18:34:41.509597] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-27T18:34:41.509708] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. ENVA took 33.8s. Estimated remaining: 3h 26m 20s. Rate: 7.9 symbols/min [2025-10-27T18:34:41.694228] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:34:41.697482] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T18:34:41.716962] [DEBUG] [LOCAL ] EOS: Loaded 14871 existing records from primary storage. [2025-10-27T18:34:41.717216] [INFO ] [MAIN ] EOS: Loaded 14871 existing records. [2025-10-27T18:34:41.846068] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:34:41.911819] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:34:41.912097] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-27T18:34:41.912160] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-27T18:34:41.912321] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-27T18:34:41.912360] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-27T18:34:42.020071] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-27T18:34:42.270341] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:34:42.814999] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-27T18:34:43.614934] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-27T18:34:43.717312] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:34:43.737800] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:34:44.253574] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:34:44.414962] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-27T18:34:45.214952] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-27T18:34:45.360202] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:34:46.015013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-27T18:34:46.778412] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:34:46.814909] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-27T18:34:46.982845] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:34:47.354768] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T18:34:47.615009] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-27T18:34:48.414913] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-27T18:34:48.563930] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:34:49.214941] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-27T18:34:49.388623] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:34:50.014944] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-27T18:34:50.583514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T18:34:50.781136] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:34:50.814943] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-27T18:34:51.614952] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-27T18:34:52.155284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:34:52.414950] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-27T18:34:52.596078] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:34:53.214996] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-27T18:34:54.014952] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-27T18:34:54.428445] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T18:34:54.587276] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-27T18:34:54.814948] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-27T18:34:55.449621] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:34:55.598849] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T18:34:55.614897] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-27T18:34:56.414948] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-27T18:34:56.562447] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:34:57.215001] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-27T18:34:57.850779] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T18:34:58.015016] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-27T18:34:58.558145] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T18:34:58.814962] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-27T18:34:58.874037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:34:59.614984] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-27T18:35:00.120022] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:35:00.411419] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T18:35:00.416526] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-27T18:35:01.215085] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-27T18:35:01.481181] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:35:02.014940] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-27T18:35:02.814925] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-27T18:35:03.046774] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:35:03.098155] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:35:03.614928] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-27T18:35:03.641844] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T18:35:04.321785] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:35:04.414913] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-27T18:35:05.214996] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-27T18:35:05.549076] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T18:35:05.551615] [INFO ] [REMOTE ] EOI: Full fetch complete (15906 records). [2025-10-27T18:35:05.551716] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-27T18:35:05.938036] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-27T18:35:05.938115] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-27T18:35:05.938454] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-27T18:35:05.938495] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-27T18:35:05.939110] [DEBUG] [LOCAL ] EOI: Trimmed 15906 records to 9956 (keeping 200 days of data) [2025-10-27T18:35:06.000740] [DEBUG] [LOCAL ] EOI: Primary data saved (9956 records). [2025-10-27T18:35:06.000879] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-27T18:35:06.000957] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOI took 27.8s. Estimated remaining: 3h 26m 49s. Rate: 7.8 symbols/min [2025-10-27T18:35:06.021483] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-27T18:35:06.174380] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:06.183308] [DEBUG] [LOCAL ] EOT: Loaded 7118 existing records from primary storage. [2025-10-27T18:35:06.183484] [INFO ] [MAIN ] EOT: Loaded 7118 existing records. [2025-10-27T18:35:06.361046] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:06.361271] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-27T18:35:06.361328] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-27T18:35:06.361473] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-27T18:35:06.361528] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-27T18:35:06.709787] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:06.814939] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-27T18:35:07.163757] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:35:07.174197] [INFO ] [REMOTE ] EOG: Full fetch complete (77471 records). [2025-10-27T18:35:07.174370] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-27T18:35:07.284196] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:35:07.300634] [INFO ] [REMOTE ] EOD: Full fetch complete (20737 records). [2025-10-27T18:35:07.316106] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-27T18:35:07.638957] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-27T18:35:07.909791] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-27T18:35:07.930482] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-27T18:35:07.982685] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-27T18:35:07.985780] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-27T18:35:07.994958] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-27T18:35:07.995429] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-27T18:35:08.005767] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-27T18:35:08.006052] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-27T18:35:08.007421] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:35:08.006792] [DEBUG] [LOCAL ] EOG: Trimmed 77471 records to 53389 (keeping 200 days of data) [2025-10-27T18:35:08.013141] [DEBUG] [LOCAL ] EOD: Trimmed 20737 records to 14650 (keeping 200 days of data) [2025-10-27T18:35:08.315939] [DEBUG] [LOCAL ] EOD: Primary data saved (14650 records). [2025-10-27T18:35:08.319135] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-27T18:35:08.319282] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOD took 33.2s. Estimated remaining: 3h 26m 30s. Rate: 7.8 symbols/min [2025-10-27T18:35:08.421389] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-27T18:35:08.537897] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:08.633937] [DEBUG] [LOCAL ] EOG: Primary data saved (53389 records). [2025-10-27T18:35:08.634161] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-27T18:35:08.635025] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOG took 32.6s. Estimated remaining: 3h 26m 6s. Rate: 7.9 symbols/min [2025-10-27T18:35:08.744914] [DEBUG] [LOCAL ] EPAC: Loaded 26742 existing records from primary storage. [2025-10-27T18:35:08.745381] [INFO ] [MAIN ] EPAC: Loaded 26742 existing records. [2025-10-27T18:35:08.909188] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:08.900781] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:35:09.002322] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:09.002639] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-27T18:35:09.002732] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-27T18:35:09.002930] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-27T18:35:09.002969] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-27T18:35:09.233196] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-27T18:35:09.239810] [DEBUG] [LOCAL ] EPAM: Loaded 39889 existing records from primary storage. [2025-10-27T18:35:09.250480] [INFO ] [MAIN ] EPAM: Loaded 39889 existing records. [2025-10-27T18:35:09.370490] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T18:35:09.556176] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:09.583638] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:09.583820] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-27T18:35:09.583865] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-27T18:35:09.584122] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-27T18:35:09.584191] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-27T18:35:09.929507] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:10.014906] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-27T18:35:10.119082] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:35:10.814984] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-27T18:35:11.215165] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:35:11.615003] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-27T18:35:12.183807] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:35:12.414942] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-27T18:35:13.142490] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:35:13.215044] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-27T18:35:13.429243] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T18:35:14.014963] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-27T18:35:14.024236] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:35:14.815000] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-27T18:35:15.299824] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-27T18:35:15.357858] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:35:15.615027] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-27T18:35:16.272379] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T18:35:16.414949] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-27T18:35:16.818663] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:35:17.214945] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-27T18:35:18.014961] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-27T18:35:18.550819] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:35:18.814918] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-27T18:35:18.956159] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:35:19.614921] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-27T18:35:20.052800] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:35:20.056213] [INFO ] [REMOTE ] EOS: Full fetch complete (22797 records). [2025-10-27T18:35:20.056286] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-27T18:35:20.421986] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-27T18:35:20.423590] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-27T18:35:20.423699] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-27T18:35:20.424211] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-27T18:35:20.424254] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-27T18:35:20.424898] [DEBUG] [LOCAL ] EOS: Trimmed 22797 records to 14302 (keeping 200 days of data) [2025-10-27T18:35:20.514414] [DEBUG] [LOCAL ] EOS: Primary data saved (14302 records). [2025-10-27T18:35:20.514701] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-27T18:35:20.514820] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOS took 39.0s. Estimated remaining: 3h 26m 8s. Rate: 7.8 symbols/min [2025-10-27T18:35:20.680561] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:20.716824] [DEBUG] [LOCAL ] EPC: Loaded 40224 existing records from primary storage. [2025-10-27T18:35:20.717213] [INFO ] [MAIN ] EPC: Loaded 40224 existing records. [2025-10-27T18:35:20.889668] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:20.889920] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-27T18:35:20.889968] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-27T18:35:20.890190] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-27T18:35:20.890228] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-27T18:35:21.216210] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-27T18:35:21.239506] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:21.298587] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:35:21.544796] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T18:35:22.014989] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-27T18:35:22.271210] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:35:22.814996] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-27T18:35:23.522180] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:35:23.614969] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-27T18:35:24.414941] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-27T18:35:24.579026] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T18:35:24.977993] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:35:25.214961] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-27T18:35:25.473007] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:35:26.015010] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-27T18:35:26.317044] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:35:26.815054] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-27T18:35:27.149011] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:35:27.305288] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T18:35:27.614949] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-27T18:35:28.414935] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-27T18:35:28.469161] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T18:35:29.214977] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-27T18:35:29.736322] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:35:29.738431] [INFO ] [REMOTE ] EOT: Full fetch complete (10646 records). [2025-10-27T18:35:29.738499] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-27T18:35:29.738911] [FATAL] [VALIDATOR ] EOT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:29.739004] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:29.739076] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:29.739162] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-27T18:35:29.739240] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-27T18:35:29.739277] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-10-27T18:35:29.739406] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-10-27T18:35:29.739473] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EOT took 23.7s. Estimated remaining: 3h 26m 3s. Rate: 7.8 symbols/min [2025-10-27T18:35:29.880496] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T18:35:29.941850] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:29.988863] [DEBUG] [LOCAL ] EPD: Loaded 54387 existing records from primary storage. [2025-10-27T18:35:29.989165] [INFO ] [MAIN ] EPD: Loaded 54387 existing records. [2025-10-27T18:35:30.020058] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-27T18:35:30.175035] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:30.175316] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-27T18:35:30.175386] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-27T18:35:30.175719] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-27T18:35:30.175775] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-27T18:35:30.522829] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:30.814928] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-27T18:35:31.614919] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-27T18:35:31.875827] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T18:35:31.956564] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:35:32.414954] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-27T18:35:33.214988] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-27T18:35:33.592638] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T18:35:33.702991] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:35:34.015000] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-27T18:35:34.319502] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:35:34.814936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-27T18:35:35.353619] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:35:35.360735] [INFO ] [REMOTE ] EPAM: Full fetch complete (56470 records). [2025-10-27T18:35:35.360873] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-27T18:35:35.361539] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:35.361621] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:35.361703] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:35.361776] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-27T18:35:35.361842] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-27T18:35:35.361876] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-27T18:35:35.362022] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-27T18:35:35.362110] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPAM took 26.7s. Estimated remaining: 3h 25m 51s. Rate: 7.9 symbols/min [2025-10-27T18:35:35.527847] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:35.568578] [DEBUG] [LOCAL ] EPR: Loaded 44288 existing records from primary storage. [2025-10-27T18:35:35.568872] [INFO ] [MAIN ] EPR: Loaded 44288 existing records. [2025-10-27T18:35:35.621710] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-27T18:35:35.748167] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:35.748399] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-27T18:35:35.748448] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-27T18:35:35.748633] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-27T18:35:35.748726] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-27T18:35:36.142183] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:36.414911] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-27T18:35:36.498638] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:35:36.800879] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:35:37.214939] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-27T18:35:38.014959] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-27T18:35:38.163431] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:35:38.814936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-27T18:35:39.001393] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:35:39.009313] [INFO ] [REMOTE ] EPAC: Full fetch complete (38822 records). [2025-10-27T18:35:39.009451] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-27T18:35:39.435577] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-27T18:35:39.435964] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-27T18:35:39.436554] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-27T18:35:39.439540] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-27T18:35:39.449044] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-27T18:35:39.450549] [DEBUG] [LOCAL ] EPAC: Trimmed 38822 records to 26063 (keeping 200 days of data) [2025-10-27T18:35:39.610700] [DEBUG] [LOCAL ] EPAC: Primary data saved (26063 records). [2025-10-27T18:35:39.610872] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-27T18:35:39.610983] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPAC took 31.3s. Estimated remaining: 3h 25m 36s. Rate: 7.9 symbols/min [2025-10-27T18:35:39.622178] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-27T18:35:39.798858] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:39.821989] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:35:39.869901] [DEBUG] [LOCAL ] EPRT: Loaded 49234 existing records from primary storage. [2025-10-27T18:35:39.870212] [INFO ] [MAIN ] EPRT: Loaded 49234 existing records. [2025-10-27T18:35:40.059564] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:40.059794] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-27T18:35:40.059843] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-27T18:35:40.060038] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-27T18:35:40.060102] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-27T18:35:40.441156] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:40.435638] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-27T18:35:41.155798] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:35:41.214956] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-27T18:35:41.521686] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:35:42.014944] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-27T18:35:42.785545] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:35:42.814913] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-27T18:35:42.956578] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T18:35:43.614944] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-27T18:35:44.414936] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-27T18:35:44.498964] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:35:44.978793] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T18:35:45.214936] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-27T18:35:45.544467] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:35:46.014939] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-27T18:35:46.803321] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:35:46.816086] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-27T18:35:47.347382] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:35:47.614938] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-27T18:35:48.414955] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-27T18:35:48.485079] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:35:49.013629] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:35:49.214934] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-27T18:35:49.546237] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T18:35:50.014934] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-27T18:35:50.810835] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:35:50.820541] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-27T18:35:51.095348] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T18:35:51.614991] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-27T18:35:52.414951] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-27T18:35:52.775981] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T18:35:52.997264] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:35:53.215006] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-27T18:35:53.677494] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:35:54.014990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-27T18:35:54.797575] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:35:54.814897] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-27T18:35:55.620150] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-27T18:35:55.622832] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:35:55.630526] [INFO ] [REMOTE ] EPC: Full fetch complete (57087 records). [2025-10-27T18:35:55.630709] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-27T18:35:55.631483] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:35:55.631616] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:35:55.631709] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:35:55.631782] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-27T18:35:55.631848] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-27T18:35:55.631884] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-27T18:35:55.632008] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-27T18:35:55.632092] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPC took 35.1s. Estimated remaining: 3h 25m 47s. Rate: 7.8 symbols/min [2025-10-27T18:35:55.816561] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:35:55.828585] [DEBUG] [LOCAL ] EQBK: Loaded 11444 existing records from primary storage. [2025-10-27T18:35:55.828805] [INFO ] [MAIN ] EQBK: Loaded 11444 existing records. [2025-10-27T18:35:55.999615] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:35:55.999838] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-27T18:35:55.999884] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-27T18:35:56.000042] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-27T18:35:56.000078] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-27T18:35:56.372361] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:35:56.414906] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-27T18:35:56.463617] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T18:35:56.970043] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:35:57.214957] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-27T18:35:57.805748] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:35:58.014944] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-27T18:35:58.814936] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-27T18:35:58.848801] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:35:58.880290] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:35:59.614946] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-27T18:36:00.414947] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-27T18:36:00.675871] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:36:01.214946] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-27T18:36:01.606670] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T18:36:02.014956] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-27T18:36:02.815079] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-27T18:36:03.142689] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-27T18:36:03.162092] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T18:36:03.326611] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:36:03.614993] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-27T18:36:04.061684] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:36:04.069628] [INFO ] [REMOTE ] EPR: Full fetch complete (62963 records). [2025-10-27T18:36:04.069756] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-27T18:36:04.070454] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:36:04.070537] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:04.070579] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:04.070615] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-27T18:36:04.070702] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-27T18:36:04.070752] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-27T18:36:04.070897] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-27T18:36:04.070983] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 28.7s. Estimated remaining: 3h 25m 41s. Rate: 7.8 symbols/min [2025-10-27T18:36:04.176070] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T18:36:04.246208] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:04.293912] [DEBUG] [LOCAL ] EQH: Loaded 53446 existing records from primary storage. [2025-10-27T18:36:04.294210] [INFO ] [MAIN ] EQH: Loaded 53446 existing records. [2025-10-27T18:36:04.420149] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-27T18:36:04.472215] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:04.472386] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-27T18:36:04.472431] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-27T18:36:04.472603] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-27T18:36:04.472675] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-27T18:36:04.815782] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:05.214989] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-27T18:36:06.013842] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T18:36:06.018980] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-27T18:36:06.735341] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:36:06.814957] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-27T18:36:07.491037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:36:07.615006] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-27T18:36:08.414953] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-27T18:36:08.524976] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T18:36:09.152952] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:36:09.214902] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-27T18:36:09.590490] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:36:09.601287] [INFO ] [REMOTE ] EPRT: Full fetch complete (69674 records). [2025-10-27T18:36:09.601453] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-27T18:36:10.015015] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-27T18:36:10.014178] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T18:36:10.036254] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-27T18:36:10.038538] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-27T18:36:10.039701] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-27T18:36:10.039764] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-27T18:36:10.040947] [DEBUG] [LOCAL ] EPRT: Trimmed 69674 records to 48434 (keeping 200 days of data) [2025-10-27T18:36:10.321508] [DEBUG] [LOCAL ] EPRT: Primary data saved (48434 records). [2025-10-27T18:36:10.321634] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-27T18:36:10.322049] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 30.7s. Estimated remaining: 3h 25m 30s. Rate: 7.8 symbols/min [2025-10-27T18:36:10.494750] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:10.544932] [DEBUG] [LOCAL ] EQNR: Loaded 53824 existing records from primary storage. [2025-10-27T18:36:10.545223] [INFO ] [MAIN ] EQNR: Loaded 53824 existing records. [2025-10-27T18:36:10.718807] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:10.718981] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-27T18:36:10.719028] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-27T18:36:10.719297] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-27T18:36:10.719353] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-27T18:36:10.816310] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-27T18:36:11.064589] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:11.614935] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-27T18:36:11.978481] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T18:36:11.988753] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-27T18:36:11.988870] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-27T18:36:12.386256] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-27T18:36:12.386373] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-27T18:36:12.387448] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-27T18:36:12.387533] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-27T18:36:12.389121] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-10-27T18:36:12.442934] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-27T18:36:12.527846] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:36:12.760533] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-10-27T18:36:12.760847] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-27T18:36:12.760965] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EPD took 43.0s. Estimated remaining: 3h 25m 11s. Rate: 7.9 symbols/min [2025-10-27T18:36:12.936743] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:12.947779] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T18:36:12.999058] [DEBUG] [LOCAL ] EQR: Loaded 52563 existing records from primary storage. [2025-10-27T18:36:12.999383] [INFO ] [MAIN ] EQR: Loaded 52563 existing records. [2025-10-27T18:36:13.177056] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:13.177253] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-27T18:36:13.177300] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-27T18:36:13.177699] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-27T18:36:13.177754] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-27T18:36:13.219998] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-27T18:36:13.539986] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:13.818472] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-27T18:36:14.014914] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-27T18:36:14.604292] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T18:36:14.815010] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-27T18:36:15.413557] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:36:15.432586] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:36:15.614922] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-27T18:36:16.414938] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-27T18:36:16.644376] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:36:17.214969] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-27T18:36:17.842528] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:36:18.014949] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-27T18:36:18.395484] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T18:36:18.814953] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-27T18:36:19.614927] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-27T18:36:19.746888] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:36:20.414947] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-27T18:36:20.545423] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T18:36:21.071806] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:36:21.160078] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T18:36:21.214922] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-27T18:36:22.014972] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-27T18:36:22.651304] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:36:22.814942] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-27T18:36:23.614941] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-27T18:36:23.829999] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:36:24.414912] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-27T18:36:24.473431] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:36:25.122443] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:36:25.214990] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-27T18:36:25.865058] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:36:26.014925] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-27T18:36:26.516091] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:36:26.716006] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T18:36:26.718877] [INFO ] [REMOTE ] EQBK: Full fetch complete (15561 records). [2025-10-27T18:36:26.718994] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-27T18:36:26.719502] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:36:26.719603] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:26.719698] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:26.719774] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-27T18:36:26.719835] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-27T18:36:26.719872] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-27T18:36:26.720027] [DEBUG] [LOCAL ] EQBK: Deleted derivative data file. [2025-10-27T18:36:26.720115] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQBK took 31.1s. Estimated remaining: 3h 25m 17s. Rate: 7.8 symbols/min [2025-10-27T18:36:26.820213] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-27T18:36:26.891271] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:26.891868] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-27T18:36:26.891923] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-27T18:36:26.892032] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-27T18:36:26.892076] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-27T18:36:26.892118] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-27T18:36:26.892151] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-27T18:36:27.257914] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:27.614951] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-27T18:36:28.414951] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-27T18:36:28.576942] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:36:29.214971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-27T18:36:29.426937] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:36:29.651661] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T18:36:29.939596] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T18:36:30.014911] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-27T18:36:30.814949] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-27T18:36:31.614974] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-27T18:36:31.903557] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T18:36:31.996563] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:36:32.414921] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-27T18:36:32.536245] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:36:32.546247] [INFO ] [REMOTE ] EQH: Full fetch complete (76599 records). [2025-10-27T18:36:32.546386] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-27T18:36:32.942046] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-27T18:36:32.942160] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-27T18:36:32.943046] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-27T18:36:32.943110] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-27T18:36:32.944497] [DEBUG] [LOCAL ] EQH: Trimmed 76599 records to 52653 (keeping 200 days of data) [2025-10-27T18:36:33.232869] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-27T18:36:33.283980] [DEBUG] [LOCAL ] EQH: Primary data saved (52653 records). [2025-10-27T18:36:33.284141] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-27T18:36:33.284247] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQH took 29.2s. Estimated remaining: 3h 25m 7s. Rate: 7.8 symbols/min [2025-10-27T18:36:33.519065] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T18:36:34.014926] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-27T18:36:34.334000] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T18:36:34.814954] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-27T18:36:35.057550] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-27T18:36:35.363176] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T18:36:35.615003] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-27T18:36:36.414975] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-27T18:36:36.761894] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T18:36:37.214964] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-27T18:36:37.375770] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:36:37.492006] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-27T18:36:38.014967] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-27T18:36:38.321072] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T18:36:38.814953] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-27T18:36:39.212899] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T18:36:39.614960] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-27T18:36:40.148094] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:36:40.414971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-27T18:36:41.080508] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T18:36:41.081455] [INFO ] [REMOTE ] EQS: Full fetch complete (2370 records). [2025-10-27T18:36:41.081524] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-27T18:36:41.225404] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-27T18:36:41.266425] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-27T18:36:41.266608] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:36:41.266695] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:36:41.266764] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-27T18:36:41.266826] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-27T18:36:41.266888] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-27T18:36:41.266942] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-27T18:36:41.266998] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQS took 14.5s. Estimated remaining: 3h 25m 0s. Rate: 7.8 symbols/min [2025-10-27T18:36:42.014988] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-27T18:36:42.868616] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T18:36:42.879738] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-27T18:36:43.942868] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:36:43.954012] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-27T18:36:44.598733] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T18:36:44.610371] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-27T18:36:45.872900] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T18:36:45.884615] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-27T18:36:46.050633] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:36:46.060596] [INFO ] [REMOTE ] EQR: Full fetch complete (74640 records). [2025-10-27T18:36:46.060747] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-27T18:36:46.451818] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-27T18:36:46.451902] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-27T18:36:46.452752] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-27T18:36:46.452813] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-27T18:36:46.454184] [DEBUG] [LOCAL ] EQR: Trimmed 74640 records to 51787 (keeping 200 days of data) [2025-10-27T18:36:46.763666] [DEBUG] [LOCAL ] EQR: Primary data saved (51787 records). [2025-10-27T18:36:46.763803] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-27T18:36:46.763892] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQR took 34.0s. Estimated remaining: 3h 24m 48s. Rate: 7.8 symbols/min [2025-10-27T18:36:47.639160] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:36:47.650806] [INFO ] [REMOTE ] EQNR: Full fetch complete (77018 records). [2025-10-27T18:36:47.650970] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-27T18:36:48.054928] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-27T18:36:48.055006] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-27T18:36:48.055972] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-27T18:36:48.056037] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-27T18:36:48.057487] [DEBUG] [LOCAL ] EQNR: Trimmed 77018 records to 53043 (keeping 200 days of data) [2025-10-27T18:36:48.376666] [DEBUG] [LOCAL ] EQNR: Primary data saved (53043 records). [2025-10-27T18:36:48.376798] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-27T18:36:48.377230] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQNR took 38.1s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-10-27T18:36:49.056405] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.086295] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.112308] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.092778] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:36:49.119784] [DEBUG] [LOCAL ] EQV: Loaded 2822 existing records from primary storage. [2025-10-27T18:36:49.120105] [INFO ] [MAIN ] EQV: Loaded 2822 existing records. [2025-10-27T18:36:49.353245] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:49.354734] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-27T18:36:49.354836] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-27T18:36:49.355966] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-27T18:36:49.356021] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-27T18:36:49.355530] [DEBUG] [LOCAL ] ERO: Loaded 42780 existing records from primary storage. [2025-10-27T18:36:49.392086] [INFO ] [MAIN ] ERO: Loaded 42780 existing records. [2025-10-27T18:36:49.543884] [DEBUG] [LOCAL ] ERJ: Loaded 51023 existing records from primary storage. [2025-10-27T18:36:49.578311] [DEBUG] [LOCAL ] EQT: Loaded 54464 existing records from primary storage. [2025-10-27T18:36:49.566608] [INFO ] [MAIN ] ERJ: Loaded 51023 existing records. [2025-10-27T18:36:49.704993] [INFO ] [MAIN ] EQT: Loaded 54464 existing records. [2025-10-27T18:36:50.054055] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.107849] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.118333] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-27T18:36:50.164202] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-27T18:36:50.183536] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-27T18:36:50.303372] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.398912] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.406698] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-27T18:36:50.424470] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-27T18:36:50.410606] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:50.440186] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-27T18:36:50.419045] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:36:50.468202] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-27T18:36:50.493115] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-27T18:36:50.498547] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-27T18:36:50.570877] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-27T18:36:50.637666] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-27T18:36:51.217766] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.279260] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-27T18:36:51.462389] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.463781] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-27T18:36:51.491212] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:36:51.494672] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-27T18:36:51.490753] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:36:51.495915] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-27T18:36:52.138825] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:36:52.140503] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-27T18:36:52.483550] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-27T18:36:52.484982] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-27T18:36:52.787175] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T18:36:52.794912] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-27T18:36:53.007706] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:36:53.009044] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-27T18:36:53.197020] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T18:36:53.214892] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-27T18:36:53.311999] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T18:36:53.332132] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T18:36:53.926007] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T18:36:54.014909] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-27T18:36:54.610182] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:36:54.814926] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-27T18:36:55.605842] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:36:55.615112] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-27T18:36:56.414909] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-27T18:36:56.522856] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T18:36:57.191852] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:36:57.214899] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-27T18:36:57.843865] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T18:36:58.014942] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-27T18:36:58.271281] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T18:36:58.814983] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-27T18:36:59.614953] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-27T18:36:59.879482] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:37:00.155734] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T18:37:00.199543] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T18:37:00.414996] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-27T18:37:01.214953] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-27T18:37:02.015007] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-27T18:37:02.634048] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T18:37:02.814931] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-27T18:37:03.297866] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T18:37:03.627258] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-27T18:37:03.636560] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-27T18:37:04.261610] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:37:04.414969] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-27T18:37:04.512186] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T18:37:04.849699] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T18:37:05.214942] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-27T18:37:06.014991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-27T18:37:06.814919] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-27T18:37:06.870912] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T18:37:07.340683] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:37:07.569302] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T18:37:07.614905] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-27T18:37:08.414911] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-27T18:37:09.155499] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:37:09.214915] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-27T18:37:09.570486] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:37:10.014989] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-27T18:37:10.816695] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-27T18:37:10.821590] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T18:37:11.614996] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-27T18:37:11.845068] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T18:37:12.415017] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-27T18:37:12.616561] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T18:37:13.052548] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:37:13.067168] [INFO ] [REMOTE ] ERO: Full fetch complete (60720 records). [2025-10-27T18:37:13.067324] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-27T18:37:13.125971] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T18:37:13.191712] [INFO ] [REMOTE ] EQV: Full fetch complete (4805 records). [2025-10-27T18:37:13.220081] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-27T18:37:13.220324] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-27T18:37:13.934733] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-27T18:37:13.939987] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-27T18:37:13.959186] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-27T18:37:13.980090] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-27T18:37:14.004112] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-27T18:37:14.004196] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-27T18:37:14.004297] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-27T18:37:14.004724] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-27T18:37:14.005762] [DEBUG] [LOCAL ] EQV: Trimmed 4805 records to 2764 (keeping 200 days of data) [2025-10-27T18:37:14.014288] [DEBUG] [LOCAL ] ERO: Trimmed 60720 records to 42023 (keeping 200 days of data) [2025-10-27T18:37:14.016309] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-27T18:37:14.077358] [DEBUG] [LOCAL ] EQV: Primary data saved (2764 records). [2025-10-27T18:37:14.077990] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-27T18:37:14.087089] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. EQV took 25.7s. Estimated remaining: 3h 24m 58s. Rate: 7.8 symbols/min [2025-10-27T18:37:14.428093] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:14.474486] [DEBUG] [LOCAL ] ERO: Primary data saved (42023 records). [2025-10-27T18:37:14.474781] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-27T18:37:14.474884] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 26.1s. Estimated remaining: 3h 24m 35s. Rate: 7.8 symbols/min [2025-10-27T18:37:14.673133] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:14.675441] [DEBUG] [LOCAL ] ES: Loaded 53468 existing records from primary storage. [2025-10-27T18:37:14.675906] [INFO ] [MAIN ] ES: Loaded 53468 existing records. [2025-10-27T18:37:14.878828] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:14.879281] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-27T18:37:14.879434] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-27T18:37:14.879769] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-27T18:37:14.879830] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-27T18:37:14.982526] [DEBUG] [LOCAL ] ESAB: Loaded 26338 existing records from primary storage. [2025-10-27T18:37:14.993389] [INFO ] [MAIN ] ESAB: Loaded 26338 existing records. [2025-10-27T18:37:15.361805] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:15.372794] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-27T18:37:15.372891] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-27T18:37:15.411300] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-27T18:37:15.414185] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-27T18:37:15.481164] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:15.528034] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-27T18:37:15.579965] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-27T18:37:15.644432] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-27T18:37:15.889851] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:15.920594] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T18:37:16.414953] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-27T18:37:17.044803] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:37:17.138083] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T18:37:17.214944] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-27T18:37:17.312338] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T18:37:18.014977] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-27T18:37:18.814955] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-27T18:37:19.096975] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:37:19.120978] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:37:19.615003] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-27T18:37:20.414958] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-27T18:37:20.443334] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T18:37:20.456279] [INFO ] [REMOTE ] ERJ: Full fetch complete (73121 records). [2025-10-27T18:37:20.456427] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-27T18:37:20.826107] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T18:37:20.929916] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-27T18:37:20.929992] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-27T18:37:20.930887] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-27T18:37:20.930952] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-27T18:37:20.932255] [DEBUG] [LOCAL ] ERJ: Trimmed 73121 records to 50207 (keeping 200 days of data) [2025-10-27T18:37:21.215725] [DEBUG] [LOCAL ] ERJ: Primary data saved (50207 records). [2025-10-27T18:37:21.215958] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-27T18:37:21.215800] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-27T18:37:21.216093] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ERJ took 32.8s. Estimated remaining: 3h 24m 26s. Rate: 7.8 symbols/min [2025-10-27T18:37:21.400276] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:21.417586] [DEBUG] [LOCAL ] ESE: Loaded 16609 existing records from primary storage. [2025-10-27T18:37:21.417857] [INFO ] [MAIN ] ESE: Loaded 16609 existing records. [2025-10-27T18:37:21.613841] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:21.614050] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-27T18:37:21.614118] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-27T18:37:21.614274] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-27T18:37:21.614310] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-27T18:37:21.972087] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:22.014932] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-27T18:37:22.479142] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T18:37:22.594285] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-27T18:37:22.604853] [INFO ] [REMOTE ] EQT: Full fetch complete (77859 records). [2025-10-27T18:37:22.604978] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-27T18:37:22.825531] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-27T18:37:22.990995] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-27T18:37:22.991082] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-27T18:37:22.991968] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-27T18:37:22.992031] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-27T18:37:22.993455] [DEBUG] [LOCAL ] EQT: Trimmed 77859 records to 53684 (keeping 200 days of data) [2025-10-27T18:37:23.307584] [DEBUG] [LOCAL ] EQT: Primary data saved (53684 records). [2025-10-27T18:37:23.307751] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-27T18:37:23.307837] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. EQT took 34.9s. Estimated remaining: 3h 24m 6s. Rate: 7.8 symbols/min [2025-10-27T18:37:23.425008] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T18:37:23.494237] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:23.541852] [DEBUG] [LOCAL ] ESI: Loaded 51368 existing records from primary storage. [2025-10-27T18:37:23.542171] [INFO ] [MAIN ] ESI: Loaded 51368 existing records. [2025-10-27T18:37:23.620162] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-27T18:37:23.735438] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:23.735682] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-27T18:37:23.735741] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-27T18:37:23.735925] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-27T18:37:23.735966] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-27T18:37:24.141563] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:24.174087] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:37:24.414922] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-27T18:37:24.825216] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:37:25.215002] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-27T18:37:25.805493] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:37:26.014967] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-27T18:37:26.789299] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:37:26.814931] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-27T18:37:27.251630] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:37:27.615015] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-27T18:37:28.035369] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:37:28.414937] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-27T18:37:28.736337] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:37:29.214939] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-27T18:37:30.014906] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-27T18:37:30.122157] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:37:30.353887] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:37:30.814955] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-27T18:37:31.618145] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-27T18:37:31.624237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T18:37:31.812217] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:37:32.292078] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:37:32.414938] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-27T18:37:33.161306] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:37:33.214911] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-27T18:37:34.014948] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-27T18:37:34.799965] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:37:34.814909] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-27T18:37:34.851315] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:37:35.614911] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-27T18:37:35.844839] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:37:36.414937] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-27T18:37:37.061428] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:37:37.214980] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-27T18:37:37.501983] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:37:38.014971] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-27T18:37:38.567150] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T18:37:38.814928] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-27T18:37:39.301889] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:37:39.614975] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-27T18:37:40.414924] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-27T18:37:40.603597] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T18:37:40.668233] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:37:41.214964] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-27T18:37:41.231791] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:37:42.015014] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-27T18:37:42.696139] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:37:42.814905] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-27T18:37:42.837747] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:37:43.615023] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-27T18:37:44.082730] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:37:44.088006] [INFO ] [REMOTE ] ESAB: Full fetch complete (36496 records). [2025-10-27T18:37:44.088103] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-27T18:37:44.419284] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-27T18:37:44.469742] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-27T18:37:44.469987] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-27T18:37:44.470736] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-27T18:37:44.470821] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-27T18:37:44.480522] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T18:37:44.483833] [DEBUG] [LOCAL ] ESAB: Trimmed 36496 records to 25775 (keeping 200 days of data) [2025-10-27T18:37:44.484331] [INFO ] [REMOTE ] ESE: Full fetch complete (22980 records). [2025-10-27T18:37:44.484847] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-27T18:37:44.833220] [DEBUG] [LOCAL ] ESAB: Primary data saved (25775 records). [2025-10-27T18:37:44.851184] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-27T18:37:44.851305] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ESAB took 30.4s. Estimated remaining: 3h 24m 28s. Rate: 7.8 symbols/min [2025-10-27T18:37:45.195557] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:45.238872] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-27T18:37:45.240982] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-27T18:37:45.241953] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-27T18:37:45.242537] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-27T18:37:45.242755] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-27T18:37:45.243514] [DEBUG] [LOCAL ] ESE: Trimmed 22980 records to 16199 (keeping 200 days of data) [2025-10-27T18:37:45.363283] [DEBUG] [LOCAL ] ESE: Primary data saved (16199 records). [2025-10-27T18:37:45.373785] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-27T18:37:45.373941] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESE took 24.2s. Estimated remaining: 3h 24m 5s. Rate: 7.8 symbols/min [2025-10-27T18:37:45.409707] [DEBUG] [LOCAL ] ESNT: Loaded 38439 existing records from primary storage. [2025-10-27T18:37:45.448622] [INFO ] [MAIN ] ESNT: Loaded 38439 existing records. [2025-10-27T18:37:45.740888] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:45.763758] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:45.764159] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-27T18:37:45.764215] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-27T18:37:45.764436] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-27T18:37:45.764475] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-27T18:37:46.073876] [DEBUG] [LOCAL ] ESRT: Loaded 47236 existing records from primary storage. [2025-10-27T18:37:46.074912] [INFO ] [MAIN ] ESRT: Loaded 47236 existing records. [2025-10-27T18:37:46.242805] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:46.253577] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-27T18:37:46.337238] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:46.337720] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-27T18:37:46.337778] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-27T18:37:46.354691] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-27T18:37:46.368147] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-27T18:37:46.439066] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T18:37:46.732212] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:46.814911] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-27T18:37:46.906628] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T18:37:47.512911] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:37:47.614933] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-27T18:37:48.415002] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-27T18:37:48.467477] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:37:48.730791] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T18:37:49.214956] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-27T18:37:50.012096] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T18:37:50.022417] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-27T18:37:50.814917] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-27T18:37:51.130373] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:37:51.166447] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T18:37:51.614941] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-27T18:37:52.415005] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-27T18:37:52.736289] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T18:37:52.872564] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T18:37:52.882859] [INFO ] [REMOTE ] ES: Full fetch complete (76476 records). [2025-10-27T18:37:52.883006] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-27T18:37:53.220185] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-27T18:37:53.328360] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-27T18:37:53.328477] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-27T18:37:53.329940] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-27T18:37:53.330019] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-27T18:37:53.332116] [DEBUG] [LOCAL ] ES: Trimmed 76476 records to 52682 (keeping 200 days of data) [2025-10-27T18:37:53.677305] [DEBUG] [LOCAL ] ES: Primary data saved (52682 records). [2025-10-27T18:37:53.677515] [INFO ] [MAIN ] ES: Full history saved. [2025-10-27T18:37:53.678257] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ES took 39.6s. Estimated remaining: 3h 23m 59s. Rate: 7.8 symbols/min [2025-10-27T18:37:53.897339] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:53.923007] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:37:53.959048] [DEBUG] [LOCAL ] ESS: Loaded 30589 existing records from primary storage. [2025-10-27T18:37:53.959362] [INFO ] [MAIN ] ESS: Loaded 30589 existing records. [2025-10-27T18:37:54.023857] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-27T18:37:54.146541] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:54.146950] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-27T18:37:54.147021] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-27T18:37:54.147364] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-27T18:37:54.147454] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-27T18:37:54.497764] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:54.525137] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T18:37:54.814929] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-27T18:37:55.444553] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T18:37:55.454327] [INFO ] [REMOTE ] ESI: Full fetch complete (73268 records). [2025-10-27T18:37:55.454476] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-27T18:37:55.615810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-27T18:37:55.853326] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-27T18:37:55.853401] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-27T18:37:55.854246] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-27T18:37:55.854307] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-27T18:37:55.855701] [DEBUG] [LOCAL ] ESI: Trimmed 73268 records to 50575 (keeping 200 days of data) [2025-10-27T18:37:56.151246] [DEBUG] [LOCAL ] ESI: Primary data saved (50575 records). [2025-10-27T18:37:56.151370] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-27T18:37:56.151444] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESI took 32.8s. Estimated remaining: 3h 23m 41s. Rate: 7.8 symbols/min [2025-10-27T18:37:56.318962] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:37:56.363039] [DEBUG] [LOCAL ] ESTC: Loaded 50954 existing records from primary storage. [2025-10-27T18:37:56.363353] [INFO ] [MAIN ] ESTC: Loaded 50954 existing records. [2025-10-27T18:37:56.425134] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-27T18:37:56.559552] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:37:56.577368] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-27T18:37:56.577746] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-27T18:37:56.579585] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:37:56.579638] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-27T18:37:56.589337] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-27T18:37:56.966235] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:37:57.014721] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:37:57.214957] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-27T18:37:58.014928] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-27T18:37:58.120960] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:37:58.560135] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:37:58.814977] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-27T18:37:59.603150] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T18:37:59.614908] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-27T18:37:59.721750] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:38:00.414966] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-27T18:38:01.037121] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:38:01.214985] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-27T18:38:02.015001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-27T18:38:02.045609] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:38:02.432907] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:38:02.814944] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-27T18:38:03.615000] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-27T18:38:03.667894] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:38:04.035777] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T18:38:04.414954] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-27T18:38:05.199706] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T18:38:05.214896] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-27T18:38:05.409035] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T18:38:06.014990] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-27T18:38:06.409040] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:38:06.814936] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-27T18:38:07.500446] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T18:38:07.614904] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-27T18:38:08.414950] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-27T18:38:08.720445] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T18:38:09.214987] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-27T18:38:09.378344] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T18:38:09.702259] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:38:10.014961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-27T18:38:10.814982] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-27T18:38:11.194623] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T18:38:11.614975] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-27T18:38:11.942704] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:38:11.951853] [INFO ] [REMOTE ] ESRT: Full fetch complete (66817 records). [2025-10-27T18:38:11.951968] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-27T18:38:12.287692] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T18:38:12.368175] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-27T18:38:12.368253] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-27T18:38:12.369161] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-27T18:38:12.369243] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-27T18:38:12.370705] [DEBUG] [LOCAL ] ESRT: Trimmed 66817 records to 46460 (keeping 200 days of data) [2025-10-27T18:38:12.418944] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-27T18:38:12.668521] [DEBUG] [LOCAL ] ESRT: Primary data saved (46460 records). [2025-10-27T18:38:12.668684] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-27T18:38:12.668792] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESRT took 27.3s. Estimated remaining: 3h 23m 51s. Rate: 7.8 symbols/min [2025-10-27T18:38:12.832119] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:12.890864] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-27T18:38:12.892021] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-10-27T18:38:13.063484] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:13.063808] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-27T18:38:13.063868] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-27T18:38:13.064489] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-27T18:38:13.064547] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-27T18:38:13.216559] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-27T18:38:13.415408] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:13.447479] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T18:38:14.014936] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-27T18:38:14.310301] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T18:38:14.379528] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T18:38:14.814936] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-27T18:38:15.550158] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:38:15.614906] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-27T18:38:16.011578] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:38:16.414976] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-27T18:38:17.042497] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:38:17.214956] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-27T18:38:17.400116] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T18:38:18.014941] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-27T18:38:18.306122] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:38:18.814964] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-27T18:38:19.615028] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-27T18:38:19.849710] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T18:38:19.860291] [INFO ] [REMOTE ] ESTC: Full fetch complete (72494 records). [2025-10-27T18:38:19.860506] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-27T18:38:20.264497] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-27T18:38:20.264583] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-27T18:38:20.265606] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-27T18:38:20.265694] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-27T18:38:20.267242] [DEBUG] [LOCAL ] ESTC: Trimmed 72494 records to 50185 (keeping 200 days of data) [2025-10-27T18:38:20.432218] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-27T18:38:20.558484] [DEBUG] [LOCAL ] ESTC: Primary data saved (50185 records). [2025-10-27T18:38:20.558623] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-27T18:38:20.558738] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESTC took 24.4s. Estimated remaining: 3h 23m 44s. Rate: 7.8 symbols/min [2025-10-27T18:38:20.726692] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:20.740420] [DEBUG] [LOCAL ] ETB: Loaded 11883 existing records from primary storage. [2025-10-27T18:38:20.740755] [INFO ] [MAIN ] ETB: Loaded 11883 existing records. [2025-10-27T18:38:20.929028] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:20.929307] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-27T18:38:20.929447] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-27T18:38:20.929694] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-27T18:38:20.929761] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-27T18:38:21.194512] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T18:38:21.250516] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-27T18:38:21.320203] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:21.352825] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-27T18:38:21.699127] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T18:38:21.706568] [INFO ] [REMOTE ] ESNT: Full fetch complete (57002 records). [2025-10-27T18:38:21.706707] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-27T18:38:22.020009] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-27T18:38:22.097694] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-27T18:38:22.097780] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-27T18:38:22.098497] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-27T18:38:22.098741] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-27T18:38:22.099906] [DEBUG] [LOCAL ] ESNT: Trimmed 57002 records to 37618 (keeping 200 days of data) [2025-10-27T18:38:22.318127] [DEBUG] [LOCAL ] ESNT: Primary data saved (37618 records). [2025-10-27T18:38:22.318350] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-27T18:38:22.318466] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESNT took 37.5s. Estimated remaining: 3h 23m 24s. Rate: 7.8 symbols/min [2025-10-27T18:38:22.486773] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:22.503629] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:38:22.530696] [DEBUG] [LOCAL ] ETD: Loaded 27368 existing records from primary storage. [2025-10-27T18:38:22.530938] [INFO ] [MAIN ] ETD: Loaded 27368 existing records. [2025-10-27T18:38:22.706250] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:22.706440] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-27T18:38:22.706484] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-27T18:38:22.706957] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-27T18:38:22.707012] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-27T18:38:22.819998] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-27T18:38:23.055956] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:23.615004] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-27T18:38:23.629772] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:38:24.257603] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-27T18:38:24.414945] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-27T18:38:25.140438] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:38:25.214920] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-27T18:38:25.360836] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:38:26.014924] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-27T18:38:26.313676] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:38:26.814931] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-27T18:38:27.523306] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T18:38:27.614921] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-27T18:38:28.396050] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T18:38:28.414889] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-27T18:38:28.686338] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T18:38:29.214941] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-27T18:38:29.754788] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T18:38:30.014933] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-27T18:38:30.806952] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:38:30.814887] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-27T18:38:30.871103] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-27T18:38:31.537485] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:38:31.614916] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-27T18:38:32.415005] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-27T18:38:32.917111] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T18:38:33.214982] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-27T18:38:33.441780] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:38:34.014943] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-27T18:38:34.057784] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:38:34.815003] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-27T18:38:35.262118] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T18:38:35.268987] [INFO ] [REMOTE ] ESS: Full fetch complete (43888 records). [2025-10-27T18:38:35.269138] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-27T18:38:35.619391] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-27T18:38:35.652168] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-27T18:38:35.652245] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-27T18:38:35.652922] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-27T18:38:35.652984] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-27T18:38:35.653924] [DEBUG] [LOCAL ] ESS: Trimmed 43888 records to 29996 (keeping 200 days of data) [2025-10-27T18:38:35.842157] [DEBUG] [LOCAL ] ESS: Primary data saved (29996 records). [2025-10-27T18:38:35.842307] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-27T18:38:35.843040] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ESS took 42.2s. Estimated remaining: 3h 23m 29s. Rate: 7.8 symbols/min [2025-10-27T18:38:36.015369] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:36.032821] [DEBUG] [LOCAL ] ETG: Loaded 16714 existing records from primary storage. [2025-10-27T18:38:36.033061] [INFO ] [MAIN ] ETG: Loaded 16714 existing records. [2025-10-27T18:38:36.232112] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:36.233612] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T18:38:36.239448] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-27T18:38:36.239546] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-27T18:38:36.240311] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-27T18:38:36.240384] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-27T18:38:36.425019] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-27T18:38:36.596730] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:37.214928] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-27T18:38:37.311449] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:38:37.314363] [INFO ] [REMOTE ] ETB: Full fetch complete (18492 records). [2025-10-27T18:38:37.314447] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-27T18:38:37.674329] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-27T18:38:37.674404] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-27T18:38:37.674847] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-27T18:38:37.674915] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-27T18:38:37.675458] [DEBUG] [LOCAL ] ETB: Trimmed 18492 records to 11479 (keeping 200 days of data) [2025-10-27T18:38:37.745438] [DEBUG] [LOCAL ] ETB: Primary data saved (11479 records). [2025-10-27T18:38:37.745566] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-27T18:38:37.745697] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETB took 17.2s. Estimated remaining: 3h 23m 9s. Rate: 7.8 symbols/min [2025-10-27T18:38:37.923961] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:37.967519] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-27T18:38:37.983658] [DEBUG] [LOCAL ] ETJ: Loaded 16575 existing records from primary storage. [2025-10-27T18:38:37.984109] [INFO ] [MAIN ] ETJ: Loaded 16575 existing records. [2025-10-27T18:38:38.020055] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-27T18:38:38.166166] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:38:38.166820] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-27T18:38:38.166956] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-27T18:38:38.167311] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-27T18:38:38.167400] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-27T18:38:38.278297] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T18:38:38.553307] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:38:38.814922] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-27T18:38:39.165834] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T18:38:39.615014] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-27T18:38:40.088412] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:38:40.414914] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-27T18:38:40.561919] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:38:41.214951] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-27T18:38:42.014947] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-27T18:38:42.192464] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T18:38:42.814937] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-27T18:38:42.917545] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:38:43.081120] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-27T18:38:43.614942] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-27T18:38:44.111158] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:38:44.370836] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:38:44.414907] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-27T18:38:45.175022] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T18:38:45.214936] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-27T18:38:46.014943] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-27T18:38:46.534151] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T18:38:46.651097] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:38:46.814933] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-27T18:38:47.614945] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-27T18:38:47.748503] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T18:38:48.414918] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-27T18:38:48.466578] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:38:49.214938] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-27T18:38:50.014949] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-27T18:38:50.225879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:38:50.527052] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T18:38:50.648855] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T18:38:50.814931] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-27T18:38:51.614952] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-27T18:38:51.724840] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:38:52.414950] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-27T18:38:52.465056] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:38:53.045926] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:38:53.214973] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-27T18:38:53.847865] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:38:54.014999] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-27T18:38:54.814929] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-27T18:38:55.614954] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-27T18:38:56.016475] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:38:56.391983] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T18:38:56.414898] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-27T18:38:56.511596] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T18:38:57.214966] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-27T18:38:58.014990] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-27T18:38:58.500558] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:38:58.774406] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T18:38:58.814927] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-27T18:38:58.853167] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T18:38:58.863332] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-27T18:38:58.863471] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-27T18:38:59.280336] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-27T18:38:59.280425] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-27T18:38:59.281350] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-27T18:38:59.281413] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-27T18:38:59.282818] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-27T18:38:59.602576] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-27T18:38:59.602736] [INFO ] [MAIN ] ET: Full history saved. [2025-10-27T18:38:59.602825] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ET took 46.9s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-27T18:38:59.624789] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-27T18:38:59.780590] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:38:59.831304] [DEBUG] [LOCAL ] ETN: Loaded 53313 existing records from primary storage. [2025-10-27T18:38:59.831730] [INFO ] [MAIN ] ETN: Loaded 53313 existing records. [2025-10-27T18:39:00.010623] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:00.010899] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-27T18:39:00.010948] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-27T18:39:00.011822] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-27T18:39:00.011880] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-27T18:39:00.147705] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:39:00.385098] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:00.414912] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-27T18:39:01.163033] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T18:39:01.167878] [INFO ] [REMOTE ] ETD: Full fetch complete (38415 records). [2025-10-27T18:39:01.167974] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-27T18:39:01.216676] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-27T18:39:01.533517] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-27T18:39:01.533589] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-27T18:39:01.534175] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-27T18:39:01.534235] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-27T18:39:01.535032] [DEBUG] [LOCAL ] ETD: Trimmed 38415 records to 26664 (keeping 200 days of data) [2025-10-27T18:39:01.703916] [DEBUG] [LOCAL ] ETD: Primary data saved (26664 records). [2025-10-27T18:39:01.704064] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-27T18:39:01.704153] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETD took 39.4s. Estimated remaining: 3h 23m 12s. Rate: 7.8 symbols/min [2025-10-27T18:39:01.899153] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:01.907308] [DEBUG] [LOCAL ] ETO: Loaded 6954 existing records from primary storage. [2025-10-27T18:39:01.907522] [INFO ] [MAIN ] ETO: Loaded 6954 existing records. [2025-10-27T18:39:02.020018] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-27T18:39:02.093064] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:02.093312] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-27T18:39:02.093369] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-27T18:39:02.093699] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-27T18:39:02.093765] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-27T18:39:02.450944] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:02.460853] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:39:02.464254] [INFO ] [REMOTE ] ETJ: Full fetch complete (25230 records). [2025-10-27T18:39:02.464353] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-27T18:39:02.815529] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-27T18:39:02.825752] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-27T18:39:02.826514] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-27T18:39:02.827089] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-27T18:39:02.827150] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-27T18:39:02.827898] [DEBUG] [LOCAL ] ETJ: Trimmed 25230 records to 15848 (keeping 200 days of data) [2025-10-27T18:39:02.921473] [DEBUG] [LOCAL ] ETJ: Primary data saved (15848 records). [2025-10-27T18:39:02.921736] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-27T18:39:02.921912] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETJ took 25.2s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-27T18:39:03.096568] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:03.129204] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-27T18:39:03.182115] [DEBUG] [LOCAL ] ETR: Loaded 53955 existing records from primary storage. [2025-10-27T18:39:03.182405] [INFO ] [MAIN ] ETR: Loaded 53955 existing records. [2025-10-27T18:39:03.371808] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:39:03.375495] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:03.376821] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-27T18:39:03.376931] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-27T18:39:03.379405] [INFO ] [REMOTE ] ETG: Full fetch complete (24407 records). [2025-10-27T18:39:03.379475] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-27T18:39:03.410277] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-27T18:39:03.448020] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-27T18:39:03.622545] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-27T18:39:03.998390] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:39:04.120341] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-27T18:39:04.142965] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-27T18:39:04.148490] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:04.145269] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-27T18:39:04.148606] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-27T18:39:04.149485] [DEBUG] [LOCAL ] ETG: Trimmed 24407 records to 16250 (keeping 200 days of data) [2025-10-27T18:39:04.246133] [DEBUG] [LOCAL ] ETG: Primary data saved (16250 records). [2025-10-27T18:39:04.246265] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-27T18:39:04.246340] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETG took 28.4s. Estimated remaining: 3h 22m 30s. Rate: 7.8 symbols/min [2025-10-27T18:39:04.414734] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:04.415220] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-27T18:39:04.464117] [DEBUG] [LOCAL ] ETSY: Loaded 54338 existing records from primary storage. [2025-10-27T18:39:04.464484] [INFO ] [MAIN ] ETSY: Loaded 54338 existing records. [2025-10-27T18:39:04.646271] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:04.646478] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-27T18:39:04.646523] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-27T18:39:04.647438] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-27T18:39:04.647495] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-27T18:39:05.016918] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:05.125961] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T18:39:05.215005] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-27T18:39:05.846212] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-27T18:39:06.014971] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-27T18:39:06.637947] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:39:06.814956] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-27T18:39:06.964230] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T18:39:07.614950] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-27T18:39:08.414922] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-27T18:39:08.533828] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T18:39:09.214915] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-27T18:39:09.340910] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T18:39:09.500282] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T18:39:10.014992] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-27T18:39:10.814924] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-27T18:39:10.948721] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T18:39:10.964228] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:39:11.614966] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-27T18:39:12.414979] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-27T18:39:12.521734] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T18:39:13.117616] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:39:13.148412] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:39:13.214900] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-27T18:39:14.015000] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-27T18:39:14.713080] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:39:14.814999] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-27T18:39:15.614984] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-27T18:39:15.838441] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T18:39:15.871406] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:39:16.414996] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-27T18:39:17.029948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T18:39:17.214937] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-27T18:39:17.308362] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:39:18.014982] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-27T18:39:18.710065] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T18:39:18.814931] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-27T18:39:18.893818] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T18:39:19.614981] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-27T18:39:20.408318] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T18:39:20.418469] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-27T18:39:21.214993] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-27T18:39:21.390383] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T18:39:21.738467] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:39:21.740541] [INFO ] [REMOTE ] ETO: Full fetch complete (9677 records). [2025-10-27T18:39:21.740608] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-27T18:39:22.020943] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-27T18:39:22.105912] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-27T18:39:22.105991] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-27T18:39:22.106217] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-27T18:39:22.106255] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-27T18:39:22.106686] [DEBUG] [LOCAL ] ETO: Trimmed 9677 records to 6726 (keeping 200 days of data) [2025-10-27T18:39:22.147805] [DEBUG] [LOCAL ] ETO: Primary data saved (6726 records). [2025-10-27T18:39:22.147924] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-27T18:39:22.148070] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETO took 20.4s. Estimated remaining: 3h 22m 43s. Rate: 7.8 symbols/min [2025-10-27T18:39:22.329132] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T18:39:22.358473] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:22.378786] [DEBUG] [LOCAL ] ETV: Loaded 22125 existing records from primary storage. [2025-10-27T18:39:22.379026] [INFO ] [MAIN ] ETV: Loaded 22125 existing records. [2025-10-27T18:39:22.550871] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:22.551050] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-27T18:39:22.551095] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-27T18:39:22.551541] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-27T18:39:22.551599] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-27T18:39:22.820365] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-27T18:39:22.897312] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:23.614964] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-27T18:39:23.658347] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:39:24.114923] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:39:24.414931] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-27T18:39:25.214912] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-27T18:39:25.292493] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:39:25.963516] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T18:39:26.014898] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-27T18:39:26.342393] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T18:39:26.814987] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-27T18:39:27.614998] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-27T18:39:27.749167] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:39:28.423145] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-27T18:39:28.442164] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:39:29.049034] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T18:39:29.214975] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-27T18:39:29.356412] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T18:39:30.014944] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-27T18:39:30.814930] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-27T18:39:31.118458] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:39:31.128782] [INFO ] [REMOTE ] ETSY: Full fetch complete (77655 records). [2025-10-27T18:39:31.128909] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-27T18:39:31.536284] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-27T18:39:31.536545] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-27T18:39:31.537571] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-27T18:39:31.537699] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-27T18:39:31.539251] [DEBUG] [LOCAL ] ETSY: Trimmed 77655 records to 53555 (keeping 200 days of data) [2025-10-27T18:39:31.621978] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-27T18:39:31.879626] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:39:31.909394] [DEBUG] [LOCAL ] ETSY: Primary data saved (53555 records). [2025-10-27T18:39:31.909686] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-27T18:39:31.910529] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETSY took 27.7s. Estimated remaining: 3h 22m 40s. Rate: 7.8 symbols/min [2025-10-27T18:39:32.090740] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:32.116111] [DEBUG] [LOCAL ] ETW: Loaded 25508 existing records from primary storage. [2025-10-27T18:39:32.116353] [INFO ] [MAIN ] ETW: Loaded 25508 existing records. [2025-10-27T18:39:32.318372] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:32.331609] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-27T18:39:32.331838] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-27T18:39:32.333305] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:39:32.333349] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-27T18:39:32.343549] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-27T18:39:32.422753] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-27T18:39:32.722342] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:32.735955] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T18:39:33.215004] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-27T18:39:34.014953] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-27T18:39:34.460583] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T18:39:34.752151] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T18:39:34.814910] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-27T18:39:34.909049] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T18:39:35.614977] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-27T18:39:35.726766] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T18:39:36.414924] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-27T18:39:37.214922] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-27T18:39:37.439804] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T18:39:37.953903] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T18:39:38.014915] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-27T18:39:38.193485] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T18:39:38.814943] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-27T18:39:39.614919] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-27T18:39:40.030145] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T18:39:40.058735] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:39:40.057878] [INFO ] [REMOTE ] ETN: Full fetch complete (76606 records). [2025-10-27T18:39:40.065394] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-27T18:39:40.418797] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-27T18:39:40.461240] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-27T18:39:40.461319] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-27T18:39:40.462207] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-27T18:39:40.462270] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-27T18:39:40.463917] [DEBUG] [LOCAL ] ETN: Trimmed 76606 records to 52514 (keeping 200 days of data) [2025-10-27T18:39:40.567334] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:39:40.794888] [DEBUG] [LOCAL ] ETN: Primary data saved (52514 records). [2025-10-27T18:39:40.795014] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-27T18:39:40.795090] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETN took 41.2s. Estimated remaining: 3h 22m 35s. Rate: 7.8 symbols/min [2025-10-27T18:39:40.960305] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:40.966372] [DEBUG] [LOCAL ] ETX: Loaded 5378 existing records from primary storage. [2025-10-27T18:39:40.966548] [INFO ] [MAIN ] ETX: Loaded 5378 existing records. [2025-10-27T18:39:41.143371] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:41.143564] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-27T18:39:41.143609] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-27T18:39:41.143842] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-27T18:39:41.143899] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-27T18:39:41.220019] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-27T18:39:41.491515] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:41.676347] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:39:42.014950] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-27T18:39:42.814906] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-27T18:39:42.975254] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T18:39:43.060900] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:39:43.455553] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:39:43.614996] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-27T18:39:44.414998] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-27T18:39:45.214947] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-27T18:39:45.696288] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T18:39:45.706410] [INFO ] [REMOTE ] ETR: Full fetch complete (77265 records). [2025-10-27T18:39:45.706533] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-27T18:39:45.958445] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T18:39:46.024430] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-27T18:39:46.134542] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-27T18:39:46.134752] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-27T18:39:46.135854] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-27T18:39:46.135921] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-27T18:39:46.137507] [DEBUG] [LOCAL ] ETR: Trimmed 77265 records to 53171 (keeping 200 days of data) [2025-10-27T18:39:46.454819] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:39:46.480863] [DEBUG] [LOCAL ] ETR: Primary data saved (53171 records). [2025-10-27T18:39:46.480948] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-27T18:39:46.481017] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETR took 43.6s. Estimated remaining: 3h 22m 23s. Rate: 7.8 symbols/min [2025-10-27T18:39:46.645177] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:46.665488] [DEBUG] [LOCAL ] ETY: Loaded 22603 existing records from primary storage. [2025-10-27T18:39:46.665755] [INFO ] [MAIN ] ETY: Loaded 22603 existing records. [2025-10-27T18:39:46.771125] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T18:39:46.821607] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-27T18:39:46.852325] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:46.852550] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-27T18:39:46.852603] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-27T18:39:46.853024] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-27T18:39:46.853079] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-27T18:39:47.205080] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:47.614951] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-27T18:39:47.737549] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T18:39:48.414969] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-27T18:39:48.737435] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T18:39:49.106903] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:39:49.214941] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-27T18:39:50.014926] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-27T18:39:50.265133] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T18:39:50.814928] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-27T18:39:51.411897] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:39:51.422628] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T18:39:51.614941] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-27T18:39:52.414927] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-27T18:39:52.598751] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:39:53.214922] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-27T18:39:53.590638] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:39:54.014936] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-27T18:39:54.149038] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T18:39:54.534050] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T18:39:54.814931] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-27T18:39:55.614953] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-27T18:39:55.901378] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T18:39:56.012028] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T18:39:56.414981] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-27T18:39:56.743466] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T18:39:57.215004] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-27T18:39:58.014915] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-27T18:39:58.032302] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T18:39:58.037272] [INFO ] [REMOTE ] ETV: Full fetch complete (32099 records). [2025-10-27T18:39:58.037347] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-27T18:39:58.406797] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-27T18:39:58.406905] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-27T18:39:58.407494] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-27T18:39:58.407536] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-27T18:39:58.408302] [DEBUG] [LOCAL ] ETV: Trimmed 32099 records to 21341 (keeping 200 days of data) [2025-10-27T18:39:58.533033] [DEBUG] [LOCAL ] ETV: Primary data saved (21341 records). [2025-10-27T18:39:58.533235] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-27T18:39:58.533322] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETV took 36.4s. Estimated remaining: 3h 22m 24s. Rate: 7.8 symbols/min [2025-10-27T18:39:58.642402] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:39:58.714086] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:39:58.734213] [DEBUG] [LOCAL ] EVC: Loaded 18007 existing records from primary storage. [2025-10-27T18:39:58.734456] [INFO ] [MAIN ] EVC: Loaded 18007 existing records. [2025-10-27T18:39:58.820192] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-27T18:39:58.919907] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:39:58.920129] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-27T18:39:58.920185] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-27T18:39:58.920606] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-27T18:39:58.920711] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-27T18:39:59.291563] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:39:59.614987] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-27T18:40:00.118434] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:40:00.414972] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-27T18:40:01.142158] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T18:40:01.147226] [INFO ] [REMOTE ] ETW: Full fetch complete (36252 records). [2025-10-27T18:40:01.147307] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-27T18:40:01.147796] [FATAL] [VALIDATOR ] ETW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:01.147877] [FATAL] [MAIN ] ETW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:01.147919] [WARN ] [MAIN ] ETW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:01.147983] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-27T18:40:01.148045] [DEBUG] [LOCAL ] ETW: No primary data file found to delete. [2025-10-27T18:40:01.148077] [INFO ] [LOCAL ] ETW: Starting deletion of derivative data. [2025-10-27T18:40:01.148190] [DEBUG] [LOCAL ] ETW: Deleted derivative data file. [2025-10-27T18:40:01.148253] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETW took 29.2s. Estimated remaining: 3h 22m 7s. Rate: 7.8 symbols/min [2025-10-27T18:40:01.220955] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-27T18:40:01.315070] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:01.345677] [DEBUG] [LOCAL ] EVEX: Loaded 33639 existing records from primary storage. [2025-10-27T18:40:01.345985] [INFO ] [MAIN ] EVEX: Loaded 33639 existing records. [2025-10-27T18:40:01.522603] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:01.522841] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-27T18:40:01.522905] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-27T18:40:01.523460] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-27T18:40:01.523523] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-27T18:40:01.891048] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T18:40:01.913896] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:02.010818] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T18:40:02.014897] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-27T18:40:02.815471] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-27T18:40:03.048044] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:40:03.050023] [INFO ] [REMOTE ] ETX: Full fetch complete (6747 records). [2025-10-27T18:40:03.050155] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-27T18:40:03.050702] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:03.051623] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:03.051810] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:03.051900] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-27T18:40:03.051993] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-27T18:40:03.052044] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-10-27T18:40:03.052294] [DEBUG] [LOCAL ] ETX: Deleted derivative data file. [2025-10-27T18:40:03.052434] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. ETX took 22.3s. Estimated remaining: 3h 21m 47s. Rate: 7.8 symbols/min [2025-10-27T18:40:03.328284] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:03.338805] [DEBUG] [LOCAL ] EVF: Loaded 9816 existing records from primary storage. [2025-10-27T18:40:03.339046] [INFO ] [MAIN ] EVF: Loaded 9816 existing records. [2025-10-27T18:40:03.546252] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:03.546524] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-27T18:40:03.546579] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-27T18:40:03.546898] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-27T18:40:03.546956] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-27T18:40:03.620686] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-27T18:40:03.965911] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:04.414922] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-27T18:40:04.684037] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:40:04.725860] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T18:40:05.214910] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-27T18:40:05.221745] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:40:06.014964] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-27T18:40:06.072912] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T18:40:06.814943] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-27T18:40:07.034399] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:40:07.614964] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-27T18:40:07.883803] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:40:08.225485] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:40:08.414981] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-27T18:40:09.214942] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-27T18:40:09.546097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T18:40:09.885111] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:40:10.014950] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-27T18:40:10.814952] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-27T18:40:11.227026] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T18:40:11.614998] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-27T18:40:12.142443] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T18:40:12.399359] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:40:12.414906] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-27T18:40:13.214967] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-27T18:40:13.488373] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:40:14.014912] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-27T18:40:14.069674] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:40:14.814961] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-27T18:40:14.935199] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T18:40:15.614920] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-27T18:40:15.722076] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T18:40:16.414963] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-27T18:40:16.867900] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:40:17.214940] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-27T18:40:17.303027] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T18:40:18.014973] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-27T18:40:18.313792] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:40:18.815000] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-27T18:40:18.999192] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:40:19.614964] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-27T18:40:19.634379] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:40:20.414999] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-27T18:40:20.723379] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T18:40:21.038370] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:40:21.215013] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-27T18:40:22.014987] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-27T18:40:22.814993] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-27T18:40:22.860932] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:40:23.092623] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T18:40:23.262464] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T18:40:23.614957] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-27T18:40:24.371810] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T18:40:24.414912] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-27T18:40:25.214940] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-27T18:40:25.358858] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T18:40:25.361484] [INFO ] [REMOTE ] EVF: Full fetch complete (12891 records). [2025-10-27T18:40:25.361553] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-27T18:40:25.708409] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-27T18:40:25.708484] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-27T18:40:25.708778] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-27T18:40:25.708840] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-27T18:40:25.709354] [DEBUG] [LOCAL ] EVF: Trimmed 12891 records to 9436 (keeping 200 days of data) [2025-10-27T18:40:25.761302] [DEBUG] [LOCAL ] EVF: Primary data saved (9436 records). [2025-10-27T18:40:25.761411] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-27T18:40:25.761488] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. EVF took 22.7s. Estimated remaining: 3h 22m 10s. Rate: 7.8 symbols/min [2025-10-27T18:40:25.930066] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:25.936734] [DEBUG] [LOCAL ] EVG: Loaded 5823 existing records from primary storage. [2025-10-27T18:40:25.936930] [INFO ] [MAIN ] EVG: Loaded 5823 existing records. [2025-10-27T18:40:26.023864] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-27T18:40:26.111373] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:26.111543] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-27T18:40:26.111589] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-27T18:40:26.111863] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-27T18:40:26.111921] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-27T18:40:26.453128] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:26.660348] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:40:26.664520] [INFO ] [REMOTE ] ETY: Full fetch complete (33610 records). [2025-10-27T18:40:26.664592] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-27T18:40:26.665062] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:40:26.665146] [FATAL] [MAIN ] ETY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:40:26.665187] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:40:26.665223] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-27T18:40:26.665277] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-27T18:40:26.665310] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-27T18:40:26.665523] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-10-27T18:40:26.665608] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. ETY took 40.2s. Estimated remaining: 3h 21m 49s. Rate: 7.8 symbols/min [2025-10-27T18:40:26.830198] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:26.827685] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-27T18:40:26.872007] [DEBUG] [LOCAL ] EVH: Loaded 50344 existing records from primary storage. [2025-10-27T18:40:26.872306] [INFO ] [MAIN ] EVH: Loaded 50344 existing records. [2025-10-27T18:40:27.043870] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:27.044086] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-27T18:40:27.044131] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-27T18:40:27.044891] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-27T18:40:27.044948] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-27T18:40:27.390435] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:27.614954] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-27T18:40:27.746157] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T18:40:27.924437] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T18:40:27.933192] [INFO ] [REMOTE ] EVEX: Full fetch complete (44240 records). [2025-10-27T18:40:27.933281] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-27T18:40:28.304180] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-27T18:40:28.304251] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-27T18:40:28.304864] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-27T18:40:28.304924] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-27T18:40:28.305817] [DEBUG] [LOCAL ] EVEX: Trimmed 44240 records to 33243 (keeping 200 days of data) [2025-10-27T18:40:28.441506] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-27T18:40:28.488093] [DEBUG] [LOCAL ] EVEX: Primary data saved (33243 records). [2025-10-27T18:40:28.488200] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-27T18:40:28.488282] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVEX took 27.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-10-27T18:40:28.653322] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:28.664291] [DEBUG] [LOCAL ] EVN: Loaded 11048 existing records from primary storage. [2025-10-27T18:40:28.664484] [INFO ] [MAIN ] EVN: Loaded 11048 existing records. [2025-10-27T18:40:28.836898] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:28.837068] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-27T18:40:28.837112] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-27T18:40:28.837369] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-27T18:40:28.837410] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-27T18:40:28.953079] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T18:40:29.199619] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:29.214896] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-27T18:40:29.410859] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:40:30.014979] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-27T18:40:30.238184] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:40:30.615835] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T18:40:30.814916] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-27T18:40:31.317842] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T18:40:31.614947] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-27T18:40:32.130093] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:40:32.414963] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-27T18:40:33.214922] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-27T18:40:33.582055] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T18:40:34.014951] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-27T18:40:34.624132] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:40:34.814973] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-27T18:40:35.238010] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T18:40:35.614943] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-27T18:40:35.716421] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:40:36.415635] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-27T18:40:36.417601] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T18:40:37.214922] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-27T18:40:37.237021] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:40:37.788482] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T18:40:38.014925] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-27T18:40:38.726577] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:40:38.814916] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-27T18:40:39.338356] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T18:40:39.614942] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-27T18:40:40.198913] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T18:40:40.415007] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-27T18:40:41.214926] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-27T18:40:41.391301] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:40:41.394439] [INFO ] [REMOTE ] EVC: Full fetch complete (28367 records). [2025-10-27T18:40:41.394533] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-27T18:40:41.757916] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-27T18:40:41.757988] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-27T18:40:41.758468] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-27T18:40:41.758506] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-27T18:40:41.759225] [DEBUG] [LOCAL ] EVC: Trimmed 28367 records to 17464 (keeping 200 days of data) [2025-10-27T18:40:41.858323] [DEBUG] [LOCAL ] EVC: Primary data saved (17464 records). [2025-10-27T18:40:41.858444] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-27T18:40:41.858518] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVC took 43.3s. Estimated remaining: 3h 21m 33s. Rate: 7.8 symbols/min [2025-10-27T18:40:42.016871] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-27T18:40:42.027471] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:42.058735] [DEBUG] [LOCAL ] EVR: Loaded 33926 existing records from primary storage. [2025-10-27T18:40:42.058990] [INFO ] [MAIN ] EVR: Loaded 33926 existing records. [2025-10-27T18:40:42.168981] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T18:40:42.247104] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:42.247280] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-27T18:40:42.247325] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-27T18:40:42.247993] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-27T18:40:42.248050] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-27T18:40:42.550317] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T18:40:42.609826] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:42.814922] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-27T18:40:43.445547] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T18:40:43.614957] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-27T18:40:44.037224] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T18:40:44.414969] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-27T18:40:45.214997] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-27T18:40:45.670880] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T18:40:45.803207] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T18:40:46.014945] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-27T18:40:46.814946] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-27T18:40:47.520602] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:40:47.588421] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:40:47.590128] [INFO ] [REMOTE ] EVG: Full fetch complete (8131 records). [2025-10-27T18:40:47.590195] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-27T18:40:47.620162] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-27T18:40:47.954143] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-27T18:40:47.954217] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-27T18:40:47.954409] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-27T18:40:47.954446] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-27T18:40:47.954865] [DEBUG] [LOCAL ] EVG: Trimmed 8131 records to 5652 (keeping 200 days of data) [2025-10-27T18:40:47.987863] [DEBUG] [LOCAL ] EVG: Primary data saved (5652 records). [2025-10-27T18:40:47.987935] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-27T18:40:47.988046] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVG took 22.2s. Estimated remaining: 3h 21m 22s. Rate: 7.8 symbols/min [2025-10-27T18:40:48.152397] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:48.167822] [DEBUG] [LOCAL ] EVT: Loaded 16696 existing records from primary storage. [2025-10-27T18:40:48.168044] [INFO ] [MAIN ] EVT: Loaded 16696 existing records. [2025-10-27T18:40:48.352760] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:48.353000] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-27T18:40:48.353061] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-27T18:40:48.353442] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-27T18:40:48.353498] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-27T18:40:48.420168] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-27T18:40:48.700921] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:49.061062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:40:49.214936] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-27T18:40:49.831233] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:40:50.014932] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-27T18:40:50.684907] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:40:50.814962] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-27T18:40:51.440002] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T18:40:51.506337] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:40:51.614986] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-27T18:40:52.395462] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:40:52.398339] [INFO ] [REMOTE ] EVN: Full fetch complete (16978 records). [2025-10-27T18:40:52.398409] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-27T18:40:52.420013] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-27T18:40:52.760924] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-27T18:40:52.761006] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-27T18:40:52.761360] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-27T18:40:52.761398] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-27T18:40:52.761918] [DEBUG] [LOCAL ] EVN: Trimmed 16978 records to 10881 (keeping 200 days of data) [2025-10-27T18:40:52.828350] [DEBUG] [LOCAL ] EVN: Primary data saved (10881 records). [2025-10-27T18:40:52.828481] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-27T18:40:52.828573] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVN took 24.3s. Estimated remaining: 3h 21m 9s. Rate: 7.8 symbols/min [2025-10-27T18:40:52.996974] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:40:53.022076] [DEBUG] [LOCAL ] EVTC: Loaded 27158 existing records from primary storage. [2025-10-27T18:40:53.022374] [INFO ] [MAIN ] EVTC: Loaded 27158 existing records. [2025-10-27T18:40:53.208610] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:40:53.208890] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-27T18:40:53.208959] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-27T18:40:53.209447] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-27T18:40:53.209510] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-27T18:40:53.221533] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-27T18:40:53.608988] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:40:53.879586] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:40:53.944006] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T18:40:54.014971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-27T18:40:54.814919] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-27T18:40:54.984821] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:40:55.614935] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-27T18:40:55.770917] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T18:40:56.414950] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-27T18:40:57.085153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:40:57.214979] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-27T18:40:57.478361] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:40:58.015002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-27T18:40:58.640891] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:40:58.814998] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-27T18:40:58.925102] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:40:59.465037] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:40:59.614991] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-27T18:41:00.414974] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-27T18:41:00.848828] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:41:01.214971] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-27T18:41:01.998733] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T18:41:02.014918] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-27T18:41:02.048359] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:41:02.814947] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-27T18:41:03.367818] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T18:41:03.614973] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-27T18:41:04.415017] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-27T18:41:04.483709] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:41:05.185921] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:41:05.214898] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-27T18:41:05.624559] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:41:06.015007] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-27T18:41:06.345713] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:41:06.814954] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-27T18:41:07.507188] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:41:07.614956] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-27T18:41:08.048392] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T18:41:08.414941] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-27T18:41:08.829234] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:41:09.214952] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-27T18:41:09.553546] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T18:41:10.014934] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-27T18:41:10.408519] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T18:41:10.814915] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-27T18:41:11.028345] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T18:41:11.615021] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-27T18:41:11.838153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:41:11.844149] [INFO ] [REMOTE ] EVR: Full fetch complete (50353 records). [2025-10-27T18:41:11.844273] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-27T18:41:12.222291] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-27T18:41:12.222364] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-27T18:41:12.223037] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-27T18:41:12.223098] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-27T18:41:12.224059] [DEBUG] [LOCAL ] EVR: Trimmed 50353 records to 32984 (keeping 200 days of data) [2025-10-27T18:41:12.414977] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-27T18:41:12.438881] [DEBUG] [LOCAL ] EVR: Primary data saved (32984 records). [2025-10-27T18:41:12.439066] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-27T18:41:12.439156] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 30.6s. Estimated remaining: 3h 21m 25s. Rate: 7.8 symbols/min [2025-10-27T18:41:12.618227] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:12.641559] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:41:12.681699] [DEBUG] [LOCAL ] EVTL: Loaded 42106 existing records from primary storage. [2025-10-27T18:41:12.682011] [INFO ] [MAIN ] EVTL: Loaded 42106 existing records. [2025-10-27T18:41:12.852962] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:12.853180] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-27T18:41:12.853227] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-27T18:41:12.853877] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-27T18:41:12.853935] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-27T18:41:13.195559] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:13.214906] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-27T18:41:13.888733] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:41:13.898720] [INFO ] [REMOTE ] EVH: Full fetch complete (71585 records). [2025-10-27T18:41:13.898917] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-27T18:41:13.899961] [FATAL] [VALIDATOR ] EVH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:41:13.900060] [FATAL] [MAIN ] EVH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:41:13.900105] [WARN ] [MAIN ] EVH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:41:13.900146] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-27T18:41:13.900211] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-10-27T18:41:13.900251] [INFO ] [LOCAL ] EVH: Starting deletion of derivative data. [2025-10-27T18:41:13.900424] [DEBUG] [LOCAL ] EVH: Deleted derivative data file. [2025-10-27T18:41:13.900510] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVH took 47.2s. Estimated remaining: 3h 21m 5s. Rate: 7.8 symbols/min [2025-10-27T18:41:14.020206] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-27T18:41:14.090471] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:14.119201] [DEBUG] [LOCAL ] EVTR: Loaded 25943 existing records from primary storage. [2025-10-27T18:41:14.119586] [INFO ] [MAIN ] EVTR: Loaded 25943 existing records. [2025-10-27T18:41:14.310729] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:14.311053] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-27T18:41:14.311125] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-27T18:41:14.311944] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-27T18:41:14.312007] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-27T18:41:14.652125] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:41:14.743763] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:14.814938] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-27T18:41:15.098520] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T18:41:15.614971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-27T18:41:15.774933] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:41:16.390740] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:41:16.415006] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-27T18:41:17.214971] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-27T18:41:17.641221] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T18:41:18.015036] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-27T18:41:18.413082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T18:41:18.419385] [INFO ] [REMOTE ] EVTC: Full fetch complete (38536 records). [2025-10-27T18:41:18.419497] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-27T18:41:18.799512] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-27T18:41:18.799614] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-27T18:41:18.800513] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-27T18:41:18.800606] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-27T18:41:18.801711] [DEBUG] [LOCAL ] EVTC: Trimmed 38536 records to 26579 (keeping 200 days of data) [2025-10-27T18:41:18.854012] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-27T18:41:18.976883] [DEBUG] [LOCAL ] EVTC: Primary data saved (26579 records). [2025-10-27T18:41:18.977105] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-27T18:41:18.977250] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTC took 26.1s. Estimated remaining: 3h 20m 52s. Rate: 7.8 symbols/min [2025-10-27T18:41:19.157708] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:19.209386] [DEBUG] [LOCAL ] EW: Loaded 54166 existing records from primary storage. [2025-10-27T18:41:19.209858] [INFO ] [MAIN ] EW: Loaded 54166 existing records. [2025-10-27T18:41:19.414370] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:19.416146] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:41:19.416263] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-27T18:41:19.421981] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-27T18:41:19.423385] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-27T18:41:19.423447] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-27T18:41:19.622412] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-27T18:41:19.822353] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:19.856084] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T18:41:20.414938] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-27T18:41:20.831788] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:41:21.214991] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-27T18:41:22.029954] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-27T18:41:22.060751] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:41:22.691525] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T18:41:22.713881] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:41:22.814993] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-27T18:41:23.556097] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:41:23.614955] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-27T18:41:24.414952] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-27T18:41:24.732753] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:41:25.129001] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T18:41:25.214954] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-27T18:41:26.014958] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-27T18:41:26.488965] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:41:26.814915] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-27T18:41:27.095118] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:41:27.614953] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-27T18:41:28.409003] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T18:41:28.419512] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-27T18:41:28.779428] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:41:29.214931] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-27T18:41:29.362732] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:41:30.014985] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-27T18:41:30.814976] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-27T18:41:30.847014] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T18:41:31.266141] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:41:31.614972] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-27T18:41:31.833924] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:41:31.837138] [INFO ] [REMOTE ] EVT: Full fetch complete (24827 records). [2025-10-27T18:41:31.837221] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-27T18:41:32.195047] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-27T18:41:32.195119] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-27T18:41:32.195584] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-27T18:41:32.195626] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-27T18:41:32.196298] [DEBUG] [LOCAL ] EVT: Trimmed 24827 records to 16213 (keeping 200 days of data) [2025-10-27T18:41:32.291770] [DEBUG] [LOCAL ] EVT: Primary data saved (16213 records). [2025-10-27T18:41:32.291902] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-27T18:41:32.291979] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVT took 44.3s. Estimated remaining: 3h 20m 56s. Rate: 7.8 symbols/min [2025-10-27T18:41:32.429096] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-27T18:41:32.461025] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:32.489894] [DEBUG] [LOCAL ] EXG: Loaded 34033 existing records from primary storage. [2025-10-27T18:41:32.490188] [INFO ] [MAIN ] EXG: Loaded 34033 existing records. [2025-10-27T18:41:32.664544] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:32.664934] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-27T18:41:32.664982] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-27T18:41:32.665559] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-27T18:41:32.665617] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-27T18:41:33.019743] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:33.214981] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-27T18:41:33.558553] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T18:41:33.762457] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:41:34.014951] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-27T18:41:34.815033] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-27T18:41:34.968743] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T18:41:35.614995] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-27T18:41:35.828883] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:41:36.414929] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-27T18:41:36.459004] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T18:41:37.053593] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:41:37.214928] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-27T18:41:37.529899] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T18:41:38.014907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-27T18:41:38.513242] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T18:41:38.814939] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-27T18:41:39.614919] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-27T18:41:39.861121] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T18:41:40.253346] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:41:40.414933] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-27T18:41:40.505342] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:41:41.214949] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-27T18:41:42.014940] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-27T18:41:42.048703] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T18:41:42.814916] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-27T18:41:42.989610] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:41:43.000232] [INFO ] [REMOTE ] EVTL: Full fetch complete (55305 records). [2025-10-27T18:41:43.000370] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-27T18:41:43.382261] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-27T18:41:43.382354] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-27T18:41:43.383104] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-27T18:41:43.383181] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-27T18:41:43.384510] [DEBUG] [LOCAL ] EVTL: Trimmed 55305 records to 41802 (keeping 200 days of data) [2025-10-27T18:41:43.519124] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T18:41:43.621906] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-27T18:41:43.651624] [DEBUG] [LOCAL ] EVTL: Primary data saved (41802 records). [2025-10-27T18:41:43.651779] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-27T18:41:43.651859] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTL took 31.2s. Estimated remaining: 3h 20m 56s. Rate: 7.8 symbols/min [2025-10-27T18:41:43.847888] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:43.911886] [DEBUG] [LOCAL ] EXK: Loaded 53965 existing records from primary storage. [2025-10-27T18:41:43.912232] [INFO ] [MAIN ] EXK: Loaded 53965 existing records. [2025-10-27T18:41:44.191159] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:44.191694] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-27T18:41:44.191754] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-27T18:41:44.192575] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-27T18:41:44.192635] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-27T18:41:44.421183] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-27T18:41:44.704871] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:44.746166] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T18:41:45.006291] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T18:41:45.214941] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-27T18:41:45.714993] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T18:41:45.721773] [INFO ] [REMOTE ] EVTR: Full fetch complete (34425 records). [2025-10-27T18:41:45.721865] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-27T18:41:46.020018] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-27T18:41:46.097106] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-27T18:41:46.097181] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-27T18:41:46.097751] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-27T18:41:46.097812] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-27T18:41:46.098606] [DEBUG] [LOCAL ] EVTR: Trimmed 34425 records to 25721 (keeping 200 days of data) [2025-10-27T18:41:46.250262] [DEBUG] [LOCAL ] EVTR: Primary data saved (25721 records). [2025-10-27T18:41:46.250386] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-27T18:41:46.250462] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EVTR took 32.3s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-27T18:41:46.414866] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:41:46.440858] [DEBUG] [LOCAL ] EXP: Loaded 29474 existing records from primary storage. [2025-10-27T18:41:46.441117] [INFO ] [MAIN ] EXP: Loaded 29474 existing records. [2025-10-27T18:41:46.612256] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:41:46.612430] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-27T18:41:46.612475] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-27T18:41:46.613035] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-27T18:41:46.613092] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-27T18:41:46.818269] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-27T18:41:46.966920] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:41:47.091284] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T18:41:47.102285] [INFO ] [REMOTE ] EW: Full fetch complete (77504 records). [2025-10-27T18:41:47.102537] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-27T18:41:47.208821] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T18:41:47.521126] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-27T18:41:47.521203] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-27T18:41:47.522203] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-27T18:41:47.522266] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-27T18:41:47.523768] [DEBUG] [LOCAL ] EW: Trimmed 77504 records to 53386 (keeping 200 days of data) [2025-10-27T18:41:47.626131] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-27T18:41:47.836772] [DEBUG] [LOCAL ] EW: Primary data saved (53386 records). [2025-10-27T18:41:47.836941] [INFO ] [MAIN ] EW: Full history saved. [2025-10-27T18:41:47.837669] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EW took 28.9s. Estimated remaining: 3h 20m 18s. Rate: 7.8 symbols/min [2025-10-27T18:41:48.414965] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-27T18:41:48.796386] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T18:41:48.864088] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:41:49.214924] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-27T18:41:49.658131] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:41:50.014990] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-27T18:41:50.814965] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-27T18:41:50.888377] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T18:41:51.025075] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:41:51.614938] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-27T18:41:52.162508] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:41:52.414920] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-27T18:41:52.482442] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T18:41:53.214961] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-27T18:41:53.427213] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:41:54.014965] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-27T18:41:54.193234] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:41:54.199469] [INFO ] [REMOTE ] EXG: Full fetch complete (49266 records). [2025-10-27T18:41:54.199616] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-27T18:41:54.590620] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-27T18:41:54.590719] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-27T18:41:54.591377] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-27T18:41:54.591417] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-27T18:41:54.592387] [DEBUG] [LOCAL ] EXG: Trimmed 49266 records to 33130 (keeping 200 days of data) [2025-10-27T18:41:54.783795] [DEBUG] [LOCAL ] EXG: Primary data saved (33130 records). [2025-10-27T18:41:54.783925] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-27T18:41:54.784001] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXG took 22.5s. Estimated remaining: 3h 20m 9s. Rate: 7.8 symbols/min [2025-10-27T18:41:54.814961] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-27T18:41:55.916103] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T18:41:55.927066] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-27T18:41:56.247849] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:41:56.414929] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-27T18:41:57.421447] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:41:57.432501] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-27T18:41:57.823034] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:41:58.015054] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-27T18:41:59.354233] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T18:41:59.361025] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-27T18:41:59.413093] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:41:59.614935] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-27T18:42:00.925762] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T18:42:00.933228] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-27T18:42:01.681888] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-27T18:42:01.692827] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-27T18:42:02.489283] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:42:02.495683] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-27T18:42:03.460627] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T18:42:03.472942] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-27T18:42:03.870263] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:42:03.877461] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-27T18:42:05.155684] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T18:42:05.166778] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-27T18:42:05.190591] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T18:42:05.195700] [INFO ] [REMOTE ] EXP: Full fetch complete (42639 records). [2025-10-27T18:42:05.195799] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-27T18:42:05.196311] [FATAL] [VALIDATOR ] EXP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:05.196394] [FATAL] [MAIN ] EXP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:05.196436] [WARN ] [MAIN ] EXP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:05.196474] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-27T18:42:05.196529] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-10-27T18:42:05.196563] [INFO ] [LOCAL ] EXP: Starting deletion of derivative data. [2025-10-27T18:42:05.196713] [DEBUG] [LOCAL ] EXP: Deleted derivative data file. [2025-10-27T18:42:05.196798] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXP took 18.9s. Estimated remaining: 3h 20m 7s. Rate: 7.8 symbols/min [2025-10-27T18:42:06.845233] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T18:42:06.858154] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-27T18:42:08.669376] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:42:08.679592] [INFO ] [REMOTE ] EXK: Full fetch complete (76880 records). [2025-10-27T18:42:08.679776] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-27T18:42:09.067841] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-27T18:42:09.067923] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-27T18:42:09.068888] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-27T18:42:09.068953] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-27T18:42:09.070616] [DEBUG] [LOCAL ] EXK: Trimmed 76880 records to 53188 (keeping 200 days of data) [2025-10-27T18:42:09.366696] [DEBUG] [LOCAL ] EXK: Primary data saved (53188 records). [2025-10-27T18:42:09.366845] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-27T18:42:09.367291] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXK took 25.7s. Estimated remaining: 3h 19m 52s. Rate: 7.8 symbols/min [2025-10-27T18:42:09.957292] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.098559] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.094745] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.099831] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:10.189739] [DEBUG] [LOCAL ] EXR: Loaded 46048 existing records from primary storage. [2025-10-27T18:42:10.206161] [INFO ] [MAIN ] EXR: Loaded 46048 existing records. [2025-10-27T18:42:10.207043] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-27T18:42:10.231136] [DEBUG] [LOCAL ] FAF: Loaded 42073 existing records from primary storage. [2025-10-27T18:42:10.250438] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-10-27T18:42:10.256718] [INFO ] [MAIN ] FAF: Loaded 42073 existing records. [2025-10-27T18:42:10.256529] [DEBUG] [LOCAL ] EXPD: Loaded 48335 existing records from primary storage. [2025-10-27T18:42:10.297926] [INFO ] [MAIN ] EXPD: Loaded 48335 existing records. [2025-10-27T18:42:10.870235] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.944267] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.975735] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.967118] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.963339] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.976091] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-27T18:42:10.975859] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-27T18:42:10.991033] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:10.987512] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.991486] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-27T18:42:10.991415] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-27T18:42:10.991675] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-27T18:42:10.992088] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-27T18:42:10.992172] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-27T18:42:10.997375] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-27T18:42:10.997441] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-27T18:42:11.004360] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-27T18:42:11.004259] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-27T18:42:11.004540] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-27T18:42:11.009738] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-27T18:42:12.303780] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.370344] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-27T18:42:12.369920] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.395512] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-27T18:42:12.490508] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.485745] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:12.490974] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-27T18:42:12.491298] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-27T18:42:13.629633] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:42:13.639255] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-27T18:42:13.697179] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:42:13.706130] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-27T18:42:14.197313] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:42:14.204223] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-27T18:42:14.812287] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-27T18:42:14.822973] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-27T18:42:15.067844] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T18:42:15.076892] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-27T18:42:15.144772] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T18:42:15.157863] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-27T18:42:15.520776] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:42:15.527692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-27T18:42:16.980029] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T18:42:16.988775] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-27T18:42:17.031488] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:42:17.041591] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-27T18:42:17.300026] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T18:42:17.310136] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-27T18:42:17.429300] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-27T18:42:17.439237] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-27T18:42:18.290784] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:42:18.300440] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-27T18:42:18.433961] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:42:18.649862] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:42:18.814986] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-27T18:42:19.615021] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-27T18:42:19.765047] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T18:42:19.821887] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:42:20.414913] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-27T18:42:20.618831] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T18:42:20.870512] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:42:21.214981] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-27T18:42:21.775845] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:42:22.015001] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-27T18:42:22.815031] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-27T18:42:23.385547] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:42:23.477966] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T18:42:23.614913] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-27T18:42:24.217597] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:42:24.414937] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-27T18:42:25.215002] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-27T18:42:25.789843] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:42:26.014947] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-27T18:42:26.135369] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-27T18:42:26.814980] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-27T18:42:26.955239] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T18:42:27.285021] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:42:27.614961] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-27T18:42:28.415010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-27T18:42:28.753012] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T18:42:28.904339] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:42:29.214978] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-27T18:42:30.015075] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-27T18:42:30.814925] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-27T18:42:30.876310] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T18:42:31.055202] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-27T18:42:31.319961] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:42:31.614937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-27T18:42:32.270572] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:42:32.283802] [INFO ] [REMOTE ] FAF: Full fetch complete (58433 records). [2025-10-27T18:42:32.284114] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-27T18:42:32.420203] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-27T18:42:32.803100] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-27T18:42:32.803263] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-27T18:42:32.804798] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-27T18:42:32.804981] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-27T18:42:32.807140] [DEBUG] [LOCAL ] FAF: Trimmed 58433 records to 41263 (keeping 200 days of data) [2025-10-27T18:42:32.943891] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:42:33.130306] [DEBUG] [LOCAL ] FAF: Primary data saved (41263 records). [2025-10-27T18:42:33.130502] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-27T18:42:33.130608] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FAF took 23.8s. Estimated remaining: 3h 20m 16s. Rate: 7.8 symbols/min [2025-10-27T18:42:33.220076] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-27T18:42:33.314325] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:33.366491] [DEBUG] [LOCAL ] FBIN: Loaded 51100 existing records from primary storage. [2025-10-27T18:42:33.367051] [INFO ] [MAIN ] FBIN: Loaded 51100 existing records. [2025-10-27T18:42:33.557889] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:33.558139] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-27T18:42:33.558192] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-27T18:42:33.559145] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-27T18:42:33.559209] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-27T18:42:33.933173] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:33.963163] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T18:42:33.972417] [INFO ] [REMOTE ] EXR: Full fetch complete (65781 records). [2025-10-27T18:42:33.972530] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-27T18:42:33.973378] [FATAL] [VALIDATOR ] EXR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:33.973468] [FATAL] [MAIN ] EXR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:33.973533] [WARN ] [MAIN ] EXR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:33.973575] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-27T18:42:33.973634] [DEBUG] [LOCAL ] EXR: No primary data file found to delete. [2025-10-27T18:42:33.973711] [INFO ] [LOCAL ] EXR: Starting deletion of derivative data. [2025-10-27T18:42:33.973874] [DEBUG] [LOCAL ] EXR: Deleted derivative data file. [2025-10-27T18:42:33.973986] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. EXR took 24.6s. Estimated remaining: 3h 19m 55s. Rate: 7.8 symbols/min [2025-10-27T18:42:34.020063] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-27T18:42:34.147868] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:34.178009] [DEBUG] [LOCAL ] FBK: Loaded 27741 existing records from primary storage. [2025-10-27T18:42:34.178412] [INFO ] [MAIN ] FBK: Loaded 27741 existing records. [2025-10-27T18:42:34.361277] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:34.361497] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-27T18:42:34.361545] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-27T18:42:34.362381] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-27T18:42:34.362704] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-27T18:42:34.752710] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:34.817302] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-27T18:42:34.823585] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-27T18:42:35.589818] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:42:35.614937] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-27T18:42:36.414935] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-27T18:42:36.522224] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T18:42:36.782436] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:42:37.214934] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-27T18:42:37.618042] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T18:42:38.014991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-27T18:42:38.814975] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-27T18:42:39.049370] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T18:42:39.460866] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:42:39.614915] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-27T18:42:39.671557] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T18:42:40.414937] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-27T18:42:41.214962] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-27T18:42:41.380323] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:42:41.390262] [INFO ] [REMOTE ] EXPD: Full fetch complete (69019 records). [2025-10-27T18:42:41.390473] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-27T18:42:41.391688] [FATAL] [VALIDATOR ] EXPD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:42:41.391811] [FATAL] [MAIN ] EXPD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:42:41.391917] [WARN ] [MAIN ] EXPD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:42:41.392007] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-27T18:42:41.392093] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-27T18:42:41.392138] [INFO ] [LOCAL ] EXPD: Starting deletion of derivative data. [2025-10-27T18:42:41.392304] [DEBUG] [LOCAL ] EXPD: Deleted derivative data file. [2025-10-27T18:42:41.392425] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. EXPD took 32.0s. Estimated remaining: 3h 19m 47s. Rate: 7.8 symbols/min [2025-10-27T18:42:41.577110] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:41.627182] [DEBUG] [LOCAL ] FBP: Loaded 46291 existing records from primary storage. [2025-10-27T18:42:41.627847] [INFO ] [MAIN ] FBP: Loaded 46291 existing records. [2025-10-27T18:42:41.848110] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:41.848367] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-27T18:42:41.848427] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-27T18:42:41.849356] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-27T18:42:41.849414] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-27T18:42:42.017684] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-27T18:42:42.218793] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:42.230205] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T18:42:42.641177] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T18:42:42.814941] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-27T18:42:43.615335] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-27T18:42:43.621223] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T18:42:43.837374] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T18:42:43.847554] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-27T18:42:43.847709] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-27T18:42:44.233431] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-27T18:42:44.233506] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-27T18:42:44.234393] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-27T18:42:44.234455] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-27T18:42:44.235889] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-27T18:42:44.423356] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-27T18:42:44.581586] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-27T18:42:44.581763] [INFO ] [MAIN ] F: Full history saved. [2025-10-27T18:42:44.581910] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 35.2s. Estimated remaining: 3h 19m 31s. Rate: 7.8 symbols/min [2025-10-27T18:42:44.774064] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:44.771785] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:42:44.811986] [DEBUG] [LOCAL ] FBRT: Loaded 35665 existing records from primary storage. [2025-10-27T18:42:44.812247] [INFO ] [MAIN ] FBRT: Loaded 35665 existing records. [2025-10-27T18:42:44.988347] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:44.988576] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-27T18:42:44.988665] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-27T18:42:44.989297] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-27T18:42:44.989352] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-27T18:42:45.220038] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-27T18:42:45.372402] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:42:46.014920] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-27T18:42:46.110342] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:42:46.313425] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T18:42:46.814924] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-27T18:42:47.252790] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:42:47.624185] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-27T18:42:47.626402] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T18:42:48.415000] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-27T18:42:48.765452] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:42:49.214949] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-27T18:42:49.674734] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:42:50.014947] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-27T18:42:50.559931] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:42:50.814998] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-27T18:42:51.285570] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:42:51.614996] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-27T18:42:52.331745] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:42:52.414905] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-27T18:42:52.772356] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T18:42:53.188570] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T18:42:53.214892] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-27T18:42:54.014918] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-27T18:42:54.073340] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:42:54.814995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-27T18:42:55.189042] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T18:42:55.614927] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-27T18:42:55.710107] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:42:56.414984] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-27T18:42:57.214917] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-27T18:42:57.318276] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:42:58.014947] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-27T18:42:58.430058] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T18:42:58.698021] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T18:42:58.704291] [INFO ] [REMOTE ] FBK: Full fetch complete (35680 records). [2025-10-27T18:42:58.704403] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-27T18:42:58.820048] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-27T18:42:59.075912] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-27T18:42:59.076031] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-27T18:42:59.076778] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-27T18:42:59.076861] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-27T18:42:59.077902] [DEBUG] [LOCAL ] FBK: Trimmed 35680 records to 27185 (keeping 200 days of data) [2025-10-27T18:42:59.235623] [DEBUG] [LOCAL ] FBK: Primary data saved (27185 records). [2025-10-27T18:42:59.235769] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-27T18:42:59.235903] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBK took 25.3s. Estimated remaining: 3h 19m 37s. Rate: 7.8 symbols/min [2025-10-27T18:42:59.408965] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:42:59.422358] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:42:59.441059] [DEBUG] [LOCAL ] FC: Loaded 14480 existing records from primary storage. [2025-10-27T18:42:59.441278] [INFO ] [MAIN ] FC: Loaded 14480 existing records. [2025-10-27T18:42:59.611474] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:42:59.611675] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-27T18:42:59.611732] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-27T18:42:59.612028] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-27T18:42:59.612084] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-27T18:42:59.622979] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-27T18:42:59.963626] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:00.059841] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:43:00.414942] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-27T18:43:01.215035] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-27T18:43:01.390410] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T18:43:02.014913] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-27T18:43:02.362863] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:43:02.717439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:43:02.814911] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-27T18:43:03.236691] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:43:03.614989] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-27T18:43:03.834140] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T18:43:04.414999] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-27T18:43:04.913045] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T18:43:05.149280] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T18:43:05.214932] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-27T18:43:06.014977] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-27T18:43:06.469682] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:43:06.814959] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-27T18:43:07.523507] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:43:07.532982] [INFO ] [REMOTE ] FBIN: Full fetch complete (72926 records). [2025-10-27T18:43:07.533165] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-27T18:43:07.623535] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-27T18:43:07.928472] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-27T18:43:07.928557] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-27T18:43:07.929605] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-27T18:43:07.929693] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-27T18:43:07.931071] [DEBUG] [LOCAL ] FBIN: Trimmed 72926 records to 50259 (keeping 200 days of data) [2025-10-27T18:43:08.231516] [DEBUG] [LOCAL ] FBIN: Primary data saved (50259 records). [2025-10-27T18:43:08.231638] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-27T18:43:08.232136] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBIN took 35.1s. Estimated remaining: 3h 19m 31s. Rate: 7.8 symbols/min [2025-10-27T18:43:08.404615] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:08.414993] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-27T18:43:08.443088] [DEBUG] [LOCAL ] FCF: Loaded 39629 existing records from primary storage. [2025-10-27T18:43:08.443455] [INFO ] [MAIN ] FCF: Loaded 39629 existing records. [2025-10-27T18:43:08.614365] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T18:43:08.658323] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:08.658442] [INFO ] [REMOTE ] FBRT: Full fetch complete (49595 records). [2025-10-27T18:43:08.658626] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-27T18:43:08.658800] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-27T18:43:08.658874] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-27T18:43:08.691170] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-27T18:43:08.734913] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-27T18:43:09.459824] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-27T18:43:09.461187] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-27T18:43:09.484851] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-27T18:43:09.483892] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:09.485184] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-27T18:43:09.485507] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-27T18:43:09.488348] [DEBUG] [LOCAL ] FBRT: Trimmed 49595 records to 34825 (keeping 200 days of data) [2025-10-27T18:43:09.621224] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:43:09.625123] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T18:43:09.760077] [DEBUG] [LOCAL ] FBRT: Primary data saved (34825 records). [2025-10-27T18:43:09.760211] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-27T18:43:09.760292] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FBRT took 25.2s. Estimated remaining: 3h 19m 12s. Rate: 7.8 symbols/min [2025-10-27T18:43:09.931690] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:09.956964] [DEBUG] [LOCAL ] FCN: Loaded 26423 existing records from primary storage. [2025-10-27T18:43:09.957253] [INFO ] [MAIN ] FCN: Loaded 26423 existing records. [2025-10-27T18:43:10.020029] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-27T18:43:10.134821] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:10.135025] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-27T18:43:10.135089] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-27T18:43:10.135567] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-27T18:43:10.135624] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-27T18:43:10.477841] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:10.738046] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:43:10.814937] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-27T18:43:10.947639] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T18:43:11.614954] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-27T18:43:11.858783] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T18:43:12.414966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-27T18:43:12.451352] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:43:13.214960] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-27T18:43:13.305768] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T18:43:14.014952] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-27T18:43:14.335085] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T18:43:14.814948] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-27T18:43:15.262126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:43:15.614990] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-27T18:43:16.224897] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:43:16.414990] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-27T18:43:16.698104] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T18:43:17.214952] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-27T18:43:18.015045] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-27T18:43:18.353334] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:43:18.544269] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T18:43:18.815022] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-27T18:43:19.614994] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-27T18:43:19.747040] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:43:20.414964] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-27T18:43:20.778373] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T18:43:20.781248] [INFO ] [REMOTE ] FC: Full fetch complete (21860 records). [2025-10-27T18:43:20.781328] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-27T18:43:21.156543] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-27T18:43:21.156635] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-27T18:43:21.157221] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-27T18:43:21.157300] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-27T18:43:21.158142] [DEBUG] [LOCAL ] FC: Trimmed 21860 records to 13951 (keeping 200 days of data) [2025-10-27T18:43:21.230331] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:43:21.229288] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-27T18:43:21.260620] [DEBUG] [LOCAL ] FC: Primary data saved (13951 records). [2025-10-27T18:43:21.260791] [INFO ] [MAIN ] FC: Full history saved. [2025-10-27T18:43:21.260873] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 22.0s. Estimated remaining: 3h 19m 12s. Rate: 7.8 symbols/min [2025-10-27T18:43:21.428280] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:21.461838] [DEBUG] [LOCAL ] FCPT: Loaded 37417 existing records from primary storage. [2025-10-27T18:43:21.462102] [INFO ] [MAIN ] FCPT: Loaded 37417 existing records. [2025-10-27T18:43:21.646149] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:21.646395] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-27T18:43:21.646450] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-27T18:43:21.646992] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-27T18:43:21.647051] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-27T18:43:22.017218] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-27T18:43:22.050254] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:22.080481] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T18:43:22.634552] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T18:43:22.814938] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-27T18:43:23.542900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T18:43:23.614936] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-27T18:43:23.799095] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:43:24.390767] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:43:24.414985] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-27T18:43:25.215001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-27T18:43:25.870311] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T18:43:26.014927] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-27T18:43:26.603898] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:43:26.802155] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T18:43:26.814898] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-27T18:43:27.614914] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-27T18:43:27.692093] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T18:43:28.414966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-27T18:43:29.173759] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T18:43:29.214896] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-27T18:43:29.556981] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:43:30.014981] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-27T18:43:30.814925] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-27T18:43:31.032900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:43:31.581333] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-27T18:43:31.590184] [INFO ] [REMOTE ] FBP: Full fetch complete (66763 records). [2025-10-27T18:43:31.590293] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-27T18:43:31.620918] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-27T18:43:31.973047] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-27T18:43:31.973121] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-27T18:43:31.973987] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-27T18:43:31.974084] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-27T18:43:31.975427] [DEBUG] [LOCAL ] FBP: Trimmed 66763 records to 45446 (keeping 200 days of data) [2025-10-27T18:43:32.237054] [DEBUG] [LOCAL ] FBP: Primary data saved (45446 records). [2025-10-27T18:43:32.237173] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-27T18:43:32.237843] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FBP took 50.8s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min [2025-10-27T18:43:32.419221] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-27T18:43:32.410947] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:32.433944] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-27T18:43:32.434059] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-27T18:43:32.434187] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-27T18:43:32.434276] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-27T18:43:32.434559] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-27T18:43:32.434624] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-27T18:43:32.467544] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:43:32.796058] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:33.214964] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-27T18:43:33.278335] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T18:43:33.761218] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T18:43:33.994442] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:43:34.000071] [INFO ] [REMOTE ] FCN: Full fetch complete (36733 records). [2025-10-27T18:43:34.000169] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-27T18:43:34.021220] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-27T18:43:34.372125] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-27T18:43:34.372196] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-27T18:43:34.372773] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-27T18:43:34.372833] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-27T18:43:34.373585] [DEBUG] [LOCAL ] FCN: Trimmed 36733 records to 25826 (keeping 200 days of data) [2025-10-27T18:43:34.522756] [DEBUG] [LOCAL ] FCN: Primary data saved (25826 records). [2025-10-27T18:43:34.522876] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-27T18:43:34.522951] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FCN took 24.8s. Estimated remaining: 3h 18m 52s. Rate: 7.8 symbols/min [2025-10-27T18:43:34.631728] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T18:43:34.718922] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:34.736102] [DEBUG] [LOCAL ] FCT: Loaded 15148 existing records from primary storage. [2025-10-27T18:43:34.736330] [INFO ] [MAIN ] FCT: Loaded 15148 existing records. [2025-10-27T18:43:34.820093] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-27T18:43:34.916051] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:34.916250] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-27T18:43:34.916299] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-27T18:43:34.916545] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-27T18:43:34.916587] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-27T18:43:35.304431] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:35.614938] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-27T18:43:36.155317] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T18:43:36.414969] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-27T18:43:36.876704] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T18:43:37.214938] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-27T18:43:37.429989] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:43:38.014916] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-27T18:43:38.738749] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:43:38.814944] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-27T18:43:39.518713] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:43:39.614957] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-27T18:43:40.211384] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:43:40.414941] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-27T18:43:40.885561] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:43:41.214976] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-27T18:43:41.296409] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T18:43:41.305878] [INFO ] [REMOTE ] FCF: Full fetch complete (58054 records). [2025-10-27T18:43:41.306130] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-27T18:43:41.853038] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-27T18:43:41.853140] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-27T18:43:41.854272] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-27T18:43:41.854352] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-27T18:43:41.856042] [DEBUG] [LOCAL ] FCF: Trimmed 58054 records to 38757 (keeping 200 days of data) [2025-10-27T18:43:42.050021] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-27T18:43:42.115693] [DEBUG] [LOCAL ] FCF: Primary data saved (38757 records). [2025-10-27T18:43:42.116721] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-27T18:43:42.116862] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCF took 33.9s. Estimated remaining: 3h 18m 45s. Rate: 7.8 symbols/min [2025-10-27T18:43:42.305231] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:42.354511] [DEBUG] [LOCAL ] FCX: Loaded 54481 existing records from primary storage. [2025-10-27T18:43:42.354957] [INFO ] [MAIN ] FCX: Loaded 54481 existing records. [2025-10-27T18:43:42.531726] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:42.532152] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-27T18:43:42.532229] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-27T18:43:42.532551] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-27T18:43:42.532690] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-27T18:43:42.652706] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T18:43:42.748098] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:43:42.820086] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-27T18:43:42.943633] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:43.614952] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-27T18:43:44.414926] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-27T18:43:44.671557] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T18:43:45.214911] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-27T18:43:45.354577] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:43:45.355431] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:43:46.014928] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-27T18:43:46.606779] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:43:46.782497] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T18:43:46.814916] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-27T18:43:47.614915] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-27T18:43:47.695670] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T18:43:48.414950] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-27T18:43:49.015923] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:43:49.214954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-27T18:43:49.616595] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T18:43:49.836844] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:43:50.014954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-27T18:43:50.605157] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:43:50.814931] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-27T18:43:51.614987] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-27T18:43:52.176514] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:43:52.184057] [INFO ] [REMOTE ] FCPT: Full fetch complete (53796 records). [2025-10-27T18:43:52.184216] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-27T18:43:52.420353] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-27T18:43:52.578377] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-27T18:43:52.578461] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-27T18:43:52.579285] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-27T18:43:52.579347] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-27T18:43:52.580438] [DEBUG] [LOCAL ] FCPT: Trimmed 53796 records to 36614 (keeping 200 days of data) [2025-10-27T18:43:52.689969] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:43:52.824191] [DEBUG] [LOCAL ] FCPT: Primary data saved (36614 records). [2025-10-27T18:43:52.824360] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-27T18:43:52.824455] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCPT took 31.6s. Estimated remaining: 3h 18m 43s. Rate: 7.8 symbols/min [2025-10-27T18:43:53.005038] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:43:53.034389] [DEBUG] [LOCAL ] FDP: Loaded 30019 existing records from primary storage. [2025-10-27T18:43:53.034677] [INFO ] [MAIN ] FDP: Loaded 30019 existing records. [2025-10-27T18:43:53.207962] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:43:53.208226] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-27T18:43:53.208273] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-27T18:43:53.208447] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-27T18:43:53.208503] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-27T18:43:53.221048] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-27T18:43:53.562206] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:43:54.014950] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-27T18:43:54.196108] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:43:54.327435] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T18:43:54.814999] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-27T18:43:54.928331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-27T18:43:55.614957] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-27T18:43:56.068136] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:43:56.414920] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-27T18:43:57.214979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-27T18:43:57.300882] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:43:57.466435] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:43:57.633612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:43:58.014972] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-27T18:43:58.357003] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T18:43:58.815017] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-27T18:43:59.614956] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-27T18:44:00.094216] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:44:00.095159] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:44:00.414962] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-27T18:44:01.214982] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-27T18:44:01.235799] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T18:44:02.014955] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-27T18:44:02.815045] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-27T18:44:03.494386] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-27T18:44:03.498447] [INFO ] [REMOTE ] FCT: Full fetch complete (21368 records). [2025-10-27T18:44:03.498545] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-27T18:44:03.499075] [FATAL] [VALIDATOR ] FCT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:03.499158] [FATAL] [MAIN ] FCT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:03.499203] [WARN ] [MAIN ] FCT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:03.499241] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-27T18:44:03.499295] [DEBUG] [LOCAL ] FCT: No primary data file found to delete. [2025-10-27T18:44:03.499328] [INFO ] [LOCAL ] FCT: Starting deletion of derivative data. [2025-10-27T18:44:03.499459] [DEBUG] [LOCAL ] FCT: Deleted derivative data file. [2025-10-27T18:44:03.499566] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FCT took 29.0s. Estimated remaining: 3h 18m 41s. Rate: 7.8 symbols/min [2025-10-27T18:44:03.619572] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-27T18:44:03.683022] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:03.711373] [DEBUG] [LOCAL ] FDS: Loaded 28600 existing records from primary storage. [2025-10-27T18:44:03.711634] [INFO ] [MAIN ] FDS: Loaded 28600 existing records. [2025-10-27T18:44:03.901730] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:03.901974] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-27T18:44:03.902031] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-27T18:44:03.908778] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-27T18:44:03.919523] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-27T18:44:03.952740] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T18:44:04.289340] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:04.327095] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:44:04.359893] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T18:44:04.360531] [INFO ] [REMOTE ] FCRX: Full fetch complete (1611 records). [2025-10-27T18:44:04.360598] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-27T18:44:04.424951] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-27T18:44:04.547279] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-27T18:44:04.547454] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:04.547521] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:04.547594] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-27T18:44:04.547681] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-27T18:44:04.547736] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-27T18:44:04.547779] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-27T18:44:04.547837] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FCRX took 32.3s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-27T18:44:04.715292] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:04.765919] [DEBUG] [LOCAL ] FDX: Loaded 51851 existing records from primary storage. [2025-10-27T18:44:04.766241] [INFO ] [MAIN ] FDX: Loaded 51851 existing records. [2025-10-27T18:44:04.968155] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:04.968354] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-27T18:44:04.968400] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-27T18:44:04.968784] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-27T18:44:04.968842] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-27T18:44:05.222249] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-27T18:44:05.364683] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:06.014971] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-27T18:44:06.299848] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:44:06.639194] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-27T18:44:06.814985] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-27T18:44:07.556517] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T18:44:07.614921] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-27T18:44:08.414936] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-27T18:44:08.675895] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T18:44:08.906469] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T18:44:09.214955] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-27T18:44:09.457840] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:44:10.014942] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-27T18:44:10.814912] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-27T18:44:10.857476] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:44:11.614917] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-27T18:44:11.703547] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:44:11.777875] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-27T18:44:12.414963] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-27T18:44:12.760612] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:44:13.215049] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-27T18:44:14.014975] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-27T18:44:14.363603] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:44:14.415956] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T18:44:14.814948] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-27T18:44:14.978044] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T18:44:15.614963] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-27T18:44:16.414964] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-27T18:44:17.215007] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-27T18:44:17.709981] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:44:17.741006] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-27T18:44:17.750808] [INFO ] [REMOTE ] FCX: Full fetch complete (77488 records). [2025-10-27T18:44:17.750934] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-27T18:44:17.751733] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:17.751832] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:17.751910] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:17.751997] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-27T18:44:17.752073] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-27T18:44:17.752112] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-10-27T18:44:17.752449] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-10-27T18:44:17.753007] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FCX took 35.6s. Estimated remaining: 3h 18m 23s. Rate: 7.8 symbols/min [2025-10-27T18:44:17.931246] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:18.013452] [DEBUG] [LOCAL ] FE: Loaded 54210 existing records from primary storage. [2025-10-27T18:44:18.014461] [INFO ] [MAIN ] FE: Loaded 54210 existing records. [2025-10-27T18:44:18.015546] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-27T18:44:18.015664] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-27T18:44:18.227437] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:18.228092] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-27T18:44:18.228163] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-27T18:44:18.228884] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-27T18:44:18.228941] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-27T18:44:18.588771] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:18.609255] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T18:44:18.814913] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-27T18:44:19.412119] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:44:19.615006] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-27T18:44:20.414981] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-27T18:44:20.451990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T18:44:20.839052] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T18:44:21.214942] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-27T18:44:22.005976] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T18:44:22.014897] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-27T18:44:22.315758] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T18:44:22.814997] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-27T18:44:23.100830] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T18:44:23.614924] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-27T18:44:23.792898] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:44:24.414933] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-27T18:44:25.214986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-27T18:44:25.256016] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:44:25.731547] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T18:44:26.015000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-27T18:44:26.532211] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T18:44:26.814954] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-27T18:44:27.040677] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:44:27.045989] [INFO ] [REMOTE ] FDP: Full fetch complete (42804 records). [2025-10-27T18:44:27.046089] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-27T18:44:27.421106] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-27T18:44:27.421184] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-27T18:44:27.421887] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-27T18:44:27.421949] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-27T18:44:27.422856] [DEBUG] [LOCAL ] FDP: Trimmed 42804 records to 29418 (keeping 200 days of data) [2025-10-27T18:44:27.596994] [DEBUG] [LOCAL ] FDP: Primary data saved (29418 records). [2025-10-27T18:44:27.597127] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-27T18:44:27.597234] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FDP took 34.8s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-27T18:44:27.620083] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-27T18:44:27.770717] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:27.770942] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-27T18:44:27.770986] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-27T18:44:27.771094] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-27T18:44:27.771137] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-27T18:44:27.771178] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-27T18:44:27.771210] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-27T18:44:28.116541] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:28.414972] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-27T18:44:28.946390] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T18:44:29.215021] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-27T18:44:29.640277] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T18:44:30.014988] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-27T18:44:30.174524] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T18:44:30.182327] [INFO ] [REMOTE ] FDS: Full fetch complete (39749 records). [2025-10-27T18:44:30.182411] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-27T18:44:30.553285] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-27T18:44:30.553445] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-27T18:44:30.554108] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-27T18:44:30.554169] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-27T18:44:30.555035] [DEBUG] [LOCAL ] FDS: Trimmed 39749 records to 28149 (keeping 200 days of data) [2025-10-27T18:44:30.646517] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T18:44:30.731718] [DEBUG] [LOCAL ] FDS: Primary data saved (28149 records). [2025-10-27T18:44:30.731857] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-27T18:44:30.731937] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FDS took 27.2s. Estimated remaining: 3h 18m 3s. Rate: 7.8 symbols/min [2025-10-27T18:44:30.820473] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-27T18:44:30.902738] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:30.949873] [DEBUG] [LOCAL ] FERG: Loaded 49424 existing records from primary storage. [2025-10-27T18:44:30.950180] [INFO ] [MAIN ] FERG: Loaded 49424 existing records. [2025-10-27T18:44:31.136496] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:31.136838] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-27T18:44:31.136996] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-27T18:44:31.137614] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-27T18:44:31.137722] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-27T18:44:31.266865] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T18:44:31.282547] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T18:44:31.566418] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:31.614942] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-27T18:44:32.042144] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T18:44:32.414929] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-27T18:44:32.876892] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T18:44:33.215006] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-27T18:44:33.656567] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:44:34.014941] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-27T18:44:34.815002] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-27T18:44:35.614924] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-27T18:44:35.845447] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T18:44:36.414924] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-27T18:44:36.694590] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T18:44:37.106119] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:44:37.214956] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-27T18:44:37.659609] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T18:44:38.020041] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-27T18:44:38.033496] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T18:44:38.814938] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-27T18:44:39.614932] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-27T18:44:39.697071] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T18:44:40.131515] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:44:40.414916] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-27T18:44:40.517447] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:44:41.012534] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:44:41.214917] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-27T18:44:41.830778] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T18:44:42.014927] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-27T18:44:42.815008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-27T18:44:43.313019] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:44:43.313847] [INFO ] [REMOTE ] FENG: Full fetch complete (2253 records). [2025-10-27T18:44:43.313931] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-27T18:44:43.314323] [FATAL] [VALIDATOR ] FENG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:44:43.314406] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:44:43.314475] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:44:43.314547] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-27T18:44:43.314609] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-27T18:44:43.314671] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-27T18:44:43.314739] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-27T18:44:43.314796] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FENG took 15.7s. Estimated remaining: 3h 18m 5s. Rate: 7.8 symbols/min [2025-10-27T18:44:43.490839] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:43.504780] [DEBUG] [LOCAL ] FET: Loaded 13196 existing records from primary storage. [2025-10-27T18:44:43.505010] [INFO ] [MAIN ] FET: Loaded 13196 existing records. [2025-10-27T18:44:43.620121] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-27T18:44:43.680562] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:43.680741] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-27T18:44:43.680792] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-27T18:44:43.681009] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-27T18:44:43.681056] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-27T18:44:44.032505] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:44.288582] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-27T18:44:44.414909] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-27T18:44:45.214970] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-27T18:44:46.015057] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-27T18:44:46.144052] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:44:46.255012] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-27T18:44:46.328213] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T18:44:46.814944] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-27T18:44:47.614944] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-27T18:44:47.957140] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:44:48.223278] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T18:44:48.414930] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-27T18:44:49.214952] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-27T18:44:49.470177] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:44:49.480175] [INFO ] [REMOTE ] FDX: Full fetch complete (74152 records). [2025-10-27T18:44:49.480337] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-27T18:44:49.877791] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-27T18:44:49.877934] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-27T18:44:49.878988] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-27T18:44:49.879101] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-27T18:44:49.880847] [DEBUG] [LOCAL ] FDX: Trimmed 74152 records to 51063 (keeping 200 days of data) [2025-10-27T18:44:50.021300] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T18:44:50.015075] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-27T18:44:50.246736] [DEBUG] [LOCAL ] FDX: Primary data saved (51063 records). [2025-10-27T18:44:50.246893] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-27T18:44:50.247753] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FDX took 45.7s. Estimated remaining: 3h 17m 56s. Rate: 7.8 symbols/min [2025-10-27T18:44:50.412081] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:44:50.435203] [DEBUG] [LOCAL ] FF: Loaded 23887 existing records from primary storage. [2025-10-27T18:44:50.435437] [INFO ] [MAIN ] FF: Loaded 23887 existing records. [2025-10-27T18:44:50.610392] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:44:50.610725] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-27T18:44:50.610779] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-27T18:44:50.610953] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-27T18:44:50.611011] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-27T18:44:50.819732] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-27T18:44:50.972193] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:44:51.024693] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T18:44:51.030570] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:44:51.614952] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-27T18:44:52.414953] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-27T18:44:52.626994] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:44:52.673165] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:44:53.214944] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-27T18:44:53.600583] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:44:53.969488] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T18:44:54.014902] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-27T18:44:54.814958] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-27T18:44:54.860626] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T18:44:55.614990] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-27T18:44:56.415017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-27T18:44:56.448109] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:44:57.214988] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-27T18:44:57.251898] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T18:44:57.517917] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:44:58.014912] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-27T18:44:58.357887] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:44:58.814920] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-27T18:44:58.932689] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T18:44:59.614952] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-27T18:45:00.265481] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T18:45:00.414917] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-27T18:45:00.529920] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T18:45:01.214958] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-27T18:45:02.014983] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-27T18:45:02.302941] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T18:45:02.814979] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-27T18:45:03.375813] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:45:03.614969] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-27T18:45:04.099562] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T18:45:04.102854] [INFO ] [REMOTE ] FET: Full fetch complete (18629 records). [2025-10-27T18:45:04.102967] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-27T18:45:04.419397] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-27T18:45:04.488686] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-27T18:45:04.504876] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-27T18:45:04.515889] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-27T18:45:04.516007] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-27T18:45:04.518055] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-27T18:45:04.518441] [DEBUG] [LOCAL ] FET: Trimmed 18629 records to 12924 (keeping 200 days of data) [2025-10-27T18:45:04.529892] [INFO ] [REMOTE ] FE: Full fetch complete (77494 records). [2025-10-27T18:45:04.559154] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-27T18:45:04.708312] [DEBUG] [LOCAL ] FET: Primary data saved (12924 records). [2025-10-27T18:45:04.714248] [INFO ] [MAIN ] FET: Full history saved. [2025-10-27T18:45:04.724687] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FET took 21.4s. Estimated remaining: 3h 18m 1s. Rate: 7.8 symbols/min [2025-10-27T18:45:05.104360] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:05.206428] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-27T18:45:05.210046] [DEBUG] [LOCAL ] FFA: Loaded 5642 existing records from primary storage. [2025-10-27T18:45:05.227795] [INFO ] [MAIN ] FFA: Loaded 5642 existing records. [2025-10-27T18:45:05.227555] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-27T18:45:05.241403] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:45:05.229397] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-27T18:45:05.291981] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-27T18:45:05.292275] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-27T18:45:05.341250] [DEBUG] [LOCAL ] FE: Trimmed 77494 records to 53430 (keeping 200 days of data) [2025-10-27T18:45:05.550216] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:05.550441] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-27T18:45:05.550488] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-27T18:45:05.550753] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-27T18:45:05.550823] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-27T18:45:06.108509] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-27T18:45:06.128274] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:06.128821] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-27T18:45:06.128542] [INFO ] [MAIN ] FE: Full history saved. [2025-10-27T18:45:06.129328] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FE took 48.4s. Estimated remaining: 3h 17m 42s. Rate: 7.8 symbols/min [2025-10-27T18:45:06.311329] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:06.330154] [DEBUG] [LOCAL ] FFC: Loaded 16845 existing records from primary storage. [2025-10-27T18:45:06.330387] [INFO ] [MAIN ] FFC: Loaded 16845 existing records. [2025-10-27T18:45:06.514157] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:06.514806] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-27T18:45:06.515111] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-27T18:45:06.515353] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-27T18:45:06.515408] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-27T18:45:06.734075] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:45:06.804884] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T18:45:06.820070] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-27T18:45:06.879065] [INFO ] [REMOTE ] FERG: Full fetch complete (71226 records). [2025-10-27T18:45:06.879305] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-27T18:45:07.068844] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:07.113134] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:45:07.395606] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-27T18:45:07.395735] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-27T18:45:07.396864] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-27T18:45:07.396941] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-27T18:45:07.398729] [DEBUG] [LOCAL ] FERG: Trimmed 71226 records to 48610 (keeping 200 days of data) [2025-10-27T18:45:07.626937] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-27T18:45:07.725451] [DEBUG] [LOCAL ] FERG: Primary data saved (48610 records). [2025-10-27T18:45:07.725590] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-27T18:45:07.725694] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FERG took 37.0s. Estimated remaining: 3h 17m 23s. Rate: 7.8 symbols/min [2025-10-27T18:45:07.899049] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:07.915966] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:45:07.951718] [DEBUG] [LOCAL ] FFWM: Loaded 36144 existing records from primary storage. [2025-10-27T18:45:07.951990] [INFO ] [MAIN ] FFWM: Loaded 36144 existing records. [2025-10-27T18:45:08.135794] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:08.136014] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-27T18:45:08.136077] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-27T18:45:08.136377] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-27T18:45:08.136434] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-27T18:45:08.424473] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-27T18:45:08.517480] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:08.642020] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:45:09.064752] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:45:09.214994] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-27T18:45:09.620466] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:45:10.014937] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-27T18:45:10.814946] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-27T18:45:10.865570] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:45:11.614939] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-27T18:45:11.803372] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:45:12.366553] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T18:45:12.414909] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-27T18:45:12.982027] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T18:45:13.214989] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-27T18:45:14.014980] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-27T18:45:14.676744] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T18:45:14.814923] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-27T18:45:14.983226] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:45:15.614946] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-27T18:45:15.737203] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:45:16.414977] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-27T18:45:16.616231] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T18:45:17.165330] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:45:17.214920] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-27T18:45:18.014927] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-27T18:45:18.103412] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T18:45:18.683029] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:45:18.814950] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-27T18:45:19.614957] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-27T18:45:20.123854] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T18:45:20.238985] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T18:45:20.415007] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-27T18:45:21.111448] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T18:45:21.214984] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-27T18:45:21.906349] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T18:45:22.015037] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-27T18:45:22.814971] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-27T18:45:23.014132] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:45:23.615002] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-27T18:45:24.005069] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:45:24.414993] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-27T18:45:24.775766] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T18:45:24.780247] [INFO ] [REMOTE ] FF: Full fetch complete (36243 records). [2025-10-27T18:45:24.780399] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-27T18:45:25.223452] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-27T18:45:25.225985] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-27T18:45:25.226692] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-27T18:45:25.227422] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-27T18:45:25.227562] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-27T18:45:25.228532] [DEBUG] [LOCAL ] FF: Trimmed 36243 records to 23163 (keeping 200 days of data) [2025-10-27T18:45:25.361786] [DEBUG] [LOCAL ] FF: Primary data saved (23163 records). [2025-10-27T18:45:25.361908] [INFO ] [MAIN ] FF: Full history saved. [2025-10-27T18:45:25.361980] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FF took 35.1s. Estimated remaining: 3h 17m 34s. Rate: 7.8 symbols/min [2025-10-27T18:45:25.531123] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:25.551608] [DEBUG] [LOCAL ] FG: Loaded 21546 existing records from primary storage. [2025-10-27T18:45:25.551893] [INFO ] [MAIN ] FG: Loaded 21546 existing records. [2025-10-27T18:45:25.666845] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T18:45:25.748522] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:25.748747] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-27T18:45:25.748799] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-27T18:45:25.748985] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-27T18:45:25.749040] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-27T18:45:26.018673] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-27T18:45:26.106447] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:26.107548] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T18:45:26.814955] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-27T18:45:27.320292] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T18:45:27.322187] [INFO ] [REMOTE ] FFA: Full fetch complete (8599 records). [2025-10-27T18:45:27.322349] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-27T18:45:27.438622] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:45:27.622154] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-27T18:45:27.705064] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-27T18:45:27.705132] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-27T18:45:27.705337] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-27T18:45:27.705373] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-27T18:45:27.705789] [DEBUG] [LOCAL ] FFA: Trimmed 8599 records to 5303 (keeping 200 days of data) [2025-10-27T18:45:27.736742] [DEBUG] [LOCAL ] FFA: Primary data saved (5303 records). [2025-10-27T18:45:27.736858] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-27T18:45:27.736944] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FFA took 23.0s. Estimated remaining: 3h 17m 16s. Rate: 7.8 symbols/min [2025-10-27T18:45:27.901404] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:27.906479] [DEBUG] [LOCAL ] FGN: Loaded 3584 existing records from primary storage. [2025-10-27T18:45:27.906729] [INFO ] [MAIN ] FGN: Loaded 3584 existing records. [2025-10-27T18:45:28.082878] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:28.083123] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-27T18:45:28.083173] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-27T18:45:28.083360] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-27T18:45:28.083415] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-27T18:45:28.266523] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:45:28.420097] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-27T18:45:28.448921] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:29.044224] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:45:29.214937] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-27T18:45:30.014913] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-27T18:45:30.753683] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T18:45:30.780563] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:45:30.814928] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-27T18:45:31.348426] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T18:45:31.614946] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-27T18:45:32.088192] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:45:32.414958] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-27T18:45:33.214932] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-27T18:45:33.744714] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T18:45:33.985542] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T18:45:34.014903] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-27T18:45:34.814910] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-27T18:45:35.091776] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T18:45:35.614945] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-27T18:45:36.137811] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T18:45:36.414985] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-27T18:45:36.756375] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T18:45:36.759858] [INFO ] [REMOTE ] FFC: Full fetch complete (24467 records). [2025-10-27T18:45:36.759935] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-27T18:45:37.118948] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-27T18:45:37.119026] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-27T18:45:37.119809] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-27T18:45:37.119871] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-27T18:45:37.120505] [DEBUG] [LOCAL ] FFC: Trimmed 24467 records to 16365 (keeping 200 days of data) [2025-10-27T18:45:37.214985] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-27T18:45:37.220783] [DEBUG] [LOCAL ] FFC: Primary data saved (16365 records). [2025-10-27T18:45:37.221680] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-27T18:45:37.221793] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFC took 31.1s. Estimated remaining: 3h 17m 12s. Rate: 7.8 symbols/min [2025-10-27T18:45:37.387106] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:37.387301] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-27T18:45:37.387338] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-27T18:45:37.387447] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-27T18:45:37.387489] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-27T18:45:37.387529] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-27T18:45:37.387562] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-27T18:45:37.699826] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:45:37.757352] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:38.014942] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-27T18:45:38.683929] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:45:38.691018] [INFO ] [REMOTE ] FFWM: Full fetch complete (51929 records). [2025-10-27T18:45:38.691155] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-27T18:45:38.820190] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-27T18:45:39.002484] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T18:45:39.107197] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-27T18:45:39.107263] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-27T18:45:39.107965] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-27T18:45:39.108026] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-27T18:45:39.109003] [DEBUG] [LOCAL ] FFWM: Trimmed 51929 records to 35352 (keeping 200 days of data) [2025-10-27T18:45:39.297181] [DEBUG] [LOCAL ] FFWM: Primary data saved (35352 records). [2025-10-27T18:45:39.297315] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-27T18:45:39.297393] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FFWM took 31.6s. Estimated remaining: 3h 16m 53s. Rate: 7.8 symbols/min [2025-10-27T18:45:39.465334] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:39.502016] [DEBUG] [LOCAL ] FHI: Loaded 39980 existing records from primary storage. [2025-10-27T18:45:39.502292] [INFO ] [MAIN ] FHI: Loaded 39980 existing records. [2025-10-27T18:45:39.620071] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-27T18:45:39.683845] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:39.684060] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-27T18:45:39.684108] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-27T18:45:39.684402] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-27T18:45:39.684442] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-27T18:45:40.034050] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:40.041878] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T18:45:40.141534] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:45:40.414929] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-27T18:45:41.214976] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-27T18:45:41.672736] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:45:42.014909] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-27T18:45:42.105931] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T18:45:42.814992] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-27T18:45:43.198639] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:45:43.614944] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-27T18:45:43.623525] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T18:45:44.414989] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-27T18:45:44.999432] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T18:45:45.214924] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-27T18:45:45.374392] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T18:45:45.859305] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:45:46.014994] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-27T18:45:46.386135] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T18:45:46.814948] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-27T18:45:47.531046] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T18:45:47.614936] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-27T18:45:48.414941] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-27T18:45:48.949618] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T18:45:49.028268] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:45:49.214941] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-27T18:45:50.014951] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-27T18:45:50.814947] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-27T18:45:50.891003] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T18:45:51.205499] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:45:51.391152] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T18:45:51.614935] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-27T18:45:52.414963] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-27T18:45:52.861602] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T18:45:53.214951] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-27T18:45:53.534636] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:45:53.991607] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:45:54.014938] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-27T18:45:54.814993] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-27T18:45:54.992542] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:45:55.220150] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:45:55.614976] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-27T18:45:56.194011] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T18:45:56.414951] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-27T18:45:57.214916] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-27T18:45:57.519095] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:45:57.735006] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T18:45:57.736016] [INFO ] [REMOTE ] FGN: Full fetch complete (5405 records). [2025-10-27T18:45:57.736083] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-27T18:45:57.736474] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:45:57.736556] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:45:57.736599] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:45:57.736638] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-27T18:45:57.736741] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-27T18:45:57.736778] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-10-27T18:45:57.736989] [DEBUG] [LOCAL ] FGN: Deleted derivative data file. [2025-10-27T18:45:57.737081] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FGN took 30.0s. Estimated remaining: 3h 17m 6s. Rate: 7.8 symbols/min [2025-10-27T18:45:57.907112] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:45:57.955587] [DEBUG] [LOCAL ] FHN: Loaded 54179 existing records from primary storage. [2025-10-27T18:45:57.955943] [INFO ] [MAIN ] FHN: Loaded 54179 existing records. [2025-10-27T18:45:58.020137] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-27T18:45:58.134196] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:45:58.134417] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-27T18:45:58.134471] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-27T18:45:58.134726] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-27T18:45:58.134783] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-27T18:45:58.480734] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:45:58.814973] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-27T18:45:59.456347] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:45:59.614989] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-27T18:46:00.385401] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T18:46:00.414899] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-27T18:46:00.642431] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T18:46:01.214976] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-27T18:46:02.014923] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-27T18:46:02.185372] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:46:02.189882] [INFO ] [REMOTE ] FG: Full fetch complete (28993 records). [2025-10-27T18:46:02.190043] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-27T18:46:02.558923] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-27T18:46:02.558996] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-27T18:46:02.559510] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-27T18:46:02.559549] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-27T18:46:02.560395] [DEBUG] [LOCAL ] FG: Trimmed 28993 records to 20750 (keeping 200 days of data) [2025-10-27T18:46:02.690677] [DEBUG] [LOCAL ] FG: Primary data saved (20750 records). [2025-10-27T18:46:02.690818] [INFO ] [MAIN ] FG: Full history saved. [2025-10-27T18:46:02.690904] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FG took 37.3s. Estimated remaining: 3h 16m 53s. Rate: 7.8 symbols/min [2025-10-27T18:46:02.820062] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-27T18:46:02.881791] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:02.939378] [DEBUG] [LOCAL ] FI: Loaded 54355 existing records from primary storage. [2025-10-27T18:46:02.939793] [INFO ] [MAIN ] FI: Loaded 54355 existing records. [2025-10-27T18:46:03.120211] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:03.120865] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-27T18:46:03.121130] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-27T18:46:03.121899] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-27T18:46:03.121958] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-27T18:46:03.379264] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T18:46:03.451192] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:46:03.544229] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:46:03.563995] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:03.614899] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-27T18:46:04.415008] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-27T18:46:04.771452] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T18:46:05.214993] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-27T18:46:05.566337] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:46:06.014947] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-27T18:46:06.814982] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-27T18:46:06.988562] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T18:46:07.178602] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-27T18:46:07.522022] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:46:07.614960] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-27T18:46:08.414961] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-27T18:46:09.008533] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:46:09.215012] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-27T18:46:09.823694] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:46:09.825126] [INFO ] [REMOTE ] FGSN: Full fetch complete (8140 records). [2025-10-27T18:46:09.825221] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-27T18:46:10.023568] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-27T18:46:10.050025] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T18:46:10.050740] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:46:10.050883] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:46:10.050961] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-27T18:46:10.051147] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-27T18:46:10.051215] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-27T18:46:10.051262] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-27T18:46:10.051366] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FGSN took 32.8s. Estimated remaining: 3h 16m 45s. Rate: 7.8 symbols/min [2025-10-27T18:46:10.273828] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:10.319754] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T18:46:10.351593] [DEBUG] [LOCAL ] FICO: Loaded 22292 existing records from primary storage. [2025-10-27T18:46:10.352001] [INFO ] [MAIN ] FICO: Loaded 22292 existing records. [2025-10-27T18:46:10.531633] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:10.531878] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-27T18:46:10.531924] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-27T18:46:10.532141] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-27T18:46:10.532197] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-27T18:46:10.820111] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-27T18:46:10.879614] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:11.475742] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:46:11.614952] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-27T18:46:12.279706] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:46:12.421941] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-27T18:46:12.425346] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:46:13.214965] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-27T18:46:13.942630] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T18:46:14.014953] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-27T18:46:14.773634] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T18:46:14.780579] [INFO ] [REMOTE ] FHI: Full fetch complete (57411 records). [2025-10-27T18:46:14.780710] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-27T18:46:14.820115] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-27T18:46:15.189180] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-27T18:46:15.189268] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-27T18:46:15.190082] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-27T18:46:15.190142] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-27T18:46:15.191283] [DEBUG] [LOCAL ] FHI: Trimmed 57411 records to 39290 (keeping 200 days of data) [2025-10-27T18:46:15.431381] [DEBUG] [LOCAL ] FHI: Primary data saved (39290 records). [2025-10-27T18:46:15.431502] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-27T18:46:15.431576] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FHI took 36.1s. Estimated remaining: 3h 16m 33s. Rate: 7.8 symbols/min [2025-10-27T18:46:15.609411] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:15.609669] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-27T18:46:15.609724] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-27T18:46:15.609834] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-27T18:46:15.609874] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-27T18:46:15.609914] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-27T18:46:15.609945] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-27T18:46:15.643859] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-27T18:46:16.003269] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:16.010136] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T18:46:16.043371] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T18:46:16.414938] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-27T18:46:17.196551] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T18:46:17.214909] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-27T18:46:17.568541] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T18:46:18.014975] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-27T18:46:18.320264] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-27T18:46:18.587092] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T18:46:18.814946] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-27T18:46:19.614929] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-27T18:46:19.881460] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T18:46:20.414999] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-27T18:46:20.924767] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:46:21.214957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-27T18:46:21.329707] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T18:46:21.616035] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:46:22.014937] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-27T18:46:22.814953] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-27T18:46:23.614981] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-27T18:46:23.669031] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T18:46:23.949689] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:46:24.022555] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:46:24.414920] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-27T18:46:25.214962] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-27T18:46:26.014929] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-27T18:46:26.081683] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T18:46:26.091899] [INFO ] [REMOTE ] FHN: Full fetch complete (77481 records). [2025-10-27T18:46:26.092036] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-27T18:46:26.365994] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T18:46:26.511190] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-27T18:46:26.511755] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-27T18:46:26.512328] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T18:46:26.518692] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-27T18:46:26.519213] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-27T18:46:26.520554] [DEBUG] [LOCAL ] FHN: Trimmed 77481 records to 53398 (keeping 200 days of data) [2025-10-27T18:46:26.815995] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-27T18:46:26.835728] [DEBUG] [LOCAL ] FHN: Primary data saved (53398 records). [2025-10-27T18:46:26.835810] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-27T18:46:26.835881] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FHN took 29.1s. Estimated remaining: 3h 16m 32s. Rate: 7.8 symbols/min [2025-10-27T18:46:27.003522] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:27.045090] [DEBUG] [LOCAL ] FIGS: Loaded 49150 existing records from primary storage. [2025-10-27T18:46:27.045396] [INFO ] [MAIN ] FIGS: Loaded 49150 existing records. [2025-10-27T18:46:27.220905] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:27.221113] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-27T18:46:27.221180] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-27T18:46:27.221365] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-27T18:46:27.221403] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-27T18:46:27.565237] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:27.614930] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-27T18:46:28.414965] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-27T18:46:28.742074] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-27T18:46:28.744793] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:46:29.186368] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T18:46:29.214903] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-27T18:46:30.014939] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-27T18:46:30.217270] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:46:30.217627] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-27T18:46:30.217732] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:46:30.217804] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-27T18:46:30.217868] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:46:30.217934] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-27T18:46:30.217998] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-27T18:46:30.218032] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-27T18:46:30.218070] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-27T18:46:30.218114] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FIG took 14.8s. Estimated remaining: 3h 16m 16s. Rate: 7.8 symbols/min [2025-10-27T18:46:30.384672] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:30.422076] [DEBUG] [LOCAL ] FIHL: Loaded 39562 existing records from primary storage. [2025-10-27T18:46:30.422519] [INFO ] [MAIN ] FIHL: Loaded 39562 existing records. [2025-10-27T18:46:30.547736] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T18:46:30.635958] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:30.636163] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-27T18:46:30.636219] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-27T18:46:30.636522] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-27T18:46:30.636577] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-27T18:46:30.820235] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-27T18:46:31.002968] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:31.614935] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-27T18:46:32.414994] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-27T18:46:32.541996] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T18:46:33.214999] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-27T18:46:33.371056] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:46:33.397290] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:46:34.014928] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-27T18:46:34.607537] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:46:34.814990] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-27T18:46:35.614925] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-27T18:46:35.809048] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:46:36.003999] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:46:36.414898] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-27T18:46:36.448954] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:46:37.214986] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-27T18:46:38.014965] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-27T18:46:38.448930] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-27T18:46:38.785189] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:46:38.814901] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-27T18:46:38.945918] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T18:46:39.614920] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-27T18:46:40.373867] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:46:40.384595] [INFO ] [REMOTE ] FI: Full fetch complete (77498 records). [2025-10-27T18:46:40.384804] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-27T18:46:40.420229] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-27T18:46:40.783181] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T18:46:40.816740] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-27T18:46:40.817189] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-27T18:46:40.818204] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-27T18:46:40.818268] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-27T18:46:40.819601] [DEBUG] [LOCAL ] FI: Trimmed 77498 records to 53574 (keeping 200 days of data) [2025-10-27T18:46:41.135182] [DEBUG] [LOCAL ] FI: Primary data saved (53574 records). [2025-10-27T18:46:41.135320] [INFO ] [MAIN ] FI: Full history saved. [2025-10-27T18:46:41.136143] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FI took 38.4s. Estimated remaining: 3h 16m 15s. Rate: 7.8 symbols/min [2025-10-27T18:46:41.223793] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-27T18:46:41.305011] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:41.317124] [DEBUG] [LOCAL ] FINS: Loaded 8341 existing records from primary storage. [2025-10-27T18:46:41.317348] [INFO ] [MAIN ] FINS: Loaded 8341 existing records. [2025-10-27T18:46:41.490811] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:41.491028] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-27T18:46:41.491076] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-27T18:46:41.491231] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-27T18:46:41.491288] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-27T18:46:41.848142] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:41.863922] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T18:46:41.869213] [INFO ] [REMOTE ] FICO: Full fetch complete (30175 records). [2025-10-27T18:46:41.869301] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-27T18:46:42.020067] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-27T18:46:42.254348] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-27T18:46:42.254427] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-27T18:46:42.255117] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-27T18:46:42.255178] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-27T18:46:42.255922] [DEBUG] [LOCAL ] FICO: Trimmed 30175 records to 21863 (keeping 200 days of data) [2025-10-27T18:46:42.388343] [DEBUG] [LOCAL ] FICO: Primary data saved (21863 records). [2025-10-27T18:46:42.388475] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-27T18:46:42.388554] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FICO took 32.3s. Estimated remaining: 3h 15m 55s. Rate: 7.8 symbols/min [2025-10-27T18:46:42.559304] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:42.601447] [DEBUG] [LOCAL ] FINV: Loaded 45901 existing records from primary storage. [2025-10-27T18:46:42.601780] [INFO ] [MAIN ] FINV: Loaded 45901 existing records. [2025-10-27T18:46:42.775795] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:42.775987] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-27T18:46:42.776040] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-27T18:46:42.776436] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-27T18:46:42.776493] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-27T18:46:42.821501] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-27T18:46:43.187379] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:43.192428] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T18:46:43.345939] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T18:46:43.427367] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T18:46:43.614945] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-27T18:46:44.414980] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-27T18:46:45.186868] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T18:46:45.214898] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-27T18:46:45.452334] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T18:46:45.876877] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T18:46:46.014933] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-27T18:46:46.807884] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T18:46:46.814886] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-27T18:46:47.607743] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:46:47.614901] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-27T18:46:48.379914] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T18:46:48.414925] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-27T18:46:48.933577] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T18:46:49.214957] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-27T18:46:50.014938] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-27T18:46:50.610317] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T18:46:50.814937] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-27T18:46:51.193228] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:46:51.437064] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T18:46:51.614917] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-27T18:46:52.414933] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-27T18:46:52.447777] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:46:53.214944] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-27T18:46:53.559172] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T18:46:54.015007] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-27T18:46:54.661395] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:46:54.814943] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-27T18:46:55.615039] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-27T18:46:55.995481] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:46:56.005892] [INFO ] [REMOTE ] FIGS: Full fetch complete (70740 records). [2025-10-27T18:46:56.006094] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-27T18:46:56.332807] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T18:46:56.423007] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-27T18:46:56.440104] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-27T18:46:56.441083] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-27T18:46:56.441996] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-27T18:46:56.442187] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-27T18:46:56.443502] [DEBUG] [LOCAL ] FIGS: Trimmed 70740 records to 48361 (keeping 200 days of data) [2025-10-27T18:46:56.707004] [DEBUG] [LOCAL ] FIGS: Primary data saved (48361 records). [2025-10-27T18:46:56.707152] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-27T18:46:56.707250] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIGS took 29.9s. Estimated remaining: 3h 15m 60s. Rate: 7.8 symbols/min [2025-10-27T18:46:56.886442] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:56.937814] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T18:46:56.966145] [DEBUG] [LOCAL ] FIS: Loaded 54105 existing records from primary storage. [2025-10-27T18:46:56.970952] [INFO ] [MAIN ] FIS: Loaded 54105 existing records. [2025-10-27T18:46:56.970846] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T18:46:57.028409] [INFO ] [REMOTE ] FINS: Full fetch complete (11547 records). [2025-10-27T18:46:57.042989] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-27T18:46:57.219786] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-27T18:46:57.260195] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:57.260966] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-27T18:46:57.261773] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-27T18:46:57.287983] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-27T18:46:57.305670] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-27T18:46:57.815727] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-27T18:46:57.816055] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-27T18:46:57.821720] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-27T18:46:57.826922] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-27T18:46:57.868293] [DEBUG] [LOCAL ] FINS: Trimmed 11547 records to 8194 (keeping 200 days of data) [2025-10-27T18:46:57.898453] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:57.948258] [DEBUG] [LOCAL ] FINS: Primary data saved (8194 records). [2025-10-27T18:46:57.948373] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-27T18:46:57.948451] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FINS took 16.8s. Estimated remaining: 3h 15m 40s. Rate: 7.8 symbols/min [2025-10-27T18:46:58.023386] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-27T18:46:58.121561] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:46:58.148140] [DEBUG] [LOCAL ] FIX: Loaded 28996 existing records from primary storage. [2025-10-27T18:46:58.148543] [INFO ] [MAIN ] FIX: Loaded 28996 existing records. [2025-10-27T18:46:58.331117] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:46:58.331477] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-27T18:46:58.331548] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-27T18:46:58.331927] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-27T18:46:58.331985] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-27T18:46:58.533201] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T18:46:58.717941] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:46:58.814907] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-27T18:46:59.607794] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:46:59.617682] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-27T18:47:00.050067] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T18:47:00.414998] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-27T18:47:01.214971] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-27T18:47:01.361442] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T18:47:02.014983] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-27T18:47:02.524974] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-27T18:47:02.815028] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-27T18:47:02.976124] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:47:03.403825] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:47:03.614957] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-27T18:47:04.128273] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:47:04.414988] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-27T18:47:05.214936] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-27T18:47:05.373669] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T18:47:05.530455] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T18:47:06.015001] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-27T18:47:06.435298] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:47:06.814931] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-27T18:47:07.614916] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-27T18:47:07.870521] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T18:47:08.010555] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T18:47:08.414955] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-27T18:47:09.074438] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T18:47:09.214936] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-27T18:47:09.865099] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:47:10.014972] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-27T18:47:10.679970] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:47:10.814932] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-27T18:47:11.279791] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T18:47:11.614996] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-27T18:47:12.195747] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T18:47:12.203056] [INFO ] [REMOTE ] FIHL: Full fetch complete (56309 records). [2025-10-27T18:47:12.203189] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-27T18:47:12.425196] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-27T18:47:12.590186] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-27T18:47:12.590266] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-27T18:47:12.591016] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-27T18:47:12.591079] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-27T18:47:12.592280] [DEBUG] [LOCAL ] FIHL: Trimmed 56309 records to 38701 (keeping 200 days of data) [2025-10-27T18:47:12.836743] [DEBUG] [LOCAL ] FIHL: Primary data saved (38701 records). [2025-10-27T18:47:12.836902] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-27T18:47:12.836987] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIHL took 42.6s. Estimated remaining: 3h 15m 46s. Rate: 7.8 symbols/min [2025-10-27T18:47:13.214972] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-27T18:47:13.443002] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T18:47:13.842727] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:47:14.014918] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-27T18:47:14.272299] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T18:47:14.814989] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-27T18:47:15.582206] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:47:15.614907] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-27T18:47:15.825509] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:47:16.415019] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-27T18:47:17.214983] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-27T18:47:17.281322] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T18:47:17.873247] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T18:47:18.014930] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-27T18:47:18.503675] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T18:47:18.814918] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-27T18:47:19.614979] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-27T18:47:19.901184] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T18:47:19.910491] [INFO ] [REMOTE ] FINV: Full fetch complete (65014 records). [2025-10-27T18:47:19.910703] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-27T18:47:20.338924] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-27T18:47:20.339043] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-27T18:47:20.339980] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-27T18:47:20.340047] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-27T18:47:20.341378] [DEBUG] [LOCAL ] FINV: Trimmed 65014 records to 45169 (keeping 200 days of data) [2025-10-27T18:47:20.622447] [DEBUG] [LOCAL ] FINV: Primary data saved (45169 records). [2025-10-27T18:47:20.622672] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-27T18:47:20.623275] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FINV took 38.2s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-10-27T18:47:20.657979] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:47:20.669580] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-27T18:47:20.851021] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T18:47:20.859405] [INFO ] [REMOTE ] FIX: Full fetch complete (45706 records). [2025-10-27T18:47:20.859547] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-27T18:47:21.234487] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-27T18:47:21.234598] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-27T18:47:21.235308] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-27T18:47:21.235369] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-27T18:47:21.236341] [DEBUG] [LOCAL ] FIX: Trimmed 45706 records to 28309 (keeping 200 days of data) [2025-10-27T18:47:21.406109] [DEBUG] [LOCAL ] FIX: Primary data saved (28309 records). [2025-10-27T18:47:21.406228] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-27T18:47:21.406302] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIX took 23.5s. Estimated remaining: 3h 15m 18s. Rate: 7.8 symbols/min [2025-10-27T18:47:22.188095] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T18:47:22.199179] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-27T18:47:24.010087] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T18:47:24.021497] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-27T18:47:24.776550] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:47:24.786618] [INFO ] [REMOTE ] FIS: Full fetch complete (77397 records). [2025-10-27T18:47:24.786749] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-27T18:47:25.173115] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-27T18:47:25.173189] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-27T18:47:25.174082] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-27T18:47:25.174144] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-27T18:47:25.175508] [DEBUG] [LOCAL ] FIS: Trimmed 77397 records to 53324 (keeping 200 days of data) [2025-10-27T18:47:25.492896] [DEBUG] [LOCAL ] FIS: Primary data saved (53324 records). [2025-10-27T18:47:25.493041] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-27T18:47:25.493148] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIS took 28.8s. Estimated remaining: 3h 15m 4s. Rate: 7.8 symbols/min [2025-10-27T18:47:26.159715] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.187028] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.187863] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.188947] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:26.189293] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-27T18:47:26.189794] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-27T18:47:26.190031] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-27T18:47:26.190092] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-27T18:47:26.190138] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-27T18:47:26.190171] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-27T18:47:26.305955] [DEBUG] [LOCAL ] FLC: Loaded 5477 existing records from primary storage. [2025-10-27T18:47:26.349260] [INFO ] [MAIN ] FLC: Loaded 5477 existing records. [2025-10-27T18:47:26.577981] [DEBUG] [LOCAL ] FLNG: Loaded 33679 existing records from primary storage. [2025-10-27T18:47:26.611276] [INFO ] [MAIN ] FLNG: Loaded 33679 existing records. [2025-10-27T18:47:26.645976] [DEBUG] [LOCAL ] FLG: Loaded 54097 existing records from primary storage. [2025-10-27T18:47:26.719004] [INFO ] [MAIN ] FLG: Loaded 54097 existing records. [2025-10-27T18:47:26.912417] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:26.971367] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-27T18:47:26.943312] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:26.982153] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.021429] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-27T18:47:27.064621] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-27T18:47:27.093814] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-27T18:47:27.145105] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:27.207608] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.207510] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:27.217995] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-27T18:47:27.223559] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-27T18:47:27.223495] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-27T18:47:27.223721] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-27T18:47:27.223773] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-27T18:47:27.231207] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-27T18:47:27.256028] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-27T18:47:27.276827] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T18:47:27.328779] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-27T18:47:27.450155] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:47:27.506853] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-27T18:47:27.517807] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:47:27.564250] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-27T18:47:27.606026] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-27T18:47:27.678416] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-27T18:47:27.769354] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-27T18:47:27.795355] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FIXT took 2.3s. Estimated remaining: 3h 14m 47s. Rate: 7.8 symbols/min [2025-10-27T18:47:28.266794] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.303115] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-27T18:47:28.413088] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:28.399839] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.429277] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-27T18:47:28.484460] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:28.484886] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-27T18:47:28.531636] [DEBUG] [LOCAL ] FLO: Loaded 52834 existing records from primary storage. [2025-10-27T18:47:28.531964] [INFO ] [MAIN ] FLO: Loaded 52834 existing records. [2025-10-27T18:47:28.704413] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:28.704634] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-27T18:47:28.704716] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-27T18:47:28.704923] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-27T18:47:28.704977] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-27T18:47:28.923553] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T18:47:28.957199] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-27T18:47:29.068247] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:29.068541] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-27T18:47:29.433738] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T18:47:29.435961] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-27T18:47:29.552557] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T18:47:29.559813] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-27T18:47:29.771600] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:47:29.782242] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-27T18:47:30.054607] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T18:47:30.056525] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-27T18:47:30.145249] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T18:47:30.481530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T18:47:30.553394] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T18:47:30.814916] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-27T18:47:31.352277] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T18:47:31.614954] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-27T18:47:32.046334] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:47:32.414991] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-27T18:47:33.013911] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:47:33.214938] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-27T18:47:33.768721] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T18:47:33.768975] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:47:34.014944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-27T18:47:34.623090] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:47:34.814944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-27T18:47:35.273713] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T18:47:35.614948] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-27T18:47:36.414965] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-27T18:47:36.628546] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T18:47:37.214959] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-27T18:47:38.014984] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-27T18:47:38.233522] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T18:47:38.496055] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T18:47:38.574142] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T18:47:38.814944] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-27T18:47:39.250181] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T18:47:39.614992] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-27T18:47:40.414940] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-27T18:47:41.171155] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:47:41.173070] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T18:47:41.174768] [INFO ] [REMOTE ] FLC: Full fetch complete (7816 records). [2025-10-27T18:47:41.185082] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-27T18:47:41.220019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-27T18:47:41.579301] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-27T18:47:41.579379] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-27T18:47:41.579571] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-27T18:47:41.579609] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-27T18:47:41.580010] [DEBUG] [LOCAL ] FLC: Trimmed 7816 records to 5167 (keeping 200 days of data) [2025-10-27T18:47:41.611241] [DEBUG] [LOCAL ] FLC: Primary data saved (5167 records). [2025-10-27T18:47:41.611339] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-27T18:47:41.611413] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLC took 16.1s. Estimated remaining: 3h 14m 50s. Rate: 7.8 symbols/min [2025-10-27T18:47:41.786167] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:41.786353] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-27T18:47:41.786402] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-27T18:47:41.786510] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-27T18:47:41.786552] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-27T18:47:41.786591] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-27T18:47:41.786622] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-27T18:47:42.023577] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-27T18:47:42.137235] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:42.478781] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T18:47:42.814994] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-27T18:47:43.465714] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:47:43.614927] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-27T18:47:44.267877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T18:47:44.414925] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-27T18:47:45.214947] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-27T18:47:45.282520] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T18:47:45.775545] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T18:47:46.014931] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-27T18:47:46.814907] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-27T18:47:47.021033] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T18:47:47.092365] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T18:47:47.614932] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-27T18:47:48.414973] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-27T18:47:48.576461] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:47:49.214945] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-27T18:47:49.557341] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:47:49.593504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T18:47:50.014934] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-27T18:47:50.324716] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:47:50.814939] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-27T18:47:51.614936] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-27T18:47:51.788961] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:47:51.917677] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T18:47:52.414944] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-27T18:47:53.214935] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-27T18:47:53.456769] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T18:47:53.725140] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:47:54.014943] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-27T18:47:54.556569] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T18:47:54.562867] [INFO ] [REMOTE ] FLNG: Full fetch complete (49710 records). [2025-10-27T18:47:54.562993] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-27T18:47:54.820050] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-27T18:47:55.013505] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-27T18:47:55.013616] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-27T18:47:55.014741] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-27T18:47:55.014829] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-27T18:47:55.016404] [DEBUG] [LOCAL ] FLNG: Trimmed 49710 records to 32921 (keeping 200 days of data) [2025-10-27T18:47:55.238846] [DEBUG] [LOCAL ] FLNG: Primary data saved (32921 records). [2025-10-27T18:47:55.238991] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-27T18:47:55.239099] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLNG took 29.7s. Estimated remaining: 3h 14m 53s. Rate: 7.8 symbols/min [2025-10-27T18:47:55.458213] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:47:55.510813] [DEBUG] [LOCAL ] FLR: Loaded 54025 existing records from primary storage. [2025-10-27T18:47:55.511188] [INFO ] [MAIN ] FLR: Loaded 54025 existing records. [2025-10-27T18:47:55.620118] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-27T18:47:55.743777] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:47:55.744168] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-27T18:47:55.744291] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-27T18:47:55.744562] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-27T18:47:55.744675] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-27T18:47:55.967517] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:47:56.200638] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:47:56.220375] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:47:56.414948] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-27T18:47:57.214995] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-27T18:47:57.348159] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T18:47:57.724860] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T18:47:58.014920] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-27T18:47:58.814903] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-27T18:47:58.867183] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T18:47:58.877085] [INFO ] [REMOTE ] FLO: Full fetch complete (75403 records). [2025-10-27T18:47:58.877188] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-27T18:47:59.260457] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-27T18:47:59.260563] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-27T18:47:59.261476] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-27T18:47:59.261551] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-27T18:47:59.263034] [DEBUG] [LOCAL ] FLO: Trimmed 75403 records to 52066 (keeping 200 days of data) [2025-10-27T18:47:59.572551] [DEBUG] [LOCAL ] FLO: Primary data saved (52066 records). [2025-10-27T18:47:59.572717] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-27T18:47:59.572936] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 31.7s. Estimated remaining: 3h 14m 39s. Rate: 7.8 symbols/min [2025-10-27T18:47:59.626017] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-27T18:47:59.675946] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:47:59.712952] [INFO ] [REMOTE ] FLG: Full fetch complete (77426 records). [2025-10-27T18:47:59.718727] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-27T18:47:59.887009] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:00.177073] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-27T18:48:00.191613] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-27T18:48:00.193263] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-27T18:48:00.193437] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-27T18:48:00.215345] [DEBUG] [LOCAL ] FLG: Trimmed 77426 records to 53317 (keeping 200 days of data) [2025-10-27T18:48:00.216551] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T18:48:00.300135] [DEBUG] [LOCAL ] FLS: Loaded 51134 existing records from primary storage. [2025-10-27T18:48:00.326324] [INFO ] [MAIN ] FLS: Loaded 51134 existing records. [2025-10-27T18:48:00.422035] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-27T18:48:00.626685] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:00.630324] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-27T18:48:00.634704] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-27T18:48:00.641948] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-27T18:48:00.642451] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-27T18:48:01.016344] [DEBUG] [LOCAL ] FLG: Primary data saved (53317 records). [2025-10-27T18:48:01.026430] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-27T18:48:01.027743] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLG took 35.5s. Estimated remaining: 3h 14m 21s. Rate: 7.8 symbols/min [2025-10-27T18:48:01.210529] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:01.216722] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-27T18:48:01.282351] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:01.330611] [DEBUG] [LOCAL ] FLUT: Loaded 51394 existing records from primary storage. [2025-10-27T18:48:01.330922] [INFO ] [MAIN ] FLUT: Loaded 51394 existing records. [2025-10-27T18:48:01.542495] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:01.545110] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T18:48:01.543327] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-27T18:48:01.545344] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-27T18:48:01.555728] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-27T18:48:01.555832] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-27T18:48:01.825980] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:48:02.015896] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:02.016003] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-27T18:48:02.814975] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-27T18:48:02.942287] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T18:48:03.614930] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-27T18:48:03.737965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T18:48:04.088110] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T18:48:04.414970] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-27T18:48:05.013562] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:48:05.214917] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-27T18:48:05.463697] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T18:48:06.015003] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-27T18:48:06.815043] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-27T18:48:06.892038] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T18:48:07.533350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:48:07.615019] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-27T18:48:08.229851] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:48:08.415015] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-27T18:48:09.214937] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-27T18:48:09.319862] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T18:48:10.016221] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:48:10.016567] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-27T18:48:10.055225] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T18:48:10.815027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-27T18:48:11.614957] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-27T18:48:11.975389] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T18:48:12.259291] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:48:12.414963] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-27T18:48:12.598936] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:48:12.604280] [INFO ] [REMOTE ] FLOC: Full fetch complete (41562 records). [2025-10-27T18:48:12.604381] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-27T18:48:12.785434] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T18:48:12.785943] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:48:12.786013] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:48:12.786081] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-27T18:48:12.786144] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-27T18:48:12.786180] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-27T18:48:12.786219] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-27T18:48:12.786275] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLOC took 31.2s. Estimated remaining: 3h 14m 20s. Rate: 7.8 symbols/min [2025-10-27T18:48:12.948544] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:12.969623] [DEBUG] [LOCAL ] FLXR: Loaded 21785 existing records from primary storage. [2025-10-27T18:48:12.969907] [INFO ] [MAIN ] FLXR: Loaded 21785 existing records. [2025-10-27T18:48:13.146779] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:13.146962] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-27T18:48:13.147011] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-27T18:48:13.147177] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-27T18:48:13.147233] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-27T18:48:13.220019] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-27T18:48:13.491860] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:14.014930] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-27T18:48:14.183581] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:48:14.814963] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-27T18:48:14.846518] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T18:48:15.502208] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:48:15.615904] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-27T18:48:15.616972] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T18:48:16.414984] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-27T18:48:17.214987] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-27T18:48:17.296501] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T18:48:17.810255] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T18:48:18.014926] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-27T18:48:18.472455] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-27T18:48:18.695883] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T18:48:18.814966] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-27T18:48:19.614934] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-27T18:48:20.414917] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-27T18:48:20.524363] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T18:48:21.020331] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T18:48:21.214911] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-27T18:48:21.258877] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:48:22.014950] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-27T18:48:22.814993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-27T18:48:22.970990] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T18:48:23.614908] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-27T18:48:23.655401] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:48:24.414934] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-27T18:48:24.766672] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T18:48:25.215273] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:48:25.215361] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-27T18:48:25.652725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T18:48:25.991327] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T18:48:26.014898] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-27T18:48:26.652677] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T18:48:26.814953] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-27T18:48:27.614933] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-27T18:48:28.414946] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-27T18:48:28.614778] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T18:48:29.225182] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-27T18:48:29.231317] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:48:29.797481] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T18:48:30.014907] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-27T18:48:30.320245] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:48:30.814989] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-27T18:48:31.592124] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:48:31.601806] [INFO ] [REMOTE ] FLS: Full fetch complete (72597 records). [2025-10-27T18:48:31.601933] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-27T18:48:31.622501] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-27T18:48:31.978002] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T18:48:32.040352] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-27T18:48:32.040425] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-27T18:48:32.041338] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-27T18:48:32.041401] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-27T18:48:32.042727] [DEBUG] [LOCAL ] FLS: Trimmed 72597 records to 50378 (keeping 200 days of data) [2025-10-27T18:48:32.337524] [DEBUG] [LOCAL ] FLS: Primary data saved (50378 records). [2025-10-27T18:48:32.337670] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-27T18:48:32.337765] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 32.8s. Estimated remaining: 3h 14m 34s. Rate: 7.8 symbols/min [2025-10-27T18:48:32.420214] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-27T18:48:32.517047] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:32.566220] [DEBUG] [LOCAL ] FMC: Loaded 52635 existing records from primary storage. [2025-10-27T18:48:32.566516] [INFO ] [MAIN ] FMC: Loaded 52635 existing records. [2025-10-27T18:48:32.770033] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:32.770268] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-27T18:48:32.770331] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-27T18:48:32.770842] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-27T18:48:32.770901] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-27T18:48:33.128596] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:33.214902] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-27T18:48:33.331303] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T18:48:33.341507] [INFO ] [REMOTE ] FLUT: Full fetch complete (73379 records). [2025-10-27T18:48:33.341722] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-27T18:48:33.722002] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-27T18:48:33.722093] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-27T18:48:33.722986] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-27T18:48:33.723050] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-27T18:48:33.724469] [DEBUG] [LOCAL ] FLUT: Trimmed 73379 records to 50601 (keeping 200 days of data) [2025-10-27T18:48:34.023091] [DEBUG] [LOCAL ] FLUT: Primary data saved (50601 records). [2025-10-27T18:48:34.022972] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-27T18:48:34.024260] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-27T18:48:34.024997] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLUT took 33.0s. Estimated remaining: 3h 14m 15s. Rate: 7.8 symbols/min [2025-10-27T18:48:34.198381] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:34.206409] [DEBUG] [LOCAL ] FMN: Loaded 5508 existing records from primary storage. [2025-10-27T18:48:34.206610] [INFO ] [MAIN ] FMN: Loaded 5508 existing records. [2025-10-27T18:48:34.388288] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:34.388689] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-27T18:48:34.388795] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-27T18:48:34.389068] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-27T18:48:34.389190] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-27T18:48:34.523829] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T18:48:34.721512] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:48:34.802146] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:34.814895] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-27T18:48:35.349315] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T18:48:35.430980] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T18:48:35.614925] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-27T18:48:36.414968] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-27T18:48:37.214957] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-27T18:48:37.547528] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T18:48:37.599056] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T18:48:37.604312] [INFO ] [REMOTE ] FLXR: Full fetch complete (27988 records). [2025-10-27T18:48:37.604409] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-27T18:48:37.894540] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T18:48:37.982758] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-27T18:48:37.982847] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-27T18:48:37.983368] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-27T18:48:37.983408] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-27T18:48:37.984252] [DEBUG] [LOCAL ] FLXR: Trimmed 27988 records to 21635 (keeping 200 days of data) [2025-10-27T18:48:38.034502] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-27T18:48:38.111378] [DEBUG] [LOCAL ] FLXR: Primary data saved (21635 records). [2025-10-27T18:48:38.111488] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-27T18:48:38.111572] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FLXR took 25.3s. Estimated remaining: 3h 14m 1s. Rate: 7.8 symbols/min [2025-10-27T18:48:38.278360] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:38.307111] [DEBUG] [LOCAL ] FMS: Loaded 30723 existing records from primary storage. [2025-10-27T18:48:38.307370] [INFO ] [MAIN ] FMS: Loaded 30723 existing records. [2025-10-27T18:48:38.480883] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:38.481063] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-27T18:48:38.481108] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-27T18:48:38.481277] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-27T18:48:38.481314] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-27T18:48:38.821684] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-27T18:48:38.842539] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:38.886144] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T18:48:39.614940] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-27T18:48:40.414914] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-27T18:48:40.603009] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:48:40.808883] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:48:41.214953] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-27T18:48:42.014900] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-27T18:48:42.427315] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T18:48:42.529352] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T18:48:42.539753] [INFO ] [REMOTE ] FLR: Full fetch complete (76921 records). [2025-10-27T18:48:42.539896] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-27T18:48:42.814973] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-27T18:48:42.934781] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-27T18:48:42.934882] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-27T18:48:42.935881] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-27T18:48:42.936025] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-27T18:48:42.937627] [DEBUG] [LOCAL ] FLR: Trimmed 76921 records to 53242 (keeping 200 days of data) [2025-10-27T18:48:43.050426] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:48:43.282850] [DEBUG] [LOCAL ] FLR: Primary data saved (53242 records). [2025-10-27T18:48:43.282989] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-27T18:48:43.283086] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FLR took 48.0s. Estimated remaining: 3h 13m 49s. Rate: 7.8 symbols/min [2025-10-27T18:48:43.462166] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:43.499374] [DEBUG] [LOCAL ] FMX: Loaded 40863 existing records from primary storage. [2025-10-27T18:48:43.499688] [INFO ] [MAIN ] FMX: Loaded 40863 existing records. [2025-10-27T18:48:43.620037] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-27T18:48:43.683790] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:43.684178] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-27T18:48:43.684242] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-27T18:48:43.684691] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-27T18:48:43.684749] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-27T18:48:44.069388] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:44.082905] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T18:48:44.414933] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-27T18:48:45.214941] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-27T18:48:45.481460] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T18:48:45.522957] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T18:48:45.668985] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T18:48:46.014939] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-27T18:48:46.814962] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-27T18:48:47.527778] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T18:48:47.614919] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-27T18:48:48.227438] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T18:48:48.414975] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-27T18:48:49.214921] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-27T18:48:49.257497] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T18:48:49.601521] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:48:49.903401] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T18:48:50.014919] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-27T18:48:50.652244] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:48:50.814919] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-27T18:48:51.615001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-27T18:48:52.166281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T18:48:52.206524] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T18:48:52.415001] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-27T18:48:53.215003] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-27T18:48:53.979726] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:48:54.014927] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-27T18:48:54.505488] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:48:54.814941] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-27T18:48:55.463002] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T18:48:55.529250] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T18:48:55.614902] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-27T18:48:56.414979] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-27T18:48:57.214951] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-27T18:48:57.428916] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T18:48:57.439671] [INFO ] [REMOTE ] FMC: Full fetch complete (75427 records). [2025-10-27T18:48:57.439799] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-27T18:48:57.897507] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-27T18:48:57.897974] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-27T18:48:57.899048] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T18:48:57.900074] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-27T18:48:57.905889] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-27T18:48:57.908035] [DEBUG] [LOCAL ] FMC: Trimmed 75427 records to 51842 (keeping 200 days of data) [2025-10-27T18:48:58.016550] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-27T18:48:58.247675] [DEBUG] [LOCAL ] FMC: Primary data saved (51842 records). [2025-10-27T18:48:58.247822] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-27T18:48:58.247945] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMC took 25.9s. Estimated remaining: 3h 13m 54s. Rate: 7.8 symbols/min [2025-10-27T18:48:58.439598] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:48:58.462877] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:48:58.473273] [DEBUG] [LOCAL ] FMY: Loaded 1371 existing records from primary storage. [2025-10-27T18:48:58.473432] [INFO ] [MAIN ] FMY: Loaded 1371 existing records. [2025-10-27T18:48:58.677716] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:48:58.677907] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-27T18:48:58.677954] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-27T18:48:58.678076] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-27T18:48:58.678116] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-27T18:48:58.820142] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-27T18:48:59.090278] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:48:59.105308] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T18:48:59.614982] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-27T18:49:00.042675] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T18:49:00.415012] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-27T18:49:00.835585] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T18:49:01.056837] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:49:01.214956] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-27T18:49:01.760674] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T18:49:02.014926] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-27T18:49:02.814995] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-27T18:49:03.358690] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:49:03.407541] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:49:03.614953] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-27T18:49:04.414928] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-27T18:49:04.768692] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T18:49:04.790456] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T18:49:05.214927] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-27T18:49:06.015004] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-27T18:49:06.581789] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T18:49:06.593505] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T18:49:06.815008] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-27T18:49:07.614937] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-27T18:49:07.952265] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T18:49:08.142907] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T18:49:08.414975] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-27T18:49:09.215004] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-27T18:49:09.708317] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-27T18:49:10.015281] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:49:10.015446] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-27T18:49:10.814941] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-27T18:49:11.585719] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T18:49:11.594848] [INFO ] [REMOTE ] FMS: Full fetch complete (43117 records). [2025-10-27T18:49:11.595005] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-27T18:49:11.626815] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-27T18:49:11.994752] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-27T18:49:11.994851] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-27T18:49:11.995583] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-27T18:49:11.995635] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-27T18:49:11.996526] [DEBUG] [LOCAL ] FMS: Trimmed 43117 records to 30079 (keeping 200 days of data) [2025-10-27T18:49:12.181718] [DEBUG] [LOCAL ] FMS: Primary data saved (30079 records). [2025-10-27T18:49:12.181943] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-27T18:49:12.182108] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 34.1s. Estimated remaining: 3h 13m 58s. Rate: 7.8 symbols/min [2025-10-27T18:49:12.322698] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T18:49:12.388360] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:12.423430] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-27T18:49:12.426027] [DEBUG] [LOCAL ] FN: Loaded 37847 existing records from primary storage. [2025-10-27T18:49:12.426322] [INFO ] [MAIN ] FN: Loaded 37847 existing records. [2025-10-27T18:49:12.480511] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T18:49:12.617903] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:12.618107] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-27T18:49:12.618155] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-27T18:49:12.618455] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-27T18:49:12.618513] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-27T18:49:12.976574] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:13.214943] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-27T18:49:14.014921] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-27T18:49:14.146783] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T18:49:14.153816] [INFO ] [REMOTE ] FMX: Full fetch complete (57813 records). [2025-10-27T18:49:14.153946] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-27T18:49:14.540314] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T18:49:14.561528] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-27T18:49:14.561689] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-27T18:49:14.562500] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-27T18:49:14.562606] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-27T18:49:14.564052] [DEBUG] [LOCAL ] FMX: Trimmed 57813 records to 39996 (keeping 200 days of data) [2025-10-27T18:49:14.710004] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:49:14.816673] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-27T18:49:14.839341] [DEBUG] [LOCAL ] FMX: Primary data saved (39996 records). [2025-10-27T18:49:14.839459] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-27T18:49:14.839533] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMX took 31.6s. Estimated remaining: 3h 13m 41s. Rate: 7.8 symbols/min [2025-10-27T18:49:15.009257] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:15.059738] [DEBUG] [LOCAL ] FNB: Loaded 53382 existing records from primary storage. [2025-10-27T18:49:15.060032] [INFO ] [MAIN ] FNB: Loaded 53382 existing records. [2025-10-27T18:49:15.237052] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:15.237277] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-27T18:49:15.237339] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-27T18:49:15.237683] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-27T18:49:15.237748] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-27T18:49:15.313095] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T18:49:15.337015] [INFO ] [REMOTE ] FMY: Full fetch complete (1942 records). [2025-10-27T18:49:15.339206] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-27T18:49:15.619381] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-27T18:49:15.964056] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:15.964314] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-27T18:49:15.964412] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-27T18:49:15.964860] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-27T18:49:15.964922] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-27T18:49:15.965252] [DEBUG] [LOCAL ] FMY: Trimmed 1942 records to 1320 (keeping 200 days of data) [2025-10-27T18:49:15.973521] [DEBUG] [LOCAL ] FMY: Primary data saved (1320 records). [2025-10-27T18:49:15.973598] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-27T18:49:15.973689] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FMY took 17.7s. Estimated remaining: 3h 13m 22s. Rate: 7.8 symbols/min [2025-10-27T18:49:16.138499] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:16.186999] [DEBUG] [LOCAL ] FND: Loaded 52826 existing records from primary storage. [2025-10-27T18:49:16.187328] [INFO ] [MAIN ] FND: Loaded 52826 existing records. [2025-10-27T18:49:16.361995] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:16.362207] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-27T18:49:16.362261] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-27T18:49:16.362558] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-27T18:49:16.362618] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-27T18:49:16.422799] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-27T18:49:16.730998] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:16.768360] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T18:49:16.770243] [INFO ] [REMOTE ] FMN: Full fetch complete (9769 records). [2025-10-27T18:49:16.770309] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-27T18:49:17.117679] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-27T18:49:17.117762] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-27T18:49:17.118040] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-27T18:49:17.118085] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-27T18:49:17.118478] [DEBUG] [LOCAL ] FMN: Trimmed 9769 records to 5419 (keeping 200 days of data) [2025-10-27T18:49:17.150840] [DEBUG] [LOCAL ] FMN: Primary data saved (5419 records). [2025-10-27T18:49:17.150921] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-27T18:49:17.150991] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FMN took 43.1s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-27T18:49:17.223560] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-27T18:49:17.320954] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:17.371699] [DEBUG] [LOCAL ] FNF: Loaded 49387 existing records from primary storage. [2025-10-27T18:49:17.372067] [INFO ] [MAIN ] FNF: Loaded 49387 existing records. [2025-10-27T18:49:17.574579] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:17.574825] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-27T18:49:17.574883] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-27T18:49:17.575114] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-27T18:49:17.575191] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-27T18:49:18.000519] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:18.014900] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-27T18:49:18.081947] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T18:49:18.821857] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-27T18:49:18.845296] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T18:49:19.112808] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T18:49:19.614911] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-27T18:49:20.418612] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-27T18:49:20.421474] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T18:49:20.921203] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:49:21.214946] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-27T18:49:22.014937] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-27T18:49:22.071772] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:49:22.814958] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-27T18:49:23.615000] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-27T18:49:23.661234] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-27T18:49:24.414956] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-27T18:49:24.938185] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-27T18:49:25.181348] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-27T18:49:25.214904] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-27T18:49:25.845696] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-27T18:49:26.014951] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-27T18:49:26.571342] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T18:49:26.619244] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T18:49:26.814940] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-27T18:49:27.316196] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T18:49:27.614962] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-27T18:49:28.414950] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-27T18:49:28.500465] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T18:49:28.763066] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T18:49:29.215010] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-27T18:49:29.852556] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:49:30.014947] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-27T18:49:30.651955] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:49:30.814930] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-27T18:49:31.614903] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-27T18:49:31.726561] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:49:32.122400] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:49:32.414964] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-27T18:49:33.039152] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T18:49:33.214942] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-27T18:49:33.615191] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:49:34.015036] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-27T18:49:34.501475] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T18:49:34.814941] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-27T18:49:35.621699] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-27T18:49:35.653842] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:49:36.415000] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-27T18:49:36.678448] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T18:49:37.022839] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T18:49:37.215018] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-27T18:49:38.015041] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-27T18:49:38.142374] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T18:49:38.722561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T18:49:38.814944] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-27T18:49:39.614971] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-27T18:49:39.800440] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T18:49:40.234068] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:49:40.414947] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-27T18:49:41.071228] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:49:41.214962] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-27T18:49:42.014925] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-27T18:49:42.180378] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:49:42.815011] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-27T18:49:42.968397] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:49:43.614951] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-27T18:49:43.677701] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:49:43.684146] [INFO ] [REMOTE ] FN: Full fetch complete (56469 records). [2025-10-27T18:49:43.684263] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-27T18:49:44.066084] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-27T18:49:44.066283] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-27T18:49:44.067217] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-27T18:49:44.067381] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-27T18:49:44.068844] [DEBUG] [LOCAL ] FN: Trimmed 56469 records to 37005 (keeping 200 days of data) [2025-10-27T18:49:44.292023] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:49:44.330996] [DEBUG] [LOCAL ] FN: Primary data saved (37005 records). [2025-10-27T18:49:44.331144] [INFO ] [MAIN ] FN: Full history saved. [2025-10-27T18:49:44.331228] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FN took 32.1s. Estimated remaining: 3h 13m 30s. Rate: 7.8 symbols/min [2025-10-27T18:49:44.422179] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-27T18:49:44.504149] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:44.554746] [DEBUG] [LOCAL ] FNV: Loaded 46719 existing records from primary storage. [2025-10-27T18:49:44.555101] [INFO ] [MAIN ] FNV: Loaded 46719 existing records. [2025-10-27T18:49:44.732926] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:44.733138] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-27T18:49:44.733185] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-27T18:49:44.733597] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-27T18:49:44.733686] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-27T18:49:45.112408] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:45.214905] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-27T18:49:45.487275] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T18:49:45.497254] [INFO ] [REMOTE ] FND: Full fetch complete (75097 records). [2025-10-27T18:49:45.497387] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-27T18:49:45.891850] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-27T18:49:45.892030] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-27T18:49:45.892999] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-27T18:49:45.893084] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-27T18:49:45.894878] [DEBUG] [LOCAL ] FND: Trimmed 75097 records to 52045 (keeping 200 days of data) [2025-10-27T18:49:46.022841] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-27T18:49:46.032965] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T18:49:46.051327] [INFO ] [REMOTE ] FNB: Full fetch complete (76250 records). [2025-10-27T18:49:46.051456] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-27T18:49:46.501262] [DEBUG] [LOCAL ] FND: Primary data saved (52045 records). [2025-10-27T18:49:46.506633] [INFO ] [MAIN ] FND: Full history saved. [2025-10-27T18:49:46.513443] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FND took 30.5s. Estimated remaining: 3h 13m 12s. Rate: 7.8 symbols/min [2025-10-27T18:49:46.766600] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-27T18:49:46.790067] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-27T18:49:46.791180] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-27T18:49:46.791817] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-27T18:49:46.826372] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:46.826949] [DEBUG] [LOCAL ] FNB: Trimmed 76250 records to 52602 (keeping 200 days of data) [2025-10-27T18:49:46.950353] [DEBUG] [LOCAL ] FOA: Loaded 13179 existing records from primary storage. [2025-10-27T18:49:46.951106] [INFO ] [MAIN ] FOA: Loaded 13179 existing records. [2025-10-27T18:49:47.021281] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:49:47.065182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-27T18:49:47.299733] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:47.300503] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-27T18:49:47.302045] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-27T18:49:47.302474] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-27T18:49:47.303154] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-27T18:49:47.904306] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:47.909155] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-27T18:49:47.910094] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-27T18:49:47.910381] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-27T18:49:47.911478] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FNB took 33.1s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-10-27T18:49:48.144405] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T18:49:48.172165] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:48.195627] [DEBUG] [LOCAL ] FOF: Loaded 8488 existing records from primary storage. [2025-10-27T18:49:48.195951] [INFO ] [MAIN ] FOF: Loaded 8488 existing records. [2025-10-27T18:49:48.415074] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-27T18:49:48.465053] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:48.465810] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-27T18:49:48.466032] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-27T18:49:48.466337] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-27T18:49:48.466427] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-27T18:49:48.865696] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:48.888691] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T18:49:49.069037] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T18:49:49.214945] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-27T18:49:49.756956] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T18:49:50.014947] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-27T18:49:50.641308] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T18:49:50.814954] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-27T18:49:51.443691] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T18:49:51.488959] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T18:49:51.497833] [INFO ] [REMOTE ] FNF: Full fetch complete (69936 records). [2025-10-27T18:49:51.497952] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-27T18:49:51.620148] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-27T18:49:51.904508] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-27T18:49:51.904586] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-27T18:49:51.905457] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-27T18:49:51.905518] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-27T18:49:51.906896] [DEBUG] [LOCAL ] FNF: Trimmed 69936 records to 48527 (keeping 200 days of data) [2025-10-27T18:49:52.197135] [DEBUG] [LOCAL ] FNF: Primary data saved (48527 records). [2025-10-27T18:49:52.197274] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-27T18:49:52.197353] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FNF took 35.0s. Estimated remaining: 3h 12m 40s. Rate: 7.8 symbols/min [2025-10-27T18:49:52.365148] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:49:52.383904] [DEBUG] [LOCAL ] FOR: Loaded 19663 existing records from primary storage. [2025-10-27T18:49:52.384121] [INFO ] [MAIN ] FOR: Loaded 19663 existing records. [2025-10-27T18:49:52.420113] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-27T18:49:52.563015] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:49:52.563242] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-27T18:49:52.563319] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-27T18:49:52.563813] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-27T18:49:52.563873] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-27T18:49:52.714759] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T18:49:52.931610] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:49:53.214986] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-27T18:49:54.014940] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-27T18:49:54.179445] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T18:49:54.331836] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T18:49:54.689326] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:49:54.814977] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-27T18:49:55.614968] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-27T18:49:55.892922] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T18:49:56.327290] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T18:49:56.414977] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-27T18:49:57.214985] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-27T18:49:57.786957] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T18:49:57.989530] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T18:49:58.014957] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-27T18:49:58.820051] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-27T18:49:58.831827] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:49:59.514777] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T18:49:59.614924] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-27T18:50:00.414942] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-27T18:50:00.806071] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T18:50:01.214989] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-27T18:50:01.824330] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T18:50:02.014979] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-27T18:50:02.202690] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:50:02.815017] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-27T18:50:03.482483] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T18:50:03.614983] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-27T18:50:03.764143] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T18:50:04.414998] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-27T18:50:04.675214] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T18:50:05.214996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-27T18:50:05.658310] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T18:50:06.014945] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-27T18:50:06.190012] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T18:50:06.815039] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-27T18:50:06.853746] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T18:50:07.518242] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T18:50:07.614981] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-27T18:50:08.414924] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-27T18:50:08.674747] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:50:08.833388] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T18:50:09.214973] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-27T18:50:10.014958] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-27T18:50:10.259499] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T18:50:10.815005] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-27T18:50:11.577223] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T18:50:11.614934] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-27T18:50:11.845921] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T18:50:11.849185] [INFO ] [REMOTE ] FOR: Full fetch complete (29448 records). [2025-10-27T18:50:11.849271] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-27T18:50:12.221944] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-27T18:50:12.222082] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-27T18:50:12.222706] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-27T18:50:12.222769] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-27T18:50:12.223674] [DEBUG] [LOCAL ] FOR: Trimmed 29448 records to 19027 (keeping 200 days of data) [2025-10-27T18:50:12.331203] [DEBUG] [LOCAL ] FOR: Primary data saved (19027 records). [2025-10-27T18:50:12.331351] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-27T18:50:12.331433] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FOR took 20.1s. Estimated remaining: 3h 12m 54s. Rate: 7.8 symbols/min [2025-10-27T18:50:12.421054] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-27T18:50:12.461721] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T18:50:12.520345] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:12.564916] [DEBUG] [LOCAL ] FOUR: Loaded 50380 existing records from primary storage. [2025-10-27T18:50:12.565294] [INFO ] [MAIN ] FOUR: Loaded 50380 existing records. [2025-10-27T18:50:12.740456] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:12.740686] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-27T18:50:12.740745] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-27T18:50:12.740930] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-27T18:50:12.740968] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-27T18:50:13.100764] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:13.214895] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-27T18:50:13.311667] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T18:50:14.014937] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-27T18:50:14.645092] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T18:50:14.814988] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-27T18:50:15.614988] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-27T18:50:15.647003] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T18:50:15.674866] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T18:50:16.414948] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-27T18:50:16.923923] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:50:17.214998] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-27T18:50:18.015008] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-27T18:50:18.110623] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T18:50:18.814953] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-27T18:50:19.614922] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-27T18:50:19.758572] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-27T18:50:19.834514] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T18:50:19.843884] [INFO ] [REMOTE ] FNV: Full fetch complete (66990 records). [2025-10-27T18:50:19.844017] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-27T18:50:20.275302] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-27T18:50:20.275184] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T18:50:20.275530] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-27T18:50:20.276571] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-27T18:50:20.276675] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-27T18:50:20.281332] [DEBUG] [LOCAL ] FNV: Trimmed 66990 records to 45932 (keeping 200 days of data) [2025-10-27T18:50:20.475714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-27T18:50:20.619592] [DEBUG] [LOCAL ] FNV: Primary data saved (45932 records). [2025-10-27T18:50:20.622537] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-27T18:50:20.623171] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FNV took 36.3s. Estimated remaining: 3h 12m 47s. Rate: 7.8 symbols/min [2025-10-27T18:50:20.689624] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T18:50:20.807614] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:20.828170] [DEBUG] [LOCAL ] FPF: Loaded 19027 existing records from primary storage. [2025-10-27T18:50:20.828398] [INFO ] [MAIN ] FPF: Loaded 19027 existing records. [2025-10-27T18:50:20.999251] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:20.999423] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-27T18:50:20.999468] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-27T18:50:20.999778] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-27T18:50:20.999836] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-27T18:50:21.226294] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-27T18:50:21.352015] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:21.360740] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T18:50:21.363770] [INFO ] [REMOTE ] FOA: Full fetch complete (20677 records). [2025-10-27T18:50:21.363871] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-27T18:50:21.744142] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-27T18:50:21.744236] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-27T18:50:21.744724] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-27T18:50:21.744805] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-27T18:50:21.745412] [DEBUG] [LOCAL ] FOA: Trimmed 20677 records to 12847 (keeping 200 days of data) [2025-10-27T18:50:21.820440] [DEBUG] [LOCAL ] FOA: Primary data saved (12847 records). [2025-10-27T18:50:21.820577] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-27T18:50:21.820684] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FOA took 35.3s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-27T18:50:21.987219] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:22.005968] [DEBUG] [LOCAL ] FPH: Loaded 19472 existing records from primary storage. [2025-10-27T18:50:22.006209] [INFO ] [MAIN ] FPH: Loaded 19472 existing records. [2025-10-27T18:50:22.020213] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-27T18:50:22.188259] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:22.189039] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-27T18:50:22.189113] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-27T18:50:22.189295] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-27T18:50:22.189356] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-27T18:50:22.533484] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:22.814994] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-27T18:50:23.088676] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T18:50:23.165763] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:50:23.614922] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-27T18:50:23.818277] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:50:23.820346] [INFO ] [REMOTE ] FOF: Full fetch complete (11895 records). [2025-10-27T18:50:23.820417] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-27T18:50:24.173328] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-27T18:50:24.173405] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-27T18:50:24.173700] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-27T18:50:24.173760] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-27T18:50:24.174308] [DEBUG] [LOCAL ] FOF: Trimmed 11895 records to 8138 (keeping 200 days of data) [2025-10-27T18:50:24.228738] [DEBUG] [LOCAL ] FOF: Primary data saved (8138 records). [2025-10-27T18:50:24.228942] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-27T18:50:24.229033] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FOF took 36.3s. Estimated remaining: 3h 12m 12s. Rate: 7.8 symbols/min [2025-10-27T18:50:24.395345] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:24.415010] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-27T18:50:24.427837] [DEBUG] [LOCAL ] FPI: Loaded 31756 existing records from primary storage. [2025-10-27T18:50:24.428075] [INFO ] [MAIN ] FPI: Loaded 31756 existing records. [2025-10-27T18:50:24.600788] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:24.600990] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-27T18:50:24.601036] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-27T18:50:24.601250] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-27T18:50:24.601305] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-27T18:50:24.942663] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:25.087549] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T18:50:25.214925] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-27T18:50:25.389079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T18:50:26.014993] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-27T18:50:26.088083] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T18:50:26.814944] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-27T18:50:27.197469] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:50:27.614955] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-27T18:50:28.414915] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-27T18:50:28.479885] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T18:50:28.544094] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T18:50:29.214915] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-27T18:50:29.519189] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:50:30.014946] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-27T18:50:30.814919] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-27T18:50:31.100450] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T18:50:31.111073] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T18:50:31.614985] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-27T18:50:31.710977] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T18:50:32.414932] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-27T18:50:32.507715] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T18:50:33.138058] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:50:33.214927] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-27T18:50:34.014947] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-27T18:50:34.444611] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:50:34.814955] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-27T18:50:35.198747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T18:50:35.614961] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-27T18:50:36.414987] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-27T18:50:36.579865] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T18:50:36.746243] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T18:50:37.018226] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T18:50:37.214951] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-27T18:50:38.014943] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-27T18:50:38.239434] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T18:50:38.814946] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-27T18:50:39.250684] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T18:50:39.615018] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-27T18:50:39.998611] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T18:50:40.414980] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-27T18:50:41.214916] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-27T18:50:41.305041] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:50:41.456131] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:50:42.015021] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-27T18:50:42.550615] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T18:50:42.633502] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T18:50:42.814967] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-27T18:50:43.614945] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-27T18:50:44.086410] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T18:50:44.414979] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-27T18:50:44.926623] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T18:50:45.197792] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T18:50:45.201523] [INFO ] [REMOTE ] FPH: Full fetch complete (30857 records). [2025-10-27T18:50:45.201610] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-27T18:50:45.223055] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-27T18:50:45.574843] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-27T18:50:45.574916] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-27T18:50:45.575463] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-27T18:50:45.575503] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-27T18:50:45.576180] [DEBUG] [LOCAL ] FPH: Trimmed 30857 records to 19064 (keeping 200 days of data) [2025-10-27T18:50:45.676865] [DEBUG] [LOCAL ] FPH: Primary data saved (19064 records). [2025-10-27T18:50:45.676991] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-27T18:50:45.677066] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FPH took 23.9s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-27T18:50:45.852080] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:45.893073] [DEBUG] [LOCAL ] FR: Loaded 47298 existing records from primary storage. [2025-10-27T18:50:45.893382] [INFO ] [MAIN ] FR: Loaded 47298 existing records. [2025-10-27T18:50:46.020061] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-27T18:50:46.076726] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:46.077245] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-27T18:50:46.077360] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-27T18:50:46.077667] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-27T18:50:46.077734] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-27T18:50:46.406687] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:50:46.462709] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:46.814910] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-27T18:50:47.615104] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-27T18:50:47.904308] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T18:50:47.909264] [INFO ] [REMOTE ] FPF: Full fetch complete (26579 records). [2025-10-27T18:50:47.909344] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-27T18:50:48.305078] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-27T18:50:48.305295] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-27T18:50:48.305864] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-27T18:50:48.306279] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-27T18:50:48.307254] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T18:50:48.317300] [DEBUG] [LOCAL ] FPF: Trimmed 26579 records to 18490 (keeping 200 days of data) [2025-10-27T18:50:48.317460] [INFO ] [REMOTE ] FOUR: Full fetch complete (72241 records). [2025-10-27T18:50:48.317880] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-27T18:50:48.427298] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-27T18:50:48.675612] [DEBUG] [LOCAL ] FPF: Primary data saved (18490 records). [2025-10-27T18:50:48.687893] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-27T18:50:48.708087] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FPF took 28.1s. Estimated remaining: 3h 12m 12s. Rate: 7.8 symbols/min [2025-10-27T18:50:48.936684] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-27T18:50:48.937078] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-27T18:50:48.938388] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-27T18:50:48.954143] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-27T18:50:49.009497] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:49.028287] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:50:49.035120] [DEBUG] [LOCAL ] FOUR: Trimmed 72241 records to 49574 (keeping 200 days of data) [2025-10-27T18:50:49.151352] [DEBUG] [LOCAL ] FRA: Loaded 14173 existing records from primary storage. [2025-10-27T18:50:49.159045] [INFO ] [MAIN ] FRA: Loaded 14173 existing records. [2025-10-27T18:50:49.239887] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-27T18:50:49.452185] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:49.452577] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-27T18:50:49.453170] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-27T18:50:49.454326] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-27T18:50:49.454399] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-27T18:50:49.801171] [DEBUG] [LOCAL ] FOUR: Primary data saved (49574 records). [2025-10-27T18:50:49.804757] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-27T18:50:49.805801] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FOUR took 37.5s. Estimated remaining: 3h 11m 53s. Rate: 7.8 symbols/min [2025-10-27T18:50:49.925520] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:50.022180] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-27T18:50:50.072511] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:50.077462] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T18:50:50.103508] [DEBUG] [LOCAL ] FRGE: Loaded 15673 existing records from primary storage. [2025-10-27T18:50:50.103777] [INFO ] [MAIN ] FRGE: Loaded 15673 existing records. [2025-10-27T18:50:50.281907] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:50.282055] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-27T18:50:50.282100] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-27T18:50:50.282248] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-27T18:50:50.282296] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-27T18:50:50.627607] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:50.764055] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:50:50.814905] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-27T18:50:51.132208] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T18:50:51.614906] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-27T18:50:52.012782] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T18:50:52.415001] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-27T18:50:53.150212] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T18:50:53.214899] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-27T18:50:53.751225] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:50:54.014957] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-27T18:50:54.814913] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-27T18:50:54.909607] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T18:50:55.023849] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T18:50:55.615002] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-27T18:50:55.926524] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:50:56.415006] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-27T18:50:56.752026] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T18:50:57.214986] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-27T18:50:57.762929] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:50:57.769862] [INFO ] [REMOTE ] FPI: Full fetch complete (43623 records). [2025-10-27T18:50:57.770057] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-27T18:50:58.017713] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-27T18:50:58.280678] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-27T18:50:58.280775] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-27T18:50:58.281682] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-27T18:50:58.281743] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-27T18:50:58.283195] [DEBUG] [LOCAL ] FPI: Trimmed 43623 records to 31057 (keeping 200 days of data) [2025-10-27T18:50:58.479108] [DEBUG] [LOCAL ] FPI: Primary data saved (31057 records). [2025-10-27T18:50:58.479253] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-27T18:50:58.479353] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FPI took 34.3s. Estimated remaining: 3h 11m 47s. Rate: 7.8 symbols/min [2025-10-27T18:50:58.685747] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:50:58.687450] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:50:58.742508] [DEBUG] [LOCAL ] FRO: Loaded 52440 existing records from primary storage. [2025-10-27T18:50:58.742853] [INFO ] [MAIN ] FRO: Loaded 52440 existing records. [2025-10-27T18:50:58.820177] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-27T18:50:58.921243] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:50:58.921453] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-27T18:50:58.921501] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-27T18:50:58.922237] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-27T18:50:58.922296] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-27T18:50:59.276588] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:50:59.341186] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T18:50:59.566257] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T18:50:59.615006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-27T18:51:00.414962] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-27T18:51:01.214910] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-27T18:51:01.732050] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T18:51:01.993982] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T18:51:02.014965] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-27T18:51:02.423418] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T18:51:02.814937] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-27T18:51:03.083229] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T18:51:03.614952] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-27T18:51:04.041610] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T18:51:04.414954] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-27T18:51:04.513467] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T18:51:04.761673] [DEBUG] [REMOTE ] FR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-27T18:51:04.762020] [WARN ] [REMOTE ] FR: No data returned for month 2025-07 [2025-10-27T18:51:04.762124] [FATAL] [REMOTE ] FR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T18:51:04.762216] [FATAL] [MAIN ] FR: Failed to fetch primary data. [2025-10-27T18:51:04.762285] [WARN ] [MAIN ] FR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T18:51:04.762352] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-27T18:51:04.762413] [DEBUG] [LOCAL ] FR: No primary data file found to delete. [2025-10-27T18:51:04.762447] [INFO ] [LOCAL ] FR: Starting deletion of derivative data. [2025-10-27T18:51:04.763573] [DEBUG] [LOCAL ] FR: Deleted derivative data file. [2025-10-27T18:51:04.763677] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FR took 19.1s. Estimated remaining: 3h 11m 37s. Rate: 7.8 symbols/min [2025-10-27T18:51:04.935195] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:04.979344] [DEBUG] [LOCAL ] FRT: Loaded 41967 existing records from primary storage. [2025-10-27T18:51:04.979708] [INFO ] [MAIN ] FRT: Loaded 41967 existing records. [2025-10-27T18:51:05.158883] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:05.159086] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-27T18:51:05.159132] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-27T18:51:05.159437] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-27T18:51:05.159495] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-27T18:51:05.214911] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-27T18:51:05.528942] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:06.014938] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-27T18:51:06.814946] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-27T18:51:06.969810] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:51:07.242755] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-27T18:51:07.614949] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-27T18:51:08.165177] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T18:51:08.414911] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-27T18:51:08.595170] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T18:51:09.214910] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-27T18:51:09.397025] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:51:10.014960] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-27T18:51:10.814974] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-27T18:51:10.901194] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T18:51:11.614917] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-27T18:51:11.705134] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T18:51:11.968724] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T18:51:12.414914] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-27T18:51:12.483628] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T18:51:13.214950] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-27T18:51:13.795359] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T18:51:14.015496] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-27T18:51:14.018215] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:51:14.814937] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-27T18:51:15.558335] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T18:51:15.614911] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-27T18:51:15.673283] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T18:51:16.415004] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-27T18:51:16.607805] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:51:16.610777] [INFO ] [REMOTE ] FRA: Full fetch complete (23122 records). [2025-10-27T18:51:16.610853] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-27T18:51:16.978403] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-27T18:51:16.978487] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-27T18:51:16.978994] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-27T18:51:16.979057] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-27T18:51:16.979799] [DEBUG] [LOCAL ] FRA: Trimmed 23122 records to 13514 (keeping 200 days of data) [2025-10-27T18:51:17.061911] [DEBUG] [LOCAL ] FRA: Primary data saved (13514 records). [2025-10-27T18:51:17.062047] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-27T18:51:17.062126] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRA took 28.3s. Estimated remaining: 3h 11m 37s. Rate: 7.8 symbols/min [2025-10-27T18:51:17.229113] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-27T18:51:17.232707] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:17.267667] [DEBUG] [LOCAL ] FSCO: Loaded 39084 existing records from primary storage. [2025-10-27T18:51:17.267982] [INFO ] [MAIN ] FSCO: Loaded 39084 existing records. [2025-10-27T18:51:17.446934] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:17.447140] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-27T18:51:17.447186] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-27T18:51:17.447717] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-27T18:51:17.447775] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-27T18:51:17.801479] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:18.014949] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-27T18:51:18.265361] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:51:18.814991] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-27T18:51:19.103060] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T18:51:19.387407] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T18:51:19.614946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-27T18:51:19.843514] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:51:20.415012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-27T18:51:20.923704] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:51:21.214947] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-27T18:51:22.014966] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-27T18:51:22.311017] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T18:51:22.715929] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T18:51:22.814926] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-27T18:51:23.571485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T18:51:23.614940] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-27T18:51:24.250403] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T18:51:24.414946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-27T18:51:25.101636] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T18:51:25.214966] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-27T18:51:25.367831] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T18:51:26.014928] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-27T18:51:26.044124] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T18:51:26.814939] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-27T18:51:26.919184] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T18:51:27.448435] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:51:27.451139] [INFO ] [REMOTE ] FRGE: Full fetch complete (29665 records). [2025-10-27T18:51:27.451212] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-27T18:51:27.628415] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-27T18:51:27.828291] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-27T18:51:27.828389] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-27T18:51:27.828943] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-27T18:51:27.829003] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-27T18:51:27.829689] [DEBUG] [LOCAL ] FRGE: Trimmed 29665 records to 15237 (keeping 200 days of data) [2025-10-27T18:51:27.917081] [DEBUG] [LOCAL ] FRGE: Primary data saved (15237 records). [2025-10-27T18:51:27.917206] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-27T18:51:27.917281] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FRGE took 38.1s. Estimated remaining: 3h 11m 35s. Rate: 7.8 symbols/min [2025-10-27T18:51:28.083102] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:28.130530] [DEBUG] [LOCAL ] FSK: Loaded 50191 existing records from primary storage. [2025-10-27T18:51:28.130859] [INFO ] [MAIN ] FSK: Loaded 50191 existing records. [2025-10-27T18:51:28.308489] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:28.308704] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-27T18:51:28.308788] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-27T18:51:28.309090] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-27T18:51:28.309129] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-27T18:51:28.420179] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-27T18:51:28.663761] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:29.010824] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T18:51:29.214932] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-27T18:51:30.014946] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-27T18:51:30.342016] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T18:51:30.468519] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T18:51:30.814955] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-27T18:51:30.968136] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T18:51:31.614956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-27T18:51:32.297336] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T18:51:32.414962] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-27T18:51:33.024429] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:51:33.215024] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-27T18:51:33.998136] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T18:51:34.007872] [INFO ] [REMOTE ] FRO: Full fetch complete (75352 records). [2025-10-27T18:51:34.007991] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-27T18:51:34.021243] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-27T18:51:34.397841] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-27T18:51:34.397922] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-27T18:51:34.398894] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-27T18:51:34.398963] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-27T18:51:34.400408] [DEBUG] [LOCAL ] FRO: Trimmed 75352 records to 51628 (keeping 200 days of data) [2025-10-27T18:51:34.718301] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:51:34.746745] [DEBUG] [LOCAL ] FRO: Primary data saved (51628 records). [2025-10-27T18:51:34.746911] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-27T18:51:34.746999] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 36.3s. Estimated remaining: 3h 11m 26s. Rate: 7.8 symbols/min [2025-10-27T18:51:34.820569] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-27T18:51:34.916531] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:34.962820] [DEBUG] [LOCAL ] FSLY: Loaded 52033 existing records from primary storage. [2025-10-27T18:51:34.963117] [INFO ] [MAIN ] FSLY: Loaded 52033 existing records. [2025-10-27T18:51:35.177027] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:35.177390] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-27T18:51:35.177497] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-27T18:51:35.177734] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-27T18:51:35.177808] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-27T18:51:35.385364] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T18:51:35.566595] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:35.614918] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-27T18:51:36.170444] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:51:36.177754] [INFO ] [REMOTE ] FRT: Full fetch complete (60385 records). [2025-10-27T18:51:36.177858] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-27T18:51:36.420140] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-27T18:51:36.562479] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-27T18:51:36.562554] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-27T18:51:36.563348] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-27T18:51:36.563410] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-27T18:51:36.564524] [DEBUG] [LOCAL ] FRT: Trimmed 60385 records to 41110 (keeping 200 days of data) [2025-10-27T18:51:36.820804] [DEBUG] [LOCAL ] FRT: Primary data saved (41110 records). [2025-10-27T18:51:36.821140] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-27T18:51:36.821390] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FRT took 32.1s. Estimated remaining: 3h 11m 9s. Rate: 7.8 symbols/min [2025-10-27T18:51:36.989838] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:37.025989] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:51:37.079998] [DEBUG] [LOCAL ] FSM: Loaded 54078 existing records from primary storage. [2025-10-27T18:51:37.080327] [INFO ] [MAIN ] FSM: Loaded 54078 existing records. [2025-10-27T18:51:37.220113] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-27T18:51:37.259381] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:37.259593] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-27T18:51:37.259663] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-27T18:51:37.260064] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-27T18:51:37.260121] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-27T18:51:37.606731] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:38.014984] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-27T18:51:38.223639] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T18:51:38.814937] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-27T18:51:39.184586] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T18:51:39.592277] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T18:51:39.614898] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-27T18:51:40.355418] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T18:51:40.414895] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-27T18:51:41.103130] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T18:51:41.214893] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-27T18:51:42.014910] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-27T18:51:42.224245] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:51:42.814949] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-27T18:51:43.129474] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T18:51:43.614960] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-27T18:51:43.715116] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T18:51:43.724591] [INFO ] [REMOTE ] FSCO: Full fetch complete (55316 records). [2025-10-27T18:51:43.724830] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-27T18:51:44.112182] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-27T18:51:44.112269] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-27T18:51:44.113098] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-27T18:51:44.113161] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-27T18:51:44.114841] [DEBUG] [LOCAL ] FSCO: Trimmed 55316 records to 38336 (keeping 200 days of data) [2025-10-27T18:51:44.342019] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T18:51:44.379807] [DEBUG] [LOCAL ] FSCO: Primary data saved (38336 records). [2025-10-27T18:51:44.379951] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-27T18:51:44.380446] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSCO took 27.3s. Estimated remaining: 3h 11m 1s. Rate: 7.8 symbols/min [2025-10-27T18:51:44.421949] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-27T18:51:44.548753] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:51:44.586563] [DEBUG] [LOCAL ] FSS: Loaded 33423 existing records from primary storage. [2025-10-27T18:51:44.586926] [INFO ] [MAIN ] FSS: Loaded 33423 existing records. [2025-10-27T18:51:44.777730] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:51:44.777953] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-27T18:51:44.778003] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-27T18:51:44.778200] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-27T18:51:44.778240] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-27T18:51:45.193520] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:51:45.214947] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-27T18:51:45.583494] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T18:51:46.014906] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-27T18:51:46.191219] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T18:51:46.814935] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-27T18:51:46.951390] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:51:47.506112] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T18:51:47.614903] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-27T18:51:48.415029] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-27T18:51:48.662823] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T18:51:48.889370] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T18:51:49.215002] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-27T18:51:49.978319] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T18:51:50.014922] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-27T18:51:50.814978] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-27T18:51:50.848675] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:51:51.614971] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-27T18:51:51.795834] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T18:51:51.955983] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T18:51:52.414948] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-27T18:51:53.214928] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-27T18:51:53.342018] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:51:54.014969] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-27T18:51:54.229223] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T18:51:54.814991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-27T18:51:55.271024] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-27T18:51:55.614972] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-27T18:51:55.737199] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T18:51:56.414925] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-27T18:51:56.643316] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:51:57.220629] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-27T18:51:57.226303] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T18:51:57.707468] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T18:51:58.014981] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-27T18:51:58.461247] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T18:51:58.814963] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-27T18:51:59.614918] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-27T18:51:59.844268] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:52:00.414944] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-27T18:52:00.461222] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T18:52:01.214946] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-27T18:52:01.578128] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T18:52:01.775770] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T18:52:01.786206] [INFO ] [REMOTE ] FSK: Full fetch complete (72144 records). [2025-10-27T18:52:01.786364] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-27T18:52:02.023608] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-27T18:52:02.181304] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-27T18:52:02.181379] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-27T18:52:02.182261] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-27T18:52:02.182322] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-27T18:52:02.183718] [DEBUG] [LOCAL ] FSK: Trimmed 72144 records to 49397 (keeping 200 days of data) [2025-10-27T18:52:02.471344] [DEBUG] [LOCAL ] FSK: Primary data saved (49397 records). [2025-10-27T18:52:02.472012] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-27T18:52:02.472925] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSK took 34.6s. Estimated remaining: 3h 11m 11s. Rate: 7.8 symbols/min [2025-10-27T18:52:02.640768] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:02.649499] [DEBUG] [LOCAL ] FT: Loaded 6909 existing records from primary storage. [2025-10-27T18:52:02.649734] [INFO ] [MAIN ] FT: Loaded 6909 existing records. [2025-10-27T18:52:02.828219] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:02.828724] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-27T18:52:02.828481] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-27T18:52:02.828942] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-27T18:52:02.830165] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-27T18:52:02.830245] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-27T18:52:03.193213] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T18:52:03.213957] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:03.316329] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T18:52:03.614968] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-27T18:52:04.414987] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-27T18:52:05.151215] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T18:52:05.161346] [INFO ] [REMOTE ] FSM: Full fetch complete (77207 records). [2025-10-27T18:52:05.161464] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-27T18:52:05.224462] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-27T18:52:05.565211] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-27T18:52:05.565414] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-27T18:52:05.566453] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-27T18:52:05.566664] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-27T18:52:05.594777] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:52:05.593542] [DEBUG] [LOCAL ] FSM: Trimmed 77207 records to 53298 (keeping 200 days of data) [2025-10-27T18:52:05.605601] [INFO ] [REMOTE ] FSLY: Full fetch complete (74876 records). [2025-10-27T18:52:05.605808] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-27T18:52:05.853473] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T18:52:06.033469] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-27T18:52:06.033399] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T18:52:06.352289] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-27T18:52:06.370622] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-27T18:52:06.370434] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-27T18:52:06.370806] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-27T18:52:06.371776] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-27T18:52:06.371941] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FSM took 29.6s. Estimated remaining: 3h 10m 57s. Rate: 7.8 symbols/min [2025-10-27T18:52:06.372212] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-27T18:52:06.480595] [DEBUG] [LOCAL ] FSLY: Trimmed 74876 records to 51237 (keeping 200 days of data) [2025-10-27T18:52:06.641991] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:06.736350] [DEBUG] [LOCAL ] FTHY: Loaded 12452 existing records from primary storage. [2025-10-27T18:52:06.764047] [INFO ] [MAIN ] FTHY: Loaded 12452 existing records. [2025-10-27T18:52:06.797037] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:52:06.834927] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-27T18:52:07.025843] [DEBUG] [LOCAL ] FSLY: Primary data saved (51237 records). [2025-10-27T18:52:07.031468] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-27T18:52:07.056119] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FSLY took 32.3s. Estimated remaining: 3h 10m 37s. Rate: 7.8 symbols/min [2025-10-27T18:52:07.060441] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:07.104130] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-27T18:52:07.124415] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-27T18:52:07.140867] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-27T18:52:07.151279] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-27T18:52:07.362018] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:07.592111] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:07.625297] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-27T18:52:07.627965] [DEBUG] [LOCAL ] FTI: Loaded 54073 existing records from primary storage. [2025-10-27T18:52:07.628230] [INFO ] [MAIN ] FTI: Loaded 54073 existing records. [2025-10-27T18:52:07.803275] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:07.803488] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-27T18:52:07.803538] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-27T18:52:07.803753] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-27T18:52:07.803826] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-27T18:52:08.167150] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:08.266060] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T18:52:08.269031] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T18:52:08.414923] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-27T18:52:09.214989] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-27T18:52:09.924890] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:52:10.014923] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-27T18:52:10.405846] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:52:10.814948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-27T18:52:11.074789] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T18:52:11.498941] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T18:52:11.614949] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-27T18:52:12.414956] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-27T18:52:12.664271] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T18:52:13.214939] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-27T18:52:13.957154] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T18:52:14.014953] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-27T18:52:14.052214] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T18:52:14.541760] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T18:52:14.814955] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-27T18:52:15.614968] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-27T18:52:16.082360] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T18:52:16.414920] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-27T18:52:16.622617] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:52:17.144953] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T18:52:17.214974] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-27T18:52:17.651905] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T18:52:18.014922] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-27T18:52:18.653284] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:52:18.814965] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-27T18:52:19.602712] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T18:52:19.614907] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-27T18:52:20.414959] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-27T18:52:20.968893] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T18:52:20.974597] [INFO ] [REMOTE ] FSS: Full fetch complete (48294 records). [2025-10-27T18:52:20.974733] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-27T18:52:21.220086] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-27T18:52:21.392840] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-27T18:52:21.392920] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-27T18:52:21.393594] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-27T18:52:21.393679] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-27T18:52:21.394752] [DEBUG] [LOCAL ] FSS: Trimmed 48294 records to 32611 (keeping 200 days of data) [2025-10-27T18:52:21.602768] [DEBUG] [LOCAL ] FSS: Primary data saved (32611 records). [2025-10-27T18:52:21.602915] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-27T18:52:21.603335] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSS took 37.2s. Estimated remaining: 3h 10m 41s. Rate: 7.8 symbols/min [2025-10-27T18:52:21.719241] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T18:52:21.848264] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T18:52:22.014946] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-27T18:52:22.815008] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-27T18:52:23.614920] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-27T18:52:23.853489] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T18:52:23.875813] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T18:52:24.226002] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T18:52:24.228531] [INFO ] [REMOTE ] FT: Full fetch complete (9324 records). [2025-10-27T18:52:24.228605] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-27T18:52:24.420126] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-27T18:52:24.604266] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-27T18:52:24.604338] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-27T18:52:24.604561] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-27T18:52:24.604598] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-27T18:52:24.605030] [DEBUG] [LOCAL ] FT: Trimmed 9324 records to 6749 (keeping 200 days of data) [2025-10-27T18:52:24.643667] [DEBUG] [LOCAL ] FT: Primary data saved (6749 records). [2025-10-27T18:52:24.643786] [INFO ] [MAIN ] FT: Full history saved. [2025-10-27T18:52:24.643862] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FT took 22.2s. Estimated remaining: 3h 10m 26s. Rate: 7.8 symbols/min [2025-10-27T18:52:25.215013] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-27T18:52:25.955535] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T18:52:26.014904] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-27T18:52:26.273694] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:52:26.767534] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T18:52:26.814914] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-27T18:52:27.615005] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-27T18:52:27.630959] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T18:52:28.414946] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-27T18:52:29.190173] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:52:29.214903] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-27T18:52:29.451639] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:52:29.961273] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:52:30.014917] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-27T18:52:30.782978] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T18:52:30.786002] [INFO ] [REMOTE ] FTHY: Full fetch complete (17264 records). [2025-10-27T18:52:30.786073] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-27T18:52:30.828384] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-27T18:52:31.143467] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-27T18:52:31.143539] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-27T18:52:31.143925] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-27T18:52:31.143985] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-27T18:52:31.144468] [DEBUG] [LOCAL ] FTHY: Trimmed 17264 records to 12001 (keeping 200 days of data) [2025-10-27T18:52:31.214548] [DEBUG] [LOCAL ] FTHY: Primary data saved (12001 records). [2025-10-27T18:52:31.214699] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-27T18:52:31.214806] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTHY took 24.8s. Estimated remaining: 3h 10m 16s. Rate: 7.8 symbols/min [2025-10-27T18:52:32.363699] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T18:52:32.374868] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-27T18:52:33.992609] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T18:52:34.005501] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-27T18:52:35.956021] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T18:52:35.966295] [INFO ] [REMOTE ] FTI: Full fetch complete (77334 records). [2025-10-27T18:52:35.966444] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-27T18:52:36.352260] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-27T18:52:36.352355] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-27T18:52:36.353344] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-27T18:52:36.353406] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-27T18:52:36.354769] [DEBUG] [LOCAL ] FTI: Trimmed 77334 records to 53292 (keeping 200 days of data) [2025-10-27T18:52:36.669554] [DEBUG] [LOCAL ] FTI: Primary data saved (53292 records). [2025-10-27T18:52:36.669708] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-27T18:52:36.669794] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTI took 29.6s. Estimated remaining: 3h 10m 5s. Rate: 7.8 symbols/min [2025-10-27T18:52:37.192668] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.333541] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.341131] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.390703] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:37.396383] [DEBUG] [LOCAL ] FTWO: Loaded 1980 existing records from primary storage. [2025-10-27T18:52:37.396857] [INFO ] [MAIN ] FTWO: Loaded 1980 existing records. [2025-10-27T18:52:37.519157] [DEBUG] [LOCAL ] FTK: Loaded 33491 existing records from primary storage. [2025-10-27T18:52:37.541579] [INFO ] [MAIN ] FTK: Loaded 33491 existing records. [2025-10-27T18:52:37.843311] [DEBUG] [LOCAL ] FTS: Loaded 43082 existing records from primary storage. [2025-10-27T18:52:37.873275] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:37.886585] [INFO ] [MAIN ] FTS: Loaded 43082 existing records. [2025-10-27T18:52:37.892302] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-27T18:52:37.875671] [DEBUG] [LOCAL ] FTV: Loaded 53787 existing records from primary storage. [2025-10-27T18:52:37.919148] [INFO ] [MAIN ] FTV: Loaded 53787 existing records. [2025-10-27T18:52:37.913516] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-27T18:52:38.032118] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-27T18:52:38.113359] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.159422] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-27T18:52:38.192910] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.284794] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-27T18:52:38.432224] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-27T18:52:38.489041] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-27T18:52:38.523280] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.641897] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.725910] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-27T18:52:38.707699] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:38.792135] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-27T18:52:38.842616] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-27T18:52:38.853702] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-27T18:52:38.860706] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-27T18:52:38.866029] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-27T18:52:38.905299] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-27T18:52:39.676065] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:39.765193] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:39.793242] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-27T18:52:39.816065] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-27T18:52:40.017154] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:40.023781] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-27T18:52:40.105438] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:40.105856] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-27T18:52:40.191905] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T18:52:40.193749] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-27T18:52:40.772954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T18:52:40.774217] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-27T18:52:40.929400] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T18:52:40.935063] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-27T18:52:41.066695] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T18:52:41.068058] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-27T18:52:41.122497] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T18:52:41.130339] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-27T18:52:41.358204] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T18:52:41.368472] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-27T18:52:41.441441] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-27T18:52:41.442496] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-27T18:52:41.551147] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T18:52:41.715691] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-27T18:52:42.014919] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-27T18:52:42.138979] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T18:52:42.677812] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T18:52:42.811161] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T18:52:42.816763] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-27T18:52:43.614943] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-27T18:52:43.954993] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T18:52:44.282943] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T18:52:44.414934] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-27T18:52:45.214930] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-27T18:52:45.884198] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T18:52:46.014911] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-27T18:52:46.814910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-27T18:52:47.096695] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T18:52:47.147130] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T18:52:47.148266] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:52:47.614927] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-27T18:52:48.414928] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-27T18:52:48.595127] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:52:48.841618] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-27T18:52:49.214944] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-27T18:52:50.014949] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-27T18:52:50.450374] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:52:50.792206] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:52:50.814894] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-27T18:52:51.614981] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-27T18:52:51.887617] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-27T18:52:52.414927] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-27T18:52:52.623388] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T18:52:53.048689] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:52:53.049870] [INFO ] [REMOTE ] FTWO: Full fetch complete (3311 records). [2025-10-27T18:52:53.049939] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-27T18:52:53.215864] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-27T18:52:53.402207] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-27T18:52:53.402288] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-27T18:52:53.402419] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-27T18:52:53.402458] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-27T18:52:53.402822] [DEBUG] [LOCAL ] FTWO: Trimmed 3311 records to 1917 (keeping 200 days of data) [2025-10-27T18:52:53.414604] [DEBUG] [LOCAL ] FTWO: Primary data saved (1917 records). [2025-10-27T18:52:53.414694] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-27T18:52:53.414789] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 16.7s. Estimated remaining: 3h 10m 12s. Rate: 7.8 symbols/min [2025-10-27T18:52:53.588938] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:52:53.642442] [DEBUG] [LOCAL ] FUBO: Loaded 54493 existing records from primary storage. [2025-10-27T18:52:53.642841] [INFO ] [MAIN ] FUBO: Loaded 54493 existing records. [2025-10-27T18:52:53.839981] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:52:53.840204] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-27T18:52:53.840257] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-27T18:52:53.840624] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-27T18:52:53.840716] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-27T18:52:54.020028] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-27T18:52:54.230768] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:52:54.814979] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-27T18:52:54.907971] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T18:52:55.149528] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:52:55.615008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-27T18:52:55.831348] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T18:52:56.415007] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-27T18:52:57.214934] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-27T18:52:57.250309] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:52:57.806700] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T18:52:58.014949] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-27T18:52:58.815002] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-27T18:52:59.614975] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-27T18:52:59.672633] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T18:52:59.679455] [INFO ] [REMOTE ] FTK: Full fetch complete (44160 records). [2025-10-27T18:52:59.679614] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-27T18:52:59.784527] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-27T18:53:00.138492] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-27T18:53:00.138598] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-27T18:53:00.139294] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-27T18:53:00.139373] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-27T18:53:00.141473] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T18:53:00.151119] [DEBUG] [LOCAL ] FTK: Trimmed 44160 records to 33051 (keeping 200 days of data) [2025-10-27T18:53:00.343287] [DEBUG] [LOCAL ] FTK: Primary data saved (33051 records). [2025-10-27T18:53:00.343418] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-27T18:53:00.343499] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTK took 23.7s. Estimated remaining: 3h 10m 3s. Rate: 7.8 symbols/min [2025-10-27T18:53:00.420099] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-27T18:53:00.542818] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:00.576726] [DEBUG] [LOCAL ] FUL: Loaded 32473 existing records from primary storage. [2025-10-27T18:53:00.577089] [INFO ] [MAIN ] FUL: Loaded 32473 existing records. [2025-10-27T18:53:00.756482] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:00.756728] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-27T18:53:00.756813] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-27T18:53:00.757021] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-27T18:53:00.757060] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-27T18:53:01.113389] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:01.214982] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-27T18:53:01.641341] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T18:53:02.014946] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-27T18:53:02.776435] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-27T18:53:02.778145] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T18:53:02.814898] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-27T18:53:03.587134] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:53:03.614890] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-27T18:53:03.768397] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T18:53:04.414999] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-27T18:53:05.215196] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-27T18:53:05.242540] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:53:06.014954] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-27T18:53:06.369849] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:53:06.814940] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-27T18:53:06.998220] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T18:53:07.242894] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T18:53:07.614992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-27T18:53:08.414951] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-27T18:53:08.568316] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:53:08.578437] [INFO ] [REMOTE ] FTV: Full fetch complete (76610 records). [2025-10-27T18:53:08.578620] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-27T18:53:08.984346] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-27T18:53:08.984453] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-27T18:53:08.985506] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-27T18:53:08.985599] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-27T18:53:08.987223] [DEBUG] [LOCAL ] FTV: Trimmed 76610 records to 52997 (keeping 200 days of data) [2025-10-27T18:53:09.224705] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-27T18:53:09.251500] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T18:53:09.341630] [DEBUG] [LOCAL ] FTV: Primary data saved (52997 records). [2025-10-27T18:53:09.341803] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-27T18:53:09.342604] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FTV took 32.6s. Estimated remaining: 3h 9m 58s. Rate: 7.8 symbols/min [2025-10-27T18:53:09.505585] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:09.554774] [DEBUG] [LOCAL ] FUN: Loaded 52795 existing records from primary storage. [2025-10-27T18:53:09.555094] [INFO ] [MAIN ] FUN: Loaded 52795 existing records. [2025-10-27T18:53:09.728700] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:09.728911] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-27T18:53:09.728964] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-27T18:53:09.729152] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-27T18:53:09.729207] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-27T18:53:10.020084] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-27T18:53:10.081099] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:10.249973] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T18:53:10.730785] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:53:10.814943] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-27T18:53:11.521304] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:53:11.614937] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-27T18:53:12.019262] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T18:53:12.414995] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-27T18:53:13.132351] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T18:53:13.214906] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-27T18:53:13.777181] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T18:53:13.785932] [INFO ] [REMOTE ] FTS: Full fetch complete (60934 records). [2025-10-27T18:53:13.786050] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-27T18:53:14.020481] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-27T18:53:14.221371] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-27T18:53:14.221469] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-27T18:53:14.222494] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-27T18:53:14.222570] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-27T18:53:14.223877] [DEBUG] [LOCAL ] FTS: Trimmed 60934 records to 42295 (keeping 200 days of data) [2025-10-27T18:53:14.497144] [DEBUG] [LOCAL ] FTS: Primary data saved (42295 records). [2025-10-27T18:53:14.497271] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-27T18:53:14.497349] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTS took 37.8s. Estimated remaining: 3h 9m 46s. Rate: 7.8 symbols/min [2025-10-27T18:53:14.706578] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:14.723058] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T18:53:14.752235] [DEBUG] [LOCAL ] FVR: Loaded 21021 existing records from primary storage. [2025-10-27T18:53:14.752490] [INFO ] [MAIN ] FVR: Loaded 21021 existing records. [2025-10-27T18:53:14.825990] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-27T18:53:14.957504] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:14.957730] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-27T18:53:14.957785] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-27T18:53:14.957947] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-27T18:53:14.957986] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-27T18:53:15.350885] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:15.614944] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-27T18:53:15.815638] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T18:53:16.416636] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-27T18:53:16.422692] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T18:53:17.214949] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-27T18:53:17.427634] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T18:53:17.470019] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T18:53:18.014948] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-27T18:53:18.814921] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-27T18:53:19.306678] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T18:53:19.614979] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-27T18:53:19.760365] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T18:53:20.279032] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T18:53:20.414917] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-27T18:53:21.214991] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-27T18:53:21.954053] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-27T18:53:21.978687] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T18:53:22.015342] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-27T18:53:22.017017] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T18:53:22.814974] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-27T18:53:23.130928] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T18:53:23.614942] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-27T18:53:24.414916] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-27T18:53:24.823283] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T18:53:24.914745] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T18:53:25.215004] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-27T18:53:25.632358] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T18:53:26.015013] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-27T18:53:26.142910] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T18:53:26.778944] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T18:53:26.814935] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-27T18:53:27.502932] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T18:53:27.614951] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-27T18:53:28.414961] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-27T18:53:28.926918] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T18:53:28.933186] [INFO ] [REMOTE ] FUL: Full fetch complete (47811 records). [2025-10-27T18:53:28.933278] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-27T18:53:29.224324] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-27T18:53:29.324398] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-27T18:53:29.324491] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-27T18:53:29.325190] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-27T18:53:29.325252] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-27T18:53:29.326260] [DEBUG] [LOCAL ] FUL: Trimmed 47811 records to 31762 (keeping 200 days of data) [2025-10-27T18:53:29.515900] [DEBUG] [LOCAL ] FUL: Primary data saved (31762 records). [2025-10-27T18:53:29.516028] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-27T18:53:29.516432] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUL took 29.2s. Estimated remaining: 3h 9m 50s. Rate: 7.8 symbols/min [2025-10-27T18:53:29.687519] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:29.725803] [DEBUG] [LOCAL ] FVRR: Loaded 41105 existing records from primary storage. [2025-10-27T18:53:29.726167] [INFO ] [MAIN ] FVRR: Loaded 41105 existing records. [2025-10-27T18:53:29.912766] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:29.912958] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-27T18:53:29.913006] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-27T18:53:29.913196] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-27T18:53:29.913253] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-27T18:53:30.020016] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-27T18:53:30.276049] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:30.312043] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T18:53:30.814981] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-27T18:53:30.932659] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T18:53:31.055114] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T18:53:31.614935] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-27T18:53:32.128962] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T18:53:32.414946] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-27T18:53:33.214954] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-27T18:53:33.906946] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T18:53:33.917446] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-27T18:53:33.917594] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-27T18:53:34.016398] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-27T18:53:34.236015] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T18:53:34.349139] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-27T18:53:34.349227] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-27T18:53:34.350170] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-27T18:53:34.350235] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-27T18:53:34.351717] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-10-27T18:53:34.661114] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-10-27T18:53:34.661239] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-27T18:53:34.661314] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FUBO took 41.2s. Estimated remaining: 3h 9m 38s. Rate: 7.8 symbols/min [2025-10-27T18:53:34.828778] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:34.828965] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-27T18:53:34.844866] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:53:34.846465] [DEBUG] [LOCAL ] FXED: Loaded 1249 existing records from primary storage. [2025-10-27T18:53:34.852011] [INFO ] [MAIN ] FXED: Loaded 1249 existing records. [2025-10-27T18:53:35.056707] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:35.058798] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T18:53:35.069374] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-27T18:53:35.069529] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-27T18:53:35.070263] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-27T18:53:35.070321] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-27T18:53:35.411957] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:35.615004] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-27T18:53:36.415490] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-27T18:53:36.420508] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T18:53:36.723562] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-27T18:53:37.214957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-27T18:53:37.667488] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T18:53:37.677621] [INFO ] [REMOTE ] FUN: Full fetch complete (73694 records). [2025-10-27T18:53:37.677789] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-27T18:53:38.024342] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-27T18:53:38.061297] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-27T18:53:38.061398] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-27T18:53:38.062505] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-27T18:53:38.062681] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-27T18:53:38.064198] [DEBUG] [LOCAL ] FUN: Trimmed 73694 records to 52033 (keeping 200 days of data) [2025-10-27T18:53:38.385469] [DEBUG] [LOCAL ] FUN: Primary data saved (52033 records). [2025-10-27T18:53:38.386201] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-27T18:53:38.387001] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T18:53:38.387144] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FUN took 29.0s. Estimated remaining: 3h 9m 24s. Rate: 7.8 symbols/min [2025-10-27T18:53:38.571488] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:38.616560] [DEBUG] [LOCAL ] G: Loaded 50825 existing records from primary storage. [2025-10-27T18:53:38.616898] [INFO ] [MAIN ] G: Loaded 50825 existing records. [2025-10-27T18:53:38.790493] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:38.790776] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-27T18:53:38.790825] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-27T18:53:38.790988] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-27T18:53:38.791025] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-27T18:53:38.820828] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-27T18:53:39.151392] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T18:53:39.149185] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:39.164570] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T18:53:39.614983] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-27T18:53:40.415048] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-27T18:53:40.786682] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T18:53:41.214999] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-27T18:53:41.446849] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T18:53:41.824450] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T18:53:42.014961] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-27T18:53:42.352223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T18:53:42.814992] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-27T18:53:43.614952] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-27T18:53:43.996584] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T18:53:44.414985] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-27T18:53:45.219194] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-27T18:53:45.224526] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T18:53:45.542270] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T18:53:46.014971] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-27T18:53:46.199936] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T18:53:46.814936] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-27T18:53:47.223711] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T18:53:47.614967] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-27T18:53:47.667674] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T18:53:47.972269] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T18:53:48.414918] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-27T18:53:48.708601] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-27T18:53:49.215008] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-27T18:53:49.726153] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T18:53:50.014978] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-27T18:53:50.815012] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-27T18:53:51.298368] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T18:53:51.316849] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T18:53:51.614953] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-27T18:53:52.340786] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T18:53:52.344114] [INFO ] [REMOTE ] FVR: Full fetch complete (29183 records). [2025-10-27T18:53:52.344184] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-27T18:53:52.420179] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-27T18:53:52.705663] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-27T18:53:52.705753] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-27T18:53:52.706295] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-27T18:53:52.706335] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-27T18:53:52.707075] [DEBUG] [LOCAL ] FVR: Trimmed 29183 records to 20577 (keeping 200 days of data) [2025-10-27T18:53:52.828497] [DEBUG] [LOCAL ] FVR: Primary data saved (20577 records). [2025-10-27T18:53:52.828616] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-27T18:53:52.828729] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVR took 38.3s. Estimated remaining: 3h 9m 28s. Rate: 7.8 symbols/min [2025-10-27T18:53:52.994709] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:53.022400] [DEBUG] [LOCAL ] GAB: Loaded 27743 existing records from primary storage. [2025-10-27T18:53:53.022662] [INFO ] [MAIN ] GAB: Loaded 27743 existing records. [2025-10-27T18:53:53.194789] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:53.194981] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-27T18:53:53.195028] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-27T18:53:53.195198] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-27T18:53:53.195237] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-27T18:53:53.225151] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-27T18:53:53.563549] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:54.014945] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-27T18:53:54.148505] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T18:53:54.614318] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:53:54.615339] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T18:53:54.626141] [INFO ] [REMOTE ] FXED: Full fetch complete (1783 records). [2025-10-27T18:53:54.626632] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-27T18:53:54.824009] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-27T18:53:54.984681] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-27T18:53:54.984773] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-27T18:53:54.984875] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-27T18:53:54.984913] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-27T18:53:54.985306] [DEBUG] [LOCAL ] FXED: Trimmed 1783 records to 1221 (keeping 200 days of data) [2025-10-27T18:53:54.993287] [DEBUG] [LOCAL ] FXED: Primary data saved (1221 records). [2025-10-27T18:53:54.993358] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-27T18:53:54.993430] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. FXED took 20.3s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-27T18:53:55.156298] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:55.162367] [DEBUG] [LOCAL ] GAM: Loaded 3866 existing records from primary storage. [2025-10-27T18:53:55.162531] [INFO ] [MAIN ] GAM: Loaded 3866 existing records. [2025-10-27T18:53:55.333183] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:53:55.333387] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-27T18:53:55.333432] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-27T18:53:55.333560] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-27T18:53:55.333596] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-27T18:53:55.620088] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-27T18:53:55.683355] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:53:56.002161] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T18:53:56.415013] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-27T18:53:56.601749] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T18:53:57.215008] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-27T18:53:58.014955] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-27T18:53:58.149499] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T18:53:58.686395] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T18:53:58.814956] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-27T18:53:58.989392] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T18:53:58.997564] [INFO ] [REMOTE ] FVRR: Full fetch complete (59301 records). [2025-10-27T18:53:58.997751] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-27T18:53:59.382216] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-27T18:53:59.382295] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-27T18:53:59.383080] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-27T18:53:59.383141] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-27T18:53:59.384248] [DEBUG] [LOCAL ] FVRR: Trimmed 59301 records to 40434 (keeping 200 days of data) [2025-10-27T18:53:59.624544] [DEBUG] [LOCAL ] FVRR: Primary data saved (40434 records). [2025-10-27T18:53:59.626364] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-27T18:53:59.628434] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T18:53:59.627121] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-27T18:53:59.634452] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. FVRR took 30.1s. Estimated remaining: 3h 8m 58s. Rate: 7.8 symbols/min [2025-10-27T18:53:59.822519] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:53:59.884900] [DEBUG] [LOCAL ] GAP: Loaded 54433 existing records from primary storage. [2025-10-27T18:53:59.885213] [INFO ] [MAIN ] GAP: Loaded 54433 existing records. [2025-10-27T18:54:00.067985] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:00.068191] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-27T18:54:00.068237] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-27T18:54:00.068575] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-27T18:54:00.068676] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-27T18:54:00.418127] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-27T18:54:00.418049] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:01.155011] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T18:54:01.214955] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-27T18:54:01.477171] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T18:54:02.014981] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-27T18:54:02.762323] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:54:02.814939] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-27T18:54:03.085752] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T18:54:03.614928] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-27T18:54:03.969078] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T18:54:04.343096] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T18:54:04.414925] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-27T18:54:05.214935] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-27T18:54:06.015040] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-27T18:54:06.214386] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:54:06.258224] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T18:54:06.596328] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T18:54:06.814951] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-27T18:54:07.614955] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-27T18:54:08.210055] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T18:54:08.410820] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T18:54:08.420504] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-27T18:54:09.214951] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-27T18:54:09.264315] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T18:54:10.014950] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-27T18:54:10.814975] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-27T18:54:11.147195] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T18:54:11.379252] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T18:54:11.426254] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T18:54:11.614959] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-27T18:54:12.414993] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-27T18:54:13.073171] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:54:13.082896] [INFO ] [REMOTE ] G: Full fetch complete (72330 records). [2025-10-27T18:54:13.083014] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-27T18:54:13.224723] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-27T18:54:13.485345] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-27T18:54:13.494839] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-27T18:54:13.497415] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:54:13.496365] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-27T18:54:13.503505] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-27T18:54:13.505227] [DEBUG] [LOCAL ] G: Trimmed 72330 records to 50010 (keeping 200 days of data) [2025-10-27T18:54:13.812857] [DEBUG] [LOCAL ] G: Primary data saved (50010 records). [2025-10-27T18:54:13.812992] [INFO ] [MAIN ] G: Full history saved. [2025-10-27T18:54:13.813104] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. G took 35.4s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-10-27T18:54:13.931628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T18:54:14.018620] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:14.018725] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-27T18:54:14.041157] [DEBUG] [LOCAL ] GATX: Loaded 18267 existing records from primary storage. [2025-10-27T18:54:14.041456] [INFO ] [MAIN ] GATX: Loaded 18267 existing records. [2025-10-27T18:54:14.238478] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:14.238717] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-27T18:54:14.238773] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-27T18:54:14.239024] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-27T18:54:14.239063] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-27T18:54:14.586959] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:14.814946] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-27T18:54:15.231270] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T18:54:15.417467] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T18:54:15.614918] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-27T18:54:16.414931] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-27T18:54:16.467425] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T18:54:17.214961] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-27T18:54:17.860838] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T18:54:18.014931] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-27T18:54:18.366115] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T18:54:18.706579] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T18:54:18.814930] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-27T18:54:19.614933] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-27T18:54:19.926610] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T18:54:20.414909] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-27T18:54:20.802525] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T18:54:21.214972] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-27T18:54:22.014923] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-27T18:54:22.183165] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T18:54:22.352633] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T18:54:22.814933] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-27T18:54:23.032950] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T18:54:23.614917] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-27T18:54:23.818722] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T18:54:24.029937] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T18:54:24.415033] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-27T18:54:25.214967] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-27T18:54:25.453588] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T18:54:26.014930] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-27T18:54:26.619607] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:54:26.621325] [INFO ] [REMOTE ] GAM: Full fetch complete (6414 records). [2025-10-27T18:54:26.623735] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-27T18:54:26.824636] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-27T18:54:26.990947] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-27T18:54:26.991025] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-27T18:54:26.991227] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-27T18:54:26.991268] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-27T18:54:26.991670] [DEBUG] [LOCAL ] GAM: Trimmed 6414 records to 3682 (keeping 200 days of data) [2025-10-27T18:54:27.013300] [DEBUG] [LOCAL ] GAM: Primary data saved (3682 records). [2025-10-27T18:54:27.013463] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-27T18:54:27.013723] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAM took 32.0s. Estimated remaining: 3h 9m 3s. Rate: 7.8 symbols/min [2025-10-27T18:54:27.147278] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:54:27.227533] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:27.241763] [DEBUG] [LOCAL ] GBAB: Loaded 12835 existing records from primary storage. [2025-10-27T18:54:27.241974] [INFO ] [MAIN ] GBAB: Loaded 12835 existing records. [2025-10-27T18:54:27.420159] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:27.420362] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-27T18:54:27.420409] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-27T18:54:27.420689] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-27T18:54:27.420747] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-27T18:54:27.620544] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-27T18:54:27.779186] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:27.973178] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T18:54:28.414967] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-27T18:54:29.215001] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-27T18:54:29.321468] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T18:54:29.677994] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T18:54:29.683140] [INFO ] [REMOTE ] GAB: Full fetch complete (39322 records). [2025-10-27T18:54:29.683217] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-27T18:54:30.021036] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-27T18:54:30.059297] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-27T18:54:30.059517] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-27T18:54:30.060268] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-27T18:54:30.065516] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-27T18:54:30.073554] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T18:54:30.079212] [DEBUG] [LOCAL ] GAB: Trimmed 39322 records to 26973 (keeping 200 days of data) [2025-10-27T18:54:30.230815] [DEBUG] [LOCAL ] GAB: Primary data saved (26973 records). [2025-10-27T18:54:30.230942] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-27T18:54:30.231020] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. GAB took 37.4s. Estimated remaining: 3h 8m 48s. Rate: 7.8 symbols/min [2025-10-27T18:54:30.395141] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:30.432959] [DEBUG] [LOCAL ] GBCI: Loaded 41806 existing records from primary storage. [2025-10-27T18:54:30.433230] [INFO ] [MAIN ] GBCI: Loaded 41806 existing records. [2025-10-27T18:54:30.605421] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:30.605634] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-27T18:54:30.605714] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-27T18:54:30.606052] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-27T18:54:30.606109] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-27T18:54:30.820221] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-27T18:54:30.956505] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:31.170580] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T18:54:31.614987] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-27T18:54:32.414919] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-27T18:54:32.711813] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T18:54:33.007167] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T18:54:33.106864] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T18:54:33.214961] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-27T18:54:34.014991] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-27T18:54:34.695507] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T18:54:34.814906] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-27T18:54:35.514500] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:54:35.614908] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-27T18:54:36.002115] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T18:54:36.414968] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-27T18:54:37.215072] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-27T18:54:37.248577] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T18:54:37.595044] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T18:54:37.606551] [INFO ] [REMOTE ] GAP: Full fetch complete (77814 records). [2025-10-27T18:54:37.606745] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-27T18:54:38.006187] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-27T18:54:38.006509] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-27T18:54:38.010629] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-27T18:54:38.010876] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-27T18:54:38.019455] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-27T18:54:38.022411] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T18:54:38.027105] [INFO ] [REMOTE ] GATX: Full fetch complete (25112 records). [2025-10-27T18:54:38.027295] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-27T18:54:38.027484] [DEBUG] [LOCAL ] GAP: Trimmed 77814 records to 53653 (keeping 200 days of data) [2025-10-27T18:54:38.643703] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-27T18:54:38.644123] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-27T18:54:38.645820] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-27T18:54:38.645901] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-27T18:54:38.657144] [DEBUG] [LOCAL ] GATX: Trimmed 25112 records to 17782 (keeping 200 days of data) [2025-10-27T18:54:38.822828] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-27T18:54:38.851081] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-27T18:54:38.852726] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-27T18:54:38.865808] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GAP took 39.2s. Estimated remaining: 3h 8m 41s. Rate: 7.8 symbols/min [2025-10-27T18:54:39.052289] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:39.053417] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-27T18:54:39.054034] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-27T18:54:39.055831] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-27T18:54:39.055962] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-27T18:54:39.058967] [DEBUG] [LOCAL ] GATX: Primary data saved (17782 records). [2025-10-27T18:54:39.059120] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-27T18:54:39.059291] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GATX took 25.2s. Estimated remaining: 3h 8m 21s. Rate: 7.8 symbols/min [2025-10-27T18:54:39.059618] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-27T18:54:39.129211] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-27T18:54:39.364788] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:39.652195] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:39.652779] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-27T18:54:39.690520] [DEBUG] [LOCAL ] GBTG: Loaded 40762 existing records from primary storage. [2025-10-27T18:54:39.693073] [INFO ] [MAIN ] GBTG: Loaded 40762 existing records. [2025-10-27T18:54:39.760524] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T18:54:39.862177] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T18:54:39.910130] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:39.910356] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-27T18:54:39.910408] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-27T18:54:39.910597] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-27T18:54:39.910636] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-27T18:54:40.017129] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T18:54:40.289742] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:40.414997] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-27T18:54:40.907167] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T18:54:41.214963] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-27T18:54:42.014942] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-27T18:54:42.249821] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T18:54:42.323499] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T18:54:42.814920] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-27T18:54:43.614929] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-27T18:54:43.898874] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T18:54:44.415015] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-27T18:54:45.052154] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T18:54:45.214939] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-27T18:54:46.014936] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-27T18:54:46.356329] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T18:54:46.814940] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-27T18:54:47.236614] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T18:54:47.466586] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-27T18:54:47.614921] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-27T18:54:47.857969] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T18:54:48.414937] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-27T18:54:48.709294] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T18:54:49.078458] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T18:54:49.214900] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-27T18:54:50.014992] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-27T18:54:50.725799] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T18:54:50.814899] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-27T18:54:51.603102] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T18:54:51.614897] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-27T18:54:51.882590] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T18:54:52.415021] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-27T18:54:53.010495] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T18:54:53.214977] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-27T18:54:53.357868] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T18:54:53.589772] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T18:54:54.014939] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-27T18:54:54.816989] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-27T18:54:54.820089] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T18:54:55.614940] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-27T18:54:56.314449] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T18:54:56.414915] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-27T18:54:56.498062] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:54:56.500454] [INFO ] [REMOTE ] GBAB: Full fetch complete (18450 records). [2025-10-27T18:54:56.500524] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-27T18:54:56.889810] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-27T18:54:56.889887] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-27T18:54:56.890385] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-27T18:54:56.890452] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-27T18:54:56.891150] [DEBUG] [LOCAL ] GBAB: Trimmed 18450 records to 12396 (keeping 200 days of data) [2025-10-27T18:54:56.974779] [DEBUG] [LOCAL ] GBAB: Primary data saved (12396 records). [2025-10-27T18:54:56.974937] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-27T18:54:56.975027] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBAB took 30.0s. Estimated remaining: 3h 8m 30s. Rate: 7.8 symbols/min [2025-10-27T18:54:57.172375] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:57.200854] [DEBUG] [LOCAL ] GBX: Loaded 28498 existing records from primary storage. [2025-10-27T18:54:57.201139] [INFO ] [MAIN ] GBX: Loaded 28498 existing records. [2025-10-27T18:54:57.221740] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-27T18:54:57.382399] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:57.382603] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-27T18:54:57.382710] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-27T18:54:57.382965] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-27T18:54:57.383025] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-27T18:54:57.733172] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:57.789902] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T18:54:57.799696] [INFO ] [REMOTE ] GBCI: Full fetch complete (59569 records). [2025-10-27T18:54:57.799833] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-27T18:54:58.021746] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-27T18:54:58.185015] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-27T18:54:58.185106] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-27T18:54:58.185994] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-27T18:54:58.186067] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-27T18:54:58.187421] [DEBUG] [LOCAL ] GBCI: Trimmed 59569 records to 41110 (keeping 200 days of data) [2025-10-27T18:54:58.372791] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T18:54:58.441411] [DEBUG] [LOCAL ] GBCI: Primary data saved (41110 records). [2025-10-27T18:54:58.441552] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-27T18:54:58.442446] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBCI took 28.2s. Estimated remaining: 3h 8m 13s. Rate: 7.8 symbols/min [2025-10-27T18:54:58.616062] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:54:58.657466] [DEBUG] [LOCAL ] GCI: Loaded 44213 existing records from primary storage. [2025-10-27T18:54:58.657846] [INFO ] [MAIN ] GCI: Loaded 44213 existing records. [2025-10-27T18:54:58.820589] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-27T18:54:58.860901] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:54:58.862381] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-27T18:54:58.863751] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T18:54:58.866952] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-27T18:54:58.872616] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-27T18:54:58.872799] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-27T18:54:59.216703] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T18:54:59.241759] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:54:59.614938] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-27T18:55:00.414964] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-27T18:55:00.843783] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T18:55:01.214997] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-27T18:55:01.602359] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T18:55:01.815147] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T18:55:02.014986] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-27T18:55:02.814950] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-27T18:55:03.535563] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:55:03.614907] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-27T18:55:04.258290] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T18:55:04.414924] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-27T18:55:05.215929] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T18:55:05.215097] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-27T18:55:05.835124] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:55:06.014958] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-27T18:55:06.554385] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:55:06.814916] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-27T18:55:07.479086] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T18:55:07.486585] [INFO ] [REMOTE ] GBTG: Full fetch complete (56886 records). [2025-10-27T18:55:07.486698] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-27T18:55:07.622815] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-27T18:55:07.865697] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-27T18:55:07.865821] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-27T18:55:07.866623] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-27T18:55:07.866893] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-27T18:55:07.868155] [DEBUG] [LOCAL ] GBTG: Trimmed 56886 records to 39966 (keeping 200 days of data) [2025-10-27T18:55:08.072757] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T18:55:08.109815] [DEBUG] [LOCAL ] GBTG: Primary data saved (39966 records). [2025-10-27T18:55:08.109913] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-27T18:55:08.109984] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 29.1s. Estimated remaining: 3h 8m 8s. Rate: 7.8 symbols/min [2025-10-27T18:55:08.274259] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:08.295682] [DEBUG] [LOCAL ] GCO: Loaded 23030 existing records from primary storage. [2025-10-27T18:55:08.295915] [INFO ] [MAIN ] GCO: Loaded 23030 existing records. [2025-10-27T18:55:08.420014] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-27T18:55:08.477924] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:08.478097] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-27T18:55:08.478179] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-27T18:55:08.478348] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-27T18:55:08.478388] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-27T18:55:08.824989] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:09.214965] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-27T18:55:09.265687] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T18:55:09.336851] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:55:09.556299] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T18:55:10.014925] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-27T18:55:10.814973] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-27T18:55:11.614984] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-27T18:55:11.674811] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T18:55:11.987202] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T18:55:12.414939] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-27T18:55:12.710808] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T18:55:13.214950] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-27T18:55:13.703119] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T18:55:13.704094] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T18:55:13.704865] [INFO ] [REMOTE ] GBLI: Full fetch complete (1287 records). [2025-10-27T18:55:13.706873] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-27T18:55:13.710841] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T18:55:13.711182] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T18:55:13.711270] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T18:55:13.711359] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-27T18:55:13.711437] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-27T18:55:13.711475] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-27T18:55:13.711514] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-27T18:55:13.711597] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GBLI took 34.8s. Estimated remaining: 3h 7m 57s. Rate: 7.8 symbols/min [2025-10-27T18:55:13.882519] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:13.901769] [DEBUG] [LOCAL ] GCTS: Loaded 20476 existing records from primary storage. [2025-10-27T18:55:13.902006] [INFO ] [MAIN ] GCTS: Loaded 20476 existing records. [2025-10-27T18:55:14.020048] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-27T18:55:14.082042] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:14.082375] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-27T18:55:14.082438] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-27T18:55:14.082623] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-27T18:55:14.082720] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-27T18:55:14.430204] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:14.814957] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-27T18:55:15.614931] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-27T18:55:15.755582] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T18:55:15.778202] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:55:16.414919] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-27T18:55:16.581793] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T18:55:17.214905] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-27T18:55:17.235780] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T18:55:18.014922] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-27T18:55:18.186229] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:55:18.814987] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-27T18:55:19.536260] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T18:55:19.614965] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-27T18:55:20.420050] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-27T18:55:20.430220] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T18:55:20.505747] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T18:55:21.022754] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T18:55:21.214985] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-27T18:55:21.855811] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:55:22.014953] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-27T18:55:22.814939] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-27T18:55:23.587997] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T18:55:23.614907] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-27T18:55:24.200360] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T18:55:24.414975] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-27T18:55:24.616408] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T18:55:25.194022] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T18:55:25.214998] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-27T18:55:26.014952] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-27T18:55:26.713599] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T18:55:26.721718] [INFO ] [REMOTE ] GBX: Full fetch complete (42502 records). [2025-10-27T18:55:26.721826] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-27T18:55:26.820032] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-27T18:55:27.111039] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-27T18:55:27.111121] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-27T18:55:27.111790] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-27T18:55:27.111854] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-27T18:55:27.112844] [DEBUG] [LOCAL ] GBX: Trimmed 42502 records to 27618 (keeping 200 days of data) [2025-10-27T18:55:27.280402] [DEBUG] [LOCAL ] GBX: Primary data saved (27618 records). [2025-10-27T18:55:27.280543] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-27T18:55:27.280625] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GBX took 30.3s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-27T18:55:27.461425] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:27.480965] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:55:27.495479] [DEBUG] [LOCAL ] GCV: Loaded 8030 existing records from primary storage. [2025-10-27T18:55:27.495744] [INFO ] [MAIN ] GCV: Loaded 8030 existing records. [2025-10-27T18:55:27.620155] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-27T18:55:27.689304] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:27.689527] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-27T18:55:27.689575] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-27T18:55:27.689764] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-27T18:55:27.689823] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-27T18:55:28.061289] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:28.418769] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-27T18:55:28.430812] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T18:55:28.508060] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T18:55:28.516437] [INFO ] [REMOTE ] GCI: Full fetch complete (63232 records). [2025-10-27T18:55:28.516604] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-27T18:55:28.903147] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-27T18:55:28.903221] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-27T18:55:28.904139] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-27T18:55:28.904203] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-27T18:55:28.905418] [DEBUG] [LOCAL ] GCI: Trimmed 63232 records to 43427 (keeping 200 days of data) [2025-10-27T18:55:29.148104] [DEBUG] [LOCAL ] GCI: Primary data saved (43427 records). [2025-10-27T18:55:29.148235] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-27T18:55:29.148949] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCI took 30.7s. Estimated remaining: 3h 7m 42s. Rate: 7.8 symbols/min [2025-10-27T18:55:29.220115] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-27T18:55:29.330693] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:29.374422] [DEBUG] [LOCAL ] GD: Loaded 47208 existing records from primary storage. [2025-10-27T18:55:29.374805] [INFO ] [MAIN ] GD: Loaded 47208 existing records. [2025-10-27T18:55:29.552402] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:29.552631] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-27T18:55:29.552715] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-27T18:55:29.552974] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-27T18:55:29.553030] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-27T18:55:29.694965] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T18:55:29.856143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T18:55:29.936078] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:30.014939] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-27T18:55:30.814941] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-27T18:55:31.468782] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T18:55:31.515239] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T18:55:31.614937] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-27T18:55:32.206384] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T18:55:32.414949] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-27T18:55:33.214951] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-27T18:55:33.947076] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T18:55:34.014918] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-27T18:55:34.814915] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-27T18:55:35.025697] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T18:55:35.214718] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T18:55:35.559226] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T18:55:35.614944] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-27T18:55:36.414942] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-27T18:55:36.542157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T18:55:37.214951] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-27T18:55:37.977391] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T18:55:38.014905] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-27T18:55:38.257336] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:55:38.814992] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-27T18:55:39.085968] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T18:55:39.614944] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-27T18:55:39.974795] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T18:55:40.350495] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T18:55:40.414905] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-27T18:55:41.214944] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-27T18:55:41.479804] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T18:55:42.014949] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-27T18:55:42.721345] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:55:42.814991] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-27T18:55:43.132164] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T18:55:43.206834] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T18:55:43.614932] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-27T18:55:44.414999] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-27T18:55:45.214934] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-27T18:55:45.299349] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T18:55:45.303701] [INFO ] [REMOTE ] GCTS: Full fetch complete (26650 records). [2025-10-27T18:55:45.303803] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-27T18:55:45.708762] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T18:55:45.715713] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-27T18:55:45.715792] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-27T18:55:45.725480] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-27T18:55:45.725560] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-27T18:55:45.726959] [DEBUG] [LOCAL ] GCTS: Trimmed 26650 records to 20201 (keeping 200 days of data) [2025-10-27T18:55:45.839083] [DEBUG] [LOCAL ] GCTS: Primary data saved (20201 records). [2025-10-27T18:55:45.839202] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-27T18:55:45.839274] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCTS took 32.1s. Estimated remaining: 3h 7m 49s. Rate: 7.8 symbols/min [2025-10-27T18:55:46.009757] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:46.014919] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-27T18:55:46.060732] [DEBUG] [LOCAL ] GDDY: Loaded 50276 existing records from primary storage. [2025-10-27T18:55:46.061101] [INFO ] [MAIN ] GDDY: Loaded 50276 existing records. [2025-10-27T18:55:46.203145] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T18:55:46.257740] [INFO ] [REMOTE ] GCO: Full fetch complete (34480 records). [2025-10-27T18:55:46.263392] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:46.263789] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-27T18:55:46.263717] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-27T18:55:46.263886] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-27T18:55:46.264240] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-27T18:55:46.264307] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-27T18:55:46.815765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-27T18:55:47.006601] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:47.022736] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-27T18:55:47.022831] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-27T18:55:47.023447] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-27T18:55:47.023489] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-27T18:55:47.024460] [DEBUG] [LOCAL ] GCO: Trimmed 34480 records to 22201 (keeping 200 days of data) [2025-10-27T18:55:47.152113] [DEBUG] [LOCAL ] GCO: Primary data saved (22201 records). [2025-10-27T18:55:47.152247] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-27T18:55:47.152328] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GCO took 39.0s. Estimated remaining: 3h 7m 31s. Rate: 7.8 symbols/min [2025-10-27T18:55:47.326763] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:47.332405] [DEBUG] [LOCAL ] GDIV: Loaded 3552 existing records from primary storage. [2025-10-27T18:55:47.332685] [INFO ] [MAIN ] GDIV: Loaded 3552 existing records. [2025-10-27T18:55:47.517034] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:47.517324] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-27T18:55:47.517447] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-27T18:55:47.517751] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-27T18:55:47.517922] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-27T18:55:47.615937] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-27T18:55:47.673330] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T18:55:47.946119] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T18:55:47.951338] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:48.415022] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-27T18:55:48.886409] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T18:55:49.214926] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-27T18:55:49.321610] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T18:55:49.637350] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T18:55:50.014950] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-27T18:55:50.739304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T18:55:50.814963] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-27T18:55:51.436025] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T18:55:51.614928] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-27T18:55:52.414932] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-27T18:55:53.040923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T18:55:53.214909] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-27T18:55:53.271578] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T18:55:53.658200] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T18:55:54.014964] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-27T18:55:54.814968] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-27T18:55:55.484433] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T18:55:55.614899] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-27T18:55:55.817128] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:55:55.819632] [INFO ] [REMOTE ] GCV: Full fetch complete (10195 records). [2025-10-27T18:55:55.819727] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-27T18:55:56.174134] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-27T18:55:56.174206] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-27T18:55:56.174438] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-27T18:55:56.174476] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-27T18:55:56.174930] [DEBUG] [LOCAL ] GCV: Trimmed 10195 records to 7919 (keeping 200 days of data) [2025-10-27T18:55:56.218932] [DEBUG] [LOCAL ] GCV: Primary data saved (7919 records). [2025-10-27T18:55:56.219049] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-27T18:55:56.219132] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GCV took 28.9s. Estimated remaining: 3h 7m 25s. Rate: 7.8 symbols/min [2025-10-27T18:55:56.383177] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:55:56.387281] [DEBUG] [LOCAL ] GDL: Loaded 2532 existing records from primary storage. [2025-10-27T18:55:56.387447] [INFO ] [MAIN ] GDL: Loaded 2532 existing records. [2025-10-27T18:55:56.420075] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-27T18:55:56.569058] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:55:56.569246] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-27T18:55:56.569331] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-27T18:55:56.569503] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-27T18:55:56.569561] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-27T18:55:56.915702] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:55:57.214935] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-27T18:55:57.316187] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T18:55:57.716167] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T18:55:58.024918] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-27T18:55:58.051052] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T18:55:58.623770] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T18:55:58.814941] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-27T18:55:59.179177] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T18:55:59.614992] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-27T18:55:59.923402] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-27T18:56:00.414999] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-27T18:56:01.214952] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-27T18:56:02.014973] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-27T18:56:02.210830] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T18:56:02.746029] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-27T18:56:02.814938] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-27T18:56:03.400515] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T18:56:03.614975] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-27T18:56:04.384571] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T18:56:04.414917] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-27T18:56:05.042512] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T18:56:05.214918] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-27T18:56:05.985316] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T18:56:06.014902] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-27T18:56:06.814978] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-27T18:56:07.210212] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T18:56:07.219910] [INFO ] [REMOTE ] GD: Full fetch complete (69633 records). [2025-10-27T18:56:07.220108] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-27T18:56:07.319802] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:56:07.626835] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-27T18:56:07.651207] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-27T18:56:07.652527] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-27T18:56:07.653874] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-27T18:56:07.654116] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-27T18:56:07.656111] [DEBUG] [LOCAL ] GD: Trimmed 69633 records to 46417 (keeping 200 days of data) [2025-10-27T18:56:07.793934] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T18:56:08.005560] [DEBUG] [LOCAL ] GD: Primary data saved (46417 records). [2025-10-27T18:56:08.005818] [INFO ] [MAIN ] GD: Full history saved. [2025-10-27T18:56:08.006712] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GD took 38.9s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-27T18:56:08.086358] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T18:56:08.188706] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:08.197342] [DEBUG] [LOCAL ] GDO: Loaded 5931 existing records from primary storage. [2025-10-27T18:56:08.197560] [INFO ] [MAIN ] GDO: Loaded 5931 existing records. [2025-10-27T18:56:08.379581] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:08.379814] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-27T18:56:08.379862] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-27T18:56:08.380090] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-27T18:56:08.380150] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-27T18:56:08.420076] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-27T18:56:08.752997] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:08.791163] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T18:56:09.214943] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-27T18:56:10.015002] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-27T18:56:10.361423] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T18:56:10.815011] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-27T18:56:11.015282] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T18:56:11.166745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T18:56:11.614968] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-27T18:56:12.414941] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-27T18:56:12.948388] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T18:56:13.214913] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-27T18:56:13.366467] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T18:56:13.376316] [INFO ] [REMOTE ] GDDY: Full fetch complete (72089 records). [2025-10-27T18:56:13.376460] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-27T18:56:13.688586] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T18:56:13.786265] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-27T18:56:13.786354] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-27T18:56:13.787398] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-27T18:56:13.787488] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-27T18:56:13.789131] [DEBUG] [LOCAL ] GDDY: Trimmed 72089 records to 49453 (keeping 200 days of data) [2025-10-27T18:56:14.014963] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-27T18:56:14.085738] [DEBUG] [LOCAL ] GDDY: Primary data saved (49453 records). [2025-10-27T18:56:14.085866] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-27T18:56:14.086341] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDDY took 28.2s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-10-27T18:56:14.257226] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:14.295573] [DEBUG] [LOCAL ] GDOT: Loaded 38172 existing records from primary storage. [2025-10-27T18:56:14.295866] [INFO ] [MAIN ] GDOT: Loaded 38172 existing records. [2025-10-27T18:56:14.476203] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:14.476444] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-27T18:56:14.476491] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-27T18:56:14.476826] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-27T18:56:14.476886] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-27T18:56:14.579676] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T18:56:14.817588] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-27T18:56:14.847192] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:15.413965] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:56:15.415084] [INFO ] [REMOTE ] GDIV: Full fetch complete (5409 records). [2025-10-27T18:56:15.415151] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-27T18:56:15.616687] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-27T18:56:15.774708] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-27T18:56:15.774787] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-27T18:56:15.774957] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-27T18:56:15.774995] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-27T18:56:15.775353] [DEBUG] [LOCAL ] GDIV: Trimmed 5409 records to 3405 (keeping 200 days of data) [2025-10-27T18:56:15.795791] [DEBUG] [LOCAL ] GDIV: Primary data saved (3405 records). [2025-10-27T18:56:15.795872] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-27T18:56:15.795941] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDIV took 28.6s. Estimated remaining: 3h 6m 56s. Rate: 7.8 symbols/min [2025-10-27T18:56:15.964850] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:15.984043] [DEBUG] [LOCAL ] GDV: Loaded 19349 existing records from primary storage. [2025-10-27T18:56:15.984308] [INFO ] [MAIN ] GDV: Loaded 19349 existing records. [2025-10-27T18:56:16.103045] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T18:56:16.170470] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:16.170702] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-27T18:56:16.170761] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-27T18:56:16.170992] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-27T18:56:16.171032] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-27T18:56:16.420031] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-27T18:56:16.529800] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:17.214993] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-27T18:56:17.685425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T18:56:17.748943] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T18:56:17.750446] [INFO ] [REMOTE ] GDL: Full fetch complete (3453 records). [2025-10-27T18:56:17.750532] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-27T18:56:18.024760] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-27T18:56:18.259433] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-27T18:56:18.259548] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-27T18:56:18.259728] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-27T18:56:18.259789] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-27T18:56:18.260339] [DEBUG] [LOCAL ] GDL: Trimmed 3453 records to 2495 (keeping 200 days of data) [2025-10-27T18:56:18.276009] [DEBUG] [LOCAL ] GDL: Primary data saved (2495 records). [2025-10-27T18:56:18.276155] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-27T18:56:18.276244] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDL took 22.1s. Estimated remaining: 3h 6m 40s. Rate: 7.8 symbols/min [2025-10-27T18:56:18.460309] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:18.513364] [DEBUG] [LOCAL ] GE: Loaded 54473 existing records from primary storage. [2025-10-27T18:56:18.513732] [INFO ] [MAIN ] GE: Loaded 54473 existing records. [2025-10-27T18:56:18.689801] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:18.689992] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-27T18:56:18.690038] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-27T18:56:18.690367] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-27T18:56:18.690423] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-27T18:56:18.826357] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-27T18:56:19.048774] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:19.064005] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:56:19.614983] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-27T18:56:19.767534] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T18:56:20.414964] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-27T18:56:21.215002] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-27T18:56:21.354013] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T18:56:21.436860] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T18:56:22.014947] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-27T18:56:22.468713] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T18:56:22.814987] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-27T18:56:23.614959] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-27T18:56:23.754095] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T18:56:23.947828] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T18:56:24.414919] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-27T18:56:24.475791] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T18:56:25.214991] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-27T18:56:26.014949] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-27T18:56:26.487310] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T18:56:26.695060] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-27T18:56:26.728181] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T18:56:26.814902] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-27T18:56:27.614945] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-27T18:56:28.260296] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T18:56:28.405541] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T18:56:28.414931] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-27T18:56:29.214980] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-27T18:56:29.570268] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T18:56:30.014953] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-27T18:56:30.814935] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-27T18:56:30.901343] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T18:56:31.392913] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T18:56:31.614928] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-27T18:56:32.052702] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T18:56:32.414997] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-27T18:56:33.214928] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-27T18:56:33.377098] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T18:56:33.601922] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T18:56:33.941801] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:56:34.014966] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-27T18:56:34.814942] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-27T18:56:35.614934] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-27T18:56:35.747934] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T18:56:36.233533] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T18:56:36.242266] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T18:56:36.414942] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-27T18:56:37.214982] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-27T18:56:37.513626] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T18:56:37.520887] [INFO ] [REMOTE ] GDOT: Full fetch complete (53745 records). [2025-10-27T18:56:37.520977] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-27T18:56:37.897105] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-27T18:56:37.897183] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-27T18:56:37.897994] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-27T18:56:37.898059] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-27T18:56:37.899157] [DEBUG] [LOCAL ] GDOT: Trimmed 53745 records to 37431 (keeping 200 days of data) [2025-10-27T18:56:38.052019] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-27T18:56:38.114786] [DEBUG] [LOCAL ] GDOT: Primary data saved (37431 records). [2025-10-27T18:56:38.114933] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-27T18:56:38.115391] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDOT took 24.0s. Estimated remaining: 3h 6m 52s. Rate: 7.8 symbols/min [2025-10-27T18:56:38.285384] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:38.307352] [DEBUG] [LOCAL ] GEF: Loaded 20945 existing records from primary storage. [2025-10-27T18:56:38.307590] [INFO ] [MAIN ] GEF: Loaded 20945 existing records. [2025-10-27T18:56:38.481919] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:38.482122] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-27T18:56:38.482167] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-27T18:56:38.482450] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-27T18:56:38.482526] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-27T18:56:38.769390] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T18:56:38.821357] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-27T18:56:38.853207] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:39.192793] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T18:56:39.614938] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-27T18:56:39.845272] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T18:56:40.414938] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-27T18:56:40.443792] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T18:56:40.795878] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T18:56:41.214945] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-27T18:56:41.892273] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T18:56:42.014942] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-27T18:56:42.814958] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-27T18:56:42.998121] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T18:56:43.614930] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-27T18:56:43.845998] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T18:56:44.414951] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-27T18:56:44.448257] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T18:56:45.091826] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:56:45.214928] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-27T18:56:45.612896] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T18:56:46.014941] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-27T18:56:46.814951] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-27T18:56:47.398663] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T18:56:47.614993] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-27T18:56:48.156131] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T18:56:48.414903] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-27T18:56:48.731903] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T18:56:49.214992] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-27T18:56:49.338109] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:56:50.014951] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-27T18:56:50.814913] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-27T18:56:50.860979] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T18:56:50.963798] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T18:56:51.448261] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T18:56:51.449778] [INFO ] [REMOTE ] GDO: Full fetch complete (8440 records). [2025-10-27T18:56:51.449845] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-27T18:56:51.621800] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-27T18:56:51.808577] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-27T18:56:51.808692] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-27T18:56:51.808969] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-27T18:56:51.809035] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-27T18:56:51.809619] [DEBUG] [LOCAL ] GDO: Trimmed 8440 records to 5681 (keeping 200 days of data) [2025-10-27T18:56:51.845864] [DEBUG] [LOCAL ] GDO: Primary data saved (5681 records). [2025-10-27T18:56:51.845992] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-27T18:56:51.846075] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDO took 43.8s. Estimated remaining: 3h 6m 54s. Rate: 7.8 symbols/min [2025-10-27T18:56:52.013526] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:52.046688] [DEBUG] [LOCAL ] GEL: Loaded 31489 existing records from primary storage. [2025-10-27T18:56:52.046986] [INFO ] [MAIN ] GEL: Loaded 31489 existing records. [2025-10-27T18:56:52.224864] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:52.225097] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-27T18:56:52.225145] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-27T18:56:52.225447] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-27T18:56:52.225506] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-27T18:56:52.420821] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-27T18:56:52.580034] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:53.215000] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-27T18:56:53.654260] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:56:53.879155] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-27T18:56:53.890787] [INFO ] [REMOTE ] GE: Full fetch complete (77858 records). [2025-10-27T18:56:53.891110] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-27T18:56:54.020132] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-27T18:56:54.343099] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-27T18:56:54.343213] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-27T18:56:54.344431] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-27T18:56:54.344507] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-27T18:56:54.346498] [DEBUG] [LOCAL ] GE: Trimmed 77858 records to 53689 (keeping 200 days of data) [2025-10-27T18:56:54.608525] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T18:56:54.744385] [DEBUG] [LOCAL ] GE: Primary data saved (53689 records). [2025-10-27T18:56:54.744601] [INFO ] [MAIN ] GE: Full history saved. [2025-10-27T18:56:54.744731] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GE took 36.5s. Estimated remaining: 3h 6m 39s. Rate: 7.8 symbols/min [2025-10-27T18:56:54.816745] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-27T18:56:54.924883] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:54.943685] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T18:56:55.000355] [DEBUG] [LOCAL ] GENI: Loaded 53659 existing records from primary storage. [2025-10-27T18:56:55.000826] [INFO ] [MAIN ] GENI: Loaded 53659 existing records. [2025-10-27T18:56:55.179733] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:55.180100] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-27T18:56:55.180159] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-27T18:56:55.180428] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-27T18:56:55.180515] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-27T18:56:55.540357] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:55.614963] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-27T18:56:55.775375] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T18:56:56.393136] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T18:56:56.414907] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-27T18:56:57.209999] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T18:56:57.215090] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-27T18:56:58.002687] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T18:56:58.006971] [INFO ] [REMOTE ] GEF: Full fetch complete (29259 records). [2025-10-27T18:56:58.007051] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-27T18:56:58.020042] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-27T18:56:58.401739] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-27T18:56:58.401820] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-27T18:56:58.402431] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-27T18:56:58.402470] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-27T18:56:58.403162] [DEBUG] [LOCAL ] GEF: Trimmed 29259 records to 20495 (keeping 200 days of data) [2025-10-27T18:56:58.528699] [DEBUG] [LOCAL ] GEF: Primary data saved (20495 records). [2025-10-27T18:56:58.528873] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-27T18:56:58.528986] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GEF took 20.4s. Estimated remaining: 3h 6m 25s. Rate: 7.8 symbols/min [2025-10-27T18:56:58.711091] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:56:58.760088] [DEBUG] [LOCAL ] GEO: Loaded 52386 existing records from primary storage. [2025-10-27T18:56:58.760428] [INFO ] [MAIN ] GEO: Loaded 52386 existing records. [2025-10-27T18:56:58.823445] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-27T18:56:58.940508] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:56:58.940753] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-27T18:56:58.940810] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-27T18:56:58.940994] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-27T18:56:58.941031] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-27T18:56:59.295492] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:56:59.357084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T18:56:59.614940] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-27T18:56:59.647019] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T18:56:59.651120] [INFO ] [REMOTE ] GDV: Full fetch complete (28175 records). [2025-10-27T18:56:59.651204] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-27T18:57:00.018853] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-27T18:57:00.018932] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-27T18:57:00.019473] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-27T18:57:00.019515] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-27T18:57:00.020266] [DEBUG] [LOCAL ] GDV: Trimmed 28175 records to 18804 (keeping 200 days of data) [2025-10-27T18:57:00.132585] [DEBUG] [LOCAL ] GDV: Primary data saved (18804 records). [2025-10-27T18:57:00.132752] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-27T18:57:00.132838] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GDV took 44.3s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-27T18:57:00.297138] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:00.338558] [DEBUG] [LOCAL ] GES: Loaded 38332 existing records from primary storage. [2025-10-27T18:57:00.338884] [INFO ] [MAIN ] GES: Loaded 38332 existing records. [2025-10-27T18:57:00.420130] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-27T18:57:00.514731] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:00.514925] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-27T18:57:00.514970] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-27T18:57:00.515237] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-27T18:57:00.515293] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-27T18:57:00.877537] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:01.214935] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-27T18:57:01.346057] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T18:57:02.015035] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-27T18:57:02.227006] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T18:57:02.722428] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T18:57:02.815002] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-27T18:57:03.614970] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-27T18:57:03.837241] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T18:57:03.876467] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T18:57:04.414940] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-27T18:57:05.215018] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-27T18:57:05.266407] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T18:57:05.942567] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T18:57:06.015075] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-27T18:57:06.624848] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T18:57:06.814983] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-27T18:57:07.459354] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T18:57:07.614942] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-27T18:57:08.414945] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-27T18:57:08.623577] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T18:57:09.197339] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T18:57:09.214896] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-27T18:57:09.409530] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T18:57:10.014984] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-27T18:57:10.814981] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-27T18:57:11.059010] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T18:57:11.197948] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T18:57:11.614982] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-27T18:57:12.209557] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T18:57:12.414965] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-27T18:57:13.214920] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-27T18:57:13.316363] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T18:57:13.924593] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T18:57:14.014990] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-27T18:57:14.312346] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T18:57:14.814959] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-27T18:57:15.614966] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-27T18:57:15.839966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:57:15.931549] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T18:57:16.414960] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-27T18:57:17.214950] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-27T18:57:17.297495] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:57:17.451675] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:57:18.014941] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-27T18:57:18.814938] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-27T18:57:18.988481] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T18:57:19.261899] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:57:19.614965] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-27T18:57:20.414944] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-27T18:57:20.460787] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T18:57:20.971960] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T18:57:21.214936] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-27T18:57:21.414052] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T18:57:21.418439] [INFO ] [REMOTE ] GEL: Full fetch complete (47749 records). [2025-10-27T18:57:21.418531] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-27T18:57:21.793614] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-27T18:57:21.793724] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-27T18:57:21.794516] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-27T18:57:21.794559] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-27T18:57:21.795674] [DEBUG] [LOCAL ] GEL: Trimmed 47749 records to 30690 (keeping 200 days of data) [2025-10-27T18:57:21.973706] [DEBUG] [LOCAL ] GEL: Primary data saved (30690 records). [2025-10-27T18:57:21.973837] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-27T18:57:21.974605] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GEL took 30.1s. Estimated remaining: 3h 6m 22s. Rate: 7.8 symbols/min [2025-10-27T18:57:22.020065] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-27T18:57:22.145600] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:22.181419] [DEBUG] [LOCAL ] GETY: Loaded 35795 existing records from primary storage. [2025-10-27T18:57:22.181706] [INFO ] [MAIN ] GETY: Loaded 35795 existing records. [2025-10-27T18:57:22.359798] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:22.360044] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-27T18:57:22.360102] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-27T18:57:22.360446] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-27T18:57:22.360518] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-27T18:57:22.723485] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:22.814909] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-27T18:57:23.381920] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T18:57:23.391826] [INFO ] [REMOTE ] GENI: Full fetch complete (76067 records). [2025-10-27T18:57:23.391945] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-27T18:57:23.636614] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-27T18:57:23.784189] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-27T18:57:23.784293] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-27T18:57:23.785359] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-27T18:57:23.785438] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-27T18:57:23.786974] [DEBUG] [LOCAL ] GENI: Trimmed 76067 records to 52863 (keeping 200 days of data) [2025-10-27T18:57:24.035057] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T18:57:24.143846] [DEBUG] [LOCAL ] GENI: Primary data saved (52863 records). [2025-10-27T18:57:24.143980] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-27T18:57:24.144072] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GENI took 29.4s. Estimated remaining: 3h 6m 6s. Rate: 7.8 symbols/min [2025-10-27T18:57:24.319135] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:24.369270] [DEBUG] [LOCAL ] GEV: Loaded 53767 existing records from primary storage. [2025-10-27T18:57:24.369591] [INFO ] [MAIN ] GEV: Loaded 53767 existing records. [2025-10-27T18:57:24.422772] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-27T18:57:24.549539] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:24.549751] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-27T18:57:24.549802] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-27T18:57:24.550112] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-27T18:57:24.550152] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-27T18:57:24.913984] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:24.950993] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T18:57:24.974230] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T18:57:25.214978] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-27T18:57:26.014929] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-27T18:57:26.461099] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-27T18:57:26.498700] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T18:57:26.814939] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-27T18:57:27.614983] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-27T18:57:28.221167] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-27T18:57:28.414903] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-27T18:57:28.749571] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T18:57:28.759130] [INFO ] [REMOTE ] GEO: Full fetch complete (75415 records). [2025-10-27T18:57:28.759271] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-27T18:57:29.164673] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-27T18:57:29.164825] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-27T18:57:29.166065] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-27T18:57:29.166214] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-27T18:57:29.168323] [DEBUG] [LOCAL ] GEO: Trimmed 75415 records to 51578 (keeping 200 days of data) [2025-10-27T18:57:29.215684] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-27T18:57:29.297398] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T18:57:29.504910] [DEBUG] [LOCAL ] GEO: Primary data saved (51578 records). [2025-10-27T18:57:29.505066] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-27T18:57:29.505631] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GEO took 31.0s. Estimated remaining: 3h 5m 54s. Rate: 7.8 symbols/min [2025-10-27T18:57:29.685051] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:57:29.690198] [DEBUG] [LOCAL ] GF: Loaded 2647 existing records from primary storage. [2025-10-27T18:57:29.690387] [INFO ] [MAIN ] GF: Loaded 2647 existing records. [2025-10-27T18:57:29.873606] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:57:29.873928] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-27T18:57:29.873989] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-27T18:57:29.874178] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-27T18:57:29.874235] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-27T18:57:30.020079] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-27T18:57:30.226273] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:57:30.322617] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T18:57:30.730856] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T18:57:30.814903] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-27T18:57:31.605104] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T18:57:31.614903] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-27T18:57:32.009067] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T18:57:32.414988] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-27T18:57:32.785713] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T18:57:33.214946] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-27T18:57:33.526733] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T18:57:34.014936] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-27T18:57:34.814941] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-27T18:57:35.203129] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T18:57:35.489103] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:57:35.535533] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-27T18:57:35.614940] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-27T18:57:36.414973] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-27T18:57:36.780424] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T18:57:37.200801] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T18:57:37.214914] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-27T18:57:38.014932] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-27T18:57:38.657172] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T18:57:38.814923] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-27T18:57:39.614937] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-27T18:57:40.001157] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T18:57:40.285670] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T18:57:40.318181] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T18:57:40.414949] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-27T18:57:41.214932] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-27T18:57:41.491474] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T18:57:41.498315] [INFO ] [REMOTE ] GES: Full fetch complete (58208 records). [2025-10-27T18:57:41.498428] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-27T18:57:41.906583] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-27T18:57:41.906691] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-27T18:57:41.907502] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-27T18:57:41.907564] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-27T18:57:41.908722] [DEBUG] [LOCAL ] GES: Trimmed 58208 records to 37496 (keeping 200 days of data) [2025-10-27T18:57:42.016220] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-27T18:57:42.129346] [DEBUG] [LOCAL ] GES: Primary data saved (37496 records). [2025-10-27T18:57:42.129479] [INFO ] [MAIN ] GES: Full history saved. [2025-10-27T18:57:42.129557] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GES took 42.0s. Estimated remaining: 3h 5m 55s. Rate: 7.8 symbols/min [2025-10-27T18:57:42.546294] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T18:57:42.654598] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T18:57:42.814928] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-27T18:57:43.463529] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T18:57:43.614912] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-27T18:57:44.288551] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T18:57:44.414974] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-27T18:57:45.214991] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-27T18:57:45.625907] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T18:57:45.633251] [INFO ] [REMOTE ] GETY: Full fetch complete (55359 records). [2025-10-27T18:57:45.633358] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-27T18:57:46.025473] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-27T18:57:46.028514] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-27T18:57:46.028890] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-27T18:57:46.030561] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-27T18:57:46.030676] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-27T18:57:46.032030] [DEBUG] [LOCAL ] GETY: Trimmed 55359 records to 35015 (keeping 200 days of data) [2025-10-27T18:57:46.223957] [DEBUG] [LOCAL ] GETY: Primary data saved (35015 records). [2025-10-27T18:57:46.224092] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-27T18:57:46.224168] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GETY took 24.2s. Estimated remaining: 3h 5m 41s. Rate: 7.8 symbols/min [2025-10-27T18:57:46.532829] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-27T18:57:46.814951] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-27T18:57:47.199811] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T18:57:47.620094] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-27T18:57:47.642739] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-27T18:57:48.012039] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T18:57:48.414989] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-27T18:57:49.215010] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-27T18:57:49.853111] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T18:57:49.853999] [INFO ] [REMOTE ] GF: Full fetch complete (4834 records). [2025-10-27T18:57:49.854065] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-27T18:57:50.214832] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-27T18:57:50.214903] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-27T18:57:50.215046] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-27T18:57:50.215082] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-27T18:57:50.215418] [DEBUG] [LOCAL ] GF: Trimmed 4834 records to 2566 (keeping 200 days of data) [2025-10-27T18:57:50.230665] [DEBUG] [LOCAL ] GF: Primary data saved (2566 records). [2025-10-27T18:57:50.230736] [INFO ] [MAIN ] GF: Full history saved. [2025-10-27T18:57:50.230803] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GF took 20.7s. Estimated remaining: 3h 5m 28s. Rate: 7.8 symbols/min [2025-10-27T18:57:50.679416] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T18:57:50.690151] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-27T18:57:53.176894] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-27T18:57:53.189021] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-27T18:57:55.572058] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-27T18:57:55.583528] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-27T18:57:57.643308] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-27T18:57:57.654563] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-27T18:58:00.130489] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-27T18:58:00.143929] [INFO ] [REMOTE ] GEV: Full fetch complete (77058 records). [2025-10-27T18:58:00.144099] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-27T18:58:00.534922] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-27T18:58:00.535015] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-27T18:58:00.535950] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-27T18:58:00.536014] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-27T18:58:00.537494] [DEBUG] [LOCAL ] GEV: Trimmed 77058 records to 52985 (keeping 200 days of data) [2025-10-27T18:58:00.866358] [DEBUG] [LOCAL ] GEV: Primary data saved (52985 records). [2025-10-27T18:58:00.866490] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-27T18:58:00.866566] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GEV took 36.7s. Estimated remaining: 3h 5m 25s. Rate: 7.8 symbols/min [2025-10-27T18:58:01.503284] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.546800] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.618528] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.619890] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:01.630324] [DEBUG] [LOCAL ] GFR: Loaded 7419 existing records from primary storage. [2025-10-27T18:58:01.630598] [INFO ] [MAIN ] GFR: Loaded 7419 existing records. [2025-10-27T18:58:01.868916] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:01.869230] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-27T18:58:01.869283] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-27T18:58:01.869421] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-27T18:58:01.869465] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-27T18:58:01.894380] [DEBUG] [LOCAL ] GFF: Loaded 29679 existing records from primary storage. [2025-10-27T18:58:01.954430] [INFO ] [MAIN ] GFF: Loaded 29679 existing records. [2025-10-27T18:58:02.007590] [DEBUG] [LOCAL ] GFI: Loaded 53895 existing records from primary storage. [2025-10-27T18:58:02.024104] [INFO ] [MAIN ] GFI: Loaded 53895 existing records. [2025-10-27T18:58:02.042245] [DEBUG] [LOCAL ] GFL: Loaded 48095 existing records from primary storage. [2025-10-27T18:58:02.143270] [INFO ] [MAIN ] GFL: Loaded 48095 existing records. [2025-10-27T18:58:02.666324] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.689415] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.690221] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.695754] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-27T18:58:02.722075] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-27T18:58:02.716713] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.756609] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-27T18:58:02.756747] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-27T18:58:02.839342] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:02.896951] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-27T18:58:02.911169] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:02.911484] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-27T18:58:02.911301] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-27T18:58:02.931141] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-27T18:58:02.937706] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-27T18:58:02.937913] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-27T18:58:03.005299] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-27T18:58:03.786572] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:03.823901] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-27T18:58:03.894021] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T18:58:03.953300] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-27T18:58:03.998536] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:04.005161] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-27T18:58:04.031792] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:04.032267] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-27T18:58:04.439533] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T18:58:04.441964] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-27T18:58:04.932941] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T18:58:04.937572] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-27T18:58:05.187045] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T18:58:05.196225] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-27T18:58:05.250057] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T18:58:05.256158] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-27T18:58:05.453618] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T18:58:05.456930] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-27T18:58:05.561970] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T18:58:05.572125] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-27T18:58:06.250787] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T18:58:06.253706] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-27T18:58:06.547674] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T18:58:06.554370] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-27T18:58:06.648173] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T18:58:06.662902] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:58:06.662704] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-27T18:58:06.665983] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-27T18:58:07.092216] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T18:58:07.107412] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-27T18:58:07.285801] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T18:58:07.287774] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-27T18:58:07.524302] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T18:58:07.535365] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-27T18:58:07.714426] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T18:58:07.716340] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-27T18:58:08.291182] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T18:58:08.414925] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-27T18:58:08.631905] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T18:58:08.636041] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T18:58:08.705274] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T18:58:09.214974] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-27T18:58:10.014986] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-27T18:58:10.138306] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T18:58:10.777358] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T18:58:10.779043] [INFO ] [REMOTE ] GFR: Full fetch complete (11909 records). [2025-10-27T18:58:10.779117] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-27T18:58:10.820405] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-27T18:58:11.148078] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-27T18:58:11.148316] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-27T18:58:11.148700] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-27T18:58:11.148977] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-27T18:58:11.149804] [DEBUG] [LOCAL ] GFR: Trimmed 11909 records to 6925 (keeping 200 days of data) [2025-10-27T18:58:11.212359] [DEBUG] [LOCAL ] GFR: Primary data saved (6925 records). [2025-10-27T18:58:11.215337] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-27T18:58:11.215423] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 10.3s. Estimated remaining: 3h 5m 21s. Rate: 7.8 symbols/min [2025-10-27T18:58:11.284841] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T18:58:11.393901] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:11.439222] [DEBUG] [LOCAL ] GGB: Loaded 52322 existing records from primary storage. [2025-10-27T18:58:11.439507] [INFO ] [MAIN ] GGB: Loaded 52322 existing records. [2025-10-27T18:58:11.615747] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:11.615829] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-27T18:58:11.616058] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-27T18:58:11.616132] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-27T18:58:11.616948] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-27T18:58:11.617008] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-27T18:58:11.967396] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:12.258884] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T18:58:12.414994] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-27T18:58:13.214920] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-27T18:58:13.328305] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T18:58:14.020031] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-27T18:58:14.038417] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T18:58:14.814973] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-27T18:58:15.070353] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T18:58:15.179804] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:58:15.614997] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-27T18:58:16.041849] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T18:58:16.414979] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-27T18:58:16.974818] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T18:58:17.214920] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-27T18:58:17.639392] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T18:58:18.014926] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-27T18:58:18.580287] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T18:58:18.814973] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-27T18:58:19.580382] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T18:58:19.614898] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-27T18:58:20.162750] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T18:58:20.414949] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-27T18:58:20.918723] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T18:58:21.214927] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-27T18:58:21.514081] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T18:58:22.014923] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-27T18:58:22.621454] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T18:58:22.814933] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-27T18:58:23.265357] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:58:23.614937] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-27T18:58:24.418187] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-27T18:58:24.436728] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T18:58:24.461244] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T18:58:24.466118] [INFO ] [REMOTE ] GFF: Full fetch complete (43426 records). [2025-10-27T18:58:24.466217] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-27T18:58:24.842987] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-27T18:58:24.843072] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-27T18:58:24.843773] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-27T18:58:24.843835] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-27T18:58:24.844870] [DEBUG] [LOCAL ] GFF: Trimmed 43426 records to 28918 (keeping 200 days of data) [2025-10-27T18:58:25.020965] [DEBUG] [LOCAL ] GFF: Primary data saved (28918 records). [2025-10-27T18:58:25.021104] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-27T18:58:25.021183] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFF took 24.2s. Estimated remaining: 3h 5m 23s. Rate: 7.8 symbols/min [2025-10-27T18:58:25.188800] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:25.214940] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-27T18:58:25.228351] [DEBUG] [LOCAL ] GGG: Loaded 41285 existing records from primary storage. [2025-10-27T18:58:25.228638] [INFO ] [MAIN ] GGG: Loaded 41285 existing records. [2025-10-27T18:58:25.407709] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:25.407931] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-27T18:58:25.407977] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-27T18:58:25.408693] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-27T18:58:25.408795] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-27T18:58:25.766780] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:25.829349] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T18:58:26.014940] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-27T18:58:26.814915] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-27T18:58:27.018749] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T18:58:27.334200] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T18:58:27.614939] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-27T18:58:28.365287] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T18:58:28.414972] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-27T18:58:29.214948] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-27T18:58:29.439521] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T18:58:29.518217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T18:58:30.014933] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-27T18:58:30.610052] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T18:58:30.814948] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-27T18:58:31.614953] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-27T18:58:31.961062] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T18:58:32.286981] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T18:58:32.414936] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-27T18:58:32.860159] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T18:58:33.214932] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-27T18:58:34.014919] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-27T18:58:34.271845] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T18:58:34.280814] [INFO ] [REMOTE ] GFL: Full fetch complete (69586 records). [2025-10-27T18:58:34.280940] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-27T18:58:34.664737] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-27T18:58:34.664842] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-27T18:58:34.665710] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-27T18:58:34.665772] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-27T18:58:34.667096] [DEBUG] [LOCAL ] GFL: Trimmed 69586 records to 47263 (keeping 200 days of data) [2025-10-27T18:58:34.835300] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-27T18:58:34.945172] [DEBUG] [LOCAL ] GFL: Primary data saved (47263 records). [2025-10-27T18:58:34.945298] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-27T18:58:34.945372] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFL took 34.1s. Estimated remaining: 3h 5m 19s. Rate: 7.8 symbols/min [2025-10-27T18:58:35.110607] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:35.125966] [DEBUG] [LOCAL ] GGT: Loaded 14679 existing records from primary storage. [2025-10-27T18:58:35.126247] [INFO ] [MAIN ] GGT: Loaded 14679 existing records. [2025-10-27T18:58:35.307532] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:35.307893] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-27T18:58:35.307963] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-27T18:58:35.308159] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-27T18:58:35.308225] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-27T18:58:35.694334] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:35.694842] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-27T18:58:35.722739] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T18:58:35.733119] [INFO ] [REMOTE ] GFI: Full fetch complete (77024 records). [2025-10-27T18:58:35.733251] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-27T18:58:36.112724] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-27T18:58:36.166862] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-27T18:58:36.167259] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-27T18:58:36.168294] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-27T18:58:36.168528] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-27T18:58:36.168911] [INFO ] [REMOTE ] GGB: Full fetch complete (74396 records). [2025-10-27T18:58:36.169105] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-27T18:58:36.191986] [DEBUG] [LOCAL ] GFI: Trimmed 77024 records to 53115 (keeping 200 days of data) [2025-10-27T18:58:36.371362] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T18:58:36.451044] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T18:58:36.566220] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-27T18:58:36.922027] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-27T18:58:36.922132] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-27T18:58:36.923084] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-27T18:58:36.923165] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-27T18:58:36.953159] [DEBUG] [LOCAL ] GGB: Trimmed 74396 records to 51546 (keeping 200 days of data) [2025-10-27T18:58:36.958522] [DEBUG] [LOCAL ] GFI: Primary data saved (53115 records). [2025-10-27T18:58:36.959123] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-27T18:58:36.960424] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GFI took 36.1s. Estimated remaining: 3h 5m 2s. Rate: 7.8 symbols/min [2025-10-27T18:58:37.227530] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:37.224744] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-27T18:58:37.243445] [DEBUG] [LOCAL ] GGZ: Loaded 2362 existing records from primary storage. [2025-10-27T18:58:37.245229] [INFO ] [MAIN ] GGZ: Loaded 2362 existing records. [2025-10-27T18:58:37.513739] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:37.532164] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T18:58:37.536009] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-27T18:58:37.536328] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-27T18:58:37.542024] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-27T18:58:37.542377] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-27T18:58:37.781563] [DEBUG] [LOCAL ] GGB: Primary data saved (51546 records). [2025-10-27T18:58:37.842471] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-27T18:58:37.869005] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGB took 26.7s. Estimated remaining: 3h 4m 44s. Rate: 7.8 symbols/min [2025-10-27T18:58:38.015607] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-27T18:58:38.154416] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:38.158554] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:38.163937] [DEBUG] [LOCAL ] GHC: Loaded 2993 existing records from primary storage. [2025-10-27T18:58:38.164087] [INFO ] [MAIN ] GHC: Loaded 2993 existing records. [2025-10-27T18:58:38.344410] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:38.344575] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-27T18:58:38.344637] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-27T18:58:38.344825] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-27T18:58:38.344889] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-27T18:58:38.723191] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:38.814907] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-27T18:58:38.855064] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T18:58:38.915350] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T18:58:39.375784] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T18:58:39.614969] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-27T18:58:40.414985] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-27T18:58:41.077427] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T18:58:41.214941] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-27T18:58:41.230447] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T18:58:42.014928] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-27T18:58:42.390824] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T18:58:42.611470] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T18:58:42.814969] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-27T18:58:43.397550] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T18:58:43.614932] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-27T18:58:44.015961] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T18:58:44.414913] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-27T18:58:44.824412] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T18:58:45.214932] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-27T18:58:45.922828] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T18:58:46.014907] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-27T18:58:46.814994] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-27T18:58:47.173219] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T18:58:47.280613] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T18:58:47.614941] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-27T18:58:48.414963] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-27T18:58:48.716529] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T18:58:48.926288] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T18:58:49.215003] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-27T18:58:50.014932] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-27T18:58:50.742537] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T18:58:50.743115] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:58:50.814900] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-27T18:58:51.615000] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-27T18:58:52.160081] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T18:58:52.301185] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T18:58:52.414946] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-27T18:58:53.214953] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-27T18:58:53.445630] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T18:58:54.014960] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-27T18:58:54.544993] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T18:58:54.726422] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:58:54.734522] [INFO ] [REMOTE ] GGG: Full fetch complete (59600 records). [2025-10-27T18:58:54.734679] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-27T18:58:54.820124] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-27T18:58:55.118866] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-27T18:58:55.118956] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-27T18:58:55.119840] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-27T18:58:55.119903] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-27T18:58:55.121367] [DEBUG] [LOCAL ] GGG: Trimmed 59600 records to 40459 (keeping 200 days of data) [2025-10-27T18:58:55.333807] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T18:58:55.376135] [DEBUG] [LOCAL ] GGG: Primary data saved (40459 records). [2025-10-27T18:58:55.376258] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-27T18:58:55.376336] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GGG took 30.4s. Estimated remaining: 3h 4m 51s. Rate: 7.8 symbols/min [2025-10-27T18:58:55.551271] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:58:55.555820] [DEBUG] [LOCAL ] GHG: Loaded 3310 existing records from primary storage. [2025-10-27T18:58:55.555969] [INFO ] [MAIN ] GHG: Loaded 3310 existing records. [2025-10-27T18:58:55.620145] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-27T18:58:55.740066] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:58:55.740270] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-27T18:58:55.740316] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-27T18:58:55.740445] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-27T18:58:55.740482] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-27T18:58:56.087174] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:58:56.113717] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T18:58:56.414949] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-27T18:58:57.137664] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T18:58:57.214949] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-27T18:58:57.746807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T18:58:58.014943] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-27T18:58:58.458630] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T18:58:58.814940] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-27T18:58:59.144237] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T18:58:59.614927] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-27T18:58:59.900560] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T18:59:00.414945] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-27T18:59:01.092696] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T18:59:01.214980] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-27T18:59:02.015034] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-27T18:59:02.618750] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T18:59:02.814997] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-27T18:59:03.050751] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:59:03.389092] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T18:59:03.391288] [INFO ] [REMOTE ] GHC: Full fetch complete (3710 records). [2025-10-27T18:59:03.391577] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-27T18:59:03.620051] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-27T18:59:03.853488] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-27T18:59:03.853564] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-27T18:59:03.853716] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-27T18:59:03.853777] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-27T18:59:03.854162] [DEBUG] [LOCAL ] GHC: Trimmed 3710 records to 2950 (keeping 200 days of data) [2025-10-27T18:59:03.878142] [DEBUG] [LOCAL ] GHC: Primary data saved (2950 records). [2025-10-27T18:59:03.878312] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-27T18:59:03.878461] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GHC took 26.0s. Estimated remaining: 3h 4m 45s. Rate: 7.8 symbols/min [2025-10-27T18:59:04.045842] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:04.056460] [DEBUG] [LOCAL ] GHI: Loaded 8101 existing records from primary storage. [2025-10-27T18:59:04.056687] [INFO ] [MAIN ] GHI: Loaded 8101 existing records. [2025-10-27T18:59:04.233385] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:04.233555] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-27T18:59:04.233601] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-27T18:59:04.233771] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-27T18:59:04.233827] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-27T18:59:04.336118] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:59:04.420153] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-27T18:59:04.594487] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:05.214968] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-27T18:59:05.673127] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T18:59:05.716540] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T18:59:06.014969] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-27T18:59:06.536035] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T18:59:06.814963] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-27T18:59:07.614971] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-27T18:59:07.786685] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T18:59:07.790287] [INFO ] [REMOTE ] GGT: Full fetch complete (19160 records). [2025-10-27T18:59:07.790415] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-27T18:59:08.163984] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-27T18:59:08.164064] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-27T18:59:08.164461] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-27T18:59:08.164499] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-27T18:59:08.165126] [DEBUG] [LOCAL ] GGT: Trimmed 19160 records to 14417 (keeping 200 days of data) [2025-10-27T18:59:08.202206] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T18:59:08.253902] [DEBUG] [LOCAL ] GGT: Primary data saved (14417 records). [2025-10-27T18:59:08.254047] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-27T18:59:08.254202] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GGT took 33.3s. Estimated remaining: 3h 4m 32s. Rate: 7.8 symbols/min [2025-10-27T18:59:08.420142] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-27T18:59:08.422928] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:08.430668] [DEBUG] [LOCAL ] GHLD: Loaded 4362 existing records from primary storage. [2025-10-27T18:59:08.430847] [INFO ] [MAIN ] GHLD: Loaded 4362 existing records. [2025-10-27T18:59:08.606299] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:08.606516] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-27T18:59:08.606566] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-27T18:59:08.606745] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-27T18:59:08.606859] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-27T18:59:08.956920] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:09.055281] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T18:59:09.214945] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-27T18:59:09.651951] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T18:59:10.014974] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-27T18:59:10.570590] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T18:59:10.571568] [INFO ] [REMOTE ] GGZ: Full fetch complete (3789 records). [2025-10-27T18:59:10.571636] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-27T18:59:10.820143] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-27T18:59:10.935426] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-27T18:59:10.935507] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-27T18:59:10.935660] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-27T18:59:10.935721] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-27T18:59:10.936165] [DEBUG] [LOCAL ] GGZ: Trimmed 3789 records to 2291 (keeping 200 days of data) [2025-10-27T18:59:10.951149] [DEBUG] [LOCAL ] GGZ: Primary data saved (2291 records). [2025-10-27T18:59:10.951214] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-27T18:59:10.951282] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GGZ took 34.0s. Estimated remaining: 3h 4m 17s. Rate: 7.8 symbols/min [2025-10-27T18:59:11.125631] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:11.142841] [DEBUG] [LOCAL ] GHM: Loaded 14511 existing records from primary storage. [2025-10-27T18:59:11.143096] [INFO ] [MAIN ] GHM: Loaded 14511 existing records. [2025-10-27T18:59:11.341131] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:11.344213] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-27T18:59:11.344378] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T18:59:11.344473] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-27T18:59:11.346035] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-27T18:59:11.346092] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-27T18:59:11.620097] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-27T18:59:11.708747] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:12.299257] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T18:59:12.414958] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-27T18:59:13.214925] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-27T18:59:13.224955] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T18:59:13.679176] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T18:59:14.014937] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-27T18:59:14.479109] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T18:59:14.814943] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-27T18:59:15.313230] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T18:59:15.614960] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-27T18:59:16.337638] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T18:59:16.414923] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-27T18:59:17.214970] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-27T18:59:17.222150] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T18:59:17.826118] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:59:18.015023] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-27T18:59:18.686943] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T18:59:18.814976] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-27T18:59:19.263020] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T18:59:19.614942] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-27T18:59:20.245827] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T18:59:20.414965] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-27T18:59:21.176701] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T18:59:21.214900] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-27T18:59:21.628390] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T18:59:22.015003] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-27T18:59:22.719695] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T18:59:22.814904] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-27T18:59:23.614913] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-27T18:59:23.732869] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T18:59:24.256981] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T18:59:24.414978] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-27T18:59:25.214924] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-27T18:59:25.263398] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T18:59:25.650008] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T18:59:26.014945] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-27T18:59:26.613526] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T18:59:26.814942] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-27T18:59:27.148761] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T18:59:27.614942] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-27T18:59:28.414949] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-27T18:59:28.743688] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T18:59:29.012043] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T18:59:29.214969] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-27T18:59:29.829631] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T18:59:30.014941] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-27T18:59:30.814978] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-27T18:59:31.464270] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T18:59:31.465481] [INFO ] [REMOTE ] GHG: Full fetch complete (4217 records). [2025-10-27T18:59:31.465549] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-27T18:59:31.620060] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-27T18:59:31.796503] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T18:59:31.870803] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-27T18:59:31.870875] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-27T18:59:31.871021] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-27T18:59:31.871061] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-27T18:59:31.871435] [DEBUG] [LOCAL ] GHG: Trimmed 4217 records to 3268 (keeping 200 days of data) [2025-10-27T18:59:31.892370] [DEBUG] [LOCAL ] GHG: Primary data saved (3268 records). [2025-10-27T18:59:31.892440] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-27T18:59:31.892537] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHG took 36.5s. Estimated remaining: 3h 4m 29s. Rate: 7.8 symbols/min [2025-10-27T18:59:32.073979] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:32.095722] [DEBUG] [LOCAL ] GHY: Loaded 21125 existing records from primary storage. [2025-10-27T18:59:32.095970] [INFO ] [MAIN ] GHY: Loaded 21125 existing records. [2025-10-27T18:59:32.218368] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T18:59:32.235276] [INFO ] [REMOTE ] GHLD: Full fetch complete (5174 records). [2025-10-27T18:59:32.254745] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-27T18:59:32.396261] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:32.396848] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-27T18:59:32.396919] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-27T18:59:32.417882] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-27T18:59:32.412705] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-27T18:59:32.441397] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-27T18:59:32.852272] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-27T18:59:32.860926] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-27T18:59:32.861141] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-27T18:59:32.861216] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-27T18:59:32.919392] [DEBUG] [LOCAL ] GHLD: Trimmed 5174 records to 4334 (keeping 200 days of data) [2025-10-27T18:59:33.003942] [DEBUG] [LOCAL ] GHLD: Primary data saved (4334 records). [2025-10-27T18:59:33.022059] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-27T18:59:33.041492] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHLD took 24.8s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-27T18:59:33.081930] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:33.234288] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-27T18:59:33.237613] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:33.269578] [DEBUG] [LOCAL ] GIB: Loaded 31725 existing records from primary storage. [2025-10-27T18:59:33.269930] [INFO ] [MAIN ] GIB: Loaded 31725 existing records. [2025-10-27T18:59:33.397376] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T18:59:33.468089] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:33.468302] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-27T18:59:33.468350] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-27T18:59:33.468591] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-27T18:59:33.468632] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-27T18:59:33.847210] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:34.014932] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-27T18:59:34.485534] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T18:59:34.814915] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-27T18:59:35.208336] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T18:59:35.614946] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-27T18:59:35.827537] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T18:59:36.414955] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-27T18:59:36.657878] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T18:59:37.214981] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-27T18:59:37.351302] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T18:59:38.014980] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-27T18:59:38.043729] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T18:59:38.814972] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-27T18:59:39.062689] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T18:59:39.066803] [INFO ] [REMOTE ] GHM: Full fetch complete (21908 records). [2025-10-27T18:59:39.066893] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-27T18:59:39.443976] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-27T18:59:39.444050] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-27T18:59:39.444477] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-27T18:59:39.444515] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-27T18:59:39.445084] [DEBUG] [LOCAL ] GHM: Trimmed 21908 records to 14338 (keeping 200 days of data) [2025-10-27T18:59:39.524828] [DEBUG] [LOCAL ] GHM: Primary data saved (14338 records). [2025-10-27T18:59:39.524950] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-27T18:59:39.525027] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHM took 28.6s. Estimated remaining: 3h 4m 2s. Rate: 7.8 symbols/min [2025-10-27T18:59:39.623407] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-27T18:59:39.695859] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:39.710040] [DEBUG] [LOCAL ] GIC: Loaded 13286 existing records from primary storage. [2025-10-27T18:59:39.710254] [INFO ] [MAIN ] GIC: Loaded 13286 existing records. [2025-10-27T18:59:39.884377] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:39.884558] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-27T18:59:39.884606] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-27T18:59:39.884812] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-27T18:59:39.884875] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-27T18:59:40.240486] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:40.293051] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T18:59:40.370704] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T18:59:40.414899] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-27T18:59:41.214968] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-27T18:59:41.393344] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T18:59:41.396442] [INFO ] [REMOTE ] GHI: Full fetch complete (11370 records). [2025-10-27T18:59:41.396526] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-27T18:59:41.750750] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-27T18:59:41.750826] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-27T18:59:41.751097] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-27T18:59:41.751134] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-27T18:59:41.751611] [DEBUG] [LOCAL ] GHI: Trimmed 11370 records to 8001 (keeping 200 days of data) [2025-10-27T18:59:41.805216] [DEBUG] [LOCAL ] GHI: Primary data saved (8001 records). [2025-10-27T18:59:41.805352] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-27T18:59:41.805432] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GHI took 37.9s. Estimated remaining: 3h 3m 46s. Rate: 7.8 symbols/min [2025-10-27T18:59:41.972632] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T18:59:42.012280] [DEBUG] [LOCAL ] GIL: Loaded 44636 existing records from primary storage. [2025-10-27T18:59:42.012555] [INFO ] [MAIN ] GIL: Loaded 44636 existing records. [2025-10-27T18:59:42.023490] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-27T18:59:42.198138] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T18:59:42.198320] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-27T18:59:42.198365] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-27T18:59:42.198538] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-27T18:59:42.198575] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-27T18:59:42.551923] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T18:59:42.683233] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T18:59:42.814960] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-27T18:59:42.937056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T18:59:43.402958] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T18:59:43.614971] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-27T18:59:44.415001] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-27T18:59:44.984865] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T18:59:45.214950] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-27T18:59:45.885418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T18:59:46.014956] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-27T18:59:46.494844] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T18:59:46.814963] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-27T18:59:47.403311] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T18:59:47.614978] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-27T18:59:48.040050] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T18:59:48.414918] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-27T18:59:48.807265] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T18:59:49.195886] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T18:59:49.214900] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-27T18:59:50.014917] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-27T18:59:50.167257] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T18:59:50.814921] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-27T18:59:51.501441] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T18:59:51.519190] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T18:59:51.614955] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-27T18:59:52.414987] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-27T18:59:52.742254] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T18:59:53.214989] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-27T18:59:53.836073] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T18:59:54.014923] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-27T18:59:54.249629] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T18:59:54.814948] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-27T18:59:55.056429] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T18:59:55.615012] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-27T18:59:55.921915] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T18:59:56.414971] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-27T18:59:56.820988] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T18:59:57.148297] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T18:59:57.214996] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-27T18:59:58.014906] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-27T18:59:58.251376] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T18:59:58.814943] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-27T18:59:59.529311] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T18:59:59.535445] [INFO ] [REMOTE ] GIB: Full fetch complete (46533 records). [2025-10-27T18:59:59.535563] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-27T18:59:59.623256] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-27T18:59:59.932330] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-27T18:59:59.932402] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-27T18:59:59.933110] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-27T18:59:59.933171] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-27T18:59:59.934116] [DEBUG] [LOCAL ] GIB: Trimmed 46533 records to 30975 (keeping 200 days of data) [2025-10-27T19:00:00.096182] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:00:00.139206] [DEBUG] [LOCAL ] GIB: Primary data saved (30975 records). [2025-10-27T19:00:00.139316] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-27T19:00:00.130618] [INFO ] [REMOTE ] GHY: Full fetch complete (32135 records). [2025-10-27T19:00:00.139435] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-27T19:00:00.139965] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIB took 27.1s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-27T19:00:00.435233] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-27T19:00:00.521538] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:00.722903] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-27T19:00:00.723051] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-27T19:00:00.723638] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-27T19:00:00.723724] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-27T19:00:00.738416] [DEBUG] [LOCAL ] GHY: Trimmed 32135 records to 20669 (keeping 200 days of data) [2025-10-27T19:00:00.879064] [DEBUG] [LOCAL ] GHY: Primary data saved (20669 records). [2025-10-27T19:00:00.879219] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-27T19:00:00.879340] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GHY took 29.0s. Estimated remaining: 3h 3m 36s. Rate: 7.8 symbols/min [2025-10-27T19:00:00.891967] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-10-27T19:00:00.923713] [INFO ] [MAIN ] GIS: Loaded 54455 existing records. [2025-10-27T19:00:01.191622] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:01.261920] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:01.262242] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-27T19:00:01.262306] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-27T19:00:01.262551] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-27T19:00:01.262623] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-27T19:00:01.596830] [DEBUG] [LOCAL ] GKOS: Loaded 43058 existing records from primary storage. [2025-10-27T19:00:01.597619] [INFO ] [MAIN ] GKOS: Loaded 43058 existing records. [2025-10-27T19:00:01.780100] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:01.821619] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-27T19:00:01.942174] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:01.942508] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-27T19:00:01.942803] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-27T19:00:01.943103] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-27T19:00:01.943208] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-27T19:00:02.033505] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:00:02.110993] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-27T19:00:02.133205] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-27T19:00:02.420484] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:02.814948] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-27T19:00:02.922676] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:00:03.615022] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-27T19:00:04.240387] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T19:00:04.414965] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-27T19:00:04.997471] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T19:00:05.112180] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T19:00:05.214918] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-27T19:00:06.014976] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-27T19:00:06.814932] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-27T19:00:07.105218] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-27T19:00:07.171611] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T19:00:07.614913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-27T19:00:08.108774] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-27T19:00:08.159883] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T19:00:08.414997] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-27T19:00:09.067680] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:00:09.214962] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-27T19:00:10.014913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-27T19:00:10.145318] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:00:10.290013] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T19:00:10.293817] [INFO ] [REMOTE ] GIC: Full fetch complete (19674 records). [2025-10-27T19:00:10.294007] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-27T19:00:10.690598] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-27T19:00:10.690717] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-27T19:00:10.691139] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-27T19:00:10.691201] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-27T19:00:10.691800] [DEBUG] [LOCAL ] GIC: Trimmed 19674 records to 12968 (keeping 200 days of data) [2025-10-27T19:00:10.767359] [DEBUG] [LOCAL ] GIC: Primary data saved (12968 records). [2025-10-27T19:00:10.767488] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-27T19:00:10.767570] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIC took 31.2s. Estimated remaining: 3h 3m 32s. Rate: 7.8 symbols/min [2025-10-27T19:00:10.820903] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-27T19:00:10.945865] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:10.983023] [DEBUG] [LOCAL ] GL: Loaded 38036 existing records from primary storage. [2025-10-27T19:00:10.983322] [INFO ] [MAIN ] GL: Loaded 38036 existing records. [2025-10-27T19:00:11.155270] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:11.155466] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-27T19:00:11.155512] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-27T19:00:11.155723] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-27T19:00:11.155779] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-27T19:00:11.509056] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:11.614924] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-27T19:00:11.754873] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T19:00:12.414980] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-27T19:00:12.903664] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T19:00:13.081135] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:00:13.214957] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-27T19:00:13.864127] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T19:00:14.015045] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-27T19:00:14.820067] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-27T19:00:14.837765] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:00:15.614926] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-27T19:00:16.063973] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:00:16.414914] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-27T19:00:16.490696] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:00:17.214973] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-27T19:00:17.914424] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T19:00:18.014918] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-27T19:00:18.638060] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-27T19:00:18.815013] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-27T19:00:19.469795] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:00:19.614913] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-27T19:00:20.057507] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-27T19:00:20.414978] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-27T19:00:20.635535] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:00:20.892949] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T19:00:21.214970] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-27T19:00:21.556044] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:00:22.014992] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-27T19:00:22.815018] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-27T19:00:23.006786] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:00:23.286029] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T19:00:23.614953] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-27T19:00:24.372719] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:00:24.414922] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-27T19:00:25.214940] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-27T19:00:25.240928] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:00:25.249808] [INFO ] [REMOTE ] GIL: Full fetch complete (62719 records). [2025-10-27T19:00:25.249923] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-27T19:00:25.642213] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-27T19:00:25.642343] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-27T19:00:25.643177] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-27T19:00:25.643350] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-27T19:00:25.644730] [DEBUG] [LOCAL ] GIL: Trimmed 62719 records to 43844 (keeping 200 days of data) [2025-10-27T19:00:25.784198] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:00:25.946414] [DEBUG] [LOCAL ] GIL: Primary data saved (43844 records). [2025-10-27T19:00:25.946667] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-27T19:00:25.946810] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GIL took 44.1s. Estimated remaining: 3h 3m 36s. Rate: 7.8 symbols/min [2025-10-27T19:00:26.020762] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-27T19:00:26.115620] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:26.158926] [DEBUG] [LOCAL ] GLOB: Loaded 48732 existing records from primary storage. [2025-10-27T19:00:26.159275] [INFO ] [MAIN ] GLOB: Loaded 48732 existing records. [2025-10-27T19:00:26.336960] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:26.337331] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-27T19:00:26.337402] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-27T19:00:26.337622] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-27T19:00:26.337702] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-27T19:00:26.706500] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:26.729938] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:00:26.814964] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-27T19:00:27.612236] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:00:27.620734] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-27T19:00:27.976608] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:00:28.415013] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-27T19:00:28.716019] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T19:00:29.215068] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-27T19:00:30.014927] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-27T19:00:30.095890] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:00:30.104293] [INFO ] [REMOTE ] GKOS: Full fetch complete (60746 records). [2025-10-27T19:00:30.104474] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-27T19:00:30.501219] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-27T19:00:30.501322] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-27T19:00:30.502218] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-27T19:00:30.502340] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-27T19:00:30.503609] [DEBUG] [LOCAL ] GKOS: Trimmed 60746 records to 42292 (keeping 200 days of data) [2025-10-27T19:00:30.610913] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T19:00:30.776806] [DEBUG] [LOCAL ] GKOS: Primary data saved (42292 records). [2025-10-27T19:00:30.776928] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-27T19:00:30.777001] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GKOS took 29.9s. Estimated remaining: 3h 3m 24s. Rate: 7.8 symbols/min [2025-10-27T19:00:30.820062] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-27T19:00:30.947696] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:30.958389] [DEBUG] [LOCAL ] GLP: Loaded 9295 existing records from primary storage. [2025-10-27T19:00:30.958593] [INFO ] [MAIN ] GLP: Loaded 9295 existing records. [2025-10-27T19:00:31.133555] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:31.133775] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-27T19:00:31.133825] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-27T19:00:31.133975] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-27T19:00:31.134014] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-27T19:00:31.492675] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:31.614924] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-27T19:00:31.672440] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:00:32.326815] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:00:32.414903] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-27T19:00:33.214936] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-27T19:00:33.484981] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T19:00:33.836867] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T19:00:34.014959] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-27T19:00:34.814988] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-27T19:00:34.898529] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T19:00:35.080621] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:00:35.614949] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-27T19:00:35.729811] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T19:00:35.740162] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-27T19:00:35.740293] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-27T19:00:36.121934] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-27T19:00:36.122011] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-27T19:00:36.122943] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-27T19:00:36.123006] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-27T19:00:36.124389] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-27T19:00:36.432380] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-27T19:00:36.458635] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-27T19:00:36.458903] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-27T19:00:36.459388] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GIS took 36.3s. Estimated remaining: 3h 3m 13s. Rate: 7.8 symbols/min [2025-10-27T19:00:36.631005] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:36.684578] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-10-27T19:00:36.684932] [INFO ] [MAIN ] GLW: Loaded 54415 existing records. [2025-10-27T19:00:36.864554] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:36.864894] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-27T19:00:36.865029] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-27T19:00:36.865249] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-27T19:00:36.865296] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-27T19:00:37.177938] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:00:37.226235] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-27T19:00:37.278821] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:37.279878] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T19:00:38.014938] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-27T19:00:38.538557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:00:38.546951] [INFO ] [REMOTE ] GL: Full fetch complete (54864 records). [2025-10-27T19:00:38.547143] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-27T19:00:38.822416] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-27T19:00:38.962573] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-27T19:00:38.962713] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-27T19:00:38.964227] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-27T19:00:38.964296] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-27T19:00:38.966025] [DEBUG] [LOCAL ] GL: Trimmed 54864 records to 37258 (keeping 200 days of data) [2025-10-27T19:00:39.244788] [DEBUG] [LOCAL ] GL: Primary data saved (37258 records). [2025-10-27T19:00:39.245026] [INFO ] [MAIN ] GL: Full history saved. [2025-10-27T19:00:39.245822] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GL took 28.5s. Estimated remaining: 3h 2m 58s. Rate: 7.8 symbols/min [2025-10-27T19:00:39.413689] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:39.481488] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-27T19:00:39.481975] [INFO ] [MAIN ] GM: Loaded 54509 existing records. [2025-10-27T19:00:39.626271] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-27T19:00:39.671726] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:39.672152] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-27T19:00:39.672215] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-27T19:00:39.672477] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-27T19:00:39.672519] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-27T19:00:40.093474] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:00:40.130880] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:00:40.382488] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:00:40.414920] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-27T19:00:40.551010] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:00:41.214985] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-27T19:00:42.014979] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-27T19:00:42.186735] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:00:42.452368] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:00:42.815063] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-27T19:00:42.910043] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:00:43.615006] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-27T19:00:44.382934] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:00:44.414904] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-27T19:00:45.214978] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-27T19:00:46.014941] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-27T19:00:46.032833] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T19:00:46.102679] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:00:46.814985] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-27T19:00:47.524038] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (3.91 seconds). [2025-10-27T19:00:47.614928] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-27T19:00:47.732605] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:00:48.414933] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-27T19:00:48.722945] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:00:48.866670] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T19:00:49.220092] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-27T19:00:49.236628] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:00:50.014944] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-27T19:00:50.814973] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-27T19:00:51.052484] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T19:00:51.588664] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T19:00:51.614921] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-27T19:00:51.881048] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T19:00:52.373532] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T19:00:52.414957] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-27T19:00:53.214969] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-27T19:00:53.297527] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T19:00:54.014963] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-27T19:00:54.815009] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-27T19:00:55.156501] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T19:00:55.615017] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-27T19:00:56.301053] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-27T19:00:56.415010] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-27T19:00:56.646700] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T19:00:57.214970] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-27T19:00:57.264991] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:00:58.014921] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-27T19:00:58.066888] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T19:00:58.814936] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-27T19:00:58.905598] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T19:00:58.907723] [INFO ] [REMOTE ] GLP: Full fetch complete (14227 records). [2025-10-27T19:00:58.907797] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-27T19:00:59.288227] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-27T19:00:59.288349] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-27T19:00:59.288988] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-27T19:00:59.289150] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-27T19:00:59.290243] [DEBUG] [LOCAL ] GLP: Trimmed 14227 records to 9104 (keeping 200 days of data) [2025-10-27T19:00:59.348493] [DEBUG] [LOCAL ] GLP: Primary data saved (9104 records). [2025-10-27T19:00:59.348720] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-27T19:00:59.348871] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLP took 28.6s. Estimated remaining: 3h 3m 9s. Rate: 7.8 symbols/min [2025-10-27T19:00:59.488941] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-27T19:00:59.570557] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:00:59.620787] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-27T19:00:59.624059] [DEBUG] [LOCAL ] GME: Loaded 54557 existing records from primary storage. [2025-10-27T19:00:59.624455] [INFO ] [MAIN ] GME: Loaded 54557 existing records. [2025-10-27T19:00:59.824470] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:00:59.824864] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-27T19:00:59.824936] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-27T19:00:59.825182] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-27T19:00:59.825237] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-27T19:01:00.174486] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:00.414967] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-27T19:01:00.780263] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:01:00.789788] [INFO ] [REMOTE ] GLOB: Full fetch complete (66565 records). [2025-10-27T19:01:00.789934] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-27T19:01:01.160758] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-27T19:01:01.160840] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-27T19:01:01.161671] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-27T19:01:01.161770] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-27T19:01:01.163170] [DEBUG] [LOCAL ] GLOB: Trimmed 66565 records to 48001 (keeping 200 days of data) [2025-10-27T19:01:01.220419] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-27T19:01:01.442919] [DEBUG] [LOCAL ] GLOB: Primary data saved (48001 records). [2025-10-27T19:01:01.443172] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-27T19:01:01.443435] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GLOB took 35.5s. Estimated remaining: 3h 2m 52s. Rate: 7.8 symbols/min [2025-10-27T19:01:01.609208] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:01.651589] [DEBUG] [LOCAL ] GMED: Loaded 48786 existing records from primary storage. [2025-10-27T19:01:01.651914] [INFO ] [MAIN ] GMED: Loaded 48786 existing records. [2025-10-27T19:01:01.867583] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:01:01.872026] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:01.883183] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-27T19:01:01.883279] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-27T19:01:01.883861] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-27T19:01:01.883913] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-27T19:01:02.024447] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-27T19:01:02.238478] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:02.814924] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-27T19:01:03.035545] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-27T19:01:03.615009] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-27T19:01:03.701166] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-27T19:01:03.826263] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:01:04.414933] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-27T19:01:04.489149] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:01:05.215040] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-27T19:01:05.431508] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T19:01:05.441860] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-27T19:01:05.442010] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-27T19:01:05.828912] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-27T19:01:05.829004] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-27T19:01:05.830005] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-27T19:01:05.830073] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-27T19:01:05.831740] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 53635 (keeping 200 days of data) [2025-10-27T19:01:06.015063] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-27T19:01:06.191348] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-27T19:01:06.192074] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-27T19:01:06.193109] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T19:01:06.193609] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GLW took 29.7s. Estimated remaining: 3h 2m 40s. Rate: 7.8 symbols/min [2025-10-27T19:01:06.381165] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:06.446278] [DEBUG] [LOCAL ] GMRE: Loaded 36688 existing records from primary storage. [2025-10-27T19:01:06.446735] [INFO ] [MAIN ] GMRE: Loaded 36688 existing records. [2025-10-27T19:01:06.641864] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:06.642243] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-27T19:01:06.642348] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-27T19:01:06.642982] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-27T19:01:06.643043] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-27T19:01:06.823557] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-27T19:01:06.883864] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:01:07.038810] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:07.614986] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-27T19:01:07.725023] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:01:08.414953] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-27T19:01:09.027095] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:01:09.214933] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-27T19:01:09.739088] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-27T19:01:10.014922] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-27T19:01:10.045077] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T19:01:10.814935] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-27T19:01:10.855063] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:01:11.614962] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-27T19:01:11.837884] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T19:01:12.414921] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-27T19:01:12.521791] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T19:01:12.532199] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-27T19:01:12.532369] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-27T19:01:12.969021] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-27T19:01:12.969143] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-27T19:01:12.970098] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-27T19:01:12.970171] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-27T19:01:12.971674] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-27T19:01:13.216578] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-27T19:01:13.299856] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-27T19:01:13.300021] [INFO ] [MAIN ] GM: Full history saved. [2025-10-27T19:01:13.300825] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GM took 34.1s. Estimated remaining: 3h 2m 32s. Rate: 7.8 symbols/min [2025-10-27T19:01:13.480350] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:13.500735] [DEBUG] [LOCAL ] GNE: Loaded 18312 existing records from primary storage. [2025-10-27T19:01:13.500984] [INFO ] [MAIN ] GNE: Loaded 18312 existing records. [2025-10-27T19:01:13.690248] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:13.690762] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-27T19:01:13.690883] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-27T19:01:13.691213] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-27T19:01:13.707269] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-27T19:01:13.799155] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-27T19:01:14.015754] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-27T19:01:14.096134] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:14.143997] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T19:01:14.178625] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T19:01:14.815001] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-27T19:01:15.615003] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-27T19:01:15.804978] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:01:16.414951] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-27T19:01:16.545353] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T19:01:16.549824] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-27T19:01:17.215008] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-27T19:01:17.705262] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:01:17.968703] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T19:01:18.014920] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-27T19:01:18.814951] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-27T19:01:19.293439] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:01:19.614962] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-27T19:01:19.802119] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:01:20.415013] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-27T19:01:21.215006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-27T19:01:21.767388] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-27T19:01:21.936486] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:01:22.014938] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-27T19:01:22.777487] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:01:22.814986] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-27T19:01:23.364148] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T19:01:23.614965] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-27T19:01:23.949417] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T19:01:24.180065] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T19:01:24.414951] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-27T19:01:25.214947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-27T19:01:26.014987] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-27T19:01:26.392716] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T19:01:26.513204] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-27T19:01:26.538753] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:01:26.814949] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-27T19:01:27.614943] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-27T19:01:28.079520] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:01:28.414945] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-27T19:01:29.021203] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:01:29.214975] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-27T19:01:30.014974] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-27T19:01:30.117891] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:01:30.534035] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:01:30.543467] [INFO ] [REMOTE ] GMED: Full fetch complete (70187 records). [2025-10-27T19:01:30.543598] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-27T19:01:30.818873] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-27T19:01:30.938265] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-27T19:01:30.938366] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-27T19:01:30.939392] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-27T19:01:30.939473] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-27T19:01:30.961673] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:01:30.966886] [DEBUG] [LOCAL ] GMED: Trimmed 70187 records to 48055 (keeping 200 days of data) [2025-10-27T19:01:31.246447] [DEBUG] [LOCAL ] GMED: Primary data saved (48055 records). [2025-10-27T19:01:31.246574] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-27T19:01:31.246681] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GMED took 29.8s. Estimated remaining: 3h 2m 39s. Rate: 7.8 symbols/min [2025-10-27T19:01:31.419854] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:31.455947] [DEBUG] [LOCAL ] GNK: Loaded 39934 existing records from primary storage. [2025-10-27T19:01:31.456217] [INFO ] [MAIN ] GNK: Loaded 39934 existing records. [2025-10-27T19:01:31.623180] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-27T19:01:31.627904] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:31.629024] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-27T19:01:31.629072] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-27T19:01:31.629264] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-27T19:01:31.629319] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-27T19:01:31.977291] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:32.414987] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-27T19:01:33.215014] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-27T19:01:33.556446] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-27T19:01:33.765994] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T19:01:33.841579] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:01:34.014942] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-27T19:01:34.268257] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:01:34.814953] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-27T19:01:35.614924] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-27T19:01:35.851249] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:01:35.989602] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-27T19:01:36.414935] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-27T19:01:37.045264] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T19:01:37.214943] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-27T19:01:38.014928] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-27T19:01:38.316228] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-27T19:01:38.327616] [INFO ] [REMOTE ] GME: Full fetch complete (77919 records). [2025-10-27T19:01:38.327785] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-27T19:01:38.747604] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-27T19:01:38.747860] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-27T19:01:38.749137] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-27T19:01:38.756887] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-27T19:01:38.758729] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T19:01:38.763412] [INFO ] [REMOTE ] GNE: Full fetch complete (22647 records). [2025-10-27T19:01:38.763608] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-27T19:01:38.769550] [DEBUG] [LOCAL ] GME: Trimmed 77919 records to 53777 (keeping 200 days of data) [2025-10-27T19:01:38.825386] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-27T19:01:39.073854] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T19:01:39.473414] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-27T19:01:39.492297] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-27T19:01:39.499670] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-27T19:01:39.517520] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-27T19:01:39.517431] [DEBUG] [LOCAL ] GME: Primary data saved (53777 records). [2025-10-27T19:01:39.517875] [INFO ] [MAIN ] GME: Full history saved. [2025-10-27T19:01:39.518352] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GME took 40.2s. Estimated remaining: 3h 2m 33s. Rate: 7.8 symbols/min [2025-10-27T19:01:39.530221] [DEBUG] [LOCAL ] GNE: Trimmed 22647 records to 18127 (keeping 200 days of data) [2025-10-27T19:01:39.616692] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-27T19:01:39.780368] [DEBUG] [LOCAL ] GNE: Primary data saved (18127 records). [2025-10-27T19:01:39.786005] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-27T19:01:39.800568] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNE took 26.5s. Estimated remaining: 3h 2m 14s. Rate: 7.8 symbols/min [2025-10-27T19:01:39.803527] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:39.979744] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:40.004953] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T19:01:40.011192] [INFO ] [REMOTE ] GMRE: Full fetch complete (51441 records). [2025-10-27T19:01:40.011387] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-27T19:01:40.125492] [DEBUG] [LOCAL ] GNL: Loaded 47104 existing records from primary storage. [2025-10-27T19:01:40.134775] [INFO ] [MAIN ] GNL: Loaded 47104 existing records. [2025-10-27T19:01:40.509374] [DEBUG] [LOCAL ] GNRC: Loaded 45998 existing records from primary storage. [2025-10-27T19:01:40.548178] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:40.545084] [INFO ] [MAIN ] GNRC: Loaded 45998 existing records. [2025-10-27T19:01:40.558740] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-27T19:01:40.563973] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-27T19:01:40.607109] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-27T19:01:40.663565] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-27T19:01:40.730359] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-27T19:01:40.756820] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-27T19:01:40.776909] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-27T19:01:40.800882] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-27T19:01:40.943777] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:40.932772] [DEBUG] [LOCAL ] GMRE: Trimmed 51441 records to 35708 (keeping 200 days of data) [2025-10-27T19:01:40.974262] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-27T19:01:40.985453] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-27T19:01:41.035349] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-27T19:01:41.085595] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-27T19:01:41.532253] [DEBUG] [LOCAL ] GMRE: Primary data saved (35708 records). [2025-10-27T19:01:41.563081] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-27T19:01:41.562995] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:41.591547] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GMRE took 35.4s. Estimated remaining: 3h 1m 57s. Rate: 7.8 symbols/min [2025-10-27T19:01:41.607724] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-27T19:01:41.913578] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-27T19:01:41.940084] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:01:41.976283] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-27T19:01:42.032855] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:42.036869] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-27T19:01:42.037153] [DEBUG] [LOCAL ] GNT: Loaded 8728 existing records from primary storage. [2025-10-27T19:01:42.037345] [INFO ] [MAIN ] GNT: Loaded 8728 existing records. [2025-10-27T19:01:42.218279] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:01:42.218486] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-27T19:01:42.218533] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-27T19:01:42.218717] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-27T19:01:42.218772] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-27T19:01:42.577735] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:01:42.814999] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-27T19:01:43.160632] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T19:01:43.395495] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:01:43.552385] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:01:43.614988] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-27T19:01:43.645964] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:01:44.225543] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T19:01:44.415019] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-27T19:01:45.214962] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-27T19:01:45.917928] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:01:46.014902] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-27T19:01:46.688944] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:01:46.814932] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-27T19:01:47.217339] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:01:47.614987] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-27T19:01:48.414996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-27T19:01:48.547622] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:01:49.074069] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T19:01:49.073874] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:01:49.214962] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-27T19:01:50.014969] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-27T19:01:50.814980] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-27T19:01:51.435061] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-27T19:01:51.616564] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-27T19:01:51.619893] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:01:52.143898] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:01:52.415016] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-27T19:01:53.071123] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T19:01:53.214978] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-27T19:01:53.807467] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T19:01:54.014969] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-27T19:01:54.058094] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T19:01:54.814960] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-27T19:01:54.981770] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:01:55.598026] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:01:55.614897] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-27T19:01:56.378439] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T19:01:56.414896] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-27T19:01:57.022878] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T19:01:57.214985] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-27T19:01:58.015011] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-27T19:01:58.782037] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:01:58.814913] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-27T19:01:59.243104] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:01:59.614986] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-27T19:02:00.123358] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:02:00.414941] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-27T19:02:01.214964] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-27T19:02:01.416353] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:02:02.014995] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-27T19:02:02.405241] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:02:02.600403] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:02:02.814938] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-27T19:02:03.614918] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-27T19:02:03.657719] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-27T19:02:03.664990] [INFO ] [REMOTE ] GNK: Full fetch complete (57129 records). [2025-10-27T19:02:03.665096] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-27T19:02:04.095708] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-27T19:02:04.095798] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-27T19:02:04.096844] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-27T19:02:04.096912] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-27T19:02:04.098160] [DEBUG] [LOCAL ] GNK: Trimmed 57129 records to 39008 (keeping 200 days of data) [2025-10-27T19:02:04.347278] [DEBUG] [LOCAL ] GNK: Primary data saved (39008 records). [2025-10-27T19:02:04.347456] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-27T19:02:04.347563] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNK took 33.1s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min [2025-10-27T19:02:04.419691] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-27T19:02:04.556975] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:04.602917] [DEBUG] [LOCAL ] GNW: Loaded 52087 existing records from primary storage. [2025-10-27T19:02:04.626951] [INFO ] [MAIN ] GNW: Loaded 52087 existing records. [2025-10-27T19:02:04.728449] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-27T19:02:04.816059] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:04.816238] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-27T19:02:04.816284] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-27T19:02:04.816465] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-27T19:02:04.816503] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-27T19:02:05.177981] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:05.187162] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T19:02:05.217491] [INFO ] [REMOTE ] GNT: Full fetch complete (11503 records). [2025-10-27T19:02:05.217276] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-27T19:02:05.217860] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-27T19:02:05.232991] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:02:05.586563] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-27T19:02:05.586659] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-27T19:02:05.587004] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-27T19:02:05.587065] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-27T19:02:05.587521] [DEBUG] [LOCAL ] GNT: Trimmed 11503 records to 8608 (keeping 200 days of data) [2025-10-27T19:02:05.636472] [DEBUG] [LOCAL ] GNT: Primary data saved (8608 records). [2025-10-27T19:02:05.636606] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-27T19:02:05.636708] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNT took 24.0s. Estimated remaining: 3h 1m 55s. Rate: 7.8 symbols/min [2025-10-27T19:02:05.799847] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:05.840406] [DEBUG] [LOCAL ] GOF: Loaded 43412 existing records from primary storage. [2025-10-27T19:02:05.840715] [INFO ] [MAIN ] GOF: Loaded 43412 existing records. [2025-10-27T19:02:06.011943] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:06.012209] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-27T19:02:06.012266] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-27T19:02:06.012445] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-27T19:02:06.012481] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-27T19:02:06.023584] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-27T19:02:06.372223] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:06.714591] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:02:06.814923] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-27T19:02:07.614932] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-27T19:02:07.856561] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T19:02:08.415014] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-27T19:02:08.446055] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:02:09.215044] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-27T19:02:09.351827] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T19:02:10.014994] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-27T19:02:10.321579] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T19:02:10.330269] [INFO ] [REMOTE ] GNRC: Full fetch complete (65709 records). [2025-10-27T19:02:10.330385] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-27T19:02:10.725184] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-27T19:02:10.725316] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-27T19:02:10.726256] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-27T19:02:10.726320] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-27T19:02:10.727671] [DEBUG] [LOCAL ] GNRC: Trimmed 65709 records to 45165 (keeping 200 days of data) [2025-10-27T19:02:10.815928] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-27T19:02:11.003725] [DEBUG] [LOCAL ] GNRC: Primary data saved (45165 records). [2025-10-27T19:02:11.003851] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-27T19:02:11.004434] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 31.2s. Estimated remaining: 3h 1m 43s. Rate: 7.8 symbols/min [2025-10-27T19:02:11.176393] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:11.211520] [DEBUG] [LOCAL ] GOLF: Loaded 30614 existing records from primary storage. [2025-10-27T19:02:11.211994] [INFO ] [MAIN ] GOLF: Loaded 30614 existing records. [2025-10-27T19:02:11.388523] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-27T19:02:11.417903] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:11.426205] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-27T19:02:11.426383] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-27T19:02:11.427141] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-27T19:02:11.427242] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-27T19:02:11.588752] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:02:11.628927] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-27T19:02:11.860088] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:12.414956] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-27T19:02:12.461396] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:02:13.019635] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:02:13.214985] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-27T19:02:14.015007] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-27T19:02:14.286243] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:02:14.689419] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:02:14.698495] [INFO ] [REMOTE ] GNL: Full fetch complete (68016 records). [2025-10-27T19:02:14.698689] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-27T19:02:14.820079] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-27T19:02:15.096191] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-27T19:02:15.096290] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-27T19:02:15.097173] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-27T19:02:15.097234] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-27T19:02:15.098486] [DEBUG] [LOCAL ] GNL: Trimmed 68016 records to 46279 (keeping 200 days of data) [2025-10-27T19:02:15.357559] [DEBUG] [LOCAL ] GNL: Primary data saved (46279 records). [2025-10-27T19:02:15.357713] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-27T19:02:15.357801] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GNL took 35.8s. Estimated remaining: 3h 1m 31s. Rate: 7.8 symbols/min [2025-10-27T19:02:15.525021] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:15.565975] [DEBUG] [LOCAL ] GOOS: Loaded 44601 existing records from primary storage. [2025-10-27T19:02:15.566250] [INFO ] [MAIN ] GOOS: Loaded 44601 existing records. [2025-10-27T19:02:15.629947] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-27T19:02:15.751241] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:15.751829] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-27T19:02:15.752025] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-27T19:02:15.752389] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-27T19:02:15.752460] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-27T19:02:15.881993] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T19:02:16.112853] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:02:16.168065] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:16.414927] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-27T19:02:17.114978] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T19:02:17.214939] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-27T19:02:17.603813] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T19:02:18.014965] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-27T19:02:18.814945] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-27T19:02:18.938902] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:02:19.341329] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T19:02:19.614993] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-27T19:02:19.967436] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:02:20.415007] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-27T19:02:21.214923] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-27T19:02:21.359014] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T19:02:21.420871] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:02:22.014932] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-27T19:02:22.772599] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T19:02:22.814929] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-27T19:02:23.388849] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:02:23.614960] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-27T19:02:24.386375] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:02:24.414895] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-27T19:02:25.214933] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-27T19:02:25.332155] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:02:25.992095] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T19:02:26.014903] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-27T19:02:26.308351] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:02:26.814941] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-27T19:02:27.573166] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:02:27.614958] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-27T19:02:28.414934] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-27T19:02:28.448842] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T19:02:29.153564] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:02:29.220049] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-27T19:02:29.231307] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:02:30.014974] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-27T19:02:30.814925] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-27T19:02:31.021970] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:02:31.614993] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-27T19:02:31.742934] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:02:32.232796] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:02:32.414930] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-27T19:02:33.215019] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-27T19:02:33.308544] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:02:33.318266] [INFO ] [REMOTE ] GNW: Full fetch complete (73915 records). [2025-10-27T19:02:33.318404] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-27T19:02:33.699962] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-27T19:02:33.700059] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-27T19:02:33.700996] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-27T19:02:33.701058] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-27T19:02:33.702433] [DEBUG] [LOCAL ] GNW: Trimmed 73915 records to 51289 (keeping 200 days of data) [2025-10-27T19:02:33.948991] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:02:34.014915] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-27T19:02:34.031794] [DEBUG] [LOCAL ] GNW: Primary data saved (51289 records). [2025-10-27T19:02:34.031884] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-27T19:02:34.031957] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GNW took 29.7s. Estimated remaining: 3h 1m 39s. Rate: 7.8 symbols/min [2025-10-27T19:02:34.203214] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:34.235626] [DEBUG] [LOCAL ] GOTU: Loaded 37178 existing records from primary storage. [2025-10-27T19:02:34.235912] [INFO ] [MAIN ] GOTU: Loaded 37178 existing records. [2025-10-27T19:02:34.411767] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:34.411952] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-27T19:02:34.412002] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-27T19:02:34.412170] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-27T19:02:34.412207] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-27T19:02:34.763473] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:34.814905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-27T19:02:34.865211] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:02:35.614989] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-27T19:02:35.690102] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:02:36.424578] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-27T19:02:36.427958] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:02:37.214927] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-27T19:02:37.337913] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:02:37.705294] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T19:02:38.014925] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-27T19:02:38.631863] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:02:38.814917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-27T19:02:39.397807] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T19:02:39.614968] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-27T19:02:40.077119] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:02:40.415039] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-27T19:02:40.954870] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:02:41.214975] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-27T19:02:41.690581] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:02:42.015015] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-27T19:02:42.814947] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-27T19:02:43.178539] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T19:02:43.185778] [INFO ] [REMOTE ] GOOS: Full fetch complete (64567 records). [2025-10-27T19:02:43.185894] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-27T19:02:43.538929] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-27T19:02:43.595697] [INFO ] [REMOTE ] GOF: Full fetch complete (62783 records). [2025-10-27T19:02:43.614942] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-27T19:02:43.615032] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-27T19:02:43.615127] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-27T19:02:43.615217] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-27T19:02:43.617225] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-27T19:02:43.650720] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-27T19:02:43.724966] [DEBUG] [LOCAL ] GOOS: Trimmed 64567 records to 43756 (keeping 200 days of data) [2025-10-27T19:02:44.141869] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:02:44.307959] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-27T19:02:44.318012] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-27T19:02:44.320727] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-27T19:02:44.319111] [DEBUG] [LOCAL ] GOOS: Primary data saved (43756 records). [2025-10-27T19:02:44.320814] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-27T19:02:44.321119] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-27T19:02:44.321220] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GOOS took 29.0s. Estimated remaining: 3h 1m 35s. Rate: 7.8 symbols/min [2025-10-27T19:02:44.420198] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-27T19:02:44.423554] [DEBUG] [LOCAL ] GOF: Trimmed 62783 records to 42668 (keeping 200 days of data) [2025-10-27T19:02:44.562837] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:44.781410] [DEBUG] [LOCAL ] GPC: Loaded 46604 existing records from primary storage. [2025-10-27T19:02:44.786491] [INFO ] [MAIN ] GPC: Loaded 46604 existing records. [2025-10-27T19:02:45.004803] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:45.007730] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-27T19:02:45.009542] [DEBUG] [LOCAL ] GOF: Primary data saved (42668 records). [2025-10-27T19:02:45.009778] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-27T19:02:45.009833] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-27T19:02:45.010022] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GOF took 39.4s. Estimated remaining: 3h 1m 17s. Rate: 7.8 symbols/min [2025-10-27T19:02:45.015560] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-27T19:02:45.032950] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-27T19:02:45.272391] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:02:45.377836] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:45.387917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-27T19:02:45.553493] [DEBUG] [LOCAL ] GPI: Loaded 14990 existing records from primary storage. [2025-10-27T19:02:45.578005] [INFO ] [MAIN ] GPI: Loaded 14990 existing records. [2025-10-27T19:02:45.680574] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:45.790571] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:45.802420] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-27T19:02:45.802987] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-27T19:02:45.803407] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:02:45.808089] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-27T19:02:45.808552] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-27T19:02:45.850780] [INFO ] [REMOTE ] GOLF: Full fetch complete (45206 records). [2025-10-27T19:02:45.881891] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-27T19:02:46.026557] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-27T19:02:46.520304] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:46.572807] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-27T19:02:46.572870] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-27T19:02:46.573593] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-27T19:02:46.573632] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-27T19:02:46.574526] [DEBUG] [LOCAL ] GOLF: Trimmed 45206 records to 29787 (keeping 200 days of data) [2025-10-27T19:02:46.755245] [DEBUG] [LOCAL ] GOLF: Primary data saved (29787 records). [2025-10-27T19:02:46.755500] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-27T19:02:46.756210] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GOLF took 35.8s. Estimated remaining: 3h 1m 1s. Rate: 7.8 symbols/min [2025-10-27T19:02:46.823994] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-27T19:02:46.927755] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:02:46.935845] [DEBUG] [LOCAL ] GPJA: Loaded 4140 existing records from primary storage. [2025-10-27T19:02:46.936047] [INFO ] [MAIN ] GPJA: Loaded 4140 existing records. [2025-10-27T19:02:47.104402] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:02:47.146400] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:02:47.146892] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-27T19:02:47.147241] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-27T19:02:47.147388] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-27T19:02:47.147443] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-27T19:02:47.496564] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:02:47.511383] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:02:47.614908] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-27T19:02:47.719492] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:02:48.303771] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:02:48.414977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-27T19:02:49.068427] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:02:49.214969] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-27T19:02:50.014976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-27T19:02:50.500305] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:02:50.644282] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:02:50.814975] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-27T19:02:51.614961] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-27T19:02:51.981594] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:02:52.414954] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-27T19:02:53.033542] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:02:53.214962] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-27T19:02:53.479008] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T19:02:54.014986] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-27T19:02:54.627928] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:02:54.814988] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-27T19:02:55.053245] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T19:02:55.614972] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-27T19:02:55.925433] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:02:56.414976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-27T19:02:56.767695] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T19:02:56.774094] [INFO ] [REMOTE ] GOTU: Full fetch complete (57991 records). [2025-10-27T19:02:56.774194] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-27T19:02:57.043179] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T19:02:57.159687] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-27T19:02:57.159765] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-27T19:02:57.160519] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-27T19:02:57.160557] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-27T19:02:57.161616] [DEBUG] [LOCAL ] GOTU: Trimmed 57991 records to 36496 (keeping 200 days of data) [2025-10-27T19:02:57.239107] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-27T19:02:57.364701] [DEBUG] [LOCAL ] GOTU: Primary data saved (36496 records). [2025-10-27T19:02:57.365093] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-27T19:02:57.365192] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GOTU took 23.3s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-10-27T19:02:58.015075] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-27T19:02:58.814916] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-27T19:02:58.968025] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:02:59.004910] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:02:59.438340] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:02:59.614964] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-27T19:03:00.219064] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:03:00.414975] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-27T19:03:01.214930] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-27T19:03:02.014981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-27T19:03:02.034236] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:03:02.381122] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:03:02.647372] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T19:03:02.814951] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-27T19:03:03.416568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:03:03.614960] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-27T19:03:04.192983] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T19:03:04.414981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-27T19:03:04.981707] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:03:05.214941] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-27T19:03:06.014970] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-27T19:03:06.814230] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:03:06.823125] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-27T19:03:06.872046] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T19:03:07.411277] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:03:07.614931] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-27T19:03:08.414993] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-27T19:03:08.594062] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T19:03:09.214965] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-27T19:03:09.713537] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:03:09.879843] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T19:03:09.880931] [INFO ] [REMOTE ] GPJA: Full fetch complete (6791 records). [2025-10-27T19:03:09.880996] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-27T19:03:10.020105] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-27T19:03:10.255005] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-27T19:03:10.255117] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-27T19:03:10.255292] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-27T19:03:10.255330] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-27T19:03:10.255721] [DEBUG] [LOCAL ] GPJA: Trimmed 6791 records to 4035 (keeping 200 days of data) [2025-10-27T19:03:10.280339] [DEBUG] [LOCAL ] GPJA: Primary data saved (4035 records). [2025-10-27T19:03:10.280435] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-27T19:03:10.280506] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPJA took 23.5s. Estimated remaining: 3h 0m 57s. Rate: 7.8 symbols/min [2025-10-27T19:03:10.814989] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-27T19:03:11.618671] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:03:11.628046] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-27T19:03:12.045451] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:03:12.052432] [INFO ] [REMOTE ] GPI: Full fetch complete (21962 records). [2025-10-27T19:03:12.052517] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-27T19:03:12.411456] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-27T19:03:12.411529] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-27T19:03:12.411965] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-27T19:03:12.412026] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-27T19:03:12.412599] [DEBUG] [LOCAL ] GPI: Trimmed 21962 records to 14518 (keeping 200 days of data) [2025-10-27T19:03:12.501773] [DEBUG] [LOCAL ] GPI: Primary data saved (14518 records). [2025-10-27T19:03:12.501909] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-27T19:03:12.501985] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPI took 27.5s. Estimated remaining: 3h 0m 42s. Rate: 7.8 symbols/min [2025-10-27T19:03:13.616496] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T19:03:13.626360] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-27T19:03:15.255499] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:03:15.264487] [INFO ] [REMOTE ] GPC: Full fetch complete (68688 records). [2025-10-27T19:03:15.264736] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-27T19:03:15.646993] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-27T19:03:15.647064] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-27T19:03:15.647920] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-27T19:03:15.647981] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-27T19:03:15.649390] [DEBUG] [LOCAL ] GPC: Trimmed 68688 records to 45800 (keeping 200 days of data) [2025-10-27T19:03:15.924465] [DEBUG] [LOCAL ] GPC: Primary data saved (45800 records). [2025-10-27T19:03:15.924597] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-27T19:03:15.924700] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPC took 31.6s. Estimated remaining: 3h 0m 28s. Rate: 7.8 symbols/min [2025-10-27T19:03:16.577808] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.598251] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.606025] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.628091] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:16.659795] [DEBUG] [LOCAL ] GPMT: Loaded 26165 existing records from primary storage. [2025-10-27T19:03:16.667881] [INFO ] [MAIN ] GPMT: Loaded 26165 existing records. [2025-10-27T19:03:16.684212] [DEBUG] [LOCAL ] GPOR: Loaded 23736 existing records from primary storage. [2025-10-27T19:03:16.758811] [INFO ] [MAIN ] GPOR: Loaded 23736 existing records. [2025-10-27T19:03:16.962488] [DEBUG] [LOCAL ] GPK: Loaded 53551 existing records from primary storage. [2025-10-27T19:03:16.928038] [DEBUG] [LOCAL ] GPN: Loaded 52523 existing records from primary storage. [2025-10-27T19:03:16.987858] [INFO ] [MAIN ] GPK: Loaded 53551 existing records. [2025-10-27T19:03:16.978194] [INFO ] [MAIN ] GPN: Loaded 52523 existing records. [2025-10-27T19:03:17.030250] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.212965] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.252582] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-27T19:03:17.285081] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.291370] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.291430] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-27T19:03:17.356211] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-27T19:03:17.345347] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-27T19:03:17.447239] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.438931] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-27T19:03:17.509428] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-27T19:03:17.559383] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:17.624128] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.641591] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-27T19:03:17.646915] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-27T19:03:17.679935] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-27T19:03:17.704677] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-27T19:03:17.709923] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-27T19:03:17.704603] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-27T19:03:17.752217] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-27T19:03:18.543274] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.567790] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-27T19:03:18.646062] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.680940] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-27T19:03:18.949528] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.954105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-27T19:03:18.953597] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:18.954451] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-27T19:03:19.543768] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:03:19.549755] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-27T19:03:19.916610] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:03:19.921623] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-27T19:03:20.181095] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:03:20.196432] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-27T19:03:20.471386] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:03:20.483204] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-27T19:03:20.701570] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:03:20.706398] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-27T19:03:20.785385] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:03:20.790522] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-27T19:03:21.327763] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:03:21.337423] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-27T19:03:21.561170] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T19:03:21.752376] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T19:03:21.782857] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:03:22.014987] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-27T19:03:22.814939] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-27T19:03:23.020145] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T19:03:23.345414] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:03:23.614935] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-27T19:03:24.341268] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:03:24.414918] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-27T19:03:24.489908] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T19:03:25.214962] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-27T19:03:25.310218] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T19:03:26.014935] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-27T19:03:26.201127] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:03:26.814946] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-27T19:03:27.031860] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T19:03:27.614939] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-27T19:03:27.913583] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T19:03:28.414941] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-27T19:03:28.965519] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:03:29.214918] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-27T19:03:29.406458] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T19:03:30.014976] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-27T19:03:30.753638] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T19:03:30.814902] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-27T19:03:30.903936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:03:31.614906] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-27T19:03:31.979118] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T19:03:31.983120] [INFO ] [REMOTE ] GPMT: Full fetch complete (36110 records). [2025-10-27T19:03:31.983206] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-27T19:03:32.354344] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-27T19:03:32.354415] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-27T19:03:32.355015] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-27T19:03:32.355075] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-27T19:03:32.355873] [DEBUG] [LOCAL ] GPMT: Trimmed 36110 records to 25517 (keeping 200 days of data) [2025-10-27T19:03:32.435796] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-27T19:03:32.503515] [DEBUG] [LOCAL ] GPMT: Primary data saved (25517 records). [2025-10-27T19:03:32.503681] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-27T19:03:32.503782] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GPMT took 16.6s. Estimated remaining: 3h 0m 33s. Rate: 7.8 symbols/min [2025-10-27T19:03:32.668203] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:32.703929] [DEBUG] [LOCAL ] GPRK: Loaded 40591 existing records from primary storage. [2025-10-27T19:03:32.704198] [INFO ] [MAIN ] GPRK: Loaded 40591 existing records. [2025-10-27T19:03:32.887241] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:32.887517] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-27T19:03:32.887674] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-27T19:03:32.887971] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-27T19:03:32.888058] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-27T19:03:33.218037] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-27T19:03:33.336088] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:33.356026] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:03:34.014986] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-27T19:03:34.044157] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T19:03:34.155489] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:03:34.814974] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-27T19:03:35.413137] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:03:35.614939] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-27T19:03:36.214467] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:03:36.414916] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-27T19:03:37.034796] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:03:37.214932] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-27T19:03:37.709103] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:03:38.014948] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-27T19:03:38.464361] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:03:38.814985] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-27T19:03:39.614920] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-27T19:03:39.806262] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:03:40.421465] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-27T19:03:40.440712] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:03:41.214916] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-27T19:03:41.560458] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T19:03:42.001914] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:03:42.014920] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-27T19:03:42.625184] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:03:42.814983] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-27T19:03:43.614927] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-27T19:03:43.892413] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:03:44.013594] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T19:03:44.414950] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-27T19:03:45.188523] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:03:45.214901] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-27T19:03:46.014911] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-27T19:03:46.376504] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T19:03:46.386560] [INFO ] [REMOTE ] GPK: Full fetch complete (76099 records). [2025-10-27T19:03:46.386703] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-27T19:03:46.780024] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-27T19:03:46.780217] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-27T19:03:46.781228] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-27T19:03:46.781302] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-27T19:03:46.783091] [DEBUG] [LOCAL ] GPK: Trimmed 76099 records to 52765 (keeping 200 days of data) [2025-10-27T19:03:46.834946] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-27T19:03:46.938242] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:03:47.170102] [DEBUG] [LOCAL ] GPK: Primary data saved (52765 records). [2025-10-27T19:03:47.170862] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-27T19:03:47.171533] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:03:47.171780] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPK took 31.2s. Estimated remaining: 3h 0m 35s. Rate: 7.8 symbols/min [2025-10-27T19:03:47.344988] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:47.370681] [DEBUG] [LOCAL ] GRBK: Loaded 26936 existing records from primary storage. [2025-10-27T19:03:47.370940] [INFO ] [MAIN ] GRBK: Loaded 26936 existing records. [2025-10-27T19:03:47.564697] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:47.564904] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-27T19:03:47.564949] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-27T19:03:47.565121] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-27T19:03:47.565158] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-27T19:03:47.626138] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-27T19:03:47.915523] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:48.164780] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:03:48.414951] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-27T19:03:49.202707] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:03:49.214910] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-27T19:03:49.394015] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:03:49.399316] [INFO ] [REMOTE ] GPOR: Full fetch complete (34910 records). [2025-10-27T19:03:49.399405] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-27T19:03:49.758284] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-27T19:03:49.758359] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-27T19:03:49.758973] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-27T19:03:49.759032] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-27T19:03:49.759787] [DEBUG] [LOCAL ] GPOR: Trimmed 34910 records to 23320 (keeping 200 days of data) [2025-10-27T19:03:49.893125] [DEBUG] [LOCAL ] GPOR: Primary data saved (23320 records). [2025-10-27T19:03:49.893246] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-27T19:03:49.893320] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPOR took 34.0s. Estimated remaining: 3h 0m 20s. Rate: 7.8 symbols/min [2025-10-27T19:03:50.029400] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-27T19:03:50.060764] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:50.072106] [DEBUG] [LOCAL ] GRC: Loaded 9494 existing records from primary storage. [2025-10-27T19:03:50.072396] [INFO ] [MAIN ] GRC: Loaded 9494 existing records. [2025-10-27T19:03:50.243808] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:50.243996] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-27T19:03:50.244042] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-27T19:03:50.244207] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-27T19:03:50.244262] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-27T19:03:50.602214] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:50.623362] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:03:50.815003] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-27T19:03:51.548050] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:03:51.614951] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-27T19:03:52.279336] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:03:52.414963] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-27T19:03:53.214999] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-27T19:03:53.531233] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:03:53.540739] [INFO ] [REMOTE ] GPN: Full fetch complete (74991 records). [2025-10-27T19:03:53.540851] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-27T19:03:53.957928] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T19:03:53.976275] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-27T19:03:53.976403] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-27T19:03:53.986783] [INFO ] [REMOTE ] GPRK: Full fetch complete (58560 records). [2025-10-27T19:03:53.986499] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-27T19:03:53.987053] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-27T19:03:53.986983] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-27T19:03:54.020448] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-27T19:03:54.095968] [DEBUG] [LOCAL ] GPN: Trimmed 74991 records to 51720 (keeping 200 days of data) [2025-10-27T19:03:54.508317] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-27T19:03:54.509688] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-27T19:03:54.515699] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-27T19:03:54.516098] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-27T19:03:54.528172] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T19:03:54.539329] [DEBUG] [LOCAL ] GPRK: Trimmed 58560 records to 39943 (keeping 200 days of data) [2025-10-27T19:03:54.745678] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:03:54.835566] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-27T19:03:54.968832] [DEBUG] [LOCAL ] GPN: Primary data saved (51720 records). [2025-10-27T19:03:54.968959] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-27T19:03:54.969068] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPN took 39.0s. Estimated remaining: 3h 0m 9s. Rate: 7.8 symbols/min [2025-10-27T19:03:54.968738] [DEBUG] [LOCAL ] GPRK: Primary data saved (39943 records). [2025-10-27T19:03:54.980420] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-27T19:03:55.012257] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GPRK took 22.5s. Estimated remaining: 2h 59m 50s. Rate: 7.8 symbols/min [2025-10-27T19:03:55.275589] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:55.319134] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:03:55.339308] [DEBUG] [LOCAL ] GRDN: Loaded 21735 existing records from primary storage. [2025-10-27T19:03:55.339545] [INFO ] [MAIN ] GRDN: Loaded 21735 existing records. [2025-10-27T19:03:55.542669] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:55.543202] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-27T19:03:55.544389] [DEBUG] [LOCAL ] GRMN: Loaded 40287 existing records from primary storage. [2025-10-27T19:03:55.543352] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-27T19:03:55.544934] [INFO ] [MAIN ] GRMN: Loaded 40287 existing records. [2025-10-27T19:03:55.544828] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-27T19:03:55.545065] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-27T19:03:55.625585] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-27T19:03:55.665416] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T19:03:55.910424] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:03:55.977140] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-27T19:03:55.982697] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-27T19:03:56.004170] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-27T19:03:56.014413] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-27T19:03:56.228821] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:56.420884] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-27T19:03:56.461035] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:03:56.925783] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:03:57.214932] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-27T19:03:57.225827] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:03:58.014992] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-27T19:03:58.789853] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T19:03:58.814919] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-27T19:03:58.869795] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T19:03:59.621906] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-27T19:03:59.625680] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T19:04:00.415105] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-27T19:04:00.739299] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T19:04:01.214959] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-27T19:04:02.015071] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-27T19:04:02.763959] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T19:04:02.814932] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-27T19:04:02.920796] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T19:04:02.952469] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-27T19:04:03.455893] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T19:04:03.614989] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-27T19:04:04.414980] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-27T19:04:04.692320] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:04:05.214962] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-27T19:04:05.469400] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:04:05.851352] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T19:04:06.014946] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-27T19:04:06.815009] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-27T19:04:07.583113] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:04:07.614904] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-27T19:04:08.235911] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:04:08.414955] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-27T19:04:09.062226] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:04:09.214912] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-27T19:04:09.383458] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T19:04:10.014985] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-27T19:04:10.630155] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:04:10.814924] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-27T19:04:10.982036] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:04:11.614932] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-27T19:04:11.827184] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T19:04:12.292676] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:04:12.414986] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-27T19:04:12.892266] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:04:13.214958] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-27T19:04:14.014953] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-27T19:04:14.814927] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-27T19:04:14.871359] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T19:04:14.934031] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:04:15.614953] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-27T19:04:16.066077] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:04:16.117956] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T19:04:16.414951] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-27T19:04:17.214909] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-27T19:04:17.378784] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:04:17.381621] [INFO ] [REMOTE ] GRC: Full fetch complete (13585 records). [2025-10-27T19:04:17.381728] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-27T19:04:17.737204] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-27T19:04:17.737311] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-27T19:04:17.737634] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-27T19:04:17.737723] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-27T19:04:17.738202] [DEBUG] [LOCAL ] GRC: Trimmed 13585 records to 9285 (keeping 200 days of data) [2025-10-27T19:04:17.793245] [DEBUG] [LOCAL ] GRC: Primary data saved (9285 records). [2025-10-27T19:04:17.793369] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-27T19:04:17.793461] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRC took 27.9s. Estimated remaining: 3h 0m 4s. Rate: 7.8 symbols/min [2025-10-27T19:04:17.960988] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:18.009689] [DEBUG] [LOCAL ] GRND: Loaded 50935 existing records from primary storage. [2025-10-27T19:04:18.010017] [INFO ] [MAIN ] GRND: Loaded 50935 existing records. [2025-10-27T19:04:18.020999] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-27T19:04:18.190785] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:18.190992] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-27T19:04:18.191037] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-27T19:04:18.191232] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-27T19:04:18.191289] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-27T19:04:18.541318] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:18.687739] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:04:18.814941] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-27T19:04:18.945327] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:04:19.614964] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-27T19:04:20.295342] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:04:20.328764] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T19:04:20.414941] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-27T19:04:21.215033] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-27T19:04:21.647048] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:04:21.653912] [INFO ] [REMOTE ] GRMN: Full fetch complete (59342 records). [2025-10-27T19:04:21.654032] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-27T19:04:22.022357] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-27T19:04:22.058233] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-27T19:04:22.058305] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-27T19:04:22.059107] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-27T19:04:22.059168] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-27T19:04:22.060261] [DEBUG] [LOCAL ] GRMN: Trimmed 59342 records to 39400 (keeping 200 days of data) [2025-10-27T19:04:22.300957] [DEBUG] [LOCAL ] GRMN: Primary data saved (39400 records). [2025-10-27T19:04:22.301088] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-27T19:04:22.301166] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRMN took 27.3s. Estimated remaining: 2h 59m 52s. Rate: 7.8 symbols/min [2025-10-27T19:04:22.466041] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:22.497403] [DEBUG] [LOCAL ] GRNT: Loaded 34437 existing records from primary storage. [2025-10-27T19:04:22.497686] [INFO ] [MAIN ] GRNT: Loaded 34437 existing records. [2025-10-27T19:04:22.673731] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:22.673880] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-27T19:04:22.673965] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-27T19:04:22.674137] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-27T19:04:22.674182] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-27T19:04:22.804057] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:04:22.818347] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-27T19:04:23.066566] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:23.307148] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:04:23.614975] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-27T19:04:23.887554] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T19:04:24.414950] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-27T19:04:24.747201] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:04:25.214954] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-27T19:04:25.271285] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:04:25.276500] [INFO ] [REMOTE ] GRBK: Full fetch complete (39850 records). [2025-10-27T19:04:25.276606] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-27T19:04:25.641717] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-27T19:04:25.641859] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-27T19:04:25.642683] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-27T19:04:25.642765] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-27T19:04:25.643732] [DEBUG] [LOCAL ] GRBK: Trimmed 39850 records to 26261 (keeping 200 days of data) [2025-10-27T19:04:25.806875] [DEBUG] [LOCAL ] GRBK: Primary data saved (26261 records). [2025-10-27T19:04:25.807003] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-27T19:04:25.807082] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRBK took 38.6s. Estimated remaining: 2h 59m 38s. Rate: 7.8 symbols/min [2025-10-27T19:04:25.974093] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:25.984066] [DEBUG] [LOCAL ] GROV: Loaded 8708 existing records from primary storage. [2025-10-27T19:04:25.984266] [INFO ] [MAIN ] GROV: Loaded 8708 existing records. [2025-10-27T19:04:26.020059] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-27T19:04:26.157954] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:26.158131] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-27T19:04:26.158176] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-27T19:04:26.158305] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-27T19:04:26.158340] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-27T19:04:26.509502] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:26.535917] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T19:04:26.814939] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-27T19:04:27.238492] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:04:27.350364] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T19:04:27.614938] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-27T19:04:28.414964] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-27T19:04:29.014707] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:04:29.214995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-27T19:04:30.014997] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-27T19:04:30.254169] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:04:30.714807] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:04:30.814942] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-27T19:04:30.945985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:04:31.615012] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-27T19:04:32.154514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:04:32.379387] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:04:32.414900] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-27T19:04:33.215002] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-27T19:04:33.976215] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:04:34.014904] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-27T19:04:34.814915] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-27T19:04:34.929179] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:04:35.323698] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:04:35.614930] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-27T19:04:36.153456] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T19:04:36.158610] [INFO ] [REMOTE ] GRDN: Full fetch complete (26896 records). [2025-10-27T19:04:36.158713] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-27T19:04:36.419524] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-27T19:04:36.448209] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T19:04:36.532928] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-27T19:04:36.533002] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-27T19:04:36.533545] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-27T19:04:36.533583] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-27T19:04:36.534292] [DEBUG] [LOCAL ] GRDN: Trimmed 26896 records to 21538 (keeping 200 days of data) [2025-10-27T19:04:36.655725] [DEBUG] [LOCAL ] GRDN: Primary data saved (21538 records). [2025-10-27T19:04:36.655844] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-27T19:04:36.655920] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRDN took 41.7s. Estimated remaining: 2h 59m 35s. Rate: 7.8 symbols/min [2025-10-27T19:04:36.823454] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:36.830207] [DEBUG] [LOCAL ] GRX: Loaded 4905 existing records from primary storage. [2025-10-27T19:04:36.830388] [INFO ] [MAIN ] GRX: Loaded 4905 existing records. [2025-10-27T19:04:37.021258] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:37.021514] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-27T19:04:37.021572] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-27T19:04:37.021745] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-27T19:04:37.021800] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-27T19:04:37.227150] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-27T19:04:37.401874] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:37.723363] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:04:38.014940] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-27T19:04:38.759051] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T19:04:38.814953] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-27T19:04:39.019477] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:04:39.614938] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-27T19:04:40.272842] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:04:40.285291] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T19:04:40.414961] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-27T19:04:41.215011] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-27T19:04:41.440684] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T19:04:41.447077] [INFO ] [REMOTE ] GRNT: Full fetch complete (48341 records). [2025-10-27T19:04:41.447166] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-27T19:04:41.837663] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-27T19:04:41.837762] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-27T19:04:41.838485] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-27T19:04:41.838546] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-27T19:04:41.839591] [DEBUG] [LOCAL ] GRNT: Trimmed 48341 records to 33640 (keeping 200 days of data) [2025-10-27T19:04:42.020260] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-27T19:04:42.030290] [DEBUG] [LOCAL ] GRNT: Primary data saved (33640 records). [2025-10-27T19:04:42.030423] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-27T19:04:42.030504] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GRNT took 19.7s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-27T19:04:42.150286] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:04:42.211843] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:42.258366] [DEBUG] [LOCAL ] GS: Loaded 52539 existing records from primary storage. [2025-10-27T19:04:42.258705] [INFO ] [MAIN ] GS: Loaded 52539 existing records. [2025-10-27T19:04:42.441796] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T19:04:42.445638] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:42.448384] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-27T19:04:42.448449] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-27T19:04:42.448639] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-27T19:04:42.448738] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-27T19:04:42.808564] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:42.814912] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-27T19:04:43.614954] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-27T19:04:44.415001] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-27T19:04:44.993800] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-27T19:04:45.012818] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:04:45.172705] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:04:45.214906] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-27T19:04:46.014988] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-27T19:04:46.814915] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-27T19:04:46.899161] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T19:04:47.036889] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T19:04:47.614960] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-27T19:04:48.006805] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T19:04:48.414923] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-27T19:04:48.776778] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T19:04:48.972623] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T19:04:49.214975] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-27T19:04:49.832256] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T19:04:50.014983] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-27T19:04:50.814978] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-27T19:04:50.824551] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:04:50.826913] [INFO ] [REMOTE ] GROV: Full fetch complete (13477 records). [2025-10-27T19:04:50.826984] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-27T19:04:51.198708] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-27T19:04:51.198786] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-27T19:04:51.199093] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-27T19:04:51.199152] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-27T19:04:51.199589] [DEBUG] [LOCAL ] GROV: Trimmed 13477 records to 8633 (keeping 200 days of data) [2025-10-27T19:04:51.245943] [DEBUG] [LOCAL ] GROV: Primary data saved (8633 records). [2025-10-27T19:04:51.246051] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-27T19:04:51.246137] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GROV took 25.4s. Estimated remaining: 2h 59m 18s. Rate: 7.8 symbols/min [2025-10-27T19:04:51.420380] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:04:51.456294] [DEBUG] [LOCAL ] GSBD: Loaded 40094 existing records from primary storage. [2025-10-27T19:04:51.456552] [INFO ] [MAIN ] GSBD: Loaded 40094 existing records. [2025-10-27T19:04:51.630670] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:04:51.626093] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-27T19:04:51.631042] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-27T19:04:51.631695] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-27T19:04:51.631884] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-27T19:04:51.631923] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-27T19:04:51.986922] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:04:52.268803] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T19:04:52.415025] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-27T19:04:53.063699] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T19:04:53.215004] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-27T19:04:53.648712] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:04:54.014958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-27T19:04:54.814971] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-27T19:04:54.910906] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T19:04:55.385196] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-27T19:04:55.614966] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-27T19:04:56.291182] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:04:56.414926] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-27T19:04:57.222239] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-27T19:04:57.237996] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:04:57.819128] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:04:58.014918] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-27T19:04:58.071403] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:04:58.645527] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T19:04:58.815035] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-27T19:04:59.614993] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-27T19:05:00.414987] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-27T19:05:00.551161] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:05:00.561258] [INFO ] [REMOTE ] GRND: Full fetch complete (72029 records). [2025-10-27T19:05:00.561428] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-27T19:05:00.958722] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-27T19:05:00.958813] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-27T19:05:00.959804] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-27T19:05:00.959869] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-27T19:05:00.961261] [DEBUG] [LOCAL ] GRND: Trimmed 72029 records to 50170 (keeping 200 days of data) [2025-10-27T19:05:01.223640] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-27T19:05:01.256388] [DEBUG] [LOCAL ] GRND: Primary data saved (50170 records). [2025-10-27T19:05:01.256637] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-27T19:05:01.256801] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GRND took 43.5s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-10-27T19:05:01.427415] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:01.478178] [DEBUG] [LOCAL ] GSK: Loaded 54290 existing records from primary storage. [2025-10-27T19:05:01.478519] [INFO ] [MAIN ] GSK: Loaded 54290 existing records. [2025-10-27T19:05:01.665936] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:01.666961] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-27T19:05:01.667022] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-27T19:05:01.667762] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-27T19:05:01.667821] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-27T19:05:01.885964] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:05:01.982360] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:05:02.018712] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-27T19:05:02.120487] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:02.762383] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:05:02.814947] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-27T19:05:03.297045] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T19:05:03.615038] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-27T19:05:04.414912] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-27T19:05:04.511308] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:05:05.214980] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-27T19:05:05.380436] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T19:05:05.454558] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T19:05:06.014941] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-27T19:05:06.484617] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:05:06.815006] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-27T19:05:07.250621] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T19:05:07.614940] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-27T19:05:08.188377] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T19:05:08.190928] [INFO ] [REMOTE ] GRX: Full fetch complete (6558 records). [2025-10-27T19:05:08.192540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-27T19:05:08.192717] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-27T19:05:08.420169] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-27T19:05:08.571678] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-27T19:05:08.571772] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-27T19:05:08.571958] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-27T19:05:08.571996] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-27T19:05:08.572377] [DEBUG] [LOCAL ] GRX: Trimmed 6558 records to 4811 (keeping 200 days of data) [2025-10-27T19:05:08.599985] [DEBUG] [LOCAL ] GRX: Primary data saved (4811 records). [2025-10-27T19:05:08.600054] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-27T19:05:08.600122] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GRX took 31.9s. Estimated remaining: 2h 59m 5s. Rate: 7.8 symbols/min [2025-10-27T19:05:08.766349] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:08.801959] [DEBUG] [LOCAL ] GSL: Loaded 33315 existing records from primary storage. [2025-10-27T19:05:08.802213] [INFO ] [MAIN ] GSL: Loaded 33315 existing records. [2025-10-27T19:05:08.973555] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:08.973760] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-27T19:05:08.973807] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-27T19:05:08.973984] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-27T19:05:08.974021] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-27T19:05:09.220094] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-27T19:05:09.322476] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:10.014955] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-27T19:05:10.436115] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T19:05:10.814991] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-27T19:05:11.038978] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T19:05:11.460534] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:05:11.614976] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-27T19:05:12.414925] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-27T19:05:12.448096] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:05:12.677618] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:05:13.215001] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-27T19:05:14.014937] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-27T19:05:14.357593] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T19:05:14.415963] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:05:14.814958] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-27T19:05:15.614988] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-27T19:05:15.715215] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:05:15.904678] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T19:05:16.414985] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-27T19:05:16.599300] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T19:05:17.214984] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-27T19:05:18.014934] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-27T19:05:18.213810] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:05:18.282253] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T19:05:18.814968] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-27T19:05:19.614962] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-27T19:05:19.891715] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:05:20.097375] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:05:20.108186] [INFO ] [REMOTE ] GS: Full fetch complete (75831 records). [2025-10-27T19:05:20.108485] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-27T19:05:20.422889] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-27T19:05:20.534885] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-27T19:05:20.534971] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-27T19:05:20.536092] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-27T19:05:20.536169] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-27T19:05:20.537734] [DEBUG] [LOCAL ] GS: Trimmed 75831 records to 51743 (keeping 200 days of data) [2025-10-27T19:05:20.890902] [DEBUG] [LOCAL ] GS: Primary data saved (51743 records). [2025-10-27T19:05:20.891051] [INFO ] [MAIN ] GS: Full history saved. [2025-10-27T19:05:20.891175] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GS took 38.9s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-27T19:05:21.074283] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:21.121175] [DEBUG] [LOCAL ] GTES: Loaded 51018 existing records from primary storage. [2025-10-27T19:05:21.121518] [INFO ] [MAIN ] GTES: Loaded 51018 existing records. [2025-10-27T19:05:21.220332] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-27T19:05:21.303666] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:21.303859] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-27T19:05:21.303906] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-27T19:05:21.304080] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-27T19:05:21.304119] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-27T19:05:21.678353] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:21.699734] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:05:21.740763] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-27T19:05:22.014946] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-27T19:05:22.531522] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:05:22.814943] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-27T19:05:22.990135] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:05:23.614949] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-27T19:05:24.414972] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-27T19:05:24.482487] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:05:25.214923] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-27T19:05:25.346711] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T19:05:25.356007] [INFO ] [REMOTE ] GSBD: Full fetch complete (58456 records). [2025-10-27T19:05:25.356121] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-27T19:05:25.742865] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-27T19:05:25.742960] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-27T19:05:25.743761] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-27T19:05:25.743836] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-27T19:05:25.763292] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:05:25.762504] [DEBUG] [LOCAL ] GSBD: Trimmed 58456 records to 39315 (keeping 200 days of data) [2025-10-27T19:05:26.003365] [DEBUG] [LOCAL ] GSBD: Primary data saved (39315 records). [2025-10-27T19:05:26.003505] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-27T19:05:26.003600] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSBD took 34.8s. Estimated remaining: 2h 58m 53s. Rate: 7.8 symbols/min [2025-10-27T19:05:26.024037] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-27T19:05:26.171495] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:26.214329] [DEBUG] [LOCAL ] GTLS: Loaded 43732 existing records from primary storage. [2025-10-27T19:05:26.214673] [INFO ] [MAIN ] GTLS: Loaded 43732 existing records. [2025-10-27T19:05:26.406166] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:26.406381] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-27T19:05:26.406431] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-27T19:05:26.406676] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-27T19:05:26.406768] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-27T19:05:26.800900] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:26.814913] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-27T19:05:26.915840] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:05:27.615001] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-27T19:05:27.705962] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T19:05:28.414953] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-27T19:05:28.582917] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:05:29.214936] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-27T19:05:29.249955] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:05:30.015019] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-27T19:05:30.195754] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T19:05:30.206512] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-27T19:05:30.206771] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-27T19:05:30.653301] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-27T19:05:30.653608] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-27T19:05:30.654852] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-27T19:05:30.654951] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-27T19:05:30.678320] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:05:30.678517] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53510 (keeping 200 days of data) [2025-10-27T19:05:30.817382] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-27T19:05:31.064981] [DEBUG] [LOCAL ] GSK: Primary data saved (53510 records). [2025-10-27T19:05:31.065190] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-27T19:05:31.065332] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GSK took 29.8s. Estimated remaining: 2h 58m 41s. Rate: 7.8 symbols/min [2025-10-27T19:05:31.302960] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:31.349092] [DEBUG] [LOCAL ] GTN: Loaded 45322 existing records from primary storage. [2025-10-27T19:05:31.349430] [INFO ] [MAIN ] GTN: Loaded 45322 existing records. [2025-10-27T19:05:31.579942] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:31.580447] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-27T19:05:31.580523] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-27T19:05:31.580839] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-27T19:05:31.580927] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-27T19:05:31.669353] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-27T19:05:31.754945] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:05:32.134359] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:32.332837] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T19:05:32.414943] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-27T19:05:33.156033] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T19:05:33.214942] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-27T19:05:33.597135] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T19:05:34.014934] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-27T19:05:34.687260] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:05:34.693462] [INFO ] [REMOTE ] GSL: Full fetch complete (48246 records). [2025-10-27T19:05:34.693557] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-27T19:05:34.820077] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-27T19:05:35.071859] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-27T19:05:35.071947] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-27T19:05:35.072675] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-27T19:05:35.072739] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-27T19:05:35.073820] [DEBUG] [LOCAL ] GSL: Trimmed 48246 records to 32535 (keeping 200 days of data) [2025-10-27T19:05:35.267397] [DEBUG] [LOCAL ] GSL: Primary data saved (32535 records). [2025-10-27T19:05:35.267499] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-27T19:05:35.267862] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GSL took 26.7s. Estimated remaining: 2h 58m 29s. Rate: 7.8 symbols/min [2025-10-27T19:05:35.436301] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:35.468089] [DEBUG] [LOCAL ] GTY: Loaded 30496 existing records from primary storage. [2025-10-27T19:05:35.468389] [INFO ] [MAIN ] GTY: Loaded 30496 existing records. [2025-10-27T19:05:35.627209] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-27T19:05:35.650486] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:05:35.669988] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:35.678680] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-27T19:05:35.678959] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-27T19:05:35.679289] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-27T19:05:35.679346] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-27T19:05:36.025993] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:36.107471] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:05:36.414976] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-27T19:05:37.214915] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-27T19:05:37.271820] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:05:37.618735] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:05:38.014959] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-27T19:05:38.814919] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-27T19:05:38.903333] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:05:39.318626] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T19:05:39.614960] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-27T19:05:40.415002] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-27T19:05:40.551434] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:05:41.214930] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-27T19:05:41.329130] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:05:41.939698] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:05:42.014949] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-27T19:05:42.814981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-27T19:05:43.180595] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T19:05:43.288389] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T19:05:43.614950] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-27T19:05:44.350155] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:05:44.414926] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-27T19:05:44.712291] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:05:45.214953] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-27T19:05:46.015793] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-27T19:05:46.021633] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:05:46.211046] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:05:46.814980] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-27T19:05:47.539836] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:05:47.624175] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-27T19:05:47.625604] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:05:48.414937] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-27T19:05:48.901898] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T19:05:49.214981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-27T19:05:50.014973] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-27T19:05:50.104740] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T19:05:50.814937] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-27T19:05:50.844488] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T19:05:50.932663] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:05:51.614997] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-27T19:05:52.109876] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:05:52.414984] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-27T19:05:53.138488] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:05:53.214988] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-27T19:05:53.982207] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:05:54.014899] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-27T19:05:54.814986] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-27T19:05:54.906346] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T19:05:55.167311] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T19:05:55.176005] [INFO ] [REMOTE ] GTN: Full fetch complete (65563 records). [2025-10-27T19:05:55.176176] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-27T19:05:55.572734] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-27T19:05:55.572871] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-27T19:05:55.574278] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-27T19:05:55.574347] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-27T19:05:55.576135] [DEBUG] [LOCAL ] GTN: Trimmed 65563 records to 44461 (keeping 200 days of data) [2025-10-27T19:05:55.625307] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-27T19:05:55.854576] [DEBUG] [LOCAL ] GTN: Primary data saved (44461 records). [2025-10-27T19:05:55.854804] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-27T19:05:55.854915] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTN took 24.8s. Estimated remaining: 2h 58m 39s. Rate: 7.8 symbols/min [2025-10-27T19:05:56.032343] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:05:56.049748] [DEBUG] [LOCAL ] GUG: Loaded 12261 existing records from primary storage. [2025-10-27T19:05:56.050072] [INFO ] [MAIN ] GUG: Loaded 12261 existing records. [2025-10-27T19:05:56.244528] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:05:56.286230] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:05:56.287343] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-27T19:05:56.287462] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-27T19:05:56.287750] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-27T19:05:56.287811] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-27T19:05:56.420092] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-27T19:05:56.668247] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:05:57.023463] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T19:05:57.214947] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-27T19:05:58.014968] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-27T19:05:58.163910] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:05:58.455980] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T19:05:58.681466] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T19:05:58.814933] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-27T19:05:59.578204] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:05:59.614941] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-27T19:06:00.414978] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-27T19:06:01.214977] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-27T19:06:01.392052] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:06:01.841410] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-27T19:06:01.852371] [INFO ] [REMOTE ] GTES: Full fetch complete (73840 records). [2025-10-27T19:06:01.852533] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-27T19:06:02.021434] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-27T19:06:02.262755] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-27T19:06:02.262845] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-27T19:06:02.263757] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-27T19:06:02.263819] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-27T19:06:02.265392] [DEBUG] [LOCAL ] GTES: Trimmed 73840 records to 50229 (keeping 200 days of data) [2025-10-27T19:06:02.547795] [DEBUG] [LOCAL ] GTES: Primary data saved (50229 records). [2025-10-27T19:06:02.547954] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-27T19:06:02.548619] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTES took 41.7s. Estimated remaining: 2h 58m 30s. Rate: 7.8 symbols/min [2025-10-27T19:06:02.721931] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:02.739374] [DEBUG] [LOCAL ] GUT: Loaded 15855 existing records from primary storage. [2025-10-27T19:06:02.739600] [INFO ] [MAIN ] GUT: Loaded 15855 existing records. [2025-10-27T19:06:02.820023] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-27T19:06:02.925266] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:02.925497] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-27T19:06:02.925545] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-27T19:06:02.925778] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-27T19:06:02.925834] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-27T19:06:03.299198] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:03.371734] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:06:03.419080] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T19:06:03.608089] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T19:06:03.615634] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-27T19:06:03.617307] [INFO ] [REMOTE ] GTLS: Full fetch complete (61406 records). [2025-10-27T19:06:03.617389] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-27T19:06:04.010288] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-27T19:06:04.010367] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-27T19:06:04.011180] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-27T19:06:04.011242] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-27T19:06:04.012420] [DEBUG] [LOCAL ] GTLS: Trimmed 61406 records to 42877 (keeping 200 days of data) [2025-10-27T19:06:04.269130] [DEBUG] [LOCAL ] GTLS: Primary data saved (42877 records). [2025-10-27T19:06:04.269277] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-27T19:06:04.269361] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GTLS took 38.3s. Estimated remaining: 2h 58m 14s. Rate: 7.8 symbols/min [2025-10-27T19:06:04.423269] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-27T19:06:04.454284] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:04.485944] [DEBUG] [LOCAL ] GVA: Loaded 33038 existing records from primary storage. [2025-10-27T19:06:04.486193] [INFO ] [MAIN ] GVA: Loaded 33038 existing records. [2025-10-27T19:06:04.668850] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:04.669046] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-27T19:06:04.669095] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-27T19:06:04.669275] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-27T19:06:04.669315] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-27T19:06:05.033749] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:05.068683] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:06:05.214929] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-27T19:06:05.545930] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:06:05.552221] [INFO ] [REMOTE ] GTY: Full fetch complete (43879 records). [2025-10-27T19:06:05.552314] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-27T19:06:05.920365] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-27T19:06:05.920437] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-27T19:06:05.921131] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-27T19:06:05.921250] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-27T19:06:05.922136] [DEBUG] [LOCAL ] GTY: Trimmed 43879 records to 29754 (keeping 200 days of data) [2025-10-27T19:06:06.014980] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-27T19:06:06.100244] [DEBUG] [LOCAL ] GTY: Primary data saved (29754 records). [2025-10-27T19:06:06.100363] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-27T19:06:06.100441] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GTY took 30.8s. Estimated remaining: 2h 57m 58s. Rate: 7.8 symbols/min [2025-10-27T19:06:06.267564] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:06.287253] [DEBUG] [LOCAL ] GWH: Loaded 20766 existing records from primary storage. [2025-10-27T19:06:06.287476] [INFO ] [MAIN ] GWH: Loaded 20766 existing records. [2025-10-27T19:06:06.464413] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:06.464722] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-27T19:06:06.464823] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-27T19:06:06.464983] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-27T19:06:06.465023] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-27T19:06:06.800678] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:06:06.847214] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-27T19:06:06.869589] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:06.971025] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:06:07.615011] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-27T19:06:08.208692] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:06:08.414922] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-27T19:06:08.662914] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T19:06:09.203594] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T19:06:09.214902] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-27T19:06:10.014984] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-27T19:06:10.131832] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:06:10.814976] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-27T19:06:10.990384] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T19:06:11.614924] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-27T19:06:11.690322] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:06:12.237027] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:06:12.415038] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-27T19:06:13.214955] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-27T19:06:13.698399] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T19:06:14.021012] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-27T19:06:14.037091] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:06:14.814929] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-27T19:06:15.088343] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:06:15.315547] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:06:15.614945] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-27T19:06:16.390470] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:06:16.414910] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-27T19:06:17.214940] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-27T19:06:17.299441] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T19:06:17.301986] [INFO ] [REMOTE ] GUG: Full fetch complete (18701 records). [2025-10-27T19:06:17.302055] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-27T19:06:17.667598] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-27T19:06:17.667694] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-27T19:06:17.668094] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-27T19:06:17.668133] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-27T19:06:17.668629] [DEBUG] [LOCAL ] GUG: Trimmed 18701 records to 11956 (keeping 200 days of data) [2025-10-27T19:06:17.738886] [DEBUG] [LOCAL ] GUG: Primary data saved (11956 records). [2025-10-27T19:06:17.739017] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-27T19:06:17.739094] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUG took 21.9s. Estimated remaining: 2h 57m 56s. Rate: 7.8 symbols/min [2025-10-27T19:06:17.908374] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:17.946723] [DEBUG] [LOCAL ] GWRE: Loaded 39996 existing records from primary storage. [2025-10-27T19:06:17.947002] [INFO ] [MAIN ] GWRE: Loaded 39996 existing records. [2025-10-27T19:06:18.016386] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-27T19:06:18.135466] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:18.145101] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T19:06:18.144764] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-27T19:06:18.148569] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-27T19:06:18.149074] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-27T19:06:18.149127] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-27T19:06:18.536692] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:18.815021] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-27T19:06:19.546766] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:06:19.614945] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-27T19:06:20.414934] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-27T19:06:20.478807] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:06:20.663851] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:06:21.217510] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-27T19:06:21.219293] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T19:06:22.014943] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-27T19:06:22.634370] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:06:22.814933] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-27T19:06:23.587742] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T19:06:23.614901] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-27T19:06:24.007532] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:06:24.414943] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-27T19:06:24.922132] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:06:25.064572] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:06:25.214951] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-27T19:06:26.014932] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-27T19:06:26.114105] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:06:26.815075] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-27T19:06:27.313315] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:06:27.614962] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-27T19:06:27.965432] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:06:28.414947] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-27T19:06:28.580462] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:06:29.214935] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-27T19:06:29.644508] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:06:30.014934] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-27T19:06:30.676500] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T19:06:30.775763] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:06:30.814911] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-27T19:06:31.614933] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-27T19:06:31.780632] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:06:32.414936] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-27T19:06:33.011087] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T19:06:33.214920] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-27T19:06:33.391948] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:06:34.014931] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-27T19:06:34.623175] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:06:34.814945] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-27T19:06:35.614921] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-27T19:06:35.920014] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-27T19:06:35.928399] [INFO ] [REMOTE ] GWH: Full fetch complete (25376 records). [2025-10-27T19:06:35.928552] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-27T19:06:36.295001] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-27T19:06:36.295083] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-27T19:06:36.295674] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-27T19:06:36.295735] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-27T19:06:36.296371] [DEBUG] [LOCAL ] GWH: Trimmed 25376 records to 20891 (keeping 200 days of data) [2025-10-27T19:06:36.415725] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-27T19:06:36.415619] [DEBUG] [LOCAL ] GWH: Primary data saved (20891 records). [2025-10-27T19:06:36.416018] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-27T19:06:36.416319] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GWH took 30.3s. Estimated remaining: 2h 58m 3s. Rate: 7.8 symbols/min [2025-10-27T19:06:36.590215] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:36.608253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:06:36.614962] [INFO ] [REMOTE ] GVA: Full fetch complete (48517 records). [2025-10-27T19:06:36.615060] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-27T19:06:36.786863] [DEBUG] [LOCAL ] GWW: Loaded 19526 existing records from primary storage. [2025-10-27T19:06:36.817023] [INFO ] [MAIN ] GWW: Loaded 19526 existing records. [2025-10-27T19:06:37.231388] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-27T19:06:37.228744] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:37.231804] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-27T19:06:37.232009] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-27T19:06:37.232820] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-27T19:06:37.233099] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-27T19:06:37.233245] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-27T19:06:37.233565] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-27T19:06:37.233718] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-27T19:06:37.316545] [DEBUG] [LOCAL ] GVA: Trimmed 48517 records to 32201 (keeping 200 days of data) [2025-10-27T19:06:37.452821] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T19:06:37.514033] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T19:06:37.552888] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-27T19:06:37.860113] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:37.865252] [DEBUG] [LOCAL ] GVA: Primary data saved (32201 records). [2025-10-27T19:06:37.865664] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-27T19:06:37.865781] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GVA took 33.6s. Estimated remaining: 2h 57m 47s. Rate: 7.8 symbols/min [2025-10-27T19:06:38.028617] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-27T19:06:38.031699] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:38.073394] [DEBUG] [LOCAL ] GXO: Loaded 47037 existing records from primary storage. [2025-10-27T19:06:38.073704] [INFO ] [MAIN ] GXO: Loaded 47037 existing records. [2025-10-27T19:06:38.248621] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:38.248829] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-27T19:06:38.248875] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-27T19:06:38.249065] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-27T19:06:38.249103] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-27T19:06:38.605224] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:38.616181] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T19:06:38.620066] [INFO ] [REMOTE ] GUT: Full fetch complete (22556 records). [2025-10-27T19:06:38.620144] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-27T19:06:38.820125] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-27T19:06:39.000927] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-27T19:06:39.001024] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-27T19:06:39.001601] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-27T19:06:39.001672] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-27T19:06:39.002353] [DEBUG] [LOCAL ] GUT: Trimmed 22556 records to 15426 (keeping 200 days of data) [2025-10-27T19:06:39.107542] [DEBUG] [LOCAL ] GUT: Primary data saved (15426 records). [2025-10-27T19:06:39.107849] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-27T19:06:39.108005] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GUT took 36.6s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-27T19:06:39.196884] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:06:39.299727] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:39.304034] [DEBUG] [LOCAL ] GYLD: Loaded 1542 existing records from primary storage. [2025-10-27T19:06:39.304201] [INFO ] [MAIN ] GYLD: Loaded 1542 existing records. [2025-10-27T19:06:39.479889] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:39.480093] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-27T19:06:39.480140] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-27T19:06:39.480278] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-27T19:06:39.480314] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-27T19:06:39.620363] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-27T19:06:39.847202] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:40.082621] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T19:06:40.414958] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-27T19:06:40.497874] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:06:41.215027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-27T19:06:42.010289] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:06:42.019453] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-27T19:06:42.385414] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T19:06:42.414756] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:06:42.814949] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-27T19:06:43.614961] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-27T19:06:44.081375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:06:44.414932] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-27T19:06:44.754736] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:06:44.792688] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T19:06:45.214932] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-27T19:06:46.015006] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-27T19:06:46.112274] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T19:06:46.814966] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-27T19:06:47.559839] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T19:06:47.614910] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-27T19:06:48.423296] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-27T19:06:48.426307] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:06:49.214980] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-27T19:06:49.261673] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:06:49.268599] [INFO ] [REMOTE ] GWRE: Full fetch complete (59865 records). [2025-10-27T19:06:49.268748] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-27T19:06:49.644863] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:06:49.667538] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-27T19:06:49.668352] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-27T19:06:49.669618] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-27T19:06:49.669710] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-27T19:06:49.671024] [DEBUG] [LOCAL ] GWRE: Trimmed 59865 records to 39239 (keeping 200 days of data) [2025-10-27T19:06:49.912443] [DEBUG] [LOCAL ] GWRE: Primary data saved (39239 records). [2025-10-27T19:06:49.912595] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-27T19:06:49.912733] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GWRE took 32.2s. Estimated remaining: 2h 57m 27s. Rate: 7.8 symbols/min [2025-10-27T19:06:50.020161] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-27T19:06:50.084357] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:06:50.126025] [DEBUG] [LOCAL ] H: Loaded 45005 existing records from primary storage. [2025-10-27T19:06:50.126334] [INFO ] [MAIN ] H: Loaded 45005 existing records. [2025-10-27T19:06:50.297559] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:06:50.297774] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-27T19:06:50.297821] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-27T19:06:50.298022] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-27T19:06:50.298079] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-27T19:06:50.399625] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T19:06:50.656891] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:06:50.762481] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:06:50.814905] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-27T19:06:51.111403] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-27T19:06:51.614939] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-27T19:06:52.414944] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-27T19:06:53.202221] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T19:06:53.214907] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-27T19:06:53.783425] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:06:54.014946] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-27T19:06:54.812825] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:06:54.816565] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-27T19:06:55.322453] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T19:06:55.621963] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-27T19:06:55.637611] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:06:55.926814] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-27T19:06:56.414933] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-27T19:06:57.214942] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-27T19:06:57.680478] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:06:58.014995] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-27T19:06:58.120552] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:06:58.814951] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-27T19:06:59.173790] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:06:59.421770] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:06:59.614938] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-27T19:07:00.414949] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-27T19:07:01.075773] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:07:01.214922] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-27T19:07:01.783965] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T19:07:02.014995] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-27T19:07:02.814916] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-27T19:07:03.170167] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T19:07:03.517496] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:07:03.614945] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-27T19:07:03.665791] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T19:07:04.414968] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-27T19:07:05.214922] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-27T19:07:05.258896] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:07:05.525050] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T19:07:06.014980] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-27T19:07:06.486524] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:07:06.654135] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:07:06.662426] [INFO ] [REMOTE ] GXO: Full fetch complete (69163 records). [2025-10-27T19:07:06.662554] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-27T19:07:06.816313] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-27T19:07:07.059039] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-27T19:07:07.059137] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-27T19:07:07.060072] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-27T19:07:07.060138] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-27T19:07:07.061510] [DEBUG] [LOCAL ] GXO: Trimmed 69163 records to 46145 (keeping 200 days of data) [2025-10-27T19:07:07.321812] [DEBUG] [LOCAL ] GXO: Primary data saved (46145 records). [2025-10-27T19:07:07.321942] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-27T19:07:07.322020] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 29.5s. Estimated remaining: 2h 57m 32s. Rate: 7.8 symbols/min [2025-10-27T19:07:07.486918] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:07.522799] [DEBUG] [LOCAL ] HAE: Loaded 39807 existing records from primary storage. [2025-10-27T19:07:07.523076] [INFO ] [MAIN ] HAE: Loaded 39807 existing records. [2025-10-27T19:07:07.620888] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-27T19:07:07.704130] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:07.704346] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-27T19:07:07.704393] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-27T19:07:07.704622] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-27T19:07:07.704838] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-27T19:07:08.053589] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:08.087695] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:07:08.091874] [INFO ] [REMOTE ] GWW: Full fetch complete (29043 records). [2025-10-27T19:07:08.091949] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-27T19:07:08.422467] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-27T19:07:08.451360] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-27T19:07:08.451439] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-27T19:07:08.451996] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-27T19:07:08.452057] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-27T19:07:08.452764] [DEBUG] [LOCAL ] GWW: Trimmed 29043 records to 18953 (keeping 200 days of data) [2025-10-27T19:07:08.574990] [DEBUG] [LOCAL ] GWW: Primary data saved (18953 records). [2025-10-27T19:07:08.575129] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-27T19:07:08.575204] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GWW took 32.2s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-27T19:07:08.740119] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:08.779253] [DEBUG] [LOCAL ] HAFN: Loaded 43254 existing records from primary storage. [2025-10-27T19:07:08.779556] [INFO ] [MAIN ] HAFN: Loaded 43254 existing records. [2025-10-27T19:07:08.968991] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:08.969242] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-27T19:07:08.969364] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-27T19:07:08.969558] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-27T19:07:08.969600] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-27T19:07:09.225331] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-27T19:07:09.328142] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:09.355150] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T19:07:09.734259] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T19:07:10.000604] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:07:10.014899] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-27T19:07:10.814950] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-27T19:07:11.369796] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T19:07:11.372373] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:07:11.373522] [INFO ] [REMOTE ] GYLD: Full fetch complete (2105 records). [2025-10-27T19:07:11.382828] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-27T19:07:11.628238] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-27T19:07:11.909261] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-27T19:07:11.909348] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-27T19:07:11.909506] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-27T19:07:11.909570] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-27T19:07:11.909999] [DEBUG] [LOCAL ] GYLD: Trimmed 2105 records to 1514 (keeping 200 days of data) [2025-10-27T19:07:11.919838] [DEBUG] [LOCAL ] GYLD: Primary data saved (1514 records). [2025-10-27T19:07:11.919951] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-27T19:07:11.920033] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. GYLD took 32.8s. Estimated remaining: 2h 57m 2s. Rate: 7.8 symbols/min [2025-10-27T19:07:12.158795] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:12.217025] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-27T19:07:12.217352] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-10-27T19:07:12.395743] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:12.395943] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-27T19:07:12.396013] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-27T19:07:12.396228] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-27T19:07:12.396284] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-27T19:07:12.426951] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-27T19:07:12.750427] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:12.929434] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:07:13.214927] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-27T19:07:14.015064] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-27T19:07:14.016141] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:07:14.825163] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-27T19:07:14.827785] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:07:15.614925] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-27T19:07:15.953345] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:07:16.414948] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-27T19:07:16.617114] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:07:17.214936] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-27T19:07:17.258073] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:07:18.014982] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-27T19:07:18.180167] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:07:18.814949] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-27T19:07:18.930618] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T19:07:19.614915] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-27T19:07:19.793333] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T19:07:19.801620] [INFO ] [REMOTE ] H: Full fetch complete (63555 records). [2025-10-27T19:07:19.801841] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-27T19:07:20.188834] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-27T19:07:20.188991] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-27T19:07:20.189963] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-27T19:07:20.190119] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-27T19:07:20.191484] [DEBUG] [LOCAL ] H: Trimmed 63555 records to 44189 (keeping 200 days of data) [2025-10-27T19:07:20.418363] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-27T19:07:20.477550] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:07:20.502202] [DEBUG] [LOCAL ] H: Primary data saved (44189 records). [2025-10-27T19:07:20.502692] [INFO ] [MAIN ] H: Full history saved. [2025-10-27T19:07:20.502806] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 30.6s. Estimated remaining: 2h 56m 55s. Rate: 7.8 symbols/min [2025-10-27T19:07:20.681991] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:20.724455] [DEBUG] [LOCAL ] HASI: Loaded 48367 existing records from primary storage. [2025-10-27T19:07:20.724817] [INFO ] [MAIN ] HASI: Loaded 48367 existing records. [2025-10-27T19:07:20.913984] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:20.914162] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-27T19:07:20.914211] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-27T19:07:20.914386] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-27T19:07:20.914425] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-27T19:07:21.217615] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-27T19:07:21.289500] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:21.322891] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:07:22.014991] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-27T19:07:22.080528] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:07:22.596937] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:07:22.814987] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-27T19:07:23.483800] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T19:07:23.614921] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-27T19:07:24.213252] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:07:24.414963] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-27T19:07:25.215031] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-27T19:07:25.605488] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T19:07:25.859382] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:07:26.014949] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-27T19:07:26.520475] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T19:07:26.814956] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-27T19:07:27.618559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-27T19:07:27.621121] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:07:28.194741] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:07:28.414991] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-27T19:07:29.214949] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-27T19:07:29.634362] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T19:07:30.014912] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-27T19:07:30.163345] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:07:30.533884] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:07:30.814945] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-27T19:07:31.614904] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-27T19:07:31.945516] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:07:32.090180] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:07:32.414940] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-27T19:07:33.214944] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-27T19:07:33.264594] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:07:33.272671] [INFO ] [REMOTE ] HAE: Full fetch complete (59338 records). [2025-10-27T19:07:33.272830] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-27T19:07:33.651428] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-27T19:07:33.651516] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-27T19:07:33.652321] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-27T19:07:33.652384] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-27T19:07:33.653511] [DEBUG] [LOCAL ] HAE: Trimmed 59338 records to 38963 (keeping 200 days of data) [2025-10-27T19:07:33.874218] [DEBUG] [LOCAL ] HAE: Primary data saved (38963 records). [2025-10-27T19:07:33.874359] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-27T19:07:33.874445] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAE took 26.6s. Estimated remaining: 2h 56m 56s. Rate: 7.8 symbols/min [2025-10-27T19:07:34.040147] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-27T19:07:34.042601] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:34.088239] [DEBUG] [LOCAL ] HAYW: Loaded 49525 existing records from primary storage. [2025-10-27T19:07:34.088549] [INFO ] [MAIN ] HAYW: Loaded 49525 existing records. [2025-10-27T19:07:34.265132] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:34.265357] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-27T19:07:34.265404] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-27T19:07:34.265601] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-27T19:07:34.265690] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-27T19:07:34.654176] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:34.678047] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:07:34.715752] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-27T19:07:34.814909] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-27T19:07:35.614977] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-27T19:07:35.649334] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:07:36.290850] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T19:07:36.414929] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-27T19:07:37.214985] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-27T19:07:37.482428] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T19:07:37.517619] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:07:38.014991] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-27T19:07:38.814998] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-27T19:07:38.907438] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:07:39.377323] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T19:07:39.387371] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-27T19:07:39.387489] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-27T19:07:39.623810] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-27T19:07:39.813462] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-27T19:07:39.813663] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-27T19:07:39.815203] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-27T19:07:39.816844] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:07:39.816989] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-27T19:07:39.828506] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-27T19:07:40.149671] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-27T19:07:40.149805] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-27T19:07:40.150435] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HAL took 28.2s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min [2025-10-27T19:07:40.317477] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:40.327198] [DEBUG] [LOCAL ] HBB: Loaded 6337 existing records from primary storage. [2025-10-27T19:07:40.327402] [INFO ] [MAIN ] HBB: Loaded 6337 existing records. [2025-10-27T19:07:40.423236] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-27T19:07:40.503389] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:40.503570] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-27T19:07:40.503615] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-27T19:07:40.503780] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-27T19:07:40.503829] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-27T19:07:40.864228] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:40.889042] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:07:41.214934] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-27T19:07:41.841489] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:07:42.014911] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-27T19:07:42.176726] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T19:07:42.815017] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-27T19:07:43.133879] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T19:07:43.614949] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-27T19:07:44.414924] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-27T19:07:44.604351] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:07:45.214934] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-27T19:07:45.366598] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:07:45.374356] [INFO ] [REMOTE ] HAFN: Full fetch complete (64522 records). [2025-10-27T19:07:45.374459] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-27T19:07:45.761564] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-27T19:07:45.761766] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-27T19:07:45.762614] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-27T19:07:45.762710] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-27T19:07:45.790236] [DEBUG] [LOCAL ] HAFN: Trimmed 64522 records to 42433 (keeping 200 days of data) [2025-10-27T19:07:45.790084] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:07:46.025618] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-27T19:07:46.044281] [DEBUG] [LOCAL ] HAFN: Primary data saved (42433 records). [2025-10-27T19:07:46.044434] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-27T19:07:46.044784] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAFN took 37.5s. Estimated remaining: 2h 56m 36s. Rate: 7.8 symbols/min [2025-10-27T19:07:46.212272] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:07:46.261521] [DEBUG] [LOCAL ] HBI: Loaded 53680 existing records from primary storage. [2025-10-27T19:07:46.261861] [INFO ] [MAIN ] HBI: Loaded 53680 existing records. [2025-10-27T19:07:46.434997] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:07:46.435193] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-27T19:07:46.435238] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-27T19:07:46.435415] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-27T19:07:46.435465] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-27T19:07:46.798120] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:07:46.798410] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:07:46.814896] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-27T19:07:47.106848] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T19:07:47.531320] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T19:07:47.614913] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-27T19:07:48.414958] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-27T19:07:49.207970] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:07:49.217131] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-27T19:07:49.256978] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T19:07:50.014986] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-27T19:07:50.821500] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-27T19:07:50.826557] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T19:07:51.510250] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:07:51.614967] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-27T19:07:52.129880] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T19:07:52.400216] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T19:07:52.414906] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-27T19:07:53.214947] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-27T19:07:53.886034] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:07:54.014981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-27T19:07:54.510897] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:07:54.814963] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-27T19:07:55.412354] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:07:55.614998] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-27T19:07:55.733101] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:07:56.415009] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-27T19:07:57.214930] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-27T19:07:57.271251] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:07:57.662983] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:07:58.014959] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-27T19:07:58.814951] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-27T19:07:58.942511] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:07:59.498942] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T19:07:59.533859] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:07:59.614976] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-27T19:08:00.415000] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-27T19:08:01.214964] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-27T19:08:02.015008] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-27T19:08:03.186934] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:08:03.189471] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-27T19:08:03.258213] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-27T19:08:03.268059] [INFO ] [REMOTE ] HASI: Full fetch complete (68250 records). [2025-10-27T19:08:03.268197] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-27T19:08:03.676853] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-27T19:08:03.690507] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-27T19:08:03.691612] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-27T19:08:03.691732] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-27T19:08:03.694245] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-27T19:08:03.705572] [DEBUG] [LOCAL ] HASI: Trimmed 68250 records to 47503 (keeping 200 days of data) [2025-10-27T19:08:03.706163] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-27T19:08:03.994854] [DEBUG] [LOCAL ] HASI: Primary data saved (47503 records). [2025-10-27T19:08:03.995041] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-27T19:08:03.995139] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HASI took 43.5s. Estimated remaining: 2h 56m 42s. Rate: 7.8 symbols/min [2025-10-27T19:08:04.160785] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:04.209168] [DEBUG] [LOCAL ] HBM: Loaded 53759 existing records from primary storage. [2025-10-27T19:08:04.209459] [INFO ] [MAIN ] HBM: Loaded 53759 existing records. [2025-10-27T19:08:04.407509] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:04.407802] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-27T19:08:04.407853] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-27T19:08:04.408052] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-27T19:08:04.408110] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-27T19:08:04.828581] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:04.829078] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-27T19:08:04.890442] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (5.28 seconds). [2025-10-27T19:08:04.899879] [INFO ] [REMOTE ] HAYW: Full fetch complete (70908 records). [2025-10-27T19:08:04.900053] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-27T19:08:05.008382] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T19:08:05.220173] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-27T19:08:05.302872] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-27T19:08:05.313684] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-27T19:08:05.319835] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-27T19:08:05.330596] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-27T19:08:05.335748] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T19:08:05.347955] [DEBUG] [LOCAL ] HAYW: Trimmed 70908 records to 48740 (keeping 200 days of data) [2025-10-27T19:08:05.620747] [DEBUG] [LOCAL ] HAYW: Primary data saved (48740 records). [2025-10-27T19:08:05.620874] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-27T19:08:05.620951] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 31.7s. Estimated remaining: 2h 56m 26s. Rate: 7.8 symbols/min [2025-10-27T19:08:05.786292] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:05.791174] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T19:08:05.792735] [INFO ] [REMOTE ] HBB: Full fetch complete (9160 records). [2025-10-27T19:08:05.792808] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-27T19:08:06.031557] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-27T19:08:06.095450] [DEBUG] [LOCAL ] HCA: Loaded 47631 existing records from primary storage. [2025-10-27T19:08:06.110728] [INFO ] [MAIN ] HCA: Loaded 47631 existing records. [2025-10-27T19:08:06.283800] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-27T19:08:06.299910] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-27T19:08:06.300422] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-27T19:08:06.300560] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-27T19:08:06.317019] [DEBUG] [LOCAL ] HBB: Trimmed 9160 records to 6050 (keeping 200 days of data) [2025-10-27T19:08:06.410527] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:06.414916] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-27T19:08:06.438548] [DEBUG] [LOCAL ] HBB: Primary data saved (6050 records). [2025-10-27T19:08:06.440838] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-27T19:08:06.447536] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HBB took 26.3s. Estimated remaining: 2h 56m 9s. Rate: 7.8 symbols/min [2025-10-27T19:08:06.438725] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-27T19:08:06.483716] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-27T19:08:06.484185] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-27T19:08:06.508540] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:08:06.824447] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-27T19:08:06.834701] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:07.012169] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:07.042124] [DEBUG] [LOCAL ] HCC: Loaded 45578 existing records from primary storage. [2025-10-27T19:08:07.042546] [INFO ] [MAIN ] HCC: Loaded 45578 existing records. [2025-10-27T19:08:07.234063] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:07.234277] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-27T19:08:07.234324] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-27T19:08:07.234510] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-27T19:08:07.234550] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-27T19:08:07.584324] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:07.614935] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-27T19:08:07.811557] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T19:08:08.334051] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T19:08:08.414927] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-27T19:08:09.134893] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:08:09.214958] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-27T19:08:09.900387] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:08:10.014952] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-27T19:08:10.768568] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:08:10.814903] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-27T19:08:11.614964] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-27T19:08:11.846545] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:08:12.320848] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:08:12.414960] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-27T19:08:13.081290] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:08:13.214954] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-27T19:08:14.014958] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-27T19:08:14.138545] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:08:14.798050] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:08:14.814909] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-27T19:08:15.570989] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:08:15.614907] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-27T19:08:16.420147] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-27T19:08:16.432457] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:08:17.214947] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-27T19:08:17.365251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T19:08:18.014966] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-27T19:08:18.158854] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:08:18.538088] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T19:08:18.814942] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-27T19:08:19.566104] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:08:19.614902] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-27T19:08:20.414976] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-27T19:08:20.741096] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:08:20.751410] [INFO ] [REMOTE ] HBI: Full fetch complete (76966 records). [2025-10-27T19:08:20.751514] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-27T19:08:21.144774] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-27T19:08:21.144880] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-27T19:08:21.145949] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-27T19:08:21.146055] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-27T19:08:21.147850] [DEBUG] [LOCAL ] HBI: Trimmed 76966 records to 52899 (keeping 200 days of data) [2025-10-27T19:08:21.230219] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-27T19:08:21.379413] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:08:21.493433] [DEBUG] [LOCAL ] HBI: Primary data saved (52899 records). [2025-10-27T19:08:21.493691] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-27T19:08:21.494072] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBI took 35.4s. Estimated remaining: 2h 56m 11s. Rate: 7.8 symbols/min [2025-10-27T19:08:21.616393] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:08:22.014944] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-27T19:08:22.814960] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-27T19:08:23.402487] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T19:08:23.614913] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-27T19:08:23.999545] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T19:08:24.278850] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:08:24.414915] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-27T19:08:25.214980] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-27T19:08:25.430082] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T19:08:25.550993] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:08:26.014934] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-27T19:08:26.814916] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-27T19:08:26.916055] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:08:27.324728] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:08:27.615024] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-27T19:08:28.414985] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-27T19:08:28.573588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:08:29.154155] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:08:29.214905] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-27T19:08:30.015006] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-27T19:08:30.112112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:08:30.120542] [INFO ] [REMOTE ] HCC: Full fetch complete (64792 records). [2025-10-27T19:08:30.120745] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-27T19:08:30.534817] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-27T19:08:30.534901] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-27T19:08:30.535825] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-27T19:08:30.535890] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-27T19:08:30.537247] [DEBUG] [LOCAL ] HCC: Trimmed 64792 records to 44733 (keeping 200 days of data) [2025-10-27T19:08:30.800003] [DEBUG] [LOCAL ] HCC: Primary data saved (44733 records). [2025-10-27T19:08:30.800211] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-27T19:08:30.800879] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCC took 24.4s. Estimated remaining: 2h 56m 5s. Rate: 7.8 symbols/min [2025-10-27T19:08:30.991469] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:08:31.002325] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-27T19:08:32.085608] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:08:32.095964] [INFO ] [REMOTE ] HBM: Full fetch complete (76762 records). [2025-10-27T19:08:32.096083] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-27T19:08:32.506402] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-27T19:08:32.506542] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-27T19:08:32.507680] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-27T19:08:32.507744] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-27T19:08:32.509258] [DEBUG] [LOCAL ] HBM: Trimmed 76762 records to 52979 (keeping 200 days of data) [2025-10-27T19:08:32.657801] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:08:32.754838] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-27T19:08:32.872786] [DEBUG] [LOCAL ] HBM: Primary data saved (52979 records). [2025-10-27T19:08:32.872976] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-27T19:08:32.873076] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HBM took 28.9s. Estimated remaining: 2h 55m 50s. Rate: 7.8 symbols/min [2025-10-27T19:08:34.340550] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:08:34.350107] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-27T19:08:36.001089] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:08:36.010297] [INFO ] [REMOTE ] HCA: Full fetch complete (68939 records). [2025-10-27T19:08:36.010436] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-27T19:08:36.401834] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-27T19:08:36.401931] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-27T19:08:36.402886] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-27T19:08:36.402948] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-27T19:08:36.404217] [DEBUG] [LOCAL ] HCA: Trimmed 68939 records to 46869 (keeping 200 days of data) [2025-10-27T19:08:36.695667] [DEBUG] [LOCAL ] HCA: Primary data saved (46869 records). [2025-10-27T19:08:36.695816] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-27T19:08:36.695909] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCA took 31.1s. Estimated remaining: 2h 55m 37s. Rate: 7.8 symbols/min [2025-10-27T19:08:37.282041] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.397553] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.442691] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.443078] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-27T19:08:37.441184] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:37.443791] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-27T19:08:37.444866] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-27T19:08:37.444936] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-27T19:08:37.449489] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-27T19:08:37.449780] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-27T19:08:37.527849] [DEBUG] [LOCAL ] HCI: Loaded 14235 existing records from primary storage. [2025-10-27T19:08:37.544256] [INFO ] [MAIN ] HCI: Loaded 14235 existing records. [2025-10-27T19:08:37.994930] [DEBUG] [LOCAL ] HDB: Loaded 52684 existing records from primary storage. [2025-10-27T19:08:38.052137] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.055024] [DEBUG] [LOCAL ] HD: Loaded 54239 existing records from primary storage. [2025-10-27T19:08:38.060880] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.061427] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-27T19:08:38.055325] [INFO ] [MAIN ] HDB: Loaded 52684 existing records. [2025-10-27T19:08:38.061694] [INFO ] [MAIN ] HD: Loaded 54239 existing records. [2025-10-27T19:08:38.074007] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-27T19:08:38.133457] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-27T19:08:38.404140] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:38.486321] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-27T19:08:38.812247] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.853277] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.861547] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-27T19:08:38.895781] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-27T19:08:38.917023] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-27T19:08:38.920509] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:38.911598] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T19:08:38.969529] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-27T19:08:38.991501] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-27T19:08:38.991692] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-27T19:08:39.053192] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-27T19:08:39.085353] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-27T19:08:39.144073] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.198538] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-27T19:08:39.376820] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:08:39.389810] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-27T19:08:39.725532] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.737129] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-27T19:08:39.750175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T19:08:39.790134] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-27T19:08:39.810795] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:39.812359] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-27T19:08:40.043840] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-27T19:08:40.044663] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-27T19:08:40.219098] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:08:40.221949] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-27T19:08:40.287535] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-27T19:08:40.414954] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-27T19:08:40.690952] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-27T19:08:41.102593] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:08:41.160146] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:08:41.214931] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-27T19:08:41.840623] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T19:08:42.015027] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-27T19:08:42.477769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:08:42.815003] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-27T19:08:43.069522] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-27T19:08:43.614986] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-27T19:08:43.870172] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-27T19:08:44.214763] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-27T19:08:44.415075] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-27T19:08:45.215015] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-27T19:08:46.014974] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-27T19:08:46.237754] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-27T19:08:46.421107] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T19:08:46.579336] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:08:46.814949] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-27T19:08:47.614957] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-27T19:08:48.019276] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-27T19:08:48.019962] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-27T19:08:48.020028] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-27T19:08:48.190018] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-27T19:08:48.190171] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:08:48.190237] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:08:48.190308] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-27T19:08:48.190368] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-27T19:08:48.190402] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-27T19:08:48.190441] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-27T19:08:48.190494] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HCXY took 11.5s. Estimated remaining: 2h 55m 34s. Rate: 7.8 symbols/min [2025-10-27T19:08:48.351512] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:08:48.398269] [DEBUG] [LOCAL ] HE: Loaded 49431 existing records from primary storage. [2025-10-27T19:08:48.398560] [INFO ] [MAIN ] HE: Loaded 49431 existing records. [2025-10-27T19:08:48.420165] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-27T19:08:48.573542] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:08:48.573747] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-27T19:08:48.573796] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-27T19:08:48.574062] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-27T19:08:48.574120] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-27T19:08:48.925407] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:08:49.026483] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T19:08:49.214916] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-27T19:08:50.015017] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-27T19:08:50.452012] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T19:08:50.717833] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:08:50.742773] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:08:50.814967] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-27T19:08:51.614939] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-27T19:08:51.886440] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:08:52.415007] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-27T19:08:53.214939] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-27T19:08:53.434190] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:08:54.014936] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-27T19:08:54.155147] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:08:54.172561] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T19:08:54.815000] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-27T19:08:55.615025] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-27T19:08:56.148914] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T19:08:56.252115] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-27T19:08:56.414939] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-27T19:08:56.695065] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:08:57.214938] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-27T19:08:58.014982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-27T19:08:58.464391] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:08:58.622429] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T19:08:58.815048] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-27T19:08:59.360951] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:08:59.614961] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-27T19:09:00.414957] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-27T19:09:00.965383] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:09:01.214924] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-27T19:09:01.637404] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-27T19:09:02.015002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-27T19:09:02.491031] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T19:09:02.511326] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:09:02.815005] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-27T19:09:03.614931] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-27T19:09:04.271182] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:09:04.311948] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-27T19:09:04.415001] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-27T19:09:04.559297] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:09:05.215003] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-27T19:09:05.719598] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T19:09:06.015002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-27T19:09:06.136326] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:09:06.139617] [INFO ] [REMOTE ] HCI: Full fetch complete (19553 records). [2025-10-27T19:09:06.139713] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-27T19:09:06.506594] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-27T19:09:06.506736] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-27T19:09:06.507253] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-27T19:09:06.507303] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-27T19:09:06.507984] [DEBUG] [LOCAL ] HCI: Trimmed 19553 records to 13895 (keeping 200 days of data) [2025-10-27T19:09:06.602671] [DEBUG] [LOCAL ] HCI: Primary data saved (13895 records). [2025-10-27T19:09:06.602819] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-27T19:09:06.602915] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HCI took 29.9s. Estimated remaining: 2h 55m 41s. Rate: 7.8 symbols/min [2025-10-27T19:09:06.795136] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:06.815151] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-27T19:09:06.828949] [DEBUG] [LOCAL ] HEI: Loaded 30813 existing records from primary storage. [2025-10-27T19:09:06.829225] [INFO ] [MAIN ] HEI: Loaded 30813 existing records. [2025-10-27T19:09:07.003004] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:07.003222] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-27T19:09:07.003268] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-27T19:09:07.003471] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-27T19:09:07.003508] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-27T19:09:07.354182] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:07.614970] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-27T19:09:08.132968] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-27T19:09:08.414998] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-27T19:09:08.442061] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T19:09:08.704208] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T19:09:09.214962] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-27T19:09:10.014967] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-27T19:09:10.506555] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-27T19:09:10.516797] [INFO ] [REMOTE ] HD: Full fetch complete (77537 records). [2025-10-27T19:09:10.516919] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-27T19:09:10.818614] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-27T19:09:10.920668] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-27T19:09:10.920846] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-27T19:09:10.922052] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-27T19:09:10.922162] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-27T19:09:10.923693] [DEBUG] [LOCAL ] HD: Trimmed 77537 records to 53453 (keeping 200 days of data) [2025-10-27T19:09:11.052435] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T19:09:11.304698] [DEBUG] [LOCAL ] HD: Primary data saved (53453 records). [2025-10-27T19:09:11.304879] [INFO ] [MAIN ] HD: Full history saved. [2025-10-27T19:09:11.305455] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HD took 34.6s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-27T19:09:11.500717] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:11.522280] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T19:09:11.535101] [DEBUG] [LOCAL ] HEQ: Loaded 6878 existing records from primary storage. [2025-10-27T19:09:11.535299] [INFO ] [MAIN ] HEQ: Loaded 6878 existing records. [2025-10-27T19:09:11.620192] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-27T19:09:11.716298] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:11.716519] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-27T19:09:11.716569] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-27T19:09:11.716744] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-27T19:09:11.716802] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-27T19:09:12.075116] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:12.288542] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:09:12.414933] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-27T19:09:13.214922] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-27T19:09:13.631317] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T19:09:13.659076] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:09:13.669134] [INFO ] [REMOTE ] HDB: Full fetch complete (75669 records). [2025-10-27T19:09:13.669255] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-27T19:09:14.019322] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-27T19:09:14.061236] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-27T19:09:14.061432] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-27T19:09:14.062437] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-27T19:09:14.062619] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-27T19:09:14.064239] [DEBUG] [LOCAL ] HDB: Trimmed 75669 records to 51901 (keeping 200 days of data) [2025-10-27T19:09:14.185020] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T19:09:14.419138] [DEBUG] [LOCAL ] HDB: Primary data saved (51901 records). [2025-10-27T19:09:14.419299] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-27T19:09:14.419385] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 37.7s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-27T19:09:14.585893] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:14.628111] [DEBUG] [LOCAL ] HESM: Loaded 49331 existing records from primary storage. [2025-10-27T19:09:14.628396] [INFO ] [MAIN ] HESM: Loaded 49331 existing records. [2025-10-27T19:09:14.739877] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T19:09:14.815056] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:14.815278] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-27T19:09:14.816429] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-27T19:09:14.816502] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-27T19:09:14.816856] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-27T19:09:14.816917] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-27T19:09:15.181328] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:15.478515] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T19:09:15.614972] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-27T19:09:16.414938] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-27T19:09:17.214927] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-27T19:09:17.274574] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:09:17.951038] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T19:09:18.014957] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-27T19:09:18.159583] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:09:18.814924] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-27T19:09:19.133391] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T19:09:19.614918] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-27T19:09:19.665363] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:09:20.414933] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-27T19:09:21.055928] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:09:21.214957] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-27T19:09:21.865381] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:09:21.922507] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:09:21.931593] [INFO ] [REMOTE ] HE: Full fetch complete (71927 records). [2025-10-27T19:09:21.931728] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-27T19:09:22.020120] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-27T19:09:22.315960] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-27T19:09:22.316040] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-27T19:09:22.316932] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-27T19:09:22.316994] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-27T19:09:22.318304] [DEBUG] [LOCAL ] HE: Trimmed 71927 records to 48626 (keeping 200 days of data) [2025-10-27T19:09:22.594857] [DEBUG] [LOCAL ] HE: Primary data saved (48626 records). [2025-10-27T19:09:22.594977] [INFO ] [MAIN ] HE: Full history saved. [2025-10-27T19:09:22.595616] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HE took 34.4s. Estimated remaining: 2h 55m 8s. Rate: 7.8 symbols/min [2025-10-27T19:09:22.765365] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:22.765490] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-27T19:09:22.765525] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-27T19:09:22.765661] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-27T19:09:22.765728] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-27T19:09:22.765808] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-27T19:09:22.765862] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-27T19:09:22.828117] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-27T19:09:23.113249] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:23.614911] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-27T19:09:23.707850] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:09:23.955605] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T19:09:24.414944] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-27T19:09:24.443566] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:09:25.117109] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T19:09:25.214927] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-27T19:09:26.015012] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-27T19:09:26.814931] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-27T19:09:26.860066] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:09:27.082181] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-27T19:09:27.138168] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:09:27.614942] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-27T19:09:28.414952] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-27T19:09:28.770771] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T19:09:28.861569] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T19:09:29.214933] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-27T19:09:30.014959] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-27T19:09:30.262014] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:09:30.742077] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T19:09:30.814906] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-27T19:09:31.614947] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-27T19:09:31.671444] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:09:31.674124] [INFO ] [REMOTE ] HEQ: Full fetch complete (9656 records). [2025-10-27T19:09:31.674215] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-27T19:09:32.083811] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-27T19:09:32.083886] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-27T19:09:32.084129] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-27T19:09:32.084167] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-27T19:09:32.084564] [DEBUG] [LOCAL ] HEQ: Trimmed 9656 records to 6624 (keeping 200 days of data) [2025-10-27T19:09:32.123067] [DEBUG] [LOCAL ] HEQ: Primary data saved (6624 records). [2025-10-27T19:09:32.123173] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-27T19:09:32.123259] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HEQ took 20.8s. Estimated remaining: 2h 55m 3s. Rate: 7.8 symbols/min [2025-10-27T19:09:32.290390] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:32.290533] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-27T19:09:32.290569] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-27T19:09:32.290697] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-27T19:09:32.290749] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-27T19:09:32.290790] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-27T19:09:32.290822] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-27T19:09:32.428837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-27T19:09:32.652174] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:33.099897] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:09:33.214915] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-27T19:09:34.014944] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-27T19:09:34.164044] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T19:09:34.221961] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:09:34.333571] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-27T19:09:34.814964] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-27T19:09:35.105739] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T19:09:35.614951] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-27T19:09:35.905491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-27T19:09:36.414972] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-27T19:09:37.214995] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-27T19:09:37.477889] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T19:09:37.798940] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:09:38.014986] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-27T19:09:38.815011] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-27T19:09:39.615024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-27T19:09:39.710400] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:09:39.761338] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:09:39.905192] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T19:09:40.414989] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-27T19:09:40.685628] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-27T19:09:41.214982] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-27T19:09:41.465915] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-27T19:09:42.014958] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-27T19:09:42.814919] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-27T19:09:43.227598] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T19:09:43.232185] [INFO ] [REMOTE ] HEI: Full fetch complete (46798 records). [2025-10-27T19:09:43.232274] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-27T19:09:43.604351] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-27T19:09:43.604433] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-27T19:09:43.605134] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-27T19:09:43.605194] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-27T19:09:43.606120] [DEBUG] [LOCAL ] HEI: Trimmed 46798 records to 30061 (keeping 200 days of data) [2025-10-27T19:09:43.658461] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-27T19:09:43.788865] [DEBUG] [LOCAL ] HEI: Primary data saved (30061 records). [2025-10-27T19:09:43.789001] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-27T19:09:43.789077] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HEI took 37.2s. Estimated remaining: 2h 55m 1s. Rate: 7.8 symbols/min [2025-10-27T19:09:43.959780] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:43.976869] [DEBUG] [LOCAL ] HFRO: Loaded 16453 existing records from primary storage. [2025-10-27T19:09:43.977124] [INFO ] [MAIN ] HFRO: Loaded 16453 existing records. [2025-10-27T19:09:44.079321] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T19:09:44.164468] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:44.164692] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-27T19:09:44.164750] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-27T19:09:44.164917] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-27T19:09:44.164957] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-27T19:09:44.416554] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-27T19:09:44.566860] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:44.596543] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T19:09:44.853891] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:09:45.214926] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-27T19:09:46.014918] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-27T19:09:46.260566] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-27T19:09:46.383422] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:09:46.814941] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-27T19:09:47.045476] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-27T19:09:47.614977] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-27T19:09:47.948039] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-27T19:09:47.948946] [INFO ] [REMOTE ] HF: Full fetch complete (422 records). [2025-10-27T19:09:47.949018] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-27T19:09:48.134459] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-10-27T19:09:48.134763] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:09:48.134843] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:09:48.134926] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-27T19:09:48.135010] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-27T19:09:48.135050] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-27T19:09:48.135092] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-27T19:09:48.135160] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HF took 25.5s. Estimated remaining: 2h 54m 48s. Rate: 7.8 symbols/min [2025-10-27T19:09:48.315581] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:48.336512] [DEBUG] [LOCAL ] HGER: Loaded 15921 existing records from primary storage. [2025-10-27T19:09:48.336876] [INFO ] [MAIN ] HGER: Loaded 15921 existing records. [2025-10-27T19:09:48.420085] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-27T19:09:48.540075] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:48.540391] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-27T19:09:48.540451] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-27T19:09:48.540749] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-27T19:09:48.540808] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-27T19:09:48.935219] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:49.214959] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-27T19:09:49.634517] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T19:09:50.014968] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-27T19:09:50.118369] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:09:50.128077] [INFO ] [REMOTE ] HESM: Full fetch complete (70064 records). [2025-10-27T19:09:50.128218] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-27T19:09:50.513723] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-27T19:09:50.513805] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-27T19:09:50.514724] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-27T19:09:50.514786] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-27T19:09:50.516044] [DEBUG] [LOCAL ] HESM: Trimmed 70064 records to 48557 (keeping 200 days of data) [2025-10-27T19:09:50.800801] [DEBUG] [LOCAL ] HESM: Primary data saved (48557 records). [2025-10-27T19:09:50.800931] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-27T19:09:50.801007] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HESM took 36.4s. Estimated remaining: 2h 54m 34s. Rate: 7.8 symbols/min [2025-10-27T19:09:50.822878] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-27T19:09:50.974869] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:09:50.986098] [DEBUG] [LOCAL ] HGLB: Loaded 9712 existing records from primary storage. [2025-10-27T19:09:50.986291] [INFO ] [MAIN ] HGLB: Loaded 9712 existing records. [2025-10-27T19:09:51.162214] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:09:51.162549] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-27T19:09:51.162694] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-27T19:09:51.168054] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-27T19:09:51.174973] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-27T19:09:51.251328] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:09:51.294241] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:09:51.546662] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:09:51.614944] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-27T19:09:52.396405] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T19:09:52.414898] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-27T19:09:53.214999] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-27T19:09:53.335963] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:09:53.875242] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T19:09:54.014995] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-27T19:09:54.296759] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-27T19:09:54.814965] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-27T19:09:55.614984] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-27T19:09:55.872954] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T19:09:55.899491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-27T19:09:56.414935] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-27T19:09:56.841121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T19:09:57.215010] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-27T19:09:58.014983] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-27T19:09:58.024262] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T19:09:58.599716] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T19:09:58.814966] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-27T19:09:59.544385] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:09:59.614939] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-27T19:10:00.414928] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-27T19:10:00.607487] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:10:01.214938] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-27T19:10:02.014916] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-27T19:10:02.059511] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:10:02.246331] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:10:02.540621] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:10:02.541867] [INFO ] [REMOTE ] HFND: Full fetch complete (1780 records). [2025-10-27T19:10:02.541961] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-27T19:10:02.721777] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T19:10:02.722010] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:10:02.722098] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:10:02.722182] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-27T19:10:02.722262] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-27T19:10:02.722313] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-27T19:10:02.722394] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-27T19:10:02.722485] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HFND took 30.6s. Estimated remaining: 2h 54m 32s. Rate: 7.8 symbols/min [2025-10-27T19:10:02.821046] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-27T19:10:02.893512] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:02.908311] [DEBUG] [LOCAL ] HGTY: Loaded 13518 existing records from primary storage. [2025-10-27T19:10:02.908547] [INFO ] [MAIN ] HGTY: Loaded 13518 existing records. [2025-10-27T19:10:03.105585] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:03.105820] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-27T19:10:03.105869] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-27T19:10:03.106047] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-27T19:10:03.106103] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-27T19:10:03.449556] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:03.614901] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-27T19:10:04.190391] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:10:04.367692] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T19:10:04.414947] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-27T19:10:04.989285] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T19:10:05.214960] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-27T19:10:06.014928] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-27T19:10:06.156727] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:10:06.492615] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T19:10:06.814958] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-27T19:10:07.614948] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-27T19:10:07.928427] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:10:08.414977] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-27T19:10:08.425212] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T19:10:08.947215] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T19:10:09.214954] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-27T19:10:10.014911] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-27T19:10:10.085060] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T19:10:10.814937] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-27T19:10:10.848686] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T19:10:11.269167] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T19:10:11.614945] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-27T19:10:12.414970] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-27T19:10:12.639943] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T19:10:13.194804] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T19:10:13.214914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-27T19:10:14.014918] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-27T19:10:14.109387] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T19:10:14.820000] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-27T19:10:14.821130] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:10:15.614919] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-27T19:10:15.873768] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T19:10:16.414932] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-27T19:10:16.541122] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:10:17.185739] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T19:10:17.214907] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-27T19:10:17.719409] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-27T19:10:18.014950] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-27T19:10:18.633123] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:10:18.635709] [INFO ] [REMOTE ] HGLB: Full fetch complete (14368 records). [2025-10-27T19:10:18.635781] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-27T19:10:18.816738] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-27T19:10:19.015624] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-27T19:10:19.015752] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-27T19:10:19.016219] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-27T19:10:19.016263] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-27T19:10:19.017048] [DEBUG] [LOCAL ] HGLB: Trimmed 14368 records to 9325 (keeping 200 days of data) [2025-10-27T19:10:19.076600] [DEBUG] [LOCAL ] HGLB: Primary data saved (9325 records). [2025-10-27T19:10:19.076845] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-27T19:10:19.076951] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 28.3s. Estimated remaining: 2h 54m 36s. Rate: 7.8 symbols/min [2025-10-27T19:10:19.253185] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:19.299905] [DEBUG] [LOCAL ] HGV: Loaded 46712 existing records from primary storage. [2025-10-27T19:10:19.300387] [INFO ] [MAIN ] HGV: Loaded 46712 existing records. [2025-10-27T19:10:19.485770] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:19.486038] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-27T19:10:19.486089] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-27T19:10:19.486318] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-27T19:10:19.486358] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-27T19:10:19.623839] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-27T19:10:19.861814] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:19.877437] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T19:10:20.414929] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-27T19:10:20.707455] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:10:21.214981] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-27T19:10:21.352515] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T19:10:22.014938] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-27T19:10:22.362186] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:10:22.692525] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T19:10:22.814965] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-27T19:10:23.615003] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-27T19:10:23.957823] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:10:24.407959] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T19:10:24.410961] [INFO ] [REMOTE ] HGTY: Full fetch complete (17637 records). [2025-10-27T19:10:24.411051] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-27T19:10:24.422197] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-27T19:10:24.773291] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-27T19:10:24.773364] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-27T19:10:24.773795] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-27T19:10:24.773855] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-27T19:10:24.774382] [DEBUG] [LOCAL ] HGTY: Trimmed 17637 records to 13404 (keeping 200 days of data) [2025-10-27T19:10:24.848775] [DEBUG] [LOCAL ] HGTY: Primary data saved (13404 records). [2025-10-27T19:10:24.848900] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-27T19:10:24.848978] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGTY took 22.1s. Estimated remaining: 2h 54m 25s. Rate: 7.8 symbols/min [2025-10-27T19:10:25.016995] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:25.052820] [DEBUG] [LOCAL ] HHH: Loaded 33416 existing records from primary storage. [2025-10-27T19:10:25.053138] [INFO ] [MAIN ] HHH: Loaded 33416 existing records. [2025-10-27T19:10:25.228944] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-27T19:10:25.234454] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:25.235395] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-27T19:10:25.235444] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-27T19:10:25.235607] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-27T19:10:25.235679] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-27T19:10:25.587432] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:25.903269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:10:26.014919] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-27T19:10:26.527416] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:10:26.530133] [INFO ] [REMOTE ] HFRO: Full fetch complete (26319 records). [2025-10-27T19:10:26.530210] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-27T19:10:26.820065] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-27T19:10:26.905318] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-27T19:10:26.905405] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-27T19:10:26.905976] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-27T19:10:26.906040] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-27T19:10:26.906915] [DEBUG] [LOCAL ] HFRO: Trimmed 26319 records to 15780 (keeping 200 days of data) [2025-10-27T19:10:26.999930] [DEBUG] [LOCAL ] HFRO: Primary data saved (15780 records). [2025-10-27T19:10:27.000119] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-27T19:10:27.000264] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HFRO took 43.2s. Estimated remaining: 2h 54m 10s. Rate: 7.8 symbols/min [2025-10-27T19:10:27.170871] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:27.205620] [DEBUG] [LOCAL ] HI: Loaded 36789 existing records from primary storage. [2025-10-27T19:10:27.205934] [INFO ] [MAIN ] HI: Loaded 36789 existing records. [2025-10-27T19:10:27.389110] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:27.389424] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-27T19:10:27.389583] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-27T19:10:27.389849] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-27T19:10:27.389924] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-27T19:10:27.581162] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T19:10:27.622097] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-27T19:10:27.781915] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:27.798286] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:10:28.414982] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-27T19:10:28.571386] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:10:28.576856] [INFO ] [REMOTE ] HGER: Full fetch complete (19434 records). [2025-10-27T19:10:28.576939] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-27T19:10:28.942292] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-27T19:10:28.942371] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-27T19:10:28.942922] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-27T19:10:28.942985] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-27T19:10:28.943593] [DEBUG] [LOCAL ] HGER: Trimmed 19434 records to 15806 (keeping 200 days of data) [2025-10-27T19:10:29.033319] [DEBUG] [LOCAL ] HGER: Primary data saved (15806 records). [2025-10-27T19:10:29.033446] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-27T19:10:29.033543] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGER took 40.9s. Estimated remaining: 2h 53m 55s. Rate: 7.8 symbols/min [2025-10-27T19:10:29.198452] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:29.215007] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-27T19:10:29.251543] [DEBUG] [LOCAL ] HIG: Loaded 51830 existing records from primary storage. [2025-10-27T19:10:29.251877] [INFO ] [MAIN ] HIG: Loaded 51830 existing records. [2025-10-27T19:10:29.428949] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:29.429323] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-27T19:10:29.429389] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-27T19:10:29.429780] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-27T19:10:29.429836] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-27T19:10:29.780258] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:29.796993] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:10:30.014942] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-27T19:10:30.657389] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T19:10:30.814915] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-27T19:10:31.408457] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:10:31.614910] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-27T19:10:32.159148] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:10:32.414913] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-27T19:10:33.005227] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:10:33.214933] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-27T19:10:33.351222] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:10:34.014984] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-27T19:10:34.689207] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:10:34.814914] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-27T19:10:35.140523] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:10:35.615008] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-27T19:10:36.423987] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-27T19:10:36.430567] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:10:36.842232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:10:37.214933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-27T19:10:37.598060] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:10:38.014947] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-27T19:10:38.820181] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-27T19:10:38.825414] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:10:39.614920] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-27T19:10:40.414933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-27T19:10:40.896469] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:10:41.214914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-27T19:10:41.824861] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:10:42.014979] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-27T19:10:42.232367] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (4.22 seconds). [2025-10-27T19:10:42.344500] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:10:42.814918] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-27T19:10:43.237468] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (4.42 seconds). [2025-10-27T19:10:43.553557] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T19:10:43.614949] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-27T19:10:44.328885] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:10:44.414899] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-27T19:10:45.036486] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:10:45.214944] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-27T19:10:45.938132] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:10:46.014926] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-27T19:10:46.802548] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:10:46.814907] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-27T19:10:47.615017] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-27T19:10:48.272788] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-27T19:10:48.414914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-27T19:10:48.669509] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T19:10:48.939810] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T19:10:49.214949] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-27T19:10:49.536293] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T19:10:50.014921] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-27T19:10:50.814935] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-27T19:10:50.964214] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:10:51.613548] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:10:51.622509] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-27T19:10:52.219518] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T19:10:52.414965] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-27T19:10:52.942186] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:10:53.214936] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-27T19:10:53.928409] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:10:54.014964] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-27T19:10:54.714350] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T19:10:54.815004] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-27T19:10:55.456280] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:10:55.473008] [INFO ] [REMOTE ] HIG: Full fetch complete (73703 records). [2025-10-27T19:10:55.473397] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-27T19:10:55.620136] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-27T19:10:55.928775] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-27T19:10:55.928896] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-27T19:10:55.930532] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-27T19:10:55.930626] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-27T19:10:55.932504] [DEBUG] [LOCAL ] HIG: Trimmed 73703 records to 51028 (keeping 200 days of data) [2025-10-27T19:10:56.247480] [DEBUG] [LOCAL ] HIG: Primary data saved (51028 records). [2025-10-27T19:10:56.247705] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-27T19:10:56.248623] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HIG took 27.2s. Estimated remaining: 2h 54m 13s. Rate: 7.8 symbols/min [2025-10-27T19:10:56.391322] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:10:56.416414] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-27T19:10:56.447451] [INFO ] [REMOTE ] HHH: Full fetch complete (46236 records). [2025-10-27T19:10:56.450201] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-27T19:10:56.449132] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:56.826875] [DEBUG] [LOCAL ] HII: Loaded 33817 existing records from primary storage. [2025-10-27T19:10:56.873031] [INFO ] [MAIN ] HII: Loaded 33817 existing records. [2025-10-27T19:10:56.992448] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-27T19:10:57.014636] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-27T19:10:57.026348] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-27T19:10:57.031764] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-27T19:10:57.099328] [DEBUG] [LOCAL ] HHH: Trimmed 46236 records to 32806 (keeping 200 days of data) [2025-10-27T19:10:57.099161] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:57.100408] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-27T19:10:57.100533] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-27T19:10:57.100898] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-27T19:10:57.101041] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-27T19:10:57.256342] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:10:57.338038] [INFO ] [REMOTE ] HI: Full fetch complete (51613 records). [2025-10-27T19:10:57.342325] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-27T19:10:57.794728] [DEBUG] [LOCAL ] HHH: Primary data saved (32806 records). [2025-10-27T19:10:57.806087] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-27T19:10:57.833952] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HHH took 33.0s. Estimated remaining: 2h 53m 57s. Rate: 7.8 symbols/min [2025-10-27T19:10:58.061600] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:10:58.072524] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-27T19:10:58.270794] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-27T19:10:58.270956] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-27T19:10:58.288558] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-27T19:10:58.291465] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:58.288712] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-27T19:10:58.292965] [DEBUG] [LOCAL ] HI: Trimmed 51613 records to 36099 (keeping 200 days of data) [2025-10-27T19:10:58.402547] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-27T19:10:58.419772] [INFO ] [REMOTE ] HGV: Full fetch complete (65904 records). [2025-10-27T19:10:58.420047] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-27T19:10:58.791114] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-27T19:10:58.816621] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-10-27T19:10:58.805082] [DEBUG] [LOCAL ] HI: Primary data saved (36099 records). [2025-10-27T19:10:58.860085] [INFO ] [MAIN ] HI: Full history saved. [2025-10-27T19:10:58.884025] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HI took 31.9s. Estimated remaining: 2h 53m 40s. Rate: 7.8 symbols/min [2025-10-27T19:10:59.281251] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-27T19:10:59.281007] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:10:59.286814] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-27T19:10:59.287927] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-27T19:10:59.298467] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-27T19:10:59.318568] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-27T19:10:59.321355] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-27T19:10:59.324488] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-27T19:10:59.343087] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-27T19:10:59.346776] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:10:59.434360] [DEBUG] [LOCAL ] HGV: Trimmed 65904 records to 45936 (keeping 200 days of data) [2025-10-27T19:10:59.624385] [DEBUG] [LOCAL ] HIO: Loaded 24328 existing records from primary storage. [2025-10-27T19:10:59.716570] [INFO ] [MAIN ] HIO: Loaded 24328 existing records. [2025-10-27T19:11:00.191241] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:00.193032] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:11:00.194161] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-27T19:11:00.230699] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:00.227497] [DEBUG] [LOCAL ] HGV: Primary data saved (45936 records). [2025-10-27T19:11:00.232918] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-27T19:11:00.232850] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-27T19:11:00.232989] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-27T19:11:00.233130] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HGV took 41.2s. Estimated remaining: 2h 53m 24s. Rate: 7.8 symbols/min [2025-10-27T19:11:00.231836] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-27T19:11:00.244925] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-27T19:11:00.263531] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-27T19:11:00.654441] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:00.795308] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:00.802270] [DEBUG] [LOCAL ] HIPO: Loaded 21635 existing records from primary storage. [2025-10-27T19:11:00.801932] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-27T19:11:00.803215] [INFO ] [MAIN ] HIPO: Loaded 21635 existing records. [2025-10-27T19:11:00.979857] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:00.980119] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-27T19:11:00.980172] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-27T19:11:00.980339] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-27T19:11:00.980425] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-27T19:11:01.329710] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:01.329997] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-27T19:11:02.349270] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T19:11:02.358536] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-27T19:11:02.532350] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:11:02.536876] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-27T19:11:02.617081] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-27T19:11:02.814972] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-27T19:11:02.924566] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-27T19:11:03.185387] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:11:03.623610] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-27T19:11:03.625820] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:11:04.414928] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-27T19:11:04.509680] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T19:11:04.614953] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:11:05.214931] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-27T19:11:05.919717] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:11:06.015002] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-27T19:11:06.814950] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-27T19:11:06.964108] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T19:11:07.614926] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-27T19:11:07.866231] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:11:08.074521] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T19:11:08.414980] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-27T19:11:08.768512] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:11:09.214991] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-27T19:11:09.436446] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T19:11:09.928444] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:11:10.014984] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-27T19:11:10.814949] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-27T19:11:11.096440] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:11:11.614991] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-27T19:11:11.641068] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:11:12.415002] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-27T19:11:13.214939] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-27T19:11:13.972294] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T19:11:14.014954] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-27T19:11:14.369781] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T19:11:14.436795] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-27T19:11:14.814981] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-27T19:11:15.428059] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:11:15.614942] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-27T19:11:15.761781] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:11:16.414949] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-27T19:11:16.697941] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:11:17.150884] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:11:17.215026] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-27T19:11:18.014957] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-27T19:11:18.239747] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T19:11:18.814947] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-27T19:11:19.205621] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:11:19.614906] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-27T19:11:20.060320] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:11:20.414933] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-27T19:11:21.214987] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-27T19:11:21.257285] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:11:21.264314] [INFO ] [REMOTE ] HII: Full fetch complete (52274 records). [2025-10-27T19:11:21.264508] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-27T19:11:21.367077] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:11:21.689081] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-27T19:11:21.689165] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-27T19:11:21.689973] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-27T19:11:21.690035] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-27T19:11:21.691095] [DEBUG] [LOCAL ] HII: Trimmed 52274 records to 33058 (keeping 200 days of data) [2025-10-27T19:11:21.893673] [DEBUG] [LOCAL ] HII: Primary data saved (33058 records). [2025-10-27T19:11:21.893814] [INFO ] [MAIN ] HII: Full history saved. [2025-10-27T19:11:21.894423] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HII took 25.6s. Estimated remaining: 2h 53m 35s. Rate: 7.8 symbols/min [2025-10-27T19:11:22.020156] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-27T19:11:22.067153] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:22.111083] [DEBUG] [LOCAL ] HIW: Loaded 45049 existing records from primary storage. [2025-10-27T19:11:22.111423] [INFO ] [MAIN ] HIW: Loaded 45049 existing records. [2025-10-27T19:11:22.285873] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:22.286141] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-27T19:11:22.286194] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-27T19:11:22.286402] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-27T19:11:22.286457] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-27T19:11:22.629341] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:22.814918] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-27T19:11:23.158612] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:11:23.162453] [INFO ] [REMOTE ] HIPO: Full fetch complete (30946 records). [2025-10-27T19:11:23.162568] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-27T19:11:23.576560] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-27T19:11:23.576799] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-27T19:11:23.577552] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-27T19:11:23.577759] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-27T19:11:23.578593] [DEBUG] [LOCAL ] HIPO: Trimmed 30946 records to 21121 (keeping 200 days of data) [2025-10-27T19:11:23.627954] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-27T19:11:23.712249] [DEBUG] [LOCAL ] HIPO: Primary data saved (21121 records). [2025-10-27T19:11:23.712482] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-27T19:11:23.712673] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIPO took 23.5s. Estimated remaining: 2h 53m 19s. Rate: 7.8 symbols/min [2025-10-27T19:11:23.860138] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-27T19:11:23.934211] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:23.954215] [DEBUG] [LOCAL ] HIX: Loaded 20759 existing records from primary storage. [2025-10-27T19:11:23.954457] [INFO ] [MAIN ] HIX: Loaded 20759 existing records. [2025-10-27T19:11:24.125836] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:24.125997] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-27T19:11:24.126041] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-27T19:11:24.126226] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-27T19:11:24.126281] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-27T19:11:24.417877] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-27T19:11:24.502327] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:24.526891] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:11:24.885177] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:11:25.214933] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-27T19:11:26.014966] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-27T19:11:26.340477] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:11:26.794205] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T19:11:26.814921] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-27T19:11:27.112620] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:11:27.615006] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-27T19:11:28.414943] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-27T19:11:28.638137] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T19:11:28.644719] [INFO ] [REMOTE ] HIO: Full fetch complete (38270 records). [2025-10-27T19:11:28.644803] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-27T19:11:29.020208] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-27T19:11:29.020370] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-27T19:11:29.021203] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-27T19:11:29.021287] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-27T19:11:29.022526] [DEBUG] [LOCAL ] HIO: Trimmed 38270 records to 23581 (keeping 200 days of data) [2025-10-27T19:11:29.186981] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-27T19:11:29.198321] [DEBUG] [LOCAL ] HIO: Primary data saved (23581 records). [2025-10-27T19:11:29.208932] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-27T19:11:29.209051] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIO took 30.2s. Estimated remaining: 2h 53m 9s. Rate: 7.8 symbols/min [2025-10-27T19:11:29.221714] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-27T19:11:29.401771] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:29.421757] [DEBUG] [LOCAL ] HKD: Loaded 18983 existing records from primary storage. [2025-10-27T19:11:29.422188] [INFO ] [MAIN ] HKD: Loaded 18983 existing records. [2025-10-27T19:11:29.556705] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:11:29.650022] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:29.650305] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-27T19:11:29.650368] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-27T19:11:29.650536] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-27T19:11:29.650575] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-27T19:11:30.011318] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:30.014899] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-27T19:11:30.815000] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-27T19:11:30.842272] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:11:31.015199] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:11:31.614922] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-27T19:11:31.917453] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:11:32.414966] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-27T19:11:32.967597] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:11:33.214925] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-27T19:11:33.630166] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:11:34.014936] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-27T19:11:34.814995] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-27T19:11:35.614976] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-27T19:11:35.675933] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:11:36.020598] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:11:36.168584] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-27T19:11:36.414911] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-27T19:11:36.446539] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:11:37.151011] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T19:11:37.214918] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-27T19:11:38.014968] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-27T19:11:38.815009] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-27T19:11:39.451865] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T19:11:39.614988] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-27T19:11:39.800593] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:11:39.909553] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-27T19:11:40.359858] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T19:11:40.414896] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-27T19:11:41.214963] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-27T19:11:41.412508] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:11:41.867869] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:11:42.015012] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-27T19:11:42.815004] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-27T19:11:43.127141] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:11:43.614998] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-27T19:11:44.415000] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-27T19:11:44.623901] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T19:11:45.124671] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T19:11:45.214969] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-27T19:11:45.602014] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-27T19:11:46.014985] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-27T19:11:46.066517] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T19:11:46.815014] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-27T19:11:47.580752] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T19:11:47.584971] [INFO ] [REMOTE ] HIX: Full fetch complete (30106 records). [2025-10-27T19:11:47.585047] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-27T19:11:47.620041] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-27T19:11:47.964747] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-27T19:11:47.964827] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-27T19:11:47.965473] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-27T19:11:47.965514] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-27T19:11:47.966283] [DEBUG] [LOCAL ] HIX: Trimmed 30106 records to 20160 (keeping 200 days of data) [2025-10-27T19:11:48.088067] [DEBUG] [LOCAL ] HIX: Primary data saved (20160 records). [2025-10-27T19:11:48.088204] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-27T19:11:48.088314] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIX took 24.4s. Estimated remaining: 2h 53m 16s. Rate: 7.8 symbols/min [2025-10-27T19:11:48.283884] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:48.332225] [DEBUG] [LOCAL ] HL: Loaded 54456 existing records from primary storage. [2025-10-27T19:11:48.332543] [INFO ] [MAIN ] HL: Loaded 54456 existing records. [2025-10-27T19:11:48.421200] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-27T19:11:48.509667] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:48.509863] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-27T19:11:48.509909] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-27T19:11:48.510128] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-27T19:11:48.510183] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-27T19:11:48.869859] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:48.964768] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-27T19:11:48.975349] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-27T19:11:48.975516] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-27T19:11:49.220676] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-27T19:11:49.363018] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:11:49.420765] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-27T19:11:49.421026] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-27T19:11:49.422117] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-27T19:11:49.422209] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-27T19:11:49.424075] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-27T19:11:49.522682] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:11:49.753439] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-27T19:11:49.753559] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-27T19:11:49.753639] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HIMS took 51.9s. Estimated remaining: 2h 53m 0s. Rate: 7.8 symbols/min [2025-10-27T19:11:49.923407] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:49.965363] [DEBUG] [LOCAL ] HLF: Loaded 49053 existing records from primary storage. [2025-10-27T19:11:49.965693] [INFO ] [MAIN ] HLF: Loaded 49053 existing records. [2025-10-27T19:11:50.025333] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-27T19:11:50.157907] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:50.158105] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-27T19:11:50.158152] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-27T19:11:50.158325] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-27T19:11:50.158364] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-27T19:11:50.524220] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:50.814968] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-27T19:11:50.982355] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:11:51.620086] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-27T19:11:51.644214] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:11:51.742039] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:11:52.414949] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-27T19:11:52.982617] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:11:53.214983] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-27T19:11:54.014940] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-27T19:11:54.095805] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:11:54.710034] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:11:54.814949] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-27T19:11:55.512760] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T19:11:55.614946] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-27T19:11:56.358489] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T19:11:56.414923] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-27T19:11:57.214928] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-27T19:11:57.303574] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:11:57.312623] [INFO ] [REMOTE ] HIW: Full fetch complete (64914 records). [2025-10-27T19:11:57.312906] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-27T19:11:57.700909] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-27T19:11:57.700984] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-27T19:11:57.701843] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-27T19:11:57.701905] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-27T19:11:57.703197] [DEBUG] [LOCAL ] HIW: Trimmed 64914 records to 44271 (keeping 200 days of data) [2025-10-27T19:11:57.964556] [DEBUG] [LOCAL ] HIW: Primary data saved (44271 records). [2025-10-27T19:11:57.964703] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-27T19:11:57.965351] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HIW took 36.1s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-27T19:11:58.022978] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-27T19:11:58.144951] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:58.176015] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:11:58.212431] [DEBUG] [LOCAL ] HLI: Loaded 31042 existing records from primary storage. [2025-10-27T19:11:58.212722] [INFO ] [MAIN ] HLI: Loaded 31042 existing records. [2025-10-27T19:11:58.400780] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:58.400991] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-27T19:11:58.401043] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-27T19:11:58.401224] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-27T19:11:58.401282] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-27T19:11:58.515715] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:11:58.558982] [INFO ] [REMOTE ] HKD: Full fetch complete (27778 records). [2025-10-27T19:11:58.576519] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-27T19:11:58.819280] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-27T19:11:59.033482] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:11:59.173925] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-27T19:11:59.173998] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-27T19:11:59.174513] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-27T19:11:59.174552] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-27T19:11:59.175261] [DEBUG] [LOCAL ] HKD: Trimmed 27778 records to 18741 (keeping 200 days of data) [2025-10-27T19:11:59.277812] [DEBUG] [LOCAL ] HKD: Primary data saved (18741 records). [2025-10-27T19:11:59.277947] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-27T19:11:59.278023] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HKD took 30.1s. Estimated remaining: 2h 52m 37s. Rate: 7.8 symbols/min [2025-10-27T19:11:59.449268] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:11:59.481452] [DEBUG] [LOCAL ] HLIO: Loaded 28394 existing records from primary storage. [2025-10-27T19:11:59.481739] [INFO ] [MAIN ] HLIO: Loaded 28394 existing records. [2025-10-27T19:11:59.624781] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-27T19:11:59.666713] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:11:59.666882] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-27T19:11:59.666947] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-27T19:11:59.667167] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-27T19:11:59.667226] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-27T19:12:00.043854] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:00.149363] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T19:12:00.188423] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:12:00.414952] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-27T19:12:01.214911] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-27T19:12:01.565114] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T19:12:01.981264] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T19:12:02.015007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-27T19:12:02.660910] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:12:02.814910] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-27T19:12:03.103834] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T19:12:03.544111] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:12:03.614916] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-27T19:12:04.414935] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-27T19:12:05.214919] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-27T19:12:05.298389] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T19:12:06.014969] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-27T19:12:06.129638] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T19:12:06.202387] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T19:12:06.814960] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-27T19:12:07.615018] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-27T19:12:07.751380] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:12:07.879427] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:12:08.414985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-27T19:12:08.964239] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:12:09.214958] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-27T19:12:10.014946] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-27T19:12:10.133488] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:12:10.645277] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:12:10.814914] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-27T19:12:11.614996] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-27T19:12:11.858541] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T19:12:11.950148] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:12:12.415002] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-27T19:12:12.590824] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:12:13.214960] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-27T19:12:14.014913] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-27T19:12:14.424246] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T19:12:14.798874] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:12:14.814905] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-27T19:12:15.614988] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-27T19:12:15.783863] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T19:12:15.903571] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:12:16.414953] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-27T19:12:17.214961] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-27T19:12:17.403913] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:12:17.698604] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:12:18.014954] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-27T19:12:18.814984] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-27T19:12:19.400117] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:12:19.426880] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-27T19:12:19.465276] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:12:19.614943] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-27T19:12:20.414955] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-27T19:12:20.879406] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T19:12:20.884635] [INFO ] [REMOTE ] HLIO: Full fetch complete (37256 records). [2025-10-27T19:12:20.884799] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-27T19:12:21.225051] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-27T19:12:21.256465] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-27T19:12:21.256534] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-27T19:12:21.257223] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-27T19:12:21.257485] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-27T19:12:21.258346] [DEBUG] [LOCAL ] HLIO: Trimmed 37256 records to 27820 (keeping 200 days of data) [2025-10-27T19:12:21.421894] [DEBUG] [LOCAL ] HLIO: Primary data saved (27820 records). [2025-10-27T19:12:21.422026] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-27T19:12:21.422103] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HLIO took 22.1s. Estimated remaining: 2h 52m 48s. Rate: 7.8 symbols/min [2025-10-27T19:12:21.589695] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:21.620709] [DEBUG] [LOCAL ] HLLY: Loaded 33731 existing records from primary storage. [2025-10-27T19:12:21.620968] [INFO ] [MAIN ] HLLY: Loaded 33731 existing records. [2025-10-27T19:12:21.798947] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:21.799143] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-27T19:12:21.799189] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-27T19:12:21.799588] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-27T19:12:21.799674] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-27T19:12:22.035188] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-27T19:12:22.148961] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:22.814969] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-27T19:12:22.894067] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T19:12:22.933137] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-27T19:12:22.943590] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-27T19:12:22.943737] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-27T19:12:23.343812] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-27T19:12:23.343890] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-27T19:12:23.344874] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-27T19:12:23.344936] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-27T19:12:23.346435] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 53676 (keeping 200 days of data) [2025-10-27T19:12:23.634228] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-27T19:12:23.635069] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:12:23.696529] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-27T19:12:23.697191] [INFO ] [MAIN ] HL: Full history saved. [2025-10-27T19:12:23.697345] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HL took 35.6s. Estimated remaining: 2h 52m 33s. Rate: 7.8 symbols/min [2025-10-27T19:12:23.833621] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:12:23.892984] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:23.943147] [DEBUG] [LOCAL ] HLN: Loaded 53891 existing records from primary storage. [2025-10-27T19:12:23.943510] [INFO ] [MAIN ] HLN: Loaded 53891 existing records. [2025-10-27T19:12:24.128238] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:24.128491] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-27T19:12:24.128553] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-27T19:12:24.128792] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-27T19:12:24.128872] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-27T19:12:24.423076] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-27T19:12:24.516504] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:25.214976] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-27T19:12:25.361829] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T19:12:25.370861] [INFO ] [REMOTE ] HLF: Full fetch complete (70700 records). [2025-10-27T19:12:25.370977] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-27T19:12:25.771221] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-27T19:12:25.777222] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-27T19:12:25.779249] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:12:25.778698] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-27T19:12:25.785628] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-27T19:12:25.786926] [DEBUG] [LOCAL ] HLF: Trimmed 70700 records to 48241 (keeping 200 days of data) [2025-10-27T19:12:26.008218] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:12:26.015002] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-27T19:12:26.077552] [DEBUG] [LOCAL ] HLF: Primary data saved (48241 records). [2025-10-27T19:12:26.077694] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-27T19:12:26.077782] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLF took 36.3s. Estimated remaining: 2h 52m 18s. Rate: 7.8 symbols/min [2025-10-27T19:12:26.241486] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:26.287982] [DEBUG] [LOCAL ] HLT: Loaded 51202 existing records from primary storage. [2025-10-27T19:12:26.288294] [INFO ] [MAIN ] HLT: Loaded 51202 existing records. [2025-10-27T19:12:26.460538] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:26.460753] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-27T19:12:26.460824] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-27T19:12:26.461056] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-27T19:12:26.461113] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-27T19:12:26.810039] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:26.814906] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-27T19:12:26.931051] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:12:27.614939] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-27T19:12:28.414974] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-27T19:12:28.488380] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:12:29.105834] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:12:29.214937] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-27T19:12:29.840514] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:12:30.014946] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-27T19:12:30.296805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T19:12:30.814983] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-27T19:12:31.373123] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:12:31.614914] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-27T19:12:32.258850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:12:32.265039] [INFO ] [REMOTE ] HLI: Full fetch complete (45430 records). [2025-10-27T19:12:32.265135] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-27T19:12:32.417121] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-27T19:12:32.645476] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-27T19:12:32.645549] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-27T19:12:32.646245] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-27T19:12:32.646309] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-27T19:12:32.647249] [DEBUG] [LOCAL ] HLI: Trimmed 45430 records to 30327 (keeping 200 days of data) [2025-10-27T19:12:32.833977] [DEBUG] [LOCAL ] HLI: Primary data saved (30327 records). [2025-10-27T19:12:32.834099] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-27T19:12:32.835283] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLI took 34.9s. Estimated remaining: 2h 52m 9s. Rate: 7.8 symbols/min [2025-10-27T19:12:33.007899] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:33.052216] [DEBUG] [LOCAL ] HLX: Loaded 48034 existing records from primary storage. [2025-10-27T19:12:33.052495] [INFO ] [MAIN ] HLX: Loaded 48034 existing records. [2025-10-27T19:12:33.218459] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-27T19:12:33.240240] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:33.241361] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-27T19:12:33.241509] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-27T19:12:33.241797] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-27T19:12:33.241859] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-27T19:12:33.459883] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:12:33.637275] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:33.691728] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:12:34.014956] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-27T19:12:34.658168] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:12:34.814888] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-27T19:12:34.918470] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:12:35.614982] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-27T19:12:36.374703] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:12:36.414999] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-27T19:12:37.065914] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T19:12:37.214942] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-27T19:12:37.841872] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:12:38.014919] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-27T19:12:38.703077] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:12:38.814951] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-27T19:12:39.614936] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-27T19:12:39.671414] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:12:39.943038] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:12:40.414983] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-27T19:12:41.214944] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-27T19:12:41.424366] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T19:12:41.975058] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:12:42.014906] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-27T19:12:42.441637] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:12:42.814945] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-27T19:12:43.614930] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-27T19:12:43.852720] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T19:12:43.937398] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T19:12:44.414938] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-27T19:12:44.749217] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:12:45.214930] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-27T19:12:45.773852] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:12:46.014936] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-27T19:12:46.814921] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-27T19:12:47.085877] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:12:47.319804] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:12:47.325967] [INFO ] [REMOTE ] HLLY: Full fetch complete (46061 records). [2025-10-27T19:12:47.326059] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-27T19:12:47.620108] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-27T19:12:47.697367] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-27T19:12:47.697442] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-27T19:12:47.698177] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-27T19:12:47.698239] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-27T19:12:47.699210] [DEBUG] [LOCAL ] HLLY: Trimmed 46061 records to 33098 (keeping 200 days of data) [2025-10-27T19:12:47.885143] [DEBUG] [LOCAL ] HLLY: Primary data saved (33098 records). [2025-10-27T19:12:47.885274] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-27T19:12:47.885672] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLLY took 26.5s. Estimated remaining: 2h 52m 11s. Rate: 7.8 symbols/min [2025-10-27T19:12:48.053847] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:48.100223] [DEBUG] [LOCAL ] HMC: Loaded 46860 existing records from primary storage. [2025-10-27T19:12:48.100521] [INFO ] [MAIN ] HMC: Loaded 46860 existing records. [2025-10-27T19:12:48.276231] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:48.276529] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-27T19:12:48.276604] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-27T19:12:48.277057] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-27T19:12:48.277181] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-27T19:12:48.419601] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-27T19:12:48.592174] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:12:48.703371] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:49.214955] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-27T19:12:49.331350] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:12:50.014913] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-27T19:12:50.141155] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:12:50.814947] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-27T19:12:50.981510] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:12:51.614977] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-27T19:12:51.818756] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:12:52.414991] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-27T19:12:52.641635] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T19:12:53.215007] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-27T19:12:53.358392] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:12:53.921869] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:12:53.932442] [INFO ] [REMOTE ] HLN: Full fetch complete (77034 records). [2025-10-27T19:12:53.932626] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-27T19:12:54.020109] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-27T19:12:54.365712] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-27T19:12:54.365896] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-27T19:12:54.366940] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-27T19:12:54.367052] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-27T19:12:54.368774] [DEBUG] [LOCAL ] HLN: Trimmed 77034 records to 53110 (keeping 200 days of data) [2025-10-27T19:12:54.497030] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:12:54.725838] [DEBUG] [LOCAL ] HLN: Primary data saved (53110 records). [2025-10-27T19:12:54.725979] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-27T19:12:54.726058] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLN took 31.0s. Estimated remaining: 2h 52m 2s. Rate: 7.8 symbols/min [2025-10-27T19:12:54.824240] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-27T19:12:54.898500] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:12:54.920121] [DEBUG] [LOCAL ] HMN: Loaded 23520 existing records from primary storage. [2025-10-27T19:12:54.920363] [INFO ] [MAIN ] HMN: Loaded 23520 existing records. [2025-10-27T19:12:55.092916] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:12:55.093110] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-27T19:12:55.093156] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-27T19:12:55.093387] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-27T19:12:55.093444] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-27T19:12:55.444363] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:12:55.614950] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-27T19:12:55.837874] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T19:12:56.255127] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:12:56.414918] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-27T19:12:56.641914] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:12:57.214985] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-27T19:12:57.897583] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:12:58.014950] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-27T19:12:58.343969] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:12:58.815010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-27T19:12:59.481208] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:12:59.614939] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-27T19:12:59.701402] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T19:13:00.414978] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-27T19:13:01.214951] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-27T19:13:01.378338] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T19:13:02.014992] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-27T19:13:02.201122] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:13:02.646933] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:13:02.814936] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-27T19:13:03.334552] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:13:03.343249] [INFO ] [REMOTE ] HLX: Full fetch complete (69008 records). [2025-10-27T19:13:03.343380] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-27T19:13:03.620111] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-27T19:13:03.727667] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-27T19:13:03.727772] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-27T19:13:03.728721] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-27T19:13:03.728785] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-27T19:13:03.730221] [DEBUG] [LOCAL ] HLX: Trimmed 69008 records to 47244 (keeping 200 days of data) [2025-10-27T19:13:03.996053] [DEBUG] [LOCAL ] HLX: Primary data saved (47244 records). [2025-10-27T19:13:03.996178] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-27T19:13:03.996989] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HLX took 31.2s. Estimated remaining: 2h 51m 57s. Rate: 7.8 symbols/min [2025-10-27T19:13:04.180437] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:04.233364] [DEBUG] [LOCAL ] HMY: Loaded 53946 existing records from primary storage. [2025-10-27T19:13:04.233702] [INFO ] [MAIN ] HMY: Loaded 53946 existing records. [2025-10-27T19:13:04.408896] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:04.409095] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-27T19:13:04.409141] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-27T19:13:04.409322] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-27T19:13:04.409360] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-27T19:13:04.429769] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-27T19:13:04.766142] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:04.863946] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T19:13:04.875412] [INFO ] [REMOTE ] HLT: Full fetch complete (73667 records). [2025-10-27T19:13:04.875589] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-27T19:13:05.092389] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:13:05.220202] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-27T19:13:05.350225] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-27T19:13:05.350312] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-27T19:13:05.351334] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-27T19:13:05.351401] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-27T19:13:05.352904] [DEBUG] [LOCAL ] HLT: Trimmed 73667 records to 50413 (keeping 200 days of data) [2025-10-27T19:13:05.672059] [DEBUG] [LOCAL ] HLT: Primary data saved (50413 records). [2025-10-27T19:13:05.672185] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-27T19:13:05.672923] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HLT took 39.6s. Estimated remaining: 2h 51m 41s. Rate: 7.8 symbols/min [2025-10-27T19:13:05.892429] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:05.895688] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-27T19:13:05.896559] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:13:05.896735] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-27T19:13:05.906292] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-27T19:13:05.906459] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-27T19:13:05.906528] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-27T19:13:05.906570] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-27T19:13:06.018888] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-27T19:13:06.253973] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:13:06.293725] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:06.814951] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-27T19:13:07.536502] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:13:07.614899] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-27T19:13:07.985586] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:13:08.414919] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-27T19:13:08.970490] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:13:09.214918] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-27T19:13:09.416849] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:13:09.417845] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T19:13:09.422299] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-27T19:13:09.422829] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:13:09.423227] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-27T19:13:09.423299] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:13:09.423372] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-27T19:13:09.423474] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-27T19:13:09.423518] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-27T19:13:09.423559] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-27T19:13:09.423602] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HNGE took 3.8s. Estimated remaining: 2h 51m 28s. Rate: 7.8 symbols/min [2025-10-27T19:13:09.594458] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:09.632452] [DEBUG] [LOCAL ] HNI: Loaded 30187 existing records from primary storage. [2025-10-27T19:13:09.632802] [INFO ] [MAIN ] HNI: Loaded 30187 existing records. [2025-10-27T19:13:09.807183] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:09.807360] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-27T19:13:09.807405] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-27T19:13:09.807585] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-27T19:13:09.807622] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-27T19:13:10.020175] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-27T19:13:10.153870] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:10.814995] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-27T19:13:11.614949] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-27T19:13:11.809261] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:13:12.005849] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:13:12.415021] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-27T19:13:12.499442] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:13:13.214955] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-27T19:13:14.014919] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-27T19:13:14.133366] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:13:14.685117] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:13:14.814908] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-27T19:13:15.147972] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T19:13:15.151810] [INFO ] [REMOTE ] HMN: Full fetch complete (31655 records). [2025-10-27T19:13:15.151884] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-27T19:13:15.521587] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-27T19:13:15.521716] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-27T19:13:15.522340] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-27T19:13:15.522402] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-27T19:13:15.523144] [DEBUG] [LOCAL ] HMN: Trimmed 31655 records to 22910 (keeping 200 days of data) [2025-10-27T19:13:15.616002] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-27T19:13:15.660231] [DEBUG] [LOCAL ] HMN: Primary data saved (22910 records). [2025-10-27T19:13:15.660334] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-27T19:13:15.660409] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 20.9s. Estimated remaining: 2h 51m 19s. Rate: 7.8 symbols/min [2025-10-27T19:13:15.836372] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:15.882258] [DEBUG] [LOCAL ] HOG: Loaded 51314 existing records from primary storage. [2025-10-27T19:13:15.882550] [INFO ] [MAIN ] HOG: Loaded 51314 existing records. [2025-10-27T19:13:16.060086] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:16.060289] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-27T19:13:16.060340] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-27T19:13:16.060538] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-27T19:13:16.060594] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-27T19:13:16.420108] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:16.415104] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-27T19:13:16.514456] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T19:13:16.814256] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T19:13:17.214933] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-27T19:13:18.026094] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-27T19:13:18.032183] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:13:18.595243] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:13:18.814948] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-27T19:13:19.238617] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T19:13:19.614951] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-27T19:13:20.414976] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-27T19:13:20.885006] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:13:20.893744] [INFO ] [REMOTE ] HMC: Full fetch complete (68437 records). [2025-10-27T19:13:20.893863] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-27T19:13:21.147489] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:13:21.220165] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-27T19:13:21.319545] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-27T19:13:21.319628] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-27T19:13:21.320567] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-27T19:13:21.320617] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-27T19:13:21.322000] [DEBUG] [LOCAL ] HMC: Trimmed 68437 records to 46041 (keeping 200 days of data) [2025-10-27T19:13:21.584154] [DEBUG] [LOCAL ] HMC: Primary data saved (46041 records). [2025-10-27T19:13:21.584279] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-27T19:13:21.584591] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HMC took 33.7s. Estimated remaining: 2h 51m 8s. Rate: 7.8 symbols/min [2025-10-27T19:13:21.751424] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:21.791812] [DEBUG] [LOCAL ] HOMB: Loaded 44356 existing records from primary storage. [2025-10-27T19:13:21.792124] [INFO ] [MAIN ] HOMB: Loaded 44356 existing records. [2025-10-27T19:13:21.971271] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:21.971595] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-27T19:13:21.971694] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-27T19:13:21.971952] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-27T19:13:21.972053] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-27T19:13:22.025684] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-27T19:13:22.306675] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T19:13:22.375622] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:22.390470] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:13:22.815001] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-27T19:13:23.614949] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-27T19:13:24.292777] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T19:13:24.366930] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T19:13:24.414944] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-27T19:13:24.957862] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:13:25.214939] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-27T19:13:25.885259] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:13:26.014905] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-27T19:13:26.720183] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:13:26.814919] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-27T19:13:27.615029] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-27T19:13:27.665120] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:13:28.150309] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:13:28.414996] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-27T19:13:29.214995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-27T19:13:29.351624] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T19:13:29.650834] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:13:29.964360] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:13:30.014910] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-27T19:13:30.821548] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-27T19:13:30.822958] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:13:31.614935] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-27T19:13:32.414975] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-27T19:13:32.683894] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:13:33.143357] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:13:33.214938] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-27T19:13:34.014973] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-27T19:13:34.134315] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T19:13:34.732553] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:13:34.814905] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-27T19:13:35.495005] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:13:35.614914] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-27T19:13:36.206404] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:13:36.414950] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-27T19:13:37.215004] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-27T19:13:37.755147] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T19:13:37.928162] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:13:38.014897] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-27T19:13:38.800581] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:13:38.814898] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-27T19:13:39.614910] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-27T19:13:39.726395] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:13:40.371102] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T19:13:40.414964] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-27T19:13:40.730240] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:13:40.736912] [INFO ] [REMOTE ] HNI: Full fetch complete (42285 records). [2025-10-27T19:13:40.737072] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-27T19:13:41.221492] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-27T19:13:41.222589] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-27T19:13:41.223591] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-27T19:13:41.224975] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-27T19:13:41.225203] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-27T19:13:41.226713] [DEBUG] [LOCAL ] HNI: Trimmed 42285 records to 29700 (keeping 200 days of data) [2025-10-27T19:13:41.412548] [DEBUG] [LOCAL ] HNI: Primary data saved (29700 records). [2025-10-27T19:13:41.412729] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-27T19:13:41.412823] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HNI took 32.0s. Estimated remaining: 2h 51m 16s. Rate: 7.8 symbols/min [2025-10-27T19:13:42.015005] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-27T19:13:42.362987] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T19:13:42.375090] [INFO ] [REMOTE ] HOG: Full fetch complete (74240 records). [2025-10-27T19:13:42.375265] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-27T19:13:42.758996] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-27T19:13:42.759074] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-27T19:13:42.759990] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-27T19:13:42.760056] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-27T19:13:42.761393] [DEBUG] [LOCAL ] HOG: Trimmed 74240 records to 50529 (keeping 200 days of data) [2025-10-27T19:13:43.058336] [DEBUG] [LOCAL ] HOG: Primary data saved (50529 records). [2025-10-27T19:13:43.058465] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-27T19:13:43.058540] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HOG took 27.4s. Estimated remaining: 2h 51m 1s. Rate: 7.8 symbols/min [2025-10-27T19:13:43.272499] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T19:13:43.283543] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-27T19:13:43.451045] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T19:13:43.614992] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-27T19:13:44.784156] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:13:44.793563] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-27T19:13:45.457405] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T19:13:45.468835] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-27T19:13:46.209246] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:13:46.218422] [INFO ] [REMOTE ] HOMB: Full fetch complete (64506 records). [2025-10-27T19:13:46.218543] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-27T19:13:46.601971] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-27T19:13:46.602061] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-27T19:13:46.602914] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-27T19:13:46.602974] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-27T19:13:46.604168] [DEBUG] [LOCAL ] HOMB: Trimmed 64506 records to 43589 (keeping 200 days of data) [2025-10-27T19:13:46.857445] [DEBUG] [LOCAL ] HOMB: Primary data saved (43589 records). [2025-10-27T19:13:46.857569] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-27T19:13:46.857938] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 25.3s. Estimated remaining: 2h 50m 48s. Rate: 7.8 symbols/min [2025-10-27T19:13:47.506583] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:13:47.517231] [INFO ] [REMOTE ] HMY: Full fetch complete (77159 records). [2025-10-27T19:13:47.517378] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-27T19:13:47.912838] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-27T19:13:47.912946] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-27T19:13:47.914043] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-27T19:13:47.914109] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-27T19:13:47.915693] [DEBUG] [LOCAL ] HMY: Trimmed 77159 records to 53166 (keeping 200 days of data) [2025-10-27T19:13:48.241926] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-27T19:13:48.242070] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-27T19:13:48.242150] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HMY took 44.2s. Estimated remaining: 2h 50m 32s. Rate: 7.8 symbols/min [2025-10-27T19:13:48.827129] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.891831] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.952791] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:48.981718] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:13:49.008576] [DEBUG] [LOCAL ] HOV: Loaded 13910 existing records from primary storage. [2025-10-27T19:13:49.008934] [INFO ] [MAIN ] HOV: Loaded 13910 existing records. [2025-10-27T19:13:49.140699] [DEBUG] [LOCAL ] HOUS: Loaded 46499 existing records from primary storage. [2025-10-27T19:13:49.189427] [INFO ] [MAIN ] HOUS: Loaded 46499 existing records. [2025-10-27T19:13:49.248097] [DEBUG] [LOCAL ] HP: Loaded 52118 existing records from primary storage. [2025-10-27T19:13:49.323482] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:49.297550] [INFO ] [MAIN ] HP: Loaded 52118 existing records. [2025-10-27T19:13:49.368148] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-27T19:13:49.369341] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-27T19:13:49.369608] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-27T19:13:49.431170] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-27T19:13:49.445782] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-27T19:13:49.425855] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-10-27T19:13:49.585162] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:49.615692] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-27T19:13:49.649025] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-27T19:13:49.708605] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-27T19:13:49.737799] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-27T19:13:49.969431] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:50.006836] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-27T19:13:50.090588] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-27T19:13:50.168167] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-27T19:13:50.173571] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-27T19:13:50.156410] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:13:50.199827] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-27T19:13:50.262182] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-27T19:13:50.339754] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-27T19:13:50.354419] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-27T19:13:50.691882] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:50.714269] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-27T19:13:51.152287] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.192845] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-27T19:13:51.396389] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.415828] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-27T19:13:51.415579] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:13:51.416850] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-27T19:13:51.616479] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T19:13:51.620132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-27T19:13:52.566118] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:13:52.570279] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-27T19:13:52.848736] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:13:52.863609] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-27T19:13:53.040703] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:13:53.053223] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-27T19:13:53.119554] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T19:13:53.124236] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-27T19:13:53.287009] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T19:13:53.298171] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-27T19:13:53.700680] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:13:53.920539] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:13:54.015024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-27T19:13:54.392088] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:13:54.505452] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T19:13:54.814967] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-27T19:13:54.966895] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T19:13:55.614964] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-27T19:13:55.794953] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:13:56.414955] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-27T19:13:57.053129] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:13:57.215042] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-27T19:13:58.015004] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-27T19:13:58.213341] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:13:58.248682] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T19:13:58.814937] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-27T19:13:59.503309] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:13:59.614911] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-27T19:13:59.764816] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T19:14:00.414949] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-27T19:14:01.215050] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-27T19:14:01.700203] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T19:14:01.946115] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:14:02.014979] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-27T19:14:02.379805] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:14:02.814942] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-27T19:14:03.489259] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T19:14:03.491751] [INFO ] [REMOTE ] HOV: Full fetch complete (18867 records). [2025-10-27T19:14:03.491826] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-27T19:14:03.620047] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-27T19:14:03.935853] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-27T19:14:03.935927] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-27T19:14:03.936398] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-27T19:14:03.936457] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-27T19:14:03.937075] [DEBUG] [LOCAL ] HOV: Trimmed 18867 records to 13651 (keeping 200 days of data) [2025-10-27T19:14:04.019077] [DEBUG] [LOCAL ] HOV: Primary data saved (13651 records). [2025-10-27T19:14:04.019244] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-27T19:14:04.019460] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HOV took 15.8s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-10-27T19:14:04.205692] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:04.241499] [DEBUG] [LOCAL ] HPF: Loaded 7554 existing records from primary storage. [2025-10-27T19:14:04.242228] [INFO ] [MAIN ] HPF: Loaded 7554 existing records. [2025-10-27T19:14:04.243545] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T19:14:04.417678] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-27T19:14:04.446769] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:04.446919] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-27T19:14:04.446966] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-27T19:14:04.447108] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-27T19:14:04.447149] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-27T19:14:04.820936] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:05.223681] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-27T19:14:05.242965] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:14:06.014932] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-27T19:14:06.029101] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:14:06.207478] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T19:14:06.814962] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-27T19:14:07.614947] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-27T19:14:07.667280] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:14:08.246931] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:14:08.313025] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:14:08.414911] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-27T19:14:09.044330] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T19:14:09.214963] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-27T19:14:10.014952] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-27T19:14:10.814968] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-27T19:14:11.314688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T19:14:11.387517] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:14:11.526967] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T19:14:11.614936] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-27T19:14:12.414951] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-27T19:14:13.214976] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-27T19:14:13.313573] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:14:13.798105] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T19:14:13.800078] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:14:14.014959] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-27T19:14:14.814960] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-27T19:14:15.048176] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:14:15.614974] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-27T19:14:16.415016] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-27T19:14:16.940207] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T19:14:16.970397] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:14:16.968692] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-27T19:14:16.980353] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-27T19:14:17.221960] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-27T19:14:17.238931] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:14:17.397972] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-27T19:14:17.398076] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-27T19:14:17.399451] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-27T19:14:17.399519] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-27T19:14:17.401739] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-27T19:14:17.764348] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-27T19:14:17.764556] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-27T19:14:17.765968] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPE took 29.5s. Estimated remaining: 2h 50m 35s. Rate: 7.8 symbols/min [2025-10-27T19:14:17.947429] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:17.965588] [DEBUG] [LOCAL ] HPI: Loaded 10818 existing records from primary storage. [2025-10-27T19:14:17.965913] [INFO ] [MAIN ] HPI: Loaded 10818 existing records. [2025-10-27T19:14:18.027567] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-27T19:14:18.152317] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:18.152557] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-27T19:14:18.152608] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-27T19:14:18.152843] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-27T19:14:18.152900] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-27T19:14:18.515456] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:18.622675] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:14:18.772897] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:14:18.814985] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-27T19:14:19.614965] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-27T19:14:20.414984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-27T19:14:20.562041] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T19:14:21.033114] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:14:21.135205] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T19:14:21.214964] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-27T19:14:21.732294] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T19:14:22.014943] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-27T19:14:22.707800] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T19:14:22.709496] [INFO ] [REMOTE ] HPF: Full fetch complete (10465 records). [2025-10-27T19:14:22.709564] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-27T19:14:22.820132] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-27T19:14:23.084738] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-27T19:14:23.084813] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-27T19:14:23.085059] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-27T19:14:23.085096] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-27T19:14:23.085492] [DEBUG] [LOCAL ] HPF: Trimmed 10465 records to 7315 (keeping 200 days of data) [2025-10-27T19:14:23.128491] [DEBUG] [LOCAL ] HPF: Primary data saved (7315 records). [2025-10-27T19:14:23.128591] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-27T19:14:23.128685] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPF took 19.1s. Estimated remaining: 2h 50m 24s. Rate: 7.8 symbols/min [2025-10-27T19:14:23.307476] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:23.358434] [DEBUG] [LOCAL ] HPP: Loaded 51926 existing records from primary storage. [2025-10-27T19:14:23.358896] [INFO ] [MAIN ] HPP: Loaded 51926 existing records. [2025-10-27T19:14:23.541466] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:23.541722] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-27T19:14:23.541779] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-27T19:14:23.541986] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-27T19:14:23.542044] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-27T19:14:23.618489] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-27T19:14:23.708934] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T19:14:23.946959] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:24.414946] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-27T19:14:25.214971] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-27T19:14:25.319174] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:14:25.330631] [INFO ] [REMOTE ] HOUS: Full fetch complete (64840 records). [2025-10-27T19:14:25.330924] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-27T19:14:25.742395] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-27T19:14:25.742512] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-27T19:14:25.744084] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-27T19:14:25.744289] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-27T19:14:25.746546] [DEBUG] [LOCAL ] HOUS: Trimmed 64840 records to 45802 (keeping 200 days of data) [2025-10-27T19:14:25.847823] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:14:26.028879] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-27T19:14:26.082322] [DEBUG] [LOCAL ] HOUS: Primary data saved (45802 records). [2025-10-27T19:14:26.085744] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-27T19:14:26.086341] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HOUS took 37.8s. Estimated remaining: 2h 50m 10s. Rate: 7.8 symbols/min [2025-10-27T19:14:26.089240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:14:26.279511] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:26.353931] [DEBUG] [LOCAL ] HPQ: Loaded 54449 existing records from primary storage. [2025-10-27T19:14:26.354411] [INFO ] [MAIN ] HPQ: Loaded 54449 existing records. [2025-10-27T19:14:26.542767] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:26.544173] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-27T19:14:26.544237] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-27T19:14:26.545159] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-27T19:14:26.545221] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-27T19:14:26.815915] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-27T19:14:26.823497] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T19:14:26.929348] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:27.614944] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-27T19:14:28.323762] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T19:14:28.412547] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T19:14:28.416422] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-27T19:14:29.200862] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:14:29.214889] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-27T19:14:29.668784] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T19:14:30.014928] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-27T19:14:30.814942] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-27T19:14:31.466175] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T19:14:31.614932] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-27T19:14:32.425471] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-27T19:14:32.431082] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:14:32.947666] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T19:14:32.957203] [INFO ] [REMOTE ] HP: Full fetch complete (74194 records). [2025-10-27T19:14:32.957322] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-27T19:14:33.106932] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T19:14:33.225099] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-27T19:14:33.376589] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-27T19:14:33.376743] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-27T19:14:33.377846] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-27T19:14:33.377914] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-27T19:14:33.379408] [DEBUG] [LOCAL ] HP: Trimmed 74194 records to 51297 (keeping 200 days of data) [2025-10-27T19:14:33.772444] [DEBUG] [LOCAL ] HP: Primary data saved (51297 records). [2025-10-27T19:14:33.772674] [INFO ] [MAIN ] HP: Full history saved. [2025-10-27T19:14:33.772808] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HP took 45.5s. Estimated remaining: 2h 50m 2s. Rate: 7.8 symbols/min [2025-10-27T19:14:33.951891] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:33.965567] [DEBUG] [LOCAL ] HPS: Loaded 10420 existing records from primary storage. [2025-10-27T19:14:33.965854] [INFO ] [MAIN ] HPS: Loaded 10420 existing records. [2025-10-27T19:14:34.020101] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-27T19:14:34.222741] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:34.222986] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-27T19:14:34.223064] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-27T19:14:34.223256] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-27T19:14:34.223330] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-27T19:14:34.628925] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:34.808461] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T19:14:34.818215] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-27T19:14:35.259880] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:14:35.617037] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-27T19:14:35.623015] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:14:36.414987] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-27T19:14:37.214932] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-27T19:14:37.375839] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T19:14:37.472548] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T19:14:38.012472] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T19:14:38.014979] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-27T19:14:38.552476] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T19:14:38.814993] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-27T19:14:39.614950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-27T19:14:40.384851] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:14:40.414898] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-27T19:14:40.463719] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:14:41.079577] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:14:41.214928] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-27T19:14:42.014948] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-27T19:14:42.088739] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:14:42.091302] [INFO ] [REMOTE ] HPI: Full fetch complete (13832 records). [2025-10-27T19:14:42.091380] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-27T19:14:42.505568] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-27T19:14:42.505714] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-27T19:14:42.506382] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-27T19:14:42.506433] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-27T19:14:42.507212] [DEBUG] [LOCAL ] HPI: Trimmed 13832 records to 10526 (keeping 200 days of data) [2025-10-27T19:14:42.576151] [DEBUG] [LOCAL ] HPI: Primary data saved (10526 records). [2025-10-27T19:14:42.576345] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-27T19:14:42.576445] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPI took 24.8s. Estimated remaining: 2h 49m 56s. Rate: 7.8 symbols/min [2025-10-27T19:14:42.753387] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:42.783036] [DEBUG] [LOCAL ] HQH: Loaded 26090 existing records from primary storage. [2025-10-27T19:14:42.783433] [INFO ] [MAIN ] HQH: Loaded 26090 existing records. [2025-10-27T19:14:42.820191] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-27T19:14:42.973541] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:42.973847] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-27T19:14:42.973899] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-27T19:14:42.974116] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-27T19:14:42.974155] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-27T19:14:43.340375] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:43.614975] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-27T19:14:43.624563] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T19:14:44.125424] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T19:14:44.414949] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-27T19:14:44.738235] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T19:14:45.214936] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-27T19:14:46.015005] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-27T19:14:46.035948] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:14:46.293748] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T19:14:46.814971] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-27T19:14:47.090328] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T19:14:47.449444] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T19:14:47.614984] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-27T19:14:48.414998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-27T19:14:48.484093] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T19:14:49.214935] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-27T19:14:50.014997] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-27T19:14:50.266033] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T19:14:50.292128] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:14:50.471994] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T19:14:50.815023] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-27T19:14:51.614924] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-27T19:14:51.939140] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:14:52.372526] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:14:52.414950] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-27T19:14:53.214944] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-27T19:14:53.289226] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:14:53.291572] [INFO ] [REMOTE ] HPS: Full fetch complete (15006 records). [2025-10-27T19:14:53.292031] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-27T19:14:53.643070] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-27T19:14:53.643148] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-27T19:14:53.643512] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-27T19:14:53.643550] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-27T19:14:53.644062] [DEBUG] [LOCAL ] HPS: Trimmed 15006 records to 10175 (keeping 200 days of data) [2025-10-27T19:14:53.703704] [DEBUG] [LOCAL ] HPS: Primary data saved (10175 records). [2025-10-27T19:14:53.703828] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-27T19:14:53.703912] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPS took 19.9s. Estimated remaining: 2h 49m 53s. Rate: 7.8 symbols/min [2025-10-27T19:14:53.867084] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:14:53.886860] [DEBUG] [LOCAL ] HQL: Loaded 17318 existing records from primary storage. [2025-10-27T19:14:53.887067] [INFO ] [MAIN ] HQL: Loaded 17318 existing records. [2025-10-27T19:14:54.022695] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-27T19:14:54.061815] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:14:54.061976] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-27T19:14:54.062022] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-27T19:14:54.062186] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-27T19:14:54.062224] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-27T19:14:54.407944] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:14:54.814966] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-27T19:14:54.971615] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T19:14:55.176127] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:14:55.614979] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-27T19:14:55.870041] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T19:14:56.414945] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-27T19:14:57.214926] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-27T19:14:57.277318] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T19:14:57.570403] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T19:14:58.014980] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-27T19:14:58.167851] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:14:58.814956] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-27T19:14:59.304509] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:14:59.614997] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-27T19:15:00.365952] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:15:00.414897] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-27T19:15:00.567010] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T19:15:01.214986] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-27T19:15:02.015000] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-27T19:15:02.699836] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T19:15:02.751950] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T19:15:02.814910] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-27T19:15:03.169170] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:15:03.614947] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-27T19:15:04.184468] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T19:15:04.190154] [INFO ] [REMOTE ] HQH: Full fetch complete (36823 records). [2025-10-27T19:15:04.190247] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-27T19:15:04.426906] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-27T19:15:04.560441] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-27T19:15:04.560517] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-27T19:15:04.561159] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-27T19:15:04.561220] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-27T19:15:04.562023] [DEBUG] [LOCAL ] HQH: Trimmed 36823 records to 25547 (keeping 200 days of data) [2025-10-27T19:15:04.756456] [DEBUG] [LOCAL ] HQH: Primary data saved (25547 records). [2025-10-27T19:15:04.756586] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-27T19:15:04.756711] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HQH took 22.2s. Estimated remaining: 2h 49m 49s. Rate: 7.8 symbols/min [2025-10-27T19:15:04.927368] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:04.977205] [DEBUG] [LOCAL ] HR: Loaded 52883 existing records from primary storage. [2025-10-27T19:15:04.977526] [INFO ] [MAIN ] HR: Loaded 52883 existing records. [2025-10-27T19:15:05.155003] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:05.155424] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-27T19:15:05.155551] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-27T19:15:05.155838] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-27T19:15:05.155895] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-27T19:15:05.222405] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-27T19:15:05.500434] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:15:05.536506] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:05.567542] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T19:15:06.014924] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-27T19:15:06.558692] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:15:06.628251] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:15:06.638430] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-27T19:15:06.638565] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-27T19:15:06.825854] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-27T19:15:07.025039] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-27T19:15:07.025126] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-27T19:15:07.026085] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-27T19:15:07.026145] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-27T19:15:07.027574] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-27T19:15:07.344609] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-27T19:15:07.344756] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-27T19:15:07.344848] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HPQ took 41.3s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min [2025-10-27T19:15:07.531037] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:07.573021] [DEBUG] [LOCAL ] HRB: Loaded 48840 existing records from primary storage. [2025-10-27T19:15:07.573301] [INFO ] [MAIN ] HRB: Loaded 48840 existing records. [2025-10-27T19:15:07.626371] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-27T19:15:07.751373] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:07.751631] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-27T19:15:07.751716] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-27T19:15:07.760029] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-27T19:15:07.760323] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T19:15:07.760403] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-27T19:15:08.111429] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:08.414956] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-27T19:15:09.058580] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T19:15:09.214948] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-27T19:15:09.837694] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T19:15:09.903822] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T19:15:10.014925] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-27T19:15:10.592945] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T19:15:10.814965] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-27T19:15:11.614970] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-27T19:15:11.795339] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T19:15:12.414934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-27T19:15:13.207885] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:15:13.218452] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-27T19:15:13.414427] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:15:14.014937] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-27T19:15:14.815415] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-27T19:15:14.818122] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T19:15:15.615004] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-27T19:15:15.781068] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:15:15.872958] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:15:16.414947] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-27T19:15:16.802458] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T19:15:17.214969] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-27T19:15:18.014924] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-27T19:15:18.155404] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:15:18.165197] [INFO ] [REMOTE ] HPP: Full fetch complete (73350 records). [2025-10-27T19:15:18.165330] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-27T19:15:18.564911] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-27T19:15:18.565096] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-27T19:15:18.566424] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-27T19:15:18.566507] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-27T19:15:18.568345] [DEBUG] [LOCAL ] HPP: Trimmed 73350 records to 51188 (keeping 200 days of data) [2025-10-27T19:15:18.793314] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T19:15:18.815102] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-27T19:15:18.897609] [DEBUG] [LOCAL ] HPP: Primary data saved (51188 records). [2025-10-27T19:15:18.897787] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-27T19:15:18.897879] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HPP took 55.8s. Estimated remaining: 2h 49m 32s. Rate: 7.8 symbols/min [2025-10-27T19:15:19.061135] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:19.093668] [DEBUG] [LOCAL ] HRI: Loaded 32615 existing records from primary storage. [2025-10-27T19:15:19.093981] [INFO ] [MAIN ] HRI: Loaded 32615 existing records. [2025-10-27T19:15:19.268166] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:19.268446] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-27T19:15:19.268613] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-27T19:15:19.268926] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-27T19:15:19.269102] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-27T19:15:19.639685] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-27T19:15:19.662895] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:19.667493] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:15:20.355580] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:15:20.414901] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-27T19:15:20.832474] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T19:15:20.839103] [INFO ] [REMOTE ] HQL: Full fetch complete (25436 records). [2025-10-27T19:15:20.839276] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-27T19:15:21.220150] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-27T19:15:21.329370] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-27T19:15:21.329469] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-27T19:15:21.330718] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-27T19:15:21.330804] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-27T19:15:21.331952] [DEBUG] [LOCAL ] HQL: Trimmed 25436 records to 17143 (keeping 200 days of data) [2025-10-27T19:15:21.481931] [DEBUG] [LOCAL ] HQL: Primary data saved (17143 records). [2025-10-27T19:15:21.482099] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-27T19:15:21.482220] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HQL took 27.8s. Estimated remaining: 2h 49m 18s. Rate: 7.8 symbols/min [2025-10-27T19:15:21.703231] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:21.782014] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:15:21.827503] [DEBUG] [LOCAL ] HRL: Loaded 53895 existing records from primary storage. [2025-10-27T19:15:21.828015] [INFO ] [MAIN ] HRL: Loaded 53895 existing records. [2025-10-27T19:15:22.021588] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-27T19:15:22.065986] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:22.066273] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-27T19:15:22.066344] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-27T19:15:22.066777] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-27T19:15:22.066851] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-27T19:15:22.452041] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:22.564415] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:15:22.814996] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-27T19:15:23.208885] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:15:23.614937] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-27T19:15:24.166448] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:15:24.414931] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-27T19:15:25.085488] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:15:25.214933] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-27T19:15:26.015399] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-27T19:15:26.017887] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:15:26.714475] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:15:26.814912] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-27T19:15:27.421518] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:15:27.614934] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-27T19:15:28.129294] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T19:15:28.414884] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-27T19:15:28.974808] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:15:29.214930] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-27T19:15:29.547019] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:15:30.014980] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-27T19:15:30.605869] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:15:30.814952] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-27T19:15:31.406214] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:15:31.614906] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-27T19:15:32.148954] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T19:15:32.414965] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-27T19:15:32.783293] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:15:33.214938] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-27T19:15:34.014947] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-27T19:15:34.167890] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:15:34.280975] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:15:34.814956] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-27T19:15:35.614944] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-27T19:15:35.770180] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:15:36.067489] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:15:36.414910] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-27T19:15:36.943050] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:15:37.214930] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-27T19:15:38.014989] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-27T19:15:38.098376] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:15:38.814973] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-27T19:15:39.094606] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:15:39.105007] [INFO ] [REMOTE ] HR: Full fetch complete (75080 records). [2025-10-27T19:15:39.105166] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-27T19:15:39.548305] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-27T19:15:39.548151] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:15:39.557309] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-27T19:15:39.558886] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-27T19:15:39.559119] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-27T19:15:39.560562] [DEBUG] [LOCAL ] HR: Trimmed 75080 records to 52096 (keeping 200 days of data) [2025-10-27T19:15:39.621233] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-27T19:15:39.873426] [DEBUG] [LOCAL ] HR: Primary data saved (52096 records). [2025-10-27T19:15:39.873567] [INFO ] [MAIN ] HR: Full history saved. [2025-10-27T19:15:39.874107] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HR took 35.1s. Estimated remaining: 2h 49m 23s. Rate: 7.8 symbols/min [2025-10-27T19:15:40.056450] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:40.092216] [DEBUG] [LOCAL ] HRTG: Loaded 34934 existing records from primary storage. [2025-10-27T19:15:40.092639] [INFO ] [MAIN ] HRTG: Loaded 34934 existing records. [2025-10-27T19:15:40.276467] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:15:40.319902] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:40.320366] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-27T19:15:40.320416] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-27T19:15:40.320596] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-27T19:15:40.320680] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-27T19:15:40.417379] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-27T19:15:40.664210] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:41.214911] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-27T19:15:41.321209] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:15:41.351277] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:15:42.014975] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-27T19:15:42.224494] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:15:42.814951] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-27T19:15:43.295605] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:15:43.304393] [INFO ] [REMOTE ] HRB: Full fetch complete (69886 records). [2025-10-27T19:15:43.304502] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-27T19:15:43.618389] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-27T19:15:43.690561] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-27T19:15:43.690717] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-27T19:15:43.691609] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-27T19:15:43.691734] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-27T19:15:43.693116] [DEBUG] [LOCAL ] HRB: Trimmed 69886 records to 48064 (keeping 200 days of data) [2025-10-27T19:15:43.917544] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:15:43.995602] [DEBUG] [LOCAL ] HRB: Primary data saved (48064 records). [2025-10-27T19:15:43.995762] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-27T19:15:43.995849] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRB took 36.7s. Estimated remaining: 2h 49m 11s. Rate: 7.8 symbols/min [2025-10-27T19:15:44.158443] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:44.204298] [DEBUG] [LOCAL ] HSBC: Loaded 51741 existing records from primary storage. [2025-10-27T19:15:44.204581] [INFO ] [MAIN ] HSBC: Loaded 51741 existing records. [2025-10-27T19:15:44.375595] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:44.375807] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-27T19:15:44.375852] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-27T19:15:44.376028] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-27T19:15:44.376064] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-27T19:15:44.420095] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-27T19:15:44.719987] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:45.156789] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T19:15:45.162823] [INFO ] [REMOTE ] HRI: Full fetch complete (46851 records). [2025-10-27T19:15:45.162934] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-27T19:15:45.226311] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-27T19:15:45.540179] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-27T19:15:45.540260] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-27T19:15:45.541066] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-27T19:15:45.541132] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-27T19:15:45.542129] [DEBUG] [LOCAL ] HRI: Trimmed 46851 records to 31983 (keeping 200 days of data) [2025-10-27T19:15:45.733390] [DEBUG] [LOCAL ] HRI: Primary data saved (31983 records). [2025-10-27T19:15:45.733525] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-27T19:15:45.733603] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HRI took 26.8s. Estimated remaining: 2h 48m 56s. Rate: 7.8 symbols/min [2025-10-27T19:15:45.901103] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:15:45.915997] [DEBUG] [LOCAL ] HSHP: Loaded 14591 existing records from primary storage. [2025-10-27T19:15:45.916234] [INFO ] [MAIN ] HSHP: Loaded 14591 existing records. [2025-10-27T19:15:46.020570] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-27T19:15:46.097113] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:15:46.097400] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-27T19:15:46.097470] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-27T19:15:46.097860] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-27T19:15:46.097917] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-27T19:15:46.396746] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T19:15:46.475174] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:15:46.508978] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T19:15:46.814943] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-27T19:15:47.374676] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:15:47.408754] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T19:15:47.614957] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-27T19:15:48.414942] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-27T19:15:49.102495] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T19:15:49.214912] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-27T19:15:49.286119] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T19:15:50.014964] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-27T19:15:50.695282] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:15:50.814951] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-27T19:15:51.614923] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-27T19:15:51.748065] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:15:52.265474] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:15:52.414950] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-27T19:15:52.607374] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:15:53.214996] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-27T19:15:53.931697] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:15:54.014949] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-27T19:15:54.814978] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-27T19:15:55.100177] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:15:55.267184] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T19:15:55.564233] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:15:55.614935] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-27T19:15:56.414955] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-27T19:15:57.214924] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-27T19:15:57.422847] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T19:15:57.667791] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:15:58.014937] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-27T19:15:58.209330] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:15:58.814985] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-27T19:15:59.594567] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:15:59.614896] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-27T19:15:59.897957] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:15:59.908807] [INFO ] [REMOTE ] HRL: Full fetch complete (77030 records). [2025-10-27T19:15:59.908944] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-27T19:16:00.288024] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-27T19:16:00.288125] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-27T19:16:00.289088] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-27T19:16:00.289175] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-27T19:16:00.290552] [DEBUG] [LOCAL ] HRL: Trimmed 77030 records to 53115 (keeping 200 days of data) [2025-10-27T19:16:00.459604] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-27T19:16:00.608463] [DEBUG] [LOCAL ] HRL: Primary data saved (53115 records). [2025-10-27T19:16:00.608567] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-27T19:16:00.608847] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HRL took 39.1s. Estimated remaining: 2h 48m 57s. Rate: 7.8 symbols/min [2025-10-27T19:16:00.774269] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:16:00.790674] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:00.845666] [DEBUG] [LOCAL ] HSY: Loaded 51078 existing records from primary storage. [2025-10-27T19:16:00.845982] [INFO ] [MAIN ] HSY: Loaded 51078 existing records. [2025-10-27T19:16:01.020390] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:01.020613] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-27T19:16:01.020692] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-27T19:16:01.020893] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-27T19:16:01.020933] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-27T19:16:01.220257] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-27T19:16:01.385798] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:01.607112] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T19:16:02.015006] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-27T19:16:02.645949] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T19:16:02.814962] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-27T19:16:03.250633] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T19:16:03.614907] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-27T19:16:03.718309] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:16:04.414993] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-27T19:16:05.214987] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-27T19:16:05.249241] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T19:16:05.283387] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T19:16:06.014936] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-27T19:16:06.726386] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:16:06.734372] [INFO ] [REMOTE ] HRTG: Full fetch complete (44505 records). [2025-10-27T19:16:06.734477] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-27T19:16:06.822258] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-27T19:16:07.111676] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-27T19:16:07.111755] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-27T19:16:07.112479] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-27T19:16:07.112540] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-27T19:16:07.113493] [DEBUG] [LOCAL ] HRTG: Trimmed 44505 records to 34356 (keeping 200 days of data) [2025-10-27T19:16:07.310244] [DEBUG] [LOCAL ] HRTG: Primary data saved (34356 records). [2025-10-27T19:16:07.310376] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-27T19:16:07.311026] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HRTG took 27.4s. Estimated remaining: 2h 48m 48s. Rate: 7.8 symbols/min [2025-10-27T19:16:07.475377] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:07.475531] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-27T19:16:07.475567] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-27T19:16:07.475698] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-27T19:16:07.475751] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-27T19:16:07.475813] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-27T19:16:07.475871] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-27T19:16:07.623965] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-27T19:16:07.767501] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:16:07.854155] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:07.988086] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T19:16:08.414951] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-27T19:16:09.214922] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-27T19:16:09.529740] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:16:09.852517] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:16:09.855457] [INFO ] [REMOTE ] HSHP: Full fetch complete (22922 records). [2025-10-27T19:16:09.855537] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-27T19:16:10.018680] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-27T19:16:10.194349] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T19:16:10.271265] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-27T19:16:10.271341] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-27T19:16:10.271854] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-27T19:16:10.271916] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-27T19:16:10.272510] [DEBUG] [LOCAL ] HSHP: Trimmed 22922 records to 14105 (keeping 200 days of data) [2025-10-27T19:16:10.351117] [DEBUG] [LOCAL ] HSHP: Primary data saved (14105 records). [2025-10-27T19:16:10.351250] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-27T19:16:10.351343] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSHP took 24.6s. Estimated remaining: 2h 48m 35s. Rate: 7.8 symbols/min [2025-10-27T19:16:10.517908] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:10.535316] [DEBUG] [LOCAL ] HTD: Loaded 14394 existing records from primary storage. [2025-10-27T19:16:10.535550] [INFO ] [MAIN ] HTD: Loaded 14394 existing records. [2025-10-27T19:16:10.720684] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:10.720953] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-27T19:16:10.721014] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-27T19:16:10.721196] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-27T19:16:10.721258] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-27T19:16:10.820141] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-27T19:16:11.091506] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:11.093599] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:16:11.093900] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-27T19:16:11.093987] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:16:11.094068] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-27T19:16:11.094144] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:16:11.094237] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-27T19:16:11.094344] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-27T19:16:11.094404] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-27T19:16:11.094468] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-27T19:16:11.094545] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTB took 3.8s. Estimated remaining: 2h 48m 18s. Rate: 7.8 symbols/min [2025-10-27T19:16:11.258406] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:11.258571] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-27T19:16:11.258608] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-27T19:16:11.258741] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-27T19:16:11.258812] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-27T19:16:11.258878] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-27T19:16:11.258921] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-27T19:16:11.601898] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:11.614900] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-27T19:16:11.881418] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-27T19:16:11.915417] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:16:12.414959] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-27T19:16:12.998745] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:16:13.214996] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-27T19:16:13.862235] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T19:16:14.014974] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-27T19:16:14.814965] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-27T19:16:14.907515] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T19:16:15.614955] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-27T19:16:16.414908] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-27T19:16:16.610214] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:16:17.031366] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:16:17.214907] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-27T19:16:17.244343] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T19:16:18.015000] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-27T19:16:18.337878] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:16:18.814924] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-27T19:16:18.931832] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T19:16:18.942919] [INFO ] [REMOTE ] HSBC: Full fetch complete (74276 records). [2025-10-27T19:16:18.943182] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-27T19:16:19.178628] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T19:16:19.421695] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-27T19:16:19.421804] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-27T19:16:19.423046] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-27T19:16:19.423115] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-27T19:16:19.424701] [DEBUG] [LOCAL ] HSBC: Trimmed 74276 records to 50955 (keeping 200 days of data) [2025-10-27T19:16:19.618723] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-27T19:16:19.769159] [DEBUG] [LOCAL ] HSBC: Primary data saved (50955 records). [2025-10-27T19:16:19.769334] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-27T19:16:19.769444] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HSBC took 35.8s. Estimated remaining: 2h 48m 12s. Rate: 7.8 symbols/min [2025-10-27T19:16:19.989346] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:20.037952] [DEBUG] [LOCAL ] HTGC: Loaded 48352 existing records from primary storage. [2025-10-27T19:16:20.038324] [INFO ] [MAIN ] HTGC: Loaded 48352 existing records. [2025-10-27T19:16:20.248426] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:20.248692] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-27T19:16:20.248756] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-27T19:16:20.249233] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-27T19:16:20.249289] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-27T19:16:20.425281] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-27T19:16:20.598305] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:21.029242] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:16:21.214911] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-27T19:16:21.461500] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T19:16:21.558276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T19:16:22.014989] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-27T19:16:22.792621] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:16:22.814903] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-27T19:16:23.614936] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-27T19:16:24.258249] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T19:16:24.414962] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-27T19:16:24.666796] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-27T19:16:24.809192] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-27T19:16:25.214935] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-27T19:16:26.014941] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-27T19:16:26.397681] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T19:16:26.814940] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-27T19:16:27.132728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T19:16:27.614937] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-27T19:16:27.796201] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:16:28.119776] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:16:28.414944] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-27T19:16:29.214921] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-27T19:16:29.351225] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T19:16:30.015029] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-27T19:16:30.282006] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-27T19:16:30.708687] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T19:16:30.814922] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-27T19:16:31.615020] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-27T19:16:32.063030] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:16:32.414969] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-27T19:16:32.662715] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-27T19:16:32.688700] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:16:32.693322] [INFO ] [REMOTE ] HTD: Full fetch complete (19580 records). [2025-10-27T19:16:32.693425] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-27T19:16:33.059716] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-27T19:16:33.059794] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-27T19:16:33.060202] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-27T19:16:33.060244] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-27T19:16:33.060841] [DEBUG] [LOCAL ] HTD: Trimmed 19580 records to 14025 (keeping 200 days of data) [2025-10-27T19:16:33.144237] [DEBUG] [LOCAL ] HTD: Primary data saved (14025 records). [2025-10-27T19:16:33.144358] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-27T19:16:33.144431] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HTD took 22.8s. Estimated remaining: 2h 48m 11s. Rate: 7.8 symbols/min [2025-10-27T19:16:33.220112] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-27T19:16:33.313849] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:33.343353] [DEBUG] [LOCAL ] HTH: Loaded 32834 existing records from primary storage. [2025-10-27T19:16:33.343601] [INFO ] [MAIN ] HTH: Loaded 32834 existing records. [2025-10-27T19:16:33.519491] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:33.519732] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-27T19:16:33.519787] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-27T19:16:33.520003] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-27T19:16:33.520048] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-27T19:16:33.918498] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:33.945000] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T19:16:34.014952] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-27T19:16:34.814971] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-27T19:16:35.165974] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T19:16:35.166627] [INFO ] [REMOTE ] HTFC: Full fetch complete (815 records). [2025-10-27T19:16:35.166762] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-27T19:16:35.358903] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-27T19:16:35.360159] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:16:35.359529] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:16:35.365732] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:16:35.365805] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-27T19:16:35.365867] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-27T19:16:35.365903] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-27T19:16:35.365941] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-27T19:16:35.366006] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTFC took 24.3s. Estimated remaining: 2h 47m 56s. Rate: 7.8 symbols/min [2025-10-27T19:16:35.529609] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:35.565137] [DEBUG] [LOCAL ] HUBB: Loaded 36419 existing records from primary storage. [2025-10-27T19:16:35.565385] [INFO ] [MAIN ] HUBB: Loaded 36419 existing records. [2025-10-27T19:16:35.620139] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-27T19:16:35.742636] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:35.742830] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-27T19:16:35.742874] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-27T19:16:35.743039] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-27T19:16:35.743076] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-27T19:16:36.092540] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:36.414933] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-27T19:16:36.967485] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T19:16:37.214985] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-27T19:16:37.889514] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:16:38.014981] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-27T19:16:38.754700] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T19:16:38.814941] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-27T19:16:38.896110] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:16:39.614939] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-27T19:16:40.053163] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:16:40.415015] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-27T19:16:40.521244] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T19:16:41.214992] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-27T19:16:42.014940] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-27T19:16:42.099535] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T19:16:42.596935] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T19:16:42.814919] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-27T19:16:43.384381] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:16:43.614956] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-27T19:16:44.225554] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:16:44.414961] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-27T19:16:45.067682] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:16:45.214913] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-27T19:16:45.655052] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:16:46.014943] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-27T19:16:46.074935] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:16:46.084411] [INFO ] [REMOTE ] HSY: Full fetch complete (73560 records). [2025-10-27T19:16:46.084556] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-27T19:16:46.468014] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-27T19:16:46.468095] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-27T19:16:46.469105] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-27T19:16:46.469173] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-27T19:16:46.470593] [DEBUG] [LOCAL ] HSY: Trimmed 73560 records to 50292 (keeping 200 days of data) [2025-10-27T19:16:46.781849] [DEBUG] [LOCAL ] HSY: Primary data saved (50292 records). [2025-10-27T19:16:46.781978] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-27T19:16:46.782563] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HSY took 46.2s. Estimated remaining: 2h 47m 53s. Rate: 7.8 symbols/min [2025-10-27T19:16:46.820073] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-27T19:16:46.952541] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:46.992520] [DEBUG] [LOCAL ] HUBS: Loaded 40387 existing records from primary storage. [2025-10-27T19:16:46.992824] [INFO ] [MAIN ] HUBS: Loaded 40387 existing records. [2025-10-27T19:16:47.172120] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:47.172342] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-27T19:16:47.172411] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-27T19:16:47.172627] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-27T19:16:47.172727] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-27T19:16:47.495428] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:16:47.560077] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:47.614911] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-27T19:16:48.414921] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-27T19:16:48.748481] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:16:48.777370] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:16:49.214934] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-27T19:16:50.015021] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-27T19:16:50.340946] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:16:50.746031] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:16:50.814943] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-27T19:16:51.614978] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-27T19:16:51.688109] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T19:16:52.008493] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T19:16:52.414989] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-27T19:16:52.903120] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:16:53.214983] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-27T19:16:54.014980] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-27T19:16:54.181225] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:16:54.509464] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:16:54.814933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-27T19:16:55.127855] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:16:55.614943] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-27T19:16:56.259302] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:16:56.268771] [INFO ] [REMOTE ] HTGC: Full fetch complete (68885 records). [2025-10-27T19:16:56.268894] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-27T19:16:56.422947] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-27T19:16:56.659407] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-27T19:16:56.659485] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-27T19:16:56.660378] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-27T19:16:56.660439] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-27T19:16:56.661825] [DEBUG] [LOCAL ] HTGC: Trimmed 68885 records to 47529 (keeping 200 days of data) [2025-10-27T19:16:56.942561] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:16:56.977471] [DEBUG] [LOCAL ] HTGC: Primary data saved (47529 records). [2025-10-27T19:16:56.977580] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-27T19:16:56.977671] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTGC took 37.2s. Estimated remaining: 2h 47m 49s. Rate: 7.8 symbols/min [2025-10-27T19:16:57.142590] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:16:57.186886] [DEBUG] [LOCAL ] HUM: Loaded 49864 existing records from primary storage. [2025-10-27T19:16:57.187199] [INFO ] [MAIN ] HUM: Loaded 49864 existing records. [2025-10-27T19:16:57.220136] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-27T19:16:57.368399] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:16:57.368705] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-27T19:16:57.368766] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-27T19:16:57.368965] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-27T19:16:57.369019] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-27T19:16:57.732609] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:16:58.024956] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-27T19:16:58.026486] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T19:16:58.152660] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:16:58.815011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-27T19:16:58.972533] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:16:59.614988] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-27T19:17:00.175444] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:17:00.414972] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-27T19:17:01.214910] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-27T19:17:01.562606] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:17:01.886585] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:17:02.014966] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-27T19:17:02.815001] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-27T19:17:03.011337] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:17:03.503584] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-27T19:17:03.614938] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-27T19:17:04.213263] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:17:04.414942] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-27T19:17:05.038354] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:17:05.214943] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-27T19:17:05.278505] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:17:05.284190] [INFO ] [REMOTE ] HTH: Full fetch complete (46924 records). [2025-10-27T19:17:05.284311] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-27T19:17:05.653916] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-27T19:17:05.653998] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-27T19:17:05.654725] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-27T19:17:05.654788] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-27T19:17:05.655840] [DEBUG] [LOCAL ] HTH: Trimmed 46924 records to 32247 (keeping 200 days of data) [2025-10-27T19:17:05.848107] [DEBUG] [LOCAL ] HTH: Primary data saved (32247 records). [2025-10-27T19:17:05.848254] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-27T19:17:05.848363] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HTH took 32.7s. Estimated remaining: 2h 47m 42s. Rate: 7.8 symbols/min [2025-10-27T19:17:06.014435] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:06.014945] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-27T19:17:06.064148] [DEBUG] [LOCAL ] HUN: Loaded 53990 existing records from primary storage. [2025-10-27T19:17:06.064464] [INFO ] [MAIN ] HUN: Loaded 53990 existing records. [2025-10-27T19:17:06.240237] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:06.240491] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-27T19:17:06.240590] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-27T19:17:06.240975] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-27T19:17:06.241050] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-27T19:17:06.602815] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:06.732793] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:17:06.814906] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-27T19:17:07.495194] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:17:07.614906] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-27T19:17:08.414906] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-27T19:17:08.501460] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T19:17:09.044678] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:17:09.051020] [INFO ] [REMOTE ] HUBB: Full fetch complete (54222 records). [2025-10-27T19:17:09.051106] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-27T19:17:09.216983] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-27T19:17:09.428320] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-27T19:17:09.428396] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-27T19:17:09.429184] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-27T19:17:09.429245] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-27T19:17:09.430263] [DEBUG] [LOCAL ] HUBB: Trimmed 54222 records to 35660 (keeping 200 days of data) [2025-10-27T19:17:09.577775] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:17:09.687707] [DEBUG] [LOCAL ] HUBB: Primary data saved (35660 records). [2025-10-27T19:17:09.687836] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-27T19:17:09.687910] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBB took 34.3s. Estimated remaining: 2h 47m 30s. Rate: 7.8 symbols/min [2025-10-27T19:17:09.853449] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:09.891813] [DEBUG] [LOCAL ] HUYA: Loaded 44262 existing records from primary storage. [2025-10-27T19:17:09.892089] [INFO ] [MAIN ] HUYA: Loaded 44262 existing records. [2025-10-27T19:17:10.020017] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-27T19:17:10.071814] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:10.071983] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-27T19:17:10.072029] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-27T19:17:10.072206] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-27T19:17:10.072243] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-27T19:17:10.422736] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:10.814949] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-27T19:17:10.878242] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T19:17:11.404890] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T19:17:11.614978] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-27T19:17:11.967001] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:17:12.415004] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-27T19:17:13.214984] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-27T19:17:13.261557] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:17:13.940470] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:17:14.014956] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-27T19:17:14.814925] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-27T19:17:14.838541] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:17:15.265084] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:17:15.614990] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-27T19:17:16.426820] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-27T19:17:16.432998] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:17:17.039790] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:17:17.214947] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-27T19:17:17.812961] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:17:17.821906] [INFO ] [REMOTE ] HUBS: Full fetch complete (57091 records). [2025-10-27T19:17:17.822067] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-27T19:17:18.020402] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-27T19:17:18.222909] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-27T19:17:18.223016] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-27T19:17:18.224127] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-27T19:17:18.224194] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-27T19:17:18.225796] [DEBUG] [LOCAL ] HUBS: Trimmed 57091 records to 39652 (keeping 200 days of data) [2025-10-27T19:17:18.487187] [DEBUG] [LOCAL ] HUBS: Primary data saved (39652 records). [2025-10-27T19:17:18.487386] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-27T19:17:18.487981] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUBS took 31.7s. Estimated remaining: 2h 47m 23s. Rate: 7.8 symbols/min [2025-10-27T19:17:18.673481] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:18.697884] [DEBUG] [LOCAL ] HVT: Loaded 14893 existing records from primary storage. [2025-10-27T19:17:18.698336] [INFO ] [MAIN ] HVT: Loaded 14893 existing records. [2025-10-27T19:17:18.820190] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-27T19:17:18.897319] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:18.897704] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-27T19:17:18.897765] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-27T19:17:18.897993] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-27T19:17:18.898052] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-27T19:17:19.352510] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:19.357379] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T19:17:19.614959] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-27T19:17:19.737854] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:17:20.218545] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:17:20.297380] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:17:20.414958] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-27T19:17:21.214949] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-27T19:17:22.014917] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-27T19:17:22.077106] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:17:22.426525] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T19:17:22.814947] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-27T19:17:23.195497] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:17:23.614946] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-27T19:17:24.249163] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:17:24.414906] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-27T19:17:25.214918] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-27T19:17:25.429513] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T19:17:25.859390] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T19:17:26.014917] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-27T19:17:26.080476] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T19:17:26.814929] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-27T19:17:27.458612] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:17:27.615040] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-27T19:17:28.125712] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T19:17:28.139108] [INFO ] [REMOTE ] HUM: Full fetch complete (71071 records). [2025-10-27T19:17:28.139263] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-27T19:17:28.420175] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-27T19:17:28.534327] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-27T19:17:28.534423] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-27T19:17:28.535340] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-27T19:17:28.535417] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-27T19:17:28.536813] [DEBUG] [LOCAL ] HUM: Trimmed 71071 records to 49027 (keeping 200 days of data) [2025-10-27T19:17:28.661002] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:17:28.849533] [DEBUG] [LOCAL ] HUM: Primary data saved (49027 records). [2025-10-27T19:17:28.849691] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-27T19:17:28.850261] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUM took 31.9s. Estimated remaining: 2h 47m 19s. Rate: 7.8 symbols/min [2025-10-27T19:17:29.014702] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:29.066788] [DEBUG] [LOCAL ] HWM: Loaded 53449 existing records from primary storage. [2025-10-27T19:17:29.067129] [INFO ] [MAIN ] HWM: Loaded 53449 existing records. [2025-10-27T19:17:29.228780] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-27T19:17:29.244179] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:29.245045] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-27T19:17:29.245115] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-27T19:17:29.245323] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-27T19:17:29.245378] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-27T19:17:29.590611] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:30.014989] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-27T19:17:30.665388] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:17:30.742913] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-27T19:17:30.814902] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-27T19:17:31.614941] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-27T19:17:31.965397] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:17:32.177443] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:17:32.320503] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:17:32.415006] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-27T19:17:33.214992] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-27T19:17:33.687035] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:17:34.014960] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-27T19:17:34.566029] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:17:34.814960] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-27T19:17:35.215348] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:17:35.614978] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-27T19:17:36.160531] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:17:36.171069] [INFO ] [REMOTE ] HUN: Full fetch complete (77040 records). [2025-10-27T19:17:36.171241] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-27T19:17:36.420776] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-27T19:17:36.585858] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-27T19:17:36.585966] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-27T19:17:36.587068] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-27T19:17:36.587148] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-27T19:17:36.588816] [DEBUG] [LOCAL ] HUN: Trimmed 77040 records to 53210 (keeping 200 days of data) [2025-10-27T19:17:36.903912] [DEBUG] [LOCAL ] HUN: Primary data saved (53210 records). [2025-10-27T19:17:36.904047] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-27T19:17:36.904140] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUN took 31.1s. Estimated remaining: 2h 47m 11s. Rate: 7.8 symbols/min [2025-10-27T19:17:37.071985] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:37.113169] [DEBUG] [LOCAL ] HXL: Loaded 46545 existing records from primary storage. [2025-10-27T19:17:37.113469] [INFO ] [MAIN ] HXL: Loaded 46545 existing records. [2025-10-27T19:17:37.217933] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-27T19:17:37.289536] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:37.289760] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-27T19:17:37.289811] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-27T19:17:37.289991] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-27T19:17:37.290069] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-27T19:17:37.591812] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T19:17:37.622090] [INFO ] [REMOTE ] HUYA: Full fetch complete (64025 records). [2025-10-27T19:17:37.639732] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-27T19:17:37.748230] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:38.026503] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-27T19:17:38.084090] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-27T19:17:38.084614] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-27T19:17:38.085885] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-27T19:17:38.086044] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-27T19:17:38.088023] [DEBUG] [LOCAL ] HUYA: Trimmed 64025 records to 43516 (keeping 200 days of data) [2025-10-27T19:17:38.235268] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:17:38.258015] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T19:17:38.405853] [DEBUG] [LOCAL ] HUYA: Primary data saved (43516 records). [2025-10-27T19:17:38.406060] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-27T19:17:38.406942] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HUYA took 28.7s. Estimated remaining: 2h 46m 56s. Rate: 7.8 symbols/min [2025-10-27T19:17:38.599193] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:38.615452] [DEBUG] [LOCAL ] HY: Loaded 9943 existing records from primary storage. [2025-10-27T19:17:38.615805] [INFO ] [MAIN ] HY: Loaded 9943 existing records. [2025-10-27T19:17:38.804599] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:17:38.804919] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-27T19:17:38.804975] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-27T19:17:38.805160] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-27T19:17:38.805200] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-27T19:17:38.820107] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-27T19:17:39.185156] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:39.467758] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:17:39.614914] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-27T19:17:39.833948] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T19:17:40.137696] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T19:17:40.414919] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-27T19:17:41.214958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-27T19:17:41.852990] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:17:42.014990] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-27T19:17:42.814989] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-27T19:17:42.940202] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T19:17:43.477901] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:17:43.614960] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-27T19:17:43.637007] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T19:17:44.414935] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-27T19:17:45.199453] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:17:45.214899] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-27T19:17:45.450445] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T19:17:46.014955] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-27T19:17:46.163947] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:17:46.168287] [INFO ] [REMOTE ] HVT: Full fetch complete (22931 records). [2025-10-27T19:17:46.168402] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-27T19:17:46.542873] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-27T19:17:46.542943] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-27T19:17:46.543444] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-27T19:17:46.543505] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-27T19:17:46.544105] [DEBUG] [LOCAL ] HVT: Trimmed 22931 records to 14524 (keeping 200 days of data) [2025-10-27T19:17:46.628390] [DEBUG] [LOCAL ] HVT: Primary data saved (14524 records). [2025-10-27T19:17:46.628519] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-27T19:17:46.628607] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HVT took 28.1s. Estimated remaining: 2h 46m 49s. Rate: 7.8 symbols/min [2025-10-27T19:17:46.792513] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:17:46.792724] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-27T19:17:46.792772] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-27T19:17:46.792883] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-27T19:17:46.792923] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-27T19:17:46.792965] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-27T19:17:46.792997] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-27T19:17:46.822968] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-27T19:17:47.161729] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:17:47.614943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-27T19:17:47.679187] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:17:47.760602] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:17:48.013360] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T19:17:48.414946] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-27T19:17:48.676018] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-27T19:17:49.214997] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-27T19:17:50.014978] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-27T19:17:50.050306] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T19:17:50.814963] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-27T19:17:51.049747] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-27T19:17:51.166138] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:17:51.614943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-27T19:17:51.965040] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T19:17:52.414931] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-27T19:17:52.676668] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T19:17:53.214957] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-27T19:17:54.014923] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-27T19:17:54.328527] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:17:54.814994] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-27T19:17:55.206341] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T19:17:55.479844] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:17:55.614926] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-27T19:17:56.414961] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-27T19:17:57.214920] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-27T19:17:57.438727] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:17:57.532532] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T19:17:57.652131] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T19:17:58.014939] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-27T19:17:58.254665] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-27T19:17:58.814947] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-27T19:17:59.299908] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:17:59.614930] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-27T19:18:00.414943] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-27T19:18:00.882573] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T19:18:01.214933] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-27T19:18:02.014956] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-27T19:18:02.234752] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-27T19:18:02.305127] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:18:02.305981] [INFO ] [REMOTE ] HYAC: Full fetch complete (909 records). [2025-10-27T19:18:02.306048] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-27T19:18:02.306370] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T19:18:02.306466] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:18:02.306533] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:18:02.306605] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-27T19:18:02.306731] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-27T19:18:02.306787] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-27T19:18:02.306829] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-27T19:18:02.306893] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HYAC took 15.7s. Estimated remaining: 2h 46m 51s. Rate: 7.8 symbols/min [2025-10-27T19:18:02.477434] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:02.477582] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-27T19:18:02.477619] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-27T19:18:02.477748] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-27T19:18:02.477789] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-27T19:18:02.477831] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-27T19:18:02.477872] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-27T19:18:02.823151] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-27T19:18:02.829296] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:03.201711] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:18:03.518139] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T19:18:03.614954] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-27T19:18:04.414916] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-27T19:18:04.436416] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:18:05.214980] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-27T19:18:06.002980] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:18:06.013045] [INFO ] [REMOTE ] HXL: Full fetch complete (66775 records). [2025-10-27T19:18:06.013192] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-27T19:18:06.025045] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-27T19:18:06.394311] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-27T19:18:06.394387] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-27T19:18:06.395284] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-27T19:18:06.395347] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-27T19:18:06.396639] [DEBUG] [LOCAL ] HXL: Trimmed 66775 records to 45823 (keeping 200 days of data) [2025-10-27T19:18:06.663890] [DEBUG] [LOCAL ] HXL: Primary data saved (45823 records). [2025-10-27T19:18:06.664005] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-27T19:18:06.664096] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HXL took 29.8s. Estimated remaining: 2h 46m 39s. Rate: 7.8 symbols/min [2025-10-27T19:18:06.836522] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:06.836707] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-27T19:18:06.850102] [DEBUG] [LOCAL ] HYI: Loaded 9716 existing records from primary storage. [2025-10-27T19:18:06.850333] [INFO ] [MAIN ] HYI: Loaded 9716 existing records. [2025-10-27T19:18:07.008990] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:18:07.093596] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:07.106667] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-27T19:18:07.106842] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-27T19:18:07.107214] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-27T19:18:07.107534] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-27T19:18:07.108544] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T19:18:07.228762] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T19:18:07.502883] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:07.614942] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-27T19:18:08.375003] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T19:18:08.414899] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-27T19:18:09.213720] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:18:09.217021] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-27T19:18:09.455370] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-27T19:18:10.014960] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-27T19:18:10.275635] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-27T19:18:10.814937] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-27T19:18:11.081152] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-27T19:18:11.614937] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-27T19:18:11.934696] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T19:18:12.414959] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-27T19:18:13.220166] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-27T19:18:13.228163] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:18:13.993315] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:18:14.014897] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-27T19:18:14.538345] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T19:18:14.814962] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-27T19:18:15.132129] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T19:18:15.614956] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-27T19:18:16.414950] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-27T19:18:16.461857] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:18:16.464250] [INFO ] [REMOTE ] HY: Full fetch complete (14792 records). [2025-10-27T19:18:16.464343] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-27T19:18:16.760832] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-27T19:18:16.836671] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-27T19:18:16.836767] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-27T19:18:16.837093] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-27T19:18:16.837131] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-27T19:18:16.837579] [DEBUG] [LOCAL ] HY: Trimmed 14792 records to 9594 (keeping 200 days of data) [2025-10-27T19:18:16.894691] [DEBUG] [LOCAL ] HY: Primary data saved (9594 records). [2025-10-27T19:18:16.894817] [INFO ] [MAIN ] HY: Full history saved. [2025-10-27T19:18:16.894893] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HY took 38.5s. Estimated remaining: 2h 46m 34s. Rate: 7.8 symbols/min [2025-10-27T19:18:17.060524] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:17.092386] [DEBUG] [LOCAL ] HYT: Loaded 33993 existing records from primary storage. [2025-10-27T19:18:17.092674] [INFO ] [MAIN ] HYT: Loaded 33993 existing records. [2025-10-27T19:18:17.220040] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-27T19:18:17.273618] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:17.273813] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-27T19:18:17.273868] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-27T19:18:17.274102] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-27T19:18:17.274160] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-27T19:18:17.627394] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:18.014943] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-27T19:18:18.034749] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:18:18.814943] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-27T19:18:19.140610] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-27T19:18:19.426741] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:18:19.614940] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-27T19:18:20.414950] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-27T19:18:20.690631] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-27T19:18:20.826441] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:18:21.214946] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-27T19:18:22.014988] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-27T19:18:22.814931] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-27T19:18:22.961765] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:18:23.023525] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:18:23.167596] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T19:18:23.168317] [INFO ] [REMOTE ] HYBX: Full fetch complete (703 records). [2025-10-27T19:18:23.168388] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-27T19:18:23.345338] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-27T19:18:23.345510] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:18:23.345568] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:18:23.345634] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-27T19:18:23.345735] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-27T19:18:23.345775] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-27T19:18:23.345816] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-27T19:18:23.345871] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYBX took 21.0s. Estimated remaining: 2h 46m 25s. Rate: 7.8 symbols/min [2025-10-27T19:18:23.513884] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:23.522268] [DEBUG] [LOCAL ] HYTR: Loaded 3140 existing records from primary storage. [2025-10-27T19:18:23.522442] [INFO ] [MAIN ] HYTR: Loaded 3140 existing records. [2025-10-27T19:18:23.620143] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-27T19:18:23.697917] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:23.698120] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-27T19:18:23.698166] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-27T19:18:23.698291] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-27T19:18:23.698327] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-27T19:18:24.041961] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:24.414986] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-27T19:18:25.214999] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-27T19:18:25.608402] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T19:18:25.933540] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T19:18:25.978019] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:18:26.014898] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-27T19:18:26.817469] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-27T19:18:26.823761] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T19:18:27.350483] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T19:18:27.614931] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-27T19:18:28.135794] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T19:18:28.414955] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-27T19:18:29.178319] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-27T19:18:29.214914] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-27T19:18:30.004975] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T19:18:30.014887] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-27T19:18:30.673748] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:18:30.815029] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-27T19:18:31.185211] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T19:18:31.614949] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-27T19:18:31.945902] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-27T19:18:32.414968] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-27T19:18:33.215007] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-27T19:18:33.460565] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T19:18:33.463282] [INFO ] [REMOTE ] HYI: Full fetch complete (14054 records). [2025-10-27T19:18:33.463350] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-27T19:18:33.817031] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-27T19:18:33.817104] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-27T19:18:33.817407] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-27T19:18:33.817445] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-27T19:18:33.817921] [DEBUG] [LOCAL ] HYI: Trimmed 14054 records to 9485 (keeping 200 days of data) [2025-10-27T19:18:33.875538] [DEBUG] [LOCAL ] HYI: Primary data saved (9485 records). [2025-10-27T19:18:33.875705] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-27T19:18:33.875797] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYI took 27.2s. Estimated remaining: 2h 46m 21s. Rate: 7.8 symbols/min [2025-10-27T19:18:33.973809] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T19:18:34.025992] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-27T19:18:34.059331] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:34.086890] [DEBUG] [LOCAL ] HZO: Loaded 28844 existing records from primary storage. [2025-10-27T19:18:34.087141] [INFO ] [MAIN ] HZO: Loaded 28844 existing records. [2025-10-27T19:18:34.260786] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:34.260979] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-27T19:18:34.261024] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-27T19:18:34.261189] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-27T19:18:34.261226] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-27T19:18:34.604620] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:34.814959] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-27T19:18:35.286440] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:18:35.472580] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:18:35.614934] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-27T19:18:36.414934] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-27T19:18:36.829679] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:18:36.963207] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:18:37.215007] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-27T19:18:38.014942] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-27T19:18:38.517241] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:18:38.814938] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-27T19:18:39.615041] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-27T19:18:39.844884] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:18:40.091724] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:18:40.095291] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:18:40.106398] [INFO ] [REMOTE ] HWM: Full fetch complete (76615 records). [2025-10-27T19:18:40.106593] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-27T19:18:40.420130] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-27T19:18:40.574459] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-27T19:18:40.574534] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-27T19:18:40.575748] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-27T19:18:40.575818] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-27T19:18:40.577720] [DEBUG] [LOCAL ] HWM: Trimmed 76615 records to 52655 (keeping 200 days of data) [2025-10-27T19:18:40.932808] [DEBUG] [LOCAL ] HWM: Primary data saved (52655 records). [2025-10-27T19:18:40.932973] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-27T19:18:40.933672] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HWM took 1m 12s. Estimated remaining: 2h 46m 12s. Rate: 7.8 symbols/min [2025-10-27T19:18:41.105612] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:18:41.115465] [DEBUG] [LOCAL ] IAE: Loaded 6423 existing records from primary storage. [2025-10-27T19:18:41.115706] [INFO ] [MAIN ] IAE: Loaded 6423 existing records. [2025-10-27T19:18:41.214922] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-27T19:18:41.294559] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:18:41.294805] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-27T19:18:41.294855] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-27T19:18:41.294993] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-27T19:18:41.295031] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-27T19:18:41.669423] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:18:41.715160] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T19:18:42.014952] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-27T19:18:42.621948] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:18:42.815004] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-27T19:18:43.138080] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T19:18:43.363535] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:18:43.614916] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-27T19:18:44.330895] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:18:44.332180] [INFO ] [REMOTE ] HYTR: Full fetch complete (4705 records). [2025-10-27T19:18:44.332250] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-27T19:18:44.420129] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-27T19:18:44.681550] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-27T19:18:44.681626] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-27T19:18:44.681809] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-27T19:18:44.681859] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-27T19:18:44.682216] [DEBUG] [LOCAL ] HYTR: Trimmed 4705 records to 3094 (keeping 200 days of data) [2025-10-27T19:18:44.700560] [DEBUG] [LOCAL ] HYTR: Primary data saved (3094 records). [2025-10-27T19:18:44.700623] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-27T19:18:44.700727] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYTR took 21.4s. Estimated remaining: 2h 45m 60s. Rate: 7.8 symbols/min [2025-10-27T19:18:45.214970] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-27T19:18:45.813454] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:18:45.896482] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:18:46.014998] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-27T19:18:46.814946] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-27T19:18:47.104343] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:18:47.110915] [INFO ] [REMOTE ] HYT: Full fetch complete (47859 records). [2025-10-27T19:18:47.111032] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-27T19:18:47.483672] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-27T19:18:47.483782] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-27T19:18:47.484524] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-27T19:18:47.484584] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-27T19:18:47.485535] [DEBUG] [LOCAL ] HYT: Trimmed 47859 records to 33156 (keeping 200 days of data) [2025-10-27T19:18:47.580085] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:18:47.643903] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-27T19:18:47.689612] [DEBUG] [LOCAL ] HYT: Primary data saved (33156 records). [2025-10-27T19:18:47.689767] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-27T19:18:47.689862] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HYT took 30.8s. Estimated remaining: 2h 45m 46s. Rate: 7.8 symbols/min [2025-10-27T19:18:48.069177] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T19:18:48.414997] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-27T19:18:48.997411] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:18:49.214932] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-27T19:18:49.824012] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T19:18:50.015016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-27T19:18:50.815026] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-27T19:18:50.860809] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T19:18:51.491852] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:18:51.614952] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-27T19:18:52.184851] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T19:18:52.414956] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-27T19:18:53.011382] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:18:53.214965] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-27T19:18:54.014953] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-27T19:18:54.362543] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:18:54.436113] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T19:18:54.814935] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-27T19:18:55.359361] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T19:18:55.361621] [INFO ] [REMOTE ] IAE: Full fetch complete (9176 records). [2025-10-27T19:18:55.361728] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-27T19:18:55.624312] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-27T19:18:55.741273] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-27T19:18:55.741344] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-27T19:18:55.741774] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-27T19:18:55.741838] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-27T19:18:55.742261] [DEBUG] [LOCAL ] IAE: Trimmed 9176 records to 6415 (keeping 200 days of data) [2025-10-27T19:18:55.779138] [DEBUG] [LOCAL ] IAE: Primary data saved (6415 records). [2025-10-27T19:18:55.779252] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-27T19:18:55.779328] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAE took 14.8s. Estimated remaining: 2h 45m 39s. Rate: 7.8 symbols/min [2025-10-27T19:18:57.157432] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:18:57.164023] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-27T19:18:57.976108] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:18:57.982613] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-27T19:18:58.836842] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:18:58.843108] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-27T19:18:59.712233] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T19:18:59.717377] [INFO ] [REMOTE ] HZO: Full fetch complete (41283 records). [2025-10-27T19:18:59.717480] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-27T19:19:00.127631] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-27T19:19:00.127812] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-27T19:19:00.128565] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-27T19:19:00.128630] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-27T19:19:00.129976] [DEBUG] [LOCAL ] HZO: Trimmed 41283 records to 28097 (keeping 200 days of data) [2025-10-27T19:19:00.309442] [DEBUG] [LOCAL ] HZO: Primary data saved (28097 records). [2025-10-27T19:19:00.309593] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-27T19:19:00.309720] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. HZO took 26.4s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-10-27T19:19:01.234386] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.227556] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.235433] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.233323] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:01.290208] [DEBUG] [LOCAL ] IBP: Loaded 29036 existing records from primary storage. [2025-10-27T19:19:01.306296] [INFO ] [MAIN ] IBP: Loaded 29036 existing records. [2025-10-27T19:19:01.427674] [DEBUG] [LOCAL ] IBN: Loaded 53601 existing records from primary storage. [2025-10-27T19:19:01.451497] [INFO ] [MAIN ] IBN: Loaded 53601 existing records. [2025-10-27T19:19:01.472842] [DEBUG] [LOCAL ] IAG: Loaded 54272 existing records from primary storage. [2025-10-27T19:19:01.510430] [INFO ] [MAIN ] IAG: Loaded 54272 existing records. [2025-10-27T19:19:01.579625] [DEBUG] [LOCAL ] IBM: Loaded 54408 existing records from primary storage. [2025-10-27T19:19:01.646284] [INFO ] [MAIN ] IBM: Loaded 54408 existing records. [2025-10-27T19:19:01.853374] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:01.927458] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-27T19:19:01.995863] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-27T19:19:02.127039] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.143183] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-27T19:19:02.137552] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.148548] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.164573] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.164419] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-27T19:19:02.189872] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-27T19:19:02.206224] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-27T19:19:02.278409] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-27T19:19:02.268065] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:02.278974] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-27T19:19:02.278921] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-27T19:19:02.299766] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-27T19:19:02.294497] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-27T19:19:02.369379] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-27T19:19:02.448489] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-27T19:19:02.484285] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-27T19:19:03.668968] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.770853] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.750569] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-27T19:19:03.830796] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.832864] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-27T19:19:03.838985] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-27T19:19:03.927938] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:03.928345] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-27T19:19:05.106867] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:19:05.112929] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-27T19:19:05.544568] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:19:05.555911] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-27T19:19:05.605342] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:19:05.617809] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-27T19:19:05.654521] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T19:19:05.665407] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-27T19:19:05.888604] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:19:05.895338] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-27T19:19:07.253178] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:19:07.260808] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-27T19:19:07.297472] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:19:07.308718] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-27T19:19:07.344635] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T19:19:07.460233] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T19:19:07.615007] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-27T19:19:08.415103] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-27T19:19:08.665912] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:19:08.750520] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:19:09.159544] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T19:19:09.215047] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-27T19:19:10.015019] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-27T19:19:10.441756] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:19:10.544905] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T19:19:10.814959] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-27T19:19:10.967320] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:19:11.614996] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-27T19:19:12.414993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-27T19:19:12.514378] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:19:13.170745] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:19:13.214903] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-27T19:19:13.555823] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T19:19:14.014934] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-27T19:19:14.750773] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:19:14.815095] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-27T19:19:15.182122] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:19:15.614931] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-27T19:19:16.414973] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-27T19:19:16.841722] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T19:19:17.071636] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:19:17.214904] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-27T19:19:17.407596] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T19:19:18.015015] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-27T19:19:18.815009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-27T19:19:19.059082] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T19:19:19.615000] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-27T19:19:20.095523] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T19:19:20.414942] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-27T19:19:20.493385] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T19:19:20.834109] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:19:21.214927] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-27T19:19:21.544288] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:19:22.014949] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-27T19:19:22.814913] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-27T19:19:22.928089] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T19:19:23.430028] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:19:23.435489] [INFO ] [REMOTE ] IBP: Full fetch complete (41148 records). [2025-10-27T19:19:23.435576] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-27T19:19:23.624218] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-27T19:19:23.819233] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-27T19:19:23.819329] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-27T19:19:23.820073] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-27T19:19:23.820136] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-27T19:19:23.821056] [DEBUG] [LOCAL ] IBP: Trimmed 41148 records to 28251 (keeping 200 days of data) [2025-10-27T19:19:23.993350] [DEBUG] [LOCAL ] IBP: Primary data saved (28251 records). [2025-10-27T19:19:23.993479] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-27T19:19:23.993556] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IBP took 23.7s. Estimated remaining: 2h 45m 39s. Rate: 7.8 symbols/min [2025-10-27T19:19:24.163910] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:24.197208] [DEBUG] [LOCAL ] IBTA: Loaded 36486 existing records from primary storage. [2025-10-27T19:19:24.197467] [INFO ] [MAIN ] IBTA: Loaded 36486 existing records. [2025-10-27T19:19:24.387950] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:24.388234] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-27T19:19:24.388315] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-27T19:19:24.388613] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-27T19:19:24.388771] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-27T19:19:24.421592] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-27T19:19:24.705545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T19:19:24.795734] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:25.214965] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-27T19:19:25.673528] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:19:26.014925] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-27T19:19:26.487330] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T19:19:26.497292] [INFO ] [REMOTE ] IBN: Full fetch complete (76660 records). [2025-10-27T19:19:26.497423] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-27T19:19:26.822468] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-27T19:19:26.880596] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-27T19:19:26.880712] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-27T19:19:26.881685] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-27T19:19:26.881748] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-27T19:19:26.883138] [DEBUG] [LOCAL ] IBN: Trimmed 76660 records to 52799 (keeping 200 days of data) [2025-10-27T19:19:27.204306] [DEBUG] [LOCAL ] IBN: Primary data saved (52799 records). [2025-10-27T19:19:27.204448] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-27T19:19:27.204531] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBN took 26.9s. Estimated remaining: 2h 45m 26s. Rate: 7.8 symbols/min [2025-10-27T19:19:27.402240] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:27.405527] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-27T19:19:27.467040] [DEBUG] [LOCAL ] ICE: Loaded 53789 existing records from primary storage. [2025-10-27T19:19:27.467426] [INFO ] [MAIN ] ICE: Loaded 53789 existing records. [2025-10-27T19:19:27.616247] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-27T19:19:27.649302] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:27.650448] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-27T19:19:27.650516] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-27T19:19:27.650740] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-27T19:19:27.650797] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-27T19:19:28.025078] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:28.057572] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T19:19:28.085182] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T19:19:28.414960] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-27T19:19:29.215018] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-27T19:19:29.538356] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:19:29.548593] [INFO ] [REMOTE ] IAG: Full fetch complete (77529 records). [2025-10-27T19:19:29.548765] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-27T19:19:29.937099] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-27T19:19:29.937181] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-27T19:19:29.938263] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-27T19:19:29.939010] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-27T19:19:29.940510] [DEBUG] [LOCAL ] IAG: Trimmed 77529 records to 53492 (keeping 200 days of data) [2025-10-27T19:19:30.022989] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-27T19:19:30.186396] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:19:30.298296] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-27T19:19:30.298539] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-27T19:19:30.299150] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IAG took 30.0s. Estimated remaining: 2h 45m 13s. Rate: 7.8 symbols/min [2025-10-27T19:19:30.488987] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:19:30.492423] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:30.535032] [DEBUG] [LOCAL ] ICL: Loaded 38567 existing records from primary storage. [2025-10-27T19:19:30.535403] [INFO ] [MAIN ] ICL: Loaded 38567 existing records. [2025-10-27T19:19:30.719818] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:30.720037] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-27T19:19:30.720092] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-27T19:19:30.720341] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-27T19:19:30.720397] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-27T19:19:30.818227] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-27T19:19:31.071048] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:31.614987] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-27T19:19:31.925200] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T19:19:32.413329] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:19:32.422993] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-27T19:19:32.960414] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:19:33.214968] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-27T19:19:34.015016] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-27T19:19:34.508038] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:19:34.814982] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-27T19:19:34.893029] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-27T19:19:35.522878] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:19:35.615024] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-27T19:19:36.081986] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T19:19:36.414994] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-27T19:19:37.052099] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:19:37.214967] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-27T19:19:38.014958] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-27T19:19:38.568000] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T19:19:38.621910] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:19:38.815033] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-27T19:19:38.994156] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:19:39.614965] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-27T19:19:40.415032] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-27T19:19:40.485242] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T19:19:40.723366] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:19:41.214960] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-27T19:19:41.692609] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:19:42.015030] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-27T19:19:42.280690] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:19:42.814970] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-27T19:19:43.614970] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-27T19:19:43.763774] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T19:19:43.813441] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:19:44.414947] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-27T19:19:45.214964] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-27T19:19:45.917619] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T19:19:45.956863] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-27T19:19:45.967080] [INFO ] [REMOTE ] IBM: Full fetch complete (77744 records). [2025-10-27T19:19:45.967202] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-27T19:19:46.022327] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-27T19:19:46.364211] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-27T19:19:46.364331] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-27T19:19:46.365411] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-27T19:19:46.365519] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-27T19:19:46.367174] [DEBUG] [LOCAL ] IBM: Trimmed 77744 records to 53628 (keeping 200 days of data) [2025-10-27T19:19:46.509498] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:19:46.753355] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-27T19:19:46.753495] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-27T19:19:46.753575] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBM took 46.4s. Estimated remaining: 2h 45m 15s. Rate: 7.8 symbols/min [2025-10-27T19:19:46.820056] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-27T19:19:46.921286] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:46.954252] [DEBUG] [LOCAL ] IDA: Loaded 33218 existing records from primary storage. [2025-10-27T19:19:46.954557] [INFO ] [MAIN ] IDA: Loaded 33218 existing records. [2025-10-27T19:19:47.134847] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:47.135057] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-27T19:19:47.135102] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-27T19:19:47.135288] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-27T19:19:47.135342] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-27T19:19:47.537739] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:47.616271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T19:19:47.616505] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-27T19:19:47.997564] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:19:48.415022] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-27T19:19:48.632234] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:19:49.214981] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-27T19:19:49.846511] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:19:49.853289] [INFO ] [REMOTE ] IBTA: Full fetch complete (51133 records). [2025-10-27T19:19:49.853428] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-27T19:19:50.025095] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-27T19:19:50.246728] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-27T19:19:50.246817] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-27T19:19:50.247563] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-27T19:19:50.247604] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-27T19:19:50.248787] [DEBUG] [LOCAL ] IBTA: Trimmed 51133 records to 35583 (keeping 200 days of data) [2025-10-27T19:19:50.446479] [DEBUG] [LOCAL ] IBTA: Primary data saved (35583 records). [2025-10-27T19:19:50.446946] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-27T19:19:50.447237] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IBTA took 26.5s. Estimated remaining: 2h 45m 3s. Rate: 7.8 symbols/min [2025-10-27T19:19:50.619165] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:19:50.630331] [DEBUG] [LOCAL ] IDE: Loaded 9211 existing records from primary storage. [2025-10-27T19:19:50.630520] [INFO ] [MAIN ] IDE: Loaded 9211 existing records. [2025-10-27T19:19:50.813474] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:19:50.813922] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-27T19:19:50.814032] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-27T19:19:50.814295] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-27T19:19:50.814351] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-27T19:19:50.846066] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-27T19:19:50.951062] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:19:51.217043] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:19:51.264107] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:19:51.614961] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-27T19:19:52.377913] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:19:52.417514] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-27T19:19:52.422004] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:19:53.214954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-27T19:19:53.792509] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:19:54.014960] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-27T19:19:54.482240] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:19:54.743868] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:19:54.814924] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-27T19:19:55.614934] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-27T19:19:55.750203] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:19:56.414991] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-27T19:19:56.802841] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:19:56.880218] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:19:57.214986] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-27T19:19:58.014963] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-27T19:19:58.403190] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T19:19:58.814979] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-27T19:19:58.953483] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:19:59.507157] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T19:19:59.614935] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-27T19:20:00.414988] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-27T19:20:01.035337] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:20:01.214988] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-27T19:20:02.015059] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-27T19:20:02.300784] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:20:02.792003] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T19:20:02.814929] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-27T19:20:03.256809] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T19:20:03.614946] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-27T19:20:03.642776] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T19:20:03.649905] [INFO ] [REMOTE ] ICL: Full fetch complete (55697 records). [2025-10-27T19:20:03.650078] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-27T19:20:04.034320] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-27T19:20:04.034397] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-27T19:20:04.035254] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-27T19:20:04.035313] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-27T19:20:04.036464] [DEBUG] [LOCAL ] ICL: Trimmed 55697 records to 37737 (keeping 200 days of data) [2025-10-27T19:20:04.249404] [DEBUG] [LOCAL ] ICL: Primary data saved (37737 records). [2025-10-27T19:20:04.249820] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-27T19:20:04.250625] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. ICL took 34.0s. Estimated remaining: 2h 45m 2s. Rate: 7.8 symbols/min [2025-10-27T19:20:04.428696] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:04.425129] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-27T19:20:04.449982] [DEBUG] [LOCAL ] IDT: Loaded 18791 existing records from primary storage. [2025-10-27T19:20:04.450218] [INFO ] [MAIN ] IDT: Loaded 18791 existing records. [2025-10-27T19:20:04.632726] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:04.632901] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-27T19:20:04.632946] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-27T19:20:04.633259] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-27T19:20:04.633315] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-27T19:20:04.995576] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:05.002543] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T19:20:05.138334] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:20:05.214926] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-27T19:20:06.014940] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-27T19:20:06.025941] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:20:06.603231] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:20:06.814949] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-27T19:20:07.614965] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-27T19:20:08.405955] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T19:20:08.414887] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-27T19:20:08.757983] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T19:20:08.769562] [INFO ] [REMOTE ] ICE: Full fetch complete (77024 records). [2025-10-27T19:20:08.769761] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-27T19:20:09.199773] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-27T19:20:09.199871] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-27T19:20:09.200844] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-27T19:20:09.200913] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-27T19:20:09.202383] [DEBUG] [LOCAL ] ICE: Trimmed 77024 records to 53009 (keeping 200 days of data) [2025-10-27T19:20:09.256599] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-27T19:20:09.336039] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:20:09.398398] [INFO ] [REMOTE ] IDE: Full fetch complete (12804 records). [2025-10-27T19:20:09.432539] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-27T19:20:09.918877] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-27T19:20:09.919544] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-27T19:20:09.920426] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-27T19:20:09.920839] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-27T19:20:09.923314] [DEBUG] [LOCAL ] IDE: Trimmed 12804 records to 9081 (keeping 200 days of data) [2025-10-27T19:20:09.985456] [DEBUG] [LOCAL ] IDE: Primary data saved (9081 records). [2025-10-27T19:20:09.986419] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-27T19:20:09.991621] [DEBUG] [LOCAL ] ICE: Primary data saved (53009 records). [2025-10-27T19:20:09.991768] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDE took 19.5s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-10-27T19:20:09.991895] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-27T19:20:10.003888] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. ICE took 42.8s. Estimated remaining: 2h 44m 35s. Rate: 7.8 symbols/min [2025-10-27T19:20:10.023831] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-27T19:20:10.355260] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:10.443074] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:10.477435] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:20:10.547561] [DEBUG] [LOCAL ] IEX: Loaded 38755 existing records from primary storage. [2025-10-27T19:20:10.548804] [INFO ] [MAIN ] IEX: Loaded 38755 existing records. [2025-10-27T19:20:10.607185] [DEBUG] [LOCAL ] IFF: Loaded 51978 existing records from primary storage. [2025-10-27T19:20:10.639990] [INFO ] [MAIN ] IFF: Loaded 51978 existing records. [2025-10-27T19:20:10.832142] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-27T19:20:10.932875] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T19:20:11.061309] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:11.088826] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:11.089132] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-27T19:20:11.089308] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-27T19:20:11.089254] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-27T19:20:11.089455] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-27T19:20:11.089577] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-27T19:20:11.089633] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-27T19:20:11.089706] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-27T19:20:11.106465] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-27T19:20:11.625280] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-27T19:20:11.852253] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:11.952323] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:11.988785] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:20:12.325549] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T19:20:12.414968] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-27T19:20:13.214962] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-27T19:20:13.614234] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:20:14.014945] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-27T19:20:14.685962] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:20:14.692136] [INFO ] [REMOTE ] IDA: Full fetch complete (45403 records). [2025-10-27T19:20:14.692248] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-27T19:20:14.820180] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-27T19:20:15.089447] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-27T19:20:15.089575] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-27T19:20:15.090325] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-27T19:20:15.090393] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-27T19:20:15.091520] [DEBUG] [LOCAL ] IDA: Trimmed 45403 records to 32500 (keeping 200 days of data) [2025-10-27T19:20:15.290453] [DEBUG] [LOCAL ] IDA: Primary data saved (32500 records). [2025-10-27T19:20:15.290580] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-27T19:20:15.291437] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IDA took 28.5s. Estimated remaining: 2h 44m 25s. Rate: 7.8 symbols/min [2025-10-27T19:20:15.461748] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:15.482629] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:20:15.504213] [DEBUG] [LOCAL ] IFN: Loaded 18773 existing records from primary storage. [2025-10-27T19:20:15.504461] [INFO ] [MAIN ] IFN: Loaded 18773 existing records. [2025-10-27T19:20:15.620033] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-27T19:20:15.682266] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:15.682599] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-27T19:20:15.682671] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-27T19:20:15.682861] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-27T19:20:15.682901] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-27T19:20:16.058184] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:16.414970] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-27T19:20:16.530026] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:20:16.651402] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:20:17.214951] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-27T19:20:17.837850] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:20:18.014984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-27T19:20:18.215906] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T19:20:18.814937] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-27T19:20:19.147811] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:20:19.614995] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-27T19:20:20.234502] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:20:20.414938] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-27T19:20:21.002864] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:20:21.095935] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:20:21.214977] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-27T19:20:22.014940] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-27T19:20:22.814907] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-27T19:20:22.841411] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:20:22.926155] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T19:20:23.610973] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:20:23.615296] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-27T19:20:24.414991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-27T19:20:25.214921] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-27T19:20:25.397355] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T19:20:25.804393] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T19:20:25.830037] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:20:26.014925] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-27T19:20:26.814941] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-27T19:20:27.269922] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:20:27.614910] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-27T19:20:27.859948] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:20:28.414937] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-27T19:20:28.745253] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:20:29.214919] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-27T19:20:29.451434] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:20:30.014992] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-27T19:20:30.426050] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T19:20:30.433889] [INFO ] [REMOTE ] IEX: Full fetch complete (53832 records). [2025-10-27T19:20:30.434085] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-27T19:20:30.820141] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-27T19:20:30.890229] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-27T19:20:30.890311] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-27T19:20:30.891083] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-27T19:20:30.891146] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-27T19:20:30.892264] [DEBUG] [LOCAL ] IEX: Trimmed 53832 records to 37995 (keeping 200 days of data) [2025-10-27T19:20:31.133044] [DEBUG] [LOCAL ] IEX: Primary data saved (37995 records). [2025-10-27T19:20:31.133185] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-27T19:20:31.133267] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IEX took 21.1s. Estimated remaining: 2h 44m 26s. Rate: 7.8 symbols/min [2025-10-27T19:20:31.320328] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:31.342056] [DEBUG] [LOCAL ] IFS: Loaded 22413 existing records from primary storage. [2025-10-27T19:20:31.342321] [INFO ] [MAIN ] IFS: Loaded 22413 existing records. [2025-10-27T19:20:31.538798] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:31.563730] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-27T19:20:31.566712] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-27T19:20:31.567552] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-27T19:20:31.568639] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:20:31.579025] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-27T19:20:31.619995] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-27T19:20:31.713677] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:20:31.971236] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:32.414962] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-27T19:20:32.736908] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:20:33.214955] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-27T19:20:33.712298] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:20:33.839420] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T19:20:34.014947] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-27T19:20:34.814940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-27T19:20:35.445356] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T19:20:35.614920] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-27T19:20:35.788781] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T19:20:36.414959] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-27T19:20:36.847038] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T19:20:36.851603] [INFO ] [REMOTE ] IDT: Full fetch complete (24280 records). [2025-10-27T19:20:36.851721] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-27T19:20:37.218679] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-27T19:20:37.218472] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-27T19:20:37.219026] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-27T19:20:37.220159] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-27T19:20:37.220217] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-27T19:20:37.221007] [DEBUG] [LOCAL ] IDT: Trimmed 24280 records to 18504 (keeping 200 days of data) [2025-10-27T19:20:37.335345] [DEBUG] [LOCAL ] IDT: Primary data saved (18504 records). [2025-10-27T19:20:37.335464] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-27T19:20:37.335539] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IDT took 33.1s. Estimated remaining: 2h 44m 17s. Rate: 7.8 symbols/min [2025-10-27T19:20:37.518141] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:20:37.520445] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:37.537294] [DEBUG] [LOCAL ] IGA: Loaded 10208 existing records from primary storage. [2025-10-27T19:20:37.537485] [INFO ] [MAIN ] IGA: Loaded 10208 existing records. [2025-10-27T19:20:37.708836] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:37.709024] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-27T19:20:37.709069] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-27T19:20:37.709254] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-27T19:20:37.709309] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-27T19:20:37.968983] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:20:38.020024] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-27T19:20:38.075881] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:38.805001] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T19:20:38.814901] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-27T19:20:39.614926] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-27T19:20:39.625710] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:20:40.414988] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-27T19:20:41.129673] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T19:20:41.214964] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-27T19:20:41.256892] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T19:20:42.014912] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-27T19:20:42.278227] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:20:42.777937] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T19:20:42.814901] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-27T19:20:43.614909] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-27T19:20:43.931728] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T19:20:44.247638] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T19:20:44.414951] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-27T19:20:45.215002] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-27T19:20:45.497369] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:20:46.014971] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-27T19:20:46.680447] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T19:20:46.820071] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-27T19:20:46.839474] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T19:20:47.614936] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-27T19:20:47.931565] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:20:47.935393] [INFO ] [REMOTE ] IFN: Full fetch complete (28126 records). [2025-10-27T19:20:47.935467] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-27T19:20:48.293119] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-27T19:20:48.293197] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-27T19:20:48.293856] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-27T19:20:48.293919] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-27T19:20:48.294554] [DEBUG] [LOCAL ] IFN: Trimmed 28126 records to 18180 (keeping 200 days of data) [2025-10-27T19:20:48.403920] [DEBUG] [LOCAL ] IFN: Primary data saved (18180 records). [2025-10-27T19:20:48.404069] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-27T19:20:48.404159] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFN took 33.1s. Estimated remaining: 2h 44m 13s. Rate: 7.8 symbols/min [2025-10-27T19:20:48.415814] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-27T19:20:48.599744] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:48.621421] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T19:20:48.644580] [DEBUG] [LOCAL ] IGD: Loaded 19483 existing records from primary storage. [2025-10-27T19:20:48.645126] [INFO ] [MAIN ] IGD: Loaded 19483 existing records. [2025-10-27T19:20:48.842224] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:48.842562] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-27T19:20:48.842721] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-27T19:20:48.843048] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-27T19:20:48.843155] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-27T19:20:49.200061] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:49.211713] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:20:49.214887] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-27T19:20:50.014934] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-27T19:20:50.154852] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T19:20:50.770044] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T19:20:50.814901] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-27T19:20:51.444622] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T19:20:51.614963] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-27T19:20:52.074206] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T19:20:52.415000] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-27T19:20:53.214959] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-27T19:20:53.839808] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:20:53.949885] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:20:54.014946] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-27T19:20:54.814966] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-27T19:20:55.614982] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-27T19:20:55.771074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T19:20:55.782082] [INFO ] [REMOTE ] IFF: Full fetch complete (73787 records). [2025-10-27T19:20:55.782297] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-27T19:20:56.131774] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:20:56.174177] [INFO ] [REMOTE ] IFS: Full fetch complete (32346 records). [2025-10-27T19:20:56.192591] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-27T19:20:56.210371] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-27T19:20:56.210623] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-27T19:20:56.211827] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-27T19:20:56.247607] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-27T19:20:56.322101] [DEBUG] [LOCAL ] IFF: Trimmed 73787 records to 51193 (keeping 200 days of data) [2025-10-27T19:20:56.428584] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-27T19:20:56.544042] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:20:56.808909] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-27T19:20:56.809302] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-27T19:20:56.809981] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-27T19:20:56.810057] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-27T19:20:56.848767] [DEBUG] [LOCAL ] IFS: Trimmed 32346 records to 21676 (keeping 200 days of data) [2025-10-27T19:20:57.038690] [DEBUG] [LOCAL ] IFF: Primary data saved (51193 records). [2025-10-27T19:20:57.045686] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-27T19:20:57.046334] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFF took 47.0s. Estimated remaining: 2h 44m 6s. Rate: 7.8 symbols/min [2025-10-27T19:20:57.161340] [DEBUG] [LOCAL ] IFS: Primary data saved (21676 records). [2025-10-27T19:20:57.163880] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-27T19:20:57.163979] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IFS took 26.0s. Estimated remaining: 2h 43m 50s. Rate: 7.8 symbols/min [2025-10-27T19:20:57.216582] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-27T19:20:57.316572] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:57.414427] [DEBUG] [LOCAL ] IGI: Loaded 4180 existing records from primary storage. [2025-10-27T19:20:57.412091] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:20:57.414636] [INFO ] [MAIN ] IGI: Loaded 4180 existing records. [2025-10-27T19:20:57.612477] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:57.613052] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-27T19:20:57.613109] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-27T19:20:57.613263] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-27T19:20:57.613319] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-27T19:20:57.747854] [DEBUG] [LOCAL ] IGR: Loaded 30924 existing records from primary storage. [2025-10-27T19:20:57.769911] [INFO ] [MAIN ] IGR: Loaded 30924 existing records. [2025-10-27T19:20:58.088777] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T19:20:58.129100] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:20:58.158626] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-27T19:20:58.294440] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:20:58.305483] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-27T19:20:58.326290] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-27T19:20:58.381853] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-27T19:20:58.409068] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-27T19:20:58.414695] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:58.821250] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-27T19:20:58.838695] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T19:20:58.928905] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:20:59.181259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T19:20:59.614951] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-27T19:21:00.414991] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-27T19:21:00.978282] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T19:21:01.214952] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-27T19:21:01.639515] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:21:01.642183] [INFO ] [REMOTE ] IGA: Full fetch complete (14234 records). [2025-10-27T19:21:01.642251] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-27T19:21:02.012963] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-27T19:21:02.013039] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-27T19:21:02.013385] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-27T19:21:02.013425] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-27T19:21:02.014119] [DEBUG] [LOCAL ] IGA: Trimmed 14234 records to 9709 (keeping 200 days of data) [2025-10-27T19:21:02.014925] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-27T19:21:02.076137] [DEBUG] [LOCAL ] IGA: Primary data saved (9709 records). [2025-10-27T19:21:02.076260] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-27T19:21:02.076338] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IGA took 24.7s. Estimated remaining: 2h 43m 39s. Rate: 7.8 symbols/min [2025-10-27T19:21:02.257570] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:02.261909] [DEBUG] [LOCAL ] IH: Loaded 2759 existing records from primary storage. [2025-10-27T19:21:02.262098] [INFO ] [MAIN ] IH: Loaded 2759 existing records. [2025-10-27T19:21:02.447199] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:02.447453] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-27T19:21:02.447521] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-27T19:21:02.447713] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-27T19:21:02.447770] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-27T19:21:02.588583] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T19:21:02.822822] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-27T19:21:02.850370] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:03.033908] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:21:03.185384] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:21:03.614941] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-27T19:21:04.414935] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-27T19:21:04.475256] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T19:21:04.714523] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-27T19:21:05.214989] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-27T19:21:06.014919] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-27T19:21:06.249847] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:21:06.586031] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T19:21:06.814971] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-27T19:21:07.305311] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T19:21:07.614935] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-27T19:21:08.196208] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T19:21:08.414960] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-27T19:21:08.950095] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:21:09.214948] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-27T19:21:09.543834] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-27T19:21:10.014956] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-27T19:21:10.728946] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T19:21:10.814915] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-27T19:21:11.111619] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-27T19:21:11.615003] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-27T19:21:12.414947] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-27T19:21:12.606722] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:21:13.214941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-27T19:21:13.693073] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:21:13.694080] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T19:21:14.014944] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-27T19:21:14.814913] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-27T19:21:15.041426] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T19:21:15.614968] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-27T19:21:16.048771] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:21:16.189535] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:21:16.414966] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-27T19:21:17.214955] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-27T19:21:17.336464] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T19:21:18.014932] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-27T19:21:18.094540] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T19:21:18.814930] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-27T19:21:19.252159] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T19:21:19.367866] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:21:19.372368] [INFO ] [REMOTE ] IGD: Full fetch complete (29970 records). [2025-10-27T19:21:19.372464] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-27T19:21:19.620130] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-27T19:21:19.777460] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-27T19:21:19.777564] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-27T19:21:19.778169] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-27T19:21:19.778229] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-27T19:21:19.778929] [DEBUG] [LOCAL ] IGD: Trimmed 29970 records to 19075 (keeping 200 days of data) [2025-10-27T19:21:19.886197] [DEBUG] [LOCAL ] IGD: Primary data saved (19075 records). [2025-10-27T19:21:19.886343] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-27T19:21:19.886421] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 31.5s. Estimated remaining: 2h 43m 43s. Rate: 7.8 symbols/min [2025-10-27T19:21:20.062154] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:20.072416] [DEBUG] [LOCAL ] IHD: Loaded 7446 existing records from primary storage. [2025-10-27T19:21:20.072673] [INFO ] [MAIN ] IHD: Loaded 7446 existing records. [2025-10-27T19:21:20.245882] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:20.246119] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-27T19:21:20.246166] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-27T19:21:20.246330] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-27T19:21:20.246389] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-27T19:21:20.313277] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T19:21:20.421358] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-27T19:21:20.604456] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:21.214949] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-27T19:21:21.504763] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:21:21.598585] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T19:21:22.014955] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-27T19:21:22.470017] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T19:21:22.814941] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-27T19:21:23.380576] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T19:21:23.614982] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-27T19:21:24.414911] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-27T19:21:24.448068] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:21:25.022719] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:21:25.023812] [INFO ] [REMOTE ] IH: Full fetch complete (5059 records). [2025-10-27T19:21:25.023881] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-27T19:21:25.223538] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-27T19:21:25.388253] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-27T19:21:25.388322] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-27T19:21:25.388472] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-27T19:21:25.388510] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-27T19:21:25.388883] [DEBUG] [LOCAL ] IH: Trimmed 5059 records to 2674 (keeping 200 days of data) [2025-10-27T19:21:25.403329] [DEBUG] [LOCAL ] IH: Primary data saved (2674 records). [2025-10-27T19:21:25.403399] [INFO ] [MAIN ] IH: Full history saved. [2025-10-27T19:21:25.403469] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IH took 23.3s. Estimated remaining: 2h 43m 32s. Rate: 7.8 symbols/min [2025-10-27T19:21:25.569697] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:25.594363] [DEBUG] [LOCAL ] IHG: Loaded 24297 existing records from primary storage. [2025-10-27T19:21:25.594607] [INFO ] [MAIN ] IHG: Loaded 24297 existing records. [2025-10-27T19:21:25.769826] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:25.770035] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-27T19:21:25.770082] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-27T19:21:25.770277] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-27T19:21:25.770333] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-27T19:21:25.945428] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:21:26.019105] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-27T19:21:26.145360] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:26.814951] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-27T19:21:27.438461] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:21:27.614946] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-27T19:21:27.815984] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:21:28.349683] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:21:28.414924] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-27T19:21:29.214915] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-27T19:21:29.470359] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T19:21:29.907574] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T19:21:30.014937] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-27T19:21:30.724090] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T19:21:30.814913] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-27T19:21:31.392315] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:21:31.614963] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-27T19:21:32.092140] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:21:32.414950] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-27T19:21:33.074053] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T19:21:33.214955] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-27T19:21:34.014956] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-27T19:21:34.158341] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:21:34.619271] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:21:34.814968] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-27T19:21:35.614962] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-27T19:21:35.708212] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:21:36.414924] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-27T19:21:36.804410] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T19:21:37.001690] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:21:37.214934] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-27T19:21:37.749241] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:21:37.750941] [INFO ] [REMOTE ] IGI: Full fetch complete (5575 records). [2025-10-27T19:21:37.751009] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-27T19:21:38.020102] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-27T19:21:38.101329] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-27T19:21:38.101396] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-27T19:21:38.101570] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-27T19:21:38.101610] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-27T19:21:38.101992] [DEBUG] [LOCAL ] IGI: Trimmed 5575 records to 4108 (keeping 200 days of data) [2025-10-27T19:21:38.126638] [DEBUG] [LOCAL ] IGI: Primary data saved (4108 records). [2025-10-27T19:21:38.126827] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-27T19:21:38.126912] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IGI took 41.1s. Estimated remaining: 2h 43m 30s. Rate: 7.8 symbols/min [2025-10-27T19:21:38.295636] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:38.329402] [DEBUG] [LOCAL ] IHS: Loaded 37672 existing records from primary storage. [2025-10-27T19:21:38.329686] [INFO ] [MAIN ] IHS: Loaded 37672 existing records. [2025-10-27T19:21:38.503039] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:38.503263] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-27T19:21:38.503313] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-27T19:21:38.503479] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-27T19:21:38.503515] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-27T19:21:38.687907] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T19:21:38.824198] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-27T19:21:38.868058] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:39.614946] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-27T19:21:39.987027] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:21:40.311575] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T19:21:40.414968] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-27T19:21:41.214985] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-27T19:21:41.493391] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T19:21:42.014921] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-27T19:21:42.381414] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:21:42.814961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-27T19:21:42.872312] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:21:42.878121] [INFO ] [REMOTE ] IGR: Full fetch complete (44547 records). [2025-10-27T19:21:42.878212] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-27T19:21:43.252561] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-27T19:21:43.252685] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-27T19:21:43.253473] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-27T19:21:43.253534] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-27T19:21:43.254457] [DEBUG] [LOCAL ] IGR: Trimmed 44547 records to 30163 (keeping 200 days of data) [2025-10-27T19:21:43.421711] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:21:43.425104] [INFO ] [REMOTE ] IHD: Full fetch complete (11668 records). [2025-10-27T19:21:43.425741] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-27T19:21:43.621974] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-27T19:21:43.657432] [DEBUG] [LOCAL ] IGR: Primary data saved (30163 records). [2025-10-27T19:21:43.690068] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-27T19:21:43.719689] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IGR took 46.6s. Estimated remaining: 2h 43m 20s. Rate: 7.8 symbols/min [2025-10-27T19:21:43.949709] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-27T19:21:43.956535] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-27T19:21:43.958156] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-27T19:21:43.958233] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-27T19:21:43.975925] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:43.976207] [DEBUG] [LOCAL ] IHD: Trimmed 11668 records to 7348 (keeping 200 days of data) [2025-10-27T19:21:44.019917] [DEBUG] [LOCAL ] IIF: Loaded 5325 existing records from primary storage. [2025-10-27T19:21:44.022597] [INFO ] [MAIN ] IIF: Loaded 5325 existing records. [2025-10-27T19:21:44.024140] [DEBUG] [LOCAL ] IHD: Primary data saved (7348 records). [2025-10-27T19:21:44.055473] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-27T19:21:44.087447] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IHD took 24.2s. Estimated remaining: 2h 43m 4s. Rate: 7.8 symbols/min [2025-10-27T19:21:44.362712] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:44.380710] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-27T19:21:44.380569] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:21:44.381066] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-27T19:21:44.381234] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-27T19:21:44.381279] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-27T19:21:44.424412] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-27T19:21:44.611768] [DEBUG] [LOCAL ] IIIN: Loaded 16519 existing records from primary storage. [2025-10-27T19:21:44.651052] [INFO ] [MAIN ] IIIN: Loaded 16519 existing records. [2025-10-27T19:21:44.868213] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:44.950495] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:21:44.950747] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-27T19:21:44.950835] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-27T19:21:44.957667] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-27T19:21:44.957773] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-27T19:21:45.046008] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:21:45.220115] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-27T19:21:45.335085] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:21:45.643872] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:21:45.736492] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T19:21:46.014933] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-27T19:21:46.752101] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:21:46.814917] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-27T19:21:47.377088] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:21:47.614934] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-27T19:21:48.414966] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-27T19:21:48.775341] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:21:49.214971] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-27T19:21:49.432716] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:21:50.014943] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-27T19:21:50.521706] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:21:50.796196] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T19:21:50.814900] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-27T19:21:51.436759] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T19:21:51.615001] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-27T19:21:52.199755] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T19:21:52.414997] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-27T19:21:53.214980] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-27T19:21:53.422259] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:21:53.928498] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T19:21:54.014923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-27T19:21:54.576975] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T19:21:54.814971] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-27T19:21:55.470855] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:21:55.614966] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-27T19:21:56.414963] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-27T19:21:57.046882] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T19:21:57.214961] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-27T19:21:57.259755] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T19:21:58.014954] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-27T19:21:58.284571] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:21:58.814944] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-27T19:21:59.523996] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T19:21:59.561438] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:21:59.614923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-27T19:22:00.025118] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-27T19:22:00.414952] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-27T19:22:01.214943] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-27T19:22:01.645977] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:22:01.946198] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:22:02.014989] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-27T19:22:02.820110] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-27T19:22:02.828055] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:22:02.832990] [INFO ] [REMOTE ] IHG: Full fetch complete (34513 records). [2025-10-27T19:22:02.833069] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-27T19:22:03.200104] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-27T19:22:03.200174] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-27T19:22:03.200822] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-27T19:22:03.200885] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-27T19:22:03.201613] [DEBUG] [LOCAL ] IHG: Trimmed 34513 records to 23569 (keeping 200 days of data) [2025-10-27T19:22:03.342477] [DEBUG] [LOCAL ] IHG: Primary data saved (23569 records). [2025-10-27T19:22:03.342601] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-27T19:22:03.342698] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHG took 37.9s. Estimated remaining: 2h 43m 10s. Rate: 7.8 symbols/min [2025-10-27T19:22:03.443089] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T19:22:03.517494] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:03.534507] [DEBUG] [LOCAL ] IIM: Loaded 15662 existing records from primary storage. [2025-10-27T19:22:03.534742] [INFO ] [MAIN ] IIM: Loaded 15662 existing records. [2025-10-27T19:22:03.620250] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-27T19:22:03.711579] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:03.711799] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-27T19:22:03.711847] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-27T19:22:03.712040] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-27T19:22:03.712110] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-27T19:22:04.060540] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:04.117232] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T19:22:04.118391] [INFO ] [REMOTE ] IIF: Full fetch complete (8761 records). [2025-10-27T19:22:04.118461] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-27T19:22:04.420168] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-27T19:22:04.474218] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-27T19:22:04.474293] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-27T19:22:04.474505] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-27T19:22:04.474542] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-27T19:22:04.474957] [DEBUG] [LOCAL ] IIF: Trimmed 8761 records to 5028 (keeping 200 days of data) [2025-10-27T19:22:04.503613] [DEBUG] [LOCAL ] IIF: Primary data saved (5028 records). [2025-10-27T19:22:04.503734] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-27T19:22:04.503815] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IIF took 20.8s. Estimated remaining: 2h 42m 54s. Rate: 7.8 symbols/min [2025-10-27T19:22:04.675696] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:04.707572] [DEBUG] [LOCAL ] IIPR: Loaded 29218 existing records from primary storage. [2025-10-27T19:22:04.707930] [INFO ] [MAIN ] IIPR: Loaded 29218 existing records. [2025-10-27T19:22:04.895127] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:04.895321] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-27T19:22:04.895368] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-27T19:22:04.895541] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-27T19:22:04.895581] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-27T19:22:05.223022] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-27T19:22:05.264415] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:05.552683] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:22:06.015019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-27T19:22:06.733508] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:22:06.808586] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:22:06.815053] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-27T19:22:07.614917] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-27T19:22:07.824841] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:22:08.414986] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-27T19:22:08.602234] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T19:22:08.956545] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T19:22:09.214905] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-27T19:22:10.014921] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-27T19:22:10.109037] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:22:10.626846] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T19:22:10.814928] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-27T19:22:11.615002] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-27T19:22:12.172007] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:22:12.414913] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-27T19:22:12.492438] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T19:22:13.214974] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-27T19:22:13.547258] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:22:14.015002] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-27T19:22:14.673116] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:22:14.815009] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-27T19:22:15.058898] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T19:22:15.062497] [INFO ] [REMOTE ] IIIN: Full fetch complete (24980 records). [2025-10-27T19:22:15.062576] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-27T19:22:15.429800] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-27T19:22:15.429870] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-27T19:22:15.430383] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-27T19:22:15.430420] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-27T19:22:15.431056] [DEBUG] [LOCAL ] IIIN: Trimmed 24980 records to 16087 (keeping 200 days of data) [2025-10-27T19:22:15.526053] [DEBUG] [LOCAL ] IIIN: Primary data saved (16087 records). [2025-10-27T19:22:15.526176] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-27T19:22:15.526250] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIIN took 31.4s. Estimated remaining: 2h 42m 50s. Rate: 7.8 symbols/min [2025-10-27T19:22:15.622735] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-27T19:22:15.698984] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:15.738235] [DEBUG] [LOCAL ] IMAX: Loaded 44157 existing records from primary storage. [2025-10-27T19:22:15.738568] [INFO ] [MAIN ] IMAX: Loaded 44157 existing records. [2025-10-27T19:22:15.915738] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:15.915981] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-27T19:22:15.916093] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-27T19:22:15.916415] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-27T19:22:15.916472] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-27T19:22:16.297375] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:16.299514] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:22:16.414901] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-27T19:22:16.539506] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:22:17.214999] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-27T19:22:17.562882] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:22:18.014944] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-27T19:22:18.199222] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:22:18.810750] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T19:22:18.817588] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-27T19:22:19.614941] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-27T19:22:19.723031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:22:20.414945] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-27T19:22:20.536063] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T19:22:21.214949] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-27T19:22:21.346334] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T19:22:22.014927] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-27T19:22:22.163992] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T19:22:22.814905] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-27T19:22:23.176467] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:22:23.614984] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-27T19:22:24.112098] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:22:24.118408] [INFO ] [REMOTE ] IHS: Full fetch complete (51579 records). [2025-10-27T19:22:24.118542] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-27T19:22:24.431018] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-27T19:22:24.420632] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:22:24.567009] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-27T19:22:24.567087] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-27T19:22:24.567819] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-27T19:22:24.567879] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-27T19:22:24.569022] [DEBUG] [LOCAL ] IHS: Trimmed 51579 records to 36888 (keeping 200 days of data) [2025-10-27T19:22:24.773898] [DEBUG] [LOCAL ] IHS: Primary data saved (36888 records). [2025-10-27T19:22:24.774031] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-27T19:22:24.774109] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IHS took 46.6s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-10-27T19:22:24.941360] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:24.984458] [DEBUG] [LOCAL ] INFA: Loaded 49194 existing records from primary storage. [2025-10-27T19:22:24.984975] [INFO ] [MAIN ] INFA: Loaded 49194 existing records. [2025-10-27T19:22:25.161200] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:25.161390] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-27T19:22:25.161454] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-27T19:22:25.161716] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-27T19:22:25.161775] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-27T19:22:25.224169] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-27T19:22:25.524415] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:25.779680] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:22:26.014963] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-27T19:22:26.319433] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:22:26.322931] [INFO ] [REMOTE ] IIM: Full fetch complete (24722 records). [2025-10-27T19:22:26.323024] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-27T19:22:26.702174] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-27T19:22:26.702267] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-27T19:22:26.702850] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-27T19:22:26.702911] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-27T19:22:26.703599] [DEBUG] [LOCAL ] IIM: Trimmed 24722 records to 15363 (keeping 200 days of data) [2025-10-27T19:22:26.799726] [DEBUG] [LOCAL ] IIM: Primary data saved (15363 records). [2025-10-27T19:22:26.799852] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-27T19:22:26.799927] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IIM took 23.5s. Estimated remaining: 2h 42m 30s. Rate: 7.8 symbols/min [2025-10-27T19:22:26.820725] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-27T19:22:26.973835] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:27.026061] [DEBUG] [LOCAL ] INFY: Loaded 54376 existing records from primary storage. [2025-10-27T19:22:27.026484] [INFO ] [MAIN ] INFY: Loaded 54376 existing records. [2025-10-27T19:22:27.208856] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:27.209146] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-27T19:22:27.209219] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-27T19:22:27.209434] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-27T19:22:27.209499] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-27T19:22:27.333195] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T19:22:27.607254] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:27.614897] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-27T19:22:28.336038] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:22:28.414957] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-27T19:22:29.155377] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T19:22:29.214967] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-27T19:22:29.778847] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:22:30.014974] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-27T19:22:30.496094] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:22:30.814993] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-27T19:22:31.607899] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:22:31.617191] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-27T19:22:32.028425] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:22:32.415008] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-27T19:22:32.753151] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:22:33.214941] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-27T19:22:34.014917] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-27T19:22:34.187092] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:22:34.341493] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:22:34.815014] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-27T19:22:35.363568] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:22:35.369351] [INFO ] [REMOTE ] IIPR: Full fetch complete (43550 records). [2025-10-27T19:22:35.369442] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-27T19:22:35.620191] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-27T19:22:35.746074] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-27T19:22:35.746153] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-27T19:22:35.746903] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-27T19:22:35.746966] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-27T19:22:35.747928] [DEBUG] [LOCAL ] IIPR: Trimmed 43550 records to 28414 (keeping 200 days of data) [2025-10-27T19:22:35.921997] [DEBUG] [LOCAL ] IIPR: Primary data saved (28414 records). [2025-10-27T19:22:35.922145] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-27T19:22:35.922244] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. IIPR took 31.4s. Estimated remaining: 2h 42m 24s. Rate: 7.8 symbols/min [2025-10-27T19:22:36.090972] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:36.137541] [DEBUG] [LOCAL ] ING: Loaded 51407 existing records from primary storage. [2025-10-27T19:22:36.137900] [INFO ] [MAIN ] ING: Loaded 51407 existing records. [2025-10-27T19:22:36.317896] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:36.318171] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-27T19:22:36.318247] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-27T19:22:36.318470] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-27T19:22:36.318596] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-27T19:22:36.424711] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-27T19:22:36.504035] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T19:22:36.788123] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:37.000591] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:22:37.214944] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-27T19:22:37.875399] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T19:22:38.015001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-27T19:22:38.814958] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-27T19:22:39.128414] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:22:39.510549] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T19:22:39.614980] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-27T19:22:40.407162] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:22:40.417636] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-27T19:22:41.118103] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:22:41.214911] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-27T19:22:42.020029] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-27T19:22:42.035198] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:22:42.577508] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:22:42.814958] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-27T19:22:43.262941] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:22:43.614943] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-27T19:22:44.319832] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:22:44.414973] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-27T19:22:45.214910] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-27T19:22:45.325024] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:22:45.891344] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:22:46.014989] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-27T19:22:46.788841] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T19:22:46.814928] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-27T19:22:47.614916] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-27T19:22:47.771165] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T19:22:48.414952] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-27T19:22:48.528418] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:22:49.130903] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:22:49.214945] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-27T19:22:50.014980] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-27T19:22:50.282071] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:22:50.815009] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-27T19:22:51.113230] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T19:22:51.122088] [INFO ] [REMOTE ] IMAX: Full fetch complete (61306 records). [2025-10-27T19:22:51.122224] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-27T19:22:51.507972] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-27T19:22:51.508047] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-27T19:22:51.508906] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-27T19:22:51.508969] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-27T19:22:51.510394] [DEBUG] [LOCAL ] IMAX: Trimmed 61306 records to 43361 (keeping 200 days of data) [2025-10-27T19:22:51.621413] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-27T19:22:51.753972] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T19:22:51.805487] [DEBUG] [LOCAL ] IMAX: Primary data saved (43361 records). [2025-10-27T19:22:51.805604] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-27T19:22:51.805700] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. IMAX took 36.3s. Estimated remaining: 2h 42m 25s. Rate: 7.8 symbols/min [2025-10-27T19:22:51.980114] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:52.008304] [DEBUG] [LOCAL ] INGM: Loaded 28491 existing records from primary storage. [2025-10-27T19:22:52.008557] [INFO ] [MAIN ] INGM: Loaded 28491 existing records. [2025-10-27T19:22:52.194590] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:52.194821] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-27T19:22:52.194875] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-27T19:22:52.195043] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-27T19:22:52.195085] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-27T19:22:52.420946] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-27T19:22:52.563901] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:52.716491] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T19:22:53.214967] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-27T19:22:53.437618] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:22:53.673591] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:22:54.015000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-27T19:22:54.791127] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:22:54.801761] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-27T19:22:54.801918] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-27T19:22:54.823427] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-27T19:22:55.208496] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-27T19:22:55.215612] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-27T19:22:55.216636] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-27T19:22:55.216758] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-27T19:22:55.231174] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:22:55.239385] [INFO ] [REMOTE ] INFA: Full fetch complete (70665 records). [2025-10-27T19:22:55.239532] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-27T19:22:55.239621] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53595 (keeping 200 days of data) [2025-10-27T19:22:55.620880] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-27T19:22:55.886540] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-27T19:22:55.921193] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-27T19:22:55.922245] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-27T19:22:55.922472] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-27T19:22:55.954721] [DEBUG] [LOCAL ] INFA: Trimmed 70665 records to 48355 (keeping 200 days of data) [2025-10-27T19:22:56.059065] [DEBUG] [LOCAL ] INFY: Primary data saved (53595 records). [2025-10-27T19:22:56.064372] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-27T19:22:56.068731] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. INFY took 29.3s. Estimated remaining: 2h 42m 14s. Rate: 7.8 symbols/min [2025-10-27T19:22:56.338497] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:22:56.366799] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:56.423328] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-27T19:22:56.445311] [DEBUG] [LOCAL ] INGR: Loaded 34234 existing records from primary storage. [2025-10-27T19:22:56.460959] [INFO ] [MAIN ] INGR: Loaded 34234 existing records. [2025-10-27T19:22:56.579990] [DEBUG] [LOCAL ] INFA: Primary data saved (48355 records). [2025-10-27T19:22:56.580571] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-27T19:22:56.580696] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. INFA took 31.8s. Estimated remaining: 2h 41m 58s. Rate: 7.8 symbols/min [2025-10-27T19:22:56.758619] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:56.764602] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-27T19:22:56.769805] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-27T19:22:56.785390] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-27T19:22:56.805891] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-27T19:22:56.910616] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:22:57.225783] [DEBUG] [LOCAL ] INN: Loaded 41981 existing records from primary storage. [2025-10-27T19:22:57.224251] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:57.226509] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-27T19:22:57.226217] [INFO ] [MAIN ] INN: Loaded 41981 existing records. [2025-10-27T19:22:57.432980] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:22:57.436205] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-27T19:22:57.437745] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T19:22:57.437866] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-27T19:22:57.447792] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-27T19:22:57.447977] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-27T19:22:57.561137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:22:57.828562] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:22:58.014984] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-27T19:22:58.635973] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:22:58.815025] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-27T19:22:58.963116] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T19:22:59.614922] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-27T19:23:00.415010] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-27T19:23:01.214996] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-27T19:23:05.810219] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (7.00 seconds). [2025-10-27T19:23:05.818253] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-27T19:23:05.969516] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (5.55 seconds). [2025-10-27T19:23:05.977034] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-27T19:23:06.034407] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (6.42 seconds). [2025-10-27T19:23:06.045967] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-27T19:23:06.449140] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (5.23 seconds). [2025-10-27T19:23:06.457733] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-27T19:23:07.645890] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:23:07.654124] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-27T19:23:08.992183] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-10-27T19:23:09.002794] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-27T19:23:09.165571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-10-27T19:23:09.173638] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-27T19:23:09.398290] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-27T19:23:09.405201] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-27T19:23:09.640075] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T19:23:09.649382] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-27T19:23:10.316192] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:23:10.326855] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-27T19:23:10.757120] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:23:10.763464] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-27T19:23:10.823343] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:23:10.830540] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-27T19:23:11.023187] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:23:11.614918] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-27T19:23:11.681598] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:23:11.691915] [INFO ] [REMOTE ] ING: Full fetch complete (73774 records). [2025-10-27T19:23:11.692063] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-27T19:23:11.746582] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:23:12.120133] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-27T19:23:12.120221] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-27T19:23:12.121169] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-27T19:23:12.121249] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-27T19:23:12.140614] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T19:23:12.147776] [DEBUG] [LOCAL ] ING: Trimmed 73774 records to 50616 (keeping 200 days of data) [2025-10-27T19:23:12.427685] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-27T19:23:12.446933] [DEBUG] [LOCAL ] ING: Primary data saved (50616 records). [2025-10-27T19:23:12.447130] [INFO ] [MAIN ] ING: Full history saved. [2025-10-27T19:23:12.447213] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. ING took 36.5s. Estimated remaining: 2h 41m 59s. Rate: 7.8 symbols/min [2025-10-27T19:23:12.620961] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:12.621077] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-27T19:23:12.621113] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-27T19:23:12.621218] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-27T19:23:12.621259] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-27T19:23:12.621300] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-27T19:23:12.621331] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-27T19:23:12.981725] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:13.008185] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T19:23:13.214918] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-27T19:23:13.558051] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T19:23:13.600456] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T19:23:14.014944] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-27T19:23:14.814978] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-27T19:23:15.312118] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:23:15.614907] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-27T19:23:16.289337] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:23:16.414955] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-27T19:23:17.214947] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-27T19:23:17.796435] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-27T19:23:17.870475] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:23:18.014953] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-27T19:23:18.759326] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:23:18.814917] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-27T19:23:19.087587] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T19:23:19.614988] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-27T19:23:20.393008] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T19:23:20.414908] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-27T19:23:20.687565] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T19:23:21.214940] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-27T19:23:22.014926] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-27T19:23:22.370530] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T19:23:22.378139] [INFO ] [REMOTE ] INGR: Full fetch complete (50874 records). [2025-10-27T19:23:22.378244] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-27T19:23:22.772679] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:23:22.798091] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-27T19:23:22.798263] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-27T19:23:22.799087] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-27T19:23:22.799169] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-27T19:23:22.800431] [DEBUG] [LOCAL ] INGR: Trimmed 50874 records to 33584 (keeping 200 days of data) [2025-10-27T19:23:22.853870] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-27T19:23:23.007488] [DEBUG] [LOCAL ] INGR: Primary data saved (33584 records). [2025-10-27T19:23:23.007699] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-27T19:23:23.007790] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INGR took 26.9s. Estimated remaining: 2h 41m 55s. Rate: 7.8 symbols/min [2025-10-27T19:23:23.178528] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:23:23.195883] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:23.239764] [DEBUG] [LOCAL ] INSP: Loaded 39188 existing records from primary storage. [2025-10-27T19:23:23.240070] [INFO ] [MAIN ] INSP: Loaded 39188 existing records. [2025-10-27T19:23:23.418789] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:23.419018] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-27T19:23:23.419092] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-27T19:23:23.419303] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-27T19:23:23.419367] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-27T19:23:23.620317] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-27T19:23:23.783639] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:23.943282] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:23:24.414910] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-27T19:23:24.458442] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:23:25.064230] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:23:25.214971] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-27T19:23:26.014997] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-27T19:23:26.613553] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T19:23:26.619428] [INFO ] [REMOTE ] INGM: Full fetch complete (41701 records). [2025-10-27T19:23:26.619596] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-27T19:23:26.820079] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-27T19:23:27.010169] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-27T19:23:27.010245] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-27T19:23:27.011159] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-27T19:23:27.011220] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-27T19:23:27.012253] [DEBUG] [LOCAL ] INGM: Trimmed 41701 records to 27728 (keeping 200 days of data) [2025-10-27T19:23:27.176501] [DEBUG] [LOCAL ] INGM: Primary data saved (27728 records). [2025-10-27T19:23:27.176634] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-27T19:23:27.176955] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INGM took 35.4s. Estimated remaining: 2h 41m 43s. Rate: 7.8 symbols/min [2025-10-27T19:23:27.347575] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:27.383592] [DEBUG] [LOCAL ] INSW: Loaded 39745 existing records from primary storage. [2025-10-27T19:23:27.383900] [INFO ] [MAIN ] INSW: Loaded 39745 existing records. [2025-10-27T19:23:27.565345] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:27.565627] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-27T19:23:27.565962] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-27T19:23:27.566365] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-27T19:23:27.566490] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-27T19:23:27.631688] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-27T19:23:27.706382] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T19:23:27.977543] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:28.381119] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T19:23:28.414969] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-27T19:23:28.522678] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:23:29.214978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-27T19:23:29.804464] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:23:30.014993] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-27T19:23:30.743087] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T19:23:30.814948] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-27T19:23:31.136718] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:23:31.147942] [INFO ] [REMOTE ] INN: Full fetch complete (57656 records). [2025-10-27T19:23:31.148078] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-27T19:23:31.526438] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-27T19:23:31.526527] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-27T19:23:31.527472] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-27T19:23:31.527536] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-27T19:23:31.528678] [DEBUG] [LOCAL ] INN: Trimmed 57656 records to 41159 (keeping 200 days of data) [2025-10-27T19:23:31.617542] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-27T19:23:31.768494] [DEBUG] [LOCAL ] INN: Primary data saved (41159 records). [2025-10-27T19:23:31.768705] [INFO ] [MAIN ] INN: Full history saved. [2025-10-27T19:23:31.768846] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INN took 35.2s. Estimated remaining: 2h 41m 32s. Rate: 7.8 symbols/min [2025-10-27T19:23:31.956087] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:31.953932] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T19:23:32.009370] [DEBUG] [LOCAL ] INVH: Loaded 53967 existing records from primary storage. [2025-10-27T19:23:32.009694] [INFO ] [MAIN ] INVH: Loaded 53967 existing records. [2025-10-27T19:23:32.181933] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:32.182122] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-27T19:23:32.182169] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-27T19:23:32.182470] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-27T19:23:32.182507] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-27T19:23:32.420069] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-27T19:23:32.555366] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:32.911624] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:23:33.215005] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-27T19:23:33.444693] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T19:23:34.014957] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-27T19:23:34.814980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-27T19:23:34.962604] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T19:23:35.621499] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-27T19:23:35.624081] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T19:23:36.141164] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:23:36.414986] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-27T19:23:36.711957] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T19:23:37.214946] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-27T19:23:37.774245] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T19:23:37.779713] [INFO ] [REMOTE ] INR: Full fetch complete (37858 records). [2025-10-27T19:23:37.779794] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-27T19:23:37.963467] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-27T19:23:37.964044] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:23:37.964135] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:23:37.964225] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-27T19:23:37.964311] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-27T19:23:37.964362] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-27T19:23:37.964407] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-27T19:23:37.964464] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INR took 25.5s. Estimated remaining: 2h 41m 22s. Rate: 7.8 symbols/min [2025-10-27T19:23:38.025006] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-27T19:23:38.141249] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:38.162777] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:23:38.193626] [DEBUG] [LOCAL ] INVX: Loaded 29473 existing records from primary storage. [2025-10-27T19:23:38.193918] [INFO ] [MAIN ] INVX: Loaded 29473 existing records. [2025-10-27T19:23:38.369970] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:38.370146] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-27T19:23:38.370191] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-27T19:23:38.370363] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-27T19:23:38.370401] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-27T19:23:38.721167] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:38.814962] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-27T19:23:39.262753] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:23:39.614969] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-27T19:23:40.234911] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T19:23:40.415039] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-27T19:23:41.220035] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-27T19:23:41.231625] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:23:41.448711] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T19:23:42.014990] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-27T19:23:42.625114] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:23:42.814916] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-27T19:23:43.204853] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:23:43.614959] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-27T19:23:44.008858] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:23:44.414959] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-27T19:23:44.694445] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:23:45.214999] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-27T19:23:45.985965] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:23:46.014899] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-27T19:23:46.692553] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:23:46.814913] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-27T19:23:47.461454] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:23:47.614912] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-27T19:23:48.201878] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:23:48.414912] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-27T19:23:48.975124] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T19:23:49.215010] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-27T19:23:49.802238] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T19:23:50.014991] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-27T19:23:50.185360] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T19:23:50.814939] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-27T19:23:51.374835] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:23:51.615036] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-27T19:23:52.371184] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:23:52.414921] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-27T19:23:52.711167] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:23:52.718065] [INFO ] [REMOTE ] INSW: Full fetch complete (59153 records). [2025-10-27T19:23:52.718174] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-27T19:23:53.110345] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-27T19:23:53.110464] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-27T19:23:53.111557] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-27T19:23:53.111631] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-27T19:23:53.113230] [DEBUG] [LOCAL ] INSW: Trimmed 59153 records to 38828 (keeping 200 days of data) [2025-10-27T19:23:53.226213] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-27T19:23:53.385826] [DEBUG] [LOCAL ] INSW: Primary data saved (38828 records). [2025-10-27T19:23:53.386028] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-27T19:23:53.386969] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INSW took 26.2s. Estimated remaining: 2h 41m 23s. Rate: 7.8 symbols/min [2025-10-27T19:23:53.566072] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:23:53.602959] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:23:53.658349] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-27T19:23:53.658698] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-10-27T19:23:53.830002] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:23:53.830178] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-27T19:23:53.830224] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-27T19:23:53.830418] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-27T19:23:53.830455] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-27T19:23:54.022475] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-27T19:23:54.189954] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:23:54.206507] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T19:23:54.814942] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-27T19:23:55.426923] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:23:55.614982] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-27T19:23:55.963160] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:23:56.414955] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-27T19:23:57.093992] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:23:57.214922] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-27T19:23:57.607561] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T19:23:58.014930] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-27T19:23:58.804496] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:23:58.815215] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-27T19:23:58.936726] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:23:59.614981] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-27T19:24:00.415029] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-27T19:24:01.121854] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:24:01.214956] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-27T19:24:01.423832] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-27T19:24:02.015016] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-27T19:24:02.814985] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-27T19:24:02.928864] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-27T19:24:02.937442] [INFO ] [REMOTE ] INSP: Full fetch complete (53937 records). [2025-10-27T19:24:02.937707] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-27T19:24:03.363931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T19:24:03.387971] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-27T19:24:03.388683] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-27T19:24:03.390291] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-27T19:24:03.390420] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-27T19:24:03.392244] [DEBUG] [LOCAL ] INSP: Trimmed 53937 records to 38599 (keeping 200 days of data) [2025-10-27T19:24:03.615683] [DEBUG] [LOCAL ] INSP: Primary data saved (38599 records). [2025-10-27T19:24:03.615767] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-27T19:24:03.616760] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-27T19:24:03.617259] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INSP took 40.6s. Estimated remaining: 2h 41m 18s. Rate: 7.7 symbols/min [2025-10-27T19:24:03.786494] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:03.837005] [DEBUG] [LOCAL ] IOT: Loaded 54232 existing records from primary storage. [2025-10-27T19:24:03.837299] [INFO ] [MAIN ] IOT: Loaded 54232 existing records. [2025-10-27T19:24:04.015941] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:04.016092] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-27T19:24:04.016138] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-27T19:24:04.016311] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-27T19:24:04.016349] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-27T19:24:04.375318] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:04.417216] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-27T19:24:04.419808] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-27T19:24:04.477905] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:04.485891] [INFO ] [REMOTE ] INVX: Full fetch complete (42610 records). [2025-10-27T19:24:04.486037] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-27T19:24:04.863067] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-27T19:24:04.863141] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-27T19:24:04.863912] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-27T19:24:04.863982] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-27T19:24:04.864972] [DEBUG] [LOCAL ] INVX: Trimmed 42610 records to 28642 (keeping 200 days of data) [2025-10-27T19:24:05.026184] [DEBUG] [LOCAL ] INVX: Primary data saved (28642 records). [2025-10-27T19:24:05.026308] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-27T19:24:05.026391] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. INVX took 27.1s. Estimated remaining: 2h 41m 3s. Rate: 7.8 symbols/min [2025-10-27T19:24:05.214922] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-27T19:24:05.274116] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:05.284188] [INFO ] [REMOTE ] INVH: Full fetch complete (76990 records). [2025-10-27T19:24:05.284311] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-27T19:24:05.668022] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-27T19:24:05.668103] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-27T19:24:05.669162] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-27T19:24:05.669227] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-27T19:24:05.670762] [DEBUG] [LOCAL ] INVH: Trimmed 76990 records to 53185 (keeping 200 days of data) [2025-10-27T19:24:05.980589] [DEBUG] [LOCAL ] INVH: Primary data saved (53185 records). [2025-10-27T19:24:05.980743] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-27T19:24:05.980841] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. INVH took 34.2s. Estimated remaining: 2h 40m 48s. Rate: 7.8 symbols/min [2025-10-27T19:24:06.366159] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:24:06.376561] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-27T19:24:07.651697] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-27T19:24:07.662913] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-27T19:24:08.023448] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:24:08.033543] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-27T19:24:09.422600] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:24:09.433597] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-27T19:24:09.973812] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-27T19:24:09.986817] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-27T19:24:10.811512] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T19:24:10.822639] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-27T19:24:12.595213] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-27T19:24:12.607081] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-27T19:24:12.641123] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:24:12.653127] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-27T19:24:14.423092] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T19:24:14.434080] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-27T19:24:14.993945] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-27T19:24:15.009608] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-27T19:24:16.396733] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T19:24:16.408236] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-27T19:24:17.405156] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-27T19:24:17.416883] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-27T19:24:17.940711] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:24:17.952075] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-27T19:24:19.625409] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T19:24:19.643181] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-27T19:24:19.876809] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T19:24:19.887928] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-27T19:24:22.027158] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T19:24:22.037364] [INFO ] [REMOTE ] IOT: Full fetch complete (77519 records). [2025-10-27T19:24:22.037493] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-27T19:24:22.455325] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-27T19:24:22.467727] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-27T19:24:22.468874] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-27T19:24:22.469220] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-27T19:24:22.471871] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-27T19:24:22.484030] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-27T19:24:22.485393] [DEBUG] [LOCAL ] IOT: Trimmed 77519 records to 53443 (keeping 200 days of data) [2025-10-27T19:24:22.792375] [DEBUG] [LOCAL ] IOT: Primary data saved (53443 records). [2025-10-27T19:24:22.792753] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-27T19:24:22.792852] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IOT took 19.2s. Estimated remaining: 2h 40m 50s. Rate: 7.8 symbols/min [2025-10-27T19:24:25.307534] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-27T19:24:25.317714] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-27T19:24:25.317843] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-27T19:24:25.723758] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-27T19:24:25.723845] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-27T19:24:25.725538] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-27T19:24:25.725606] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-27T19:24:25.727216] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-27T19:24:26.071495] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-27T19:24:26.071629] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-27T19:24:26.072347] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IONQ took 32.7s. Estimated remaining: 2h 40m 38s. Rate: 7.8 symbols/min [2025-10-27T19:24:26.688565] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.798617] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.808919] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.791612] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:26.825277] [DEBUG] [LOCAL ] IQI: Loaded 17915 existing records from primary storage. [2025-10-27T19:24:26.825684] [INFO ] [MAIN ] IQI: Loaded 17915 existing records. [2025-10-27T19:24:26.952616] [DEBUG] [LOCAL ] IPI: Loaded 21710 existing records from primary storage. [2025-10-27T19:24:26.959388] [INFO ] [MAIN ] IPI: Loaded 21710 existing records. [2025-10-27T19:24:27.204530] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.234897] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.259697] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-27T19:24:27.260561] [DEBUG] [LOCAL ] IPG: Loaded 54110 existing records from primary storage. [2025-10-27T19:24:27.261355] [INFO ] [MAIN ] IPG: Loaded 54110 existing records. [2025-10-27T19:24:27.262606] [DEBUG] [LOCAL ] IP: Loaded 54078 existing records from primary storage. [2025-10-27T19:24:27.278472] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-27T19:24:27.278684] [INFO ] [MAIN ] IP: Loaded 54078 existing records. [2025-10-27T19:24:27.294948] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-27T19:24:27.551910] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.607738] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.636069] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-27T19:24:27.678414] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-27T19:24:27.687350] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-27T19:24:27.810260] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.964864] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:27.935443] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-27T19:24:27.997980] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-27T19:24:28.013470] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-27T19:24:28.047093] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-27T19:24:28.047243] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-27T19:24:28.041628] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-27T19:24:28.104218] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-27T19:24:28.130161] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-27T19:24:28.790445] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:28.840104] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-27T19:24:29.081603] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.097822] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-27T19:24:29.242156] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.256870] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-27T19:24:29.278894] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:29.279225] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-27T19:24:29.719409] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:24:29.723928] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-27T19:24:29.792462] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:24:29.796714] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-27T19:24:30.426069] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:24:30.430188] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-27T19:24:30.691051] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:24:30.701426] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-27T19:24:30.758679] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:24:30.763926] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-27T19:24:31.014892] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:24:31.025547] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-27T19:24:31.319844] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:24:31.323800] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-27T19:24:31.525248] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:24:31.530492] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-27T19:24:31.970722] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:24:31.980822] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-27T19:24:32.342473] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T19:24:32.348061] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-27T19:24:32.430719] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T19:24:32.442974] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-27T19:24:32.637452] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:24:32.642875] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-27T19:24:33.262316] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:24:33.266107] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-27T19:24:33.370634] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:24:33.381627] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-27T19:24:33.488299] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T19:24:33.493973] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-27T19:24:33.901524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T19:24:34.014967] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-27T19:24:34.375597] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T19:24:34.606604] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T19:24:34.683453] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T19:24:34.749571] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:24:34.814954] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-27T19:24:35.614921] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-27T19:24:35.863945] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T19:24:36.414974] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-27T19:24:37.214947] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-27T19:24:37.433544] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:24:37.738677] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:24:37.873142] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:24:38.014968] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-27T19:24:38.815029] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-27T19:24:39.614932] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-27T19:24:39.802876] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:24:39.827896] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T19:24:40.414934] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-27T19:24:41.121090] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:24:41.214905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-27T19:24:41.420123] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:24:42.014978] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-27T19:24:42.562573] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:24:42.755168] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T19:24:42.758517] [INFO ] [REMOTE ] IQI: Full fetch complete (26176 records). [2025-10-27T19:24:42.758592] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-27T19:24:42.820110] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-27T19:24:43.143020] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-27T19:24:43.143093] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-27T19:24:43.143749] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-27T19:24:43.143812] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-27T19:24:43.144474] [DEBUG] [LOCAL ] IQI: Trimmed 26176 records to 17496 (keeping 200 days of data) [2025-10-27T19:24:43.252466] [DEBUG] [LOCAL ] IQI: Primary data saved (17496 records). [2025-10-27T19:24:43.252584] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-27T19:24:43.252701] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 17.2s. Estimated remaining: 2h 40m 40s. Rate: 7.7 symbols/min [2025-10-27T19:24:43.439059] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:43.491027] [DEBUG] [LOCAL ] IQV: Loaded 50707 existing records from primary storage. [2025-10-27T19:24:43.491348] [INFO ] [MAIN ] IQV: Loaded 50707 existing records. [2025-10-27T19:24:43.629183] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-27T19:24:43.669509] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:43.669734] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-27T19:24:43.669788] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-27T19:24:43.669970] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-27T19:24:43.670011] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-27T19:24:44.055573] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:44.414982] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-27T19:24:44.542748] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:24:44.844468] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T19:24:45.214934] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-27T19:24:46.014980] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-27T19:24:46.123740] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:24:46.562534] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:24:46.567270] [INFO ] [REMOTE ] IPI: Full fetch complete (30410 records). [2025-10-27T19:24:46.567350] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-27T19:24:46.820176] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-27T19:24:46.930021] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-27T19:24:46.930093] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-27T19:24:46.930693] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-27T19:24:46.930753] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-27T19:24:46.931443] [DEBUG] [LOCAL ] IPI: Trimmed 30410 records to 21303 (keeping 200 days of data) [2025-10-27T19:24:47.051852] [DEBUG] [LOCAL ] IPI: Primary data saved (21303 records). [2025-10-27T19:24:47.051991] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-27T19:24:47.052083] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 21.0s. Estimated remaining: 2h 40m 28s. Rate: 7.8 symbols/min [2025-10-27T19:24:47.217540] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:47.266580] [DEBUG] [LOCAL ] IR: Loaded 53502 existing records from primary storage. [2025-10-27T19:24:47.266965] [INFO ] [MAIN ] IR: Loaded 53502 existing records. [2025-10-27T19:24:47.444155] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:47.444367] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-27T19:24:47.444437] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-27T19:24:47.444685] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-27T19:24:47.444751] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-27T19:24:47.616855] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-27T19:24:47.765762] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:24:47.862025] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:48.414912] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-27T19:24:48.689489] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:24:49.214954] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-27T19:24:49.250231] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:24:50.014988] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-27T19:24:50.096128] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:24:50.814967] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-27T19:24:50.985303] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:24:51.361212] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T19:24:51.614938] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-27T19:24:52.414929] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-27T19:24:52.461460] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:24:53.214922] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-27T19:24:53.404820] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:24:54.014986] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-27T19:24:54.451673] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:24:54.462359] [INFO ] [REMOTE ] IPG: Full fetch complete (77443 records). [2025-10-27T19:24:54.462501] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-27T19:24:54.816298] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-27T19:24:54.856724] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-27T19:24:54.856814] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-27T19:24:54.857837] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-27T19:24:54.857944] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-27T19:24:54.859688] [DEBUG] [LOCAL ] IPG: Trimmed 77443 records to 53328 (keeping 200 days of data) [2025-10-27T19:24:55.076171] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:24:55.236470] [DEBUG] [LOCAL ] IPG: Primary data saved (53328 records). [2025-10-27T19:24:55.236596] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-27T19:24:55.237192] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IPG took 29.2s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-10-27T19:24:55.409329] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:55.456767] [DEBUG] [LOCAL ] IRM: Loaded 49536 existing records from primary storage. [2025-10-27T19:24:55.457062] [INFO ] [MAIN ] IRM: Loaded 49536 existing records. [2025-10-27T19:24:55.622903] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-27T19:24:55.664904] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:55.667763] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T19:24:55.678565] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-27T19:24:55.678946] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-27T19:24:55.679592] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-27T19:24:55.679693] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-27T19:24:56.024938] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:56.414922] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-27T19:24:56.557232] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T19:24:57.214958] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-27T19:24:57.284871] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T19:24:57.295280] [INFO ] [REMOTE ] IP: Full fetch complete (77423 records). [2025-10-27T19:24:57.295447] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-27T19:24:57.687113] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-27T19:24:57.687192] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-27T19:24:57.688189] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-27T19:24:57.688253] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-27T19:24:57.689618] [DEBUG] [LOCAL ] IP: Trimmed 77423 records to 53297 (keeping 200 days of data) [2025-10-27T19:24:58.017370] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-27T19:24:58.019320] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:24:58.049150] [DEBUG] [LOCAL ] IP: Primary data saved (53297 records). [2025-10-27T19:24:58.049766] [INFO ] [MAIN ] IP: Full history saved. [2025-10-27T19:24:58.049871] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IP took 32.0s. Estimated remaining: 2h 40m 8s. Rate: 7.8 symbols/min [2025-10-27T19:24:58.223690] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:24:58.250145] [DEBUG] [LOCAL ] IRS: Loaded 23670 existing records from primary storage. [2025-10-27T19:24:58.250406] [INFO ] [MAIN ] IRS: Loaded 23670 existing records. [2025-10-27T19:24:58.436031] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:24:58.436236] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-27T19:24:58.436284] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-27T19:24:58.436465] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-27T19:24:58.436523] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-27T19:24:58.799623] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:24:58.814930] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-27T19:24:58.872517] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:24:59.489444] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:24:59.614920] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-27T19:24:59.689121] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:25:00.414945] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-27T19:25:01.214985] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-27T19:25:01.521013] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:25:02.015023] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-27T19:25:02.365821] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:25:02.814978] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-27T19:25:03.463491] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T19:25:03.580149] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-27T19:25:03.614928] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-27T19:25:03.662932] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T19:25:04.414943] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-27T19:25:05.063259] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:25:05.214953] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-27T19:25:05.947006] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:25:06.014902] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-27T19:25:06.767470] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T19:25:06.814944] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-27T19:25:07.268786] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:25:07.614962] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-27T19:25:08.414971] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-27T19:25:08.733034] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T19:25:08.763431] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:25:09.214951] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-27T19:25:09.834538] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:25:09.849453] [INFO ] [REMOTE ] IQV: Full fetch complete (72667 records). [2025-10-27T19:25:09.849604] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-27T19:25:10.014916] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-27T19:25:10.269420] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-27T19:25:10.269512] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-27T19:25:10.270470] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-27T19:25:10.270597] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-27T19:25:10.323208] [DEBUG] [LOCAL ] IQV: Trimmed 72667 records to 49937 (keeping 200 days of data) [2025-10-27T19:25:10.323087] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T19:25:10.623696] [DEBUG] [LOCAL ] IQV: Primary data saved (49937 records). [2025-10-27T19:25:10.623820] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-27T19:25:10.624477] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IQV took 27.4s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-27T19:25:10.794014] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:10.805259] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T19:25:10.814904] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-27T19:25:10.862242] [DEBUG] [LOCAL ] IRT: Loaded 51098 existing records from primary storage. [2025-10-27T19:25:10.862562] [INFO ] [MAIN ] IRT: Loaded 51098 existing records. [2025-10-27T19:25:11.033776] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:11.033983] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-27T19:25:11.034029] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-27T19:25:11.034225] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-27T19:25:11.034263] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-27T19:25:11.378061] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:11.614927] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-27T19:25:11.839768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:25:12.414983] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-27T19:25:12.807456] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T19:25:13.214970] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-27T19:25:13.696844] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:25:13.869561] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:25:14.014951] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-27T19:25:14.814948] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-27T19:25:15.559585] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T19:25:15.614899] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-27T19:25:16.171138] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:25:16.414922] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-27T19:25:16.835380] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:25:17.096388] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T19:25:17.214908] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-27T19:25:18.014944] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-27T19:25:18.815015] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-27T19:25:18.909208] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:25:18.957230] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:25:18.967441] [INFO ] [REMOTE ] IR: Full fetch complete (76477 records). [2025-10-27T19:25:18.967569] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-27T19:25:19.349194] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-27T19:25:19.349270] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-27T19:25:19.350666] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-27T19:25:19.350728] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-27T19:25:19.352093] [DEBUG] [LOCAL ] IR: Trimmed 76477 records to 52720 (keeping 200 days of data) [2025-10-27T19:25:19.618517] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-27T19:25:19.663222] [DEBUG] [LOCAL ] IR: Primary data saved (52720 records). [2025-10-27T19:25:19.663365] [INFO ] [MAIN ] IR: Full history saved. [2025-10-27T19:25:19.663784] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IR took 32.6s. Estimated remaining: 2h 39m 59s. Rate: 7.8 symbols/min [2025-10-27T19:25:19.833028] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:19.850864] [DEBUG] [LOCAL ] ISD: Loaded 15824 existing records from primary storage. [2025-10-27T19:25:19.851106] [INFO ] [MAIN ] ISD: Loaded 15824 existing records. [2025-10-27T19:25:20.032014] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:20.032258] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-27T19:25:20.032325] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-27T19:25:20.032615] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-27T19:25:20.032715] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-27T19:25:20.341119] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:25:20.425836] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-27T19:25:20.432449] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:21.214944] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-27T19:25:21.318894] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:25:21.859284] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:25:21.865490] [INFO ] [REMOTE ] IRS: Full fetch complete (32676 records). [2025-10-27T19:25:21.865590] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-27T19:25:22.015521] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-27T19:25:22.243200] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-27T19:25:22.243277] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-27T19:25:22.243991] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-27T19:25:22.244055] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-27T19:25:22.244782] [DEBUG] [LOCAL ] IRS: Trimmed 32676 records to 23461 (keeping 200 days of data) [2025-10-27T19:25:22.374575] [DEBUG] [LOCAL ] IRS: Primary data saved (23461 records). [2025-10-27T19:25:22.374727] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-27T19:25:22.374811] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. IRS took 24.3s. Estimated remaining: 2h 39m 46s. Rate: 7.8 symbols/min [2025-10-27T19:25:22.540189] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:22.580368] [DEBUG] [LOCAL ] IT: Loaded 42830 existing records from primary storage. [2025-10-27T19:25:22.580679] [INFO ] [MAIN ] IT: Loaded 42830 existing records. [2025-10-27T19:25:22.753378] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:22.753634] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-27T19:25:22.753716] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-27T19:25:22.753896] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-27T19:25:22.753933] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-27T19:25:22.815752] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-27T19:25:23.108242] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:23.167579] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T19:25:23.614928] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-27T19:25:23.801217] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:25:23.848507] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:25:24.414997] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-27T19:25:24.909879] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:25:25.214977] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-27T19:25:25.367367] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:25:26.014982] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-27T19:25:26.507584] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T19:25:26.814916] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-27T19:25:27.006000] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:25:27.614963] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-27T19:25:28.030327] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:25:28.414982] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-27T19:25:29.205116] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:25:29.214941] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-27T19:25:29.604260] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:25:30.014995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-27T19:25:30.758758] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T19:25:30.814971] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-27T19:25:31.285271] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:25:31.433622] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:25:31.614939] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-27T19:25:32.414971] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-27T19:25:33.007302] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T19:25:33.214569] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T19:25:33.224600] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-27T19:25:34.015007] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-27T19:25:34.481199] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:25:34.814947] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-27T19:25:35.268685] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:25:35.614960] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-27T19:25:36.384453] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:25:36.414938] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-27T19:25:36.931002] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T19:25:37.214912] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-27T19:25:37.376342] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:25:38.014941] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-27T19:25:38.256510] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:25:38.814985] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-27T19:25:39.614922] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-27T19:25:39.780064] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T19:25:39.789150] [INFO ] [REMOTE ] IRM: Full fetch complete (71911 records). [2025-10-27T19:25:39.789289] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-27T19:25:40.178618] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-27T19:25:40.178757] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-27T19:25:40.179765] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-27T19:25:40.179830] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-27T19:25:40.181210] [DEBUG] [LOCAL ] IRM: Trimmed 71911 records to 48673 (keeping 200 days of data) [2025-10-27T19:25:40.421673] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-27T19:25:40.482184] [DEBUG] [LOCAL ] IRM: Primary data saved (48673 records). [2025-10-27T19:25:40.482538] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-27T19:25:40.482671] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRM took 45.2s. Estimated remaining: 2h 39m 50s. Rate: 7.7 symbols/min [2025-10-27T19:25:40.661629] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:40.693305] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:25:40.731185] [DEBUG] [LOCAL ] ITGR: Loaded 31720 existing records from primary storage. [2025-10-27T19:25:40.731802] [INFO ] [MAIN ] ITGR: Loaded 31720 existing records. [2025-10-27T19:25:40.917563] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:40.917769] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-27T19:25:40.917821] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-27T19:25:40.918022] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-27T19:25:40.918083] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-27T19:25:41.122403] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:25:41.247348] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-27T19:25:41.249712] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T19:25:41.330507] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:42.014983] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-27T19:25:42.814949] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-27T19:25:42.946826] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:25:42.956402] [INFO ] [REMOTE ] IRT: Full fetch complete (72825 records). [2025-10-27T19:25:42.956537] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-27T19:25:43.359852] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-27T19:25:43.359998] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-27T19:25:43.361112] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-27T19:25:43.361176] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-27T19:25:43.362720] [DEBUG] [LOCAL ] IRT: Trimmed 72825 records to 50309 (keeping 200 days of data) [2025-10-27T19:25:43.603592] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:25:43.616913] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-27T19:25:43.713035] [DEBUG] [LOCAL ] IRT: Primary data saved (50309 records). [2025-10-27T19:25:43.713140] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-27T19:25:43.713916] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. IRT took 33.1s. Estimated remaining: 2h 39m 37s. Rate: 7.7 symbols/min [2025-10-27T19:25:43.821622] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:25:43.892804] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:43.927495] [DEBUG] [LOCAL ] ITT: Loaded 32727 existing records from primary storage. [2025-10-27T19:25:43.927806] [INFO ] [MAIN ] ITT: Loaded 32727 existing records. [2025-10-27T19:25:44.098217] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:44.098430] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-27T19:25:44.098476] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-27T19:25:44.098704] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-27T19:25:44.098760] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-27T19:25:44.420862] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-27T19:25:44.451031] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:44.629685] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:25:45.214922] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-27T19:25:45.353214] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:25:46.014912] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-27T19:25:46.368197] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:25:46.820836] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-27T19:25:46.825166] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:25:46.829384] [INFO ] [REMOTE ] ISD: Full fetch complete (23971 records). [2025-10-27T19:25:46.829482] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-27T19:25:47.211213] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-27T19:25:47.211286] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-27T19:25:47.211842] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-27T19:25:47.211904] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-27T19:25:47.212527] [DEBUG] [LOCAL ] ISD: Trimmed 23971 records to 15420 (keeping 200 days of data) [2025-10-27T19:25:47.304750] [DEBUG] [LOCAL ] ISD: Primary data saved (15420 records). [2025-10-27T19:25:47.304884] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-27T19:25:47.304961] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. ISD took 27.6s. Estimated remaining: 2h 39m 25s. Rate: 7.8 symbols/min [2025-10-27T19:25:47.469983] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:47.519571] [DEBUG] [LOCAL ] ITUB: Loaded 54090 existing records from primary storage. [2025-10-27T19:25:47.519898] [INFO ] [MAIN ] ITUB: Loaded 54090 existing records. [2025-10-27T19:25:47.618357] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-27T19:25:47.698845] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:47.699046] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-27T19:25:47.699093] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-27T19:25:47.699272] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-27T19:25:47.699310] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-27T19:25:48.058513] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:48.219176] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:25:48.414932] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-27T19:25:48.783505] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:25:49.214947] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-27T19:25:49.351211] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T19:25:50.014955] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-27T19:25:50.814934] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-27T19:25:50.903615] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:25:51.614949] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-27T19:25:51.717198] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T19:25:51.884306] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:25:51.893067] [INFO ] [REMOTE ] IT: Full fetch complete (58143 records). [2025-10-27T19:25:51.893202] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-27T19:25:52.262274] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-27T19:25:52.262348] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-27T19:25:52.263167] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-27T19:25:52.263227] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-27T19:25:52.264319] [DEBUG] [LOCAL ] IT: Trimmed 58143 records to 42087 (keeping 200 days of data) [2025-10-27T19:25:52.426859] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-27T19:25:52.511825] [DEBUG] [LOCAL ] IT: Primary data saved (42087 records). [2025-10-27T19:25:52.511948] [INFO ] [MAIN ] IT: Full history saved. [2025-10-27T19:25:52.512025] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. IT took 30.1s. Estimated remaining: 2h 39m 14s. Rate: 7.8 symbols/min [2025-10-27T19:25:52.686762] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:25:52.711287] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:25:52.753215] [DEBUG] [LOCAL ] ITW: Loaded 46349 existing records from primary storage. [2025-10-27T19:25:52.753464] [INFO ] [MAIN ] ITW: Loaded 46349 existing records. [2025-10-27T19:25:52.924748] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:25:52.924927] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-27T19:25:52.924971] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-27T19:25:52.925138] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-27T19:25:52.925175] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-27T19:25:53.220132] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-27T19:25:53.270144] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:25:53.610931] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T19:25:54.014945] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-27T19:25:54.814918] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-27T19:25:54.843452] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:25:55.396971] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:25:55.614971] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-27T19:25:55.985551] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T19:25:56.415010] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-27T19:25:56.841246] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T19:25:57.214997] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-27T19:25:57.647893] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:25:58.014939] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-27T19:25:58.763432] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:25:58.814910] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-27T19:25:59.087351] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T19:25:59.614956] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-27T19:26:00.374597] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:26:00.414982] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-27T19:26:00.960635] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:26:01.214982] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-27T19:26:02.015056] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-27T19:26:02.228014] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T19:26:02.798037] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T19:26:02.814889] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-27T19:26:03.246047] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:26:03.614946] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-27T19:26:04.417690] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-27T19:26:04.432973] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:26:05.215214] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:26:05.215327] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-27T19:26:05.499630] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:26:06.014900] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-27T19:26:06.059428] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T19:26:06.814939] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-27T19:26:07.195266] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:26:07.614915] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-27T19:26:07.678167] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T19:26:08.414943] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-27T19:26:09.218258] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-27T19:26:09.223847] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T19:26:09.511742] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:26:10.014946] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-27T19:26:10.199274] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:26:10.205399] [INFO ] [REMOTE ] ITT: Full fetch complete (47571 records). [2025-10-27T19:26:10.205488] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-27T19:26:10.577272] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-27T19:26:10.577347] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-27T19:26:10.578086] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-27T19:26:10.578148] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-27T19:26:10.579076] [DEBUG] [LOCAL ] ITT: Trimmed 47571 records to 31974 (keeping 200 days of data) [2025-10-27T19:26:10.804429] [DEBUG] [LOCAL ] ITT: Primary data saved (31974 records). [2025-10-27T19:26:10.804537] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-27T19:26:10.804619] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITT took 27.1s. Estimated remaining: 2h 39m 18s. Rate: 7.7 symbols/min [2025-10-27T19:26:10.820040] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-27T19:26:10.996326] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:11.040075] [DEBUG] [LOCAL ] IVR: Loaded 48532 existing records from primary storage. [2025-10-27T19:26:11.040371] [INFO ] [MAIN ] IVR: Loaded 48532 existing records. [2025-10-27T19:26:11.232310] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:11.232969] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-27T19:26:11.233177] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-27T19:26:11.233454] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-27T19:26:11.233514] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-27T19:26:11.638044] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:11.622181] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-27T19:26:11.633856] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:26:12.375599] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:26:12.414909] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-27T19:26:12.467886] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:26:13.214997] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-27T19:26:13.888572] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:26:14.014923] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-27T19:26:14.815013] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-27T19:26:14.937660] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:26:15.443698] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T19:26:15.614960] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-27T19:26:16.190563] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:26:16.197409] [INFO ] [REMOTE ] ITGR: Full fetch complete (44025 records). [2025-10-27T19:26:16.197559] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-27T19:26:16.422097] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-27T19:26:16.589376] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-27T19:26:16.589464] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-27T19:26:16.590239] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-27T19:26:16.590309] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-27T19:26:16.591440] [DEBUG] [LOCAL ] ITGR: Trimmed 44025 records to 31163 (keeping 200 days of data) [2025-10-27T19:26:16.790627] [DEBUG] [LOCAL ] ITGR: Primary data saved (31163 records). [2025-10-27T19:26:16.790812] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-27T19:26:16.790927] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITGR took 36.3s. Estimated remaining: 2h 39m 8s. Rate: 7.7 symbols/min [2025-10-27T19:26:16.976819] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:17.007943] [DEBUG] [LOCAL ] IVT: Loaded 31798 existing records from primary storage. [2025-10-27T19:26:17.008253] [INFO ] [MAIN ] IVT: Loaded 31798 existing records. [2025-10-27T19:26:17.208950] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:17.209288] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-27T19:26:17.209458] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-27T19:26:17.209736] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-27T19:26:17.209808] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-27T19:26:17.220893] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-27T19:26:17.410554] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:26:17.633348] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:18.014997] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-27T19:26:18.419712] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T19:26:18.435070] [INFO ] [REMOTE ] ITUB: Full fetch complete (77307 records). [2025-10-27T19:26:18.435274] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-27T19:26:18.820026] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-27T19:26:19.073194] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-27T19:26:19.074839] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T19:26:19.075081] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-27T19:26:19.085533] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-27T19:26:19.085859] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-27T19:26:19.087751] [DEBUG] [LOCAL ] ITUB: Trimmed 77307 records to 53305 (keeping 200 days of data) [2025-10-27T19:26:19.434322] [DEBUG] [LOCAL ] ITUB: Primary data saved (53305 records). [2025-10-27T19:26:19.434463] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-27T19:26:19.435033] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. ITUB took 32.1s. Estimated remaining: 2h 38m 55s. Rate: 7.8 symbols/min [2025-10-27T19:26:19.613834] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:19.614922] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-27T19:26:19.666864] [DEBUG] [LOCAL ] IVZ: Loaded 53908 existing records from primary storage. [2025-10-27T19:26:19.667183] [INFO ] [MAIN ] IVZ: Loaded 53908 existing records. [2025-10-27T19:26:19.847850] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:19.848090] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-27T19:26:19.848180] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-27T19:26:19.848590] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-27T19:26:19.864638] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-27T19:26:19.967944] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T19:26:20.200675] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:26:20.296741] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:20.414991] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-27T19:26:20.812861] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:26:21.214930] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-27T19:26:21.605675] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:26:22.014930] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-27T19:26:22.814969] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-27T19:26:23.014848] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T19:26:23.511166] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:26:23.614934] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-27T19:26:24.336940] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:26:24.415005] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-27T19:26:24.463417] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T19:26:25.214998] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-27T19:26:25.712348] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:26:26.014953] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-27T19:26:26.397857] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T19:26:26.814977] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-27T19:26:27.491038] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:26:27.614948] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-27T19:26:28.288840] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:26:28.414957] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-27T19:26:29.130254] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:26:29.214906] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-27T19:26:29.562868] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:26:30.014942] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-27T19:26:30.485042] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:26:30.494055] [INFO ] [REMOTE ] ITW: Full fetch complete (66943 records). [2025-10-27T19:26:30.494180] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-27T19:26:30.827359] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-27T19:26:30.884163] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-27T19:26:30.884249] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-27T19:26:30.885227] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-27T19:26:30.885293] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-27T19:26:30.886767] [DEBUG] [LOCAL ] ITW: Trimmed 66943 records to 45560 (keeping 200 days of data) [2025-10-27T19:26:31.163912] [DEBUG] [LOCAL ] ITW: Primary data saved (45560 records). [2025-10-27T19:26:31.164040] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-27T19:26:31.164128] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. ITW took 38.7s. Estimated remaining: 2h 38m 52s. Rate: 7.7 symbols/min [2025-10-27T19:26:31.333949] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:31.355270] [DEBUG] [LOCAL ] IX: Loaded 22374 existing records from primary storage. [2025-10-27T19:26:31.355520] [INFO ] [MAIN ] IX: Loaded 22374 existing records. [2025-10-27T19:26:31.540638] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:31.540989] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-27T19:26:31.541069] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-27T19:26:31.541318] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-27T19:26:31.541389] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-27T19:26:31.615108] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-27T19:26:31.913434] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:26:31.935071] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:32.414953] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-27T19:26:32.541284] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T19:26:32.698114] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T19:26:33.214991] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-27T19:26:34.014969] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-27T19:26:34.347339] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:26:34.426528] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:26:34.815020] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-27T19:26:34.900636] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:26:35.614995] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-27T19:26:36.185899] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-27T19:26:36.394482] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T19:26:36.414938] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-27T19:26:37.214966] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-27T19:26:38.014927] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-27T19:26:38.336997] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:26:38.347488] [INFO ] [REMOTE ] IVR: Full fetch complete (69033 records). [2025-10-27T19:26:38.347673] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-27T19:26:38.662970] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:26:38.762986] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-27T19:26:38.763064] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-27T19:26:38.764011] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-27T19:26:38.764075] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-27T19:26:38.765386] [DEBUG] [LOCAL ] IVR: Trimmed 69033 records to 47696 (keeping 200 days of data) [2025-10-27T19:26:38.816725] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-27T19:26:39.062337] [DEBUG] [LOCAL ] IVR: Primary data saved (47696 records). [2025-10-27T19:26:39.062481] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-27T19:26:39.063181] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVR took 28.3s. Estimated remaining: 2h 38m 44s. Rate: 7.7 symbols/min [2025-10-27T19:26:39.238001] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:39.282052] [DEBUG] [LOCAL ] J: Loaded 41171 existing records from primary storage. [2025-10-27T19:26:39.282574] [INFO ] [MAIN ] J: Loaded 41171 existing records. [2025-10-27T19:26:39.438998] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:26:39.485393] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T19:26:39.519679] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:39.520393] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-27T19:26:39.520450] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-27T19:26:39.520904] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-27T19:26:39.520968] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-27T19:26:39.620079] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-27T19:26:39.876211] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:40.414938] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-27T19:26:40.722356] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:26:41.214951] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-27T19:26:41.779274] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T19:26:41.786066] [INFO ] [REMOTE ] IVT: Full fetch complete (45581 records). [2025-10-27T19:26:41.786157] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-27T19:26:42.021328] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-27T19:26:42.154459] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-27T19:26:42.154557] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-27T19:26:42.155368] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-27T19:26:42.155421] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-27T19:26:42.156355] [DEBUG] [LOCAL ] IVT: Trimmed 45581 records to 31135 (keeping 200 days of data) [2025-10-27T19:26:42.344593] [DEBUG] [LOCAL ] IVT: Primary data saved (31135 records). [2025-10-27T19:26:42.344783] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-27T19:26:42.344874] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IVT took 25.6s. Estimated remaining: 2h 38m 31s. Rate: 7.8 symbols/min [2025-10-27T19:26:42.476502] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:26:42.534329] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:42.572481] [DEBUG] [LOCAL ] JBGS: Loaded 42157 existing records from primary storage. [2025-10-27T19:26:42.572777] [INFO ] [MAIN ] JBGS: Loaded 42157 existing records. [2025-10-27T19:26:42.744131] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:42.744361] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-27T19:26:42.744407] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-27T19:26:42.744607] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-27T19:26:42.744694] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-27T19:26:42.820135] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-27T19:26:43.093762] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:43.541059] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:26:43.614937] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-27T19:26:43.739347] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T19:26:44.414934] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-27T19:26:45.051616] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:26:45.214931] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-27T19:26:46.014945] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-27T19:26:46.213340] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:26:46.814920] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-27T19:26:46.889801] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:26:47.147013] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:26:47.615002] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-27T19:26:48.291373] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:26:48.414893] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-27T19:26:48.430456] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T19:26:49.214953] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-27T19:26:49.751609] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:26:50.014951] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-27T19:26:50.636339] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:26:50.814980] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-27T19:26:51.612971] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T19:26:51.623114] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-27T19:26:52.027531] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:26:52.414932] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-27T19:26:53.045271] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:26:53.066835] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T19:26:53.214922] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-27T19:26:54.014956] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-27T19:26:54.661091] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:26:54.814968] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-27T19:26:55.109554] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T19:26:55.615005] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-27T19:26:55.807854] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:26:56.414996] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-27T19:26:56.572687] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T19:26:57.214940] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-27T19:26:58.014986] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-27T19:26:58.054466] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T19:26:58.064801] [INFO ] [REMOTE ] IVZ: Full fetch complete (77072 records). [2025-10-27T19:26:58.064918] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-27T19:26:58.464786] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-27T19:26:58.464920] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-27T19:26:58.465918] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-27T19:26:58.466066] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-27T19:26:58.495190] [DEBUG] [LOCAL ] IVZ: Trimmed 77072 records to 53128 (keeping 200 days of data) [2025-10-27T19:26:58.496814] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:26:58.816867] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-27T19:26:58.821101] [DEBUG] [LOCAL ] IVZ: Primary data saved (53128 records). [2025-10-27T19:26:58.822142] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-27T19:26:58.822596] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. IVZ took 39.4s. Estimated remaining: 2h 38m 33s. Rate: 7.7 symbols/min [2025-10-27T19:26:58.994689] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:26:59.036782] [DEBUG] [LOCAL ] JBI: Loaded 43031 existing records from primary storage. [2025-10-27T19:26:59.037206] [INFO ] [MAIN ] JBI: Loaded 43031 existing records. [2025-10-27T19:26:59.175033] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T19:26:59.257411] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:26:59.257704] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-27T19:26:59.257762] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-27T19:26:59.257937] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-27T19:26:59.257974] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-27T19:26:59.601517] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:26:59.614897] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-27T19:27:00.079240] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T19:27:00.414986] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-27T19:27:00.852973] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:27:01.214994] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-27T19:27:01.824929] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T19:27:01.829191] [INFO ] [REMOTE ] IX: Full fetch complete (28978 records). [2025-10-27T19:27:01.829284] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-27T19:27:02.028599] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-27T19:27:02.219782] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-27T19:27:02.219845] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-27T19:27:02.220442] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-27T19:27:02.220479] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-27T19:27:02.221162] [DEBUG] [LOCAL ] IX: Trimmed 28978 records to 21695 (keeping 200 days of data) [2025-10-27T19:27:02.342049] [DEBUG] [LOCAL ] IX: Primary data saved (21695 records). [2025-10-27T19:27:02.342157] [INFO ] [MAIN ] IX: Full history saved. [2025-10-27T19:27:02.342225] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. IX took 31.2s. Estimated remaining: 2h 38m 21s. Rate: 7.7 symbols/min [2025-10-27T19:27:02.507371] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:02.551401] [DEBUG] [LOCAL ] JBL: Loaded 49039 existing records from primary storage. [2025-10-27T19:27:02.551767] [INFO ] [MAIN ] JBL: Loaded 49039 existing records. [2025-10-27T19:27:02.730108] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:02.730387] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-27T19:27:02.730433] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-27T19:27:02.730619] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-27T19:27:02.730694] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-27T19:27:02.820451] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-27T19:27:03.130125] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:03.132786] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T19:27:03.444702] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T19:27:03.614987] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-27T19:27:04.291081] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:27:04.414908] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-27T19:27:05.214915] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-27T19:27:05.275867] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T19:27:05.867840] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:27:06.014942] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-27T19:27:06.191981] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T19:27:06.815016] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-27T19:27:07.175864] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T19:27:07.615002] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-27T19:27:08.255410] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:27:08.414925] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-27T19:27:09.047084] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:27:09.055733] [INFO ] [REMOTE ] J: Full fetch complete (59985 records). [2025-10-27T19:27:09.055863] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-27T19:27:09.224022] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-27T19:27:09.431613] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-27T19:27:09.431737] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-27T19:27:09.432609] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-27T19:27:09.432680] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-27T19:27:09.433852] [DEBUG] [LOCAL ] J: Trimmed 59985 records to 40512 (keeping 200 days of data) [2025-10-27T19:27:09.689284] [DEBUG] [LOCAL ] J: Primary data saved (40512 records). [2025-10-27T19:27:09.689496] [INFO ] [MAIN ] J: Full history saved. [2025-10-27T19:27:09.690514] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. J took 30.6s. Estimated remaining: 2h 38m 13s. Rate: 7.7 symbols/min [2025-10-27T19:27:09.863061] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:09.892396] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:27:09.929765] [DEBUG] [LOCAL ] JBND: Loaded 27871 existing records from primary storage. [2025-10-27T19:27:09.930031] [INFO ] [MAIN ] JBND: Loaded 27871 existing records. [2025-10-27T19:27:10.020132] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-27T19:27:10.110822] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:10.111059] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-27T19:27:10.111135] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-27T19:27:10.111369] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-27T19:27:10.111435] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-27T19:27:10.484893] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:10.508329] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:27:10.814951] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-27T19:27:11.342050] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:27:11.413301] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T19:27:11.614989] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-27T19:27:12.414973] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-27T19:27:12.975665] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:27:13.006170] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T19:27:13.215002] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-27T19:27:14.015000] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-27T19:27:14.277110] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T19:27:14.814960] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-27T19:27:15.565372] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:27:15.618172] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-27T19:27:15.621253] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T19:27:16.414942] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-27T19:27:16.673403] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T19:27:17.214939] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-27T19:27:18.015003] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-27T19:27:18.114013] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:27:18.599544] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T19:27:18.606382] [INFO ] [REMOTE ] JBGS: Full fetch complete (59102 records). [2025-10-27T19:27:18.606476] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-27T19:27:18.823777] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-27T19:27:18.985800] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-27T19:27:18.985889] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-27T19:27:18.986745] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-27T19:27:18.986807] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-27T19:27:18.988046] [DEBUG] [LOCAL ] JBGS: Trimmed 59102 records to 41297 (keeping 200 days of data) [2025-10-27T19:27:19.226628] [DEBUG] [LOCAL ] JBGS: Primary data saved (41297 records). [2025-10-27T19:27:19.226789] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-27T19:27:19.226865] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBGS took 36.9s. Estimated remaining: 2h 38m 7s. Rate: 7.7 symbols/min [2025-10-27T19:27:19.421092] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:19.421313] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-27T19:27:19.421466] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-27T19:27:19.421668] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-27T19:27:19.421857] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-27T19:27:19.421978] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-27T19:27:19.422157] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-27T19:27:19.628758] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-27T19:27:19.706773] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T19:27:19.819315] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:20.238006] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:27:20.325326] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T19:27:20.414903] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-27T19:27:21.214926] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-27T19:27:21.812789] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:27:22.014939] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-27T19:27:22.211179] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:27:22.211495] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-27T19:27:22.211581] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:27:22.211632] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-27T19:27:22.211723] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:27:22.211799] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-27T19:27:22.211862] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-27T19:27:22.211896] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-27T19:27:22.211935] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-27T19:27:22.211981] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBS took 3.0s. Estimated remaining: 2h 37m 54s. Rate: 7.8 symbols/min [2025-10-27T19:27:22.379789] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:22.412922] [DEBUG] [LOCAL ] JBTM: Loaded 33976 existing records from primary storage. [2025-10-27T19:27:22.413190] [INFO ] [MAIN ] JBTM: Loaded 33976 existing records. [2025-10-27T19:27:22.597252] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:22.597689] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-27T19:27:22.597782] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-27T19:27:22.598131] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-27T19:27:22.598271] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-27T19:27:22.820725] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-27T19:27:22.913720] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:27:23.002629] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:23.569875] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:27:23.614893] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-27T19:27:24.414998] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-27T19:27:24.678107] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:27:25.214993] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-27T19:27:25.845322] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:27:26.014984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-27T19:27:26.814921] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-27T19:27:26.859152] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T19:27:26.917996] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:27:27.619797] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-27T19:27:27.625830] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:27:28.415005] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-27T19:27:29.033800] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T19:27:29.046291] [INFO ] [REMOTE ] JBI: Full fetch complete (63242 records). [2025-10-27T19:27:29.046532] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-27T19:27:29.220285] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-27T19:27:29.432485] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-27T19:27:29.432601] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-27T19:27:29.433592] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-27T19:27:29.433683] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-27T19:27:29.435009] [DEBUG] [LOCAL ] JBI: Trimmed 63242 records to 42114 (keeping 200 days of data) [2025-10-27T19:27:29.671041] [DEBUG] [LOCAL ] JBI: Primary data saved (42114 records). [2025-10-27T19:27:29.671269] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-27T19:27:29.671741] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBI took 30.8s. Estimated remaining: 2h 37m 46s. Rate: 7.8 symbols/min [2025-10-27T19:27:29.759562] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T19:27:29.863918] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:29.875302] [DEBUG] [LOCAL ] JCE: Loaded 7308 existing records from primary storage. [2025-10-27T19:27:29.875514] [INFO ] [MAIN ] JCE: Loaded 7308 existing records. [2025-10-27T19:27:30.024617] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-27T19:27:30.054699] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:30.056283] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-27T19:27:30.056394] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-27T19:27:30.056835] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-27T19:27:30.057041] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-27T19:27:30.350546] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T19:27:30.434790] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:30.814960] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-27T19:27:31.312154] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:27:31.476376] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T19:27:31.614954] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-27T19:27:32.414926] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-27T19:27:32.754836] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:27:32.761633] [INFO ] [REMOTE ] JBND: Full fetch complete (36591 records). [2025-10-27T19:27:32.761740] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-27T19:27:33.136199] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-27T19:27:33.136279] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-27T19:27:33.137363] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-27T19:27:33.137470] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-27T19:27:33.138371] [DEBUG] [LOCAL ] JBND: Trimmed 36591 records to 27459 (keeping 200 days of data) [2025-10-27T19:27:33.223745] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-27T19:27:33.305306] [DEBUG] [LOCAL ] JBND: Primary data saved (27459 records). [2025-10-27T19:27:33.305460] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-27T19:27:33.305545] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBND took 23.6s. Estimated remaining: 2h 37m 34s. Rate: 7.8 symbols/min [2025-10-27T19:27:33.479693] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:33.538244] [DEBUG] [LOCAL ] JCI: Loaded 54295 existing records from primary storage. [2025-10-27T19:27:33.538578] [INFO ] [MAIN ] JCI: Loaded 54295 existing records. [2025-10-27T19:27:33.717086] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:33.717342] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-27T19:27:33.717402] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-27T19:27:33.717584] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-27T19:27:33.717623] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-27T19:27:33.834810] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T19:27:34.020114] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-27T19:27:34.094456] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:34.136069] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T19:27:34.814935] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-27T19:27:35.171829] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T19:27:35.458023] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:27:35.614963] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-27T19:27:36.414979] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-27T19:27:36.685196] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:27:37.214943] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-27T19:27:37.974414] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T19:27:38.014899] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-27T19:27:38.726741] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:27:38.814942] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-27T19:27:39.614917] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-27T19:27:39.943165] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:27:39.999206] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T19:27:40.013876] [INFO ] [REMOTE ] JBL: Full fetch complete (70550 records). [2025-10-27T19:27:40.014580] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T19:27:40.014398] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-27T19:27:40.425576] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-27T19:27:40.430037] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-27T19:27:40.430160] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-27T19:27:40.432056] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-27T19:27:40.432235] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-27T19:27:40.433801] [DEBUG] [LOCAL ] JBL: Trimmed 70550 records to 48193 (keeping 200 days of data) [2025-10-27T19:27:40.725537] [DEBUG] [LOCAL ] JBL: Primary data saved (48193 records). [2025-10-27T19:27:40.725703] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-27T19:27:40.725798] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JBL took 38.4s. Estimated remaining: 2h 37m 26s. Rate: 7.8 symbols/min [2025-10-27T19:27:40.906692] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:40.956750] [DEBUG] [LOCAL ] JEF: Loaded 50955 existing records from primary storage. [2025-10-27T19:27:40.957092] [INFO ] [MAIN ] JEF: Loaded 50955 existing records. [2025-10-27T19:27:41.131929] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:41.132142] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-27T19:27:41.132209] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-27T19:27:41.132397] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-27T19:27:41.132435] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-27T19:27:41.222213] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-27T19:27:41.502926] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:41.747384] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T19:27:41.818101] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:27:42.014956] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-27T19:27:42.814931] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-27T19:27:43.267097] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T19:27:43.614993] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-27T19:27:44.274240] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T19:27:44.416478] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-27T19:27:44.420046] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T19:27:45.214960] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-27T19:27:45.590161] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T19:27:45.662922] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T19:27:46.014969] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-27T19:27:46.814976] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-27T19:27:47.472259] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:27:47.512239] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:27:47.614928] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-27T19:27:48.414919] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-27T19:27:48.497221] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:27:49.021049] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T19:27:49.214945] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-27T19:27:50.014966] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-27T19:27:50.501835] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:27:50.814940] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-27T19:27:51.335998] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T19:27:51.575556] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:27:51.614917] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-27T19:27:52.414933] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-27T19:27:52.599868] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T19:27:52.602197] [INFO ] [REMOTE ] JCE: Full fetch complete (9603 records). [2025-10-27T19:27:52.602267] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-27T19:27:52.950717] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-27T19:27:52.950799] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-27T19:27:52.951021] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-27T19:27:52.951060] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-27T19:27:52.951465] [DEBUG] [LOCAL ] JCE: Trimmed 9603 records to 7116 (keeping 200 days of data) [2025-10-27T19:27:52.992898] [DEBUG] [LOCAL ] JCE: Primary data saved (7116 records). [2025-10-27T19:27:52.993021] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-27T19:27:52.993098] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 23.3s. Estimated remaining: 2h 37m 23s. Rate: 7.8 symbols/min [2025-10-27T19:27:53.156600] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:27:53.197939] [DEBUG] [LOCAL ] JELD: Loaded 46422 existing records from primary storage. [2025-10-27T19:27:53.198222] [INFO ] [MAIN ] JELD: Loaded 46422 existing records. [2025-10-27T19:27:53.220083] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-27T19:27:53.382256] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:27:53.382473] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-27T19:27:53.382540] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-27T19:27:53.382766] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-27T19:27:53.382822] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-27T19:27:53.776416] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:27:54.025207] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-27T19:27:54.031277] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:27:54.550567] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T19:27:54.814965] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-27T19:27:55.410129] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:27:55.614968] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-27T19:27:56.085895] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T19:27:56.414968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-27T19:27:57.200460] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T19:27:57.214895] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-27T19:27:57.706559] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:27:58.014968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-27T19:27:58.310272] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T19:27:58.814972] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-27T19:27:59.614953] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-27T19:27:59.953941] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T19:28:00.183165] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:28:00.414944] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-27T19:28:00.769002] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T19:28:01.214946] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-27T19:28:02.015019] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-27T19:28:02.815000] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-27T19:28:03.251045] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T19:28:03.614925] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-27T19:28:04.056305] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T19:28:04.414988] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-27T19:28:04.758052] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:28:04.765447] [INFO ] [REMOTE ] JBTM: Full fetch complete (46946 records). [2025-10-27T19:28:04.765540] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-27T19:28:05.145940] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-27T19:28:05.146036] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-27T19:28:05.146800] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-27T19:28:05.146880] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-27T19:28:05.173973] [DEBUG] [LOCAL ] JBTM: Trimmed 46946 records to 33232 (keeping 200 days of data) [2025-10-27T19:28:05.175881] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (4.76 seconds). [2025-10-27T19:28:05.186834] [INFO ] [REMOTE ] JCI: Full fetch complete (77658 records). [2025-10-27T19:28:05.186941] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-27T19:28:05.796367] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-27T19:28:05.813677] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-27T19:28:05.814749] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-27T19:28:05.821774] [DEBUG] [LOCAL ] JBTM: Primary data saved (33232 records). [2025-10-27T19:28:05.816339] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-27T19:28:05.821900] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-27T19:28:05.822517] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JBTM took 43.6s. Estimated remaining: 2h 37m 20s. Rate: 7.7 symbols/min [2025-10-27T19:28:05.891118] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T19:28:05.956760] [DEBUG] [LOCAL ] JCI: Trimmed 77658 records to 53513 (keeping 200 days of data) [2025-10-27T19:28:05.998129] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-27T19:28:06.107518] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:06.168798] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (4.95 seconds). [2025-10-27T19:28:06.195155] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-27T19:28:06.213092] [DEBUG] [LOCAL ] JFR: Loaded 31608 existing records from primary storage. [2025-10-27T19:28:06.214434] [INFO ] [MAIN ] JFR: Loaded 31608 existing records. [2025-10-27T19:28:06.540238] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:06.546558] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-27T19:28:06.546616] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-27T19:28:06.579914] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-27T19:28:06.580008] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-27T19:28:06.729920] [DEBUG] [LOCAL ] JCI: Primary data saved (53513 records). [2025-10-27T19:28:06.735757] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-27T19:28:06.741812] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JCI took 33.4s. Estimated remaining: 2h 37m 5s. Rate: 7.8 symbols/min [2025-10-27T19:28:07.100838] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:07.163363] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:07.163774] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-27T19:28:07.178086] [DEBUG] [LOCAL ] JGH: Loaded 12716 existing records from primary storage. [2025-10-27T19:28:07.178316] [INFO ] [MAIN ] JGH: Loaded 12716 existing records. [2025-10-27T19:28:07.362821] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:07.363420] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-27T19:28:07.363476] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-27T19:28:07.363625] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-27T19:28:07.363701] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-27T19:28:07.743111] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:07.743727] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-27T19:28:07.778915] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:28:07.812730] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T19:28:08.289439] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:28:08.319309] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:28:08.414942] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-27T19:28:09.214936] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-27T19:28:09.818459] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:28:10.014922] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-27T19:28:10.052072] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:28:10.814966] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-27T19:28:11.425703] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:28:11.614899] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-27T19:28:12.342887] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:28:12.414986] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-27T19:28:13.214944] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-27T19:28:13.803180] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T19:28:13.813333] [INFO ] [REMOTE ] JEF: Full fetch complete (73315 records). [2025-10-27T19:28:13.813458] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-27T19:28:14.062480] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-27T19:28:14.091526] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:28:14.255549] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-27T19:28:14.255706] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-27T19:28:14.256884] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-27T19:28:14.256962] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-27T19:28:14.258345] [DEBUG] [LOCAL ] JEF: Trimmed 73315 records to 50159 (keeping 200 days of data) [2025-10-27T19:28:14.591820] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T19:28:14.606121] [DEBUG] [LOCAL ] JEF: Primary data saved (50159 records). [2025-10-27T19:28:14.606582] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-27T19:28:14.606699] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JEF took 33.9s. Estimated remaining: 2h 36m 58s. Rate: 7.8 symbols/min [2025-10-27T19:28:14.773782] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:14.814905] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-27T19:28:14.816844] [DEBUG] [LOCAL ] JHG: Loaded 48186 existing records from primary storage. [2025-10-27T19:28:14.817099] [INFO ] [MAIN ] JHG: Loaded 48186 existing records. [2025-10-27T19:28:14.959530] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T19:28:15.000448] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:15.000604] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-27T19:28:15.000676] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-27T19:28:15.000870] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-27T19:28:15.000908] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-27T19:28:15.360076] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:15.614961] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-27T19:28:15.954486] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:28:16.413887] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T19:28:16.418195] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-27T19:28:17.199685] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:28:17.214909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-27T19:28:18.015539] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T19:28:18.014904] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-27T19:28:18.751461] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T19:28:18.814932] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-27T19:28:19.614954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-27T19:28:20.283590] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:28:20.414959] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-27T19:28:21.214909] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-27T19:28:21.258934] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:28:22.014938] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-27T19:28:22.048892] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:28:22.125586] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T19:28:22.814968] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-27T19:28:23.614943] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-27T19:28:23.687684] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T19:28:23.696321] [INFO ] [REMOTE ] JELD: Full fetch complete (64532 records). [2025-10-27T19:28:23.696424] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-27T19:28:24.126144] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-27T19:28:24.139347] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-27T19:28:24.152181] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T19:28:24.151685] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-27T19:28:24.155236] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-27T19:28:24.156096] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:28:24.164664] [DEBUG] [LOCAL ] JELD: Trimmed 64532 records to 45579 (keeping 200 days of data) [2025-10-27T19:28:24.407088] [DEBUG] [LOCAL ] JELD: Primary data saved (45579 records). [2025-10-27T19:28:24.407210] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-27T19:28:24.407666] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JELD took 31.4s. Estimated remaining: 2h 36m 52s. Rate: 7.8 symbols/min [2025-10-27T19:28:24.420019] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-27T19:28:24.577840] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:24.585020] [DEBUG] [LOCAL ] JHI: Loaded 4189 existing records from primary storage. [2025-10-27T19:28:24.585222] [INFO ] [MAIN ] JHI: Loaded 4189 existing records. [2025-10-27T19:28:24.757247] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:24.757460] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-27T19:28:24.757514] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-27T19:28:24.757674] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-27T19:28:24.757729] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-27T19:28:25.103330] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:25.214936] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-27T19:28:25.835564] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T19:28:26.014918] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-27T19:28:26.082574] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:28:26.406696] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-27T19:28:26.814919] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-27T19:28:27.615018] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-27T19:28:28.132462] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T19:28:28.414983] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-27T19:28:28.547889] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T19:28:29.214985] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-27T19:28:29.835800] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:28:30.014998] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-27T19:28:30.470009] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T19:28:30.610120] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T19:28:30.814968] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-27T19:28:31.194363] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T19:28:31.614935] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-27T19:28:32.414934] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-27T19:28:32.677382] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:28:33.214950] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-27T19:28:33.873494] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T19:28:33.880796] [INFO ] [REMOTE ] JFR: Full fetch complete (48647 records). [2025-10-27T19:28:33.880915] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-27T19:28:34.027906] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-27T19:28:34.027836] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:28:34.271202] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-27T19:28:34.271281] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-27T19:28:34.272027] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-27T19:28:34.272090] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-27T19:28:34.273159] [DEBUG] [LOCAL ] JFR: Trimmed 48647 records to 30827 (keeping 200 days of data) [2025-10-27T19:28:34.449389] [DEBUG] [LOCAL ] JFR: Primary data saved (30827 records). [2025-10-27T19:28:34.449534] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-27T19:28:34.449614] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JFR took 28.6s. Estimated remaining: 2h 36m 47s. Rate: 7.7 symbols/min [2025-10-27T19:28:34.551081] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:28:34.619045] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:34.624474] [DEBUG] [LOCAL ] JHS: Loaded 3045 existing records from primary storage. [2025-10-27T19:28:34.624672] [INFO ] [MAIN ] JHS: Loaded 3045 existing records. [2025-10-27T19:28:34.795746] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:34.795943] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-27T19:28:34.795987] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-27T19:28:34.796115] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-27T19:28:34.796151] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-27T19:28:34.820106] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-27T19:28:35.173484] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:35.430420] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:28:35.614920] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-27T19:28:36.414933] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-27T19:28:37.008815] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:28:37.098462] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T19:28:37.214905] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-27T19:28:38.015004] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-27T19:28:38.763664] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:28:38.814916] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-27T19:28:38.885507] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T19:28:39.614983] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-27T19:28:39.932677] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T19:28:40.406605] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:28:40.415714] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-27T19:28:40.835482] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T19:28:41.214950] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-27T19:28:42.014931] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-27T19:28:42.788468] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T19:28:42.810252] [INFO ] [REMOTE ] JHG: Full fetch complete (68742 records). [2025-10-27T19:28:42.811050] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-27T19:28:42.811495] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T19:28:42.816252] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-27T19:28:42.839124] [INFO ] [REMOTE ] JGH: Full fetch complete (16433 records). [2025-10-27T19:28:42.854605] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-27T19:28:43.560336] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-27T19:28:43.565666] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-27T19:28:43.556459] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:28:43.571972] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-27T19:28:43.596524] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-27T19:28:43.618683] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-27T19:28:43.647053] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-27T19:28:43.647940] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-27T19:28:43.648388] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-27T19:28:43.648545] [DEBUG] [LOCAL ] JHG: Trimmed 68742 records to 47426 (keeping 200 days of data) [2025-10-27T19:28:43.648687] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-27T19:28:43.650339] [DEBUG] [LOCAL ] JGH: Trimmed 16433 records to 12378 (keeping 200 days of data) [2025-10-27T19:28:43.904768] [DEBUG] [LOCAL ] JGH: Primary data saved (12378 records). [2025-10-27T19:28:43.913864] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-27T19:28:43.913980] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JGH took 37.2s. Estimated remaining: 2h 36m 41s. Rate: 7.7 symbols/min [2025-10-27T19:28:44.191291] [DEBUG] [LOCAL ] JHG: Primary data saved (47426 records). [2025-10-27T19:28:44.195888] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:44.196102] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-27T19:28:44.196231] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHG took 29.6s. Estimated remaining: 2h 36m 25s. Rate: 7.8 symbols/min [2025-10-27T19:28:44.367738] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:44.397965] [DEBUG] [LOCAL ] JILL: Loaded 15415 existing records from primary storage. [2025-10-27T19:28:44.412690] [INFO ] [MAIN ] JILL: Loaded 15415 existing records. [2025-10-27T19:28:44.443883] [DEBUG] [LOCAL ] JHX: Loaded 53967 existing records from primary storage. [2025-10-27T19:28:44.442685] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-27T19:28:44.475066] [INFO ] [MAIN ] JHX: Loaded 53967 existing records. [2025-10-27T19:28:44.660271] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T19:28:44.705310] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:44.716301] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-27T19:28:44.726582] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-27T19:28:44.763523] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-27T19:28:44.779082] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-27T19:28:44.809885] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:44.835348] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-27T19:28:44.848617] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-27T19:28:44.863400] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-27T19:28:44.863561] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-27T19:28:44.894836] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T19:28:45.226719] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-27T19:28:45.498828] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:45.518907] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:45.770487] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:28:46.015008] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-27T19:28:46.360748] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T19:28:46.814940] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-27T19:28:47.612189] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T19:28:47.615437] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-27T19:28:48.397627] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:28:48.414906] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-27T19:28:49.214919] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-27T19:28:49.430483] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T19:28:49.768990] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T19:28:50.014972] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-27T19:28:50.420801] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-27T19:28:50.814969] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-27T19:28:51.440540] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:28:51.614940] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-27T19:28:52.407162] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:28:52.414889] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-27T19:28:53.215015] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-27T19:28:53.334550] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T19:28:53.871579] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:28:54.014971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-27T19:28:54.482629] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:28:54.815002] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-27T19:28:55.614951] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-27T19:28:55.661481] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:28:55.664062] [INFO ] [REMOTE ] JHI: Full fetch complete (5803 records). [2025-10-27T19:28:55.664152] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-27T19:28:56.040769] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-27T19:28:56.040858] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-27T19:28:56.041054] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-27T19:28:56.041095] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-27T19:28:56.041473] [DEBUG] [LOCAL ] JHI: Trimmed 5803 records to 4048 (keeping 200 days of data) [2025-10-27T19:28:56.065406] [DEBUG] [LOCAL ] JHI: Primary data saved (4048 records). [2025-10-27T19:28:56.065490] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-27T19:28:56.065565] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHI took 31.7s. Estimated remaining: 2h 36m 22s. Rate: 7.8 symbols/min [2025-10-27T19:28:56.238279] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:28:56.277535] [DEBUG] [LOCAL ] JKS: Loaded 39701 existing records from primary storage. [2025-10-27T19:28:56.277863] [INFO ] [MAIN ] JKS: Loaded 39701 existing records. [2025-10-27T19:28:56.423838] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-27T19:28:56.460315] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:28:56.460535] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-27T19:28:56.460602] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-27T19:28:56.460802] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-27T19:28:56.460855] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-27T19:28:56.699466] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T19:28:56.840141] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:28:57.214955] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-27T19:28:57.887569] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T19:28:58.014913] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-27T19:28:58.792970] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:28:58.814915] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-27T19:28:59.614972] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-27T19:28:59.657362] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:29:00.004233] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T19:29:00.345568] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:29:00.414914] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-27T19:29:01.214951] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-27T19:29:01.870392] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T19:29:01.871596] [INFO ] [REMOTE ] JHS: Full fetch complete (4591 records). [2025-10-27T19:29:01.871690] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-27T19:29:02.019827] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-27T19:29:02.266049] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:29:02.294262] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-27T19:29:02.294611] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-27T19:29:02.295017] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-27T19:29:02.295077] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-27T19:29:02.295420] [DEBUG] [LOCAL ] JHS: Trimmed 4591 records to 2985 (keeping 200 days of data) [2025-10-27T19:29:02.312593] [DEBUG] [LOCAL ] JHS: Primary data saved (2985 records). [2025-10-27T19:29:02.312678] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-27T19:29:02.312760] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHS took 27.9s. Estimated remaining: 2h 36m 13s. Rate: 7.8 symbols/min [2025-10-27T19:29:02.476536] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:02.509714] [DEBUG] [LOCAL ] JLL: Loaded 31885 existing records from primary storage. [2025-10-27T19:29:02.509974] [INFO ] [MAIN ] JLL: Loaded 31885 existing records. [2025-10-27T19:29:02.680993] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:02.681187] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-27T19:29:02.681232] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-27T19:29:02.681399] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-27T19:29:02.681445] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-27T19:29:02.820077] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-27T19:29:03.033589] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:03.210518] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:29:03.614952] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-27T19:29:04.188099] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:29:04.414923] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-27T19:29:04.649992] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:29:05.214962] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-27T19:29:05.819544] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T19:29:06.014918] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-27T19:29:06.460582] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T19:29:06.814950] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-27T19:29:07.614937] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-27T19:29:07.788028] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T19:29:07.868361] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T19:29:08.414990] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-27T19:29:08.514337] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T19:29:09.215001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-27T19:29:09.336050] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:29:10.014966] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-27T19:29:10.234239] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:29:10.814949] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-27T19:29:11.584563] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:29:11.614919] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-27T19:29:11.850261] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:29:12.414934] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-27T19:29:13.066821] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:29:13.214939] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-27T19:29:13.487082] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:29:13.497038] [INFO ] [REMOTE ] JHX: Full fetch complete (63448 records). [2025-10-27T19:29:13.497159] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-27T19:29:13.899620] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T19:29:13.899360] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-27T19:29:13.902406] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-27T19:29:13.903371] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-27T19:29:13.903530] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-27T19:29:13.903833] [INFO ] [REMOTE ] JILL: Full fetch complete (22328 records). [2025-10-27T19:29:13.904192] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-27T19:29:13.994724] [DEBUG] [LOCAL ] JHX: Trimmed 63448 records to 53186 (keeping 200 days of data) [2025-10-27T19:29:14.020030] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-27T19:29:14.483797] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-27T19:29:14.491992] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-27T19:29:14.493866] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-27T19:29:14.493950] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-27T19:29:14.508726] [DEBUG] [LOCAL ] JILL: Trimmed 22328 records to 15011 (keeping 200 days of data) [2025-10-27T19:29:14.679270] [DEBUG] [LOCAL ] JHX: Primary data saved (53186 records). [2025-10-27T19:29:14.686686] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-27T19:29:14.686464] [DEBUG] [LOCAL ] JILL: Primary data saved (15011 records). [2025-10-27T19:29:14.687548] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JHX took 30.7s. Estimated remaining: 2h 36m 10s. Rate: 7.7 symbols/min [2025-10-27T19:29:14.687670] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-27T19:29:14.730519] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JILL took 30.5s. Estimated remaining: 2h 35m 54s. Rate: 7.8 symbols/min [2025-10-27T19:29:14.827095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-27T19:29:14.858108] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:14.866244] [DEBUG] [LOCAL ] JLS: Loaded 4056 existing records from primary storage. [2025-10-27T19:29:14.866460] [INFO ] [MAIN ] JLS: Loaded 4056 existing records. [2025-10-27T19:29:15.044325] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:15.044614] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-27T19:29:15.044761] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-27T19:29:15.044906] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-27T19:29:15.044944] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-27T19:29:15.401699] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:15.427526] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:29:15.614939] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-27T19:29:15.815195] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:29:16.005305] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-27T19:29:16.414984] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-27T19:29:16.788565] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T19:29:17.214957] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-27T19:29:18.014920] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-27T19:29:18.652897] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T19:29:18.814966] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-27T19:29:18.908131] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:29:19.614948] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-27T19:29:19.887418] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T19:29:20.414878] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-27T19:29:21.162579] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T19:29:21.214944] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-27T19:29:21.284915] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T19:29:22.015000] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-27T19:29:22.513403] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T19:29:22.521196] [INFO ] [REMOTE ] JKS: Full fetch complete (58541 records). [2025-10-27T19:29:22.521332] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-27T19:29:22.820107] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-27T19:29:22.905383] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-27T19:29:22.905475] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-27T19:29:22.906316] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-27T19:29:22.906376] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-27T19:29:22.907473] [DEBUG] [LOCAL ] JKS: Trimmed 58541 records to 38863 (keeping 200 days of data) [2025-10-27T19:29:23.137993] [DEBUG] [LOCAL ] JKS: Primary data saved (38863 records). [2025-10-27T19:29:23.138281] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-27T19:29:23.138847] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JKS took 27.1s. Estimated remaining: 2h 35m 47s. Rate: 7.8 symbols/min [2025-10-27T19:29:23.260134] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T19:29:23.392835] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:29:23.614973] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-27T19:29:24.201385] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T19:29:24.414992] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-27T19:29:25.214958] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-27T19:29:25.386987] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:29:25.864616] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T19:29:26.014958] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-27T19:29:26.550370] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T19:29:26.815008] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-27T19:29:27.376550] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T19:29:27.615004] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-27T19:29:28.174281] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T19:29:28.414959] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-27T19:29:28.762309] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T19:29:29.214932] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-27T19:29:29.621444] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T19:29:29.623344] [INFO ] [REMOTE ] JLS: Full fetch complete (5820 records). [2025-10-27T19:29:29.623446] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-27T19:29:29.977847] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-27T19:29:29.977921] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-27T19:29:29.978072] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-27T19:29:29.978114] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-27T19:29:29.978462] [DEBUG] [LOCAL ] JLS: Trimmed 5820 records to 3941 (keeping 200 days of data) [2025-10-27T19:29:30.004736] [DEBUG] [LOCAL ] JLS: Primary data saved (3941 records). [2025-10-27T19:29:30.004872] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-27T19:29:30.004966] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JLS took 15.3s. Estimated remaining: 2h 35m 38s. Rate: 7.8 symbols/min [2025-10-27T19:29:30.014979] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-27T19:29:30.898097] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T19:29:30.904607] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-27T19:29:31.890276] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:29:31.895593] [INFO ] [REMOTE ] JLL: Full fetch complete (45090 records). [2025-10-27T19:29:31.895729] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-27T19:29:32.270704] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-27T19:29:32.270834] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-27T19:29:32.271538] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-27T19:29:32.271577] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-27T19:29:32.272503] [DEBUG] [LOCAL ] JLL: Trimmed 45090 records to 31094 (keeping 200 days of data) [2025-10-27T19:29:32.451993] [DEBUG] [LOCAL ] JLL: Primary data saved (31094 records). [2025-10-27T19:29:32.452113] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-27T19:29:32.452188] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JLL took 30.1s. Estimated remaining: 2h 35m 25s. Rate: 7.8 symbols/min [2025-10-27T19:29:33.106977] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.152232] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.150601] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.171067] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-27T19:29:33.171150] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-27T19:29:33.172693] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:33.171382] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-27T19:29:33.173561] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-27T19:29:33.173623] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-27T19:29:33.173961] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-27T19:29:33.512065] [DEBUG] [LOCAL ] JMIA: Loaded 51953 existing records from primary storage. [2025-10-27T19:29:33.593437] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-27T19:29:33.592444] [INFO ] [MAIN ] JMIA: Loaded 51953 existing records. [2025-10-27T19:29:33.598965] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-10-27T19:29:33.605084] [DEBUG] [LOCAL ] JOBY: Loaded 54589 existing records from primary storage. [2025-10-27T19:29:33.684663] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:33.684767] [INFO ] [MAIN ] JOBY: Loaded 54589 existing records. [2025-10-27T19:29:33.709998] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-27T19:29:34.086802] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.160998] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.166590] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.166738] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-27T19:29:34.179349] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T19:29:34.178736] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.194742] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-27T19:29:34.194864] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-27T19:29:34.199599] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-27T19:29:34.199489] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:34.200700] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-27T19:29:34.200777] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-27T19:29:34.194978] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-27T19:29:34.201014] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-27T19:29:34.200982] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-27T19:29:34.201125] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-27T19:29:34.250405] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-27T19:29:34.577083] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T19:29:34.654806] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-27T19:29:35.168993] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T19:29:35.209851] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-27T19:29:35.229176] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.321824] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-27T19:29:35.327386] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.348988] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:35.614958] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-27T19:29:35.745867] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:29:36.414986] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-27T19:29:36.896836] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:29:37.215003] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-27T19:29:37.300610] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T19:29:37.901889] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-27T19:29:38.014963] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-27T19:29:38.471793] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T19:29:38.814991] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-27T19:29:38.956419] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T19:29:39.614958] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-27T19:29:40.414976] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-27T19:29:40.873011] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T19:29:40.963365] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T19:29:41.226418] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-27T19:29:41.228938] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T19:29:42.014964] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-27T19:29:42.815016] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-27T19:29:43.405350] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-27T19:29:43.614968] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-27T19:29:44.391358] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:29:44.420039] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-27T19:29:44.435982] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T19:29:45.214926] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-27T19:29:45.639410] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T19:29:45.656209] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T19:29:45.724600] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T19:29:46.014946] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-27T19:29:46.814940] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-27T19:29:47.414425] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:29:47.614942] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-27T19:29:47.802377] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T19:29:48.414922] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-27T19:29:48.850493] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T19:29:48.851312] [INFO ] [REMOTE ] JMM: Full fetch complete (2321 records). [2025-10-27T19:29:48.851379] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-27T19:29:49.029917] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-27T19:29:49.030148] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:29:49.030236] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:29:49.030330] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-27T19:29:49.030412] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-27T19:29:49.030450] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-27T19:29:49.030491] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-27T19:29:49.030544] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JMM took 16.6s. Estimated remaining: 2h 35m 27s. Rate: 7.8 symbols/min [2025-10-27T19:29:49.199383] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:29:49.214981] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-27T19:29:49.225214] [DEBUG] [LOCAL ] JOE: Loaded 23916 existing records from primary storage. [2025-10-27T19:29:49.225431] [INFO ] [MAIN ] JOE: Loaded 23916 existing records. [2025-10-27T19:29:49.415895] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:29:49.416311] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-27T19:29:49.416522] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-27T19:29:49.416914] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-27T19:29:49.416995] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-27T19:29:49.813843] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:29:49.819102] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-27T19:29:50.014932] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-27T19:29:50.815025] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-27T19:29:51.441162] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T19:29:51.614916] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-27T19:29:51.839846] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-27T19:29:52.077347] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T19:29:52.296477] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:29:52.414965] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-27T19:29:53.214998] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-27T19:29:54.014950] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-27T19:29:54.210681] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:29:54.814934] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-27T19:29:54.974223] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T19:29:55.007854] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T19:29:55.614961] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-27T19:29:56.415025] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-27T19:29:56.545552] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T19:29:56.915306] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T19:29:57.214934] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-27T19:29:57.965323] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T19:29:58.014961] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-27T19:29:58.206875] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T19:29:58.814993] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-27T19:29:59.615022] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-27T19:30:00.300389] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-27T19:30:00.414932] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-27T19:30:00.596509] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T19:30:00.664981] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:30:01.214938] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-27T19:30:02.015006] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-27T19:30:02.718474] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:30:02.814939] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-27T19:30:03.158429] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-27T19:30:03.563981] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T19:30:03.614926] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-27T19:30:04.414956] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-27T19:30:05.214981] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-27T19:30:05.387289] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-27T19:30:05.906567] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:30:05.916887] [INFO ] [REMOTE ] JMIA: Full fetch complete (73509 records). [2025-10-27T19:30:05.917023] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-27T19:30:06.020839] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-27T19:30:06.324939] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-27T19:30:06.373102] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-27T19:30:06.373695] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-27T19:30:06.375624] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-27T19:30:06.375717] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-27T19:30:06.377692] [DEBUG] [LOCAL ] JMIA: Trimmed 73509 records to 51192 (keeping 200 days of data) [2025-10-27T19:30:06.697285] [DEBUG] [LOCAL ] JMIA: Primary data saved (51192 records). [2025-10-27T19:30:06.697497] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-27T19:30:06.697607] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JMIA took 34.2s. Estimated remaining: 2h 35m 29s. Rate: 7.7 symbols/min [2025-10-27T19:30:06.820177] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-27T19:30:06.882833] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:06.893954] [DEBUG] [LOCAL ] JOF: Loaded 6999 existing records from primary storage. [2025-10-27T19:30:06.894262] [INFO ] [MAIN ] JOF: Loaded 6999 existing records. [2025-10-27T19:30:07.086125] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:07.086502] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-27T19:30:07.086555] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-27T19:30:07.086907] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-27T19:30:07.086970] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-27T19:30:07.473596] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:07.509881] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T19:30:07.614931] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-27T19:30:07.737431] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:30:07.741781] [INFO ] [REMOTE ] JOE: Full fetch complete (35330 records). [2025-10-27T19:30:07.741900] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-27T19:30:08.108688] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-27T19:30:08.108783] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-27T19:30:08.109419] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-27T19:30:08.109459] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-27T19:30:08.110413] [DEBUG] [LOCAL ] JOE: Trimmed 35330 records to 23241 (keeping 200 days of data) [2025-10-27T19:30:08.247626] [DEBUG] [LOCAL ] JOE: Primary data saved (23241 records). [2025-10-27T19:30:08.247767] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-27T19:30:08.247841] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JOE took 19.2s. Estimated remaining: 2h 35m 15s. Rate: 7.7 symbols/min [2025-10-27T19:30:08.424521] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:08.421000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-27T19:30:08.467287] [DEBUG] [LOCAL ] JPC: Loaded 37523 existing records from primary storage. [2025-10-27T19:30:08.467739] [INFO ] [MAIN ] JPC: Loaded 37523 existing records. [2025-10-27T19:30:08.648388] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-27T19:30:08.702779] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:08.703259] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-27T19:30:08.703307] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-27T19:30:08.703489] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-27T19:30:08.703527] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-27T19:30:09.058943] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T19:30:09.063932] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:09.214989] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-27T19:30:09.858482] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-27T19:30:09.876108] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T19:30:10.014948] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-27T19:30:10.815003] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-27T19:30:11.167785] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:30:11.614976] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-27T19:30:12.414986] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-27T19:30:13.063199] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-27T19:30:13.214954] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-27T19:30:13.889309] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:30:14.020035] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-27T19:30:14.038359] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T19:30:14.814928] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-27T19:30:15.488976] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:30:15.524638] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:30:15.620678] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-27T19:30:15.633451] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T19:30:15.643740] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-27T19:30:15.643842] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-27T19:30:16.050335] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-27T19:30:16.050408] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-27T19:30:16.051369] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-27T19:30:16.051430] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-27T19:30:16.052811] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-27T19:30:16.384096] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-27T19:30:16.384222] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-27T19:30:16.385206] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JNJ took 43.9s. Estimated remaining: 2h 35m 8s. Rate: 7.7 symbols/min [2025-10-27T19:30:16.420228] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-27T19:30:16.551306] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:16.602180] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-27T19:30:16.602597] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-10-27T19:30:16.777831] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:16.778076] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-27T19:30:16.778265] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-27T19:30:16.786639] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-27T19:30:16.800077] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-27T19:30:16.844083] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:30:17.157964] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:17.214898] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-27T19:30:18.014951] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-27T19:30:18.525414] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T19:30:18.814959] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-27T19:30:19.076675] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-27T19:30:19.087939] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-27T19:30:19.088178] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-27T19:30:19.309818] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T19:30:19.497240] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-27T19:30:19.546742] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-27T19:30:19.546827] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-27T19:30:19.547850] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-27T19:30:19.547914] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-27T19:30:19.549359] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-27T19:30:19.629927] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-27T19:30:19.862196] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-27T19:30:19.862322] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-27T19:30:19.862397] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOBY took 47.4s. Estimated remaining: 2h 34m 56s. Rate: 7.8 symbols/min [2025-10-27T19:30:20.031618] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:20.064126] [DEBUG] [LOCAL ] JQC: Loaded 34356 existing records from primary storage. [2025-10-27T19:30:20.064378] [INFO ] [MAIN ] JQC: Loaded 34356 existing records. [2025-10-27T19:30:20.250092] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:20.250302] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-27T19:30:20.250349] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-27T19:30:20.250567] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-27T19:30:20.250624] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-27T19:30:20.426188] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-27T19:30:20.617379] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:21.214948] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-27T19:30:21.770384] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T19:30:21.874315] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:30:22.014979] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-27T19:30:22.557422] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:30:22.814965] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-27T19:30:23.614936] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-27T19:30:24.090919] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T19:30:24.129838] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:30:24.414935] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-27T19:30:24.463639] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T19:30:25.215012] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-27T19:30:25.805452] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T19:30:26.014983] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-27T19:30:26.282625] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T19:30:26.815022] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-27T19:30:27.505901] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:30:27.614912] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-27T19:30:28.414991] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-27T19:30:28.519799] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:30:28.863000] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T19:30:28.861309] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T19:30:29.214933] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-27T19:30:30.015000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-27T19:30:30.612419] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T19:30:30.814908] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-27T19:30:30.834442] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T19:30:31.614939] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-27T19:30:32.329324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T19:30:32.414936] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-27T19:30:33.043588] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:30:33.051076] [INFO ] [REMOTE ] JPC: Full fetch complete (54946 records). [2025-10-27T19:30:33.051186] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-27T19:30:33.221345] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-27T19:30:33.428146] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-27T19:30:33.428226] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-27T19:30:33.429024] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-27T19:30:33.429085] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-27T19:30:33.430217] [DEBUG] [LOCAL ] JPC: Trimmed 54946 records to 36745 (keeping 200 days of data) [2025-10-27T19:30:33.651348] [DEBUG] [LOCAL ] JPC: Primary data saved (36745 records). [2025-10-27T19:30:33.651462] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-27T19:30:33.651806] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JPC took 25.4s. Estimated remaining: 2h 34m 54s. Rate: 7.7 symbols/min [2025-10-27T19:30:33.738767] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:30:33.852181] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:33.873821] [DEBUG] [LOCAL ] JRI: Loaded 15493 existing records from primary storage. [2025-10-27T19:30:33.874124] [INFO ] [MAIN ] JRI: Loaded 15493 existing records. [2025-10-27T19:30:34.020284] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-27T19:30:34.063384] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:34.070004] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-27T19:30:34.070325] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:30:34.070408] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-27T19:30:34.072975] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-27T19:30:34.073458] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-27T19:30:34.425104] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:34.814919] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-27T19:30:34.920525] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:30:35.614969] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-27T19:30:35.653881] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T19:30:35.655729] [INFO ] [REMOTE ] JOF: Full fetch complete (9546 records). [2025-10-27T19:30:35.655806] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-27T19:30:36.019219] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-27T19:30:36.019290] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-27T19:30:36.019506] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-27T19:30:36.019544] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-27T19:30:36.019975] [DEBUG] [LOCAL ] JOF: Trimmed 9546 records to 6868 (keeping 200 days of data) [2025-10-27T19:30:36.059732] [DEBUG] [LOCAL ] JOF: Primary data saved (6868 records). [2025-10-27T19:30:36.059839] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-27T19:30:36.059918] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JOF took 29.4s. Estimated remaining: 2h 34m 41s. Rate: 7.8 symbols/min [2025-10-27T19:30:36.227635] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:36.239591] [DEBUG] [LOCAL ] JRS: Loaded 11662 existing records from primary storage. [2025-10-27T19:30:36.239843] [INFO ] [MAIN ] JRS: Loaded 11662 existing records. [2025-10-27T19:30:36.433395] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-27T19:30:36.438293] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:36.439116] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-27T19:30:36.439167] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-27T19:30:36.439306] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-27T19:30:36.439345] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-27T19:30:36.797392] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:36.812804] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:30:37.214958] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-27T19:30:37.639096] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:30:37.761230] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T19:30:38.014936] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-27T19:30:38.492842] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T19:30:38.814962] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-27T19:30:39.614934] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-27T19:30:39.810422] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T19:30:40.414939] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-27T19:30:41.214994] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-27T19:30:41.494507] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T19:30:41.669872] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:30:42.014940] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-27T19:30:42.170286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T19:30:42.775602] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:30:42.814917] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-27T19:30:43.614940] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-27T19:30:43.633143] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:30:44.298267] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T19:30:44.414930] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-27T19:30:44.968602] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T19:30:45.214933] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-27T19:30:45.945311] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:30:46.014921] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-27T19:30:46.814931] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-27T19:30:46.973117] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T19:30:47.614939] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-27T19:30:48.415048] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-27T19:30:48.439623] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T19:30:48.782482] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-27T19:30:48.998417] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T19:30:49.215006] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-27T19:30:50.014978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-27T19:30:50.253423] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:30:50.514108] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T19:30:50.815002] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-27T19:30:51.615009] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-27T19:30:52.092408] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T19:30:52.414991] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-27T19:30:52.665525] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:30:53.214946] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-27T19:30:53.408848] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:30:53.416271] [INFO ] [REMOTE ] JQC: Full fetch complete (50101 records). [2025-10-27T19:30:53.416466] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-27T19:30:53.806745] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-27T19:30:53.806841] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-27T19:30:53.807720] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-27T19:30:53.807866] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-27T19:30:53.808980] [DEBUG] [LOCAL ] JQC: Trimmed 50101 records to 33597 (keeping 200 days of data) [2025-10-27T19:30:54.014288] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:30:54.014917] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-27T19:30:54.027834] [DEBUG] [LOCAL ] JQC: Primary data saved (33597 records). [2025-10-27T19:30:54.028570] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-27T19:30:54.028719] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JQC took 34.2s. Estimated remaining: 2h 34m 44s. Rate: 7.7 symbols/min [2025-10-27T19:30:54.195617] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:30:54.234589] [DEBUG] [LOCAL ] JXN: Loaded 44772 existing records from primary storage. [2025-10-27T19:30:54.234916] [INFO ] [MAIN ] JXN: Loaded 44772 existing records. [2025-10-27T19:30:54.404933] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:30:54.405149] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-27T19:30:54.405194] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-27T19:30:54.405370] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-27T19:30:54.405407] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-27T19:30:54.748062] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:30:54.814911] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-27T19:30:55.614956] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-27T19:30:56.008233] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T19:30:56.324838] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T19:30:56.376286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:30:56.414898] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-27T19:30:57.214994] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-27T19:30:58.014986] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-27T19:30:58.029131] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:30:58.465453] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T19:30:58.814978] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-27T19:30:59.537126] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:30:59.614914] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-27T19:30:59.758953] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T19:30:59.761712] [INFO ] [REMOTE ] JRS: Full fetch complete (16037 records). [2025-10-27T19:30:59.761795] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-27T19:31:00.116319] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-27T19:31:00.116413] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-27T19:31:00.116804] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-27T19:31:00.116866] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-27T19:31:00.117364] [DEBUG] [LOCAL ] JRS: Trimmed 16037 records to 11423 (keeping 200 days of data) [2025-10-27T19:31:00.180514] [DEBUG] [LOCAL ] JRS: Primary data saved (11423 records). [2025-10-27T19:31:00.180630] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-27T19:31:00.180741] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JRS took 24.1s. Estimated remaining: 2h 34m 34s. Rate: 7.7 symbols/min [2025-10-27T19:31:00.344904] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:00.390503] [DEBUG] [LOCAL ] K: Loaded 51098 existing records from primary storage. [2025-10-27T19:31:00.390816] [INFO ] [MAIN ] K: Loaded 51098 existing records. [2025-10-27T19:31:00.420695] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-27T19:31:00.570904] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:00.571122] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-27T19:31:00.571195] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-27T19:31:00.571590] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-27T19:31:00.571706] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-27T19:31:00.928634] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:01.214944] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-27T19:31:01.641471] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-27T19:31:02.014924] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-27T19:31:02.519481] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:31:02.814997] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-27T19:31:02.877918] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:31:02.882321] [INFO ] [REMOTE ] JRI: Full fetch complete (22752 records). [2025-10-27T19:31:02.882420] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-27T19:31:03.241679] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-27T19:31:03.241769] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-27T19:31:03.242264] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-27T19:31:03.242305] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-27T19:31:03.242947] [DEBUG] [LOCAL ] JRI: Trimmed 22752 records to 15041 (keeping 200 days of data) [2025-10-27T19:31:03.334171] [DEBUG] [LOCAL ] JRI: Primary data saved (15041 records). [2025-10-27T19:31:03.334314] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-27T19:31:03.334398] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JRI took 29.7s. Estimated remaining: 2h 34m 22s. Rate: 7.7 symbols/min [2025-10-27T19:31:03.499724] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:03.514111] [DEBUG] [LOCAL ] KAI: Loaded 13576 existing records from primary storage. [2025-10-27T19:31:03.514332] [INFO ] [MAIN ] KAI: Loaded 13576 existing records. [2025-10-27T19:31:03.617319] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-27T19:31:03.698059] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:03.698367] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-27T19:31:03.698443] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-27T19:31:03.698761] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-27T19:31:03.698820] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-27T19:31:04.080860] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:04.082750] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (3.66 seconds). [2025-10-27T19:31:04.094142] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-27T19:31:04.094300] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-27T19:31:04.219400] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T19:31:04.420183] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-27T19:31:04.518444] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-27T19:31:04.518526] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-27T19:31:04.519564] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-27T19:31:04.519628] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-27T19:31:04.521161] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-27T19:31:04.860456] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-27T19:31:04.860615] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-27T19:31:04.861476] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. JPM took 48.5s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-27T19:31:05.033592] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:05.081950] [DEBUG] [LOCAL ] KAR: Loaded 40299 existing records from primary storage. [2025-10-27T19:31:05.082251] [INFO ] [MAIN ] KAR: Loaded 40299 existing records. [2025-10-27T19:31:05.224580] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-27T19:31:05.266879] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:05.267074] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-27T19:31:05.267149] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-27T19:31:05.267556] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-27T19:31:05.267626] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-27T19:31:05.551164] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:31:05.674201] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:05.832425] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:31:06.014915] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-27T19:31:06.066862] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T19:31:06.814949] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-27T19:31:07.614970] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-27T19:31:07.870123] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T19:31:08.419189] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-27T19:31:08.437347] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T19:31:08.663907] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:31:09.214990] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-27T19:31:09.643486] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:31:10.014943] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-27T19:31:10.793491] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T19:31:10.814897] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-27T19:31:10.983517] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T19:31:11.614943] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-27T19:31:12.394440] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:31:12.414989] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-27T19:31:12.989762] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:31:13.214964] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-27T19:31:13.477240] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T19:31:14.014934] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-27T19:31:14.540923] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T19:31:14.578422] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T19:31:14.814945] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-27T19:31:15.614948] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-27T19:31:15.967357] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:31:16.414934] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-27T19:31:17.218880] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-27T19:31:17.233332] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T19:31:17.365360] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T19:31:18.014972] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-27T19:31:18.518741] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:31:18.580280] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:31:18.814949] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-27T19:31:19.540473] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T19:31:19.614939] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-27T19:31:20.414969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-27T19:31:21.214938] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-27T19:31:21.239776] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T19:31:21.248592] [INFO ] [REMOTE ] JXN: Full fetch complete (65257 records). [2025-10-27T19:31:21.248796] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-27T19:31:21.657992] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:31:21.657177] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-27T19:31:21.661598] [INFO ] [REMOTE ] KAI: Full fetch complete (19400 records). [2025-10-27T19:31:21.661488] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-27T19:31:21.661783] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-27T19:31:21.662983] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-27T19:31:21.663245] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-27T19:31:21.768933] [DEBUG] [LOCAL ] JXN: Trimmed 65257 records to 43924 (keeping 200 days of data) [2025-10-27T19:31:22.015487] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-27T19:31:22.257239] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-27T19:31:22.257693] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-27T19:31:22.258341] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-27T19:31:22.258425] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-27T19:31:22.305204] [DEBUG] [LOCAL ] KAI: Trimmed 19400 records to 13227 (keeping 200 days of data) [2025-10-27T19:31:22.407961] [DEBUG] [LOCAL ] JXN: Primary data saved (43924 records). [2025-10-27T19:31:22.408229] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-27T19:31:22.410701] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. JXN took 28.4s. Estimated remaining: 2h 34m 10s. Rate: 7.7 symbols/min [2025-10-27T19:31:22.608147] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:22.619122] [DEBUG] [LOCAL ] KAI: Primary data saved (13227 records). [2025-10-27T19:31:22.619316] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-27T19:31:22.619681] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 19.3s. Estimated remaining: 2h 33m 54s. Rate: 7.8 symbols/min [2025-10-27T19:31:22.740790] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:31:22.819322] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-27T19:31:22.818171] [DEBUG] [LOCAL ] KB: Loaded 23210 existing records from primary storage. [2025-10-27T19:31:22.853150] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:22.853525] [INFO ] [MAIN ] KB: Loaded 23210 existing records. [2025-10-27T19:31:23.034087] [DEBUG] [LOCAL ] KBDC: Loaded 22964 existing records from primary storage. [2025-10-27T19:31:23.054350] [INFO ] [MAIN ] KBDC: Loaded 22964 existing records. [2025-10-27T19:31:23.054250] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:23.054582] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-27T19:31:23.103036] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-27T19:31:23.162630] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-27T19:31:23.162863] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-27T19:31:23.390867] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:23.414040] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-27T19:31:23.424436] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-27T19:31:23.434236] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-27T19:31:23.458199] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-27T19:31:23.855786] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:23.881464] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-27T19:31:24.006099] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:24.041262] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T19:31:24.414958] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-27T19:31:24.474604] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:31:24.729122] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T19:31:25.214953] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-27T19:31:25.356830] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T19:31:26.014924] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-27T19:31:26.094882] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:31:26.644102] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:31:26.814980] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-27T19:31:27.614959] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-27T19:31:28.012766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T19:31:28.414944] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-27T19:31:29.223693] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-27T19:31:29.229509] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:31:29.838485] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:31:30.014982] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-27T19:31:30.322019] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:31:30.741964] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T19:31:30.814963] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-27T19:31:31.615013] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-27T19:31:31.935050] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:31:32.414982] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-27T19:31:32.971290] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T19:31:33.215013] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-27T19:31:33.738005] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T19:31:34.014932] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-27T19:31:34.314616] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T19:31:34.815022] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-27T19:31:35.511620] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:31:35.531999] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T19:31:35.614952] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-27T19:31:36.414915] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-27T19:31:36.639440] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:31:37.214915] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-27T19:31:37.606506] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:31:37.936240] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:31:38.014964] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-27T19:31:38.815038] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-27T19:31:39.154852] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:31:39.614938] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-27T19:31:39.933681] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T19:31:40.415041] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-27T19:31:40.708462] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T19:31:41.214998] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-27T19:31:41.724834] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:31:42.014970] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-27T19:31:42.815468] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-27T19:31:42.815389] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:31:42.891465] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:31:42.900928] [INFO ] [REMOTE ] K: Full fetch complete (72248 records). [2025-10-27T19:31:42.901052] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-27T19:31:43.293358] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-27T19:31:43.293442] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-27T19:31:43.294544] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-27T19:31:43.294612] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-27T19:31:43.296056] [DEBUG] [LOCAL ] K: Trimmed 72248 records to 50265 (keeping 200 days of data) [2025-10-27T19:31:43.617096] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-27T19:31:43.621860] [DEBUG] [LOCAL ] K: Primary data saved (50265 records). [2025-10-27T19:31:43.622021] [INFO ] [MAIN ] K: Full history saved. [2025-10-27T19:31:43.622121] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. K took 43.4s. Estimated remaining: 2h 34m 0s. Rate: 7.7 symbols/min [2025-10-27T19:31:43.815886] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:43.860637] [DEBUG] [LOCAL ] KBH: Loaded 49358 existing records from primary storage. [2025-10-27T19:31:43.860969] [INFO ] [MAIN ] KBH: Loaded 49358 existing records. [2025-10-27T19:31:44.065054] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:44.065377] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-27T19:31:44.065442] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-27T19:31:44.065781] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-27T19:31:44.065855] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-27T19:31:44.237027] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:31:44.355825] [INFO ] [REMOTE ] KAR: Full fetch complete (57037 records). [2025-10-27T19:31:44.375557] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-27T19:31:44.420185] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-27T19:31:44.617162] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:44.686322] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:31:44.958891] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-27T19:31:44.958976] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-27T19:31:44.959887] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-27T19:31:44.959953] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-27T19:31:44.961207] [DEBUG] [LOCAL ] KAR: Trimmed 57037 records to 39580 (keeping 200 days of data) [2025-10-27T19:31:45.182685] [DEBUG] [LOCAL ] KAR: Primary data saved (39580 records). [2025-10-27T19:31:45.182815] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-27T19:31:45.183553] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KAR took 40.3s. Estimated remaining: 2h 33m 46s. Rate: 7.7 symbols/min [2025-10-27T19:31:45.224852] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-27T19:31:45.358526] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:45.405188] [DEBUG] [LOCAL ] KBR: Loaded 48714 existing records from primary storage. [2025-10-27T19:31:45.405496] [INFO ] [MAIN ] KBR: Loaded 48714 existing records. [2025-10-27T19:31:45.529985] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:31:45.601706] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:45.601875] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-27T19:31:45.601921] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-27T19:31:45.602104] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-27T19:31:45.602143] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-27T19:31:45.951717] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:46.014906] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-27T19:31:46.814927] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-27T19:31:46.923107] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:31:47.359143] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:31:47.614977] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-27T19:31:47.987414] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:31:48.339178] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:31:48.342999] [INFO ] [REMOTE ] KB: Full fetch complete (33356 records). [2025-10-27T19:31:48.343090] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-27T19:31:48.420261] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-27T19:31:48.737088] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-27T19:31:48.737155] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-27T19:31:48.737857] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-27T19:31:48.737919] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-27T19:31:48.738689] [DEBUG] [LOCAL ] KB: Trimmed 33356 records to 22731 (keeping 200 days of data) [2025-10-27T19:31:48.876492] [DEBUG] [LOCAL ] KB: Primary data saved (22731 records). [2025-10-27T19:31:48.876634] [INFO ] [MAIN ] KB: Full history saved. [2025-10-27T19:31:48.876766] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KB took 26.5s. Estimated remaining: 2h 33m 34s. Rate: 7.7 symbols/min [2025-10-27T19:31:49.044388] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:49.093330] [DEBUG] [LOCAL ] KD: Loaded 53087 existing records from primary storage. [2025-10-27T19:31:49.093631] [INFO ] [MAIN ] KD: Loaded 53087 existing records. [2025-10-27T19:31:49.220069] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-27T19:31:49.293199] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:49.293439] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-27T19:31:49.293493] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-27T19:31:49.293773] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-27T19:31:49.293837] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-27T19:31:49.655046] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:49.671257] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T19:31:49.677679] [INFO ] [REMOTE ] KBDC: Full fetch complete (31145 records). [2025-10-27T19:31:49.677776] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-27T19:31:50.015862] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-27T19:31:50.046215] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-27T19:31:50.046282] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-27T19:31:50.047022] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-27T19:31:50.047083] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-27T19:31:50.047861] [DEBUG] [LOCAL ] KBDC: Trimmed 31145 records to 22512 (keeping 200 days of data) [2025-10-27T19:31:50.183347] [DEBUG] [LOCAL ] KBDC: Primary data saved (22512 records). [2025-10-27T19:31:50.183475] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-27T19:31:50.183595] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBDC took 27.6s. Estimated remaining: 2h 33m 20s. Rate: 7.8 symbols/min [2025-10-27T19:31:50.355219] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:31:50.362074] [DEBUG] [LOCAL ] KEN: Loaded 4617 existing records from primary storage. [2025-10-27T19:31:50.362272] [INFO ] [MAIN ] KEN: Loaded 4617 existing records. [2025-10-27T19:31:50.546990] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:31:50.547247] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-27T19:31:50.547408] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-27T19:31:50.547575] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-27T19:31:50.547629] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-27T19:31:50.723865] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:31:50.823982] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-27T19:31:50.941141] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:31:51.231501] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:31:51.614937] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-27T19:31:52.414966] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-27T19:31:52.775636] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T19:31:53.214993] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-27T19:31:53.259858] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T19:31:54.015042] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-27T19:31:54.082582] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:31:54.359688] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T19:31:54.814996] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-27T19:31:55.271791] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T19:31:55.625172] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-27T19:31:55.628710] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T19:31:55.920031] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T19:31:56.414995] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-27T19:31:57.214946] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-27T19:31:57.577413] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T19:31:58.014961] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-27T19:31:58.814981] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-27T19:31:59.016928] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:31:59.415543] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:31:59.614939] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-27T19:32:00.019712] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T19:32:00.110235] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T19:32:00.414929] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-27T19:32:01.214991] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-27T19:32:02.014941] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-27T19:32:02.032203] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T19:32:02.814939] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-27T19:32:03.459078] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T19:32:03.614962] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-27T19:32:04.357244] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T19:32:04.414941] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-27T19:32:04.980566] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-10-27T19:32:05.214949] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-27T19:32:05.889952] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:32:06.014944] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-27T19:32:06.523118] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:32:06.812754] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T19:32:06.814897] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-27T19:32:06.903386] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-27T19:32:07.231995] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:32:07.614972] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-27T19:32:08.414979] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-27T19:32:09.214919] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-27T19:32:09.268702] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T19:32:09.613787] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T19:32:09.613616] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:32:10.014953] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-27T19:32:10.401695] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T19:32:10.814933] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-27T19:32:11.615011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-27T19:32:12.129533] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:32:12.139535] [INFO ] [REMOTE ] KBR: Full fetch complete (70071 records). [2025-10-27T19:32:12.139686] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-27T19:32:12.420134] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-27T19:32:12.553487] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-27T19:32:12.553599] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-27T19:32:12.554912] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-27T19:32:12.554987] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-27T19:32:12.556763] [DEBUG] [LOCAL ] KBR: Trimmed 70071 records to 47929 (keeping 200 days of data) [2025-10-27T19:32:12.837387] [DEBUG] [LOCAL ] KBR: Primary data saved (47929 records). [2025-10-27T19:32:12.837508] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-27T19:32:12.838261] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KBR took 27.7s. Estimated remaining: 2h 33m 27s. Rate: 7.7 symbols/min [2025-10-27T19:32:13.011340] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:13.045347] [DEBUG] [LOCAL ] KEP: Loaded 32980 existing records from primary storage. [2025-10-27T19:32:13.045608] [INFO ] [MAIN ] KEP: Loaded 32980 existing records. [2025-10-27T19:32:13.149957] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T19:32:13.151239] [INFO ] [REMOTE ] KEN: Full fetch complete (5838 records). [2025-10-27T19:32:13.177559] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-27T19:32:13.220895] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-27T19:32:13.297934] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:13.298157] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-27T19:32:13.319699] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-27T19:32:13.328211] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-27T19:32:13.335907] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-27T19:32:13.913176] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-27T19:32:13.920686] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-27T19:32:13.940086] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-27T19:32:13.920596] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-27T19:32:13.953368] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-27T19:32:13.980804] [DEBUG] [LOCAL ] KEN: Trimmed 5838 records to 4395 (keeping 200 days of data) [2025-10-27T19:32:14.038788] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-27T19:32:14.045012] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:14.060248] [DEBUG] [LOCAL ] KEN: Primary data saved (4395 records). [2025-10-27T19:32:14.060342] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-27T19:32:14.060416] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEN took 23.9s. Estimated remaining: 2h 33m 13s. Rate: 7.7 symbols/min [2025-10-27T19:32:14.226060] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:14.265529] [DEBUG] [LOCAL ] KEX: Loaded 39315 existing records from primary storage. [2025-10-27T19:32:14.265859] [INFO ] [MAIN ] KEX: Loaded 39315 existing records. [2025-10-27T19:32:14.441209] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:14.441406] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-27T19:32:14.441451] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-27T19:32:14.441691] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-27T19:32:14.441747] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-27T19:32:14.807936] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:14.820013] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-27T19:32:14.838571] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:32:15.604671] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:32:15.615280] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-27T19:32:15.956295] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:32:16.414927] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-27T19:32:16.959061] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:32:17.214989] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-27T19:32:17.687386] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:32:18.014964] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-27T19:32:18.345493] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:32:18.814986] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-27T19:32:19.614943] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-27T19:32:19.675370] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:32:20.379896] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:32:20.414898] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-27T19:32:20.526787] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T19:32:21.178441] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T19:32:21.214936] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-27T19:32:22.014946] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-27T19:32:22.814920] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-27T19:32:23.281370] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:32:23.307455] [INFO ] [REMOTE ] KBH: Full fetch complete (71001 records). [2025-10-27T19:32:23.318671] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-27T19:32:23.320256] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-27T19:32:23.396795] [INFO ] [REMOTE ] KD: Full fetch complete (76065 records). [2025-10-27T19:32:23.408144] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-27T19:32:23.629809] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-27T19:32:24.137562] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-27T19:32:24.137823] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-27T19:32:24.137899] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-27T19:32:24.137956] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-27T19:32:24.138944] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-27T19:32:24.139713] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-27T19:32:24.139795] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-27T19:32:24.139866] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-27T19:32:24.141968] [DEBUG] [LOCAL ] KBH: Trimmed 71001 records to 48545 (keeping 200 days of data) [2025-10-27T19:32:24.141873] [DEBUG] [LOCAL ] KD: Trimmed 76065 records to 52295 (keeping 200 days of data) [2025-10-27T19:32:24.582091] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T19:32:24.596198] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-27T19:32:24.742942] [DEBUG] [LOCAL ] KD: Primary data saved (52295 records). [2025-10-27T19:32:24.747178] [INFO ] [MAIN ] KD: Full history saved. [2025-10-27T19:32:24.758268] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KD took 35.9s. Estimated remaining: 2h 33m 8s. Rate: 7.7 symbols/min [2025-10-27T19:32:24.843861] [DEBUG] [LOCAL ] KBH: Primary data saved (48545 records). [2025-10-27T19:32:24.854832] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-27T19:32:24.876446] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KBH took 41.3s. Estimated remaining: 2h 32m 53s. Rate: 7.8 symbols/min [2025-10-27T19:32:25.031885] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:25.058527] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-27T19:32:25.058680] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-27T19:32:25.064447] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-27T19:32:25.069623] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-27T19:32:25.079995] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-27T19:32:25.085242] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-27T19:32:25.183107] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:25.332619] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:32:25.430320] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-27T19:32:25.535500] [DEBUG] [LOCAL ] KEYS: Loaded 43717 existing records from primary storage. [2025-10-27T19:32:25.568797] [INFO ] [MAIN ] KEYS: Loaded 43717 existing records. [2025-10-27T19:32:25.568542] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:25.744160] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:25.744452] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-27T19:32:25.744509] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-27T19:32:25.744925] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-27T19:32:25.744982] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-27T19:32:26.019764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-27T19:32:26.118605] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:26.120488] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:32:26.490586] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:32:26.814946] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-27T19:32:27.580147] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T19:32:27.614917] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-27T19:32:28.250151] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:32:28.414918] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-27T19:32:28.816195] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T19:32:29.214959] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-27T19:32:29.817686] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:32:30.015014] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-27T19:32:30.336061] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T19:32:30.814975] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-27T19:32:31.366170] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:32:31.614998] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-27T19:32:32.414950] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-27T19:32:32.481145] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T19:32:32.539758] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:32:33.214994] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-27T19:32:33.783950] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:32:34.014967] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-27T19:32:34.347014] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T19:32:34.814967] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-27T19:32:35.614946] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-27T19:32:35.783789] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:32:36.004476] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T19:32:36.401325] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T19:32:36.414898] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-27T19:32:37.214968] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-27T19:32:37.859455] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T19:32:37.866109] [INFO ] [REMOTE ] KEP: Full fetch complete (42532 records). [2025-10-27T19:32:37.866240] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-27T19:32:38.023371] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-27T19:32:38.242671] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-27T19:32:38.242754] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-27T19:32:38.243426] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-27T19:32:38.243466] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-27T19:32:38.244344] [DEBUG] [LOCAL ] KEP: Trimmed 42532 records to 32538 (keeping 200 days of data) [2025-10-27T19:32:38.441875] [DEBUG] [LOCAL ] KEP: Primary data saved (32538 records). [2025-10-27T19:32:38.442139] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-27T19:32:38.443052] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEP took 25.6s. Estimated remaining: 2h 32m 51s. Rate: 7.7 symbols/min [2025-10-27T19:32:38.612723] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:38.649068] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:32:38.647585] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-27T19:32:38.660231] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-27T19:32:38.840675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-27T19:32:38.846541] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:38.847442] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-27T19:32:38.847498] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-27T19:32:38.847624] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-27T19:32:38.847704] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-27T19:32:39.246213] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:39.309242] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T19:32:39.614939] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-27T19:32:39.942993] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T19:32:40.222680] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:32:40.414933] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-27T19:32:41.214944] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-27T19:32:41.932539] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:32:42.014907] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-27T19:32:42.524037] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:32:42.814944] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-27T19:32:43.513904] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T19:32:43.614933] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-27T19:32:43.692880] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:32:44.415016] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-27T19:32:45.215037] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-27T19:32:45.280131] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T19:32:45.535085] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:32:45.844813] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T19:32:46.015012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-27T19:32:46.814958] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-27T19:32:47.159793] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:32:47.615011] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-27T19:32:48.415118] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-27T19:32:48.618049] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T19:32:48.732911] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T19:32:48.947507] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T19:32:49.215027] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-27T19:32:50.014959] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-27T19:32:50.799618] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:32:50.809890] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-27T19:32:50.810054] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-27T19:32:50.821909] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-27T19:32:51.006119] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T19:32:51.007146] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:32:51.007222] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:32:51.007296] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-27T19:32:51.007367] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-27T19:32:51.007404] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-27T19:32:51.007443] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-27T19:32:51.007510] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KEY took 26.2s. Estimated remaining: 2h 32m 48s. Rate: 7.7 symbols/min [2025-10-27T19:32:51.171865] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:51.192232] [DEBUG] [LOCAL ] KFRC: Loaded 21172 existing records from primary storage. [2025-10-27T19:32:51.192488] [INFO ] [MAIN ] KFRC: Loaded 21172 existing records. [2025-10-27T19:32:51.394847] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:51.395394] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-27T19:32:51.395468] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-27T19:32:51.395701] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-27T19:32:51.395961] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-27T19:32:51.477460] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:32:51.631562] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-27T19:32:51.704083] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:32:51.752492] [INFO ] [REMOTE ] KEX: Full fetch complete (56170 records). [2025-10-27T19:32:51.771085] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-27T19:32:51.792531] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:52.167610] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-27T19:32:52.167712] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-27T19:32:52.168511] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-27T19:32:52.168550] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-27T19:32:52.169626] [DEBUG] [LOCAL ] KEX: Trimmed 56170 records to 38625 (keeping 200 days of data) [2025-10-27T19:32:52.396568] [DEBUG] [LOCAL ] KEX: Primary data saved (38625 records). [2025-10-27T19:32:52.396765] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-27T19:32:52.397222] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KEX took 38.3s. Estimated remaining: 2h 32m 34s. Rate: 7.7 symbols/min [2025-10-27T19:32:52.420112] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-27T19:32:52.577197] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:32:52.588170] [DEBUG] [LOCAL ] KFS: Loaded 8813 existing records from primary storage. [2025-10-27T19:32:52.588382] [INFO ] [MAIN ] KFS: Loaded 8813 existing records. [2025-10-27T19:32:52.763581] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:32:52.763882] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-27T19:32:52.763934] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-27T19:32:52.764093] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-27T19:32:52.764131] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-27T19:32:53.143489] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:32:53.170177] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:32:53.214907] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-27T19:32:53.307396] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T19:32:54.015007] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-27T19:32:54.398726] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-27T19:32:54.782986] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T19:32:54.814909] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-27T19:32:55.614923] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-27T19:32:55.972863] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:32:56.079321] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:32:56.415003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-27T19:32:56.789061] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:32:57.214994] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-27T19:32:57.832755] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:32:58.014957] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-27T19:32:58.814985] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-27T19:32:59.357624] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T19:32:59.401199] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:32:59.410779] [INFO ] [REMOTE ] KEYS: Full fetch complete (63112 records). [2025-10-27T19:32:59.410932] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-27T19:32:59.619683] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-27T19:32:59.871580] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-27T19:32:59.871691] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-27T19:32:59.872693] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-27T19:32:59.872757] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-27T19:32:59.874051] [DEBUG] [LOCAL ] KEYS: Trimmed 63112 records to 42921 (keeping 200 days of data) [2025-10-27T19:33:00.156828] [DEBUG] [LOCAL ] KEYS: Primary data saved (42921 records). [2025-10-27T19:33:00.156957] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-27T19:33:00.157033] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KEYS took 35.3s. Estimated remaining: 2h 32m 26s. Rate: 7.7 symbols/min [2025-10-27T19:33:00.321847] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:00.350435] [DEBUG] [LOCAL ] KFY: Loaded 29905 existing records from primary storage. [2025-10-27T19:33:00.350711] [INFO ] [MAIN ] KFY: Loaded 29905 existing records. [2025-10-27T19:33:00.422935] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-27T19:33:00.526464] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:00.526638] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-27T19:33:00.526728] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-27T19:33:00.526907] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-27T19:33:00.526957] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-27T19:33:00.870848] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:00.882426] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:33:01.214908] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-27T19:33:02.014960] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-27T19:33:02.814989] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-27T19:33:03.195909] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-27T19:33:03.488579] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T19:33:03.614967] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-27T19:33:03.858220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T19:33:03.876870] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-27T19:33:03.938462] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T19:33:04.414972] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-27T19:33:04.891842] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T19:33:05.214922] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-27T19:33:06.014982] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-27T19:33:06.119104] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T19:33:06.323581] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-27T19:33:06.814960] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-27T19:33:07.614968] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-27T19:33:07.932420] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T19:33:07.997172] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T19:33:08.414957] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-27T19:33:09.042950] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T19:33:09.214923] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-27T19:33:10.014919] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-27T19:33:10.214322] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T19:33:10.814932] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-27T19:33:11.099311] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T19:33:11.284758] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:33:11.614954] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-27T19:33:12.338552] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T19:33:12.414920] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-27T19:33:12.890147] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:33:13.214941] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-27T19:33:13.982950] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T19:33:14.014909] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-27T19:33:14.814908] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-27T19:33:15.021783] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T19:33:15.308833] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T19:33:15.614937] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-27T19:33:16.414934] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-27T19:33:16.992455] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T19:33:17.006087] [INFO ] [REMOTE ] KF: Full fetch complete (3430 records). [2025-10-27T19:33:17.006959] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-27T19:33:17.007888] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T19:33:17.220741] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-27T19:33:17.412754] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-27T19:33:17.412844] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-27T19:33:17.413002] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-27T19:33:17.413042] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-27T19:33:17.413433] [DEBUG] [LOCAL ] KF: Trimmed 3430 records to 2320 (keeping 200 days of data) [2025-10-27T19:33:17.429112] [DEBUG] [LOCAL ] KF: Primary data saved (2320 records). [2025-10-27T19:33:17.429347] [INFO ] [MAIN ] KF: Full history saved. [2025-10-27T19:33:17.429463] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KF took 39.0s. Estimated remaining: 2h 32m 28s. Rate: 7.7 symbols/min [2025-10-27T19:33:17.616112] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:17.676415] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-10-27T19:33:17.676980] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-10-27T19:33:17.863247] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:17.863532] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-27T19:33:17.863583] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-27T19:33:17.863907] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-27T19:33:17.863966] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-27T19:33:18.019330] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-27T19:33:18.144942] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T19:33:18.175407] [INFO ] [REMOTE ] KFS: Full fetch complete (11334 records). [2025-10-27T19:33:18.181438] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-27T19:33:18.379087] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:18.653496] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-27T19:33:18.653594] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-27T19:33:18.654153] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-27T19:33:18.654218] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-27T19:33:18.654764] [DEBUG] [LOCAL ] KFS: Trimmed 11334 records to 8681 (keeping 200 days of data) [2025-10-27T19:33:18.707127] [DEBUG] [LOCAL ] KFS: Primary data saved (8681 records). [2025-10-27T19:33:18.707315] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-27T19:33:18.707411] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFS took 26.3s. Estimated remaining: 2h 32m 14s. Rate: 7.7 symbols/min [2025-10-27T19:33:18.820092] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-27T19:33:18.881774] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:18.931357] [DEBUG] [LOCAL ] KGS: Loaded 46710 existing records from primary storage. [2025-10-27T19:33:18.931729] [INFO ] [MAIN ] KGS: Loaded 46710 existing records. [2025-10-27T19:33:19.110209] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:19.110871] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-27T19:33:19.111043] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-27T19:33:19.111284] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-27T19:33:19.111327] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-27T19:33:19.405438] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T19:33:19.519505] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:19.614989] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-27T19:33:20.414967] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-27T19:33:20.793529] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T19:33:21.143729] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T19:33:21.214904] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-27T19:33:21.411266] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T19:33:21.416805] [INFO ] [REMOTE ] KFRC: Full fetch complete (27318 records). [2025-10-27T19:33:21.416903] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-27T19:33:21.795718] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-27T19:33:21.795802] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-27T19:33:21.796380] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-27T19:33:21.796419] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-27T19:33:21.797163] [DEBUG] [LOCAL ] KFRC: Trimmed 27318 records to 20906 (keeping 200 days of data) [2025-10-27T19:33:21.921949] [DEBUG] [LOCAL ] KFRC: Primary data saved (20906 records). [2025-10-27T19:33:21.922072] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-27T19:33:21.922145] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KFRC took 30.9s. Estimated remaining: 2h 32m 2s. Rate: 7.7 symbols/min [2025-10-27T19:33:22.019955] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-27T19:33:22.090070] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:22.140190] [DEBUG] [LOCAL ] KIM: Loaded 53768 existing records from primary storage. [2025-10-27T19:33:22.140526] [INFO ] [MAIN ] KIM: Loaded 53768 existing records. [2025-10-27T19:33:22.313929] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:22.314140] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-27T19:33:22.314187] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-27T19:33:22.314370] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-27T19:33:22.314407] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-27T19:33:22.675993] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:22.699885] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:33:22.814914] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-27T19:33:23.060053] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:33:23.614953] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-27T19:33:24.368594] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:33:24.414929] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-27T19:33:24.903239] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:33:25.214955] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-27T19:33:25.989358] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:33:26.014924] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-27T19:33:26.315812] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:33:26.814982] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-27T19:33:26.926066] [DEBUG] [REMOTE ] KFY: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-27T19:33:26.926361] [WARN ] [REMOTE ] KFY: No data returned for month 2025-09 [2025-10-27T19:33:26.926448] [FATAL] [REMOTE ] KFY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:33:26.926524] [FATAL] [MAIN ] KFY: Failed to fetch primary data. [2025-10-27T19:33:26.926559] [WARN ] [MAIN ] KFY: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:33:26.926595] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-27T19:33:26.926703] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-27T19:33:26.926761] [INFO ] [LOCAL ] KFY: Starting deletion of derivative data. [2025-10-27T19:33:26.926908] [DEBUG] [LOCAL ] KFY: Deleted derivative data file. [2025-10-27T19:33:26.926991] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KFY took 26.8s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-27T19:33:27.094237] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:27.115080] [DEBUG] [LOCAL ] KIO: Loaded 21965 existing records from primary storage. [2025-10-27T19:33:27.115316] [INFO ] [MAIN ] KIO: Loaded 21965 existing records. [2025-10-27T19:33:27.287052] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:27.287267] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-27T19:33:27.287314] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-27T19:33:27.287477] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-27T19:33:27.287516] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-27T19:33:27.621680] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-27T19:33:27.643506] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:27.928681] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T19:33:28.414931] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-27T19:33:28.973165] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:33:29.214944] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-27T19:33:29.963041] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:33:30.014912] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-27T19:33:30.552712] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:33:30.814934] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-27T19:33:31.614952] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-27T19:33:31.895057] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T19:33:32.264409] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-27T19:33:32.414936] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-27T19:33:32.651213] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T19:33:33.214994] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-27T19:33:33.613510] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:33:34.014948] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-27T19:33:34.470740] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:33:34.814960] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-27T19:33:35.614969] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-27T19:33:36.002929] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:33:36.103639] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-27T19:33:36.414972] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-27T19:33:37.020682] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:33:37.215009] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-27T19:33:38.015263] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-27T19:33:38.019635] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:33:38.069132] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T19:33:38.814950] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-27T19:33:39.614939] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-27T19:33:39.802696] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:33:40.414975] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-27T19:33:40.532574] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:33:40.587089] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T19:33:41.215008] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-27T19:33:42.015021] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-27T19:33:42.469065] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T19:33:42.631678] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:33:42.814961] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-27T19:33:43.106580] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T19:33:43.615013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-27T19:33:44.262347] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:33:44.312969] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T19:33:44.414967] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-27T19:33:45.214966] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-27T19:33:45.767576] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T19:33:46.015021] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-27T19:33:46.814924] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-27T19:33:46.956518] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:33:47.117027] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T19:33:47.615022] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-27T19:33:48.414992] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-27T19:33:48.770833] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T19:33:49.215000] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-27T19:33:49.456484] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T19:33:49.479130] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:33:49.478688] [INFO ] [REMOTE ] KGS: Full fetch complete (66532 records). [2025-10-27T19:33:49.483980] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-27T19:33:49.886583] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-27T19:33:49.886702] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-27T19:33:49.887594] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-27T19:33:49.887635] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-27T19:33:49.888972] [DEBUG] [LOCAL ] KGS: Trimmed 66532 records to 45875 (keeping 200 days of data) [2025-10-27T19:33:50.057006] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-27T19:33:50.158385] [DEBUG] [LOCAL ] KGS: Primary data saved (45875 records). [2025-10-27T19:33:50.158509] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-27T19:33:50.158938] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KGS took 31.5s. Estimated remaining: 2h 31m 59s. Rate: 7.7 symbols/min [2025-10-27T19:33:50.328927] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:50.383059] [DEBUG] [LOCAL ] KKR: Loaded 54277 existing records from primary storage. [2025-10-27T19:33:50.383389] [INFO ] [MAIN ] KKR: Loaded 54277 existing records. [2025-10-27T19:33:50.557791] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:50.557997] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-27T19:33:50.558044] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-27T19:33:50.558325] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-27T19:33:50.558365] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-27T19:33:50.827509] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-27T19:33:50.909146] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:50.943290] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:33:51.614987] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-27T19:33:51.921594] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:33:51.926850] [INFO ] [REMOTE ] KIO: Full fetch complete (32438 records). [2025-10-27T19:33:51.926948] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-27T19:33:52.304839] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-27T19:33:52.304918] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-27T19:33:52.305523] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-27T19:33:52.305562] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-27T19:33:52.306351] [DEBUG] [LOCAL ] KIO: Trimmed 32438 records to 21584 (keeping 200 days of data) [2025-10-27T19:33:52.418335] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-27T19:33:52.439727] [DEBUG] [LOCAL ] KIO: Primary data saved (21584 records). [2025-10-27T19:33:52.439983] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-27T19:33:52.440142] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KIO took 25.5s. Estimated remaining: 2h 31m 45s. Rate: 7.7 symbols/min [2025-10-27T19:33:52.610758] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:52.642874] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-27T19:33:52.656565] [DEBUG] [LOCAL ] KKRS: Loaded 5581 existing records from primary storage. [2025-10-27T19:33:52.657424] [INFO ] [MAIN ] KKRS: Loaded 5581 existing records. [2025-10-27T19:33:52.835525] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:33:52.835782] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-27T19:33:52.835833] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-27T19:33:52.835993] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-27T19:33:52.836048] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-27T19:33:53.194942] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:53.214906] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-27T19:33:53.345066] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:33:53.979897] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T19:33:54.014904] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-27T19:33:54.481446] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:33:54.500103] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:33:54.814982] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-27T19:33:55.615048] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-27T19:33:56.415013] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-27T19:33:56.543878] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T19:33:57.201024] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:33:57.211635] [INFO ] [REMOTE ] KIM: Full fetch complete (76969 records). [2025-10-27T19:33:57.211850] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-27T19:33:57.224003] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-27T19:33:57.618502] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-27T19:33:57.618586] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-27T19:33:57.619556] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-27T19:33:57.619622] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-27T19:33:57.621095] [DEBUG] [LOCAL ] KIM: Trimmed 76969 records to 52988 (keeping 200 days of data) [2025-10-27T19:33:57.922683] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T19:33:57.947739] [DEBUG] [LOCAL ] KIM: Primary data saved (52988 records). [2025-10-27T19:33:57.947875] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-27T19:33:57.947953] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KIM took 36.0s. Estimated remaining: 2h 31m 36s. Rate: 7.7 symbols/min [2025-10-27T19:33:58.020632] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-27T19:33:58.115965] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:33:58.116550] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-27T19:33:58.116606] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-27T19:33:58.116766] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-27T19:33:58.116808] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-27T19:33:58.116849] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-27T19:33:58.116880] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-27T19:33:58.480068] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:33:58.515385] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T19:33:58.650239] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T19:33:58.814970] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-27T19:33:59.614992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-27T19:34:00.415024] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-27T19:34:01.215045] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-27T19:34:02.399850] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-27T19:34:02.417130] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-27T19:34:02.446546] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (3.63 seconds). [2025-10-27T19:34:02.456872] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-27T19:34:02.457025] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-27T19:34:02.849491] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-27T19:34:02.849570] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-27T19:34:02.850613] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-27T19:34:02.850698] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-27T19:34:02.852089] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-10-27T19:34:03.175126] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-27T19:34:03.175255] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-27T19:34:03.175333] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KGC took 45.7s. Estimated remaining: 2h 31m 25s. Rate: 7.7 symbols/min [2025-10-27T19:34:03.344796] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:03.344948] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-27T19:34:03.344986] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-27T19:34:03.345097] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-27T19:34:03.345140] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-27T19:34:03.345180] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-27T19:34:03.345212] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-27T19:34:03.414015] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:34:03.443812] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-27T19:34:03.445973] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:34:03.446293] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-27T19:34:03.456889] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:34:03.485582] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-27T19:34:03.498315] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-27T19:34:03.498399] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-27T19:34:03.505784] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-27T19:34:03.505868] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KKRT took 5.6s. Estimated remaining: 2h 31m 10s. Rate: 7.8 symbols/min [2025-10-27T19:34:03.879638] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:03.908766] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-27T19:34:03.912845] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:03.950845] [DEBUG] [LOCAL ] KLC: Loaded 36622 existing records from primary storage. [2025-10-27T19:34:03.951151] [INFO ] [MAIN ] KLC: Loaded 36622 existing records. [2025-10-27T19:34:04.055413] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (3.64 seconds). [2025-10-27T19:34:04.084027] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-27T19:34:04.138349] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:04.138747] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-27T19:34:04.138802] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-27T19:34:04.139014] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-27T19:34:04.139071] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-27T19:34:04.494435] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:04.494754] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-27T19:34:05.000528] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:34:05.052912] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:34:05.053167] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-27T19:34:05.053271] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:34:05.053342] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-27T19:34:05.053391] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:34:05.053446] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-27T19:34:05.053526] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-27T19:34:05.053591] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-27T19:34:05.053678] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-27T19:34:05.053762] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KLAR took 1.9s. Estimated remaining: 2h 30m 56s. Rate: 7.8 symbols/min [2025-10-27T19:34:05.224704] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-27T19:34:05.229764] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:05.280599] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-27T19:34:05.280940] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-10-27T19:34:05.460194] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:05.460515] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-27T19:34:05.460571] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-27T19:34:05.481897] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-27T19:34:05.499631] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-27T19:34:05.582157] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-10-27T19:34:05.873571] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:05.891051] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:34:05.962578] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:34:06.014901] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-27T19:34:06.814939] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-27T19:34:07.614969] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-27T19:34:08.037622] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-27T19:34:08.414969] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-27T19:34:08.571617] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T19:34:08.718979] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:34:09.214948] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-27T19:34:09.972360] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:34:10.014923] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-27T19:34:10.223021] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:34:10.814957] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-27T19:34:11.614948] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-27T19:34:11.727066] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:34:11.819745] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:34:12.414980] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-27T19:34:13.214985] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-27T19:34:13.262834] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:34:13.652872] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:34:13.786741] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:34:14.014941] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-27T19:34:14.814944] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-27T19:34:15.614905] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-27T19:34:15.935301] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T19:34:15.961317] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T19:34:16.088130] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:34:16.414934] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-27T19:34:17.214920] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-27T19:34:18.016851] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-27T19:34:18.021502] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:34:18.111677] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T19:34:18.815017] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-27T19:34:19.246697] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T19:34:19.248148] [INFO ] [REMOTE ] KKRS: Full fetch complete (7538 records). [2025-10-27T19:34:19.248223] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-27T19:34:19.616274] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-27T19:34:19.667708] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-27T19:34:19.667965] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-27T19:34:19.668308] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-27T19:34:19.668498] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-27T19:34:19.669147] [DEBUG] [LOCAL ] KKRS: Trimmed 7538 records to 5455 (keeping 200 days of data) [2025-10-27T19:34:19.707396] [DEBUG] [LOCAL ] KKRS: Primary data saved (5455 records). [2025-10-27T19:34:19.707736] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-27T19:34:19.707867] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KKRS took 27.3s. Estimated remaining: 2h 30m 56s. Rate: 7.8 symbols/min [2025-10-27T19:34:19.831386] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T19:34:19.960612] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:19.968969] [DEBUG] [LOCAL ] KMPB: Loaded 3498 existing records from primary storage. [2025-10-27T19:34:19.969275] [INFO ] [MAIN ] KMPB: Loaded 3498 existing records. [2025-10-27T19:34:20.157997] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:20.158395] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-27T19:34:20.158452] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-27T19:34:20.158850] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-27T19:34:20.158909] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-27T19:34:20.420234] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-27T19:34:20.540957] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:20.752300] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:34:21.214997] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-27T19:34:21.799871] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:34:22.014937] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-27T19:34:22.255544] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-27T19:34:22.814947] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-27T19:34:23.135733] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-27T19:34:23.614955] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-27T19:34:23.656220] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:34:23.962633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T19:34:24.414940] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-27T19:34:24.952453] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:34:25.214947] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-27T19:34:25.509403] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T19:34:26.014931] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-27T19:34:26.560723] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T19:34:26.814964] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-27T19:34:27.295088] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:34:27.614997] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-27T19:34:28.414990] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-27T19:34:29.215001] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-27T19:34:29.282324] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T19:34:30.014989] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-27T19:34:30.227080] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T19:34:30.237426] [INFO ] [REMOTE ] KKR: Full fetch complete (77657 records). [2025-10-27T19:34:30.237546] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-27T19:34:30.492511] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T19:34:30.664673] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T19:34:30.696031] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-27T19:34:30.696204] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-27T19:34:30.697394] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-27T19:34:30.697486] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-27T19:34:30.698948] [DEBUG] [LOCAL ] KKR: Trimmed 77657 records to 53494 (keeping 200 days of data) [2025-10-27T19:34:30.822758] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-27T19:34:31.025252] [DEBUG] [LOCAL ] KKR: Primary data saved (53494 records). [2025-10-27T19:34:31.025384] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-27T19:34:31.025471] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KKR took 40.9s. Estimated remaining: 2h 30m 51s. Rate: 7.7 symbols/min [2025-10-27T19:34:31.411565] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:34:31.614939] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-27T19:34:32.414940] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-27T19:34:32.942554] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T19:34:32.943577] [INFO ] [REMOTE ] KMPB: Full fetch complete (4916 records). [2025-10-27T19:34:32.943674] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-27T19:34:33.098510] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T19:34:33.153877] [INFO ] [REMOTE ] KLC: Full fetch complete (50688 records). [2025-10-27T19:34:33.192728] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-27T19:34:33.229896] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-27T19:34:33.498387] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-27T19:34:33.517819] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-27T19:34:33.538417] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-27T19:34:33.553591] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-27T19:34:33.623375] [DEBUG] [LOCAL ] KMPB: Trimmed 4916 records to 3417 (keeping 200 days of data) [2025-10-27T19:34:33.708916] [DEBUG] [LOCAL ] KMPB: Primary data saved (3417 records). [2025-10-27T19:34:33.728016] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-27T19:34:33.747387] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMPB took 14.0s. Estimated remaining: 2h 30m 39s. Rate: 7.8 symbols/min [2025-10-27T19:34:33.759863] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-27T19:34:33.759912] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-27T19:34:33.760850] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-27T19:34:33.760910] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-27T19:34:33.762069] [DEBUG] [LOCAL ] KLC: Trimmed 50688 records to 35861 (keeping 200 days of data) [2025-10-27T19:34:33.957475] [DEBUG] [LOCAL ] KLC: Primary data saved (35861 records). [2025-10-27T19:34:33.957605] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-27T19:34:33.957717] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KLC took 30.4s. Estimated remaining: 2h 30m 24s. Rate: 7.8 symbols/min [2025-10-27T19:34:35.302127] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T19:34:35.318394] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-27T19:34:37.102801] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T19:34:37.114749] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-27T19:34:38.834948] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:34:38.846513] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-27T19:34:39.815551] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T19:34:39.825885] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-27T19:34:39.826033] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-27T19:34:40.212985] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-27T19:34:40.213072] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-27T19:34:40.214109] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-27T19:34:40.214177] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-27T19:34:40.215715] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-27T19:34:40.540500] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-27T19:34:40.540626] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-27T19:34:40.541378] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMI took 35.5s. Estimated remaining: 2h 30m 15s. Rate: 7.8 symbols/min [2025-10-27T19:34:41.232807] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.235508] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.262430] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.290622] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:34:41.394904] [DEBUG] [LOCAL ] KMX: Loaded 54064 existing records from primary storage. [2025-10-27T19:34:41.396377] [INFO ] [MAIN ] KMX: Loaded 54064 existing records. [2025-10-27T19:34:41.397399] [DEBUG] [LOCAL ] KN: Loaded 39073 existing records from primary storage. [2025-10-27T19:34:41.416128] [DEBUG] [LOCAL ] KMT: Loaded 43438 existing records from primary storage. [2025-10-27T19:34:41.438503] [INFO ] [MAIN ] KMT: Loaded 43438 existing records. [2025-10-27T19:34:41.438330] [INFO ] [MAIN ] KN: Loaded 39073 existing records. [2025-10-27T19:34:41.614280] [DEBUG] [LOCAL ] KMPR: Loaded 41064 existing records from primary storage. [2025-10-27T19:34:41.753684] [INFO ] [MAIN ] KMPR: Loaded 41064 existing records. [2025-10-27T19:34:41.945190] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.031630] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.014516] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.090291] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.112901] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-27T19:34:42.107138] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.118343] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-27T19:34:42.128701] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.128746] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-27T19:34:42.129269] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-27T19:34:42.129319] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-27T19:34:42.155213] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-27T19:34:42.160450] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-27T19:34:42.222758] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-27T19:34:42.311087] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-27T19:34:42.310997] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:34:42.388040] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-27T19:34:42.574885] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-27T19:34:42.655818] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-27T19:34:42.655981] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-27T19:34:43.386829] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.458762] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-27T19:34:43.530910] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.568520] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-27T19:34:43.720413] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.746811] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-27T19:34:43.802797] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:34:43.803447] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-27T19:34:44.972458] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T19:34:44.979927] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-27T19:34:45.239091] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T19:34:45.244590] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-27T19:34:45.580515] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-27T19:34:45.591124] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-27T19:34:45.793505] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-27T19:34:45.803357] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-27T19:34:45.987316] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:34:45.993967] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-27T19:34:46.495344] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:34:46.503614] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-27T19:34:46.715067] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T19:34:46.724634] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-27T19:34:47.172574] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:34:47.181073] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-27T19:34:47.285036] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T19:34:47.291535] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-27T19:34:47.673815] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T19:34:47.682519] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-27T19:34:48.288444] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T19:34:48.297362] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-27T19:34:48.463197] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T19:34:48.474158] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-27T19:34:48.709338] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T19:34:48.739720] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:34:49.214994] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-27T19:34:49.813092] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:34:50.014956] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-27T19:34:50.249007] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:34:50.409152] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:34:50.815022] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-27T19:34:51.292413] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:34:51.614934] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-27T19:34:51.751241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T19:34:52.414935] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-27T19:34:52.850077] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:34:53.214953] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-27T19:34:53.728522] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:34:54.014933] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-27T19:34:54.524598] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:34:54.814996] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-27T19:34:54.953947] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T19:34:55.614985] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-27T19:34:55.878525] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:34:56.414929] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-27T19:34:56.538692] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:34:57.214936] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-27T19:34:57.838720] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:34:58.014931] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-27T19:34:58.599888] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:34:58.814957] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-27T19:34:58.973058] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:34:59.614931] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-27T19:35:00.129527] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:35:00.414973] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-27T19:35:01.214941] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-27T19:35:01.254885] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T19:35:02.014958] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-27T19:35:02.814944] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-27T19:35:03.288257] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-10-27T19:35:03.594358] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-27T19:35:03.614908] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-27T19:35:04.016070] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T19:35:04.414949] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-27T19:35:05.121811] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T19:35:05.224808] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-27T19:35:05.236178] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T19:35:06.014948] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-27T19:35:06.366516] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T19:35:06.376004] [INFO ] [REMOTE ] KMPR: Full fetch complete (53871 records). [2025-10-27T19:35:06.376236] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-27T19:35:06.777473] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-27T19:35:06.777580] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-27T19:35:06.778810] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-27T19:35:06.778879] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-27T19:35:06.780673] [DEBUG] [LOCAL ] KMPR: Trimmed 53871 records to 40466 (keeping 200 days of data) [2025-10-27T19:35:06.835159] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-27T19:35:07.046531] [DEBUG] [LOCAL ] KMPR: Primary data saved (40466 records). [2025-10-27T19:35:07.046739] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-27T19:35:07.046847] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KMPR took 26.5s. Estimated remaining: 2h 30m 25s. Rate: 7.7 symbols/min [2025-10-27T19:35:07.234385] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:07.260449] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T19:35:07.269246] [INFO ] [REMOTE ] KN: Full fetch complete (56798 records). [2025-10-27T19:35:07.269419] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-27T19:35:07.586773] [DEBUG] [LOCAL ] KNF: Loaded 37242 existing records from primary storage. [2025-10-27T19:35:07.596954] [INFO ] [MAIN ] KNF: Loaded 37242 existing records. [2025-10-27T19:35:07.852581] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-27T19:35:07.876781] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-27T19:35:07.916480] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-27T19:35:07.920766] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:07.921720] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-27T19:35:07.921598] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-27T19:35:07.922427] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-27T19:35:07.923175] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-27T19:35:07.923345] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-27T19:35:08.003899] [DEBUG] [LOCAL ] KN: Trimmed 56798 records to 38260 (keeping 200 days of data) [2025-10-27T19:35:08.460849] [DEBUG] [LOCAL ] KN: Primary data saved (38260 records). [2025-10-27T19:35:08.470604] [INFO ] [MAIN ] KN: Full history saved. [2025-10-27T19:35:08.475496] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KN took 27.9s. Estimated remaining: 2h 30m 11s. Rate: 7.8 symbols/min [2025-10-27T19:35:08.694076] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:35:08.750736] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:08.766852] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-27T19:35:08.805690] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-27T19:35:08.875047] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:08.881274] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-27T19:35:08.892447] [INFO ] [REMOTE ] KMX: Full fetch complete (76429 records). [2025-10-27T19:35:08.892635] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-27T19:35:09.004697] [DEBUG] [LOCAL ] KNOP: Loaded 10190 existing records from primary storage. [2025-10-27T19:35:09.005549] [INFO ] [MAIN ] KNOP: Loaded 10190 existing records. [2025-10-27T19:35:09.415044] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:09.443947] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-27T19:35:09.455860] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-27T19:35:09.459964] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-27T19:35:09.478110] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-27T19:35:09.568564] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-27T19:35:09.581909] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-27T19:35:09.600026] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-27T19:35:09.611755] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-27T19:35:09.666170] [DEBUG] [LOCAL ] KMX: Trimmed 76429 records to 53284 (keeping 200 days of data) [2025-10-27T19:35:10.054229] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:10.101139] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-27T19:35:10.178277] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:35:10.211403] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-27T19:35:10.239937] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:35:10.250679] [INFO ] [REMOTE ] KMT: Full fetch complete (61812 records). [2025-10-27T19:35:10.251917] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-27T19:35:10.332771] [DEBUG] [LOCAL ] KMX: Primary data saved (53284 records). [2025-10-27T19:35:10.338556] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-27T19:35:10.343813] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KMX took 29.8s. Estimated remaining: 2h 29m 58s. Rate: 7.8 symbols/min [2025-10-27T19:35:10.695536] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:10.837949] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-27T19:35:10.838795] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-27T19:35:10.839780] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-27T19:35:10.840207] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-27T19:35:10.840134] [DEBUG] [LOCAL ] KNSL: Loaded 18763 existing records from primary storage. [2025-10-27T19:35:10.840545] [INFO ] [MAIN ] KNSL: Loaded 18763 existing records. [2025-10-27T19:35:10.920204] [DEBUG] [LOCAL ] KMT: Trimmed 61812 records to 42540 (keeping 200 days of data) [2025-10-27T19:35:11.115956] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:11.124728] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-27T19:35:11.124829] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-27T19:35:11.126483] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-27T19:35:11.127219] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-27T19:35:11.128074] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:35:11.161692] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-27T19:35:11.629145] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:11.632910] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-27T19:35:11.680360] [DEBUG] [LOCAL ] KMT: Primary data saved (42540 records). [2025-10-27T19:35:11.694116] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-27T19:35:11.694320] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMT took 31.2s. Estimated remaining: 2h 29m 44s. Rate: 7.8 symbols/min [2025-10-27T19:35:11.763776] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:35:11.890573] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:11.919733] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:35:11.939402] [DEBUG] [LOCAL ] KNTK: Loaded 47955 existing records from primary storage. [2025-10-27T19:35:11.939738] [INFO ] [MAIN ] KNTK: Loaded 47955 existing records. [2025-10-27T19:35:12.135566] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:12.135806] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-27T19:35:12.135894] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-27T19:35:12.136076] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-27T19:35:12.136115] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-27T19:35:12.420072] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-27T19:35:12.544043] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:12.852928] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T19:35:12.983208] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T19:35:13.214919] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-27T19:35:13.884143] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T19:35:14.014985] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-27T19:35:14.814949] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-27T19:35:15.025275] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T19:35:15.397078] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:35:15.614934] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-27T19:35:16.414966] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-27T19:35:16.759090] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:35:17.214997] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-27T19:35:18.014966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-27T19:35:18.126558] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:35:18.517220] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T19:35:18.783436] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:35:18.814904] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-27T19:35:19.614938] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-27T19:35:19.647157] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T19:35:20.414935] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-27T19:35:20.918622] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T19:35:21.115068] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:35:21.214999] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-27T19:35:22.014916] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-27T19:35:22.106484] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T19:35:22.814953] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-27T19:35:22.984185] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:35:23.614925] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-27T19:35:24.053065] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T19:35:24.296307] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:35:24.414928] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-27T19:35:25.214926] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-27T19:35:25.511163] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T19:35:26.014953] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-27T19:35:26.521705] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:35:26.715768] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T19:35:26.814948] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-27T19:35:27.614938] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-27T19:35:27.752371] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T19:35:28.414988] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-27T19:35:28.521778] [DEBUG] [REMOTE ] KNOP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-27T19:35:28.522133] [WARN ] [REMOTE ] KNOP: No data returned for month 2025-07 [2025-10-27T19:35:28.522237] [FATAL] [REMOTE ] KNOP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:35:28.522353] [FATAL] [MAIN ] KNOP: Failed to fetch primary data. [2025-10-27T19:35:28.522430] [WARN ] [MAIN ] KNOP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:35:28.522518] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-27T19:35:28.522590] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-27T19:35:28.522689] [INFO ] [LOCAL ] KNOP: Starting deletion of derivative data. [2025-10-27T19:35:28.522859] [DEBUG] [LOCAL ] KNOP: Deleted derivative data file. [2025-10-27T19:35:28.522954] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNOP took 20.0s. Estimated remaining: 2h 29m 45s. Rate: 7.8 symbols/min [2025-10-27T19:35:28.695491] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:28.749120] [DEBUG] [LOCAL ] KNX: Loaded 53425 existing records from primary storage. [2025-10-27T19:35:28.749578] [INFO ] [MAIN ] KNX: Loaded 53425 existing records. [2025-10-27T19:35:28.944609] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:28.945268] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-27T19:35:28.945417] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-27T19:35:28.945930] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-27T19:35:28.946015] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-27T19:35:29.222346] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-27T19:35:29.217044] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:35:29.382936] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:30.014976] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-27T19:35:30.365470] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:35:30.815012] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-27T19:35:31.603993] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:35:31.614907] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-27T19:35:32.209817] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:35:32.214214] [INFO ] [REMOTE ] KNSL: Full fetch complete (27232 records). [2025-10-27T19:35:32.214293] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-27T19:35:32.421755] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-27T19:35:32.577046] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-27T19:35:32.577120] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-27T19:35:32.577726] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-27T19:35:32.577787] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-27T19:35:32.578429] [DEBUG] [LOCAL ] KNSL: Trimmed 27232 records to 18472 (keeping 200 days of data) [2025-10-27T19:35:32.695722] [DEBUG] [LOCAL ] KNSL: Primary data saved (18472 records). [2025-10-27T19:35:32.695823] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-27T19:35:32.695898] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNSL took 22.3s. Estimated remaining: 2h 29m 34s. Rate: 7.8 symbols/min [2025-10-27T19:35:32.872250] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:32.872385] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-27T19:35:32.872421] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-27T19:35:32.872529] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-27T19:35:32.872570] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-27T19:35:32.872610] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-27T19:35:32.872664] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-27T19:35:33.225093] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-27T19:35:33.248959] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:33.281125] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:35:33.620567] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:35:34.015030] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-27T19:35:34.814981] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-27T19:35:35.209547] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T19:35:35.614956] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-27T19:35:36.152051] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T19:35:36.416314] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-27T19:35:36.424334] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:35:36.906107] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T19:35:36.914097] [INFO ] [REMOTE ] KNF: Full fetch complete (51522 records). [2025-10-27T19:35:36.914270] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-27T19:35:37.220050] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-27T19:35:37.306992] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-27T19:35:37.307061] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-27T19:35:37.307910] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-27T19:35:37.307970] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-27T19:35:37.308956] [DEBUG] [LOCAL ] KNF: Trimmed 51522 records to 36587 (keeping 200 days of data) [2025-10-27T19:35:37.528577] [DEBUG] [LOCAL ] KNF: Primary data saved (36587 records). [2025-10-27T19:35:37.528782] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-27T19:35:37.529468] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNF took 30.5s. Estimated remaining: 2h 29m 23s. Rate: 7.8 symbols/min [2025-10-27T19:35:37.698332] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:37.738706] [DEBUG] [LOCAL ] KODK: Loaded 44310 existing records from primary storage. [2025-10-27T19:35:37.738989] [INFO ] [MAIN ] KODK: Loaded 44310 existing records. [2025-10-27T19:35:37.915768] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:37.916060] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-27T19:35:37.916115] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-27T19:35:37.916360] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-27T19:35:37.916400] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-27T19:35:38.015418] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-27T19:35:38.271254] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:38.782296] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:35:38.814900] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-27T19:35:38.878458] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-27T19:35:39.543225] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:35:39.614951] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-27T19:35:40.153843] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:35:40.414965] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-27T19:35:40.906430] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:35:41.214960] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-27T19:35:42.014961] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-27T19:35:42.064301] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T19:35:42.597470] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:35:42.814928] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-27T19:35:43.614992] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-27T19:35:43.988037] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:35:44.081906] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T19:35:44.414947] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-27T19:35:44.642963] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T19:35:45.214941] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-27T19:35:46.020146] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-27T19:35:46.038741] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:35:46.448841] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:35:46.815004] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-27T19:35:47.614946] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-27T19:35:47.736050] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:35:48.209102] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T19:35:48.414961] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-27T19:35:49.214968] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-27T19:35:49.946930] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T19:35:49.956102] [INFO ] [REMOTE ] KNTK: Full fetch complete (66143 records). [2025-10-27T19:35:49.956228] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-27T19:35:50.018510] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-27T19:35:50.343859] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-27T19:35:50.343953] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-27T19:35:50.344905] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-27T19:35:50.344967] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-27T19:35:50.346304] [DEBUG] [LOCAL ] KNTK: Trimmed 66143 records to 47192 (keeping 200 days of data) [2025-10-27T19:35:50.477531] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-27T19:35:50.680320] [DEBUG] [LOCAL ] KNTK: Primary data saved (47192 records). [2025-10-27T19:35:50.680438] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-27T19:35:50.680516] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KNTK took 39.0s. Estimated remaining: 2h 29m 21s. Rate: 7.8 symbols/min [2025-10-27T19:35:50.815141] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-27T19:35:50.862626] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:35:50.903727] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:50.928762] [DEBUG] [LOCAL ] KOF: Loaded 26803 existing records from primary storage. [2025-10-27T19:35:50.929008] [INFO ] [MAIN ] KOF: Loaded 26803 existing records. [2025-10-27T19:35:51.123101] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:51.123448] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-27T19:35:51.123528] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-27T19:35:51.123830] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-27T19:35:51.123889] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-27T19:35:51.471379] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:51.496034] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T19:35:51.614901] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-27T19:35:52.414990] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-27T19:35:52.745636] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T19:35:53.020776] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-27T19:35:53.214918] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-27T19:35:53.740943] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T19:35:53.981738] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:35:54.014911] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-27T19:35:54.814963] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-27T19:35:55.614952] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-27T19:35:56.311047] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T19:35:56.416575] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-27T19:35:56.417699] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T19:35:56.491180] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-27T19:35:57.215098] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-27T19:35:58.005333] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:35:58.014900] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-27T19:35:58.016274] [INFO ] [REMOTE ] KNX: Full fetch complete (76335 records). [2025-10-27T19:35:58.016355] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-27T19:35:58.334302] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:35:58.433064] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-27T19:35:58.433138] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-27T19:35:58.434251] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-27T19:35:58.434315] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-27T19:35:58.435722] [DEBUG] [LOCAL ] KNX: Trimmed 76335 records to 52645 (keeping 200 days of data) [2025-10-27T19:35:58.742453] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-27T19:35:58.742583] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-27T19:35:58.743386] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KNX took 30.2s. Estimated remaining: 2h 29m 13s. Rate: 7.8 symbols/min [2025-10-27T19:35:58.820047] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-27T19:35:58.908429] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:35:58.927516] [DEBUG] [LOCAL ] KOP: Loaded 17502 existing records from primary storage. [2025-10-27T19:35:58.927782] [INFO ] [MAIN ] KOP: Loaded 17502 existing records. [2025-10-27T19:35:59.102936] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:35:59.103165] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-27T19:35:59.103218] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-27T19:35:59.103380] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-27T19:35:59.103417] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-27T19:35:59.445818] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:35:59.614932] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-27T19:35:59.750844] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T19:36:00.414956] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-27T19:36:00.904836] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-27T19:36:01.214945] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-27T19:36:01.746888] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:36:02.014937] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-27T19:36:02.814997] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-27T19:36:04.176405] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-27T19:36:04.186557] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-27T19:36:04.244397] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T19:36:04.360358] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (3.15 seconds). [2025-10-27T19:36:04.414928] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-27T19:36:05.219361] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-27T19:36:05.235589] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-27T19:36:05.329459] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T19:36:05.607311] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:36:06.014937] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-27T19:36:06.347093] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T19:36:06.814946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-27T19:36:07.455861] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T19:36:07.611367] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T19:36:07.616903] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-27T19:36:08.414957] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-27T19:36:09.215014] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-27T19:36:09.597927] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T19:36:09.837837] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:36:09.847200] [INFO ] [REMOTE ] KODK: Full fetch complete (63247 records). [2025-10-27T19:36:09.847342] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-27T19:36:10.031447] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-27T19:36:10.248077] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-27T19:36:10.248280] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-27T19:36:10.249332] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-27T19:36:10.249397] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-27T19:36:10.250624] [DEBUG] [LOCAL ] KODK: Trimmed 63247 records to 43487 (keeping 200 days of data) [2025-10-27T19:36:10.376084] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:36:10.507427] [DEBUG] [LOCAL ] KODK: Primary data saved (43487 records). [2025-10-27T19:36:10.507566] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-27T19:36:10.508000] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KODK took 33.0s. Estimated remaining: 2h 29m 9s. Rate: 7.8 symbols/min [2025-10-27T19:36:10.674286] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:10.678677] [DEBUG] [LOCAL ] KORE: Loaded 2257 existing records from primary storage. [2025-10-27T19:36:10.678827] [INFO ] [MAIN ] KORE: Loaded 2257 existing records. [2025-10-27T19:36:10.820205] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-27T19:36:10.873114] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:10.873312] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-27T19:36:10.873359] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-27T19:36:10.873486] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-27T19:36:10.873523] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-27T19:36:11.232389] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:11.338192] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T19:36:11.614941] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-27T19:36:11.792784] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T19:36:12.414946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-27T19:36:12.566882] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:36:13.214956] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-27T19:36:13.376539] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:36:13.381888] [INFO ] [REMOTE ] KOF: Full fetch complete (37855 records). [2025-10-27T19:36:13.381970] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-27T19:36:13.747910] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-27T19:36:13.747987] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-27T19:36:13.748681] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-27T19:36:13.748743] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-27T19:36:13.749541] [DEBUG] [LOCAL ] KOF: Trimmed 37855 records to 26160 (keeping 200 days of data) [2025-10-27T19:36:13.907987] [DEBUG] [LOCAL ] KOF: Primary data saved (26160 records). [2025-10-27T19:36:13.908138] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-27T19:36:13.908243] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KOF took 23.2s. Estimated remaining: 2h 28m 58s. Rate: 7.8 symbols/min [2025-10-27T19:36:14.020147] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-27T19:36:14.082211] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:14.130684] [DEBUG] [LOCAL ] KOS: Loaded 53873 existing records from primary storage. [2025-10-27T19:36:14.130987] [INFO ] [MAIN ] KOS: Loaded 53873 existing records. [2025-10-27T19:36:14.304816] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:14.305039] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-27T19:36:14.305085] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-27T19:36:14.305272] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-27T19:36:14.305326] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-27T19:36:14.654203] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:14.814904] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-27T19:36:14.899551] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T19:36:15.614870] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-27T19:36:16.102475] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:36:16.254550] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (3.04 seconds). [2025-10-27T19:36:16.264917] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-27T19:36:16.265066] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-27T19:36:16.418023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-27T19:36:16.493018] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T19:36:16.494017] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:36:16.494135] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:36:16.494363] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-27T19:36:16.494447] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-27T19:36:16.494508] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-27T19:36:16.494585] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-27T19:36:16.494692] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KO took 43.8s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-27T19:36:16.716718] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:16.722479] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T19:36:16.779314] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-10-27T19:36:16.779625] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-10-27T19:36:16.956505] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:16.957545] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-27T19:36:16.957603] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-27T19:36:16.958348] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-27T19:36:16.958405] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-27T19:36:17.148279] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:36:17.215150] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-27T19:36:17.322492] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:17.544137] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-27T19:36:18.014952] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-27T19:36:18.458930] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:36:18.814945] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-27T19:36:19.129558] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T19:36:19.614939] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-27T19:36:20.030914] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T19:36:20.414995] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-27T19:36:21.214951] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-27T19:36:21.812873] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:36:22.014958] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-27T19:36:22.047776] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:36:22.815029] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-27T19:36:23.615010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-27T19:36:23.773503] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:36:23.799888] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:36:24.414958] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-27T19:36:24.760173] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T19:36:25.214953] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-27T19:36:25.477335] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:36:26.014953] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-27T19:36:26.815024] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-27T19:36:26.878871] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:36:27.022865] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T19:36:27.026912] [INFO ] [REMOTE ] KOP: Full fetch complete (25346 records). [2025-10-27T19:36:27.027033] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-27T19:36:27.239482] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:36:27.432991] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-27T19:36:27.433069] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-27T19:36:27.433584] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-27T19:36:27.433623] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-27T19:36:27.434368] [DEBUG] [LOCAL ] KOP: Trimmed 25346 records to 17144 (keeping 200 days of data) [2025-10-27T19:36:27.539576] [DEBUG] [LOCAL ] KOP: Primary data saved (17144 records). [2025-10-27T19:36:27.539744] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-27T19:36:27.539833] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KOP took 28.8s. Estimated remaining: 2h 28m 40s. Rate: 7.8 symbols/min [2025-10-27T19:36:27.620045] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-27T19:36:27.718377] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:27.767263] [DEBUG] [LOCAL ] KRC: Loaded 48712 existing records from primary storage. [2025-10-27T19:36:27.767559] [INFO ] [MAIN ] KRC: Loaded 48712 existing records. [2025-10-27T19:36:27.945621] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:27.945857] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-27T19:36:27.945925] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-27T19:36:27.946144] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-27T19:36:27.946203] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-27T19:36:28.288600] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:28.414919] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-27T19:36:29.214944] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-27T19:36:29.262697] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:36:29.346544] [DEBUG] [REMOTE ] KORE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-27T19:36:29.346862] [WARN ] [REMOTE ] KORE: No data returned for month 2025-08 [2025-10-27T19:36:29.346963] [FATAL] [REMOTE ] KORE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:36:29.347073] [FATAL] [MAIN ] KORE: Failed to fetch primary data. [2025-10-27T19:36:29.347168] [WARN ] [MAIN ] KORE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:36:29.347252] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-27T19:36:29.347328] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-27T19:36:29.347379] [INFO ] [LOCAL ] KORE: Starting deletion of derivative data. [2025-10-27T19:36:29.347550] [DEBUG] [LOCAL ] KORE: Deleted derivative data file. [2025-10-27T19:36:29.347635] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KORE took 18.8s. Estimated remaining: 2h 28m 27s. Rate: 7.8 symbols/min [2025-10-27T19:36:29.521631] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:29.550119] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:36:29.588474] [DEBUG] [LOCAL ] KREF: Loaded 38596 existing records from primary storage. [2025-10-27T19:36:29.588795] [INFO ] [MAIN ] KREF: Loaded 38596 existing records. [2025-10-27T19:36:29.776833] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:29.777045] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-27T19:36:29.777093] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-27T19:36:29.777315] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-27T19:36:29.777354] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-27T19:36:30.020049] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-27T19:36:30.131337] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:30.815050] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-27T19:36:31.449444] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:36:31.614939] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-27T19:36:32.306794] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T19:36:32.414977] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-27T19:36:33.146011] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:36:33.214938] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-27T19:36:33.313834] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T19:36:34.015002] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-27T19:36:34.814974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-27T19:36:35.076332] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T19:36:35.378630] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:36:35.614931] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-27T19:36:36.039228] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:36:36.414979] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-27T19:36:37.104189] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:36:37.214910] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-27T19:36:37.673743] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:36:38.014962] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-27T19:36:38.733265] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:36:38.814960] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-27T19:36:39.016900] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:36:39.614997] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-27T19:36:40.192167] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:36:40.414950] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-27T19:36:40.679290] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T19:36:41.214974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-27T19:36:42.014986] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-27T19:36:42.142979] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:36:42.486941] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T19:36:42.814996] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-27T19:36:43.479173] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:36:43.614945] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-27T19:36:44.097727] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:36:44.414934] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-27T19:36:45.233233] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-27T19:36:45.244751] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T19:36:45.582018] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T19:36:46.014989] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-27T19:36:46.639598] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:36:46.814987] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-27T19:36:47.614969] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-27T19:36:47.895310] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:36:47.905544] [INFO ] [REMOTE ] KOS: Full fetch complete (77033 records). [2025-10-27T19:36:47.905736] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-27T19:36:48.307233] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-27T19:36:48.307350] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-27T19:36:48.308448] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-27T19:36:48.308528] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-27T19:36:48.335111] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:36:48.334141] [DEBUG] [LOCAL ] KOS: Trimmed 77033 records to 53087 (keeping 200 days of data) [2025-10-27T19:36:48.424166] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-27T19:36:48.639357] [DEBUG] [LOCAL ] KOS: Primary data saved (53087 records). [2025-10-27T19:36:48.639518] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-27T19:36:48.639605] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KOS took 34.7s. Estimated remaining: 2h 28m 30s. Rate: 7.8 symbols/min [2025-10-27T19:36:48.805248] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:48.848527] [DEBUG] [LOCAL ] KRG: Loaded 49992 existing records from primary storage. [2025-10-27T19:36:48.848853] [INFO ] [MAIN ] KRG: Loaded 49992 existing records. [2025-10-27T19:36:49.024278] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:49.024464] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-27T19:36:49.024510] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-27T19:36:49.024782] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-27T19:36:49.024856] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-27T19:36:49.223709] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-27T19:36:49.384234] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:49.415042] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:36:49.507743] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T19:36:50.014950] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-27T19:36:50.580716] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T19:36:50.815001] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-27T19:36:51.243090] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:36:51.614942] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-27T19:36:51.970847] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:36:52.414943] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-27T19:36:53.134002] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T19:36:53.214906] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-27T19:36:53.620708] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:36:54.014936] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-27T19:36:54.621816] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:36:54.814984] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-27T19:36:55.488027] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T19:36:55.495881] [INFO ] [REMOTE ] KREF: Full fetch complete (53069 records). [2025-10-27T19:36:55.496016] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-27T19:36:55.620101] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-27T19:36:55.895751] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-27T19:36:55.895875] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-27T19:36:55.896811] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-27T19:36:55.896914] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-27T19:36:55.898059] [DEBUG] [LOCAL ] KREF: Trimmed 53069 records to 37851 (keeping 200 days of data) [2025-10-27T19:36:56.024625] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T19:36:56.153541] [DEBUG] [LOCAL ] KREF: Primary data saved (37851 records). [2025-10-27T19:36:56.153696] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-27T19:36:56.154143] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KREF took 26.8s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-10-27T19:36:56.322989] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:56.323140] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-27T19:36:56.323181] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-27T19:36:56.323323] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-27T19:36:56.323378] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-27T19:36:56.323431] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-27T19:36:56.323468] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-27T19:36:56.420032] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-27T19:36:56.678447] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:36:56.805862] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:36:57.214952] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-27T19:36:58.014918] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-27T19:36:58.100407] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:36:58.110540] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-27T19:36:58.110701] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-27T19:36:58.500482] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-27T19:36:58.500594] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-27T19:36:58.501639] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-27T19:36:58.501721] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-27T19:36:58.503154] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-27T19:36:58.816056] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-27T19:36:58.830838] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-27T19:36:58.830927] [INFO ] [MAIN ] KR: Full history saved. [2025-10-27T19:36:58.831001] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KR took 42.3s. Estimated remaining: 2h 28m 10s. Rate: 7.8 symbols/min [2025-10-27T19:36:59.007523] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:36:59.040438] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:59.040987] [INFO ] [REMOTE ] KRC: Full fetch complete (70042 records). [2025-10-27T19:36:59.041066] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-27T19:36:59.099963] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:36:59.133955] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-27T19:36:59.154907] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:36:59.166092] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-27T19:36:59.196574] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:36:59.236892] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-27T19:36:59.305516] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-27T19:36:59.356845] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-27T19:36:59.387421] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-27T19:36:59.393201] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KRMN took 3.2s. Estimated remaining: 2h 27m 55s. Rate: 7.8 symbols/min [2025-10-27T19:36:59.404194] [DEBUG] [LOCAL ] KRO: Loaded 26911 existing records from primary storage. [2025-10-27T19:36:59.439212] [INFO ] [MAIN ] KRO: Loaded 26911 existing records. [2025-10-27T19:36:59.641940] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-27T19:36:59.676373] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-27T19:36:59.691725] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-27T19:36:59.695472] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-27T19:36:59.817154] [DEBUG] [LOCAL ] KRC: Trimmed 70042 records to 47927 (keeping 200 days of data) [2025-10-27T19:36:59.823892] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:36:59.846714] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:36:59.846852] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-27T19:36:59.847587] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-27T19:36:59.848030] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-27T19:36:59.848087] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-27T19:37:00.215404] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-27T19:37:00.279495] [DEBUG] [LOCAL ] KRP: Loaded 36327 existing records from primary storage. [2025-10-27T19:37:00.285398] [INFO ] [MAIN ] KRP: Loaded 36327 existing records. [2025-10-27T19:37:00.290855] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-27T19:37:00.660136] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:00.703054] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-27T19:37:00.759723] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:00.760286] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-27T19:37:00.760109] [DEBUG] [LOCAL ] KRC: Primary data saved (47927 records). [2025-10-27T19:37:00.760494] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-27T19:37:00.760431] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-27T19:37:00.761413] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRC took 33.2s. Estimated remaining: 2h 27m 42s. Rate: 7.8 symbols/min [2025-10-27T19:37:00.792287] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-27T19:37:00.823697] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-27T19:37:01.084252] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:01.298738] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:01.299099] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-27T19:37:01.345356] [DEBUG] [LOCAL ] KSS: Loaded 54355 existing records from primary storage. [2025-10-27T19:37:01.345872] [INFO ] [MAIN ] KSS: Loaded 54355 existing records. [2025-10-27T19:37:01.541200] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:01.541476] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-27T19:37:01.541543] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-27T19:37:01.541861] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-27T19:37:01.541937] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-27T19:37:01.907985] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:02.014912] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-27T19:37:03.358754] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:37:03.367605] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-27T19:37:04.118203] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (3.83 seconds). [2025-10-27T19:37:04.128848] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-27T19:37:04.391112] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (3.69 seconds). [2025-10-27T19:37:04.414900] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-27T19:37:04.715674] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:37:05.202488] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (3.19 seconds). [2025-10-27T19:37:05.214894] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-27T19:37:05.259902] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T19:37:06.014913] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-27T19:37:06.102121] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T19:37:06.814955] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-27T19:37:06.870814] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T19:37:07.524266] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-27T19:37:07.614931] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-27T19:37:08.414983] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-27T19:37:08.473610] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T19:37:09.108627] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:37:09.214942] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-27T19:37:09.450026] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:37:10.014950] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-27T19:37:10.814944] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-27T19:37:11.340015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T19:37:11.375160] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:37:11.566291] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T19:37:11.614940] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-27T19:37:12.414909] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-27T19:37:12.831506] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:37:13.214916] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-27T19:37:13.440150] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T19:37:14.014963] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-27T19:37:14.376278] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:37:14.814987] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-27T19:37:15.542021] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T19:37:15.606354] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T19:37:15.614890] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-27T19:37:16.414989] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-27T19:37:16.489454] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T19:37:17.215050] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-27T19:37:18.015243] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-27T19:37:18.311502] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T19:37:18.529559] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T19:37:18.797208] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T19:37:18.814898] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-27T19:37:19.619774] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-27T19:37:19.621689] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:37:20.414957] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-27T19:37:21.214984] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-27T19:37:21.474002] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T19:37:21.483558] [INFO ] [REMOTE ] KRG: Full fetch complete (71425 records). [2025-10-27T19:37:21.483692] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-27T19:37:21.818269] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:37:21.905416] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-27T19:37:21.905491] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-27T19:37:21.906532] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-27T19:37:21.906598] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-27T19:37:21.907955] [DEBUG] [LOCAL ] KRG: Trimmed 71425 records to 49194 (keeping 200 days of data) [2025-10-27T19:37:22.027808] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-27T19:37:22.204444] [DEBUG] [LOCAL ] KRG: Primary data saved (49194 records). [2025-10-27T19:37:22.204588] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-27T19:37:22.204721] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRG took 33.6s. Estimated remaining: 2h 27m 47s. Rate: 7.8 symbols/min [2025-10-27T19:37:22.371569] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:22.412000] [DEBUG] [LOCAL ] KT: Loaded 45999 existing records from primary storage. [2025-10-27T19:37:22.412331] [INFO ] [MAIN ] KT: Loaded 45999 existing records. [2025-10-27T19:37:22.593046] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:22.593269] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-27T19:37:22.593323] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-27T19:37:22.593549] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-27T19:37:22.593594] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-27T19:37:22.816905] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-27T19:37:22.957639] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:23.341549] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-27T19:37:23.473591] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T19:37:23.614911] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-27T19:37:23.858496] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T19:37:23.863727] [INFO ] [REMOTE ] KRO: Full fetch complete (35374 records). [2025-10-27T19:37:23.863818] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-27T19:37:24.262068] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-27T19:37:24.262148] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-27T19:37:24.262848] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-27T19:37:24.262908] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-27T19:37:24.263795] [DEBUG] [LOCAL ] KRO: Trimmed 35374 records to 26446 (keeping 200 days of data) [2025-10-27T19:37:24.412369] [DEBUG] [LOCAL ] KRO: Primary data saved (26446 records). [2025-10-27T19:37:24.412484] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-27T19:37:24.412558] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRO took 25.6s. Estimated remaining: 2h 27m 34s. Rate: 7.8 symbols/min [2025-10-27T19:37:24.423369] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-27T19:37:24.589392] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:24.625280] [DEBUG] [LOCAL ] KTB: Loaded 40735 existing records from primary storage. [2025-10-27T19:37:24.625571] [INFO ] [MAIN ] KTB: Loaded 40735 existing records. [2025-10-27T19:37:24.807328] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:24.807576] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-27T19:37:24.807630] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-27T19:37:24.807846] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-27T19:37:24.807890] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-27T19:37:25.074954] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:37:25.190506] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:25.214906] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-27T19:37:26.014952] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-27T19:37:26.255425] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T19:37:26.437877] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T19:37:26.814982] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-27T19:37:27.614986] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-27T19:37:27.958935] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T19:37:28.033285] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:37:28.414948] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-27T19:37:28.783759] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:37:29.214956] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-27T19:37:30.014915] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-27T19:37:30.050024] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:37:30.200827] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T19:37:30.814975] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-27T19:37:31.602047] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:37:31.614902] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-27T19:37:32.414929] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-27T19:37:32.552582] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T19:37:33.015870] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:37:33.214943] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-27T19:37:33.889991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T19:37:33.896399] [INFO ] [REMOTE ] KRP: Full fetch complete (54774 records). [2025-10-27T19:37:33.896546] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-27T19:37:34.020119] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-27T19:37:34.274888] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-27T19:37:34.275016] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-27T19:37:34.275874] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-27T19:37:34.275978] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-27T19:37:34.277117] [DEBUG] [LOCAL ] KRP: Trimmed 54774 records to 35495 (keeping 200 days of data) [2025-10-27T19:37:34.551807] [DEBUG] [LOCAL ] KRP: Primary data saved (35495 records). [2025-10-27T19:37:34.554192] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T19:37:34.554437] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-27T19:37:34.563028] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KRP took 35.2s. Estimated remaining: 2h 27m 28s. Rate: 7.8 symbols/min [2025-10-27T19:37:34.727194] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:34.739898] [DEBUG] [LOCAL ] KTF: Loaded 11768 existing records from primary storage. [2025-10-27T19:37:34.740111] [INFO ] [MAIN ] KTF: Loaded 11768 existing records. [2025-10-27T19:37:34.820334] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-27T19:37:34.914917] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:34.915111] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-27T19:37:34.915159] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-27T19:37:34.915522] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-27T19:37:34.915636] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-27T19:37:35.273344] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:35.614952] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-27T19:37:36.037962] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T19:37:36.314240] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T19:37:36.324375] [INFO ] [REMOTE ] KSS: Full fetch complete (77738 records). [2025-10-27T19:37:36.324499] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-27T19:37:36.420131] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-27T19:37:36.715880] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-27T19:37:36.715977] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-27T19:37:36.717127] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-27T19:37:36.717224] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-27T19:37:36.718734] [DEBUG] [LOCAL ] KSS: Trimmed 77738 records to 53574 (keeping 200 days of data) [2025-10-27T19:37:36.809957] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:37:37.048052] [DEBUG] [LOCAL ] KSS: Primary data saved (53574 records). [2025-10-27T19:37:37.048185] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-27T19:37:37.048260] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KSS took 36.3s. Estimated remaining: 2h 27m 16s. Rate: 7.8 symbols/min [2025-10-27T19:37:37.219681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-27T19:37:37.221146] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:37.270718] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-27T19:37:37.271040] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-10-27T19:37:37.454996] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:37.455225] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-27T19:37:37.455280] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-27T19:37:37.455471] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-27T19:37:37.455511] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-27T19:37:37.824417] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:37.849505] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T19:37:38.014940] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-27T19:37:38.762635] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:37:38.814958] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-27T19:37:39.450573] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T19:37:39.616730] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-27T19:37:39.619360] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:37:40.414997] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-27T19:37:40.967257] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T19:37:40.989740] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T19:37:41.214992] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-27T19:37:42.014958] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-27T19:37:42.580197] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:37:42.814946] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-27T19:37:43.614993] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-27T19:37:43.733492] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T19:37:43.993792] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T19:37:44.415029] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-27T19:37:44.865464] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:37:45.214906] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-27T19:37:45.376499] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:37:46.014973] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-27T19:37:46.788828] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:37:46.814898] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-27T19:37:47.088769] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T19:37:47.614919] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-27T19:37:48.414974] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-27T19:37:48.483672] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:37:48.926515] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T19:37:49.214976] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-27T19:37:49.943195] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:37:50.014933] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-27T19:37:50.801045] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:37:50.814896] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-27T19:37:51.122539] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T19:37:51.614930] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-27T19:37:51.937509] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:37:51.944298] [INFO ] [REMOTE ] KTB: Full fetch complete (58292 records). [2025-10-27T19:37:51.944399] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-27T19:37:52.319663] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-27T19:37:52.319774] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-27T19:37:52.320594] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-27T19:37:52.320636] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-27T19:37:52.321771] [DEBUG] [LOCAL ] KTB: Trimmed 58292 records to 39895 (keeping 200 days of data) [2025-10-27T19:37:52.414981] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-27T19:37:52.560532] [DEBUG] [LOCAL ] KTB: Primary data saved (39895 records). [2025-10-27T19:37:52.560685] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-27T19:37:52.560795] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KTB took 28.1s. Estimated remaining: 2h 27m 15s. Rate: 7.8 symbols/min [2025-10-27T19:37:52.731793] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:52.778723] [DEBUG] [LOCAL ] KVYO: Loaded 51644 existing records from primary storage. [2025-10-27T19:37:52.779076] [INFO ] [MAIN ] KVYO: Loaded 51644 existing records. [2025-10-27T19:37:52.971690] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:52.972076] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-27T19:37:52.978541] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-27T19:37:52.980036] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-27T19:37:52.979974] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T19:37:52.980157] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-27T19:37:53.216421] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-27T19:37:53.358852] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:53.393720] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T19:37:53.828301] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T19:37:54.014944] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-27T19:37:54.814937] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-27T19:37:55.614951] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-27T19:37:55.788574] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T19:37:56.027037] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:37:56.414977] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-27T19:37:56.756164] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T19:37:56.765906] [INFO ] [REMOTE ] KT: Full fetch complete (66661 records). [2025-10-27T19:37:56.766124] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-27T19:37:57.145477] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-27T19:37:57.145555] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-27T19:37:57.146495] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-27T19:37:57.146559] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-27T19:37:57.147844] [DEBUG] [LOCAL ] KT: Trimmed 66661 records to 45188 (keeping 200 days of data) [2025-10-27T19:37:57.234038] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-27T19:37:57.418077] [DEBUG] [LOCAL ] KT: Primary data saved (45188 records). [2025-10-27T19:37:57.418247] [INFO ] [MAIN ] KT: Full history saved. [2025-10-27T19:37:57.418343] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KT took 35.2s. Estimated remaining: 2h 27m 5s. Rate: 7.8 symbols/min [2025-10-27T19:37:57.588861] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:37:57.626465] [DEBUG] [LOCAL ] KW: Loaded 40820 existing records from primary storage. [2025-10-27T19:37:57.627005] [INFO ] [MAIN ] KW: Loaded 40820 existing records. [2025-10-27T19:37:57.769272] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:37:57.876698] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:37:57.877022] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-27T19:37:57.877073] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-27T19:37:57.877298] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-27T19:37:57.877338] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-27T19:37:58.023519] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-27T19:37:58.264296] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:37:58.502706] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T19:37:58.569168] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:37:58.815000] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-27T19:37:59.614924] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-27T19:38:00.029438] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:38:00.414960] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-27T19:38:01.214944] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-27T19:38:01.366618] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T19:38:02.014939] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-27T19:38:02.814946] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-27T19:38:03.498541] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-27T19:38:03.614970] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-27T19:38:03.638923] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-10-27T19:38:03.736105] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T19:38:04.414965] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-27T19:38:04.963292] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:38:05.215051] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-27T19:38:05.554471] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T19:38:06.014986] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-27T19:38:06.029219] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T19:38:06.031382] [INFO ] [REMOTE ] KTF: Full fetch complete (17376 records). [2025-10-27T19:38:06.031471] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-27T19:38:06.207322] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (3.39 seconds). [2025-10-27T19:38:06.436802] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-27T19:38:06.436876] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-27T19:38:06.437245] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-27T19:38:06.437285] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-27T19:38:06.437805] [DEBUG] [LOCAL ] KTF: Trimmed 17376 records to 11395 (keeping 200 days of data) [2025-10-27T19:38:06.507882] [DEBUG] [LOCAL ] KTF: Primary data saved (11395 records). [2025-10-27T19:38:06.508012] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-27T19:38:06.508109] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KTF took 31.9s. Estimated remaining: 2h 26m 58s. Rate: 7.8 symbols/min [2025-10-27T19:38:06.674413] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:06.691683] [DEBUG] [LOCAL ] KWR: Loaded 15854 existing records from primary storage. [2025-10-27T19:38:06.691933] [INFO ] [MAIN ] KWR: Loaded 15854 existing records. [2025-10-27T19:38:06.820141] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-27T19:38:06.878847] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:06.879069] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-27T19:38:06.879119] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-27T19:38:06.879311] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-27T19:38:06.879368] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-27T19:38:07.229115] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:07.614914] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-27T19:38:07.772486] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T19:38:07.782555] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-27T19:38:07.782708] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-27T19:38:08.170044] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-27T19:38:08.185883] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-27T19:38:08.196552] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-27T19:38:08.199415] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-27T19:38:08.201673] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-27T19:38:08.213621] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-27T19:38:08.419986] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-27T19:38:08.539072] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-27T19:38:08.539324] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-27T19:38:08.540284] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KVUE took 31.5s. Estimated remaining: 2h 26m 45s. Rate: 7.8 symbols/min [2025-10-27T19:38:08.711391] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:08.744314] [DEBUG] [LOCAL ] KYN: Loaded 30665 existing records from primary storage. [2025-10-27T19:38:08.744566] [INFO ] [MAIN ] KYN: Loaded 30665 existing records. [2025-10-27T19:38:08.954237] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:08.954489] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-27T19:38:08.954539] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-27T19:38:08.954768] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-27T19:38:08.954830] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-27T19:38:09.169273] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:38:09.218748] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-27T19:38:09.378996] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:09.687836] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T19:38:10.014948] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-27T19:38:10.403082] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:38:10.814978] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-27T19:38:11.127437] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T19:38:11.614973] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-27T19:38:12.352116] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T19:38:12.414971] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-27T19:38:12.555047] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T19:38:13.214974] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-27T19:38:13.621980] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T19:38:14.014898] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-27T19:38:14.558749] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:38:14.814987] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-27T19:38:15.614997] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-27T19:38:15.644518] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T19:38:15.817740] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:38:16.309819] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T19:38:16.414974] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-27T19:38:17.214954] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-27T19:38:17.815786] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T19:38:18.014931] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-27T19:38:18.299612] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:38:18.310154] [INFO ] [REMOTE ] KVYO: Full fetch complete (72433 records). [2025-10-27T19:38:18.310315] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-27T19:38:18.719987] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-27T19:38:18.720123] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-27T19:38:18.721170] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-27T19:38:18.721332] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-27T19:38:18.723073] [DEBUG] [LOCAL ] KVYO: Trimmed 72433 records to 50902 (keeping 200 days of data) [2025-10-27T19:38:18.818397] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-27T19:38:18.833116] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:38:19.035552] [DEBUG] [LOCAL ] KVYO: Primary data saved (50902 records). [2025-10-27T19:38:19.035728] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-27T19:38:19.035829] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVYO took 26.5s. Estimated remaining: 2h 26m 40s. Rate: 7.8 symbols/min [2025-10-27T19:38:19.205340] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:19.243925] [DEBUG] [LOCAL ] L: Loaded 41681 existing records from primary storage. [2025-10-27T19:38:19.244212] [INFO ] [MAIN ] L: Loaded 41681 existing records. [2025-10-27T19:38:19.417835] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:19.418182] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-27T19:38:19.418240] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-27T19:38:19.418866] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-27T19:38:19.418923] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-27T19:38:19.624015] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-27T19:38:19.791165] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:19.929492] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:38:20.414916] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-27T19:38:20.725092] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:38:21.214996] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-27T19:38:21.315484] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T19:38:21.944868] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T19:38:22.014927] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-27T19:38:22.814926] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-27T19:38:23.258808] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:38:23.615008] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-27T19:38:23.757408] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T19:38:24.415026] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-27T19:38:24.728315] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:38:24.735928] [INFO ] [REMOTE ] KW: Full fetch complete (57128 records). [2025-10-27T19:38:24.736083] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-27T19:38:25.123355] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-27T19:38:25.123478] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-27T19:38:25.124354] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-27T19:38:25.124418] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-27T19:38:25.125605] [DEBUG] [LOCAL ] KW: Trimmed 57128 records to 40000 (keeping 200 days of data) [2025-10-27T19:38:25.224808] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-27T19:38:25.362503] [DEBUG] [LOCAL ] KW: Primary data saved (40000 records). [2025-10-27T19:38:25.362703] [INFO ] [MAIN ] KW: Full history saved. [2025-10-27T19:38:25.362801] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KW took 27.9s. Estimated remaining: 2h 26m 31s. Rate: 7.8 symbols/min [2025-10-27T19:38:25.541485] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:25.590049] [DEBUG] [LOCAL ] LAC: Loaded 53351 existing records from primary storage. [2025-10-27T19:38:25.590348] [INFO ] [MAIN ] LAC: Loaded 53351 existing records. [2025-10-27T19:38:25.773163] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:25.773526] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-27T19:38:25.773631] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-27T19:38:25.774025] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-27T19:38:25.774135] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-27T19:38:25.918934] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:38:26.020079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-27T19:38:26.175402] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:26.202358] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T19:38:26.814952] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-27T19:38:27.260437] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:38:27.614978] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-27T19:38:27.765535] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:38:28.415022] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-27T19:38:29.157629] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:38:29.214962] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-27T19:38:29.254914] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:38:30.014950] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-27T19:38:30.188304] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:38:30.814947] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-27T19:38:31.412788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:38:31.535559] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T19:38:31.614926] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-27T19:38:32.414958] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-27T19:38:33.214986] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-27T19:38:33.262095] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:38:33.936409] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:38:34.014930] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-27T19:38:34.080340] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T19:38:34.814976] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-27T19:38:34.945497] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:38:34.948012] [INFO ] [REMOTE ] KWR: Full fetch complete (23047 records). [2025-10-27T19:38:34.948080] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-27T19:38:35.298679] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-27T19:38:35.298763] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-27T19:38:35.299233] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-27T19:38:35.299273] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-27T19:38:35.299877] [DEBUG] [LOCAL ] KWR: Trimmed 23047 records to 15417 (keeping 200 days of data) [2025-10-27T19:38:35.392114] [DEBUG] [LOCAL ] KWR: Primary data saved (15417 records). [2025-10-27T19:38:35.392241] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-27T19:38:35.392316] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KWR took 28.9s. Estimated remaining: 2h 26m 25s. Rate: 7.8 symbols/min [2025-10-27T19:38:35.554512] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:35.576821] [DEBUG] [LOCAL ] LAD: Loaded 23777 existing records from primary storage. [2025-10-27T19:38:35.577049] [INFO ] [MAIN ] LAD: Loaded 23777 existing records. [2025-10-27T19:38:35.620174] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-27T19:38:35.757192] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:35.757429] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-27T19:38:35.757489] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-27T19:38:35.757681] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-27T19:38:35.757737] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-27T19:38:36.127868] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:36.129353] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:38:36.414959] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-27T19:38:36.656886] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:38:37.214914] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-27T19:38:37.265986] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T19:38:38.014974] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-27T19:38:38.122095] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T19:38:38.814974] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-27T19:38:39.614973] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-27T19:38:39.810930] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:38:40.165675] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T19:38:40.414962] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-27T19:38:41.015988] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:38:41.214938] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-27T19:38:41.618132] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T19:38:42.014990] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-27T19:38:42.303833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T19:38:42.814982] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-27T19:38:42.947354] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:38:42.953319] [INFO ] [REMOTE ] KYN: Full fetch complete (44419 records). [2025-10-27T19:38:42.953403] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-27T19:38:43.322470] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-27T19:38:43.322558] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-27T19:38:43.323468] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-27T19:38:43.323552] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-27T19:38:43.324617] [DEBUG] [LOCAL ] KYN: Trimmed 44419 records to 29810 (keeping 200 days of data) [2025-10-27T19:38:43.504596] [DEBUG] [LOCAL ] KYN: Primary data saved (29810 records). [2025-10-27T19:38:43.504776] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-27T19:38:43.505520] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. KYN took 35.0s. Estimated remaining: 2h 26m 18s. Rate: 7.8 symbols/min [2025-10-27T19:38:43.620198] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-27T19:38:43.672313] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:43.712357] [DEBUG] [LOCAL ] LADR: Loaded 39961 existing records from primary storage. [2025-10-27T19:38:43.712669] [INFO ] [MAIN ] LADR: Loaded 39961 existing records. [2025-10-27T19:38:43.888176] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:43.888408] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-27T19:38:43.888455] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-27T19:38:43.888665] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-27T19:38:43.888724] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-27T19:38:44.247564] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:44.272008] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T19:38:44.414907] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-27T19:38:44.669494] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:38:45.214994] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-27T19:38:46.014973] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-27T19:38:46.161732] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:38:46.169702] [INFO ] [REMOTE ] L: Full fetch complete (59230 records). [2025-10-27T19:38:46.169839] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-27T19:38:46.556216] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-27T19:38:46.556395] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-27T19:38:46.563957] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-27T19:38:46.573840] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-27T19:38:46.575387] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:38:46.582108] [DEBUG] [LOCAL ] L: Trimmed 59230 records to 40785 (keeping 200 days of data) [2025-10-27T19:38:46.814995] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-27T19:38:46.820609] [DEBUG] [LOCAL ] L: Primary data saved (40785 records). [2025-10-27T19:38:46.820768] [INFO ] [MAIN ] L: Full history saved. [2025-10-27T19:38:46.820851] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. L took 27.8s. Estimated remaining: 2h 26m 6s. Rate: 7.8 symbols/min [2025-10-27T19:38:46.984351] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:38:46.989137] [DEBUG] [LOCAL ] LANV: Loaded 2817 existing records from primary storage. [2025-10-27T19:38:46.989281] [INFO ] [MAIN ] LANV: Loaded 2817 existing records. [2025-10-27T19:38:47.158122] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:38:47.158365] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-27T19:38:47.158412] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-27T19:38:47.158553] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-27T19:38:47.158590] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-27T19:38:47.507944] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:38:47.571217] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:38:47.614906] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-27T19:38:47.737629] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T19:38:48.159999] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T19:38:48.414995] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-27T19:38:49.214942] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-27T19:38:49.556587] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T19:38:49.730729] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:38:50.014934] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-27T19:38:50.814992] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-27T19:38:50.978773] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T19:38:51.614932] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-27T19:38:52.230196] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T19:38:52.414928] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-27T19:38:52.537275] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:38:53.214946] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-27T19:38:53.519930] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T19:38:53.723241] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T19:38:54.014928] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-27T19:38:54.460415] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T19:38:54.814943] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-27T19:38:55.614932] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-27T19:38:55.766542] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T19:38:56.027200] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T19:38:56.414945] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-27T19:38:56.884252] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T19:38:57.214940] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-27T19:38:58.014939] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-27T19:38:58.702406] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T19:38:58.814962] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-27T19:38:59.121141] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T19:38:59.614928] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-27T19:38:59.962210] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:39:00.414952] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-27T19:39:01.222510] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-27T19:39:01.244603] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T19:39:02.014954] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-27T19:39:02.815000] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-27T19:39:03.720630] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:39:03.722105] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-27T19:39:04.336621] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T19:39:04.414894] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-27T19:39:04.563288] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (4.15 seconds). [2025-10-27T19:39:04.918742] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T19:39:05.140944] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (3.92 seconds). [2025-10-27T19:39:05.214998] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-27T19:39:05.475212] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T19:39:05.476327] [INFO ] [REMOTE ] LANV: Full fetch complete (4234 records). [2025-10-27T19:39:05.476396] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-27T19:39:05.828943] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-27T19:39:05.829014] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-27T19:39:05.829140] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-27T19:39:05.829177] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-27T19:39:05.829505] [DEBUG] [LOCAL ] LANV: Trimmed 4234 records to 2761 (keeping 200 days of data) [2025-10-27T19:39:05.844194] [DEBUG] [LOCAL ] LANV: Primary data saved (2761 records). [2025-10-27T19:39:05.844254] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-27T19:39:05.844318] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LANV took 19.0s. Estimated remaining: 2h 26m 9s. Rate: 7.8 symbols/min [2025-10-27T19:39:06.010989] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:06.011153] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-27T19:39:06.011189] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-27T19:39:06.011293] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-27T19:39:06.011337] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-27T19:39:06.011420] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-27T19:39:06.011470] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-27T19:39:06.023111] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-27T19:39:06.366093] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:06.814935] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-27T19:39:07.078158] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T19:39:07.133186] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T19:39:07.290838] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T19:39:07.614931] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-27T19:39:08.414935] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-27T19:39:09.214996] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-27T19:39:09.472873] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T19:39:10.014943] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-27T19:39:10.326812] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-27T19:39:10.336994] [INFO ] [REMOTE ] LAC: Full fetch complete (76151 records). [2025-10-27T19:39:10.337109] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-27T19:39:10.728201] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-27T19:39:10.735234] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-27T19:39:10.747913] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-27T19:39:10.748046] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-27T19:39:10.750014] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:39:10.758475] [DEBUG] [LOCAL ] LAC: Trimmed 76151 records to 52585 (keeping 200 days of data) [2025-10-27T19:39:10.837473] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-27T19:39:11.061854] [DEBUG] [LOCAL ] LAC: Primary data saved (52585 records). [2025-10-27T19:39:11.062206] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-27T19:39:11.062309] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LAC took 45.7s. Estimated remaining: 2h 25m 59s. Rate: 7.8 symbols/min [2025-10-27T19:39:11.271776] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:11.313237] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:39:11.336378] [DEBUG] [LOCAL ] LAW: Loaded 15240 existing records from primary storage. [2025-10-27T19:39:11.336638] [INFO ] [MAIN ] LAW: Loaded 15240 existing records. [2025-10-27T19:39:11.593325] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:11.593631] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-27T19:39:11.593724] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-27T19:39:11.593889] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-27T19:39:11.593929] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-27T19:39:11.620402] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-27T19:39:12.100572] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:12.131128] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:39:12.414961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-27T19:39:12.974391] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T19:39:12.980247] [INFO ] [REMOTE ] LAD: Full fetch complete (35751 records). [2025-10-27T19:39:12.980384] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-27T19:39:13.137501] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T19:39:13.220211] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-27T19:39:13.370956] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-27T19:39:13.371030] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-27T19:39:13.371715] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-27T19:39:13.371774] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-27T19:39:13.372561] [DEBUG] [LOCAL ] LAD: Trimmed 35751 records to 23328 (keeping 200 days of data) [2025-10-27T19:39:13.524000] [DEBUG] [LOCAL ] LAD: Primary data saved (23328 records). [2025-10-27T19:39:13.524117] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-27T19:39:13.524193] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LAD took 38.1s. Estimated remaining: 2h 25m 46s. Rate: 7.8 symbols/min [2025-10-27T19:39:13.691280] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:13.730785] [DEBUG] [LOCAL ] LAZ: Loaded 45115 existing records from primary storage. [2025-10-27T19:39:13.731107] [INFO ] [MAIN ] LAZ: Loaded 45115 existing records. [2025-10-27T19:39:13.927966] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:13.928225] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-27T19:39:13.928278] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-27T19:39:13.928485] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-27T19:39:13.928540] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-27T19:39:14.037010] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-27T19:39:14.050674] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T19:39:14.292219] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:14.814961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-27T19:39:15.325209] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T19:39:15.511019] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:39:15.614961] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-27T19:39:16.122971] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T19:39:16.414943] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-27T19:39:17.214963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-27T19:39:17.978276] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:39:18.014907] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-27T19:39:18.376283] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T19:39:18.814955] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-27T19:39:19.285282] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T19:39:19.614939] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-27T19:39:19.931222] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T19:39:20.415003] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-27T19:39:21.085837] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T19:39:21.214988] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-27T19:39:21.275883] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T19:39:22.015003] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-27T19:39:22.815006] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-27T19:39:23.096175] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T19:39:23.103938] [INFO ] [REMOTE ] LADR: Full fetch complete (55703 records). [2025-10-27T19:39:23.104068] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-27T19:39:23.480329] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-27T19:39:23.480431] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-27T19:39:23.481294] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-27T19:39:23.481377] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-27T19:39:23.482530] [DEBUG] [LOCAL ] LADR: Trimmed 55703 records to 39131 (keeping 200 days of data) [2025-10-27T19:39:23.651916] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-27T19:39:23.721179] [DEBUG] [LOCAL ] LADR: Primary data saved (39131 records). [2025-10-27T19:39:23.721524] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-27T19:39:23.722225] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LADR took 40.2s. Estimated remaining: 2h 25m 41s. Rate: 7.8 symbols/min [2025-10-27T19:39:23.860134] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:39:23.938026] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:23.973804] [DEBUG] [LOCAL ] LB: Loaded 37459 existing records from primary storage. [2025-10-27T19:39:23.974090] [INFO ] [MAIN ] LB: Loaded 37459 existing records. [2025-10-27T19:39:24.146940] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:24.147130] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-27T19:39:24.147177] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-27T19:39:24.147384] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-27T19:39:24.147439] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-27T19:39:24.431705] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-27T19:39:24.436813] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:39:24.522053] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:24.756976] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T19:39:25.214970] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-27T19:39:25.837770] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:39:26.014908] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-27T19:39:26.318009] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T19:39:26.814936] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-27T19:39:27.369210] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:39:27.614901] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-27T19:39:27.713176] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T19:39:28.414988] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-27T19:39:28.870518] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T19:39:29.214953] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-27T19:39:29.910458] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:39:30.014951] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-27T19:39:30.584639] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:39:30.614190] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:39:30.814980] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-27T19:39:31.614914] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-27T19:39:31.760477] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T19:39:32.415014] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-27T19:39:32.881339] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T19:39:33.215052] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-27T19:39:33.971846] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T19:39:34.014920] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-27T19:39:34.148803] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T19:39:34.152975] [INFO ] [REMOTE ] LAW: Full fetch complete (21217 records). [2025-10-27T19:39:34.153054] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-27T19:39:34.509408] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-27T19:39:34.509481] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-27T19:39:34.509958] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-27T19:39:34.510019] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-27T19:39:34.510565] [DEBUG] [LOCAL ] LAW: Trimmed 21217 records to 15098 (keeping 200 days of data) [2025-10-27T19:39:34.592106] [DEBUG] [LOCAL ] LAW: Primary data saved (15098 records). [2025-10-27T19:39:34.592212] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-27T19:39:34.592299] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAW took 23.5s. Estimated remaining: 2h 25m 36s. Rate: 7.8 symbols/min [2025-10-27T19:39:34.814941] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-27T19:39:35.195543] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:39:35.614957] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-27T19:39:36.293743] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T19:39:36.414944] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-27T19:39:36.616358] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T19:39:37.214947] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-27T19:39:38.014972] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-27T19:39:38.287363] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:39:38.358385] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T19:39:38.369381] [INFO ] [REMOTE ] LAR: Full fetch complete (63615 records). [2025-10-27T19:39:38.369503] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-27T19:39:38.582272] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-27T19:39:38.582931] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:39:38.583004] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:39:38.583077] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-27T19:39:38.583141] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-27T19:39:38.583177] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-27T19:39:38.583216] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-27T19:39:38.583278] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAR took 32.7s. Estimated remaining: 2h 25m 25s. Rate: 7.8 symbols/min [2025-10-27T19:39:38.814963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-27T19:39:39.140864] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T19:39:39.614996] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-27T19:39:40.017925] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T19:39:40.025713] [INFO ] [REMOTE ] LAZ: Full fetch complete (65336 records). [2025-10-27T19:39:40.025822] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-27T19:39:40.405807] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-27T19:39:40.405882] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-27T19:39:40.406820] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-27T19:39:40.406880] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-27T19:39:40.408127] [DEBUG] [LOCAL ] LAZ: Trimmed 65336 records to 44276 (keeping 200 days of data) [2025-10-27T19:39:40.672474] [DEBUG] [LOCAL ] LAZ: Primary data saved (44276 records). [2025-10-27T19:39:40.672787] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-27T19:39:40.673299] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LAZ took 27.1s. Estimated remaining: 2h 25m 12s. Rate: 7.8 symbols/min [2025-10-27T19:39:40.725981] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T19:39:40.733811] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-27T19:39:42.139264] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T19:39:42.147616] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-27T19:39:43.326718] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:39:43.334549] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-27T19:39:44.990588] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T19:39:45.000317] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-27T19:39:46.464469] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:39:46.472896] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-27T19:39:47.745303] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T19:39:47.753293] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-27T19:39:48.826510] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:39:48.833733] [INFO ] [REMOTE ] LB: Full fetch complete (55494 records). [2025-10-27T19:39:48.833880] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-27T19:39:49.220628] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-27T19:39:49.220745] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-27T19:39:49.221573] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-27T19:39:49.221621] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-27T19:39:49.222747] [DEBUG] [LOCAL ] LB: Trimmed 55494 records to 36633 (keeping 200 days of data) [2025-10-27T19:39:49.442397] [DEBUG] [LOCAL ] LB: Primary data saved (36633 records). [2025-10-27T19:39:49.442528] [INFO ] [MAIN ] LB: Full history saved. [2025-10-27T19:39:49.442679] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LB took 25.7s. Estimated remaining: 2h 25m 5s. Rate: 7.8 symbols/min [2025-10-27T19:39:50.124899] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.145459] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.147403] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.166131] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:39:50.203362] [DEBUG] [LOCAL ] LCII: Loaded 27122 existing records from primary storage. [2025-10-27T19:39:50.226736] [INFO ] [MAIN ] LCII: Loaded 27122 existing records. [2025-10-27T19:39:50.324024] [DEBUG] [LOCAL ] LC: Loaded 49022 existing records from primary storage. [2025-10-27T19:39:50.309221] [DEBUG] [LOCAL ] LDI: Loaded 45883 existing records from primary storage. [2025-10-27T19:39:50.370514] [INFO ] [MAIN ] LC: Loaded 49022 existing records. [2025-10-27T19:39:50.370343] [INFO ] [MAIN ] LDI: Loaded 45883 existing records. [2025-10-27T19:39:50.380197] [DEBUG] [LOCAL ] LBRT: Loaded 53783 existing records from primary storage. [2025-10-27T19:39:50.533782] [INFO ] [MAIN ] LBRT: Loaded 53783 existing records. [2025-10-27T19:39:50.728822] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.784876] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-27T19:39:50.822891] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-27T19:39:50.905553] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-27T19:39:50.914623] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.939443] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-27T19:39:50.905817] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-27T19:39:50.939694] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-27T19:39:50.966170] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:50.988407] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-27T19:39:51.011767] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-27T19:39:51.002336] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-27T19:39:51.098454] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-27T19:39:51.178456] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-27T19:39:51.220677] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:39:51.264044] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-27T19:39:51.280193] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-27T19:39:51.387887] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-27T19:39:51.478368] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-27T19:39:51.537916] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-27T19:39:52.229355] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.260162] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.260469] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-27T19:39:52.285902] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-27T19:39:52.469293] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.471887] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-27T19:39:52.549751] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:39:52.549995] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-27T19:39:53.407812] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:39:53.412576] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-27T19:39:53.866539] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T19:39:53.873878] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-27T19:39:53.906462] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T19:39:53.916948] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-27T19:39:54.598136] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:39:54.608335] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-27T19:39:54.633359] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T19:39:54.638848] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-27T19:39:54.677836] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:39:54.685065] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-27T19:39:55.573896] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:39:55.581182] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-27T19:39:55.641211] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T19:39:55.655963] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-27T19:39:55.762549] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T19:39:55.772336] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-27T19:39:56.158201] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T19:39:56.167218] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-27T19:39:57.086249] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:39:57.097418] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-27T19:39:57.139303] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:39:57.214918] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-27T19:39:57.265303] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:39:57.590629] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:39:58.014964] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-27T19:39:58.147139] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T19:39:58.500094] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:39:58.814917] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-27T19:39:59.490865] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T19:39:59.614899] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-27T19:40:00.095551] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:40:00.414959] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-27T19:40:01.214985] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-27T19:40:01.570796] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T19:40:02.014990] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-27T19:40:02.749473] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-27T19:40:02.814955] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-27T19:40:03.615022] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-27T19:40:04.291972] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-10-27T19:40:04.414970] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-27T19:40:04.762502] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-27T19:40:05.065076] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:40:05.136278] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T19:40:05.214965] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-27T19:40:06.014908] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-27T19:40:06.070596] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T19:40:06.371179] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:40:06.814936] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-27T19:40:07.614940] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-27T19:40:07.993346] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T19:40:08.253137] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-27T19:40:08.279506] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:40:08.414932] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-27T19:40:09.214945] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-27T19:40:09.703917] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:40:10.015000] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-27T19:40:10.814928] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-27T19:40:11.614952] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-27T19:40:11.893792] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:40:12.228760] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T19:40:12.233291] [INFO ] [REMOTE ] LCII: Full fetch complete (39063 records). [2025-10-27T19:40:12.233384] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-27T19:40:12.424675] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-27T19:40:12.516734] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:40:12.674711] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-27T19:40:12.674804] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-27T19:40:12.675496] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-27T19:40:12.675537] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-27T19:40:12.676524] [DEBUG] [LOCAL ] LCII: Trimmed 39063 records to 26354 (keeping 200 days of data) [2025-10-27T19:40:12.836224] [DEBUG] [LOCAL ] LCII: Primary data saved (26354 records). [2025-10-27T19:40:12.836416] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-27T19:40:12.836593] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 23.4s. Estimated remaining: 2h 25m 12s. Rate: 7.7 symbols/min [2025-10-27T19:40:13.011462] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:13.039377] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:40:13.085433] [DEBUG] [LOCAL ] LDOS: Loaded 45191 existing records from primary storage. [2025-10-27T19:40:13.085768] [INFO ] [MAIN ] LDOS: Loaded 45191 existing records. [2025-10-27T19:40:13.221432] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-27T19:40:13.268237] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:13.268445] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-27T19:40:13.268493] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-27T19:40:13.268711] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-27T19:40:13.268769] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-27T19:40:13.616255] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:14.015028] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-27T19:40:14.109416] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T19:40:14.119991] [INFO ] [REMOTE ] LBRT: Full fetch complete (76929 records). [2025-10-27T19:40:14.120168] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-27T19:40:14.512353] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-27T19:40:14.512491] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-27T19:40:14.513660] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-27T19:40:14.513769] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-27T19:40:14.540301] [DEBUG] [LOCAL ] LBRT: Trimmed 76929 records to 53003 (keeping 200 days of data) [2025-10-27T19:40:14.541829] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:40:14.825204] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-27T19:40:14.871790] [DEBUG] [LOCAL ] LBRT: Primary data saved (53003 records). [2025-10-27T19:40:14.871894] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-27T19:40:14.871968] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LBRT took 25.4s. Estimated remaining: 2h 24m 59s. Rate: 7.8 symbols/min [2025-10-27T19:40:15.040264] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:15.054335] [DEBUG] [LOCAL ] LDP: Loaded 12611 existing records from primary storage. [2025-10-27T19:40:15.054719] [INFO ] [MAIN ] LDP: Loaded 12611 existing records. [2025-10-27T19:40:15.229857] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:15.230189] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-27T19:40:15.230249] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-27T19:40:15.230416] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-27T19:40:15.230471] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-27T19:40:15.351745] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:40:15.606457] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:15.614904] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-27T19:40:16.252002] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T19:40:16.261509] [INFO ] [REMOTE ] LC: Full fetch complete (70736 records). [2025-10-27T19:40:16.261619] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-27T19:40:16.418377] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-27T19:40:16.654058] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-27T19:40:16.654225] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-27T19:40:16.655193] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-27T19:40:16.655281] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-27T19:40:16.656872] [DEBUG] [LOCAL ] LC: Trimmed 70736 records to 48250 (keeping 200 days of data) [2025-10-27T19:40:16.781955] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:40:16.977131] [DEBUG] [LOCAL ] LC: Primary data saved (48250 records). [2025-10-27T19:40:16.977264] [INFO ] [MAIN ] LC: Full history saved. [2025-10-27T19:40:16.977810] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LC took 27.5s. Estimated remaining: 2h 24m 46s. Rate: 7.8 symbols/min [2025-10-27T19:40:17.143672] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:17.185357] [DEBUG] [LOCAL ] LEA: Loaded 41626 existing records from primary storage. [2025-10-27T19:40:17.185627] [INFO ] [MAIN ] LEA: Loaded 41626 existing records. [2025-10-27T19:40:17.220271] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-27T19:40:17.362210] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:17.362384] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-27T19:40:17.362428] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-27T19:40:17.362598] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-27T19:40:17.362634] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-27T19:40:17.715894] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:17.742967] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T19:40:17.778579] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T19:40:18.014976] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-27T19:40:18.814972] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-27T19:40:19.615086] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-27T19:40:19.648563] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T19:40:20.133993] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T19:40:20.414974] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-27T19:40:21.093728] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T19:40:21.214948] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-27T19:40:21.789911] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T19:40:22.015000] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-27T19:40:22.815047] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-27T19:40:23.016108] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T19:40:23.026003] [INFO ] [REMOTE ] LDI: Full fetch complete (62457 records). [2025-10-27T19:40:23.026112] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-27T19:40:23.424348] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-27T19:40:23.424528] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-27T19:40:23.425728] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T19:40:23.430350] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-27T19:40:23.430762] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-27T19:40:23.440965] [DEBUG] [LOCAL ] LDI: Trimmed 62457 records to 45259 (keeping 200 days of data) [2025-10-27T19:40:23.458288] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:40:23.621207] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-27T19:40:23.718670] [DEBUG] [LOCAL ] LDI: Primary data saved (45259 records). [2025-10-27T19:40:23.718804] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-27T19:40:23.719618] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LDI took 34.2s. Estimated remaining: 2h 24m 37s. Rate: 7.8 symbols/min [2025-10-27T19:40:23.889790] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:23.937697] [DEBUG] [LOCAL ] LEG: Loaded 50679 existing records from primary storage. [2025-10-27T19:40:23.937987] [INFO ] [MAIN ] LEG: Loaded 50679 existing records. [2025-10-27T19:40:24.119559] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:24.119916] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-27T19:40:24.119974] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-27T19:40:24.120555] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-27T19:40:24.120612] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-27T19:40:24.420130] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-27T19:40:24.470989] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:25.215556] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-27T19:40:25.218603] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:40:25.332885] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T19:40:26.014959] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-27T19:40:26.815030] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-27T19:40:26.892393] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:40:27.131149] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T19:40:27.614956] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-27T19:40:28.414988] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-27T19:40:28.629106] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T19:40:29.138296] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:40:29.214974] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-27T19:40:29.533276] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:40:30.015002] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-27T19:40:30.481976] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T19:40:30.778288] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T19:40:30.815040] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-27T19:40:31.615037] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-27T19:40:31.815687] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:40:32.415002] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-27T19:40:32.930682] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T19:40:33.214978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-27T19:40:33.976490] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:40:34.014897] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-27T19:40:34.424367] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:40:34.814943] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-27T19:40:35.527129] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T19:40:35.622856] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-27T19:40:35.639268] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:40:36.417985] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-27T19:40:36.421224] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T19:40:37.214939] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-27T19:40:37.659579] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:40:38.014919] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-27T19:40:38.622450] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:40:38.814966] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-27T19:40:39.236006] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:40:39.614950] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-27T19:40:40.389030] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:40:40.414906] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-27T19:40:40.590282] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:40:41.214930] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-27T19:40:41.947687] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T19:40:42.014908] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-27T19:40:42.295013] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:40:42.814946] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-27T19:40:43.105555] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T19:40:43.614923] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-27T19:40:43.647938] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T19:40:43.650576] [INFO ] [REMOTE ] LDP: Full fetch complete (18707 records). [2025-10-27T19:40:43.650711] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-27T19:40:44.010485] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-27T19:40:44.010559] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-27T19:40:44.010993] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-27T19:40:44.011055] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-27T19:40:44.011592] [DEBUG] [LOCAL ] LDP: Trimmed 18707 records to 12250 (keeping 200 days of data) [2025-10-27T19:40:44.083293] [DEBUG] [LOCAL ] LDP: Primary data saved (12250 records). [2025-10-27T19:40:44.083416] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-27T19:40:44.083496] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 29.2s. Estimated remaining: 2h 24m 41s. Rate: 7.7 symbols/min [2025-10-27T19:40:44.244728] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:44.295091] [DEBUG] [LOCAL ] LEN: Loaded 53974 existing records from primary storage. [2025-10-27T19:40:44.295385] [INFO ] [MAIN ] LEN: Loaded 53974 existing records. [2025-10-27T19:40:44.420124] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-27T19:40:44.473302] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:44.473494] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-27T19:40:44.473541] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-27T19:40:44.473763] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-27T19:40:44.473819] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-27T19:40:44.817544] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:45.196221] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:40:45.203622] [INFO ] [REMOTE ] LEA: Full fetch complete (60376 records). [2025-10-27T19:40:45.203784] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-27T19:40:45.224576] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-27T19:40:45.636122] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-27T19:40:45.636336] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-27T19:40:45.637365] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-27T19:40:45.637453] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-27T19:40:45.639232] [DEBUG] [LOCAL ] LEA: Trimmed 60376 records to 40872 (keeping 200 days of data) [2025-10-27T19:40:45.793103] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:40:45.930438] [DEBUG] [LOCAL ] LEA: Primary data saved (40872 records). [2025-10-27T19:40:45.930567] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-27T19:40:45.930663] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 29.0s. Estimated remaining: 2h 24m 28s. Rate: 7.8 symbols/min [2025-10-27T19:40:46.024758] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-27T19:40:46.096090] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:46.113172] [DEBUG] [LOCAL ] LEO: Loaded 17046 existing records from primary storage. [2025-10-27T19:40:46.113409] [INFO ] [MAIN ] LEO: Loaded 17046 existing records. [2025-10-27T19:40:46.285803] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:46.286015] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-27T19:40:46.286061] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-27T19:40:46.286223] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-27T19:40:46.286260] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-27T19:40:46.636916] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:46.814935] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-27T19:40:46.986438] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T19:40:47.315084] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T19:40:47.396617] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:40:47.614968] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-27T19:40:48.414953] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-27T19:40:48.861508] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:40:49.214935] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-27T19:40:49.876115] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:40:50.014946] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-27T19:40:50.801448] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T19:40:50.810715] [INFO ] [REMOTE ] LEG: Full fetch complete (72776 records). [2025-10-27T19:40:50.810855] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-27T19:40:50.822579] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-27T19:40:51.198800] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-27T19:40:51.198909] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-27T19:40:51.200021] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-27T19:40:51.200106] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-27T19:40:51.201711] [DEBUG] [LOCAL ] LEG: Trimmed 72776 records to 49847 (keeping 200 days of data) [2025-10-27T19:40:51.435453] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T19:40:51.539118] [DEBUG] [LOCAL ] LEG: Primary data saved (49847 records). [2025-10-27T19:40:51.539264] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-27T19:40:51.540065] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEG took 27.8s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min [2025-10-27T19:40:51.620093] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-27T19:40:51.738413] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:51.794746] [DEBUG] [LOCAL ] LEVI: Loaded 52588 existing records from primary storage. [2025-10-27T19:40:51.795069] [INFO ] [MAIN ] LEVI: Loaded 52588 existing records. [2025-10-27T19:40:52.024316] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:52.024550] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-27T19:40:52.024626] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-27T19:40:52.024913] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-27T19:40:52.024982] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-27T19:40:52.176118] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:40:52.420255] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-27T19:40:52.592171] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:53.214482] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T19:40:53.225558] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-27T19:40:53.695152] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:40:53.704525] [INFO ] [REMOTE ] LDOS: Full fetch complete (66694 records). [2025-10-27T19:40:53.704730] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-27T19:40:54.029282] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-27T19:40:54.084268] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-27T19:40:54.084339] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-27T19:40:54.085294] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-27T19:40:54.085358] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-27T19:40:54.086613] [DEBUG] [LOCAL ] LDOS: Trimmed 66694 records to 44312 (keeping 200 days of data) [2025-10-27T19:40:54.354819] [DEBUG] [LOCAL ] LDOS: Primary data saved (44312 records). [2025-10-27T19:40:54.354935] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-27T19:40:54.355348] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LDOS took 41.5s. Estimated remaining: 2h 24m 6s. Rate: 7.8 symbols/min [2025-10-27T19:40:54.527176] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:40:54.545786] [DEBUG] [LOCAL ] LFT: Loaded 18343 existing records from primary storage. [2025-10-27T19:40:54.546024] [INFO ] [MAIN ] LFT: Loaded 18343 existing records. [2025-10-27T19:40:54.727228] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:40:54.727555] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-27T19:40:54.727740] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-27T19:40:54.727981] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-27T19:40:54.728057] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-27T19:40:54.818443] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-27T19:40:54.950631] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T19:40:55.174635] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:40:55.436576] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:40:55.498757] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T19:40:55.614993] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-27T19:40:56.414969] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-27T19:40:56.692342] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T19:40:57.214947] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-27T19:40:57.362174] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T19:40:58.014944] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-27T19:40:58.690505] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:40:58.814925] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-27T19:40:58.856070] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:40:59.543089] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:40:59.614939] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-27T19:41:00.414952] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-27T19:41:00.970553] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:41:01.214937] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-27T19:41:02.014951] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-27T19:41:02.814998] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-27T19:41:03.017979] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T19:41:03.538099] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T19:41:03.614934] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-27T19:41:03.679165] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-27T19:41:04.414942] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-27T19:41:04.975330] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T19:41:05.214957] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-27T19:41:05.385790] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T19:41:06.014934] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-27T19:41:06.409047] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:41:06.629754] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T19:41:06.814916] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-27T19:41:07.126920] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T19:41:07.614991] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-27T19:41:08.414919] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-27T19:41:08.490728] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:41:08.657921] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T19:41:09.219918] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-27T19:41:09.222259] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T19:41:10.014949] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-27T19:41:10.202245] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:41:10.814961] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-27T19:41:11.614998] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-27T19:41:11.673459] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T19:41:11.715321] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:41:12.414987] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-27T19:41:12.554318] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T19:41:13.214949] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-27T19:41:13.817314] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:41:13.992584] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T19:41:14.014901] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-27T19:41:14.769590] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T19:41:14.772721] [INFO ] [REMOTE ] LFT: Full fetch complete (23752 records). [2025-10-27T19:41:14.772792] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-27T19:41:14.823624] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-27T19:41:15.131617] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-27T19:41:15.131755] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-27T19:41:15.132238] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-27T19:41:15.132277] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-27T19:41:15.132923] [DEBUG] [LOCAL ] LFT: Trimmed 23752 records to 18012 (keeping 200 days of data) [2025-10-27T19:41:15.232291] [DEBUG] [LOCAL ] LFT: Primary data saved (18012 records). [2025-10-27T19:41:15.232419] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-27T19:41:15.232497] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LFT took 20.9s. Estimated remaining: 2h 24m 10s. Rate: 7.7 symbols/min [2025-10-27T19:41:15.397099] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:15.408403] [DEBUG] [LOCAL ] LGI: Loaded 10091 existing records from primary storage. [2025-10-27T19:41:15.408611] [INFO ] [MAIN ] LGI: Loaded 10091 existing records. [2025-10-27T19:41:15.582923] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:15.583153] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-27T19:41:15.583200] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-27T19:41:15.583351] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-27T19:41:15.583388] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-27T19:41:15.624275] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-27T19:41:15.935806] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:16.414988] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-27T19:41:16.426254] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T19:41:16.429715] [INFO ] [REMOTE ] LEO: Full fetch complete (26391 records). [2025-10-27T19:41:16.429796] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-27T19:41:16.811297] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-27T19:41:16.811392] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-27T19:41:16.811954] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-27T19:41:16.812040] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-27T19:41:16.812957] [DEBUG] [LOCAL ] LEO: Trimmed 26391 records to 16427 (keeping 200 days of data) [2025-10-27T19:41:16.909342] [DEBUG] [LOCAL ] LEO: Primary data saved (16427 records). [2025-10-27T19:41:16.909623] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-27T19:41:16.909855] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LEO took 31.0s. Estimated remaining: 2h 23m 57s. Rate: 7.8 symbols/min [2025-10-27T19:41:17.037864] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T19:41:17.049298] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:41:17.131363] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:17.166176] [DEBUG] [LOCAL ] LH: Loaded 37491 existing records from primary storage. [2025-10-27T19:41:17.166443] [INFO ] [MAIN ] LH: Loaded 37491 existing records. [2025-10-27T19:41:17.214910] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-27T19:41:17.350694] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:17.350869] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-27T19:41:17.350918] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-27T19:41:17.351093] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-27T19:41:17.351147] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-27T19:41:17.716353] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:17.989177] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:41:18.014906] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-27T19:41:18.814916] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-27T19:41:18.823921] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T19:41:19.614997] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-27T19:41:20.414989] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-27T19:41:20.730327] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T19:41:20.769914] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T19:41:21.165555] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T19:41:21.215022] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-27T19:41:21.683886] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T19:41:22.015011] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-27T19:41:22.815032] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-27T19:41:23.468394] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:41:23.471391] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T19:41:23.614983] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-27T19:41:24.414996] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-27T19:41:24.886517] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:41:25.214950] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-27T19:41:25.218031] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:41:26.014940] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-27T19:41:26.814949] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-27T19:41:27.122435] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T19:41:27.545828] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T19:41:27.614931] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-27T19:41:27.788998] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-27T19:41:27.799925] [INFO ] [REMOTE ] LEN: Full fetch complete (77224 records). [2025-10-27T19:41:27.800127] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-27T19:41:28.142672] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T19:41:28.221330] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-27T19:41:28.221414] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-27T19:41:28.222428] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-27T19:41:28.222494] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-27T19:41:28.223960] [DEBUG] [LOCAL ] LEN: Trimmed 77224 records to 53194 (keeping 200 days of data) [2025-10-27T19:41:28.433802] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-27T19:41:28.552174] [DEBUG] [LOCAL ] LEN: Primary data saved (53194 records). [2025-10-27T19:41:28.552313] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-27T19:41:28.552391] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LEN took 44.5s. Estimated remaining: 2h 23m 53s. Rate: 7.7 symbols/min [2025-10-27T19:41:28.715721] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:28.761582] [DEBUG] [LOCAL ] LHX: Loaded 49076 existing records from primary storage. [2025-10-27T19:41:28.761965] [INFO ] [MAIN ] LHX: Loaded 49076 existing records. [2025-10-27T19:41:28.934064] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:28.934286] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-27T19:41:28.934333] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-27T19:41:28.934529] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-27T19:41:28.934582] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-27T19:41:29.124185] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T19:41:29.185492] [INFO ] [REMOTE ] LGI: Full fetch complete (14487 records). [2025-10-27T19:41:29.191194] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-27T19:41:29.220278] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-27T19:41:29.435472] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:29.698939] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-27T19:41:29.699040] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-27T19:41:29.699357] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-27T19:41:29.699396] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-27T19:41:29.699907] [DEBUG] [LOCAL ] LGI: Trimmed 14487 records to 9859 (keeping 200 days of data) [2025-10-27T19:41:29.757901] [DEBUG] [LOCAL ] LGI: Primary data saved (9859 records). [2025-10-27T19:41:29.758026] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-27T19:41:29.758113] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LGI took 14.5s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-10-27T19:41:29.924951] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:29.952399] [DEBUG] [LOCAL ] LII: Loaded 28260 existing records from primary storage. [2025-10-27T19:41:29.952673] [INFO ] [MAIN ] LII: Loaded 28260 existing records. [2025-10-27T19:41:30.020129] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-27T19:41:30.132523] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:30.132757] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-27T19:41:30.132807] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-27T19:41:30.132996] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-27T19:41:30.133051] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-27T19:41:30.486020] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:30.795522] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:41:30.814919] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-27T19:41:31.614930] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-27T19:41:31.699466] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T19:41:32.414911] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-27T19:41:32.606722] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T19:41:32.669250] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T19:41:33.214938] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-27T19:41:34.014938] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-27T19:41:34.380441] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:41:34.390604] [INFO ] [REMOTE ] LEVI: Full fetch complete (75005 records). [2025-10-27T19:41:34.390770] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-27T19:41:34.780395] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-27T19:41:34.780639] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-27T19:41:34.781921] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-27T19:41:34.782039] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-27T19:41:34.783769] [DEBUG] [LOCAL ] LEVI: Trimmed 75005 records to 51807 (keeping 200 days of data) [2025-10-27T19:41:34.843292] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-27T19:41:35.029924] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T19:41:35.144086] [DEBUG] [LOCAL ] LEVI: Primary data saved (51807 records). [2025-10-27T19:41:35.144221] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-27T19:41:35.144942] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LEVI took 43.6s. Estimated remaining: 2h 23m 29s. Rate: 7.8 symbols/min [2025-10-27T19:41:35.313370] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:35.358518] [DEBUG] [LOCAL ] LION: Loaded 47662 existing records from primary storage. [2025-10-27T19:41:35.358939] [INFO ] [MAIN ] LION: Loaded 47662 existing records. [2025-10-27T19:41:35.562360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T19:41:35.566036] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:35.575579] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-27T19:41:35.575675] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-27T19:41:35.576046] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-27T19:41:35.576112] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-27T19:41:35.620014] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-27T19:41:35.928878] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:36.097998] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T19:41:36.415049] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-27T19:41:37.214957] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-27T19:41:37.271467] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T19:41:37.657243] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T19:41:38.014949] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-27T19:41:38.235252] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T19:41:38.814936] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-27T19:41:39.401754] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T19:41:39.614966] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-27T19:41:39.766163] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T19:41:40.414992] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-27T19:41:41.116471] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:41:41.214920] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-27T19:41:42.008580] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:41:42.018799] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-27T19:41:42.497360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T19:41:42.814931] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-27T19:41:43.231230] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:41:43.614993] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-27T19:41:44.146994] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:41:44.414949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-27T19:41:44.504189] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T19:41:45.214973] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-27T19:41:45.247764] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:41:46.014993] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-27T19:41:46.217272] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:41:46.724498] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T19:41:46.814913] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-27T19:41:47.614921] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-27T19:41:47.812785] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T19:41:48.414980] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-27T19:41:48.841676] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:41:49.214934] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-27T19:41:49.248988] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T19:41:50.014967] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-27T19:41:50.764282] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T19:41:50.814953] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-27T19:41:51.615009] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-27T19:41:51.727973] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T19:41:51.734856] [INFO ] [REMOTE ] LH: Full fetch complete (54778 records). [2025-10-27T19:41:51.735004] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-27T19:41:52.117751] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-27T19:41:52.117826] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-27T19:41:52.118669] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-27T19:41:52.118730] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-27T19:41:52.119818] [DEBUG] [LOCAL ] LH: Trimmed 54778 records to 36776 (keeping 200 days of data) [2025-10-27T19:41:52.347371] [DEBUG] [LOCAL ] LH: Primary data saved (36776 records). [2025-10-27T19:41:52.347583] [INFO ] [MAIN ] LH: Full history saved. [2025-10-27T19:41:52.347710] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 35.4s. Estimated remaining: 2h 23m 30s. Rate: 7.7 symbols/min [2025-10-27T19:41:52.416283] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-27T19:41:52.519428] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:41:52.536863] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T19:41:52.544813] [DEBUG] [LOCAL ] LITB: Loaded 3922 existing records from primary storage. [2025-10-27T19:41:52.545303] [INFO ] [MAIN ] LITB: Loaded 3922 existing records. [2025-10-27T19:41:52.746096] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:41:52.750573] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:41:52.760536] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-27T19:41:52.760743] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-27T19:41:52.761183] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-27T19:41:52.761235] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-27T19:41:53.112053] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:41:53.214898] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-27T19:41:53.690456] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T19:41:53.998040] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:41:54.014904] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-27T19:41:54.815032] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-27T19:41:55.126465] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T19:41:55.495386] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:41:55.614916] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-27T19:41:56.414955] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-27T19:41:57.215002] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-27T19:41:57.350323] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:41:57.650171] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T19:41:57.661299] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T19:41:58.014991] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-27T19:41:58.814994] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-27T19:41:59.276706] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T19:41:59.552735] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T19:41:59.614919] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-27T19:42:00.414996] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-27T19:42:01.215042] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-27T19:42:02.014957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-27T19:42:03.302739] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T19:42:03.304109] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-27T19:42:03.643028] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-10-27T19:42:03.654794] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-27T19:42:03.740490] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (4.13 seconds). [2025-10-27T19:42:03.866986] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T19:42:04.139455] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-27T19:42:04.145363] [INFO ] [REMOTE ] LII: Full fetch complete (41936 records). [2025-10-27T19:42:04.145486] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-27T19:42:04.420143] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-27T19:42:04.508020] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-27T19:42:04.508092] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-27T19:42:04.508809] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-27T19:42:04.508870] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-27T19:42:04.509737] [DEBUG] [LOCAL ] LII: Trimmed 41936 records to 27586 (keeping 200 days of data) [2025-10-27T19:42:04.674947] [DEBUG] [LOCAL ] LII: Primary data saved (27586 records). [2025-10-27T19:42:04.675069] [INFO ] [MAIN ] LII: Full history saved. [2025-10-27T19:42:04.675143] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LII took 34.9s. Estimated remaining: 2h 23m 26s. Rate: 7.7 symbols/min [2025-10-27T19:42:04.842153] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:04.892429] [DEBUG] [LOCAL ] LLY: Loaded 53960 existing records from primary storage. [2025-10-27T19:42:04.892789] [INFO ] [MAIN ] LLY: Loaded 53960 existing records. [2025-10-27T19:42:05.063571] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:05.063785] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-27T19:42:05.063831] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-27T19:42:05.064032] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-27T19:42:05.064086] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-27T19:42:05.215718] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-27T19:42:05.409208] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:06.014971] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-27T19:42:06.266712] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T19:42:06.814972] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-27T19:42:06.923384] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (3.27 seconds). [2025-10-27T19:42:07.009269] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:42:07.022927] [INFO ] [REMOTE ] LHX: Full fetch complete (70683 records). [2025-10-27T19:42:07.023166] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-27T19:42:07.131972] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-27T19:42:07.407480] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-27T19:42:07.407565] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-27T19:42:07.408600] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-27T19:42:07.408690] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-27T19:42:07.410062] [DEBUG] [LOCAL ] LHX: Trimmed 70683 records to 48276 (keeping 200 days of data) [2025-10-27T19:42:07.620425] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-27T19:42:07.707896] [DEBUG] [LOCAL ] LHX: Primary data saved (48276 records). [2025-10-27T19:42:07.708030] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-27T19:42:07.708109] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LHX took 39.2s. Estimated remaining: 2h 23m 14s. Rate: 7.7 symbols/min [2025-10-27T19:42:07.884136] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:07.934166] [DEBUG] [LOCAL ] LMND: Loaded 52880 existing records from primary storage. [2025-10-27T19:42:07.934489] [INFO ] [MAIN ] LMND: Loaded 52880 existing records. [2025-10-27T19:42:08.143677] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-27T19:42:08.147706] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:08.148020] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-27T19:42:08.159880] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-27T19:42:08.160129] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-27T19:42:08.160186] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-27T19:42:08.423159] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-27T19:42:08.511407] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:09.079908] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T19:42:09.214986] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-27T19:42:09.317481] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:42:09.327247] [INFO ] [REMOTE ] LION: Full fetch complete (58494 records). [2025-10-27T19:42:09.327402] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-27T19:42:09.702376] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-27T19:42:09.702449] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-27T19:42:09.703314] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-27T19:42:09.703374] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-27T19:42:09.704482] [DEBUG] [LOCAL ] LION: Trimmed 58494 records to 47270 (keeping 200 days of data) [2025-10-27T19:42:09.964301] [DEBUG] [LOCAL ] LION: Primary data saved (47270 records). [2025-10-27T19:42:09.964502] [INFO ] [MAIN ] LION: Full history saved. [2025-10-27T19:42:09.965217] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LION took 34.8s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-27T19:42:10.027166] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-27T19:42:10.132567] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:10.180977] [DEBUG] [LOCAL ] LMT: Loaded 50333 existing records from primary storage. [2025-10-27T19:42:10.181297] [INFO ] [MAIN ] LMT: Loaded 50333 existing records. [2025-10-27T19:42:10.352868] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:10.353075] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-27T19:42:10.353121] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-27T19:42:10.353362] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-27T19:42:10.353418] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-27T19:42:10.692909] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:10.814902] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-27T19:42:11.224293] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T19:42:11.614966] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-27T19:42:11.793904] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:42:12.414949] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-27T19:42:12.513485] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:42:13.135106] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:42:13.214918] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-27T19:42:14.015004] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-27T19:42:14.423620] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T19:42:14.814936] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-27T19:42:15.004125] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:42:15.456049] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:42:15.457453] [INFO ] [REMOTE ] LITB: Full fetch complete (5810 records). [2025-10-27T19:42:15.457521] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-27T19:42:15.627998] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-27T19:42:15.815769] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-27T19:42:15.815843] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-27T19:42:15.816013] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-27T19:42:15.816052] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-27T19:42:15.816417] [DEBUG] [LOCAL ] LITB: Trimmed 5810 records to 3695 (keeping 200 days of data) [2025-10-27T19:42:15.837670] [DEBUG] [LOCAL ] LITB: Primary data saved (3695 records). [2025-10-27T19:42:15.837774] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-27T19:42:15.837895] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LITB took 23.5s. Estimated remaining: 2h 22m 52s. Rate: 7.8 symbols/min [2025-10-27T19:42:16.011452] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:16.059189] [DEBUG] [LOCAL ] LNC: Loaded 52139 existing records from primary storage. [2025-10-27T19:42:16.059520] [INFO ] [MAIN ] LNC: Loaded 52139 existing records. [2025-10-27T19:42:16.258528] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:16.258858] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-27T19:42:16.258966] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-27T19:42:16.259221] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-27T19:42:16.259271] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-27T19:42:16.445955] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-27T19:42:16.561305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-27T19:42:16.671809] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:17.215007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-27T19:42:17.622009] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T19:42:18.014990] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-27T19:42:18.225884] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T19:42:18.814961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-27T19:42:19.114901] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T19:42:19.614951] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-27T19:42:20.191388] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T19:42:20.412807] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T19:42:20.417428] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-27T19:42:21.214932] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-27T19:42:22.014978] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-27T19:42:22.752274] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (3.14 seconds). [2025-10-27T19:42:22.814907] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-27T19:42:23.529969] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:42:23.614949] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-27T19:42:24.106027] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (3.69 seconds). [2025-10-27T19:42:24.414970] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-27T19:42:24.618727] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T19:42:25.129034] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T19:42:25.214918] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-27T19:42:25.321014] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (4.11 seconds). [2025-10-27T19:42:26.014908] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-27T19:42:26.216280] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T19:42:26.814934] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-27T19:42:27.162786] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T19:42:27.468848] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T19:42:27.614941] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-27T19:42:28.414996] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-27T19:42:28.761314] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-27T19:42:29.214914] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-27T19:42:29.774578] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T19:42:30.014993] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-27T19:42:30.135898] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T19:42:30.814959] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-27T19:42:31.592088] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-27T19:42:31.614956] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-27T19:42:32.020106] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T19:42:32.414947] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-27T19:42:32.519291] [DEBUG] [REMOTE ] LMND: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-27T19:42:32.519500] [WARN ] [REMOTE ] LMND: No data returned for month 2025-10 [2025-10-27T19:42:32.519588] [FATAL] [REMOTE ] LMND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:42:32.519705] [FATAL] [MAIN ] LMND: Failed to fetch primary data. [2025-10-27T19:42:32.519776] [WARN ] [MAIN ] LMND: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:42:32.519862] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-27T19:42:32.519963] [DEBUG] [LOCAL ] LMND: No primary data file found to delete. [2025-10-27T19:42:32.520042] [INFO ] [LOCAL ] LMND: Starting deletion of derivative data. [2025-10-27T19:42:32.521096] [DEBUG] [LOCAL ] LMND: Deleted derivative data file. [2025-10-27T19:42:32.521208] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LMND took 24.8s. Estimated remaining: 2h 22m 52s. Rate: 7.7 symbols/min [2025-10-27T19:42:32.700009] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:32.707226] [DEBUG] [LOCAL ] LND: Loaded 5066 existing records from primary storage. [2025-10-27T19:42:32.707453] [INFO ] [MAIN ] LND: Loaded 5066 existing records. [2025-10-27T19:42:32.891868] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:32.892376] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-27T19:42:32.892578] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-27T19:42:32.892882] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-27T19:42:32.892934] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-27T19:42:33.221351] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T19:42:33.217944] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-27T19:42:33.345967] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:33.995884] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T19:42:34.014908] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-27T19:42:34.653200] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T19:42:34.663364] [INFO ] [REMOTE ] LLY: Full fetch complete (77192 records). [2025-10-27T19:42:34.663514] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-27T19:42:34.824202] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-27T19:42:35.083291] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-27T19:42:35.083508] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-27T19:42:35.084784] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-27T19:42:35.084854] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-27T19:42:35.086928] [DEBUG] [LOCAL ] LLY: Trimmed 77192 records to 53169 (keeping 200 days of data) [2025-10-27T19:42:35.220625] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T19:42:35.386244] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:42:35.511205] [DEBUG] [LOCAL ] LLY: Primary data saved (53169 records). [2025-10-27T19:42:35.511411] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-27T19:42:35.512113] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LLY took 30.8s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-10-27T19:42:35.621501] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-27T19:42:35.703969] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:35.763357] [DEBUG] [LOCAL ] LNG: Loaded 51798 existing records from primary storage. [2025-10-27T19:42:35.763908] [INFO ] [MAIN ] LNG: Loaded 51798 existing records. [2025-10-27T19:42:35.956315] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:35.956623] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-27T19:42:35.956732] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-27T19:42:35.956995] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-27T19:42:35.957039] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-27T19:42:36.279287] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T19:42:36.369463] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:36.414930] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-27T19:42:36.826063] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T19:42:37.214983] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-27T19:42:38.014997] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-27T19:42:38.551247] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:42:38.814922] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-27T19:42:39.279925] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T19:42:39.389531] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:42:39.614930] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-27T19:42:40.415007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-27T19:42:40.800450] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T19:42:41.214942] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-27T19:42:41.961855] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:42:42.014894] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-27T19:42:42.374328] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T19:42:42.705903] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T19:42:42.815031] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-27T19:42:43.614958] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-27T19:42:44.414920] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-27T19:42:44.448737] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T19:42:45.214991] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-27T19:42:45.656752] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:42:45.691630] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:42:45.701108] [INFO ] [REMOTE ] LMT: Full fetch complete (72566 records). [2025-10-27T19:42:45.701232] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-27T19:42:46.023373] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-27T19:42:46.079312] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-27T19:42:46.079387] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-27T19:42:46.080363] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-27T19:42:46.080426] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-27T19:42:46.081830] [DEBUG] [LOCAL ] LMT: Trimmed 72566 records to 49543 (keeping 200 days of data) [2025-10-27T19:42:46.392974] [DEBUG] [LOCAL ] LMT: Primary data saved (49543 records). [2025-10-27T19:42:46.393116] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-27T19:42:46.393811] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 36.4s. Estimated remaining: 2h 22m 36s. Rate: 7.7 symbols/min [2025-10-27T19:42:46.569635] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:46.584684] [DEBUG] [LOCAL ] LNN: Loaded 11861 existing records from primary storage. [2025-10-27T19:42:46.584934] [INFO ] [MAIN ] LNN: Loaded 11861 existing records. [2025-10-27T19:42:46.686879] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T19:42:46.767558] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:46.767815] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-27T19:42:46.767878] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-27T19:42:46.768174] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-27T19:42:46.768231] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-27T19:42:46.820088] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-27T19:42:47.123748] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:47.158158] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T19:42:47.614971] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-27T19:42:47.955770] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T19:42:48.420717] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-27T19:42:48.436481] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:42:48.964992] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T19:42:49.214948] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-27T19:42:50.015027] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-27T19:42:50.814931] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-27T19:42:51.046586] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:42:51.330240] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T19:42:51.332585] [INFO ] [REMOTE ] LND: Full fetch complete (7821 records). [2025-10-27T19:42:51.332693] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-27T19:42:51.617958] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-27T19:42:51.701564] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-27T19:42:51.701683] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-27T19:42:51.702013] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-27T19:42:51.702189] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-27T19:42:51.721712] [DEBUG] [LOCAL ] LND: Trimmed 7821 records to 4869 (keeping 200 days of data) [2025-10-27T19:42:51.744860] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:42:51.773170] [DEBUG] [LOCAL ] LND: Primary data saved (4869 records). [2025-10-27T19:42:51.773285] [INFO ] [MAIN ] LND: Full history saved. [2025-10-27T19:42:51.773374] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LND took 19.3s. Estimated remaining: 2h 22m 26s. Rate: 7.8 symbols/min [2025-10-27T19:42:51.936038] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:51.974705] [DEBUG] [LOCAL ] LOAR: Loaded 42569 existing records from primary storage. [2025-10-27T19:42:51.974990] [INFO ] [MAIN ] LOAR: Loaded 42569 existing records. [2025-10-27T19:42:52.162996] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:52.164262] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T19:42:52.164745] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-27T19:42:52.167155] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-27T19:42:52.168486] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-27T19:42:52.168553] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-27T19:42:52.420156] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-27T19:42:52.523111] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:53.214963] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-27T19:42:53.649356] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T19:42:54.014943] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-27T19:42:54.445370] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:42:54.814997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-27T19:42:55.620101] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-27T19:42:55.635418] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T19:42:55.812067] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T19:42:56.414943] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-27T19:42:57.113140] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:42:57.122687] [INFO ] [REMOTE ] LNC: Full fetch complete (74523 records). [2025-10-27T19:42:57.122823] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-27T19:42:57.220069] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-27T19:42:57.253186] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-27T19:42:57.526080] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-27T19:42:57.526165] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-27T19:42:57.527179] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-27T19:42:57.527241] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-27T19:42:57.528534] [DEBUG] [LOCAL ] LNC: Trimmed 74523 records to 51328 (keeping 200 days of data) [2025-10-27T19:42:57.828045] [DEBUG] [LOCAL ] LNC: Primary data saved (51328 records). [2025-10-27T19:42:57.828167] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-27T19:42:57.828243] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNC took 42.0s. Estimated remaining: 2h 22m 17s. Rate: 7.8 symbols/min [2025-10-27T19:42:57.994368] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:42:58.020102] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-27T19:42:58.022460] [DEBUG] [LOCAL ] LOB: Loaded 27102 existing records from primary storage. [2025-10-27T19:42:58.022758] [INFO ] [MAIN ] LOB: Loaded 27102 existing records. [2025-10-27T19:42:58.200934] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:42:58.201149] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-27T19:42:58.201201] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-27T19:42:58.201390] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-27T19:42:58.201445] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-27T19:42:58.544418] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:42:58.676525] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T19:42:58.814911] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-27T19:42:59.011306] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:42:59.539342] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T19:42:59.614904] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-27T19:43:00.414934] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-27T19:43:01.214997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-27T19:43:01.901917] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T19:43:01.952254] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T19:43:02.014950] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-27T19:43:02.639526] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:43:02.814943] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-27T19:43:03.614972] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-27T19:43:04.414922] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-27T19:43:04.465898] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (3.25 seconds). [2025-10-27T19:43:05.069480] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T19:43:05.090434] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:43:05.214918] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-27T19:43:05.525239] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-27T19:43:06.014957] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-27T19:43:06.151098] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T19:43:06.603038] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T19:43:06.814962] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-27T19:43:07.614944] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-27T19:43:07.960424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T19:43:08.414975] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-27T19:43:09.126579] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T19:43:09.214911] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-27T19:43:09.409596] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T19:43:10.014949] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-27T19:43:10.668286] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T19:43:10.683404] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T19:43:10.814928] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-27T19:43:11.614923] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-27T19:43:12.420969] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-27T19:43:12.446527] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T19:43:12.447381] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T19:43:13.214983] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-27T19:43:13.928793] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:43:13.939176] [INFO ] [REMOTE ] LNG: Full fetch complete (74664 records). [2025-10-27T19:43:13.939384] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-27T19:43:14.020158] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-27T19:43:14.358706] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-27T19:43:14.358843] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-27T19:43:14.360331] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-27T19:43:14.360485] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-27T19:43:14.362732] [DEBUG] [LOCAL ] LNG: Trimmed 74664 records to 50980 (keeping 200 days of data) [2025-10-27T19:43:14.634745] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:43:14.748522] [DEBUG] [LOCAL ] LNG: Primary data saved (50980 records). [2025-10-27T19:43:14.748777] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-27T19:43:14.749307] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LNG took 39.2s. Estimated remaining: 2h 22m 17s. Rate: 7.7 symbols/min [2025-10-27T19:43:14.820141] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-27T19:43:14.929419] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:14.935583] [DEBUG] [LOCAL ] LOCL: Loaded 3535 existing records from primary storage. [2025-10-27T19:43:14.935973] [INFO ] [MAIN ] LOCL: Loaded 3535 existing records. [2025-10-27T19:43:15.126556] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:15.126884] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-27T19:43:15.126947] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-27T19:43:15.127068] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-27T19:43:15.127120] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-27T19:43:15.320387] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T19:43:15.517142] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:15.527960] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T19:43:15.531170] [INFO ] [REMOTE ] LNN: Full fetch complete (16303 records). [2025-10-27T19:43:15.531242] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-27T19:43:15.620161] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-27T19:43:15.890199] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-27T19:43:15.890273] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-27T19:43:15.890620] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-27T19:43:15.890689] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-27T19:43:15.891185] [DEBUG] [LOCAL ] LNN: Trimmed 16303 records to 11526 (keeping 200 days of data) [2025-10-27T19:43:15.962084] [DEBUG] [LOCAL ] LNN: Primary data saved (11526 records). [2025-10-27T19:43:15.962202] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-27T19:43:15.962276] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LNN took 29.6s. Estimated remaining: 2h 22m 3s. Rate: 7.8 symbols/min [2025-10-27T19:43:16.137692] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:16.176877] [DEBUG] [LOCAL ] LOMA: Loaded 33310 existing records from primary storage. [2025-10-27T19:43:16.177274] [INFO ] [MAIN ] LOMA: Loaded 33310 existing records. [2025-10-27T19:43:16.357096] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:16.357390] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-27T19:43:16.357445] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-27T19:43:16.357719] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-27T19:43:16.357779] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-27T19:43:16.422901] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-27T19:43:16.738030] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:16.853688] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T19:43:17.214955] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-27T19:43:17.624987] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T19:43:18.014953] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-27T19:43:18.141845] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T19:43:18.815000] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-27T19:43:19.368985] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T19:43:19.608669] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T19:43:19.615223] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-27T19:43:20.415011] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-27T19:43:21.006832] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:43:21.038941] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T19:43:21.214918] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-27T19:43:22.015000] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-27T19:43:22.625391] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:43:22.814988] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-27T19:43:22.943749] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T19:43:23.614956] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-27T19:43:23.923170] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T19:43:23.930317] [INFO ] [REMOTE ] LOAR: Full fetch complete (56041 records). [2025-10-27T19:43:23.930430] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-27T19:43:24.304811] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-27T19:43:24.304887] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-27T19:43:24.305737] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-27T19:43:24.305797] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-27T19:43:24.306952] [DEBUG] [LOCAL ] LOAR: Trimmed 56041 records to 41789 (keeping 200 days of data) [2025-10-27T19:43:24.424018] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-27T19:43:24.551911] [DEBUG] [LOCAL ] LOAR: Primary data saved (41789 records). [2025-10-27T19:43:24.552205] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-27T19:43:24.552313] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOAR took 32.8s. Estimated remaining: 2h 21m 56s. Rate: 7.7 symbols/min [2025-10-27T19:43:24.745203] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:24.747351] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:43:24.801138] [DEBUG] [LOCAL ] LOW: Loaded 53735 existing records from primary storage. [2025-10-27T19:43:24.801454] [INFO ] [MAIN ] LOW: Loaded 53735 existing records. [2025-10-27T19:43:24.984340] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:24.984570] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-27T19:43:24.984619] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-27T19:43:24.984869] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-27T19:43:24.984925] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-27T19:43:25.225531] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-27T19:43:25.341819] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:25.590424] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T19:43:25.730823] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T19:43:25.736415] [INFO ] [REMOTE ] LOB: Full fetch complete (38789 records). [2025-10-27T19:43:25.736568] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-27T19:43:26.023928] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-27T19:43:26.117979] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-27T19:43:26.118051] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-27T19:43:26.118785] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-27T19:43:26.118846] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-27T19:43:26.119604] [DEBUG] [LOCAL ] LOB: Trimmed 38789 records to 26452 (keeping 200 days of data) [2025-10-27T19:43:26.272446] [DEBUG] [LOCAL ] LOB: Primary data saved (26452 records). [2025-10-27T19:43:26.272570] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-27T19:43:26.272755] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOB took 28.4s. Estimated remaining: 2h 21m 43s. Rate: 7.8 symbols/min [2025-10-27T19:43:26.444007] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T19:43:26.447160] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:26.485387] [DEBUG] [LOCAL ] LPG: Loaded 39709 existing records from primary storage. [2025-10-27T19:43:26.485686] [INFO ] [MAIN ] LPG: Loaded 39709 existing records. [2025-10-27T19:43:26.669940] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:26.670193] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-27T19:43:26.670240] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-27T19:43:26.670454] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-27T19:43:26.670509] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-27T19:43:26.821167] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-27T19:43:27.037487] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:27.615003] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-27T19:43:27.791113] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:43:28.415014] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-27T19:43:28.702053] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T19:43:29.214958] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-27T19:43:29.475554] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:43:30.014950] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-27T19:43:30.753886] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:43:30.814900] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-27T19:43:31.123512] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T19:43:31.625307] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-27T19:43:31.627969] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:43:32.415020] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-27T19:43:32.878051] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T19:43:33.214938] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-27T19:43:33.525182] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-27T19:43:33.577788] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:43:34.014983] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-27T19:43:34.815001] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-27T19:43:35.101320] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T19:43:35.614952] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-27T19:43:36.378112] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:43:36.414901] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-27T19:43:37.008752] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:43:37.016886] [INFO ] [REMOTE ] LOMA: Full fetch complete (47985 records). [2025-10-27T19:43:37.017119] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-27T19:43:37.221234] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-27T19:43:37.425062] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-27T19:43:37.425207] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-27T19:43:37.426696] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-27T19:43:37.426841] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-27T19:43:37.428361] [DEBUG] [LOCAL ] LOMA: Trimmed 47985 records to 32945 (keeping 200 days of data) [2025-10-27T19:43:37.642771] [DEBUG] [LOCAL ] LOMA: Primary data saved (32945 records). [2025-10-27T19:43:37.643099] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-27T19:43:37.643935] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOMA took 21.7s. Estimated remaining: 2h 21m 39s. Rate: 7.8 symbols/min [2025-10-27T19:43:37.789668] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T19:43:37.789944] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:43:37.875137] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:37.909914] [DEBUG] [LOCAL ] LPL: Loaded 29601 existing records from primary storage. [2025-10-27T19:43:37.910303] [INFO ] [MAIN ] LPL: Loaded 29601 existing records. [2025-10-27T19:43:38.020150] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-27T19:43:38.107618] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:38.107930] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-27T19:43:38.107981] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-27T19:43:38.108206] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-27T19:43:38.108246] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-27T19:43:38.496208] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:38.814940] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-27T19:43:39.482856] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T19:43:39.614908] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-27T19:43:39.933992] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T19:43:40.414940] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-27T19:43:41.214949] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-27T19:43:41.296043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:43:41.413108] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:43:42.014945] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-27T19:43:42.435581] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:43:42.759177] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:43:42.815014] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-27T19:43:43.614951] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-27T19:43:43.790164] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:43:44.414953] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-27T19:43:45.131025] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:43:45.214933] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-27T19:43:45.529924] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T19:43:46.015208] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-27T19:43:46.814926] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-27T19:43:46.910446] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:43:47.334774] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T19:43:47.443511] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T19:43:47.614979] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-27T19:43:48.282324] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T19:43:48.414930] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-27T19:43:49.214995] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-27T19:43:49.514352] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T19:43:49.685977] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T19:43:50.014944] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-27T19:43:50.414701] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T19:43:50.814938] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-27T19:43:51.379318] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T19:43:51.380498] [INFO ] [REMOTE ] LOCL: Full fetch complete (4534 records). [2025-10-27T19:43:51.380567] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-27T19:43:51.620198] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-27T19:43:51.730930] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-27T19:43:51.731004] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-27T19:43:51.731151] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-27T19:43:51.731190] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-27T19:43:51.731540] [DEBUG] [LOCAL ] LOCL: Trimmed 4534 records to 3246 (keeping 200 days of data) [2025-10-27T19:43:51.749625] [DEBUG] [LOCAL ] LOCL: Primary data saved (3246 records). [2025-10-27T19:43:51.749717] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-27T19:43:51.749790] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LOCL took 37.0s. Estimated remaining: 2h 21m 37s. Rate: 7.7 symbols/min [2025-10-27T19:43:51.914794] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:43:51.957265] [DEBUG] [LOCAL ] LPX: Loaded 40685 existing records from primary storage. [2025-10-27T19:43:51.957580] [INFO ] [MAIN ] LPX: Loaded 40685 existing records. [2025-10-27T19:43:52.132017] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:43:52.132213] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-27T19:43:52.132264] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-27T19:43:52.132461] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-27T19:43:52.132517] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-27T19:43:52.420139] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-27T19:43:52.480905] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:43:53.089066] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T19:43:53.214923] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-27T19:43:53.612417] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T19:43:53.948113] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:43:54.014969] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-27T19:43:54.814929] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-27T19:43:54.857390] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T19:43:55.614957] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-27T19:43:56.413634] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T19:43:56.422207] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-27T19:43:57.214938] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-27T19:43:57.341974] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:43:57.830275] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T19:43:58.014931] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-27T19:43:58.382101] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:43:58.814941] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-27T19:43:59.289623] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:43:59.296336] [INFO ] [REMOTE ] LPG: Full fetch complete (58619 records). [2025-10-27T19:43:59.296437] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-27T19:43:59.620066] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-27T19:43:59.689264] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-27T19:43:59.689345] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-27T19:43:59.690219] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-27T19:43:59.690282] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-27T19:43:59.691410] [DEBUG] [LOCAL ] LPG: Trimmed 58619 records to 38804 (keeping 200 days of data) [2025-10-27T19:43:59.924178] [DEBUG] [LOCAL ] LPG: Primary data saved (38804 records). [2025-10-27T19:43:59.924430] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-27T19:43:59.924596] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LPG took 33.7s. Estimated remaining: 2h 21m 29s. Rate: 7.7 symbols/min [2025-10-27T19:44:00.094884] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:00.121004] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:44:00.164106] [DEBUG] [LOCAL ] LRN: Loaded 39785 existing records from primary storage. [2025-10-27T19:44:00.164488] [INFO ] [MAIN ] LRN: Loaded 39785 existing records. [2025-10-27T19:44:00.344860] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:00.345095] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-27T19:44:00.345184] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-27T19:44:00.345373] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-27T19:44:00.345414] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-27T19:44:00.420051] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-27T19:44:00.707800] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:01.214970] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-27T19:44:02.014961] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-27T19:44:02.266726] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-27T19:44:02.814952] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-27T19:44:03.827109] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-10-27T19:44:03.835417] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-27T19:44:04.837275] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (3.62 seconds). [2025-10-27T19:44:04.846311] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-27T19:44:05.120962] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-10-27T19:44:05.214918] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-27T19:44:05.788165] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-27T19:44:05.942557] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:44:06.014915] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-27T19:44:06.256800] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (3.44 seconds). [2025-10-27T19:44:06.267332] [INFO ] [REMOTE ] LOW: Full fetch complete (76706 records). [2025-10-27T19:44:06.267472] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-27T19:44:06.657877] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-27T19:44:06.657960] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-27T19:44:06.658956] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-27T19:44:06.659017] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-27T19:44:06.660427] [DEBUG] [LOCAL ] LOW: Trimmed 76706 records to 52939 (keeping 200 days of data) [2025-10-27T19:44:06.836009] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-27T19:44:07.007674] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T19:44:07.027191] [DEBUG] [LOCAL ] LOW: Primary data saved (52939 records). [2025-10-27T19:44:07.027845] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-27T19:44:07.028020] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LOW took 42.5s. Estimated remaining: 2h 21m 21s. Rate: 7.7 symbols/min [2025-10-27T19:44:07.210767] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:07.253491] [DEBUG] [LOCAL ] LSPD: Loaded 42896 existing records from primary storage. [2025-10-27T19:44:07.253816] [INFO ] [MAIN ] LSPD: Loaded 42896 existing records. [2025-10-27T19:44:07.436036] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:07.436318] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-27T19:44:07.436391] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-27T19:44:07.437028] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-27T19:44:07.437086] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-27T19:44:07.638231] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-27T19:44:07.708225] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:44:07.825043] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:08.269908] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T19:44:08.414907] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-27T19:44:08.881127] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:44:08.889108] [INFO ] [REMOTE ] LPL: Full fetch complete (38071 records). [2025-10-27T19:44:08.889199] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-27T19:44:09.220094] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-27T19:44:09.267429] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-27T19:44:09.267993] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-27T19:44:09.268753] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-27T19:44:09.268815] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-27T19:44:09.269826] [DEBUG] [LOCAL ] LPL: Trimmed 38071 records to 29165 (keeping 200 days of data) [2025-10-27T19:44:09.438058] [DEBUG] [LOCAL ] LPL: Primary data saved (29165 records). [2025-10-27T19:44:09.438175] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-27T19:44:09.438287] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPL took 31.8s. Estimated remaining: 2h 21m 9s. Rate: 7.8 symbols/min [2025-10-27T19:44:09.639171] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:09.636258] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T19:44:09.681002] [DEBUG] [LOCAL ] LTC: Loaded 31075 existing records from primary storage. [2025-10-27T19:44:09.681272] [INFO ] [MAIN ] LTC: Loaded 31075 existing records. [2025-10-27T19:44:09.854739] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:09.854955] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-27T19:44:09.855019] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-27T19:44:09.855354] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-27T19:44:09.855426] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-27T19:44:10.024045] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-27T19:44:10.209256] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:10.571720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:44:10.814946] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-27T19:44:11.614914] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-27T19:44:11.921920] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T19:44:12.370859] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T19:44:12.414943] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-27T19:44:12.863719] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T19:44:13.214986] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-27T19:44:13.623097] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T19:44:14.014984] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-27T19:44:14.676576] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:44:14.774359] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T19:44:14.814931] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-27T19:44:15.614940] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-27T19:44:16.095231] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T19:44:16.415026] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-27T19:44:16.846684] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:44:17.214972] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-27T19:44:17.670360] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:44:18.014976] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-27T19:44:18.295926] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:18.814954] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-27T19:44:19.325421] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T19:44:19.614944] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-27T19:44:20.017857] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:44:20.414941] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-27T19:44:21.110335] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T19:44:21.118456] [INFO ] [REMOTE ] LPX: Full fetch complete (58635 records). [2025-10-27T19:44:21.118590] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-27T19:44:21.220422] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-27T19:44:21.509346] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-27T19:44:21.509434] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-27T19:44:21.510553] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-27T19:44:21.510632] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-27T19:44:21.512120] [DEBUG] [LOCAL ] LPX: Trimmed 58635 records to 39955 (keeping 200 days of data) [2025-10-27T19:44:21.647545] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T19:44:21.787936] [DEBUG] [LOCAL ] LPX: Primary data saved (39955 records). [2025-10-27T19:44:21.788084] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-27T19:44:21.788497] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LPX took 30.0s. Estimated remaining: 2h 21m 5s. Rate: 7.7 symbols/min [2025-10-27T19:44:21.954600] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:22.005637] [DEBUG] [LOCAL ] LTH: Loaded 52315 existing records from primary storage. [2025-10-27T19:44:22.005963] [INFO ] [MAIN ] LTH: Loaded 52315 existing records. [2025-10-27T19:44:22.020191] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-27T19:44:22.184665] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:22.184877] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-27T19:44:22.184924] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-27T19:44:22.185209] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-27T19:44:22.185250] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-27T19:44:22.536398] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:22.595208] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:44:22.814962] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-27T19:44:23.536520] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T19:44:23.614903] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-27T19:44:24.192284] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:44:24.414958] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-27T19:44:24.699663] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:25.215014] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-27T19:44:25.580780] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:44:26.014998] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-27T19:44:26.262280] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T19:44:26.269577] [INFO ] [REMOTE ] LRN: Full fetch complete (58102 records). [2025-10-27T19:44:26.269780] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-27T19:44:26.721571] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-27T19:44:26.721704] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-27T19:44:26.723156] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-27T19:44:26.723227] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-27T19:44:26.724802] [DEBUG] [LOCAL ] LRN: Trimmed 58102 records to 39074 (keeping 200 days of data) [2025-10-27T19:44:26.815933] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-27T19:44:26.986445] [DEBUG] [LOCAL ] LRN: Primary data saved (39074 records). [2025-10-27T19:44:26.986700] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-27T19:44:26.986827] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LRN took 27.1s. Estimated remaining: 2h 20m 55s. Rate: 7.7 symbols/min [2025-10-27T19:44:27.172009] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:27.216905] [DEBUG] [LOCAL ] LTM: Loaded 39877 existing records from primary storage. [2025-10-27T19:44:27.217317] [INFO ] [MAIN ] LTM: Loaded 39877 existing records. [2025-10-27T19:44:27.408522] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:27.409040] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-27T19:44:27.409198] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-27T19:44:27.409547] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-27T19:44:27.409609] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-27T19:44:27.623933] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-27T19:44:27.668863] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T19:44:27.840242] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:27.902760] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T19:44:28.415001] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-27T19:44:28.547968] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:44:29.214998] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-27T19:44:29.398612] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:44:30.014927] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-27T19:44:30.508286] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T19:44:30.815028] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-27T19:44:31.511520] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:44:31.614978] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-27T19:44:32.415010] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-27T19:44:32.607425] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:44:32.621077] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:44:33.215003] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-27T19:44:33.467720] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T19:44:34.014993] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-27T19:44:34.299607] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:44:34.814952] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-27T19:44:35.354939] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T19:44:35.614982] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-27T19:44:36.139204] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T19:44:36.414947] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-27T19:44:36.872993] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:44:37.214954] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-27T19:44:37.897570] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T19:44:38.014960] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-27T19:44:38.668475] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T19:44:38.675288] [INFO ] [REMOTE ] LTC: Full fetch complete (43913 records). [2025-10-27T19:44:38.675411] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-27T19:44:38.820028] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-27T19:44:39.092872] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-27T19:44:39.092960] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-27T19:44:39.093770] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-27T19:44:39.093835] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-27T19:44:39.094936] [DEBUG] [LOCAL ] LTC: Trimmed 43913 records to 30481 (keeping 200 days of data) [2025-10-27T19:44:39.285195] [DEBUG] [LOCAL ] LTC: Primary data saved (30481 records). [2025-10-27T19:44:39.285323] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-27T19:44:39.286038] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LTC took 29.8s. Estimated remaining: 2h 20m 51s. Rate: 7.7 symbols/min [2025-10-27T19:44:39.454196] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:39.499961] [DEBUG] [LOCAL ] LU: Loaded 49888 existing records from primary storage. [2025-10-27T19:44:39.526846] [INFO ] [MAIN ] LU: Loaded 49888 existing records. [2025-10-27T19:44:39.597534] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:44:39.630568] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-27T19:44:39.722840] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:39.722996] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-27T19:44:39.723042] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-27T19:44:39.723230] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-27T19:44:39.723285] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-27T19:44:40.081425] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:40.099391] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T19:44:40.415002] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-27T19:44:41.214925] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-27T19:44:41.254261] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-27T19:44:41.262784] [INFO ] [REMOTE ] LSPD: Full fetch complete (62440 records). [2025-10-27T19:44:41.262942] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-27T19:44:41.649968] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-27T19:44:41.650074] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-27T19:44:41.651034] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-27T19:44:41.651112] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-27T19:44:41.652330] [DEBUG] [LOCAL ] LSPD: Trimmed 62440 records to 42066 (keeping 200 days of data) [2025-10-27T19:44:41.920975] [DEBUG] [LOCAL ] LSPD: Primary data saved (42066 records). [2025-10-27T19:44:41.921191] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-27T19:44:41.921541] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LSPD took 34.9s. Estimated remaining: 2h 20m 39s. Rate: 7.7 symbols/min [2025-10-27T19:44:41.957971] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:44:42.019416] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-27T19:44:42.114869] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:44:42.137239] [DEBUG] [LOCAL ] LUCK: Loaded 24073 existing records from primary storage. [2025-10-27T19:44:42.137506] [INFO ] [MAIN ] LUCK: Loaded 24073 existing records. [2025-10-27T19:44:42.319223] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:44:42.319867] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-27T19:44:42.319986] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-27T19:44:42.320371] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-27T19:44:42.320441] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-27T19:44:42.513040] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T19:44:42.747434] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:44:42.814948] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-27T19:44:43.372680] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T19:44:43.614921] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-27T19:44:43.998922] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T19:44:44.414954] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-27T19:44:44.596334] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T19:44:45.214936] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-27T19:44:45.990404] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T19:44:46.014899] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-27T19:44:46.708325] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T19:44:46.814941] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-27T19:44:47.620073] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-27T19:44:47.641109] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T19:44:48.205716] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:44:48.414945] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-27T19:44:49.220135] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-27T19:44:49.237190] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:44:49.642880] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T19:44:50.014947] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-27T19:44:50.272998] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T19:44:50.814950] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-27T19:44:51.173203] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T19:44:51.615010] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-27T19:44:52.343085] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T19:44:52.414939] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-27T19:44:52.825707] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:44:53.214971] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-27T19:44:53.814635] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T19:44:53.824873] [INFO ] [REMOTE ] LTH: Full fetch complete (74746 records). [2025-10-27T19:44:53.825172] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-27T19:44:54.022537] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-27T19:44:54.231396] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-27T19:44:54.231484] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-27T19:44:54.232524] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-27T19:44:54.232587] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-27T19:44:54.234114] [DEBUG] [LOCAL ] LTH: Trimmed 74746 records to 51546 (keeping 200 days of data) [2025-10-27T19:44:54.533298] [DEBUG] [LOCAL ] LTH: Primary data saved (51546 records). [2025-10-27T19:44:54.533426] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-27T19:44:54.533940] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 32.7s. Estimated remaining: 2h 20m 35s. Rate: 7.7 symbols/min [2025-10-27T19:44:54.620298] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T19:44:54.814905] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-27T19:44:54.840210] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:44:55.614943] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-27T19:44:56.378000] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T19:44:56.414982] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-27T19:44:56.789430] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:44:57.126273] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T19:44:57.214942] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-27T19:44:58.014964] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-27T19:44:58.814957] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-27T19:44:58.964799] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T19:44:58.979690] [INFO ] [REMOTE ] LTM: Full fetch complete (51764 records). [2025-10-27T19:44:58.985039] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T19:44:58.984704] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-27T19:44:59.364027] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-27T19:44:59.364108] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-27T19:44:59.364910] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-27T19:44:59.364971] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-27T19:44:59.366041] [DEBUG] [LOCAL ] LTM: Trimmed 51764 records to 39414 (keeping 200 days of data) [2025-10-27T19:44:59.590027] [DEBUG] [LOCAL ] LTM: Primary data saved (39414 records). [2025-10-27T19:44:59.590164] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-27T19:44:59.590250] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LTM took 32.6s. Estimated remaining: 2h 20m 25s. Rate: 7.7 symbols/min [2025-10-27T19:44:59.614918] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-27T19:44:59.945267] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T19:45:00.414941] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-27T19:45:01.088794] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T19:45:01.214965] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-27T19:45:03.077778] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T19:45:03.082102] [INFO ] [REMOTE ] LUCK: Full fetch complete (38807 records). [2025-10-27T19:45:03.082208] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-27T19:45:03.466815] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-27T19:45:03.466904] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-27T19:45:03.467786] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-27T19:45:03.467848] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-27T19:45:03.468717] [DEBUG] [LOCAL ] LUCK: Trimmed 38807 records to 23228 (keeping 200 days of data) [2025-10-27T19:45:03.620865] [DEBUG] [LOCAL ] LUCK: Primary data saved (23228 records). [2025-10-27T19:45:03.633812] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-27T19:45:03.636680] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LUCK took 21.7s. Estimated remaining: 2h 20m 14s. Rate: 7.8 symbols/min [2025-10-27T19:45:03.639478] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-27T19:45:03.650082] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-27T19:45:05.425661] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:45:05.436632] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-27T19:45:06.592825] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T19:45:06.602917] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-27T19:45:08.427449] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T19:45:08.438463] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-27T19:45:09.717253] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:45:09.726555] [INFO ] [REMOTE ] LU: Full fetch complete (70958 records). [2025-10-27T19:45:09.726721] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-27T19:45:10.105814] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-27T19:45:10.105893] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-27T19:45:10.106890] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-27T19:45:10.106952] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-27T19:45:10.108553] [DEBUG] [LOCAL ] LU: Trimmed 70958 records to 49197 (keeping 200 days of data) [2025-10-27T19:45:10.376008] [DEBUG] [LOCAL ] LU: Primary data saved (49197 records). [2025-10-27T19:45:10.376150] [INFO ] [MAIN ] LU: Full history saved. [2025-10-27T19:45:10.376870] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LU took 31.1s. Estimated remaining: 2h 20m 6s. Rate: 7.8 symbols/min [2025-10-27T19:45:11.020889] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.022010] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.083056] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.086114] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-27T19:45:11.100382] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-27T19:45:11.104453] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-27T19:45:11.104388] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:11.104923] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-27T19:45:11.105286] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-27T19:45:11.105340] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-27T19:45:11.407471] [DEBUG] [LOCAL ] LUMN: Loaded 54425 existing records from primary storage. [2025-10-27T19:45:11.424558] [INFO ] [MAIN ] LUMN: Loaded 54425 existing records. [2025-10-27T19:45:11.501983] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-27T19:45:11.528179] [DEBUG] [LOCAL ] LVS: Loaded 54349 existing records from primary storage. [2025-10-27T19:45:11.538820] [INFO ] [MAIN ] LVS: Loaded 54349 existing records. [2025-10-27T19:45:11.544247] [INFO ] [MAIN ] LUV: Loaded 54469 existing records. [2025-10-27T19:45:11.892873] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:11.912021] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-27T19:45:12.146259] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.157400] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.157689] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.172836] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-27T19:45:12.173080] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.179459] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:12.179616] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-27T19:45:12.179802] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-27T19:45:12.179982] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-27T19:45:12.180041] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-27T19:45:12.180205] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-27T19:45:12.180299] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-27T19:45:12.200894] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-27T19:45:12.277317] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-27T19:45:12.266940] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:45:12.366266] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-27T19:45:12.355884] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-27T19:45:12.385902] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:45:12.394439] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-27T19:45:12.477230] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:45:12.549017] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-27T19:45:12.619019] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-27T19:45:12.668035] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-27T19:45:12.722928] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-27T19:45:12.800938] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.4s. Estimated remaining: 2h 19m 54s. Rate: 7.8 symbols/min [2025-10-27T19:45:13.338014] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.455787] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-27T19:45:13.496233] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.530356] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:13.541130] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-27T19:45:13.566141] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:13.566809] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-27T19:45:13.582243] [DEBUG] [LOCAL ] LVWR: Loaded 18752 existing records from primary storage. [2025-10-27T19:45:13.582797] [INFO ] [MAIN ] LVWR: Loaded 18752 existing records. [2025-10-27T19:45:13.753908] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:13.754109] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-27T19:45:13.754154] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-27T19:45:13.754308] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-27T19:45:13.754345] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-27T19:45:14.095355] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:14.095670] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-27T19:45:14.446411] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-27T19:45:14.448309] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-27T19:45:14.876125] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T19:45:14.881315] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-27T19:45:15.273852] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T19:45:15.284507] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-27T19:45:15.396751] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T19:45:15.407905] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-27T19:45:15.441733] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T19:45:15.452405] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-27T19:45:15.497748] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:45:15.499368] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-27T19:45:16.077554] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T19:45:16.079394] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-27T19:45:16.586781] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:45:16.597402] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-27T19:45:16.804871] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:45:16.809026] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-27T19:45:16.905851] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T19:45:16.915995] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-27T19:45:17.251126] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T19:45:17.261721] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-27T19:45:18.000447] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:45:18.014896] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-27T19:45:18.190812] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:45:18.658315] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T19:45:18.766421] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T19:45:18.814994] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-27T19:45:19.614938] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-27T19:45:19.846480] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T19:45:20.414944] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-27T19:45:20.997464] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-27T19:45:21.119012] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T19:45:21.214918] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-27T19:45:21.903679] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T19:45:22.014935] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-27T19:45:22.731374] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:45:22.814908] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-27T19:45:23.614920] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-27T19:45:23.694317] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T19:45:24.261385] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:45:24.414950] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-27T19:45:24.740846] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T19:45:25.214934] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-27T19:45:25.816275] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T19:45:25.885982] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T19:45:26.014943] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-27T19:45:26.814997] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-27T19:45:27.547501] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T19:45:27.614971] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-27T19:45:28.423556] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-27T19:45:28.426393] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T19:45:28.547977] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:45:29.215000] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-27T19:45:29.974131] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T19:45:30.014971] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-27T19:45:30.814943] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-27T19:45:30.926786] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T19:45:31.614981] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-27T19:45:31.728024] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:45:32.414968] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-27T19:45:32.522520] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:45:33.033093] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T19:45:33.037193] [INFO ] [REMOTE ] LVWR: Full fetch complete (20854 records). [2025-10-27T19:45:33.037290] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-27T19:45:33.218107] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-27T19:45:33.414661] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-27T19:45:33.414834] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-27T19:45:33.415380] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-27T19:45:33.415453] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-27T19:45:33.416428] [DEBUG] [LOCAL ] LVWR: Trimmed 20854 records to 18668 (keeping 200 days of data) [2025-10-27T19:45:33.538410] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T19:45:33.563254] [DEBUG] [LOCAL ] LVWR: Primary data saved (18668 records). [2025-10-27T19:45:33.563394] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-27T19:45:33.563470] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LVWR took 20.7s. Estimated remaining: 2h 19m 57s. Rate: 7.7 symbols/min [2025-10-27T19:45:33.744673] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:33.795095] [DEBUG] [LOCAL ] LW: Loaded 51910 existing records from primary storage. [2025-10-27T19:45:33.795458] [INFO ] [MAIN ] LW: Loaded 51910 existing records. [2025-10-27T19:45:33.994662] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:33.994882] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-27T19:45:33.994931] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-27T19:45:33.995210] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-27T19:45:33.995249] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-27T19:45:34.025451] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-27T19:45:34.381072] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:34.814951] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-27T19:45:35.555177] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T19:45:35.614913] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-27T19:45:35.665330] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T19:45:36.414927] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-27T19:45:36.546234] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T19:45:37.214943] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-27T19:45:37.316112] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:45:38.014948] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-27T19:45:38.650027] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-27T19:45:38.660720] [INFO ] [REMOTE ] LUMN: Full fetch complete (77785 records). [2025-10-27T19:45:38.660854] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-27T19:45:38.832261] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-27T19:45:39.050717] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-27T19:45:39.050806] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-27T19:45:39.051809] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-27T19:45:39.051872] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-27T19:45:39.053591] [DEBUG] [LOCAL ] LUMN: Trimmed 77785 records to 53646 (keeping 200 days of data) [2025-10-27T19:45:39.084312] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:45:39.178344] [INFO ] [REMOTE ] LVS: Full fetch complete (77728 records). [2025-10-27T19:45:39.191227] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-27T19:45:39.862344] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-27T19:45:39.887636] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-27T19:45:39.900478] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-27T19:45:39.913330] [DEBUG] [LOCAL ] LUMN: Primary data saved (53646 records). [2025-10-27T19:45:39.913713] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-27T19:45:39.913511] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-27T19:45:39.914324] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LUMN took 29.5s. Estimated remaining: 2h 19m 48s. Rate: 7.7 symbols/min [2025-10-27T19:45:40.035809] [DEBUG] [LOCAL ] LVS: Trimmed 77728 records to 53569 (keeping 200 days of data) [2025-10-27T19:45:40.090067] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T19:45:40.258470] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-27T19:45:40.290594] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-27T19:45:40.326590] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:40.504050] [DEBUG] [LOCAL ] LXFR: Loaded 16581 existing records from primary storage. [2025-10-27T19:45:40.515619] [INFO ] [MAIN ] LXFR: Loaded 16581 existing records. [2025-10-27T19:45:41.143997] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:41.165519] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-27T19:45:41.170231] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-27T19:45:41.191729] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-27T19:45:41.208907] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-27T19:45:41.408334] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-27T19:45:41.408087] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-27T19:45:41.447121] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-27T19:45:41.474868] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-27T19:45:41.484340] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-27T19:45:41.498377] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-27T19:45:41.498760] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-27T19:45:41.498475] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-27T19:45:41.512945] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVS took 31.1s. Estimated remaining: 2h 19m 35s. Rate: 7.8 symbols/min [2025-10-27T19:45:41.632309] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-27T19:45:41.992275] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:42.151719] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:42.152264] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-27T19:45:42.322506] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-27T19:45:42.337448] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-27T19:45:42.337589] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 31.9s. Estimated remaining: 2h 19m 21s. Rate: 7.8 symbols/min [2025-10-27T19:45:42.364837] [DEBUG] [LOCAL ] LXP: Loaded 51479 existing records from primary storage. [2025-10-27T19:45:42.403716] [INFO ] [MAIN ] LXP: Loaded 51479 existing records. [2025-10-27T19:45:42.662029] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:45:42.697453] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:42.697789] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-27T19:45:42.697846] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-27T19:45:42.698037] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-27T19:45:42.698075] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-27T19:45:42.974767] [DEBUG] [LOCAL ] LXU: Loaded 31894 existing records from primary storage. [2025-10-27T19:45:43.021144] [INFO ] [MAIN ] LXU: Loaded 31894 existing records. [2025-10-27T19:45:43.178731] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:45:43.224104] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-27T19:45:43.301030] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:43.304239] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-27T19:45:43.303834] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:45:43.305603] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-27T19:45:43.305844] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-27T19:45:43.317256] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-27T19:45:43.337415] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-27T19:45:43.372892] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T19:45:43.446582] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-27T19:45:43.703217] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:45:43.703591] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-27T19:45:44.007466] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:45:44.411829] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T19:45:44.421172] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-27T19:45:44.689075] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T19:45:44.717501] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T19:45:45.214939] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-27T19:45:45.401109] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T19:45:46.014920] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-27T19:45:46.673950] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T19:45:46.814938] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-27T19:45:47.278191] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T19:45:47.614964] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-27T19:45:48.414995] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-27T19:45:48.665686] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T19:45:49.123612] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-27T19:45:49.214941] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-27T19:45:49.810347] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T19:45:49.832827] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T19:45:50.014952] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-27T19:45:50.814948] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-27T19:45:51.614967] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-27T19:45:51.652481] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T19:45:51.729267] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T19:45:52.282437] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T19:45:52.414930] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-27T19:45:53.214923] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-27T19:45:53.378214] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T19:45:53.982971] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:45:54.014900] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-27T19:45:54.814942] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-27T19:45:55.342228] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T19:45:55.614931] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-27T19:45:56.198071] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T19:45:56.414939] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-27T19:45:57.220098] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-27T19:45:57.235460] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:45:57.759368] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:45:58.014918] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-27T19:45:58.048028] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T19:45:58.814941] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-27T19:45:59.614921] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-27T19:45:59.724003] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:45:59.804690] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T19:46:00.414939] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-27T19:46:01.214948] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-27T19:46:01.829867] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T19:46:02.015032] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-27T19:46:02.814988] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-27T19:46:03.912442] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:46:03.915806] [INFO ] [REMOTE ] LXFR: Full fetch complete (24662 records). [2025-10-27T19:46:03.916198] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-27T19:46:03.934177] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-27T19:46:04.012133] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-27T19:46:04.291055] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (3.88 seconds). [2025-10-27T19:46:04.385135] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-27T19:46:04.385211] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-27T19:46:04.385831] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-27T19:46:04.385895] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-27T19:46:04.386499] [DEBUG] [LOCAL ] LXFR: Trimmed 24662 records to 16176 (keeping 200 days of data) [2025-10-27T19:46:04.428754] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-27T19:46:04.485796] [DEBUG] [LOCAL ] LXFR: Primary data saved (16176 records). [2025-10-27T19:46:04.485925] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-27T19:46:04.486012] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 24.6s. Estimated remaining: 2h 19m 26s. Rate: 7.7 symbols/min [2025-10-27T19:46:04.653046] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:04.701846] [DEBUG] [LOCAL ] LYB: Loaded 54401 existing records from primary storage. [2025-10-27T19:46:04.702152] [INFO ] [MAIN ] LYB: Loaded 54401 existing records. [2025-10-27T19:46:04.880539] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:04.880793] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-27T19:46:04.880845] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-27T19:46:04.881182] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-27T19:46:04.881239] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-27T19:46:05.260129] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:05.260791] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-27T19:46:05.310905] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (3.30 seconds). [2025-10-27T19:46:05.604413] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:46:05.646488] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T19:46:06.014941] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-27T19:46:06.815051] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-27T19:46:07.566273] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-27T19:46:07.614966] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-27T19:46:07.744288] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T19:46:08.289697] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-27T19:46:08.414973] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-27T19:46:08.787704] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T19:46:09.214974] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-27T19:46:09.325744] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:46:10.014967] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-27T19:46:10.814966] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-27T19:46:10.914258] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:46:10.925914] [INFO ] [REMOTE ] LXP: Full fetch complete (72850 records). [2025-10-27T19:46:10.926168] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-27T19:46:11.308689] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T19:46:11.371176] [INFO ] [REMOTE ] LXU: Full fetch complete (45284 records). [2025-10-27T19:46:11.383486] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-27T19:46:11.493145] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-27T19:46:11.510236] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-27T19:46:11.511907] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-27T19:46:11.519175] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-27T19:46:11.591596] [DEBUG] [LOCAL ] LXP: Trimmed 72850 records to 50671 (keeping 200 days of data) [2025-10-27T19:46:11.628363] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-27T19:46:12.059009] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-27T19:46:12.059131] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-27T19:46:12.060733] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-27T19:46:12.111697] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-27T19:46:12.187422] [DEBUG] [LOCAL ] LXU: Trimmed 45284 records to 31131 (keeping 200 days of data) [2025-10-27T19:46:12.396375] [DEBUG] [LOCAL ] LXP: Primary data saved (50671 records). [2025-10-27T19:46:12.397150] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-27T19:46:12.397314] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LXP took 30.9s. Estimated remaining: 2h 19m 18s. Rate: 7.7 symbols/min [2025-10-27T19:46:12.712684] [DEBUG] [LOCAL ] LXU: Primary data saved (31131 records). [2025-10-27T19:46:12.717078] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:12.717553] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-27T19:46:12.717878] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXU took 30.4s. Estimated remaining: 2h 19m 4s. Rate: 7.8 symbols/min [2025-10-27T19:46:12.745175] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:46:12.832539] [INFO ] [REMOTE ] LW: Full fetch complete (74742 records). [2025-10-27T19:46:12.845215] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-27T19:46:13.040902] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:13.195631] [DEBUG] [LOCAL ] LYG: Loaded 53424 existing records from primary storage. [2025-10-27T19:46:13.229056] [INFO ] [MAIN ] LYG: Loaded 53424 existing records. [2025-10-27T19:46:13.654070] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-27T19:46:13.657073] [DEBUG] [LOCAL ] LYV: Loaded 51724 existing records from primary storage. [2025-10-27T19:46:13.657344] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-27T19:46:13.669988] [INFO ] [MAIN ] LYV: Loaded 51724 existing records. [2025-10-27T19:46:13.672236] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-27T19:46:13.695101] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:13.673230] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-27T19:46:13.728934] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-27T19:46:13.744949] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-27T19:46:13.783106] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-27T19:46:13.799235] [DEBUG] [LOCAL ] LW: Trimmed 74742 records to 51116 (keeping 200 days of data) [2025-10-27T19:46:13.810354] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-27T19:46:14.132620] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:14.137986] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-27T19:46:14.177401] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-27T19:46:14.279307] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-27T19:46:14.369803] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-27T19:46:14.432684] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-27T19:46:14.629476] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-27T19:46:14.675177] [DEBUG] [LOCAL ] LW: Primary data saved (51116 records). [2025-10-27T19:46:14.691791] [INFO ] [MAIN ] LW: Full history saved. [2025-10-27T19:46:14.723097] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LW took 41.2s. Estimated remaining: 2h 18m 52s. Rate: 7.8 symbols/min [2025-10-27T19:46:14.902248] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:14.941360] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-27T19:46:15.132083] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:15.298264] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:15.310167] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-27T19:46:15.328382] [DEBUG] [LOCAL ] LZB: Loaded 35474 existing records from primary storage. [2025-10-27T19:46:15.328865] [INFO ] [MAIN ] LZB: Loaded 35474 existing records. [2025-10-27T19:46:15.542193] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:15.542566] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-27T19:46:15.542633] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-27T19:46:15.542975] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-27T19:46:15.543046] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-27T19:46:15.964919] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:15.965375] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-27T19:46:16.625752] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T19:46:16.660842] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-27T19:46:16.663758] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:46:16.674446] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-27T19:46:16.770762] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T19:46:16.834413] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:46:17.214951] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-27T19:46:17.911040] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T19:46:18.014961] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-27T19:46:18.433252] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T19:46:18.485141] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:46:18.814964] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-27T19:46:19.614944] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-27T19:46:19.705212] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T19:46:20.165631] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:46:20.414945] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-27T19:46:21.220225] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-27T19:46:21.234144] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T19:46:21.352899] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:46:22.014986] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-27T19:46:22.814950] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-27T19:46:23.134855] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T19:46:23.342514] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:46:23.614948] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-27T19:46:24.414938] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-27T19:46:24.611002] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:46:24.897489] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:46:25.214944] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-27T19:46:26.014927] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-27T19:46:26.092136] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:46:26.625166] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T19:46:26.814969] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-27T19:46:27.614982] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-27T19:46:27.713298] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T19:46:28.105860] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T19:46:28.414994] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-27T19:46:29.127742] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:46:29.214967] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-27T19:46:30.014980] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-27T19:46:30.299195] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T19:46:30.814967] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-27T19:46:31.047836] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T19:46:31.128532] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T19:46:31.614946] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-27T19:46:32.029788] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T19:46:32.414968] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-27T19:46:32.996297] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:46:33.214939] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-27T19:46:33.950861] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:46:34.014936] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-27T19:46:34.814928] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-27T19:46:34.907889] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T19:46:34.918369] [INFO ] [REMOTE ] LYB: Full fetch complete (77642 records). [2025-10-27T19:46:34.918564] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-27T19:46:35.339808] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-27T19:46:35.339894] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-27T19:46:35.341004] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-27T19:46:35.341067] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-27T19:46:35.342549] [DEBUG] [LOCAL ] LYB: Trimmed 77642 records to 53621 (keeping 200 days of data) [2025-10-27T19:46:35.619951] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-27T19:46:35.671690] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-27T19:46:35.671838] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-27T19:46:35.671919] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYB took 31.2s. Estimated remaining: 2h 18m 55s. Rate: 7.7 symbols/min [2025-10-27T19:46:35.858795] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:35.893399] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T19:46:35.920107] [DEBUG] [LOCAL ] LZM: Loaded 15105 existing records from primary storage. [2025-10-27T19:46:35.920440] [INFO ] [MAIN ] LZM: Loaded 15105 existing records. [2025-10-27T19:46:36.111711] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:36.125581] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-27T19:46:36.126193] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-27T19:46:36.127292] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T19:46:36.130123] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-27T19:46:36.135127] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-27T19:46:36.420053] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-27T19:46:36.488805] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:37.111098] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:46:37.214927] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-27T19:46:37.446731] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T19:46:37.454188] [INFO ] [REMOTE ] LZB: Full fetch complete (51169 records). [2025-10-27T19:46:37.454353] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-27T19:46:37.860127] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-27T19:46:37.860260] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-27T19:46:37.861638] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-27T19:46:37.861739] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-27T19:46:37.863683] [DEBUG] [LOCAL ] LZB: Trimmed 51169 records to 34783 (keeping 200 days of data) [2025-10-27T19:46:38.041566] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-27T19:46:38.094407] [DEBUG] [LOCAL ] LZB: Primary data saved (34783 records). [2025-10-27T19:46:38.094564] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-27T19:46:38.094694] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LZB took 23.4s. Estimated remaining: 2h 18m 43s. Rate: 7.7 symbols/min [2025-10-27T19:46:38.261134] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:38.312289] [DEBUG] [LOCAL ] M: Loaded 54323 existing records from primary storage. [2025-10-27T19:46:38.312670] [INFO ] [MAIN ] M: Loaded 54323 existing records. [2025-10-27T19:46:38.490770] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:38.491195] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-27T19:46:38.491282] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-27T19:46:38.491668] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-27T19:46:38.491742] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-27T19:46:38.772765] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T19:46:38.810146] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T19:46:38.815978] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-27T19:46:38.901049] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:39.614940] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-27T19:46:39.692971] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T19:46:40.414930] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-27T19:46:41.214933] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-27T19:46:41.454849] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T19:46:41.754749] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T19:46:41.991252] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:46:42.014929] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-27T19:46:42.814979] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-27T19:46:43.614929] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-27T19:46:43.711560] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T19:46:44.414956] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-27T19:46:44.667527] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T19:46:44.680043] [INFO ] [REMOTE ] LYG: Full fetch complete (76283 records). [2025-10-27T19:46:44.680229] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-27T19:46:45.130070] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-27T19:46:45.130205] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-27T19:46:45.131468] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-27T19:46:45.131553] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-27T19:46:45.133394] [DEBUG] [LOCAL ] LYG: Trimmed 76283 records to 52640 (keeping 200 days of data) [2025-10-27T19:46:45.216911] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-27T19:46:45.365466] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T19:46:45.479270] [DEBUG] [LOCAL ] LYG: Primary data saved (52640 records). [2025-10-27T19:46:45.479415] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-27T19:46:45.480207] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LYG took 33.1s. Estimated remaining: 2h 18m 35s. Rate: 7.8 symbols/min [2025-10-27T19:46:45.647739] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:45.699785] [DEBUG] [LOCAL ] MA: Loaded 53204 existing records from primary storage. [2025-10-27T19:46:45.700084] [INFO ] [MAIN ] MA: Loaded 53204 existing records. [2025-10-27T19:46:45.880948] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:45.881317] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-27T19:46:45.881387] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-27T19:46:45.881601] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-27T19:46:45.881689] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-27T19:46:46.036749] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-27T19:46:46.205494] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T19:46:46.268520] [INFO ] [REMOTE ] LYV: Full fetch complete (74138 records). [2025-10-27T19:46:46.290248] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-27T19:46:46.290136] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:46.376906] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T19:46:46.730313] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-27T19:46:46.730439] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-27T19:46:46.731991] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-27T19:46:46.732061] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-27T19:46:46.734014] [DEBUG] [LOCAL ] LYV: Trimmed 74138 records to 50904 (keeping 200 days of data) [2025-10-27T19:46:46.821482] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-27T19:46:47.044747] [DEBUG] [LOCAL ] LYV: Primary data saved (50904 records). [2025-10-27T19:46:47.044891] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-27T19:46:47.045003] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LYV took 34.3s. Estimated remaining: 2h 18m 22s. Rate: 7.8 symbols/min [2025-10-27T19:46:47.209267] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:47.250791] [DEBUG] [LOCAL ] MAA: Loaded 43628 existing records from primary storage. [2025-10-27T19:46:47.251141] [INFO ] [MAIN ] MAA: Loaded 43628 existing records. [2025-10-27T19:46:47.439400] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:47.439979] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-27T19:46:47.440121] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-27T19:46:47.440435] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-27T19:46:47.440638] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-27T19:46:47.552945] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:46:47.619079] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-27T19:46:47.841248] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:47.870465] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-27T19:46:48.414958] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-27T19:46:49.220151] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-27T19:46:49.234472] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T19:46:49.893906] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:46:49.957199] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T19:46:50.014915] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-27T19:46:50.814962] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-27T19:46:50.841792] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T19:46:51.614932] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-27T19:46:52.415009] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-27T19:46:52.796100] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T19:46:53.007750] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T19:46:53.214937] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-27T19:46:53.727148] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T19:46:53.992137] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T19:46:54.014906] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-27T19:46:54.649962] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T19:46:54.815002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-27T19:46:55.614952] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-27T19:46:55.993041] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T19:46:55.997874] [INFO ] [REMOTE ] LZM: Full fetch complete (20202 records). [2025-10-27T19:46:55.997964] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-27T19:46:56.388706] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-27T19:46:56.388791] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-27T19:46:56.389205] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-27T19:46:56.389244] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-27T19:46:56.389887] [DEBUG] [LOCAL ] LZM: Trimmed 20202 records to 14897 (keeping 200 days of data) [2025-10-27T19:46:56.420530] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-27T19:46:56.473584] [DEBUG] [LOCAL ] LZM: Primary data saved (14897 records). [2025-10-27T19:46:56.473800] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-27T19:46:56.473901] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. LZM took 20.8s. Estimated remaining: 2h 18m 16s. Rate: 7.8 symbols/min [2025-10-27T19:46:56.642306] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:46:56.688458] [DEBUG] [LOCAL ] MAC: Loaded 50284 existing records from primary storage. [2025-10-27T19:46:56.688819] [INFO ] [MAIN ] MAC: Loaded 50284 existing records. [2025-10-27T19:46:56.868069] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:46:56.868275] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-27T19:46:56.868322] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-27T19:46:56.868609] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-27T19:46:56.868681] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-27T19:46:57.222913] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-27T19:46:57.227555] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:46:57.289514] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:46:57.993169] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T19:46:58.014907] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-27T19:46:58.815022] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-27T19:46:59.158813] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T19:46:59.199617] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T19:46:59.614929] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-27T19:47:00.374459] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:47:00.414905] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-27T19:47:01.214948] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-27T19:47:02.015030] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-27T19:47:02.214497] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-27T19:47:02.815041] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-27T19:47:04.685462] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-10-27T19:47:04.696468] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-27T19:47:05.009045] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (4.59 seconds). [2025-10-27T19:47:05.018735] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-27T19:47:05.127251] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (3.11 seconds). [2025-10-27T19:47:05.214928] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-27T19:47:05.524589] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-27T19:47:06.014984] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-27T19:47:06.362777] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T19:47:06.455146] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T19:47:06.814996] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-27T19:47:07.218073] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-27T19:47:07.614971] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-27T19:47:07.760599] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:47:07.945194] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:47:08.415030] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-27T19:47:09.214907] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-27T19:47:09.792447] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-27T19:47:10.020100] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-27T19:47:10.034952] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T19:47:10.815962] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-27T19:47:10.819602] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T19:47:11.528960] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:47:11.614936] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-27T19:47:12.370896] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T19:47:12.414906] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-27T19:47:13.214925] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-27T19:47:13.514781] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-27T19:47:13.525568] [INFO ] [REMOTE ] M: Full fetch complete (77657 records). [2025-10-27T19:47:13.525816] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-27T19:47:13.785489] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T19:47:13.955793] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-27T19:47:13.955865] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-27T19:47:13.956880] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-27T19:47:13.956942] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-27T19:47:13.958304] [DEBUG] [LOCAL ] M: Trimmed 77657 records to 53543 (keeping 200 days of data) [2025-10-27T19:47:14.018874] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-27T19:47:14.278488] [DEBUG] [LOCAL ] M: Primary data saved (53543 records). [2025-10-27T19:47:14.278609] [INFO ] [MAIN ] M: Full history saved. [2025-10-27T19:47:14.278709] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. M took 36.2s. Estimated remaining: 2h 18m 16s. Rate: 7.7 symbols/min [2025-10-27T19:47:14.448360] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:14.482843] [DEBUG] [LOCAL ] MAGN: Loaded 36632 existing records from primary storage. [2025-10-27T19:47:14.483128] [INFO ] [MAIN ] MAGN: Loaded 36632 existing records. [2025-10-27T19:47:14.675836] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:14.685563] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-27T19:47:14.685637] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-27T19:47:14.686459] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T19:47:14.689736] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-27T19:47:14.695333] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-27T19:47:14.820025] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-27T19:47:15.050342] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:15.544863] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:47:15.614916] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-27T19:47:15.992804] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:47:16.414977] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-27T19:47:17.214912] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-27T19:47:17.307328] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T19:47:17.619148] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:47:18.015027] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-27T19:47:18.534918] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T19:47:18.543460] [INFO ] [REMOTE ] MAA: Full fetch complete (61989 records). [2025-10-27T19:47:18.543603] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-27T19:47:18.822028] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-27T19:47:18.947144] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-27T19:47:18.947222] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-27T19:47:18.948242] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-27T19:47:18.948305] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-27T19:47:18.949629] [DEBUG] [LOCAL ] MAA: Trimmed 61989 records to 42844 (keeping 200 days of data) [2025-10-27T19:47:19.220233] [DEBUG] [LOCAL ] MAA: Primary data saved (42844 records). [2025-10-27T19:47:19.220355] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-27T19:47:19.220431] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAA took 32.2s. Estimated remaining: 2h 18m 6s. Rate: 7.7 symbols/min [2025-10-27T19:47:19.402327] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:19.431248] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T19:47:19.476472] [DEBUG] [LOCAL ] MAIN: Loaded 42512 existing records from primary storage. [2025-10-27T19:47:19.476794] [INFO ] [MAIN ] MAIN: Loaded 42512 existing records. [2025-10-27T19:47:19.620057] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-27T19:47:19.656023] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:19.656434] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-27T19:47:19.656489] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-27T19:47:19.656733] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-27T19:47:19.656789] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-27T19:47:20.017440] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:20.415019] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-27T19:47:20.790765] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-27T19:47:20.802012] [INFO ] [REMOTE ] MA: Full fetch complete (76377 records). [2025-10-27T19:47:20.802188] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-27T19:47:21.216068] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-27T19:47:21.349263] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-27T19:47:21.349368] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-27T19:47:21.350533] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-27T19:47:21.350616] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-27T19:47:21.354382] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:47:21.367527] [DEBUG] [LOCAL ] MA: Trimmed 76377 records to 52417 (keeping 200 days of data) [2025-10-27T19:47:21.624411] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T19:47:21.729995] [DEBUG] [LOCAL ] MA: Primary data saved (52417 records). [2025-10-27T19:47:21.730152] [INFO ] [MAIN ] MA: Full history saved. [2025-10-27T19:47:21.730864] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MA took 36.3s. Estimated remaining: 2h 17m 54s. Rate: 7.8 symbols/min [2025-10-27T19:47:21.903593] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:21.946789] [DEBUG] [LOCAL ] MAN: Loaded 44967 existing records from primary storage. [2025-10-27T19:47:21.947092] [INFO ] [MAIN ] MAN: Loaded 44967 existing records. [2025-10-27T19:47:22.020880] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-27T19:47:22.130961] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:22.131118] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-27T19:47:22.131170] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-27T19:47:22.131530] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-27T19:47:22.131569] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-27T19:47:22.487682] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:22.507254] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T19:47:22.814930] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-27T19:47:23.546889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:47:23.614966] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-27T19:47:24.105388] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:47:24.414928] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-27T19:47:24.476929] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T19:47:25.214962] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-27T19:47:25.853035] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T19:47:26.014909] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-27T19:47:26.139759] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T19:47:26.814952] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-27T19:47:27.531305] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T19:47:27.614917] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-27T19:47:28.346548] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T19:47:28.414907] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-27T19:47:29.100214] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T19:47:29.109392] [INFO ] [REMOTE ] MAC: Full fetch complete (71500 records). [2025-10-27T19:47:29.109524] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-27T19:47:29.216309] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-27T19:47:29.497862] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-27T19:47:29.497953] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-27T19:47:29.498946] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-27T19:47:29.499011] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-27T19:47:29.500381] [DEBUG] [LOCAL ] MAC: Trimmed 71500 records to 49449 (keeping 200 days of data) [2025-10-27T19:47:29.804858] [DEBUG] [LOCAL ] MAC: Primary data saved (49449 records). [2025-10-27T19:47:29.805020] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-27T19:47:29.805595] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAC took 33.3s. Estimated remaining: 2h 17m 47s. Rate: 7.8 symbols/min [2025-10-27T19:47:29.986571] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T19:47:30.023011] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-27T19:47:30.025352] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:30.055636] [DEBUG] [LOCAL ] MANU: Loaded 27474 existing records from primary storage. [2025-10-27T19:47:30.055948] [INFO ] [MAIN ] MANU: Loaded 27474 existing records. [2025-10-27T19:47:30.235003] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:30.235233] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-27T19:47:30.235280] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-27T19:47:30.235550] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-27T19:47:30.235589] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-27T19:47:30.599691] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:30.731042] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T19:47:30.814916] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-27T19:47:31.221907] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T19:47:31.614929] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-27T19:47:31.712859] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:47:32.414947] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-27T19:47:33.060435] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T19:47:33.214941] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-27T19:47:33.782957] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:47:34.014937] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-27T19:47:34.234269] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T19:47:34.814959] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-27T19:47:35.614932] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-27T19:47:35.652980] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:47:35.786936] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T19:47:36.414953] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-27T19:47:36.675915] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T19:47:37.214958] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-27T19:47:37.796845] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:47:38.014955] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-27T19:47:38.780340] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T19:47:38.814902] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-27T19:47:39.430133] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T19:47:39.614941] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-27T19:47:40.292977] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T19:47:40.414955] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-27T19:47:40.972504] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T19:47:41.214947] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-27T19:47:41.578165] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T19:47:42.014933] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-27T19:47:42.055960] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T19:47:42.814938] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-27T19:47:43.269212] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T19:47:43.614932] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-27T19:47:44.048428] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T19:47:44.414958] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-27T19:47:45.220728] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-27T19:47:45.225486] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T19:47:45.792621] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:47:46.014940] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-27T19:47:46.126495] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T19:47:46.814937] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-27T19:47:47.388256] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:47:47.614932] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-27T19:47:47.890486] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T19:47:48.414963] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-27T19:47:48.864874] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T19:47:49.214953] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-27T19:47:50.014923] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-27T19:47:50.139157] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T19:47:50.148738] [INFO ] [REMOTE ] MAN: Full fetch complete (63016 records). [2025-10-27T19:47:50.148861] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-27T19:47:50.528635] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-27T19:47:50.528870] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-27T19:47:50.529808] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-27T19:47:50.529891] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-27T19:47:50.531282] [DEBUG] [LOCAL ] MAN: Trimmed 63016 records to 44314 (keeping 200 days of data) [2025-10-27T19:47:50.637742] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T19:47:50.680110] [INFO ] [REMOTE ] MAGN: Full fetch complete (51778 records). [2025-10-27T19:47:50.680296] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-27T19:47:50.819209] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-27T19:47:51.122808] [DEBUG] [LOCAL ] MAN: Primary data saved (44314 records). [2025-10-27T19:47:51.125614] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-27T19:47:51.132007] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MAN took 29.4s. Estimated remaining: 2h 17m 50s. Rate: 7.7 symbols/min [2025-10-27T19:47:51.401711] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:51.402465] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-27T19:47:51.402600] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-27T19:47:51.403852] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-27T19:47:51.404012] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-27T19:47:51.405429] [DEBUG] [LOCAL ] MAGN: Trimmed 51778 records to 35837 (keeping 200 days of data) [2025-10-27T19:47:51.628686] [DEBUG] [LOCAL ] MAGN: Primary data saved (35837 records). [2025-10-27T19:47:51.628920] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-27T19:47:51.642925] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MAGN took 37.4s. Estimated remaining: 2h 17m 36s. Rate: 7.7 symbols/min [2025-10-27T19:47:51.680080] [DEBUG] [LOCAL ] MAS: Loaded 52954 existing records from primary storage. [2025-10-27T19:47:51.691473] [INFO ] [MAIN ] MAS: Loaded 52954 existing records. [2025-10-27T19:47:52.000316] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:52.022886] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:52.023864] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-27T19:47:52.044513] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-27T19:47:52.068539] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T19:47:52.077105] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T19:47:52.077362] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-27T19:47:52.086237] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-27T19:47:52.098192] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-27T19:47:52.126932] [INFO ] [REMOTE ] MAIN: Full fetch complete (60332 records). [2025-10-27T19:47:52.149574] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-27T19:47:52.420473] [DEBUG] [LOCAL ] MATV: Loaded 35439 existing records from primary storage. [2025-10-27T19:47:52.470891] [INFO ] [MAIN ] MATV: Loaded 35439 existing records. [2025-10-27T19:47:52.893531] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:52.921541] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-27T19:47:52.999533] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:53.048251] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-27T19:47:53.048671] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-27T19:47:53.064303] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-27T19:47:53.097194] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-27T19:47:53.191535] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-27T19:47:53.200346] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-27T19:47:53.206734] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-27T19:47:53.206852] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-27T19:47:53.254031] [DEBUG] [LOCAL ] MAIN: Trimmed 60332 records to 41726 (keeping 200 days of data) [2025-10-27T19:47:53.266167] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T19:47:53.316793] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-27T19:47:53.768559] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:53.811823] [DEBUG] [LOCAL ] MAIN: Primary data saved (41726 records). [2025-10-27T19:47:53.811935] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-27T19:47:53.812010] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAIN took 34.6s. Estimated remaining: 2h 17m 24s. Rate: 7.8 symbols/min [2025-10-27T19:47:53.986985] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:47:54.018553] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-27T19:47:54.019229] [DEBUG] [LOCAL ] MATX: Loaded 32268 existing records from primary storage. [2025-10-27T19:47:54.020344] [INFO ] [MAIN ] MATX: Loaded 32268 existing records. [2025-10-27T19:47:54.210594] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:47:54.210800] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-27T19:47:54.210862] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-27T19:47:54.211037] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-27T19:47:54.211077] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-27T19:47:54.584695] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:47:54.605833] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T19:47:54.647108] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T19:47:54.814939] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-27T19:47:55.017406] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T19:47:55.614959] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-27T19:47:56.226159] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T19:47:56.414997] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-27T19:47:57.214931] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-27T19:47:57.375093] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T19:47:57.404853] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T19:47:58.014957] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-27T19:47:58.169263] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T19:47:58.814928] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-27T19:47:59.437621] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T19:47:59.614945] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-27T19:48:00.416879] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-27T19:48:00.419342] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:48:01.214940] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-27T19:48:01.769083] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T19:48:01.775420] [INFO ] [REMOTE ] MANU: Full fetch complete (39425 records). [2025-10-27T19:48:01.775522] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-27T19:48:02.035011] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-27T19:48:02.167782] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-27T19:48:02.167894] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-27T19:48:02.168735] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-27T19:48:02.168798] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-27T19:48:02.169628] [DEBUG] [LOCAL ] MANU: Trimmed 39425 records to 26885 (keeping 200 days of data) [2025-10-27T19:48:02.332739] [DEBUG] [LOCAL ] MANU: Primary data saved (26885 records). [2025-10-27T19:48:02.332865] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-27T19:48:02.332941] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MANU took 32.5s. Estimated remaining: 2h 17m 17s. Rate: 7.8 symbols/min [2025-10-27T19:48:02.507349] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:02.539540] [DEBUG] [LOCAL ] MAX: Loaded 31092 existing records from primary storage. [2025-10-27T19:48:02.539875] [INFO ] [MAIN ] MAX: Loaded 31092 existing records. [2025-10-27T19:48:02.714760] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:02.714994] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-27T19:48:02.715042] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-27T19:48:02.715266] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-27T19:48:02.715321] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-27T19:48:03.063881] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:03.064318] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-27T19:48:03.124250] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T19:48:03.614941] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-27T19:48:03.870347] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T19:48:03.979803] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (3.56 seconds). [2025-10-27T19:48:04.414976] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-27T19:48:04.540284] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T19:48:04.756776] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:48:05.214941] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-27T19:48:06.014964] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-27T19:48:06.325993] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T19:48:06.694883] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T19:48:06.814916] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-27T19:48:06.983273] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T19:48:07.615042] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-27T19:48:07.773987] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T19:48:08.415027] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-27T19:48:08.546480] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T19:48:09.214958] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-27T19:48:09.564406] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T19:48:10.015019] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-27T19:48:10.732013] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T19:48:10.814961] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-27T19:48:10.995573] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T19:48:11.614953] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-27T19:48:12.222216] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:48:12.414930] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-27T19:48:12.604963] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T19:48:13.214950] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-27T19:48:14.014968] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-27T19:48:14.202533] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:48:14.285583] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T19:48:14.814935] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-27T19:48:14.910328] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T19:48:15.614970] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-27T19:48:16.360384] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:48:16.414996] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-27T19:48:16.577583] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:48:17.214947] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-27T19:48:17.318687] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:48:18.015002] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-27T19:48:18.218157] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:48:18.814996] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-27T19:48:18.892343] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:48:19.614917] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-27T19:48:20.009227] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T19:48:20.414950] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-27T19:48:20.797691] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T19:48:21.214951] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-27T19:48:21.918591] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T19:48:21.928350] [INFO ] [REMOTE ] MAS: Full fetch complete (75422 records). [2025-10-27T19:48:21.928465] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-27T19:48:22.024768] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-27T19:48:22.319394] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-27T19:48:22.319530] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-27T19:48:22.320570] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-27T19:48:22.320670] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-27T19:48:22.322258] [DEBUG] [LOCAL ] MAS: Trimmed 75422 records to 52162 (keeping 200 days of data) [2025-10-27T19:48:22.444522] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T19:48:22.666316] [DEBUG] [LOCAL ] MAS: Primary data saved (52162 records). [2025-10-27T19:48:22.666464] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-27T19:48:22.666565] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MAS took 31.5s. Estimated remaining: 2h 17m 19s. Rate: 7.7 symbols/min [2025-10-27T19:48:22.817708] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-27T19:48:22.835419] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:22.875824] [DEBUG] [LOCAL ] MBC: Loaded 44511 existing records from primary storage. [2025-10-27T19:48:22.876101] [INFO ] [MAIN ] MBC: Loaded 44511 existing records. [2025-10-27T19:48:23.052703] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:23.052910] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-27T19:48:23.052983] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-27T19:48:23.053315] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-27T19:48:23.053433] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-27T19:48:23.239959] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T19:48:23.292037] [INFO ] [REMOTE ] MATX: Full fetch complete (43998 records). [2025-10-27T19:48:23.324025] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-27T19:48:23.582927] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:23.623505] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-27T19:48:23.818547] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-27T19:48:23.818625] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-27T19:48:23.819459] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-27T19:48:23.819541] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-27T19:48:23.820499] [DEBUG] [LOCAL ] MATX: Trimmed 43998 records to 31546 (keeping 200 days of data) [2025-10-27T19:48:24.013796] [DEBUG] [LOCAL ] MATX: Primary data saved (31546 records). [2025-10-27T19:48:24.013931] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-27T19:48:24.014009] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATX took 30.2s. Estimated remaining: 2h 17m 6s. Rate: 7.7 symbols/min [2025-10-27T19:48:24.183905] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:24.206301] [DEBUG] [LOCAL ] MBI: Loaded 24183 existing records from primary storage. [2025-10-27T19:48:24.206537] [INFO ] [MAIN ] MBI: Loaded 24183 existing records. [2025-10-27T19:48:24.326048] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T19:48:24.409987] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:24.410217] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-27T19:48:24.410266] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-27T19:48:24.410490] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-27T19:48:24.410546] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-27T19:48:24.421520] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-27T19:48:24.767993] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:24.789156] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T19:48:25.214937] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-27T19:48:25.524718] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:26.014922] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-27T19:48:26.312508] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:26.814992] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-27T19:48:27.256965] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T19:48:27.263369] [INFO ] [REMOTE ] MAX: Full fetch complete (45050 records). [2025-10-27T19:48:27.263471] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-27T19:48:27.623220] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-27T19:48:27.639721] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-27T19:48:27.640397] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-27T19:48:27.641223] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-27T19:48:27.641377] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-27T19:48:27.642372] [DEBUG] [LOCAL ] MAX: Trimmed 45050 records to 30512 (keeping 200 days of data) [2025-10-27T19:48:27.821879] [DEBUG] [LOCAL ] MAX: Primary data saved (30512 records). [2025-10-27T19:48:27.822117] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-27T19:48:27.822257] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MAX took 25.5s. Estimated remaining: 2h 16m 56s. Rate: 7.7 symbols/min [2025-10-27T19:48:27.883868] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T19:48:27.928834] [INFO ] [REMOTE ] MATV: Full fetch complete (51922 records). [2025-10-27T19:48:27.945991] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-27T19:48:28.160766] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:28.417002] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-27T19:48:28.433725] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-27T19:48:28.434676] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-27T19:48:28.448106] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-27T19:48:28.449537] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-27T19:48:28.450676] [DEBUG] [LOCAL ] MC: Loaded 44204 existing records from primary storage. [2025-10-27T19:48:28.451580] [INFO ] [MAIN ] MC: Loaded 44204 existing records. [2025-10-27T19:48:28.523543] [DEBUG] [LOCAL ] MATV: Trimmed 51922 records to 34605 (keeping 200 days of data) [2025-10-27T19:48:28.729889] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T19:48:28.735175] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:28.742521] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-27T19:48:28.742834] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-27T19:48:28.746916] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-27T19:48:28.747668] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-27T19:48:29.215697] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-27T19:48:29.239697] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:29.261455] [DEBUG] [LOCAL ] MATV: Primary data saved (34605 records). [2025-10-27T19:48:29.261607] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-27T19:48:29.261720] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MATV took 37.6s. Estimated remaining: 2h 16m 43s. Rate: 7.8 symbols/min [2025-10-27T19:48:29.432416] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:29.445109] [DEBUG] [LOCAL ] MCB: Loaded 11581 existing records from primary storage. [2025-10-27T19:48:29.445305] [INFO ] [MAIN ] MCB: Loaded 11581 existing records. [2025-10-27T19:48:29.630571] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:29.630877] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-27T19:48:29.630961] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-27T19:48:29.631146] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-27T19:48:29.631267] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-27T19:48:29.870766] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T19:48:30.019265] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-27T19:48:30.079027] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:30.096547] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T19:48:30.815000] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-27T19:48:31.378624] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T19:48:31.582511] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T19:48:31.614931] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-27T19:48:32.414987] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-27T19:48:32.864888] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T19:48:33.210243] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:48:33.214890] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-27T19:48:33.758747] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T19:48:34.014965] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-27T19:48:34.814999] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-27T19:48:35.116464] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T19:48:35.614960] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-27T19:48:35.860700] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T19:48:36.414956] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-27T19:48:36.571308] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:48:37.214945] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-27T19:48:37.519436] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:48:38.014966] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-27T19:48:38.491277] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T19:48:38.534230] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T19:48:38.814939] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-27T19:48:39.614944] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-27T19:48:40.347332] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T19:48:40.414911] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-27T19:48:40.718750] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T19:48:41.214924] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-27T19:48:41.521812] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:48:41.729988] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T19:48:42.014920] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-27T19:48:42.815021] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-27T19:48:43.506615] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T19:48:43.565764] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T19:48:43.614909] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-27T19:48:44.414917] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-27T19:48:44.532038] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T19:48:45.214938] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-27T19:48:45.553433] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T19:48:45.626469] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T19:48:46.014942] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-27T19:48:46.814957] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-27T19:48:47.065180] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T19:48:47.614954] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-27T19:48:47.864046] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T19:48:48.414952] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-27T19:48:48.949910] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T19:48:48.962684] [INFO ] [REMOTE ] MBC: Full fetch complete (63065 records). [2025-10-27T19:48:48.962895] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-27T19:48:49.220213] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-27T19:48:49.350439] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-27T19:48:49.350567] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-27T19:48:49.351555] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-27T19:48:49.351619] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-27T19:48:49.352936] [DEBUG] [LOCAL ] MBC: Trimmed 63065 records to 43734 (keeping 200 days of data) [2025-10-27T19:48:49.448143] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T19:48:49.624571] [DEBUG] [LOCAL ] MBC: Primary data saved (43734 records). [2025-10-27T19:48:49.624726] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-27T19:48:49.625441] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MBC took 27.0s. Estimated remaining: 2h 16m 45s. Rate: 7.7 symbols/min [2025-10-27T19:48:49.789758] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:49.789920] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-27T19:48:49.789956] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-27T19:48:49.790064] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-27T19:48:49.790104] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-27T19:48:49.790144] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-27T19:48:49.790174] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-27T19:48:50.014961] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-27T19:48:50.154335] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:50.757565] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T19:48:50.814944] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-27T19:48:50.856469] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T19:48:51.614947] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-27T19:48:52.414928] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-27T19:48:52.692525] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T19:48:52.739187] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T19:48:53.214937] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-27T19:48:53.607971] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T19:48:54.014918] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-27T19:48:54.072522] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:48:54.076032] [INFO ] [REMOTE ] MCB: Full fetch complete (16918 records). [2025-10-27T19:48:54.076127] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-27T19:48:54.456704] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-27T19:48:54.456785] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-27T19:48:54.457138] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-27T19:48:54.457176] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-27T19:48:54.457692] [DEBUG] [LOCAL ] MCB: Trimmed 16918 records to 11290 (keeping 200 days of data) [2025-10-27T19:48:54.524450] [DEBUG] [LOCAL ] MCB: Primary data saved (11290 records). [2025-10-27T19:48:54.524577] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-27T19:48:54.524678] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MCB took 25.3s. Estimated remaining: 2h 16m 35s. Rate: 7.7 symbols/min [2025-10-27T19:48:54.711638] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:48:54.719118] [DEBUG] [LOCAL ] MCI: Loaded 6261 existing records from primary storage. [2025-10-27T19:48:54.719312] [INFO ] [MAIN ] MCI: Loaded 6261 existing records. [2025-10-27T19:48:54.815873] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-27T19:48:54.892566] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:48:54.892775] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-27T19:48:54.892824] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-27T19:48:54.893053] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-27T19:48:54.893111] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-27T19:48:55.248055] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:48:55.303537] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T19:48:55.614969] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-27T19:48:56.414938] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-27T19:48:56.749916] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T19:48:56.816443] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T19:48:57.006064] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T19:48:57.214951] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-27T19:48:58.014945] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-27T19:48:58.814929] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-27T19:48:58.943744] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T19:48:59.335211] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T19:48:59.487772] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T19:48:59.614917] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-27T19:49:00.414986] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-27T19:49:01.214963] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-27T19:49:02.015012] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-27T19:49:02.404761] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-27T19:49:02.815020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-27T19:49:03.323938] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-27T19:49:03.614957] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-27T19:49:04.222436] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-27T19:49:04.230457] [INFO ] [REMOTE ] MC: Full fetch complete (63109 records). [2025-10-27T19:49:04.230599] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-27T19:49:04.345759] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-27T19:49:04.416300] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-27T19:49:04.631268] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-27T19:49:04.631345] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-27T19:49:04.632266] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-27T19:49:04.632328] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-27T19:49:04.633564] [DEBUG] [LOCAL ] MC: Trimmed 63109 records to 43384 (keeping 200 days of data) [2025-10-27T19:49:04.895170] [DEBUG] [LOCAL ] MC: Primary data saved (43384 records). [2025-10-27T19:49:04.895376] [INFO ] [MAIN ] MC: Full history saved. [2025-10-27T19:49:04.895474] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MC took 37.1s. Estimated remaining: 2h 16m 29s. Rate: 7.7 symbols/min [2025-10-27T19:49:05.080787] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:49:05.097950] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:05.123532] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T19:49:05.128388] [INFO ] [REMOTE ] MBI: Full fetch complete (35531 records). [2025-10-27T19:49:05.128489] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-27T19:49:05.223675] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-27T19:49:05.238274] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:49:05.428022] [DEBUG] [LOCAL ] MCK: Loaded 38481 existing records from primary storage. [2025-10-27T19:49:05.449772] [INFO ] [MAIN ] MCK: Loaded 38481 existing records. [2025-10-27T19:49:05.717426] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-27T19:49:05.719332] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-27T19:49:05.737965] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-27T19:49:05.739592] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-27T19:49:05.743837] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:05.744319] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-27T19:49:05.744517] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-27T19:49:05.744703] [DEBUG] [LOCAL ] MBI: Trimmed 35531 records to 23562 (keeping 200 days of data) [2025-10-27T19:49:05.745032] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-27T19:49:05.745139] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-27T19:49:06.027173] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-27T19:49:06.232530] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:06.252375] [DEBUG] [LOCAL ] MBI: Primary data saved (23562 records). [2025-10-27T19:49:06.252576] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-27T19:49:06.252705] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MBI took 42.2s. Estimated remaining: 2h 16m 17s. Rate: 7.7 symbols/min [2025-10-27T19:49:06.441905] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:06.453891] [DEBUG] [LOCAL ] MCN: Loaded 8104 existing records from primary storage. [2025-10-27T19:49:06.454195] [INFO ] [MAIN ] MCN: Loaded 8104 existing records. [2025-10-27T19:49:06.644820] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:06.645166] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-27T19:49:06.645223] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-27T19:49:06.645412] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-27T19:49:06.645455] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-27T19:49:06.823098] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-27T19:49:06.914017] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T19:49:07.050615] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:07.469435] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T19:49:07.614949] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-27T19:49:08.031391] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T19:49:08.414930] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-27T19:49:08.524927] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T19:49:09.214939] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-27T19:49:10.014954] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-27T19:49:10.607620] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-27T19:49:10.654037] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T19:49:10.753378] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:49:10.814939] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-27T19:49:11.565405] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T19:49:11.614980] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-27T19:49:12.155262] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T19:49:12.414942] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-27T19:49:13.214997] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-27T19:49:14.014976] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-27T19:49:14.144094] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:49:14.760739] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:49:14.799567] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T19:49:14.814897] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-27T19:49:15.614997] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-27T19:49:16.184176] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:49:16.216897] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T19:49:16.414959] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-27T19:49:17.214957] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-27T19:49:17.622207] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T19:49:17.817917] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:49:18.014993] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-27T19:49:18.403469] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T19:49:18.814965] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-27T19:49:19.423450] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T19:49:19.614963] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-27T19:49:20.323905] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T19:49:20.414940] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-27T19:49:21.214973] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-27T19:49:22.014982] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-27T19:49:22.185500] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T19:49:22.589969] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T19:49:22.753967] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:49:22.814934] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-27T19:49:23.551320] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:49:23.614941] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-27T19:49:24.106627] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T19:49:24.414963] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-27T19:49:25.132188] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T19:49:25.134014] [INFO ] [REMOTE ] MCN: Full fetch complete (11506 records). [2025-10-27T19:49:25.134083] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-27T19:49:25.220235] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-27T19:49:25.496885] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-27T19:49:25.496969] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-27T19:49:25.497265] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-27T19:49:25.497304] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-27T19:49:25.497762] [DEBUG] [LOCAL ] MCN: Trimmed 11506 records to 7854 (keeping 200 days of data) [2025-10-27T19:49:25.542135] [DEBUG] [LOCAL ] MCN: Primary data saved (7854 records). [2025-10-27T19:49:25.542261] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-27T19:49:25.542347] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCN took 19.3s. Estimated remaining: 2h 16m 18s. Rate: 7.7 symbols/min [2025-10-27T19:49:25.704707] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:25.741777] [DEBUG] [LOCAL ] MCO: Loaded 40099 existing records from primary storage. [2025-10-27T19:49:25.742066] [INFO ] [MAIN ] MCO: Loaded 40099 existing records. [2025-10-27T19:49:25.913474] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:25.913693] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-27T19:49:25.913750] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-27T19:49:25.913928] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-27T19:49:25.913964] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-27T19:49:26.020157] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-27T19:49:26.265618] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:26.594349] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T19:49:26.621263] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T19:49:26.623163] [INFO ] [REMOTE ] MCI: Full fetch complete (9782 records). [2025-10-27T19:49:26.623261] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-27T19:49:26.820130] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-27T19:49:27.006978] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-27T19:49:27.007051] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-27T19:49:27.007285] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-27T19:49:27.007327] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-27T19:49:27.007769] [DEBUG] [LOCAL ] MCI: Trimmed 9782 records to 6120 (keeping 200 days of data) [2025-10-27T19:49:27.043260] [DEBUG] [LOCAL ] MCI: Primary data saved (6120 records). [2025-10-27T19:49:27.043381] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-27T19:49:27.043459] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCI took 32.5s. Estimated remaining: 2h 16m 5s. Rate: 7.7 symbols/min [2025-10-27T19:49:27.211464] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:27.221703] [DEBUG] [LOCAL ] MCR: Loaded 8940 existing records from primary storage. [2025-10-27T19:49:27.221933] [INFO ] [MAIN ] MCR: Loaded 8940 existing records. [2025-10-27T19:49:27.393493] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:27.393736] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-27T19:49:27.393788] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-27T19:49:27.394027] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-27T19:49:27.394082] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-27T19:49:27.624519] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-27T19:49:27.766755] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:28.044991] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T19:49:28.415002] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-27T19:49:28.644394] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T19:49:28.655892] [INFO ] [REMOTE ] MCD: Full fetch complete (77119 records). [2025-10-27T19:49:28.656086] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-27T19:49:28.852582] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T19:49:28.853472] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:49:28.853544] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:49:28.853616] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-27T19:49:28.853722] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-27T19:49:28.853769] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-27T19:49:28.853854] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-27T19:49:28.853929] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCD took 39.2s. Estimated remaining: 2h 15m 53s. Rate: 7.7 symbols/min [2025-10-27T19:49:29.040026] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T19:49:29.043147] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:29.073974] [DEBUG] [LOCAL ] MCS: Loaded 21485 existing records from primary storage. [2025-10-27T19:49:29.074342] [INFO ] [MAIN ] MCS: Loaded 21485 existing records. [2025-10-27T19:49:29.219413] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-27T19:49:29.255274] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:29.255475] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-27T19:49:29.255520] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-27T19:49:29.255718] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-27T19:49:29.255774] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-27T19:49:29.621625] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:29.814738] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:49:30.014935] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-27T19:49:30.814918] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-27T19:49:30.882953] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:49:31.614940] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-27T19:49:31.845903] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T19:49:32.414948] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-27T19:49:32.628886] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T19:49:33.214947] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-27T19:49:33.806371] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T19:49:33.812877] [INFO ] [REMOTE ] MCK: Full fetch complete (56445 records). [2025-10-27T19:49:33.813017] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-27T19:49:34.023757] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-27T19:49:34.223675] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-27T19:49:34.223779] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-27T19:49:34.224847] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-27T19:49:34.224960] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-27T19:49:34.241272] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T19:49:34.247092] [DEBUG] [LOCAL ] MCK: Trimmed 56445 records to 37561 (keeping 200 days of data) [2025-10-27T19:49:34.478122] [DEBUG] [LOCAL ] MCK: Primary data saved (37561 records). [2025-10-27T19:49:34.478261] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-27T19:49:34.478677] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCK took 29.6s. Estimated remaining: 2h 15m 43s. Rate: 7.8 symbols/min [2025-10-27T19:49:34.644879] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:34.668118] [DEBUG] [LOCAL ] MCY: Loaded 23761 existing records from primary storage. [2025-10-27T19:49:34.668362] [INFO ] [MAIN ] MCY: Loaded 23761 existing records. [2025-10-27T19:49:34.820542] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-27T19:49:34.844990] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:34.845266] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-27T19:49:34.845313] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-27T19:49:34.845485] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-27T19:49:34.845522] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-27T19:49:34.933019] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T19:49:35.213540] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:35.614980] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-27T19:49:35.645517] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T19:49:36.213107] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T19:49:36.414935] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-27T19:49:36.531075] [DEBUG] [REMOTE ] MCY: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-27T19:49:36.531316] [WARN ] [REMOTE ] MCY: No data returned for month 2025-01 [2025-10-27T19:49:36.531403] [FATAL] [REMOTE ] MCY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:49:36.531475] [FATAL] [MAIN ] MCY: Failed to fetch primary data. [2025-10-27T19:49:36.531541] [WARN ] [MAIN ] MCY: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:49:36.531610] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-27T19:49:36.531701] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-10-27T19:49:36.531752] [INFO ] [LOCAL ] MCY: Starting deletion of derivative data. [2025-10-27T19:49:36.531916] [DEBUG] [LOCAL ] MCY: Deleted derivative data file. [2025-10-27T19:49:36.532006] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCY took 2.1s. Estimated remaining: 2h 15m 31s. Rate: 7.8 symbols/min [2025-10-27T19:49:36.698513] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:36.736178] [DEBUG] [LOCAL ] MD: Loaded 39054 existing records from primary storage. [2025-10-27T19:49:36.736441] [INFO ] [MAIN ] MD: Loaded 39054 existing records. [2025-10-27T19:49:36.908695] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:36.908885] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-27T19:49:36.908930] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-27T19:49:36.909250] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-27T19:49:36.909305] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-27T19:49:37.220121] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-27T19:49:37.288199] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:37.961518] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T19:49:38.014900] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-27T19:49:38.799934] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T19:49:38.814903] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-27T19:49:39.463252] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T19:49:39.614926] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-27T19:49:40.414935] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-27T19:49:40.600039] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T19:49:41.214949] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-27T19:49:41.266459] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T19:49:42.014929] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-27T19:49:42.494622] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T19:49:42.605480] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T19:49:42.814951] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-27T19:49:43.614945] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-27T19:49:44.403920] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T19:49:44.414897] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-27T19:49:44.513088] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T19:49:44.515494] [INFO ] [REMOTE ] MCR: Full fetch complete (13414 records). [2025-10-27T19:49:44.515593] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-27T19:49:44.879423] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-27T19:49:44.879497] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-27T19:49:44.879810] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-27T19:49:44.879870] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-27T19:49:44.880320] [DEBUG] [LOCAL ] MCR: Trimmed 13414 records to 8810 (keeping 200 days of data) [2025-10-27T19:49:44.930107] [DEBUG] [LOCAL ] MCR: Primary data saved (8810 records). [2025-10-27T19:49:44.930229] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-27T19:49:44.930302] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCR took 17.9s. Estimated remaining: 2h 15m 24s. Rate: 7.8 symbols/min [2025-10-27T19:49:45.101279] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:49:45.108963] [DEBUG] [LOCAL ] MDST: Loaded 6257 existing records from primary storage. [2025-10-27T19:49:45.109181] [INFO ] [MAIN ] MDST: Loaded 6257 existing records. [2025-10-27T19:49:45.220026] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-27T19:49:45.295071] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:49:45.295438] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-27T19:49:45.295494] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-27T19:49:45.295753] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-27T19:49:45.295812] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-27T19:49:45.666748] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:49:45.946726] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T19:49:46.014915] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-27T19:49:46.116384] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T19:49:46.544110] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T19:49:46.814928] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-27T19:49:47.382510] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:49:47.614911] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-27T19:49:48.414952] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-27T19:49:48.640386] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T19:49:49.214968] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-27T19:49:49.442153] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T19:49:49.818001] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:49:50.014966] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-27T19:49:50.814988] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-27T19:49:51.364563] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T19:49:51.614962] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-27T19:49:51.892444] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T19:49:51.990096] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T19:49:52.414974] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-27T19:49:53.214939] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-27T19:49:53.578228] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T19:49:54.021217] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-27T19:49:54.026245] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:49:54.567159] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T19:49:54.814937] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-27T19:49:55.614985] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-27T19:49:56.181080] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T19:49:56.414924] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-27T19:49:56.584560] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T19:49:56.830106] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T19:49:57.214940] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-27T19:49:58.014945] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-27T19:49:58.754177] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T19:49:58.780949] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T19:49:58.814907] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-27T19:49:59.614934] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-27T19:49:59.949887] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:50:00.414938] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-27T19:50:01.214926] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-27T19:50:01.468148] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T19:50:02.014984] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-27T19:50:02.814959] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-27T19:50:02.869410] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T19:50:03.070185] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-27T19:50:03.217743] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T19:50:03.614928] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-27T19:50:04.414925] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-27T19:50:04.479763] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T19:50:05.214925] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-27T19:50:05.374499] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T19:50:05.381353] [INFO ] [REMOTE ] MCS: Full fetch complete (30701 records). [2025-10-27T19:50:05.381503] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-27T19:50:05.697985] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T19:50:05.717447] [INFO ] [REMOTE ] MDST: Full fetch complete (8918 records). [2025-10-27T19:50:05.733134] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-27T19:50:05.962980] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-27T19:50:05.974475] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-27T19:50:05.985435] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-27T19:50:05.993364] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-27T19:50:06.020160] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-27T19:50:06.023718] [DEBUG] [LOCAL ] MCS: Trimmed 30701 records to 21024 (keeping 200 days of data) [2025-10-27T19:50:06.285200] [DEBUG] [LOCAL ] MCS: Primary data saved (21024 records). [2025-10-27T19:50:06.326921] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-27T19:50:06.340083] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCS took 37.5s. Estimated remaining: 2h 15m 27s. Rate: 7.7 symbols/min [2025-10-27T19:50:06.340279] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-27T19:50:06.340512] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-27T19:50:06.340796] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-27T19:50:06.340856] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-27T19:50:06.341254] [DEBUG] [LOCAL ] MDST: Trimmed 8918 records to 6157 (keeping 200 days of data) [2025-10-27T19:50:06.378591] [DEBUG] [LOCAL ] MDST: Primary data saved (6157 records). [2025-10-27T19:50:06.378746] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-27T19:50:06.378836] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 21.4s. Estimated remaining: 2h 15m 13s. Rate: 7.8 symbols/min [2025-10-27T19:50:06.521332] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T19:50:06.814999] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-27T19:50:07.771880] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T19:50:07.780902] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-27T19:50:08.212951] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:50:08.415022] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-27T19:50:09.221072] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T19:50:09.229053] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-27T19:50:09.598629] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:50:10.015008] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-27T19:50:10.682947] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T19:50:10.691625] [INFO ] [REMOTE ] MD: Full fetch complete (55357 records). [2025-10-27T19:50:10.691819] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-27T19:50:11.113410] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-27T19:50:11.113489] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-27T19:50:11.114374] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-27T19:50:11.114438] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-27T19:50:11.115566] [DEBUG] [LOCAL ] MD: Trimmed 55357 records to 38402 (keeping 200 days of data) [2025-10-27T19:50:11.336413] [DEBUG] [LOCAL ] MD: Primary data saved (38402 records). [2025-10-27T19:50:11.336550] [INFO ] [MAIN ] MD: Full history saved. [2025-10-27T19:50:11.336984] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MD took 34.8s. Estimated remaining: 2h 15m 3s. Rate: 7.8 symbols/min [2025-10-27T19:50:11.948060] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:50:11.961213] [INFO ] [REMOTE ] MCO: Full fetch complete (58493 records). [2025-10-27T19:50:11.961420] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-27T19:50:12.358766] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-27T19:50:12.358841] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-27T19:50:12.359830] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-27T19:50:12.359892] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-27T19:50:12.361029] [DEBUG] [LOCAL ] MCO: Trimmed 58493 records to 39288 (keeping 200 days of data) [2025-10-27T19:50:12.616235] [DEBUG] [LOCAL ] MCO: Primary data saved (39288 records). [2025-10-27T19:50:12.616416] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-27T19:50:12.616525] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MCO took 47.1s. Estimated remaining: 2h 14m 50s. Rate: 7.8 symbols/min [2025-10-27T19:50:13.162064] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.332236] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.336026] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.358009] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:13.364258] [DEBUG] [LOCAL ] MDV: Loaded 8375 existing records from primary storage. [2025-10-27T19:50:13.364956] [INFO ] [MAIN ] MDV: Loaded 8375 existing records. [2025-10-27T19:50:13.489047] [DEBUG] [LOCAL ] MEC: Loaded 17160 existing records from primary storage. [2025-10-27T19:50:13.500359] [INFO ] [MAIN ] MEC: Loaded 17160 existing records. [2025-10-27T19:50:13.685191] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:13.740480] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-27T19:50:13.757837] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-27T19:50:13.757684] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-27T19:50:13.769747] [DEBUG] [LOCAL ] MDU: Loaded 48743 existing records from primary storage. [2025-10-27T19:50:13.785014] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-27T19:50:13.790860] [INFO ] [MAIN ] MDT: Loaded 54458 existing records. [2025-10-27T19:50:13.791212] [INFO ] [MAIN ] MDU: Loaded 48743 existing records. [2025-10-27T19:50:13.809401] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-27T19:50:14.038094] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.179604] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.223478] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-27T19:50:14.370124] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.393755] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.359060] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-27T19:50:14.409745] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-27T19:50:14.445871] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-27T19:50:14.492787] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:14.481933] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-27T19:50:14.529868] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-27T19:50:14.580443] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-27T19:50:14.689142] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-27T19:50:14.787092] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-27T19:50:14.792543] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-27T19:50:15.227995] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.278896] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-27T19:50:15.663851] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.745416] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-27T19:50:15.907894] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.940189] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:15.940751] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-27T19:50:15.941339] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-27T19:50:16.105260] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T19:50:16.107128] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-27T19:50:16.368066] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T19:50:16.371245] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-27T19:50:16.783600] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T19:50:16.785519] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-27T19:50:16.975611] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:50:16.978219] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-27T19:50:17.023121] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T19:50:17.214962] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-27T19:50:17.335526] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T19:50:17.633904] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T19:50:17.655855] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T19:50:18.014924] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-27T19:50:18.755525] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T19:50:18.814954] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-27T19:50:19.614954] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-27T19:50:19.968249] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T19:50:20.056791] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T19:50:20.414993] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-27T19:50:20.458884] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T19:50:21.214960] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-27T19:50:21.744198] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T19:50:21.967812] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T19:50:22.014917] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-27T19:50:22.814941] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-27T19:50:23.614926] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-27T19:50:23.772137] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:50:23.944526] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T19:50:24.363120] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T19:50:24.414898] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-27T19:50:24.885259] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T19:50:25.214941] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-27T19:50:25.648867] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T19:50:26.014947] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-27T19:50:26.814967] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-27T19:50:27.614921] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-27T19:50:27.913432] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T19:50:28.185211] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:50:28.306119] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T19:50:28.414918] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-27T19:50:29.214959] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-27T19:50:29.859160] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T19:50:30.014939] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-27T19:50:30.656547] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T19:50:30.814971] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-27T19:50:30.849699] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T19:50:31.614937] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-27T19:50:31.968024] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T19:50:32.414962] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-27T19:50:32.895702] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T19:50:32.897725] [INFO ] [REMOTE ] MDV: Full fetch complete (11711 records). [2025-10-27T19:50:32.897805] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-27T19:50:33.219481] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-27T19:50:33.294033] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-27T19:50:33.294161] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-27T19:50:33.294471] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-27T19:50:33.294534] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-27T19:50:33.295348] [DEBUG] [LOCAL ] MDV: Trimmed 11711 records to 8221 (keeping 200 days of data) [2025-10-27T19:50:33.344618] [DEBUG] [LOCAL ] MDV: Primary data saved (8221 records). [2025-10-27T19:50:33.344845] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-27T19:50:33.345046] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 20.7s. Estimated remaining: 2h 14m 53s. Rate: 7.7 symbols/min [2025-10-27T19:50:33.524157] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:33.551349] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T19:50:33.580910] [DEBUG] [LOCAL ] MED: Loaded 21277 existing records from primary storage. [2025-10-27T19:50:33.581155] [INFO ] [MAIN ] MED: Loaded 21277 existing records. [2025-10-27T19:50:33.752961] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:33.753176] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-27T19:50:33.753221] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-27T19:50:33.753493] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-27T19:50:33.753549] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-27T19:50:34.020058] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-27T19:50:34.118327] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:34.129700] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T19:50:34.814953] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-27T19:50:35.232939] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T19:50:35.614944] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-27T19:50:36.057819] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T19:50:36.414973] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-27T19:50:36.606888] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T19:50:37.214970] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-27T19:50:38.022558] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-27T19:50:38.025679] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T19:50:38.287881] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T19:50:38.814937] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-27T19:50:39.423084] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T19:50:39.614950] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-27T19:50:40.326630] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T19:50:40.404919] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:50:40.414927] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-27T19:50:41.214914] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-27T19:50:41.549070] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T19:50:42.014955] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-27T19:50:42.599127] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T19:50:42.814927] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-27T19:50:42.997317] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T19:50:43.007362] [INFO ] [REMOTE ] MDU: Full fetch complete (70707 records). [2025-10-27T19:50:43.007509] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-27T19:50:43.389897] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-27T19:50:43.390000] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-27T19:50:43.390994] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-27T19:50:43.391059] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-27T19:50:43.392452] [DEBUG] [LOCAL ] MDU: Trimmed 70707 records to 47956 (keeping 200 days of data) [2025-10-27T19:50:43.513944] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T19:50:43.621339] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-27T19:50:43.702867] [DEBUG] [LOCAL ] MDU: Primary data saved (47956 records). [2025-10-27T19:50:43.702979] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-27T19:50:43.703071] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MDU took 31.1s. Estimated remaining: 2h 14m 47s. Rate: 7.7 symbols/min [2025-10-27T19:50:43.872233] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:43.902495] [DEBUG] [LOCAL ] MEG: Loaded 32046 existing records from primary storage. [2025-10-27T19:50:43.902771] [INFO ] [MAIN ] MEG: Loaded 32046 existing records. [2025-10-27T19:50:44.076441] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:44.076731] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-27T19:50:44.076788] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-27T19:50:44.077058] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-27T19:50:44.077114] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-27T19:50:44.421747] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-27T19:50:44.428525] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:44.441981] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T19:50:45.214910] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-27T19:50:45.873816] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:50:46.008819] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T19:50:46.019298] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-27T19:50:46.814981] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-27T19:50:47.391408] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:50:47.615038] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-27T19:50:47.825051] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T19:50:48.415757] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-27T19:50:48.418500] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:50:49.214967] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-27T19:50:49.778633] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T19:50:50.015027] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-27T19:50:50.436775] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T19:50:50.449004] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-27T19:50:50.449213] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-27T19:50:50.826324] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-27T19:50:50.853384] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-27T19:50:50.853505] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-27T19:50:50.855962] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-27T19:50:50.856461] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-27T19:50:50.858973] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-27T19:50:51.105379] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T19:50:51.111977] [INFO ] [REMOTE ] MED: Full fetch complete (31804 records). [2025-10-27T19:50:51.112741] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-27T19:50:51.522261] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-27T19:50:51.524795] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-27T19:50:51.530358] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-27T19:50:51.563835] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-27T19:50:51.605373] [DEBUG] [LOCAL ] MED: Trimmed 31804 records to 20766 (keeping 200 days of data) [2025-10-27T19:50:51.617889] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-27T19:50:51.617802] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-27T19:50:51.619339] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-27T19:50:51.619446] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MDT took 39.0s. Estimated remaining: 2h 14m 40s. Rate: 7.7 symbols/min [2025-10-27T19:50:51.848855] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T19:50:51.943498] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:51.968294] [DEBUG] [LOCAL ] MED: Primary data saved (20766 records). [2025-10-27T19:50:51.968557] [INFO ] [MAIN ] MED: Full history saved. [2025-10-27T19:50:51.968820] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MED took 18.6s. Estimated remaining: 2h 14m 26s. Rate: 7.8 symbols/min [2025-10-27T19:50:52.061553] [DEBUG] [LOCAL ] MEGI: Loaded 19980 existing records from primary storage. [2025-10-27T19:50:52.085225] [INFO ] [MAIN ] MEGI: Loaded 19980 existing records. [2025-10-27T19:50:52.307079] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:52.373771] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:52.374067] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-27T19:50:52.374122] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-27T19:50:52.374476] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-27T19:50:52.374533] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-27T19:50:52.415678] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-27T19:50:52.553559] [DEBUG] [LOCAL ] MEI: Loaded 31676 existing records from primary storage. [2025-10-27T19:50:52.575957] [INFO ] [MAIN ] MEI: Loaded 31676 existing records. [2025-10-27T19:50:52.877520] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:52.945298] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:52.945528] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-27T19:50:52.945576] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-27T19:50:52.945806] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-27T19:50:52.945863] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-27T19:50:53.221618] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-27T19:50:53.307124] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:53.328696] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:50:53.587316] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T19:50:53.591276] [INFO ] [REMOTE ] MEC: Full fetch complete (23113 records). [2025-10-27T19:50:53.591351] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-27T19:50:53.957023] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-27T19:50:53.957100] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-27T19:50:53.957586] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-27T19:50:53.957626] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-27T19:50:53.958297] [DEBUG] [LOCAL ] MEC: Trimmed 23113 records to 16889 (keeping 200 days of data) [2025-10-27T19:50:54.028476] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-27T19:50:54.063434] [DEBUG] [LOCAL ] MEC: Primary data saved (16889 records). [2025-10-27T19:50:54.063698] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-27T19:50:54.063877] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MEC took 41.4s. Estimated remaining: 2h 14m 14s. Rate: 7.8 symbols/min [2025-10-27T19:50:54.231679] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:50:54.247826] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T19:50:54.297713] [DEBUG] [LOCAL ] MET: Loaded 54064 existing records from primary storage. [2025-10-27T19:50:54.298020] [INFO ] [MAIN ] MET: Loaded 54064 existing records. [2025-10-27T19:50:54.469191] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:50:54.469384] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-27T19:50:54.469430] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-27T19:50:54.469755] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-27T19:50:54.469811] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-27T19:50:54.816848] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-27T19:50:54.820751] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:50:55.260943] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T19:50:55.614922] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-27T19:50:55.860401] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T19:50:56.337846] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T19:50:56.414920] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-27T19:50:57.214942] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-27T19:50:57.807015] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T19:50:58.014942] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-27T19:50:58.433817] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T19:50:58.711937] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T19:50:58.814921] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-27T19:50:59.614975] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-27T19:50:59.750343] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T19:51:00.414932] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-27T19:51:01.214941] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-27T19:51:02.014931] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-27T19:51:02.188433] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-27T19:51:02.815045] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-27T19:51:04.160015] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-27T19:51:04.164071] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-27T19:51:04.892198] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (4.48 seconds). [2025-10-27T19:51:04.899863] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-27T19:51:05.085404] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-27T19:51:05.214954] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-27T19:51:05.298953] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (3.28 seconds). [2025-10-27T19:51:05.500516] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T19:51:05.867012] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T19:51:06.014965] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-27T19:51:06.238010] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T19:51:06.814933] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-27T19:51:07.614973] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-27T19:51:07.717108] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T19:51:08.250584] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T19:51:08.340934] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T19:51:08.414927] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-27T19:51:09.214968] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-27T19:51:09.489232] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T19:51:09.885816] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T19:51:10.015002] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-27T19:51:10.814951] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-27T19:51:11.614967] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-27T19:51:11.697410] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T19:51:11.887478] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T19:51:12.414929] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-27T19:51:13.116372] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T19:51:13.214960] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-27T19:51:14.014920] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-27T19:51:14.292476] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T19:51:14.296579] [INFO ] [REMOTE ] MEGI: Full fetch complete (28872 records). [2025-10-27T19:51:14.296865] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-27T19:51:14.436705] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T19:51:14.723235] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-27T19:51:14.723310] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-27T19:51:14.724017] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-27T19:51:14.724078] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-27T19:51:14.724900] [DEBUG] [LOCAL ] MEGI: Trimmed 28872 records to 19596 (keeping 200 days of data) [2025-10-27T19:51:14.816712] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-27T19:51:14.842554] [DEBUG] [LOCAL ] MEGI: Primary data saved (19596 records). [2025-10-27T19:51:14.842721] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-27T19:51:14.842807] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MEGI took 23.2s. Estimated remaining: 2h 14m 16s. Rate: 7.7 symbols/min [2025-10-27T19:51:15.009486] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:15.051570] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:51:15.074076] [DEBUG] [LOCAL ] MFA: Loaded 46167 existing records from primary storage. [2025-10-27T19:51:15.074382] [INFO ] [MAIN ] MFA: Loaded 46167 existing records. [2025-10-27T19:51:15.244748] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:15.244953] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-27T19:51:15.245000] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-27T19:51:15.245186] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-27T19:51:15.245223] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-27T19:51:15.586009] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:15.614904] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-27T19:51:16.296089] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T19:51:16.414897] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-27T19:51:17.082313] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T19:51:17.214905] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-27T19:51:18.014937] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-27T19:51:18.142834] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:51:18.337189] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T19:51:18.814982] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-27T19:51:18.901681] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T19:51:19.614990] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-27T19:51:20.414932] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-27T19:51:20.523441] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T19:51:21.099496] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:51:21.214988] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-27T19:51:21.765834] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T19:51:22.014945] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-27T19:51:22.748854] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T19:51:22.814995] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-27T19:51:23.582832] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T19:51:23.589456] [INFO ] [REMOTE ] MEG: Full fetch complete (47272 records). [2025-10-27T19:51:23.589565] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-27T19:51:23.620090] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-27T19:51:23.987070] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-27T19:51:23.987287] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-27T19:51:23.988159] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-27T19:51:23.988359] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-27T19:51:23.989995] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T19:51:23.998118] [DEBUG] [LOCAL ] MEG: Trimmed 47272 records to 31233 (keeping 200 days of data) [2025-10-27T19:51:24.172885] [DEBUG] [LOCAL ] MEG: Primary data saved (31233 records). [2025-10-27T19:51:24.173014] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-27T19:51:24.173090] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEG took 40.5s. Estimated remaining: 2h 14m 10s. Rate: 7.7 symbols/min [2025-10-27T19:51:24.378090] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:24.386759] [DEBUG] [LOCAL ] MFAN: Loaded 4371 existing records from primary storage. [2025-10-27T19:51:24.386987] [INFO ] [MAIN ] MFAN: Loaded 4371 existing records. [2025-10-27T19:51:24.420182] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-27T19:51:24.569790] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:24.570008] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-27T19:51:24.570055] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-27T19:51:24.570200] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-27T19:51:24.570257] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-27T19:51:24.914413] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:25.214940] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-27T19:51:25.556487] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-27T19:51:25.678588] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T19:51:25.706265] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T19:51:26.015000] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-27T19:51:26.460027] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T19:51:26.814970] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-27T19:51:27.614936] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-27T19:51:27.675329] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:51:27.681111] [INFO ] [REMOTE ] MEI: Full fetch complete (45342 records). [2025-10-27T19:51:27.681196] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-27T19:51:28.055999] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-27T19:51:28.056071] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-27T19:51:28.056883] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-27T19:51:28.056944] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-27T19:51:28.057845] [DEBUG] [LOCAL ] MEI: Trimmed 45342 records to 31111 (keeping 200 days of data) [2025-10-27T19:51:28.233268] [DEBUG] [LOCAL ] MEI: Primary data saved (31111 records). [2025-10-27T19:51:28.233417] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-27T19:51:28.233525] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MEI took 36.3s. Estimated remaining: 2h 13m 59s. Rate: 7.7 symbols/min [2025-10-27T19:51:28.401613] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:28.407903] [DEBUG] [LOCAL ] MFAO: Loaded 3917 existing records from primary storage. [2025-10-27T19:51:28.408086] [INFO ] [MAIN ] MFAO: Loaded 3917 existing records. [2025-10-27T19:51:28.420495] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-27T19:51:28.586908] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:28.587099] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-27T19:51:28.587147] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-27T19:51:28.587281] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-27T19:51:28.587337] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-27T19:51:28.953012] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:29.034539] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T19:51:29.103813] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T19:51:29.214931] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-27T19:51:29.870000] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:51:30.014947] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-27T19:51:30.814958] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-27T19:51:31.350455] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T19:51:31.614923] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-27T19:51:31.864496] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T19:51:31.875327] [INFO ] [REMOTE ] MET: Full fetch complete (77355 records). [2025-10-27T19:51:31.875474] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-27T19:51:32.248627] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T19:51:32.272292] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-27T19:51:32.272619] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-27T19:51:32.273685] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-27T19:51:32.273746] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-27T19:51:32.275015] [DEBUG] [LOCAL ] MET: Trimmed 77355 records to 53279 (keeping 200 days of data) [2025-10-27T19:51:32.454560] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-27T19:51:32.601908] [DEBUG] [LOCAL ] MET: Primary data saved (53279 records). [2025-10-27T19:51:32.602037] [INFO ] [MAIN ] MET: Full history saved. [2025-10-27T19:51:32.602117] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols completed. MET took 38.5s. Estimated remaining: 2h 13m 49s. Rate: 7.7 symbols/min [2025-10-27T19:51:32.768692] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:32.804255] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T19:51:32.820392] [DEBUG] [LOCAL ] MFC: Loaded 51713 existing records from primary storage. [2025-10-27T19:51:32.820704] [INFO ] [MAIN ] MFC: Loaded 51713 existing records. [2025-10-27T19:51:32.993675] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:32.993892] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-27T19:51:32.993938] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-27T19:51:32.994117] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-27T19:51:32.994154] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-27T19:51:33.223047] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-27T19:51:33.350026] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:33.810596] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T19:51:34.014935] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-27T19:51:34.814958] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-27T19:51:35.213175] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T19:51:35.614970] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-27T19:51:36.204393] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T19:51:36.305272] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:51:36.414920] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-27T19:51:36.910592] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T19:51:37.214948] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-27T19:51:37.776083] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T19:51:38.014952] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-27T19:51:38.385178] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-27T19:51:38.814951] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-27T19:51:39.355287] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T19:51:39.614934] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-27T19:51:40.414949] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-27T19:51:41.139604] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T19:51:41.214932] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-27T19:51:41.849747] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T19:51:42.014960] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-27T19:51:42.395582] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T19:51:42.478939] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T19:51:42.814984] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-27T19:51:43.614974] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-27T19:51:44.060134] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T19:51:44.254823] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T19:51:44.414992] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-27T19:51:45.214974] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-27T19:51:45.867810] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T19:51:45.869392] [INFO ] [REMOTE ] MFAN: Full fetch complete (6015 records). [2025-10-27T19:51:45.869465] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-27T19:51:46.020725] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-27T19:51:46.241782] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T19:51:46.269025] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-27T19:51:46.269114] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-27T19:51:46.278569] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-27T19:51:46.278997] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-27T19:51:46.280278] [DEBUG] [LOCAL ] MFAN: Trimmed 6015 records to 4192 (keeping 200 days of data) [2025-10-27T19:51:46.305301] [DEBUG] [LOCAL ] MFAN: Primary data saved (4192 records). [2025-10-27T19:51:46.305425] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-27T19:51:46.305504] [INFO ] [MAIN ] Update Progress: 1330/2366 symbols completed. MFAN took 22.1s. Estimated remaining: 2h 13m 46s. Rate: 7.7 symbols/min [2025-10-27T19:51:46.502336] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:46.553063] [DEBUG] [LOCAL ] MFG: Loaded 50211 existing records from primary storage. [2025-10-27T19:51:46.553457] [INFO ] [MAIN ] MFG: Loaded 50211 existing records. [2025-10-27T19:51:46.655298] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T19:51:46.777702] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:46.777991] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-27T19:51:46.778062] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-27T19:51:46.778482] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-27T19:51:46.778557] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-27T19:51:46.825128] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-27T19:51:47.314776] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:47.343297] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T19:51:47.614979] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-27T19:51:48.415017] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-27T19:51:48.671418] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T19:51:49.214965] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-27T19:51:49.689831] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T19:51:50.014949] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-27T19:51:50.117085] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T19:51:50.125794] [INFO ] [REMOTE ] MFA: Full fetch complete (65128 records). [2025-10-27T19:51:50.125934] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-27T19:51:50.518822] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-27T19:51:50.518899] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-27T19:51:50.519851] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-27T19:51:50.519913] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-27T19:51:50.521239] [DEBUG] [LOCAL ] MFA: Trimmed 65128 records to 45266 (keeping 200 days of data) [2025-10-27T19:51:50.780790] [DEBUG] [LOCAL ] MFA: Primary data saved (45266 records). [2025-10-27T19:51:50.780910] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-27T19:51:50.781609] [INFO ] [MAIN ] Update Progress: 1331/2366 symbols completed. MFA took 35.9s. Estimated remaining: 2h 13m 35s. Rate: 7.7 symbols/min [2025-10-27T19:51:50.823469] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-27T19:51:50.950138] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:50.966327] [DEBUG] [LOCAL ] MFM: Loaded 14207 existing records from primary storage. [2025-10-27T19:51:50.966558] [INFO ] [MAIN ] MFM: Loaded 14207 existing records. [2025-10-27T19:51:51.140563] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:51:51.140810] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-27T19:51:51.140858] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-27T19:51:51.141113] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-27T19:51:51.141154] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-27T19:51:51.500260] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:51.573297] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T19:51:51.614923] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-27T19:51:52.082703] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:51:52.414948] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-27T19:51:53.108605] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T19:51:53.214944] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-27T19:51:53.275556] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T19:51:54.014965] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-27T19:51:54.814955] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-27T19:51:55.251842] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T19:51:55.253270] [INFO ] [REMOTE ] MFAO: Full fetch complete (5469 records). [2025-10-27T19:51:55.253339] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-27T19:51:55.623103] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-27T19:51:55.624395] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-27T19:51:55.624587] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-27T19:51:55.624816] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-27T19:51:55.624877] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-27T19:51:55.625246] [DEBUG] [LOCAL ] MFAO: Trimmed 5469 records to 3768 (keeping 200 days of data) [2025-10-27T19:51:55.648075] [DEBUG] [LOCAL ] MFAO: Primary data saved (3768 records). [2025-10-27T19:51:55.648178] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-27T19:51:55.648254] [INFO ] [MAIN ] Update Progress: 1332/2366 symbols completed. MFAO took 27.4s. Estimated remaining: 2h 13m 25s. Rate: 7.7 symbols/min [2025-10-27T19:51:55.830130] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:51:55.830598] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-27T19:51:55.830773] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-27T19:51:55.830948] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-27T19:51:55.831174] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-27T19:51:55.831328] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-27T19:51:55.831384] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-27T19:51:56.131898] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T19:51:56.244606] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:51:56.405206] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:51:56.414914] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-27T19:51:56.672742] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (3.46 seconds). [2025-10-27T19:51:56.929808] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T19:51:57.214955] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-27T19:51:58.014941] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-27T19:51:58.330226] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T19:51:58.393462] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T19:51:58.814935] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-27T19:51:59.614950] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-27T19:51:59.936560] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T19:52:00.414930] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-27T19:52:01.214951] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-27T19:52:01.580584] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T19:52:02.015119] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-27T19:52:02.264327] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T19:52:02.814951] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-27T19:52:03.614930] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-27T19:52:03.679923] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-27T19:52:04.288163] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T19:52:04.414938] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-27T19:52:04.839069] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-27T19:52:04.849180] [INFO ] [REMOTE ] MFC: Full fetch complete (74353 records). [2025-10-27T19:52:04.849314] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-27T19:52:05.173295] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T19:52:05.217062] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-27T19:52:05.265391] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-27T19:52:05.265504] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-27T19:52:05.266676] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-27T19:52:05.266865] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-27T19:52:05.268392] [DEBUG] [LOCAL ] MFC: Trimmed 74353 records to 50900 (keeping 200 days of data) [2025-10-27T19:52:05.507946] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-27T19:52:05.612085] [DEBUG] [LOCAL ] MFC: Primary data saved (50900 records). [2025-10-27T19:52:05.612219] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-27T19:52:05.612297] [INFO ] [MAIN ] Update Progress: 1333/2366 symbols completed. MFC took 33.0s. Estimated remaining: 2h 13m 19s. Rate: 7.7 symbols/min [2025-10-27T19:52:05.676292] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T19:52:05.778188] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:05.786428] [DEBUG] [LOCAL ] MFSG: Loaded 6020 existing records from primary storage. [2025-10-27T19:52:05.786681] [INFO ] [MAIN ] MFSG: Loaded 6020 existing records. [2025-10-27T19:52:05.955898] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:05.956094] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-27T19:52:05.956141] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-27T19:52:05.956408] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-27T19:52:05.956463] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-27T19:52:06.020079] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-27T19:52:06.321926] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:06.814951] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-27T19:52:07.150760] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T19:52:07.600689] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T19:52:07.614897] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-27T19:52:08.414948] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-27T19:52:08.840206] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T19:52:09.214934] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-27T19:52:09.479181] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T19:52:09.655994] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T19:52:10.014963] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-27T19:52:10.270194] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T19:52:10.814943] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-27T19:52:11.475329] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T19:52:11.614936] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-27T19:52:12.414973] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-27T19:52:13.214935] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-27T19:52:13.218797] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:52:13.344552] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:52:13.517618] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-27T19:52:14.014939] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-27T19:52:14.280084] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-27T19:52:14.814993] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-27T19:52:15.614936] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-27T19:52:15.638187] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T19:52:15.883576] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-27T19:52:16.414989] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-27T19:52:16.776818] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-27T19:52:17.214925] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-27T19:52:17.738509] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T19:52:18.014979] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-27T19:52:18.450292] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T19:52:18.814918] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-27T19:52:19.354693] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T19:52:19.614927] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-27T19:52:20.020074] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T19:52:20.414942] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-27T19:52:21.107917] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T19:52:21.109444] [INFO ] [REMOTE ] MFSB: Full fetch complete (2153 records). [2025-10-27T19:52:21.109511] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-27T19:52:21.220105] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-27T19:52:21.290119] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-27T19:52:21.290322] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:52:21.290391] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:52:21.290464] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-27T19:52:21.290549] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-27T19:52:21.290606] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-27T19:52:21.290682] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-27T19:52:21.290777] [INFO ] [MAIN ] Update Progress: 1334/2366 symbols completed. MFSB took 25.6s. Estimated remaining: 2h 13m 18s. Rate: 7.7 symbols/min [2025-10-27T19:52:21.454204] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:21.468776] [DEBUG] [LOCAL ] MFSI: Loaded 12878 existing records from primary storage. [2025-10-27T19:52:21.469039] [INFO ] [MAIN ] MFSI: Loaded 12878 existing records. [2025-10-27T19:52:21.642282] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:21.642470] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-27T19:52:21.642516] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-27T19:52:21.642736] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-27T19:52:21.642792] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-27T19:52:22.001922] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:22.014897] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-27T19:52:22.113846] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T19:52:22.116730] [INFO ] [REMOTE ] MFM: Full fetch complete (19396 records). [2025-10-27T19:52:22.116804] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-27T19:52:22.472908] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-27T19:52:22.473101] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-27T19:52:22.473579] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-27T19:52:22.473625] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-27T19:52:22.474267] [DEBUG] [LOCAL ] MFM: Trimmed 19396 records to 13557 (keeping 200 days of data) [2025-10-27T19:52:22.539253] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T19:52:22.578693] [DEBUG] [LOCAL ] MFM: Primary data saved (13557 records). [2025-10-27T19:52:22.578865] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-27T19:52:22.578955] [INFO ] [MAIN ] Update Progress: 1335/2366 symbols completed. MFM took 31.8s. Estimated remaining: 2h 13m 5s. Rate: 7.7 symbols/min [2025-10-27T19:52:22.750181] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:22.755418] [DEBUG] [LOCAL ] MFSV: Loaded 3038 existing records from primary storage. [2025-10-27T19:52:22.755589] [INFO ] [MAIN ] MFSV: Loaded 3038 existing records. [2025-10-27T19:52:22.820124] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-27T19:52:22.933950] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:22.934220] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-27T19:52:22.934310] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-27T19:52:22.934448] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-27T19:52:22.934487] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-27T19:52:23.293747] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:23.300557] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:52:23.614956] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-27T19:52:23.991771] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T19:52:24.414944] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-27T19:52:25.214963] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-27T19:52:25.664400] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T19:52:25.842510] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:52:26.015001] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-27T19:52:26.295207] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-27T19:52:26.814943] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-27T19:52:27.140168] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T19:52:27.614933] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-27T19:52:27.909610] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T19:52:28.414942] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-27T19:52:28.847971] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T19:52:29.214930] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-27T19:52:29.501221] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T19:52:30.014955] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-27T19:52:30.489387] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T19:52:30.814930] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-27T19:52:31.301025] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T19:52:31.614935] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-27T19:52:32.415007] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-27T19:52:32.821051] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T19:52:33.214936] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-27T19:52:33.269109] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T19:52:33.279105] [INFO ] [REMOTE ] MFG: Full fetch complete (70004 records). [2025-10-27T19:52:33.279276] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-27T19:52:33.670780] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-27T19:52:33.670870] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-27T19:52:33.671867] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-27T19:52:33.671935] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-27T19:52:33.673392] [DEBUG] [LOCAL ] MFG: Trimmed 70004 records to 49410 (keeping 200 days of data) [2025-10-27T19:52:33.950100] [DEBUG] [LOCAL ] MFG: Primary data saved (49410 records). [2025-10-27T19:52:33.950229] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-27T19:52:33.950312] [INFO ] [MAIN ] Update Progress: 1336/2366 symbols completed. MFG took 47.6s. Estimated remaining: 2h 13m 0s. Rate: 7.7 symbols/min [2025-10-27T19:52:34.019371] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-27T19:52:34.063246] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:52:34.111997] [INFO ] [REMOTE ] MFSG: Full fetch complete (6900 records). [2025-10-27T19:52:34.129605] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-27T19:52:34.129519] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:34.312309] [DEBUG] [LOCAL ] MG: Loaded 15521 existing records from primary storage. [2025-10-27T19:52:34.349335] [INFO ] [MAIN ] MG: Loaded 15521 existing records. [2025-10-27T19:52:34.672040] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-27T19:52:34.666502] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:34.677060] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-27T19:52:34.677146] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-27T19:52:34.677919] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T19:52:34.680502] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-27T19:52:34.677237] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-27T19:52:34.680607] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-27T19:52:34.680989] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-27T19:52:34.681253] [DEBUG] [LOCAL ] MFSG: Trimmed 6900 records to 5908 (keeping 200 days of data) [2025-10-27T19:52:34.681302] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-27T19:52:34.815529] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-27T19:52:34.891002] [DEBUG] [LOCAL ] MFSG: Primary data saved (5908 records). [2025-10-27T19:52:34.892775] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-27T19:52:34.926245] [INFO ] [MAIN ] Update Progress: 1337/2366 symbols completed. MFSG took 29.3s. Estimated remaining: 2h 12m 47s. Rate: 7.7 symbols/min [2025-10-27T19:52:35.236380] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:35.237765] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:35.282998] [DEBUG] [LOCAL ] MGA: Loaded 51109 existing records from primary storage. [2025-10-27T19:52:35.283284] [INFO ] [MAIN ] MGA: Loaded 51109 existing records. [2025-10-27T19:52:35.358591] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T19:52:35.459540] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:35.459745] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-27T19:52:35.459803] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-27T19:52:35.460038] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-27T19:52:35.460093] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-27T19:52:35.627172] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-27T19:52:35.806430] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:36.410788] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T19:52:36.414885] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-27T19:52:36.992263] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T19:52:37.214958] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-27T19:52:37.998939] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T19:52:38.014889] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-27T19:52:38.549575] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T19:52:38.814966] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-27T19:52:39.342513] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T19:52:39.614921] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-27T19:52:40.415752] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-27T19:52:40.417432] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T19:52:41.182252] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T19:52:41.184308] [INFO ] [REMOTE ] MFSV: Full fetch complete (3804 records). [2025-10-27T19:52:41.184383] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-27T19:52:41.220107] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-27T19:52:41.558983] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-27T19:52:41.559085] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-27T19:52:41.559215] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-27T19:52:41.559254] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-27T19:52:41.559588] [DEBUG] [LOCAL ] MFSV: Trimmed 3804 records to 2986 (keeping 200 days of data) [2025-10-27T19:52:41.578161] [DEBUG] [LOCAL ] MFSV: Primary data saved (2986 records). [2025-10-27T19:52:41.578226] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-27T19:52:41.578303] [INFO ] [MAIN ] Update Progress: 1338/2366 symbols completed. MFSV took 19.0s. Estimated remaining: 2h 12m 39s. Rate: 7.8 symbols/min [2025-10-27T19:52:41.747489] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:41.754037] [DEBUG] [LOCAL ] MGF: Loaded 4168 existing records from primary storage. [2025-10-27T19:52:41.754245] [INFO ] [MAIN ] MGF: Loaded 4168 existing records. [2025-10-27T19:52:41.928477] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:41.928732] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-27T19:52:41.928785] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-27T19:52:41.928966] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-27T19:52:41.929023] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-27T19:52:42.023288] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-27T19:52:42.279131] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:42.510835] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T19:52:42.624029] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:52:42.814917] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-27T19:52:43.326779] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T19:52:43.614971] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-27T19:52:44.414970] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-27T19:52:44.564882] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T19:52:44.960353] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T19:52:45.214946] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-27T19:52:46.014939] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-27T19:52:46.173264] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:52:46.176946] [INFO ] [REMOTE ] MFSI: Full fetch complete (15241 records). [2025-10-27T19:52:46.177014] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-27T19:52:46.527834] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-27T19:52:46.527904] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-27T19:52:46.528229] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-27T19:52:46.528267] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-27T19:52:46.528909] [DEBUG] [LOCAL ] MFSI: Trimmed 15241 records to 12866 (keeping 200 days of data) [2025-10-27T19:52:46.603046] [DEBUG] [LOCAL ] MFSI: Primary data saved (12866 records). [2025-10-27T19:52:46.603167] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-27T19:52:46.603241] [INFO ] [MAIN ] Update Progress: 1339/2366 symbols completed. MFSI took 25.3s. Estimated remaining: 2h 12m 29s. Rate: 7.8 symbols/min [2025-10-27T19:52:46.766357] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:52:46.814852] [DEBUG] [LOCAL ] MGM: Loaded 54382 existing records from primary storage. [2025-10-27T19:52:46.815053] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-27T19:52:46.816400] [INFO ] [MAIN ] MGM: Loaded 54382 existing records. [2025-10-27T19:52:46.995761] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:52:46.995999] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-27T19:52:46.996045] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-27T19:52:46.996377] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-27T19:52:46.996444] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-27T19:52:47.350460] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:52:47.435522] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T19:52:47.504101] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T19:52:47.614931] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-27T19:52:47.989686] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-27T19:52:48.414934] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-27T19:52:49.214953] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-27T19:52:49.899828] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:52:49.987529] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T19:52:50.014908] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-27T19:52:50.814950] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-27T19:52:51.461739] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T19:52:51.614962] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-27T19:52:51.657289] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:52:52.414917] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-27T19:52:52.575525] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T19:52:53.214954] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-27T19:52:53.583496] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:52:54.014945] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-27T19:52:54.164606] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T19:52:54.643530] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T19:52:54.814981] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-27T19:52:55.614934] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-27T19:52:56.179012] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T19:52:56.429745] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-27T19:52:56.452798] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T19:52:56.813419] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T19:52:57.215046] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-27T19:52:58.014952] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-27T19:52:58.814927] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-27T19:52:58.951887] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T19:52:58.983784] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:52:59.408404] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T19:52:59.614949] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-27T19:53:00.414974] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-27T19:53:00.614805] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T19:53:01.214935] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-27T19:53:02.014998] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-27T19:53:02.814940] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-27T19:53:03.555632] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-10-27T19:53:03.614898] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-27T19:53:03.880724] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-27T19:53:04.077769] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:53:04.414985] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-27T19:53:05.214975] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-27T19:53:05.474169] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T19:53:05.513590] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (3.50 seconds). [2025-10-27T19:53:05.981133] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T19:53:06.014899] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-27T19:53:06.051441] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T19:53:06.052800] [INFO ] [REMOTE ] MGF: Full fetch complete (5732 records). [2025-10-27T19:53:06.052869] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-27T19:53:06.407186] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-27T19:53:06.407272] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-27T19:53:06.407477] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-27T19:53:06.407517] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-27T19:53:06.407920] [DEBUG] [LOCAL ] MGF: Trimmed 5732 records to 4095 (keeping 200 days of data) [2025-10-27T19:53:06.430890] [DEBUG] [LOCAL ] MGF: Primary data saved (4095 records). [2025-10-27T19:53:06.430969] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-27T19:53:06.431041] [INFO ] [MAIN ] Update Progress: 1340/2366 symbols completed. MGF took 24.9s. Estimated remaining: 2h 12m 30s. Rate: 7.7 symbols/min [2025-10-27T19:53:06.597791] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:06.605625] [DEBUG] [LOCAL ] MGR: Loaded 5578 existing records from primary storage. [2025-10-27T19:53:06.605828] [INFO ] [MAIN ] MGR: Loaded 5578 existing records. [2025-10-27T19:53:06.788277] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:06.788471] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-27T19:53:06.788518] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-27T19:53:06.788678] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-27T19:53:06.788735] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-27T19:53:06.820185] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-27T19:53:07.003573] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:53:07.069486] [INFO ] [REMOTE ] MG: Full fetch complete (23134 records). [2025-10-27T19:53:07.080443] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-27T19:53:07.285066] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:07.541244] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-27T19:53:07.541322] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-27T19:53:07.541805] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-27T19:53:07.541867] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-27T19:53:07.542441] [DEBUG] [LOCAL ] MG: Trimmed 23134 records to 15016 (keeping 200 days of data) [2025-10-27T19:53:07.615680] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-27T19:53:07.626767] [DEBUG] [LOCAL ] MG: Primary data saved (15016 records). [2025-10-27T19:53:07.626854] [INFO ] [MAIN ] MG: Full history saved. [2025-10-27T19:53:07.626932] [INFO ] [MAIN ] Update Progress: 1341/2366 symbols completed. MG took 33.7s. Estimated remaining: 2h 12m 18s. Rate: 7.7 symbols/min [2025-10-27T19:53:07.795217] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:07.801515] [DEBUG] [LOCAL ] MGRB: Loaded 4017 existing records from primary storage. [2025-10-27T19:53:07.801720] [INFO ] [MAIN ] MGRB: Loaded 4017 existing records. [2025-10-27T19:53:07.975842] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:07.976037] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-27T19:53:07.976082] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-27T19:53:07.976210] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-27T19:53:07.976246] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-27T19:53:08.082101] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T19:53:08.352215] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:08.406358] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:53:08.416678] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-27T19:53:08.754818] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T19:53:09.214978] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-27T19:53:10.014944] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-27T19:53:10.745506] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T19:53:10.814925] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-27T19:53:11.623362] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-27T19:53:11.629232] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T19:53:12.222805] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T19:53:12.414941] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-27T19:53:12.651468] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T19:53:12.662527] [INFO ] [REMOTE ] MGA: Full fetch complete (73669 records). [2025-10-27T19:53:12.662691] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-27T19:53:13.045449] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-27T19:53:13.045532] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-27T19:53:13.046576] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-27T19:53:13.046681] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-27T19:53:13.048127] [DEBUG] [LOCAL ] MGA: Trimmed 73669 records to 50302 (keeping 200 days of data) [2025-10-27T19:53:13.216328] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-27T19:53:13.343972] [DEBUG] [LOCAL ] MGA: Primary data saved (50302 records). [2025-10-27T19:53:13.344091] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-27T19:53:13.344165] [INFO ] [MAIN ] Update Progress: 1342/2366 symbols completed. MGA took 38.4s. Estimated remaining: 2h 12m 8s. Rate: 7.7 symbols/min [2025-10-27T19:53:13.507496] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:13.511686] [DEBUG] [LOCAL ] MGRD: Loaded 2219 existing records from primary storage. [2025-10-27T19:53:13.511834] [INFO ] [MAIN ] MGRD: Loaded 2219 existing records. [2025-10-27T19:53:13.688876] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:13.689056] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-27T19:53:13.689102] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-27T19:53:13.689277] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-27T19:53:13.689334] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-27T19:53:13.820059] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T19:53:14.021273] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-27T19:53:14.050306] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:14.082954] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T19:53:14.641491] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T19:53:14.814954] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-27T19:53:15.614963] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-27T19:53:16.046904] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T19:53:16.085504] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T19:53:16.414973] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-27T19:53:16.984747] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T19:53:17.214951] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-27T19:53:17.616322] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T19:53:18.014943] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-27T19:53:18.610863] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T19:53:18.814944] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-27T19:53:19.249536] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T19:53:19.614936] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-27T19:53:19.958967] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-27T19:53:20.414966] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-27T19:53:21.083193] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T19:53:21.214940] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-27T19:53:21.618238] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T19:53:22.014926] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-27T19:53:22.465843] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T19:53:22.814983] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-27T19:53:23.354081] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T19:53:23.614942] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-27T19:53:24.147859] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T19:53:24.414966] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-27T19:53:24.994169] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T19:53:25.214939] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-27T19:53:25.777169] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T19:53:26.014953] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-27T19:53:26.444027] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T19:53:26.814943] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-27T19:53:27.614940] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-27T19:53:28.224268] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:53:28.311726] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T19:53:28.414919] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-27T19:53:28.910605] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:53:29.214932] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-27T19:53:30.014931] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-27T19:53:30.589562] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T19:53:30.720604] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T19:53:30.814910] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-27T19:53:31.614933] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-27T19:53:32.136606] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T19:53:32.138116] [INFO ] [REMOTE ] MGR: Full fetch complete (7773 records). [2025-10-27T19:53:32.138202] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-27T19:53:32.416453] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-27T19:53:32.504172] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-27T19:53:32.504315] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-27T19:53:32.504729] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-27T19:53:32.504868] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-27T19:53:32.505492] [DEBUG] [LOCAL ] MGR: Trimmed 7773 records to 5451 (keeping 200 days of data) [2025-10-27T19:53:32.541311] [DEBUG] [LOCAL ] MGR: Primary data saved (5451 records). [2025-10-27T19:53:32.541492] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-27T19:53:32.541628] [INFO ] [MAIN ] Update Progress: 1343/2366 symbols completed. MGR took 26.1s. Estimated remaining: 2h 12m 9s. Rate: 7.7 symbols/min [2025-10-27T19:53:32.701757] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T19:53:32.761956] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:32.770739] [DEBUG] [LOCAL ] MGRE: Loaded 6475 existing records from primary storage. [2025-10-27T19:53:32.770926] [INFO ] [MAIN ] MGRE: Loaded 6475 existing records. [2025-10-27T19:53:32.945261] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T19:53:32.949027] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:32.950763] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-27T19:53:32.950815] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-27T19:53:32.951053] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-27T19:53:32.951110] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-27T19:53:33.220161] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-27T19:53:33.327626] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:33.711448] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T19:53:34.014940] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-27T19:53:34.814966] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-27T19:53:35.377772] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T19:53:35.379283] [INFO ] [REMOTE ] MGRB: Full fetch complete (5486 records). [2025-10-27T19:53:35.379406] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-27T19:53:35.624353] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-27T19:53:35.746996] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-27T19:53:35.747238] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-27T19:53:35.747453] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-27T19:53:35.747495] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-27T19:53:35.747905] [DEBUG] [LOCAL ] MGRB: Trimmed 5486 records to 3906 (keeping 200 days of data) [2025-10-27T19:53:35.771602] [DEBUG] [LOCAL ] MGRB: Primary data saved (3906 records). [2025-10-27T19:53:35.771738] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-27T19:53:35.771827] [INFO ] [MAIN ] Update Progress: 1344/2366 symbols completed. MGRB took 28.1s. Estimated remaining: 2h 11m 58s. Rate: 7.7 symbols/min [2025-10-27T19:53:35.939463] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:35.969662] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T19:53:35.980211] [INFO ] [REMOTE ] MGM: Full fetch complete (77757 records). [2025-10-27T19:53:35.980347] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-27T19:53:36.152580] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T19:53:36.330297] [DEBUG] [LOCAL ] MGY: Loaded 53190 existing records from primary storage. [2025-10-27T19:53:36.346044] [INFO ] [MAIN ] MGY: Loaded 53190 existing records. [2025-10-27T19:53:36.422563] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-27T19:53:36.512285] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-27T19:53:36.519257] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-27T19:53:36.520528] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-27T19:53:36.520610] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-27T19:53:36.583249] [DEBUG] [LOCAL ] MGM: Trimmed 77757 records to 53601 (keeping 200 days of data) [2025-10-27T19:53:36.614515] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:36.615000] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-27T19:53:36.615054] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-27T19:53:36.615242] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-27T19:53:36.615283] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-27T19:53:36.877384] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T19:53:37.216708] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-27T19:53:37.221709] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:37.317683] [DEBUG] [LOCAL ] MGM: Primary data saved (53601 records). [2025-10-27T19:53:37.317829] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-27T19:53:37.318401] [INFO ] [MAIN ] Update Progress: 1345/2366 symbols completed. MGM took 50.7s. Estimated remaining: 2h 11m 46s. Rate: 7.7 symbols/min [2025-10-27T19:53:37.482977] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:37.483115] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-27T19:53:37.483151] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-27T19:53:37.483254] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-27T19:53:37.483296] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-27T19:53:37.483336] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-27T19:53:37.483367] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-27T19:53:37.842318] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:37.838812] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:53:38.014934] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-27T19:53:38.217687] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:53:38.217961] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-27T19:53:38.218045] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:53:38.218090] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-27T19:53:38.218151] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:53:38.218222] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-27T19:53:38.218286] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-27T19:53:38.218322] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-27T19:53:38.218405] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-27T19:53:38.218460] [INFO ] [MAIN ] Update Progress: 1346/2366 symbols completed. MH took 0.9s. Estimated remaining: 2h 11m 33s. Rate: 7.8 symbols/min [2025-10-27T19:53:38.384827] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:38.398904] [DEBUG] [LOCAL ] MHD: Loaded 12010 existing records from primary storage. [2025-10-27T19:53:38.399120] [INFO ] [MAIN ] MHD: Loaded 12010 existing records. [2025-10-27T19:53:38.571239] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:38.571449] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-27T19:53:38.571519] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-27T19:53:38.571702] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-27T19:53:38.571757] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-27T19:53:38.820091] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-27T19:53:38.920246] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:39.501540] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T19:53:39.614928] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-27T19:53:40.281762] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T19:53:40.414910] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-27T19:53:41.175583] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T19:53:41.214955] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-27T19:53:41.790621] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:53:42.014940] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-27T19:53:42.505948] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:53:42.814944] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-27T19:53:43.609062] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T19:53:43.614887] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-27T19:53:44.221162] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T19:53:44.414989] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-27T19:53:45.215010] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-27T19:53:45.892831] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T19:53:46.014987] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-27T19:53:46.091686] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T19:53:46.462682] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T19:53:46.815045] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-27T19:53:47.357310] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T19:53:47.614931] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-27T19:53:48.203298] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T19:53:48.414965] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-27T19:53:49.193683] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T19:53:49.214898] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-27T19:53:50.015029] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-27T19:53:50.044316] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T19:53:50.707390] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T19:53:50.814962] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-27T19:53:51.151847] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-27T19:53:51.614947] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-27T19:53:52.414952] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-27T19:53:52.654545] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T19:53:53.086833] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T19:53:53.088264] [INFO ] [REMOTE ] MGRE: Full fetch complete (9140 records). [2025-10-27T19:53:53.088332] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-27T19:53:53.220039] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-27T19:53:53.481672] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-27T19:53:53.481760] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-27T19:53:53.482013] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-27T19:53:53.482052] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-27T19:53:53.482461] [DEBUG] [LOCAL ] MGRE: Trimmed 9140 records to 6310 (keeping 200 days of data) [2025-10-27T19:53:53.523803] [DEBUG] [LOCAL ] MGRE: Primary data saved (6310 records). [2025-10-27T19:53:53.523956] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-27T19:53:53.524045] [INFO ] [MAIN ] Update Progress: 1347/2366 symbols completed. MGRE took 21.0s. Estimated remaining: 2h 11m 31s. Rate: 7.7 symbols/min [2025-10-27T19:53:53.634817] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T19:53:53.703840] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:53.714519] [DEBUG] [LOCAL ] MHF: Loaded 9173 existing records from primary storage. [2025-10-27T19:53:53.714748] [INFO ] [MAIN ] MHF: Loaded 9173 existing records. [2025-10-27T19:53:53.885735] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:53.885933] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-27T19:53:53.885978] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-27T19:53:53.886116] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-27T19:53:53.886154] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-27T19:53:54.023264] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-27T19:53:54.236322] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:53:54.814958] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-27T19:53:55.622319] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-27T19:53:55.624260] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T19:53:55.626316] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:53:56.414981] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-27T19:53:56.424262] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T19:53:57.214977] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-27T19:53:57.358316] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T19:53:57.746817] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T19:53:58.014952] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-27T19:53:58.586479] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T19:53:58.589355] [INFO ] [REMOTE ] MHD: Full fetch complete (17930 records). [2025-10-27T19:53:58.589453] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-27T19:53:58.820053] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-27T19:53:58.962544] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-27T19:53:58.962622] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-27T19:53:58.963032] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-27T19:53:58.963084] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-27T19:53:58.963631] [DEBUG] [LOCAL ] MHD: Trimmed 17930 records to 11584 (keeping 200 days of data) [2025-10-27T19:53:59.034815] [DEBUG] [LOCAL ] MHD: Primary data saved (11584 records). [2025-10-27T19:53:59.034954] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-27T19:53:59.035033] [INFO ] [MAIN ] Update Progress: 1348/2366 symbols completed. MHD took 20.8s. Estimated remaining: 2h 11m 21s. Rate: 7.8 symbols/min [2025-10-27T19:53:59.211500] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:53:59.252433] [DEBUG] [LOCAL ] MHK: Loaded 42711 existing records from primary storage. [2025-10-27T19:53:59.252738] [INFO ] [MAIN ] MHK: Loaded 42711 existing records. [2025-10-27T19:53:59.441418] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:53:59.441622] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-27T19:53:59.441699] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-27T19:53:59.441954] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-27T19:53:59.442009] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-27T19:53:59.620074] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-27T19:53:59.793799] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:00.414921] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-27T19:54:00.555355] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T19:54:00.579269] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:54:00.580168] [INFO ] [REMOTE ] MGRD: Full fetch complete (3271 records). [2025-10-27T19:54:00.580233] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-27T19:54:00.927249] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-27T19:54:00.927320] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-27T19:54:00.927434] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-27T19:54:00.927472] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-27T19:54:00.927832] [DEBUG] [LOCAL ] MGRD: Trimmed 3271 records to 2159 (keeping 200 days of data) [2025-10-27T19:54:00.940713] [DEBUG] [LOCAL ] MGRD: Primary data saved (2159 records). [2025-10-27T19:54:00.940779] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-27T19:54:00.940849] [INFO ] [MAIN ] Update Progress: 1349/2366 symbols completed. MGRD took 47.6s. Estimated remaining: 2h 11m 9s. Rate: 7.8 symbols/min [2025-10-27T19:54:01.105696] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:01.105851] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-27T19:54:01.105886] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-27T19:54:01.105993] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-27T19:54:01.106033] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-27T19:54:01.106098] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-27T19:54:01.106159] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-27T19:54:01.219991] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-27T19:54:01.474377] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:02.014951] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-27T19:54:02.814932] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-27T19:54:03.002501] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-27T19:54:03.327722] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:54:03.614940] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-27T19:54:04.205315] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T19:54:04.414965] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-27T19:54:04.950854] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (3.73 seconds). [2025-10-27T19:54:05.206518] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T19:54:05.214887] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-27T19:54:05.681792] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T19:54:05.854573] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T19:54:06.014996] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-27T19:54:06.814952] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-27T19:54:07.120941] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T19:54:07.614927] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-27T19:54:08.329138] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T19:54:08.414902] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-27T19:54:08.784819] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T19:54:08.859208] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T19:54:09.214950] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-27T19:54:10.014988] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-27T19:54:10.494596] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:54:10.597024] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T19:54:10.814960] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-27T19:54:11.537747] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T19:54:11.614936] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-27T19:54:12.414968] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-27T19:54:13.199297] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T19:54:13.214894] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-27T19:54:13.793606] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T19:54:14.014963] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-27T19:54:14.344589] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-27T19:54:14.517033] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T19:54:14.815012] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-27T19:54:15.191841] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T19:54:15.614927] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-27T19:54:16.123556] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T19:54:16.414913] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-27T19:54:16.987866] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:54:17.214994] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-27T19:54:17.657767] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T19:54:18.015031] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-27T19:54:18.814991] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-27T19:54:18.852255] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T19:54:18.854618] [INFO ] [REMOTE ] MHF: Full fetch complete (12900 records). [2025-10-27T19:54:18.854714] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-27T19:54:19.134696] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T19:54:19.213229] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-27T19:54:19.213301] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-27T19:54:19.213583] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-27T19:54:19.213620] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-27T19:54:19.214098] [DEBUG] [LOCAL ] MHF: Trimmed 12900 records to 9097 (keeping 200 days of data) [2025-10-27T19:54:19.267936] [DEBUG] [LOCAL ] MHF: Primary data saved (9097 records). [2025-10-27T19:54:19.268068] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-27T19:54:19.268145] [INFO ] [MAIN ] Update Progress: 1350/2366 symbols completed. MHF took 25.7s. Estimated remaining: 2h 11m 9s. Rate: 7.7 symbols/min [2025-10-27T19:54:19.437389] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:19.446264] [DEBUG] [LOCAL ] MHN: Loaded 7435 existing records from primary storage. [2025-10-27T19:54:19.446441] [INFO ] [MAIN ] MHN: Loaded 7435 existing records. [2025-10-27T19:54:19.621219] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:54:19.621291] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-27T19:54:19.622613] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-27T19:54:19.622713] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-27T19:54:19.622949] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-27T19:54:19.623009] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-27T19:54:19.970613] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:20.414946] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-27T19:54:20.928203] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T19:54:21.217115] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-27T19:54:21.218638] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T19:54:21.961596] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:54:22.014976] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-27T19:54:22.279576] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-27T19:54:22.814934] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-27T19:54:23.355083] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T19:54:23.614957] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-27T19:54:24.414996] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-27T19:54:25.214966] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-27T19:54:25.358865] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-27T19:54:25.370320] [INFO ] [REMOTE ] MGY: Full fetch complete (75975 records). [2025-10-27T19:54:25.370456] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-27T19:54:25.776869] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-27T19:54:25.777312] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T19:54:25.777429] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-27T19:54:25.781252] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-27T19:54:25.781671] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-27T19:54:25.783463] [DEBUG] [LOCAL ] MGY: Trimmed 75975 records to 52406 (keeping 200 days of data) [2025-10-27T19:54:25.900389] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T19:54:26.024269] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-27T19:54:26.130073] [DEBUG] [LOCAL ] MGY: Primary data saved (52406 records). [2025-10-27T19:54:26.130202] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-27T19:54:26.130276] [INFO ] [MAIN ] Update Progress: 1351/2366 symbols completed. MGY took 50.4s. Estimated remaining: 2h 11m 1s. Rate: 7.7 symbols/min [2025-10-27T19:54:26.295144] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:26.318981] [DEBUG] [LOCAL ] MHO: Loaded 24039 existing records from primary storage. [2025-10-27T19:54:26.319215] [INFO ] [MAIN ] MHO: Loaded 24039 existing records. [2025-10-27T19:54:26.499749] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:54:26.499983] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-27T19:54:26.500037] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-27T19:54:26.500307] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-27T19:54:26.500363] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-27T19:54:26.824983] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-27T19:54:26.855864] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:27.392139] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T19:54:27.480486] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T19:54:27.614911] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-27T19:54:28.414954] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-27T19:54:28.654632] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T19:54:28.674994] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-27T19:54:29.214973] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-27T19:54:29.870445] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T19:54:30.014908] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-27T19:54:30.814998] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-27T19:54:31.584773] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T19:54:31.593108] [INFO ] [REMOTE ] MHK: Full fetch complete (61485 records). [2025-10-27T19:54:31.593312] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-27T19:54:31.624401] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-27T19:54:31.682482] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:54:32.010790] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-27T19:54:32.010881] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-27T19:54:32.012295] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-27T19:54:32.012360] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-27T19:54:32.013680] [DEBUG] [LOCAL ] MHK: Trimmed 61485 records to 42038 (keeping 200 days of data) [2025-10-27T19:54:32.076967] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T19:54:32.270296] [DEBUG] [LOCAL ] MHK: Primary data saved (42038 records). [2025-10-27T19:54:32.270444] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-27T19:54:32.271107] [INFO ] [MAIN ] Update Progress: 1352/2366 symbols completed. MHK took 33.2s. Estimated remaining: 2h 10m 52s. Rate: 7.7 symbols/min [2025-10-27T19:54:32.417589] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-27T19:54:32.438736] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:32.438993] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-27T19:54:32.439038] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-27T19:54:32.439148] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-27T19:54:32.439189] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-27T19:54:32.439228] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-27T19:54:32.439259] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-27T19:54:32.786966] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:32.893011] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T19:54:32.893743] [INFO ] [REMOTE ] MHLA: Full fetch complete (1481 records). [2025-10-27T19:54:32.893810] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-27T19:54:32.894131] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T19:54:32.894210] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:54:32.894276] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:54:32.894347] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-27T19:54:32.894408] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-27T19:54:32.894442] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-27T19:54:32.894481] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-27T19:54:32.894530] [INFO ] [MAIN ] Update Progress: 1353/2366 symbols completed. MHLA took 32.0s. Estimated remaining: 2h 10m 39s. Rate: 7.8 symbols/min [2025-10-27T19:54:33.062106] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:33.076773] [DEBUG] [LOCAL ] MIN: Loaded 14084 existing records from primary storage. [2025-10-27T19:54:33.076994] [INFO ] [MAIN ] MIN: Loaded 14084 existing records. [2025-10-27T19:54:33.217955] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-27T19:54:33.253782] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:54:33.253979] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-27T19:54:33.254027] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-27T19:54:33.254329] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-27T19:54:33.254390] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-27T19:54:33.608504] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:34.014937] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-27T19:54:34.507811] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T19:54:34.619135] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T19:54:34.814930] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-27T19:54:35.511727] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T19:54:35.614927] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-27T19:54:36.099704] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T19:54:36.414990] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-27T19:54:37.045892] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T19:54:37.214962] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-27T19:54:37.728934] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T19:54:37.730775] [INFO ] [REMOTE ] MHN: Full fetch complete (11096 records). [2025-10-27T19:54:37.730893] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-27T19:54:38.020221] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-27T19:54:38.183596] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-27T19:54:38.183743] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-27T19:54:38.184361] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-27T19:54:38.184428] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-27T19:54:38.185207] [DEBUG] [LOCAL ] MHN: Trimmed 11096 records to 7019 (keeping 200 days of data) [2025-10-27T19:54:38.235351] [DEBUG] [LOCAL ] MHN: Primary data saved (7019 records). [2025-10-27T19:54:38.235543] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-27T19:54:38.235675] [INFO ] [MAIN ] Update Progress: 1354/2366 symbols completed. MHN took 19.0s. Estimated remaining: 2h 10m 29s. Rate: 7.8 symbols/min [2025-10-27T19:54:38.477183] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:38.547673] [DEBUG] [LOCAL ] MIR: Loaded 52162 existing records from primary storage. [2025-10-27T19:54:38.548027] [INFO ] [MAIN ] MIR: Loaded 52162 existing records. [2025-10-27T19:54:38.781234] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:54:38.781486] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-27T19:54:38.781548] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-27T19:54:38.782002] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-27T19:54:38.782059] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-27T19:54:38.820042] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-27T19:54:39.180341] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:39.196002] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T19:54:39.600269] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T19:54:39.614898] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-27T19:54:40.258346] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:54:40.414939] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-27T19:54:40.620839] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:54:40.621119] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-27T19:54:40.621205] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:54:40.621250] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-27T19:54:40.621309] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:54:40.621379] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-27T19:54:40.621439] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-27T19:54:40.621473] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-27T19:54:40.621525] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-27T19:54:40.621571] [INFO ] [MAIN ] Update Progress: 1355/2366 symbols completed. MIAX took 8.4s. Estimated remaining: 2h 10m 18s. Rate: 7.8 symbols/min [2025-10-27T19:54:40.785308] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:54:40.785409] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-27T19:54:40.785445] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-27T19:54:40.785547] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-27T19:54:40.785590] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-27T19:54:40.785629] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-27T19:54:40.785694] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-27T19:54:41.130252] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:54:41.214963] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-27T19:54:42.014944] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-27T19:54:42.339769] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-27T19:54:42.602556] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T19:54:42.814931] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-27T19:54:43.614935] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-27T19:54:43.855925] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T19:54:44.414944] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-27T19:54:44.800887] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T19:54:44.932553] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T19:54:45.214943] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-27T19:54:45.630752] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T19:54:46.015002] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-27T19:54:46.591347] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T19:54:46.814918] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-27T19:54:47.403203] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T19:54:47.615016] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-27T19:54:48.414981] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-27T19:54:49.218079] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-27T19:54:49.221196] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T19:54:49.251185] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T19:54:50.014965] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-27T19:54:50.236205] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T19:54:50.776808] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T19:54:50.814909] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-27T19:54:51.614984] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-27T19:54:52.059394] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T19:54:52.232853] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T19:54:52.414965] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-27T19:54:53.214972] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-27T19:54:53.506425] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T19:54:53.942314] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T19:54:54.014945] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-27T19:54:54.356039] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T19:54:54.814941] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-27T19:54:55.125025] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T19:54:55.614928] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-27T19:54:56.414997] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-27T19:54:56.917673] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T19:54:57.193577] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T19:54:57.214904] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-27T19:54:58.014985] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-27T19:54:58.450534] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T19:54:58.814954] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-27T19:54:59.187764] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:54:59.241701] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T19:54:59.614963] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-27T19:55:00.414942] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-27T19:55:00.614502] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T19:55:00.617912] [INFO ] [REMOTE ] MIN: Full fetch complete (17762 records). [2025-10-27T19:55:00.617997] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-27T19:55:01.011403] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-27T19:55:01.011497] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-27T19:55:01.011919] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-27T19:55:01.011983] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-27T19:55:01.012680] [DEBUG] [LOCAL ] MIN: Trimmed 17762 records to 13805 (keeping 200 days of data) [2025-10-27T19:55:01.091331] [DEBUG] [LOCAL ] MIN: Primary data saved (13805 records). [2025-10-27T19:55:01.091500] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-27T19:55:01.091596] [INFO ] [MAIN ] Update Progress: 1356/2366 symbols completed. MIN took 28.2s. Estimated remaining: 2h 10m 19s. Rate: 7.7 symbols/min [2025-10-27T19:55:01.220145] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-27T19:55:01.266013] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:01.270730] [DEBUG] [LOCAL ] MITP: Loaded 2211 existing records from primary storage. [2025-10-27T19:55:01.271396] [INFO ] [MAIN ] MITP: Loaded 2211 existing records. [2025-10-27T19:55:01.473935] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:01.474173] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-27T19:55:01.474221] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-27T19:55:01.474349] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-27T19:55:01.474388] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-27T19:55:01.843812] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:02.014994] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-27T19:55:02.814932] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-27T19:55:02.917340] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T19:55:03.314394] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T19:55:03.581919] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-10-27T19:55:03.614916] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-27T19:55:04.414922] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-27T19:55:04.720181] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-27T19:55:04.752354] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T19:55:04.917400] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (3.70 seconds). [2025-10-27T19:55:05.214985] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-27T19:55:05.945435] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T19:55:05.946326] [INFO ] [REMOTE ] MITN: Full fetch complete (2335 records). [2025-10-27T19:55:05.946413] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-27T19:55:06.020100] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-27T19:55:06.137388] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T19:55:06.137592] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:55:06.137684] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:55:06.137753] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-27T19:55:06.137815] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-27T19:55:06.137849] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-27T19:55:06.137887] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-27T19:55:06.137940] [INFO ] [MAIN ] Update Progress: 1357/2366 symbols completed. MITN took 25.5s. Estimated remaining: 2h 10m 10s. Rate: 7.8 symbols/min [2025-10-27T19:55:06.814987] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-27T19:55:07.114428] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-27T19:55:07.479613] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T19:55:07.484279] [INFO ] [REMOTE ] MHO: Full fetch complete (36425 records). [2025-10-27T19:55:07.484366] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-27T19:55:07.621697] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-27T19:55:07.868457] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-27T19:55:07.868529] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-27T19:55:07.869263] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-27T19:55:07.869322] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-27T19:55:07.870082] [DEBUG] [LOCAL ] MHO: Trimmed 36425 records to 23488 (keeping 200 days of data) [2025-10-27T19:55:08.011218] [DEBUG] [LOCAL ] MHO: Primary data saved (23488 records). [2025-10-27T19:55:08.011337] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-27T19:55:08.011410] [INFO ] [MAIN ] Update Progress: 1358/2366 symbols completed. MHO took 41.9s. Estimated remaining: 2h 9m 58s. Rate: 7.8 symbols/min [2025-10-27T19:55:08.415002] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-27T19:55:08.706931] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-27T19:55:08.999155] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:55:09.214959] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-27T19:55:09.534930] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-27T19:55:10.015003] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-27T19:55:10.814929] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-27T19:55:11.183103] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:55:11.336482] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T19:55:11.614937] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-27T19:55:12.015136] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T19:55:12.414960] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-27T19:55:13.214967] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-27T19:55:13.499505] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-27T19:55:14.014915] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-27T19:55:14.315555] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-27T19:55:14.431727] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T19:55:14.441965] [INFO ] [REMOTE ] MIR: Full fetch complete (74028 records). [2025-10-27T19:55:14.442094] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-27T19:55:14.817144] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-27T19:55:14.835147] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-27T19:55:14.836381] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-27T19:55:14.837574] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-27T19:55:14.837757] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-27T19:55:14.839195] [DEBUG] [LOCAL ] MIR: Trimmed 74028 records to 51414 (keeping 200 days of data) [2025-10-27T19:55:15.131430] [DEBUG] [LOCAL ] MIR: Primary data saved (51414 records). [2025-10-27T19:55:15.131569] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-27T19:55:15.132333] [INFO ] [MAIN ] Update Progress: 1359/2366 symbols completed. MIR took 36.9s. Estimated remaining: 2h 9m 49s. Rate: 7.8 symbols/min [2025-10-27T19:55:15.293214] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T19:55:15.614991] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-27T19:55:16.106269] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T19:55:16.107171] [INFO ] [REMOTE ] MITP: Full fetch complete (3194 records). [2025-10-27T19:55:16.107246] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-27T19:55:16.464444] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-27T19:55:16.464537] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-27T19:55:16.464721] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-27T19:55:16.464793] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-27T19:55:16.465287] [DEBUG] [LOCAL ] MITP: Trimmed 3194 records to 2087 (keeping 200 days of data) [2025-10-27T19:55:16.483612] [DEBUG] [LOCAL ] MITP: Primary data saved (2087 records). [2025-10-27T19:55:16.483798] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-27T19:55:16.483911] [INFO ] [MAIN ] Update Progress: 1360/2366 symbols completed. MITP took 15.4s. Estimated remaining: 2h 9m 37s. Rate: 7.8 symbols/min [2025-10-27T19:55:17.122097] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:17.098989] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:17.121290] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:17.200381] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:17.204569] [DEBUG] [LOCAL ] MIY: Loaded 6308 existing records from primary storage. [2025-10-27T19:55:17.205291] [INFO ] [MAIN ] MIY: Loaded 6308 existing records. [2025-10-27T19:55:17.321545] [DEBUG] [LOCAL ] MITT: Loaded 22491 existing records from primary storage. [2025-10-27T19:55:17.330687] [INFO ] [MAIN ] MITT: Loaded 22491 existing records. [2025-10-27T19:55:17.486481] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:17.504930] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-27T19:55:17.516153] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-27T19:55:17.536887] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-27T19:55:17.548751] [DEBUG] [LOCAL ] MKL: Loaded 34164 existing records from primary storage. [2025-10-27T19:55:17.543082] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-27T19:55:17.554247] [INFO ] [MAIN ] MKL: Loaded 34164 existing records. [2025-10-27T19:55:17.761546] [DEBUG] [LOCAL ] MKC: Loaded 53293 existing records from primary storage. [2025-10-27T19:55:17.794790] [INFO ] [MAIN ] MKC: Loaded 53293 existing records. [2025-10-27T19:55:17.860145] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:17.905930] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-27T19:55:17.921440] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-27T19:55:17.994038] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-27T19:55:18.012885] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-27T19:55:18.104281] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:18.134197] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-27T19:55:18.160833] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-27T19:55:18.282814] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-27T19:55:18.333275] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-27T19:55:18.411319] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:18.451556] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-27T19:55:18.535952] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-27T19:55:18.568726] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-27T19:55:18.646979] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-27T19:55:18.890327] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:19.021872] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-27T19:55:19.223287] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:19.281139] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-27T19:55:19.530872] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:19.546427] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-27T19:55:19.569327] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:19.569914] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-27T19:55:19.804381] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T19:55:19.806136] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-27T19:55:20.298122] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T19:55:20.414962] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-27T19:55:20.449315] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:55:20.780366] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T19:55:20.816975] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T19:55:20.915742] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:55:21.214957] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-27T19:55:21.924401] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T19:55:22.014943] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-27T19:55:22.647708] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T19:55:22.814906] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-27T19:55:23.615000] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-27T19:55:23.988893] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T19:55:24.075235] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:55:24.414954] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-27T19:55:25.215012] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-27T19:55:26.014938] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-27T19:55:26.138437] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T19:55:26.139418] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T19:55:26.814954] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-27T19:55:27.263736] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:55:27.264340] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T19:55:27.614981] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-27T19:55:28.414952] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-27T19:55:28.998975] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T19:55:29.214948] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-27T19:55:29.576248] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T19:55:30.014978] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-27T19:55:30.536326] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T19:55:30.814932] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-27T19:55:31.180072] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-27T19:55:31.289474] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T19:55:31.614954] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-27T19:55:32.081752] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T19:55:32.415004] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-27T19:55:33.214955] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-27T19:55:33.816990] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T19:55:34.015099] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-27T19:55:34.350098] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T19:55:34.814967] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-27T19:55:35.614928] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-27T19:55:35.676157] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:55:36.215063] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T19:55:36.227168] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T19:55:36.229025] [INFO ] [REMOTE ] MIY: Full fetch complete (8666 records). [2025-10-27T19:55:36.229090] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-27T19:55:36.424414] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-27T19:55:36.585782] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-27T19:55:36.585853] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-27T19:55:36.586086] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-27T19:55:36.586125] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-27T19:55:36.586542] [DEBUG] [LOCAL ] MIY: Trimmed 8666 records to 6145 (keeping 200 days of data) [2025-10-27T19:55:36.623261] [DEBUG] [LOCAL ] MIY: Primary data saved (6145 records). [2025-10-27T19:55:36.623338] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-27T19:55:36.623407] [INFO ] [MAIN ] Update Progress: 1361/2366 symbols completed. MIY took 20.1s. Estimated remaining: 2h 9m 38s. Rate: 7.8 symbols/min [2025-10-27T19:55:36.788477] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:36.828519] [DEBUG] [LOCAL ] MLI: Loaded 44061 existing records from primary storage. [2025-10-27T19:55:36.828810] [INFO ] [MAIN ] MLI: Loaded 44061 existing records. [2025-10-27T19:55:37.001288] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:37.001469] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-27T19:55:37.001537] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-27T19:55:37.001925] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-27T19:55:37.001999] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-27T19:55:37.226070] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-27T19:55:37.348551] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:37.838047] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T19:55:38.014930] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-27T19:55:38.416860] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T19:55:38.814947] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-27T19:55:39.360096] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T19:55:39.614964] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-27T19:55:40.164402] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T19:55:40.414967] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-27T19:55:40.838401] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T19:55:41.214936] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-27T19:55:41.339324] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T19:55:42.014945] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-27T19:55:42.786559] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T19:55:42.814916] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-27T19:55:43.564253] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T19:55:43.614917] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-27T19:55:44.129358] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T19:55:44.414947] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-27T19:55:45.222292] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-27T19:55:45.228915] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T19:55:45.374334] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T19:55:45.380496] [INFO ] [REMOTE ] MKL: Full fetch complete (49790 records). [2025-10-27T19:55:45.380665] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-27T19:55:45.777112] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-27T19:55:45.777191] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-27T19:55:45.778025] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-27T19:55:45.778087] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-27T19:55:45.779217] [DEBUG] [LOCAL ] MKL: Trimmed 49790 records to 33390 (keeping 200 days of data) [2025-10-27T19:55:45.986579] [DEBUG] [LOCAL ] MKL: Primary data saved (33390 records). [2025-10-27T19:55:45.986789] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-27T19:55:45.986881] [INFO ] [MAIN ] Update Progress: 1362/2366 symbols completed. MKL took 29.5s. Estimated remaining: 2h 9m 32s. Rate: 7.8 symbols/min [2025-10-27T19:55:46.020206] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-27T19:55:46.174442] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:46.202319] [DEBUG] [LOCAL ] MLM: Loaded 28997 existing records from primary storage. [2025-10-27T19:55:46.202567] [INFO ] [MAIN ] MLM: Loaded 28997 existing records. [2025-10-27T19:55:46.390510] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T19:55:46.395725] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:46.400295] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-27T19:55:46.400483] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-27T19:55:46.401008] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-27T19:55:46.401065] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-27T19:55:46.746704] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:46.814905] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-27T19:55:47.349512] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T19:55:47.614988] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-27T19:55:48.093090] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T19:55:48.414943] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-27T19:55:49.111544] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T19:55:49.214938] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-27T19:55:49.696784] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T19:55:50.014934] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-27T19:55:50.660108] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T19:55:50.827442] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-27T19:55:50.849473] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T19:55:51.614917] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-27T19:55:51.760690] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T19:55:52.414951] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-27T19:55:52.850607] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T19:55:53.214944] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-27T19:55:54.014949] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-27T19:55:54.257768] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T19:55:54.716742] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T19:55:54.814939] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-27T19:55:54.876342] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T19:55:54.880489] [INFO ] [REMOTE ] MITT: Full fetch complete (33134 records). [2025-10-27T19:55:54.880571] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-27T19:55:55.248896] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-27T19:55:55.249001] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-27T19:55:55.249777] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-27T19:55:55.249839] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-27T19:55:55.250771] [DEBUG] [LOCAL ] MITT: Trimmed 33134 records to 21643 (keeping 200 days of data) [2025-10-27T19:55:55.373959] [DEBUG] [LOCAL ] MITT: Primary data saved (21643 records). [2025-10-27T19:55:55.374076] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-27T19:55:55.374155] [INFO ] [MAIN ] Update Progress: 1363/2366 symbols completed. MITT took 38.9s. Estimated remaining: 2h 9m 25s. Rate: 7.7 symbols/min [2025-10-27T19:55:55.540096] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:55:55.544944] [DEBUG] [LOCAL ] MLP: Loaded 3020 existing records from primary storage. [2025-10-27T19:55:55.545101] [INFO ] [MAIN ] MLP: Loaded 3020 existing records. [2025-10-27T19:55:55.620016] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-27T19:55:55.721974] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:55:55.722166] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-27T19:55:55.722213] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-27T19:55:55.722378] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-27T19:55:55.722418] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-27T19:55:56.107162] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:55:56.171223] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T19:55:56.414952] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-27T19:55:56.797460] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T19:55:57.214962] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-27T19:55:57.336857] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T19:55:57.794497] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T19:55:58.014946] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-27T19:55:58.814949] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-27T19:55:59.440866] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T19:55:59.614926] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-27T19:56:00.078299] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T19:56:00.414976] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-27T19:56:00.523506] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T19:56:01.214969] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-27T19:56:02.014932] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-27T19:56:02.153695] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T19:56:02.814925] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-27T19:56:03.230822] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T19:56:03.614938] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-27T19:56:04.415005] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-27T19:56:04.519327] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-27T19:56:04.527618] [INFO ] [REMOTE ] MLI: Full fetch complete (63304 records). [2025-10-27T19:56:04.527832] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-27T19:56:04.912374] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-27T19:56:04.912458] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-27T19:56:04.913507] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-27T19:56:04.913572] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-27T19:56:04.914990] [DEBUG] [LOCAL ] MLI: Trimmed 63304 records to 43225 (keeping 200 days of data) [2025-10-27T19:56:05.195412] [DEBUG] [LOCAL ] MLI: Primary data saved (43225 records). [2025-10-27T19:56:05.205277] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-27T19:56:05.205382] [INFO ] [MAIN ] Update Progress: 1364/2366 symbols completed. MLI took 28.6s. Estimated remaining: 2h 9m 19s. Rate: 7.7 symbols/min [2025-10-27T19:56:05.237599] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T19:56:05.322891] [INFO ] [REMOTE ] MKC: Full fetch complete (76013 records). [2025-10-27T19:56:05.297882] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T19:56:05.326725] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-27T19:56:05.340971] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-27T19:56:05.479306] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:05.728157] [DEBUG] [LOCAL ] MLR: Loaded 12216 existing records from primary storage. [2025-10-27T19:56:05.741848] [INFO ] [MAIN ] MLR: Loaded 12216 existing records. [2025-10-27T19:56:05.796496] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-27T19:56:05.965333] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-27T19:56:05.970585] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-27T19:56:05.976958] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-27T19:56:05.977045] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-27T19:56:06.020061] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-27T19:56:06.054315] [DEBUG] [LOCAL ] MKC: Trimmed 76013 records to 52496 (keeping 200 days of data) [2025-10-27T19:56:06.053395] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:06.055189] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-27T19:56:06.055272] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-27T19:56:06.055432] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-27T19:56:06.055471] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-27T19:56:06.226310] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T19:56:06.683153] [DEBUG] [LOCAL ] MKC: Primary data saved (52496 records). [2025-10-27T19:56:06.683380] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-27T19:56:06.683499] [INFO ] [MAIN ] Update Progress: 1365/2366 symbols completed. MKC took 50.2s. Estimated remaining: 2h 9m 7s. Rate: 7.8 symbols/min [2025-10-27T19:56:06.825422] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-27T19:56:06.873426] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:06.938086] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:06.987050] [DEBUG] [LOCAL ] MMC: Loaded 52683 existing records from primary storage. [2025-10-27T19:56:06.987359] [INFO ] [MAIN ] MMC: Loaded 52683 existing records. [2025-10-27T19:56:07.165669] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:07.165867] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-27T19:56:07.165913] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-27T19:56:07.166209] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-27T19:56:07.166248] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-27T19:56:07.308426] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T19:56:07.527068] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:07.553466] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T19:56:07.614988] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-27T19:56:08.414940] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-27T19:56:08.981249] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T19:56:09.188962] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T19:56:09.214902] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-27T19:56:10.014948] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-27T19:56:10.552175] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T19:56:10.557252] [INFO ] [REMOTE ] MLM: Full fetch complete (45005 records). [2025-10-27T19:56:10.557368] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-27T19:56:10.815926] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-27T19:56:10.868181] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T19:56:10.948525] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-27T19:56:10.948611] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-27T19:56:10.949500] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-27T19:56:10.949560] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-27T19:56:10.950687] [DEBUG] [LOCAL ] MLM: Trimmed 45005 records to 28252 (keeping 200 days of data) [2025-10-27T19:56:11.125972] [DEBUG] [LOCAL ] MLM: Primary data saved (28252 records). [2025-10-27T19:56:11.126113] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-27T19:56:11.126234] [INFO ] [MAIN ] Update Progress: 1366/2366 symbols completed. MLM took 25.1s. Estimated remaining: 2h 8m 57s. Rate: 7.8 symbols/min [2025-10-27T19:56:11.294830] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T19:56:11.303428] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:11.319476] [DEBUG] [LOCAL ] MMD: Loaded 10857 existing records from primary storage. [2025-10-27T19:56:11.319783] [INFO ] [MAIN ] MMD: Loaded 10857 existing records. [2025-10-27T19:56:11.493062] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:11.493279] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-27T19:56:11.493327] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-27T19:56:11.493563] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-27T19:56:11.493603] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-27T19:56:11.629101] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-27T19:56:11.849607] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:12.414977] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-27T19:56:12.921853] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T19:56:12.949407] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T19:56:13.214976] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-27T19:56:13.581212] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T19:56:14.015002] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-27T19:56:14.585173] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T19:56:14.815009] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-27T19:56:15.615000] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-27T19:56:15.724033] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T19:56:16.414956] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-27T19:56:17.217059] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T19:56:17.216089] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-27T19:56:17.387498] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T19:56:17.957299] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T19:56:18.014965] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-27T19:56:18.788911] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T19:56:18.814903] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-27T19:56:19.615013] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-27T19:56:20.047967] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T19:56:20.414916] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-27T19:56:20.610199] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T19:56:21.214980] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-27T19:56:21.686025] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T19:56:22.014943] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-27T19:56:22.097520] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T19:56:22.724617] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T19:56:22.814927] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-27T19:56:23.332539] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T19:56:23.333553] [INFO ] [REMOTE ] MLP: Full fetch complete (4266 records). [2025-10-27T19:56:23.333620] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-27T19:56:23.620195] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-27T19:56:23.705481] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-27T19:56:23.705575] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-27T19:56:23.705734] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-27T19:56:23.705796] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-27T19:56:23.706146] [DEBUG] [LOCAL ] MLP: Trimmed 4266 records to 2938 (keeping 200 days of data) [2025-10-27T19:56:23.722801] [DEBUG] [LOCAL ] MLP: Primary data saved (2938 records). [2025-10-27T19:56:23.722875] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-27T19:56:23.722946] [INFO ] [MAIN ] Update Progress: 1367/2366 symbols completed. MLP took 28.3s. Estimated remaining: 2h 8m 52s. Rate: 7.8 symbols/min [2025-10-27T19:56:23.891763] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:23.906481] [DEBUG] [LOCAL ] MMI: Loaded 15642 existing records from primary storage. [2025-10-27T19:56:23.906753] [INFO ] [MAIN ] MMI: Loaded 15642 existing records. [2025-10-27T19:56:24.087693] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:24.087880] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-27T19:56:24.087925] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-27T19:56:24.088212] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-27T19:56:24.088269] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-27T19:56:24.416348] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-27T19:56:24.453305] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:24.462146] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T19:56:25.214942] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-27T19:56:25.754402] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T19:56:25.920963] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T19:56:26.014945] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-27T19:56:26.596776] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T19:56:26.814954] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-27T19:56:27.615005] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-27T19:56:27.807724] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T19:56:27.810486] [INFO ] [REMOTE ] MLR: Full fetch complete (18920 records). [2025-10-27T19:56:27.810560] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-27T19:56:28.176728] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-27T19:56:28.176809] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-27T19:56:28.177246] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-27T19:56:28.177285] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-27T19:56:28.177840] [DEBUG] [LOCAL ] MLR: Trimmed 18920 records to 11858 (keeping 200 days of data) [2025-10-27T19:56:28.247998] [DEBUG] [LOCAL ] MLR: Primary data saved (11858 records). [2025-10-27T19:56:28.248103] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-27T19:56:28.248181] [INFO ] [MAIN ] Update Progress: 1368/2366 symbols completed. MLR took 23.0s. Estimated remaining: 2h 8m 42s. Rate: 7.8 symbols/min [2025-10-27T19:56:28.419839] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-27T19:56:28.422859] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:28.423756] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-27T19:56:28.432195] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-27T19:56:28.432677] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T19:56:28.433017] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-27T19:56:28.436119] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-27T19:56:28.436178] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-27T19:56:28.436216] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-27T19:56:28.786954] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:29.214958] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-27T19:56:29.408154] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:56:29.408462] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-27T19:56:29.408547] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:56:29.408619] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-27T19:56:29.408707] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:56:29.408777] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-27T19:56:29.408838] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-27T19:56:29.408874] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-27T19:56:29.408930] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-27T19:56:29.408999] [INFO ] [MAIN ] Update Progress: 1369/2366 symbols completed. MMID took 1.2s. Estimated remaining: 2h 8m 30s. Rate: 7.8 symbols/min [2025-10-27T19:56:29.579127] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:29.579328] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-27T19:56:29.579369] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-27T19:56:29.579443] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-27T19:56:29.579479] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-27T19:56:29.579520] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-27T19:56:29.579550] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-27T19:56:29.940501] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:30.015117] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-27T19:56:30.203971] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T19:56:30.814969] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-27T19:56:30.922414] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T19:56:31.240469] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T19:56:31.614989] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-27T19:56:32.414915] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-27T19:56:32.493164] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T19:56:33.204789] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T19:56:33.214904] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-27T19:56:34.014959] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-27T19:56:34.191054] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T19:56:34.431321] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T19:56:34.815025] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-27T19:56:35.614994] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-27T19:56:36.184123] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T19:56:36.362776] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T19:56:36.415011] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-27T19:56:37.218150] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-27T19:56:37.219973] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T19:56:38.014932] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-27T19:56:38.286299] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-27T19:56:38.478527] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T19:56:38.814936] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-27T19:56:39.282622] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T19:56:39.614963] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-27T19:56:39.730570] [DEBUG] [REMOTE ] MMKT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-27T19:56:39.730924] [WARN ] [REMOTE ] MMKT: No data returned for month 2025-05 [2025-10-27T19:56:39.731011] [FATAL] [REMOTE ] MMKT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:56:39.731088] [FATAL] [MAIN ] MMKT: Failed to fetch primary data. [2025-10-27T19:56:39.731151] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:56:39.731222] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-27T19:56:39.731283] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-27T19:56:39.731317] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-27T19:56:39.731355] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-27T19:56:39.731401] [INFO ] [MAIN ] Update Progress: 1370/2366 symbols completed. MMKT took 10.3s. Estimated remaining: 2h 8m 24s. Rate: 7.8 symbols/min [2025-10-27T19:56:39.903889] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:39.953877] [DEBUG] [LOCAL ] MMM: Loaded 53891 existing records from primary storage. [2025-10-27T19:56:39.954212] [INFO ] [MAIN ] MMM: Loaded 53891 existing records. [2025-10-27T19:56:40.128557] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:40.128768] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-27T19:56:40.128817] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-27T19:56:40.129004] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-27T19:56:40.129040] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-27T19:56:40.420093] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-27T19:56:40.483814] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:41.214976] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-27T19:56:41.910887] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T19:56:42.015015] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-27T19:56:42.436592] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-27T19:56:42.447770] [INFO ] [REMOTE ] MMC: Full fetch complete (75232 records). [2025-10-27T19:56:42.447952] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-27T19:56:42.561908] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T19:56:42.821632] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-27T19:56:42.841034] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-27T19:56:42.841118] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-27T19:56:42.842144] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-27T19:56:42.842340] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-27T19:56:42.843718] [DEBUG] [LOCAL ] MMC: Trimmed 75232 records to 51895 (keeping 200 days of data) [2025-10-27T19:56:43.156460] [DEBUG] [LOCAL ] MMC: Primary data saved (51895 records). [2025-10-27T19:56:43.156583] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-27T19:56:43.156694] [INFO ] [MAIN ] Update Progress: 1371/2366 symbols completed. MMC took 36.5s. Estimated remaining: 2h 8m 13s. Rate: 7.8 symbols/min [2025-10-27T19:56:43.330432] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:43.363593] [DEBUG] [LOCAL ] MMS: Loaded 33822 existing records from primary storage. [2025-10-27T19:56:43.363905] [INFO ] [MAIN ] MMS: Loaded 33822 existing records. [2025-10-27T19:56:43.538938] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:43.539137] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-27T19:56:43.539183] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-27T19:56:43.539460] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-27T19:56:43.539500] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-27T19:56:43.620092] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-27T19:56:43.881692] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:44.414923] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-27T19:56:44.661978] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T19:56:44.681451] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T19:56:45.214977] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-27T19:56:45.316995] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T19:56:46.014995] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-27T19:56:46.640439] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T19:56:46.814955] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-27T19:56:47.001253] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T19:56:47.615040] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-27T19:56:48.291898] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T19:56:48.374332] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T19:56:48.414926] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-27T19:56:49.215001] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-27T19:56:50.015006] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-27T19:56:50.060899] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T19:56:50.063332] [INFO ] [REMOTE ] MMD: Full fetch complete (16943 records). [2025-10-27T19:56:50.063414] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-27T19:56:50.481103] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-27T19:56:50.481222] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-27T19:56:50.481736] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-27T19:56:50.481863] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-27T19:56:50.482690] [DEBUG] [LOCAL ] MMD: Trimmed 16943 records to 10594 (keeping 200 days of data) [2025-10-27T19:56:50.564709] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-27T19:56:50.587168] [DEBUG] [LOCAL ] MMD: Primary data saved (10594 records). [2025-10-27T19:56:50.587365] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-27T19:56:50.587589] [INFO ] [MAIN ] Update Progress: 1372/2366 symbols completed. MMD took 39.5s. Estimated remaining: 2h 8m 5s. Rate: 7.8 symbols/min [2025-10-27T19:56:50.753906] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:56:50.765486] [DEBUG] [LOCAL ] MMT: Loaded 10225 existing records from primary storage. [2025-10-27T19:56:50.765747] [INFO ] [MAIN ] MMT: Loaded 10225 existing records. [2025-10-27T19:56:50.827948] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-27T19:56:50.941051] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:56:50.941223] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-27T19:56:50.941269] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-27T19:56:50.941426] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-27T19:56:50.941481] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-27T19:56:51.296718] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:56:51.317830] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T19:56:51.615004] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-27T19:56:52.414948] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-27T19:56:52.623558] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T19:56:52.659435] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T19:56:52.924907] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T19:56:53.214945] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-27T19:56:54.014974] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-27T19:56:54.060822] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T19:56:54.814993] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-27T19:56:54.980596] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T19:56:55.565277] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T19:56:55.614954] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-27T19:56:56.221594] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T19:56:56.414937] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-27T19:56:57.214999] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-27T19:56:57.984425] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T19:56:58.014962] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-27T19:56:58.107450] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T19:56:58.814964] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-27T19:56:58.909885] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T19:56:59.614943] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-27T19:57:00.414953] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-27T19:57:00.558178] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T19:57:01.214968] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-27T19:57:01.505768] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T19:57:02.014960] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-27T19:57:02.814927] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-27T19:57:03.472991] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-27T19:57:03.615046] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-27T19:57:04.016379] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T19:57:04.096922] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T19:57:04.415007] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-27T19:57:04.454970] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-10-27T19:57:05.191474] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T19:57:05.195618] [INFO ] [REMOTE ] MMI: Full fetch complete (22012 records). [2025-10-27T19:57:05.195731] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-27T19:57:05.220259] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-27T19:57:05.562869] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-27T19:57:05.562964] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-27T19:57:05.563452] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-27T19:57:05.563492] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-27T19:57:05.564376] [DEBUG] [LOCAL ] MMI: Trimmed 22012 records to 15152 (keeping 200 days of data) [2025-10-27T19:57:05.669932] [DEBUG] [LOCAL ] MMI: Primary data saved (15152 records). [2025-10-27T19:57:05.670078] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-27T19:57:05.670162] [INFO ] [MAIN ] Update Progress: 1373/2366 symbols completed. MMI took 41.9s. Estimated remaining: 2h 8m 3s. Rate: 7.8 symbols/min [2025-10-27T19:57:05.842505] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:05.859752] [DEBUG] [LOCAL ] MMU: Loaded 16972 existing records from primary storage. [2025-10-27T19:57:05.859987] [INFO ] [MAIN ] MMU: Loaded 16972 existing records. [2025-10-27T19:57:06.031333] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-27T19:57:06.061700] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:06.062898] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-27T19:57:06.063050] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-27T19:57:06.063419] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-27T19:57:06.063532] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-27T19:57:06.173215] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T19:57:06.472103] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:06.543366] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T19:57:06.814980] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-27T19:57:06.976727] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T19:57:07.614980] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-27T19:57:07.696705] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T19:57:08.414981] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-27T19:57:08.993237] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T19:57:09.214971] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-27T19:57:10.014987] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-27T19:57:10.359769] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T19:57:10.370075] [INFO ] [REMOTE ] MMM: Full fetch complete (77220 records). [2025-10-27T19:57:10.370232] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-27T19:57:10.803212] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-27T19:57:10.803372] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-27T19:57:10.804692] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-27T19:57:10.813050] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-27T19:57:10.825690] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-27T19:57:10.826530] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:57:10.828487] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T19:57:10.842093] [DEBUG] [LOCAL ] MMM: Trimmed 77220 records to 53110 (keeping 200 days of data) [2025-10-27T19:57:11.168574] [DEBUG] [LOCAL ] MMM: Primary data saved (53110 records). [2025-10-27T19:57:11.168767] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-27T19:57:11.168869] [INFO ] [MAIN ] Update Progress: 1374/2366 symbols completed. MMM took 31.4s. Estimated remaining: 2h 7m 53s. Rate: 7.8 symbols/min [2025-10-27T19:57:11.332016] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:11.359081] [DEBUG] [LOCAL ] MNR: Loaded 25351 existing records from primary storage. [2025-10-27T19:57:11.359357] [INFO ] [MAIN ] MNR: Loaded 25351 existing records. [2025-10-27T19:57:11.539092] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:11.539304] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-27T19:57:11.539352] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-27T19:57:11.539684] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-27T19:57:11.539744] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-27T19:57:11.620058] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-27T19:57:11.671277] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T19:57:11.946122] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:12.414981] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-27T19:57:12.590250] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T19:57:13.155971] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T19:57:13.214904] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-27T19:57:14.014976] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-27T19:57:14.568716] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T19:57:14.584589] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T19:57:14.814927] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-27T19:57:15.534390] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T19:57:15.614943] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-27T19:57:16.414976] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-27T19:57:16.790932] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T19:57:17.214999] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-27T19:57:17.316236] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T19:57:18.009009] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T19:57:18.015021] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-27T19:57:18.814910] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-27T19:57:19.141118] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T19:57:19.614934] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-27T19:57:19.679991] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T19:57:20.414946] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-27T19:57:20.883429] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T19:57:20.889939] [INFO ] [REMOTE ] MMS: Full fetch complete (50948 records). [2025-10-27T19:57:20.890038] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-27T19:57:21.220090] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-27T19:57:21.289142] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-27T19:57:21.289339] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-27T19:57:21.290900] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T19:57:21.290698] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-27T19:57:21.293547] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-27T19:57:21.293624] [INFO ] [REMOTE ] MMT: Full fetch complete (15911 records). [2025-10-27T19:57:21.293896] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-27T19:57:21.374099] [DEBUG] [LOCAL ] MMS: Trimmed 50948 records to 33129 (keeping 200 days of data) [2025-10-27T19:57:21.772328] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-27T19:57:21.772628] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-27T19:57:21.777852] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-27T19:57:21.778198] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-27T19:57:21.781300] [DEBUG] [LOCAL ] MMT: Trimmed 15911 records to 9961 (keeping 200 days of data) [2025-10-27T19:57:21.918883] [DEBUG] [LOCAL ] MMT: Primary data saved (9961 records). [2025-10-27T19:57:21.920949] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-27T19:57:21.921088] [INFO ] [MAIN ] Update Progress: 1375/2366 symbols completed. MMT took 31.3s. Estimated remaining: 2h 7m 48s. Rate: 7.8 symbols/min [2025-10-27T19:57:21.932786] [DEBUG] [LOCAL ] MMS: Primary data saved (33129 records). [2025-10-27T19:57:21.961114] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-27T19:57:21.997335] [INFO ] [MAIN ] Update Progress: 1376/2366 symbols completed. MMS took 38.8s. Estimated remaining: 2h 7m 35s. Rate: 7.8 symbols/min [2025-10-27T19:57:22.024118] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-27T19:57:22.264179] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:22.286734] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:22.287364] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-27T19:57:22.287423] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-27T19:57:22.287538] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-27T19:57:22.287581] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-27T19:57:22.287622] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-27T19:57:22.287709] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-27T19:57:22.610055] [DEBUG] [LOCAL ] MNSO: Loaded 44552 existing records from primary storage. [2025-10-27T19:57:22.684300] [INFO ] [MAIN ] MNSO: Loaded 44552 existing records. [2025-10-27T19:57:22.714222] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:22.728352] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T19:57:22.814967] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-27T19:57:22.916363] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:22.916770] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-27T19:57:22.916832] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-27T19:57:22.917310] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-27T19:57:22.917369] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-27T19:57:23.070437] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:57:23.105980] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T19:57:23.115882] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-27T19:57:23.199434] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:57:23.233183] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-27T19:57:23.262152] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:57:23.285419] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-27T19:57:23.327884] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-27T19:57:23.328157] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-27T19:57:23.350907] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-27T19:57:23.373867] [INFO ] [MAIN ] Update Progress: 1377/2366 symbols completed. MNTN took 1.4s. Estimated remaining: 2h 7m 22s. Rate: 7.8 symbols/min [2025-10-27T19:57:23.378572] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:23.622079] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-27T19:57:23.626208] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:23.627412] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-27T19:57:23.627464] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-27T19:57:23.627602] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-27T19:57:23.627688] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-27T19:57:23.627762] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-27T19:57:23.627807] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-27T19:57:24.076408] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:24.414961] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-27T19:57:24.669577] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:57:25.215002] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-27T19:57:26.015021] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-27T19:57:26.056478] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T19:57:26.104308] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T19:57:26.814983] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-27T19:57:27.149177] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T19:57:27.614979] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-27T19:57:28.326134] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T19:57:28.360807] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T19:57:28.414949] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-27T19:57:29.069182] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:57:29.214924] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-27T19:57:29.884840] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T19:57:29.889754] [INFO ] [REMOTE ] MMU: Full fetch complete (24909 records). [2025-10-27T19:57:29.889868] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-27T19:57:30.020059] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-27T19:57:30.263580] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-27T19:57:30.263680] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-27T19:57:30.264203] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-27T19:57:30.264243] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-27T19:57:30.264976] [DEBUG] [LOCAL ] MMU: Trimmed 24909 records to 16573 (keeping 200 days of data) [2025-10-27T19:57:30.363369] [DEBUG] [LOCAL ] MMU: Primary data saved (16573 records). [2025-10-27T19:57:30.363545] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-27T19:57:30.363631] [INFO ] [MAIN ] Update Progress: 1378/2366 symbols completed. MMU took 24.7s. Estimated remaining: 2h 7m 14s. Rate: 7.8 symbols/min [2025-10-27T19:57:30.528197] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:30.569583] [DEBUG] [LOCAL ] MOD: Loaded 45103 existing records from primary storage. [2025-10-27T19:57:30.569897] [INFO ] [MAIN ] MOD: Loaded 45103 existing records. [2025-10-27T19:57:30.743548] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:30.743782] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-27T19:57:30.743829] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-27T19:57:30.744013] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-27T19:57:30.744050] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-27T19:57:30.820083] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-27T19:57:31.089111] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:31.622069] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-27T19:57:31.625811] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T19:57:31.843138] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T19:57:32.414944] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-27T19:57:33.174781] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T19:57:33.214893] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-27T19:57:34.014998] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-27T19:57:34.564706] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-27T19:57:34.809177] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T19:57:34.814313] [INFO ] [REMOTE ] MNR: Full fetch complete (37146 records). [2025-10-27T19:57:34.814387] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-27T19:57:34.825675] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-27T19:57:34.941844] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T19:57:35.222911] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-27T19:57:35.222976] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-27T19:57:35.223706] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-27T19:57:35.223765] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-27T19:57:35.224478] [DEBUG] [LOCAL ] MNR: Trimmed 37146 records to 24744 (keeping 200 days of data) [2025-10-27T19:57:35.365697] [DEBUG] [LOCAL ] MNR: Primary data saved (24744 records). [2025-10-27T19:57:35.365818] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-27T19:57:35.365890] [INFO ] [MAIN ] Update Progress: 1379/2366 symbols completed. MNR took 24.2s. Estimated remaining: 2h 7m 4s. Rate: 7.8 symbols/min [2025-10-27T19:57:35.531514] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:35.578766] [DEBUG] [LOCAL ] MODG: Loaded 52270 existing records from primary storage. [2025-10-27T19:57:35.579063] [INFO ] [MAIN ] MODG: Loaded 52270 existing records. [2025-10-27T19:57:35.622282] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-27T19:57:35.769337] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:35.769545] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-27T19:57:35.769603] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-27T19:57:35.769918] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-27T19:57:35.769975] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-27T19:57:36.130105] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:36.414965] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-27T19:57:36.540530] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T19:57:37.214898] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-27T19:57:37.414353] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T19:57:38.014961] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-27T19:57:38.130085] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T19:57:38.814923] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-27T19:57:38.930695] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T19:57:39.614907] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-27T19:57:39.673717] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T19:57:40.414922] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-27T19:57:40.454719] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T19:57:40.980699] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T19:57:41.214958] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-27T19:57:42.014910] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-27T19:57:42.436111] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T19:57:42.824742] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-27T19:57:42.827242] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T19:57:43.534352] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T19:57:43.614912] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-27T19:57:44.414987] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-27T19:57:44.772421] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T19:57:45.069338] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T19:57:45.214932] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-27T19:57:45.798703] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T19:57:46.014936] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-27T19:57:46.401071] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T19:57:46.814922] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-27T19:57:47.620045] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-27T19:57:47.636842] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T19:57:47.879370] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T19:57:48.414993] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-27T19:57:49.107797] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T19:57:49.214962] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-27T19:57:50.014936] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-27T19:57:50.343970] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T19:57:50.671026] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T19:57:50.814931] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-27T19:57:51.227359] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T19:57:51.614931] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-27T19:57:52.414921] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-27T19:57:52.538333] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T19:57:52.941177] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T19:57:52.949559] [INFO ] [REMOTE ] MNSO: Full fetch complete (64340 records). [2025-10-27T19:57:52.949715] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-27T19:57:53.220172] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-27T19:57:53.333192] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-27T19:57:53.333283] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-27T19:57:53.334358] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-27T19:57:53.334424] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-27T19:57:53.335674] [DEBUG] [LOCAL ] MNSO: Trimmed 64340 records to 43635 (keeping 200 days of data) [2025-10-27T19:57:53.590485] [DEBUG] [LOCAL ] MNSO: Primary data saved (43635 records). [2025-10-27T19:57:53.590609] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-27T19:57:53.590713] [INFO ] [MAIN ] Update Progress: 1380/2366 symbols completed. MNSO took 31.7s. Estimated remaining: 2h 7m 4s. Rate: 7.8 symbols/min [2025-10-27T19:57:53.756902] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:57:53.802639] [DEBUG] [LOCAL ] MOH: Loaded 43812 existing records from primary storage. [2025-10-27T19:57:53.802939] [INFO ] [MAIN ] MOH: Loaded 43812 existing records. [2025-10-27T19:57:53.974981] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:57:53.975229] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-27T19:57:53.975289] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-27T19:57:53.975475] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-27T19:57:53.975529] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-27T19:57:54.037072] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-27T19:57:54.326207] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:57:54.619064] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-27T19:57:54.656595] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:57:54.814901] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-27T19:57:55.614945] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-27T19:57:55.705032] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T19:57:55.963129] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T19:57:56.414986] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-27T19:57:56.712988] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T19:57:57.214939] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-27T19:57:58.014954] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-27T19:57:58.525720] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-27T19:57:58.814984] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-27T19:57:59.014175] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T19:57:59.284210] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T19:57:59.614988] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-27T19:58:00.076890] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T19:58:00.414971] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-27T19:58:01.214921] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-27T19:58:01.584964] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T19:58:02.015015] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-27T19:58:02.814986] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-27T19:58:03.786055] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-27T19:58:03.794237] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-27T19:58:03.922297] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-27T19:58:03.930329] [INFO ] [REMOTE ] MOD: Full fetch complete (66482 records). [2025-10-27T19:58:03.930448] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-27T19:58:04.314057] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-27T19:58:04.314168] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-27T19:58:04.315184] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-27T19:58:04.315247] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-27T19:58:04.316522] [DEBUG] [LOCAL ] MOD: Trimmed 66482 records to 44245 (keeping 200 days of data) [2025-10-27T19:58:04.575559] [DEBUG] [LOCAL ] MOD: Primary data saved (44245 records). [2025-10-27T19:58:04.575728] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-27T19:58:04.576100] [INFO ] [MAIN ] Update Progress: 1381/2366 symbols completed. MOD took 34.2s. Estimated remaining: 2h 6m 59s. Rate: 7.8 symbols/min [2025-10-27T19:58:04.742588] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:04.791915] [DEBUG] [LOCAL ] MOS: Loaded 54290 existing records from primary storage. [2025-10-27T19:58:04.792213] [INFO ] [MAIN ] MOS: Loaded 54290 existing records. [2025-10-27T19:58:04.964252] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:04.964407] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-27T19:58:04.964453] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-27T19:58:04.964637] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-27T19:58:04.964725] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-27T19:58:05.313826] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:05.314227] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-27T19:58:05.384078] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-27T19:58:05.396687] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-27T19:58:05.648480] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (3.63 seconds). [2025-10-27T19:58:05.659257] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-27T19:58:05.659393] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-27T19:58:05.882463] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T19:58:05.884486] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T19:58:05.885857] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T19:58:05.894630] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T19:58:05.895051] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-27T19:58:05.895135] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-27T19:58:05.895174] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-27T19:58:05.895214] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-27T19:58:05.895281] [INFO ] [MAIN ] Update Progress: 1382/2366 symbols completed. MO took 42.5s. Estimated remaining: 2h 6m 46s. Rate: 7.8 symbols/min [2025-10-27T19:58:06.020031] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-27T19:58:06.069337] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:06.091812] [DEBUG] [LOCAL ] MOV: Loaded 21343 existing records from primary storage. [2025-10-27T19:58:06.092069] [INFO ] [MAIN ] MOV: Loaded 21343 existing records. [2025-10-27T19:58:06.265708] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:06.265927] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-27T19:58:06.265975] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-27T19:58:06.266237] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-27T19:58:06.266276] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-27T19:58:06.621055] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:06.814952] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-27T19:58:06.886525] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T19:58:07.283942] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T19:58:07.294067] [INFO ] [REMOTE ] MODG: Full fetch complete (74776 records). [2025-10-27T19:58:07.294204] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-27T19:58:07.623802] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-27T19:58:07.669705] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T19:58:07.715503] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-27T19:58:07.715715] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-27T19:58:07.716774] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-27T19:58:07.716854] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-27T19:58:07.718295] [DEBUG] [LOCAL ] MODG: Trimmed 74776 records to 51468 (keeping 200 days of data) [2025-10-27T19:58:07.894159] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T19:58:08.017059] [DEBUG] [LOCAL ] MODG: Primary data saved (51468 records). [2025-10-27T19:58:08.017193] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-27T19:58:08.017270] [INFO ] [MAIN ] Update Progress: 1383/2366 symbols completed. MODG took 32.7s. Estimated remaining: 2h 6m 35s. Rate: 7.8 symbols/min [2025-10-27T19:58:08.184467] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:08.233257] [DEBUG] [LOCAL ] MP: Loaded 54524 existing records from primary storage. [2025-10-27T19:58:08.233612] [INFO ] [MAIN ] MP: Loaded 54524 existing records. [2025-10-27T19:58:08.405342] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:08.405556] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-27T19:58:08.405609] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-27T19:58:08.405840] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-27T19:58:08.405894] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-27T19:58:08.420125] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-27T19:58:08.755835] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:09.214916] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-27T19:58:09.263406] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T19:58:09.612165] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T19:58:10.014950] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-27T19:58:10.814937] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-27T19:58:10.851472] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T19:58:11.053067] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T19:58:11.614957] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-27T19:58:12.414912] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-27T19:58:12.670901] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T19:58:13.059944] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T19:58:13.214947] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-27T19:58:14.014917] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-27T19:58:14.269379] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T19:58:14.733877] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T19:58:14.814976] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-27T19:58:15.174838] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T19:58:15.614917] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-27T19:58:16.056097] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T19:58:16.414946] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-27T19:58:17.214992] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-27T19:58:17.430728] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T19:58:18.014981] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-27T19:58:18.392996] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T19:58:18.809429] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T19:58:18.818917] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-27T19:58:18.859384] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T19:58:19.614947] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-27T19:58:20.414955] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-27T19:58:21.134923] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-27T19:58:21.214988] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-27T19:58:21.275807] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T19:58:21.611187] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T19:58:21.900243] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T19:58:22.014939] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-27T19:58:22.815037] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-27T19:58:22.985292] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T19:58:23.615015] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-27T19:58:24.414960] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-27T19:58:24.740027] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T19:58:24.748891] [INFO ] [REMOTE ] MOH: Full fetch complete (60385 records). [2025-10-27T19:58:24.749010] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-27T19:58:25.141175] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-27T19:58:25.141309] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-27T19:58:25.142286] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-27T19:58:25.142386] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-27T19:58:25.143835] [DEBUG] [LOCAL ] MOH: Trimmed 60385 records to 43173 (keeping 200 days of data) [2025-10-27T19:58:25.229679] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-27T19:58:25.300920] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T19:58:25.455195] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T19:58:25.472040] [DEBUG] [LOCAL ] MOH: Primary data saved (43173 records). [2025-10-27T19:58:25.472175] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-27T19:58:25.472254] [INFO ] [MAIN ] Update Progress: 1384/2366 symbols completed. MOH took 31.9s. Estimated remaining: 2h 6m 34s. Rate: 7.8 symbols/min [2025-10-27T19:58:25.634572] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:25.641402] [DEBUG] [LOCAL ] MPA: Loaded 5235 existing records from primary storage. [2025-10-27T19:58:25.641581] [INFO ] [MAIN ] MPA: Loaded 5235 existing records. [2025-10-27T19:58:25.817635] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:25.817960] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-27T19:58:25.818008] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-27T19:58:25.818251] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-27T19:58:25.818308] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-27T19:58:26.021709] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-27T19:58:26.169695] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:26.815018] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-27T19:58:27.419628] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T19:58:27.454773] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-27T19:58:27.614930] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-27T19:58:27.749691] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T19:58:28.414946] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-27T19:58:28.719503] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T19:58:28.723079] [INFO ] [REMOTE ] MOV: Full fetch complete (30407 records). [2025-10-27T19:58:28.723156] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-27T19:58:29.097637] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-27T19:58:29.097749] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-27T19:58:29.098348] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-27T19:58:29.098386] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-27T19:58:29.099115] [DEBUG] [LOCAL ] MOV: Trimmed 30407 records to 20617 (keeping 200 days of data) [2025-10-27T19:58:29.218701] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-27T19:58:29.223253] [DEBUG] [LOCAL ] MOV: Primary data saved (20617 records). [2025-10-27T19:58:29.223314] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-27T19:58:29.223381] [INFO ] [MAIN ] Update Progress: 1385/2366 symbols completed. MOV took 23.3s. Estimated remaining: 2h 6m 23s. Rate: 7.8 symbols/min [2025-10-27T19:58:29.390254] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:29.440731] [DEBUG] [LOCAL ] MPC: Loaded 52630 existing records from primary storage. [2025-10-27T19:58:29.441063] [INFO ] [MAIN ] MPC: Loaded 52630 existing records. [2025-10-27T19:58:29.616130] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:29.616318] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-27T19:58:29.616365] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-27T19:58:29.616547] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-27T19:58:29.616586] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-27T19:58:29.974827] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:30.014916] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-27T19:58:30.479431] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T19:58:30.766024] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-27T19:58:30.814954] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-27T19:58:31.171435] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T19:58:31.614989] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-27T19:58:32.353235] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T19:58:32.354667] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T19:58:32.414919] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-27T19:58:32.986105] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T19:58:33.214948] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-27T19:58:34.014948] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-27T19:58:34.814956] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-27T19:58:35.236151] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T19:58:35.337896] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-27T19:58:35.354781] [INFO ] [REMOTE ] MOS: Full fetch complete (77631 records). [2025-10-27T19:58:35.354943] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-27T19:58:35.624524] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-27T19:58:35.754409] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-27T19:58:35.754520] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-27T19:58:35.755608] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-27T19:58:35.755770] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-27T19:58:35.789364] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T19:58:35.787696] [DEBUG] [LOCAL ] MOS: Trimmed 77631 records to 53511 (keeping 200 days of data) [2025-10-27T19:58:36.137163] [DEBUG] [LOCAL ] MOS: Primary data saved (53511 records). [2025-10-27T19:58:36.137297] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-27T19:58:36.137781] [INFO ] [MAIN ] Update Progress: 1386/2366 symbols completed. MOS took 31.6s. Estimated remaining: 2h 6m 15s. Rate: 7.8 symbols/min [2025-10-27T19:58:36.304218] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:36.353604] [DEBUG] [LOCAL ] MPLX: Loaded 51542 existing records from primary storage. [2025-10-27T19:58:36.353939] [INFO ] [MAIN ] MPLX: Loaded 51542 existing records. [2025-10-27T19:58:36.420127] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-27T19:58:36.532164] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:36.532437] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-27T19:58:36.532494] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-27T19:58:36.532742] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-27T19:58:36.532797] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-27T19:58:36.878708] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:37.215018] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-27T19:58:37.813285] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T19:58:38.014927] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-27T19:58:38.241030] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T19:58:38.283385] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-27T19:58:38.605586] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T19:58:38.814934] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-27T19:58:39.614948] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-27T19:58:40.281484] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T19:58:40.414942] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-27T19:58:40.603524] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T19:58:40.750131] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-27T19:58:41.214956] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-27T19:58:42.014948] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-27T19:58:42.814948] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-27T19:58:43.247412] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T19:58:43.445352] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-27T19:58:43.501786] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T19:58:43.614910] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-27T19:58:44.276435] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T19:58:44.277899] [INFO ] [REMOTE ] MPA: Full fetch complete (7095 records). [2025-10-27T19:58:44.277968] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-27T19:58:44.425867] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-27T19:58:44.643687] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-27T19:58:44.643773] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-27T19:58:44.643956] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-27T19:58:44.643993] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-27T19:58:44.644382] [DEBUG] [LOCAL ] MPA: Trimmed 7095 records to 5098 (keeping 200 days of data) [2025-10-27T19:58:44.678574] [DEBUG] [LOCAL ] MPA: Primary data saved (5098 records). [2025-10-27T19:58:44.678767] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-27T19:58:44.678895] [INFO ] [MAIN ] Update Progress: 1387/2366 symbols completed. MPA took 19.2s. Estimated remaining: 2h 6m 8s. Rate: 7.8 symbols/min [2025-10-27T19:58:44.870469] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:44.877633] [DEBUG] [LOCAL ] MPV: Loaded 4410 existing records from primary storage. [2025-10-27T19:58:44.877865] [INFO ] [MAIN ] MPV: Loaded 4410 existing records. [2025-10-27T19:58:45.050767] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:45.050991] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-27T19:58:45.051037] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-27T19:58:45.051171] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-27T19:58:45.051208] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-27T19:58:45.223427] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-27T19:58:45.414636] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:46.014972] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-27T19:58:46.634812] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T19:58:46.766046] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T19:58:46.814946] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-27T19:58:47.000721] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T19:58:47.614981] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-27T19:58:48.414958] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-27T19:58:49.030465] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T19:58:49.214945] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-27T19:58:49.317923] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T19:58:49.463288] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-27T19:58:49.474278] [INFO ] [REMOTE ] MP: Full fetch complete (77593 records). [2025-10-27T19:58:49.474451] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-27T19:58:49.872240] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-27T19:58:49.872408] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-27T19:58:49.873593] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-27T19:58:49.873681] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-27T19:58:49.875212] [DEBUG] [LOCAL ] MP: Trimmed 77593 records to 53744 (keeping 200 days of data) [2025-10-27T19:58:49.976726] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T19:58:50.053092] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-27T19:58:50.208940] [DEBUG] [LOCAL ] MP: Primary data saved (53744 records). [2025-10-27T19:58:50.209214] [INFO ] [MAIN ] MP: Full history saved. [2025-10-27T19:58:50.209349] [INFO ] [MAIN ] Update Progress: 1388/2366 symbols completed. MP took 42.2s. Estimated remaining: 2h 5m 59s. Rate: 7.8 symbols/min [2025-10-27T19:58:50.373571] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:50.421980] [DEBUG] [LOCAL ] MPW: Loaded 54261 existing records from primary storage. [2025-10-27T19:58:50.422304] [INFO ] [MAIN ] MPW: Loaded 54261 existing records. [2025-10-27T19:58:50.599136] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:50.604320] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-27T19:58:50.604495] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T19:58:50.604723] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-27T19:58:50.607221] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-27T19:58:50.607280] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-27T19:58:50.820274] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-27T19:58:50.956623] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:58:51.614947] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-27T19:58:52.163419] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T19:58:52.414948] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-27T19:58:52.817613] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-27T19:58:53.214915] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-27T19:58:53.297347] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T19:58:53.665964] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T19:58:54.014934] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-27T19:58:54.372483] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-27T19:58:54.814937] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-27T19:58:55.614931] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-27T19:58:56.182639] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T19:58:56.420209] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-27T19:58:56.433016] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T19:58:56.994885] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T19:58:57.214905] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-27T19:58:58.014958] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-27T19:58:58.491145] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T19:58:58.492346] [INFO ] [REMOTE ] MPV: Full fetch complete (7596 records). [2025-10-27T19:58:58.492412] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-27T19:58:58.820107] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-27T19:58:58.852195] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-27T19:58:58.852427] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-27T19:58:58.852689] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-27T19:58:58.852750] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-27T19:58:58.853322] [DEBUG] [LOCAL ] MPV: Trimmed 7596 records to 4296 (keeping 200 days of data) [2025-10-27T19:58:58.879822] [DEBUG] [LOCAL ] MPV: Primary data saved (4296 records). [2025-10-27T19:58:58.879942] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-27T19:58:58.880019] [INFO ] [MAIN ] Update Progress: 1389/2366 symbols completed. MPV took 14.2s. Estimated remaining: 2h 5m 51s. Rate: 7.8 symbols/min [2025-10-27T19:58:59.065286] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:58:59.072717] [DEBUG] [LOCAL ] MPX: Loaded 4001 existing records from primary storage. [2025-10-27T19:58:59.073147] [INFO ] [MAIN ] MPX: Loaded 4001 existing records. [2025-10-27T19:58:59.293357] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:58:59.298438] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-27T19:58:59.298540] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-27T19:58:59.300853] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T19:58:59.301174] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-27T19:58:59.312898] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-27T19:58:59.620156] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-27T19:58:59.673210] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:00.414931] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-27T19:59:00.667500] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T19:59:01.214977] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-27T19:59:02.014917] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-27T19:59:02.137438] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-27T19:59:02.762524] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-27T19:59:02.814958] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-27T19:59:03.471441] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-27T19:59:03.481112] [INFO ] [REMOTE ] MPC: Full fetch complete (75615 records). [2025-10-27T19:59:03.481244] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-27T19:59:03.620228] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-27T19:59:03.885756] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-27T19:59:03.885846] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-27T19:59:03.886931] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-27T19:59:03.886996] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-27T19:59:03.888408] [DEBUG] [LOCAL ] MPC: Trimmed 75615 records to 51791 (keeping 200 days of data) [2025-10-27T19:59:04.204971] [DEBUG] [LOCAL ] MPC: Primary data saved (51791 records). [2025-10-27T19:59:04.205101] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-27T19:59:04.205717] [INFO ] [MAIN ] Update Progress: 1390/2366 symbols completed. MPC took 35.0s. Estimated remaining: 2h 5m 42s. Rate: 7.8 symbols/min [2025-10-27T19:59:04.377251] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:04.388598] [DEBUG] [LOCAL ] MQT: Loaded 8175 existing records from primary storage. [2025-10-27T19:59:04.389044] [INFO ] [MAIN ] MQT: Loaded 8175 existing records. [2025-10-27T19:59:04.620482] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:04.626505] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T19:59:04.630098] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-27T19:59:04.626880] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-27T19:59:04.631171] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-27T19:59:04.631517] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-27T19:59:04.631603] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-27T19:59:05.117295] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:05.223588] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-27T19:59:05.268001] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-27T19:59:05.286355] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T19:59:05.339882] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-10-27T19:59:06.014987] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-27T19:59:06.032762] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T19:59:06.682119] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T19:59:06.815001] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-27T19:59:07.614948] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-27T19:59:08.414963] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-27T19:59:08.425296] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T19:59:08.575907] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T19:59:09.214957] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-27T19:59:09.635570] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T19:59:09.933065] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T19:59:10.014913] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-27T19:59:10.815016] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-27T19:59:11.506892] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T19:59:11.614959] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-27T19:59:12.040437] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T19:59:12.371099] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T19:59:12.414931] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-27T19:59:12.796456] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T19:59:13.214957] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-27T19:59:14.014957] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-27T19:59:14.814940] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-27T19:59:14.873570] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T19:59:15.383754] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T19:59:15.548001] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T19:59:15.614945] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-27T19:59:16.414997] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-27T19:59:16.923465] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T19:59:17.214934] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-27T19:59:17.343045] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T19:59:18.014960] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-27T19:59:18.594912] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T19:59:18.814985] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-27T19:59:19.614941] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-27T19:59:19.633116] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T19:59:19.664897] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T19:59:20.414954] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-27T19:59:20.873585] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-27T19:59:20.874834] [INFO ] [REMOTE ] MPX: Full fetch complete (6456 records). [2025-10-27T19:59:20.874902] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-27T19:59:21.224047] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-27T19:59:21.229063] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-27T19:59:21.229213] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-27T19:59:21.230148] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-27T19:59:21.230225] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-27T19:59:21.230903] [DEBUG] [LOCAL ] MPX: Trimmed 6456 records to 3742 (keeping 200 days of data) [2025-10-27T19:59:21.252573] [DEBUG] [LOCAL ] MPX: Primary data saved (3742 records). [2025-10-27T19:59:21.252886] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-27T19:59:21.253065] [INFO ] [MAIN ] Update Progress: 1391/2366 symbols completed. MPX took 22.4s. Estimated remaining: 2h 5m 41s. Rate: 7.8 symbols/min [2025-10-27T19:59:21.447540] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T19:59:21.465549] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:21.493965] [DEBUG] [LOCAL ] MQY: Loaded 16808 existing records from primary storage. [2025-10-27T19:59:21.494211] [INFO ] [MAIN ] MQY: Loaded 16808 existing records. [2025-10-27T19:59:21.672020] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:21.672185] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-27T19:59:21.672256] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-27T19:59:21.672600] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-27T19:59:21.672693] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-27T19:59:21.949923] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:59:22.022865] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-27T19:59:22.028611] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:22.814950] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-27T19:59:23.615013] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-27T19:59:23.806835] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T19:59:24.217484] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T19:59:24.414907] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-27T19:59:24.538204] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T19:59:25.214911] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-27T19:59:25.581429] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T19:59:26.014979] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-27T19:59:26.814981] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-27T19:59:26.998978] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T19:59:27.081061] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T19:59:27.614983] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-27T19:59:28.259717] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T19:59:28.414953] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-27T19:59:28.736456] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T19:59:28.746820] [INFO ] [REMOTE ] MPLX: Full fetch complete (74343 records). [2025-10-27T19:59:28.746957] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-27T19:59:29.146289] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-27T19:59:29.146380] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-27T19:59:29.147553] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-27T19:59:29.147625] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-27T19:59:29.149217] [DEBUG] [LOCAL ] MPLX: Trimmed 74343 records to 50731 (keeping 200 days of data) [2025-10-27T19:59:29.240607] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-27T19:59:29.452445] [DEBUG] [LOCAL ] MPLX: Primary data saved (50731 records). [2025-10-27T19:59:29.452592] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-27T19:59:29.453114] [INFO ] [MAIN ] Update Progress: 1392/2366 symbols completed. MPLX took 53.3s. Estimated remaining: 2h 5m 33s. Rate: 7.8 symbols/min [2025-10-27T19:59:29.620411] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:29.657474] [DEBUG] [LOCAL ] MRC: Loaded 37565 existing records from primary storage. [2025-10-27T19:59:29.657776] [INFO ] [MAIN ] MRC: Loaded 37565 existing records. [2025-10-27T19:59:29.834878] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:29.835064] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-27T19:59:29.835111] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-27T19:59:29.835291] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-27T19:59:29.835328] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-27T19:59:29.942462] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T19:59:30.032596] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-27T19:59:30.225504] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:30.284312] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T19:59:30.294562] [INFO ] [REMOTE ] MPW: Full fetch complete (77574 records). [2025-10-27T19:59:30.294780] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-27T19:59:30.678624] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-27T19:59:30.678737] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-27T19:59:30.679813] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-27T19:59:30.679874] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-27T19:59:30.681280] [DEBUG] [LOCAL ] MPW: Trimmed 77574 records to 53481 (keeping 200 days of data) [2025-10-27T19:59:30.841319] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-27T19:59:30.988695] [DEBUG] [LOCAL ] MPW: Primary data saved (53481 records). [2025-10-27T19:59:30.988853] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-27T19:59:30.989085] [INFO ] [MAIN ] Update Progress: 1393/2366 symbols completed. MPW took 40.8s. Estimated remaining: 2h 5m 21s. Rate: 7.8 symbols/min [2025-10-27T19:59:31.127552] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T19:59:31.176219] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:31.224102] [DEBUG] [LOCAL ] MRK: Loaded 54570 existing records from primary storage. [2025-10-27T19:59:31.224405] [INFO ] [MAIN ] MRK: Loaded 54570 existing records. [2025-10-27T19:59:31.399387] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:31.399565] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-27T19:59:31.399612] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-27T19:59:31.399818] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-10-27T19:59:31.399869] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-27T19:59:31.616293] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-27T19:59:31.654900] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T19:59:31.762414] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:32.415016] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-27T19:59:32.595045] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T19:59:33.214923] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-27T19:59:33.390377] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T19:59:34.014948] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-27T19:59:34.733694] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T19:59:34.814908] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-27T19:59:35.299705] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T19:59:35.553597] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T19:59:35.614923] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-27T19:59:36.414934] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-27T19:59:36.590859] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T19:59:37.214951] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-27T19:59:37.376226] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T19:59:38.014999] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-27T19:59:38.665723] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T19:59:38.815015] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-27T19:59:39.021027] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T19:59:39.614984] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-27T19:59:40.065827] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T19:59:40.229976] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T19:59:40.414940] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-27T19:59:40.901105] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T19:59:40.903348] [INFO ] [REMOTE ] MQT: Full fetch complete (13109 records). [2025-10-27T19:59:40.903427] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-27T19:59:41.220107] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-27T19:59:41.259663] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-27T19:59:41.259822] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-27T19:59:41.260126] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-27T19:59:41.260167] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-27T19:59:41.260602] [DEBUG] [LOCAL ] MQT: Trimmed 13109 records to 7883 (keeping 200 days of data) [2025-10-27T19:59:41.307037] [DEBUG] [LOCAL ] MQT: Primary data saved (7883 records). [2025-10-27T19:59:41.307139] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-27T19:59:41.307212] [INFO ] [MAIN ] Update Progress: 1394/2366 symbols completed. MQT took 37.1s. Estimated remaining: 2h 5m 15s. Rate: 7.8 symbols/min [2025-10-27T19:59:41.383835] [DEBUG] [REMOTE ] MRK: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-27T19:59:41.408087] [WARN ] [REMOTE ] MRK: No data returned for month 2025-03 [2025-10-27T19:59:41.410561] [FATAL] [REMOTE ] MRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:59:41.421558] [FATAL] [MAIN ] MRK: Failed to fetch primary data. [2025-10-27T19:59:41.437141] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:59:41.455608] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-27T19:59:41.463328] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-27T19:59:41.478613] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-27T19:59:41.480025] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:41.480284] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-27T19:59:41.480331] [DEBUG] [LOCAL ] MRK: Deleted derivative data file. [2025-10-27T19:59:41.480404] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-27T19:59:41.480571] [INFO ] [MAIN ] Update Progress: 1395/2366 symbols completed. MRK took 10.5s. Estimated remaining: 2h 5m 2s. Rate: 7.8 symbols/min [2025-10-27T19:59:41.480811] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-27T19:59:41.523592] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-27T19:59:41.560274] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-27T19:59:41.571048] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-27T19:59:41.762563] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:42.017537] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-27T19:59:42.022298] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:42.043866] [DEBUG] [LOCAL ] MS: Loaded 54467 existing records from primary storage. [2025-10-27T19:59:42.044175] [INFO ] [MAIN ] MS: Loaded 54467 existing records. [2025-10-27T19:59:42.225583] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:42.225830] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-27T19:59:42.225896] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-27T19:59:42.226133] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-27T19:59:42.226185] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-27T19:59:42.609124] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:42.814913] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-27T19:59:43.015533] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T19:59:43.015878] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-27T19:59:43.015973] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T19:59:43.016027] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-27T19:59:43.016089] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T19:59:43.016158] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-27T19:59:43.016220] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-27T19:59:43.016256] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-27T19:59:43.016295] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-27T19:59:43.016340] [INFO ] [MAIN ] Update Progress: 1396/2366 symbols completed. MRP took 1.7s. Estimated remaining: 2h 4m 50s. Rate: 7.8 symbols/min [2025-10-27T19:59:43.141974] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T19:59:43.181771] [INFO ] [REMOTE ] MQY: Full fetch complete (25599 records). [2025-10-27T19:59:43.182862] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-27T19:59:43.199909] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T19:59:43.394258] [DEBUG] [LOCAL ] MSA: Loaded 19085 existing records from primary storage. [2025-10-27T19:59:43.436792] [INFO ] [MAIN ] MSA: Loaded 19085 existing records. [2025-10-27T19:59:43.647686] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-27T19:59:43.775434] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T19:59:43.777246] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-27T19:59:43.777303] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-27T19:59:43.777462] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-27T19:59:43.777418] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-27T19:59:43.778069] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-27T19:59:43.778204] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-27T19:59:43.778342] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-27T19:59:43.778400] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-27T19:59:43.858141] [DEBUG] [LOCAL ] MQY: Trimmed 25599 records to 16443 (keeping 200 days of data) [2025-10-27T19:59:44.138273] [DEBUG] [LOCAL ] MQY: Primary data saved (16443 records). [2025-10-27T19:59:44.158734] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-27T19:59:44.161367] [INFO ] [MAIN ] Update Progress: 1397/2366 symbols completed. MQY took 22.9s. Estimated remaining: 2h 4m 38s. Rate: 7.8 symbols/min [2025-10-27T19:59:44.239400] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T19:59:44.414907] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-27T19:59:45.214916] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-27T19:59:45.281528] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T19:59:45.736568] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T19:59:46.014994] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-27T19:59:46.221914] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T19:59:46.814995] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-27T19:59:47.614920] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-27T19:59:47.668525] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T19:59:47.835867] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T19:59:48.414939] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-27T19:59:48.563842] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T19:59:49.214948] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-27T19:59:50.014924] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-27T19:59:50.206103] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T19:59:50.234762] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T19:59:50.814918] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-27T19:59:50.951749] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T19:59:51.614971] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-27T19:59:51.858073] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T19:59:52.414959] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-27T19:59:52.715376] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T19:59:53.214976] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-27T19:59:53.946173] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T19:59:54.014914] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-27T19:59:54.136720] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T19:59:54.814937] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-27T19:59:55.061019] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T19:59:55.614972] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-27T19:59:56.074130] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T19:59:56.414939] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-27T19:59:56.677138] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T19:59:57.214962] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-27T19:59:57.574312] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T19:59:58.014928] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-27T19:59:58.326312] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T19:59:58.814944] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-27T19:59:59.546532] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T19:59:59.614937] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-27T19:59:59.731515] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T20:00:00.414989] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-27T20:00:01.214966] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-27T20:00:01.876579] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T20:00:02.014949] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-27T20:00:03.312383] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (2.90 seconds). [2025-10-27T20:00:03.316529] [INFO ] [REMOTE ] MSA: Full fetch complete (25923 records). [2025-10-27T20:00:03.316727] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-27T20:00:03.744710] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-27T20:00:03.763706] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-27T20:00:03.764268] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-27T20:00:03.765042] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-27T20:00:03.765123] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-27T20:00:03.765337] [INFO ] [REMOTE ] MRC: Full fetch complete (55013 records). [2025-10-27T20:00:03.765616] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-27T20:00:03.766426] [DEBUG] [LOCAL ] MSA: Trimmed 25923 records to 18569 (keeping 200 days of data) [2025-10-27T20:00:04.070611] [DEBUG] [LOCAL ] MSA: Primary data saved (18569 records). [2025-10-27T20:00:04.085738] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-27T20:00:04.119506] [INFO ] [MAIN ] Update Progress: 1398/2366 symbols completed. MSA took 21.1s. Estimated remaining: 2h 4m 39s. Rate: 7.8 symbols/min [2025-10-27T20:00:04.273859] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-27T20:00:04.273946] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-27T20:00:04.274873] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-27T20:00:04.274936] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-27T20:00:04.276174] [DEBUG] [LOCAL ] MRC: Trimmed 55013 records to 36785 (keeping 200 days of data) [2025-10-27T20:00:04.496280] [DEBUG] [LOCAL ] MRC: Primary data saved (36785 records). [2025-10-27T20:00:04.496419] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-27T20:00:04.496904] [INFO ] [MAIN ] Update Progress: 1399/2366 symbols completed. MRC took 35.0s. Estimated remaining: 2h 4m 26s. Rate: 7.8 symbols/min [2025-10-27T20:00:04.832236] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-27T20:00:04.844251] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-27T20:00:07.409359] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-27T20:00:07.420710] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-27T20:00:09.474152] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T20:00:09.487045] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-27T20:00:12.292989] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-27T20:00:12.303277] [INFO ] [REMOTE ] MS: Full fetch complete (77857 records). [2025-10-27T20:00:12.303420] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-27T20:00:12.689913] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-27T20:00:12.689994] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-27T20:00:12.691039] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-27T20:00:12.691103] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-27T20:00:12.692565] [DEBUG] [LOCAL ] MS: Trimmed 77857 records to 53686 (keeping 200 days of data) [2025-10-27T20:00:13.012758] [DEBUG] [LOCAL ] MS: Primary data saved (53686 records). [2025-10-27T20:00:13.012895] [INFO ] [MAIN ] MS: Full history saved. [2025-10-27T20:00:13.012970] [INFO ] [MAIN ] Update Progress: 1400/2366 symbols completed. MS took 31.5s. Estimated remaining: 2h 4m 19s. Rate: 7.8 symbols/min [2025-10-27T20:00:13.771923] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:13.762971] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:13.788434] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:13.791429] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:13.791733] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-27T20:00:13.792342] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-27T20:00:13.792447] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-27T20:00:13.792486] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-27T20:00:13.792526] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-27T20:00:13.792557] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-27T20:00:13.906681] [DEBUG] [LOCAL ] MSB: Loaded 8092 existing records from primary storage. [2025-10-27T20:00:13.929182] [DEBUG] [LOCAL ] MSD: Loaded 16816 existing records from primary storage. [2025-10-27T20:00:13.928770] [INFO ] [MAIN ] MSB: Loaded 8092 existing records. [2025-10-27T20:00:13.982737] [INFO ] [MAIN ] MSD: Loaded 16816 existing records. [2025-10-27T20:00:14.221885] [DEBUG] [LOCAL ] MSCI: Loaded 34551 existing records from primary storage. [2025-10-27T20:00:14.330149] [INFO ] [MAIN ] MSCI: Loaded 34551 existing records. [2025-10-27T20:00:14.677949] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:14.696070] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-27T20:00:14.741821] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-27T20:00:14.770919] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-27T20:00:14.778409] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:14.808620] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-27T20:00:14.808520] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-27T20:00:14.838997] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:14.854145] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-27T20:00:14.889759] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-27T20:00:14.895103] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-27T20:00:14.916208] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-27T20:00:15.195930] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:15.227387] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-27T20:00:15.261730] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-27T20:00:15.317528] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-27T20:00:15.353208] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-27T20:00:15.574975] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T20:00:15.661816] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-27T20:00:15.951178] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:15.969938] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-27T20:00:16.148136] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:16.154067] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-27T20:00:16.158957] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T20:00:16.167713] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-27T20:00:16.273378] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:16.274136] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-27T20:00:16.819864] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T20:00:16.823408] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-27T20:00:16.841682] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T20:00:16.843306] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-27T20:00:17.078832] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:00:17.082451] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-27T20:00:17.196002] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-27T20:00:17.196994] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-27T20:00:17.363154] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T20:00:17.366068] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-27T20:00:17.403636] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T20:00:17.411174] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-27T20:00:17.550755] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T20:00:17.551760] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-27T20:00:17.898003] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T20:00:17.899002] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-27T20:00:18.095613] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T20:00:18.099287] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-27T20:00:18.184735] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:00:18.187076] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-27T20:00:18.218318] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T20:00:18.219413] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-27T20:00:18.515890] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-27T20:00:18.729635] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T20:00:18.783391] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T20:00:18.814897] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-27T20:00:18.903503] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T20:00:19.286759] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T20:00:19.614948] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-27T20:00:20.414966] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-27T20:00:21.201890] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T20:00:21.214895] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-27T20:00:21.378048] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T20:00:22.014949] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-27T20:00:22.550995] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:00:22.731803] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T20:00:22.814946] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-27T20:00:23.141377] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T20:00:23.615020] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-27T20:00:24.414984] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-27T20:00:24.614923] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T20:00:25.156941] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:00:25.214915] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-27T20:00:26.014992] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-27T20:00:26.168216] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T20:00:26.541774] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:00:26.542823] [INFO ] [REMOTE ] MSC: Full fetch complete (2451 records). [2025-10-27T20:00:26.542910] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-27T20:00:26.727564] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-27T20:00:26.727755] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:00:26.727822] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:00:26.727893] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-27T20:00:26.727954] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-27T20:00:26.727990] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-27T20:00:26.728029] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-27T20:00:26.728081] [INFO ] [MAIN ] Update Progress: 1401/2366 symbols completed. MSC took 13.7s. Estimated remaining: 2h 4m 15s. Rate: 7.8 symbols/min [2025-10-27T20:00:26.822675] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-27T20:00:26.896207] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:26.935249] [DEBUG] [LOCAL ] MSDL: Loaded 39231 existing records from primary storage. [2025-10-27T20:00:26.935527] [INFO ] [MAIN ] MSDL: Loaded 39231 existing records. [2025-10-27T20:00:27.116693] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:27.116889] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-27T20:00:27.116936] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-27T20:00:27.117286] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-27T20:00:27.117344] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-27T20:00:27.468056] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:27.614965] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-27T20:00:28.111791] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T20:00:28.414940] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-27T20:00:29.124228] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T20:00:29.214996] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-27T20:00:29.572033] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T20:00:29.909708] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T20:00:30.014944] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-27T20:00:30.814928] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-27T20:00:31.490841] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T20:00:31.538402] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T20:00:31.614907] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-27T20:00:32.414914] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-27T20:00:32.484045] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T20:00:33.038462] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T20:00:33.214960] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-27T20:00:34.014988] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-27T20:00:34.075616] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T20:00:34.080072] [INFO ] [REMOTE ] MSD: Full fetch complete (23140 records). [2025-10-27T20:00:34.080145] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-27T20:00:34.443521] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-27T20:00:34.443591] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-27T20:00:34.444068] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-27T20:00:34.444130] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-27T20:00:34.444749] [DEBUG] [LOCAL ] MSD: Trimmed 23140 records to 16589 (keeping 200 days of data) [2025-10-27T20:00:34.536185] [DEBUG] [LOCAL ] MSD: Primary data saved (16589 records). [2025-10-27T20:00:34.536307] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-27T20:00:34.536379] [INFO ] [MAIN ] Update Progress: 1402/2366 symbols completed. MSD took 21.5s. Estimated remaining: 2h 4m 8s. Rate: 7.8 symbols/min [2025-10-27T20:00:34.700567] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:34.725957] [DEBUG] [LOCAL ] MSGE: Loaded 27409 existing records from primary storage. [2025-10-27T20:00:34.726205] [INFO ] [MAIN ] MSGE: Loaded 27409 existing records. [2025-10-27T20:00:34.820254] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-27T20:00:34.909172] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:34.909402] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-27T20:00:34.909453] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-27T20:00:34.909800] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-27T20:00:34.909866] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-27T20:00:35.261135] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:35.517072] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T20:00:35.563775] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T20:00:35.614904] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-27T20:00:36.414975] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-27T20:00:36.839999] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T20:00:37.214924] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-27T20:00:38.014919] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-27T20:00:38.070120] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T20:00:38.076096] [INFO ] [REMOTE ] MSCI: Full fetch complete (50513 records). [2025-10-27T20:00:38.076198] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-27T20:00:38.502252] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-27T20:00:38.502666] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-27T20:00:38.503946] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-27T20:00:38.504919] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T20:00:38.511006] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-27T20:00:38.512739] [DEBUG] [LOCAL ] MSCI: Trimmed 50513 records to 33730 (keeping 200 days of data) [2025-10-27T20:00:38.721268] [DEBUG] [LOCAL ] MSCI: Primary data saved (33730 records). [2025-10-27T20:00:38.721412] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-27T20:00:38.721494] [INFO ] [MAIN ] Update Progress: 1403/2366 symbols completed. MSCI took 25.7s. Estimated remaining: 2h 3m 58s. Rate: 7.8 symbols/min [2025-10-27T20:00:38.820010] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-27T20:00:38.919065] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:38.942882] [DEBUG] [LOCAL ] MSGS: Loaded 17404 existing records from primary storage. [2025-10-27T20:00:38.943504] [INFO ] [MAIN ] MSGS: Loaded 17404 existing records. [2025-10-27T20:00:39.068756] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T20:00:39.184707] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:39.184959] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-27T20:00:39.185010] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-27T20:00:39.185179] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-27T20:00:39.185218] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-27T20:00:39.554480] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:39.614988] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-27T20:00:40.007396] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T20:00:40.414982] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-27T20:00:40.432209] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T20:00:40.922576] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T20:00:41.214990] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-27T20:00:41.859571] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T20:00:42.014969] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-27T20:00:42.814936] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-27T20:00:43.463064] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T20:00:43.614917] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-27T20:00:44.142157] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T20:00:44.426739] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-27T20:00:44.435903] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:00:45.159304] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T20:00:45.161403] [INFO ] [REMOTE ] MSB: Full fetch complete (13193 records). [2025-10-27T20:00:45.161475] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-27T20:00:45.220032] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-27T20:00:45.548760] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-27T20:00:45.548836] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-27T20:00:45.549172] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-27T20:00:45.549232] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-27T20:00:45.549734] [DEBUG] [LOCAL ] MSB: Trimmed 13193 records to 7959 (keeping 200 days of data) [2025-10-27T20:00:45.595601] [DEBUG] [LOCAL ] MSB: Primary data saved (7959 records). [2025-10-27T20:00:45.595724] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-27T20:00:45.595810] [INFO ] [MAIN ] Update Progress: 1404/2366 symbols completed. MSB took 32.6s. Estimated remaining: 2h 3m 49s. Rate: 7.8 symbols/min [2025-10-27T20:00:45.759353] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:45.795846] [DEBUG] [LOCAL ] MSI: Loaded 40175 existing records from primary storage. [2025-10-27T20:00:45.796150] [INFO ] [MAIN ] MSI: Loaded 40175 existing records. [2025-10-27T20:00:45.971929] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:00:45.972116] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-27T20:00:45.972160] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-27T20:00:45.972361] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-27T20:00:45.972416] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-27T20:00:46.025041] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-27T20:00:46.327696] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T20:00:46.352948] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:46.814950] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-27T20:00:47.503796] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T20:00:47.579478] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T20:00:47.614955] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-27T20:00:48.414953] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-27T20:00:49.177809] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T20:00:49.214905] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-27T20:00:49.243885] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T20:00:50.014990] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-27T20:00:50.755584] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T20:00:50.814933] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-27T20:00:50.841412] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T20:00:51.614972] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-27T20:00:52.001280] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T20:00:52.414937] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-27T20:00:52.842535] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T20:00:53.214925] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-27T20:00:53.349580] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T20:00:54.014987] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-27T20:00:54.578142] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T20:00:54.814939] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-27T20:00:54.986500] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T20:00:55.614959] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-27T20:00:55.900588] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:00:55.906735] [INFO ] [REMOTE ] MSGE: Full fetch complete (39793 records). [2025-10-27T20:00:55.906840] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-27T20:00:56.274847] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-27T20:00:56.274928] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-27T20:00:56.275687] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-27T20:00:56.275749] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-27T20:00:56.279691] [DEBUG] [LOCAL ] MSGE: Trimmed 39793 records to 26790 (keeping 200 days of data) [2025-10-27T20:00:56.422539] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-27T20:00:56.435178] [DEBUG] [LOCAL ] MSGE: Primary data saved (26790 records). [2025-10-27T20:00:56.435256] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-27T20:00:56.435335] [INFO ] [MAIN ] Update Progress: 1405/2366 symbols completed. MSGE took 21.9s. Estimated remaining: 2h 3m 44s. Rate: 7.8 symbols/min [2025-10-27T20:00:56.605481] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:00:56.605638] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-27T20:00:56.605713] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-27T20:00:56.605824] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-27T20:00:56.605865] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-27T20:00:56.605905] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-27T20:00:56.605935] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-27T20:00:56.960144] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:00:56.979238] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T20:00:57.214989] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-27T20:00:57.513538] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-27T20:00:58.014940] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-27T20:00:58.098505] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T20:00:58.814990] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-27T20:00:59.319907] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T20:00:59.614945] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-27T20:01:00.153118] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T20:01:00.251017] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T20:01:00.414961] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-27T20:01:01.214975] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-27T20:01:01.723808] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:01:02.015005] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-27T20:01:02.645998] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T20:01:02.814982] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-27T20:01:03.345420] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T20:01:03.614931] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-27T20:01:03.795804] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T20:01:04.087141] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-27T20:01:04.414930] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-27T20:01:05.214984] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-27T20:01:05.641704] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T20:01:05.720528] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T20:01:06.014952] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-27T20:01:06.814990] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-27T20:01:07.531986] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T20:01:07.614956] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-27T20:01:07.865371] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T20:01:08.415004] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-27T20:01:08.998660] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T20:01:09.214932] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-27T20:01:09.258958] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T20:01:09.267795] [INFO ] [REMOTE ] MSDL: Full fetch complete (56761 records). [2025-10-27T20:01:09.267939] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-27T20:01:09.655568] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-27T20:01:09.655664] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-27T20:01:09.656687] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-27T20:01:09.656756] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-27T20:01:09.657939] [DEBUG] [LOCAL ] MSDL: Trimmed 56761 records to 38515 (keeping 200 days of data) [2025-10-27T20:01:09.887309] [DEBUG] [LOCAL ] MSDL: Primary data saved (38515 records). [2025-10-27T20:01:09.887438] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-27T20:01:09.888132] [INFO ] [MAIN ] Update Progress: 1406/2366 symbols completed. MSDL took 43.2s. Estimated remaining: 2h 3m 40s. Rate: 7.8 symbols/min [2025-10-27T20:01:10.028212] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-27T20:01:10.064219] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:10.102552] [DEBUG] [LOCAL ] MSM: Loaded 36054 existing records from primary storage. [2025-10-27T20:01:10.102853] [INFO ] [MAIN ] MSM: Loaded 36054 existing records. [2025-10-27T20:01:10.277939] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:10.278157] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-27T20:01:10.278307] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-27T20:01:10.283834] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-27T20:01:10.287015] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-27T20:01:10.335735] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T20:01:10.667233] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:10.814932] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-27T20:01:11.019531] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T20:01:11.614970] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-27T20:01:11.901518] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:01:11.905766] [INFO ] [REMOTE ] MSGS: Full fetch complete (23844 records). [2025-10-27T20:01:11.905876] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-27T20:01:12.294480] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-27T20:01:12.294560] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-27T20:01:12.295113] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-27T20:01:12.295177] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-27T20:01:12.295900] [DEBUG] [LOCAL ] MSGS: Trimmed 23844 records to 17192 (keeping 200 days of data) [2025-10-27T20:01:12.399875] [DEBUG] [LOCAL ] MSGS: Primary data saved (17192 records). [2025-10-27T20:01:12.400010] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-27T20:01:12.400088] [INFO ] [MAIN ] Update Progress: 1407/2366 symbols completed. MSGS took 33.7s. Estimated remaining: 2h 3m 29s. Rate: 7.8 symbols/min [2025-10-27T20:01:12.420419] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-27T20:01:12.577330] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:12.629493] [DEBUG] [LOCAL ] MT: Loaded 51084 existing records from primary storage. [2025-10-27T20:01:12.629841] [INFO ] [MAIN ] MT: Loaded 51084 existing records. [2025-10-27T20:01:12.821112] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:12.821378] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-27T20:01:12.821466] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-27T20:01:12.821941] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-27T20:01:12.822000] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-27T20:01:13.146788] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T20:01:13.236421] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:13.230422] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-27T20:01:13.317585] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T20:01:14.014956] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-27T20:01:14.153944] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T20:01:14.814943] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-27T20:01:14.919048] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T20:01:15.614974] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-27T20:01:16.276987] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T20:01:16.414978] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-27T20:01:17.214943] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-27T20:01:17.457606] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T20:01:17.779100] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T20:01:18.014961] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-27T20:01:18.605447] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:01:18.814975] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-27T20:01:19.281015] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T20:01:19.614925] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-27T20:01:19.676478] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T20:01:20.414967] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-27T20:01:20.884067] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:01:21.214986] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-27T20:01:22.014915] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-27T20:01:22.112630] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T20:01:22.256250] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T20:01:22.814980] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-27T20:01:22.845761] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T20:01:22.850150] [INFO ] [REMOTE ] MSIF: Full fetch complete (19732 records). [2025-10-27T20:01:22.850253] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-27T20:01:23.036066] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-27T20:01:23.036476] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:01:23.036553] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:01:23.036604] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-27T20:01:23.036725] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-27T20:01:23.036773] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-27T20:01:23.036814] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-27T20:01:23.036883] [INFO ] [MAIN ] Update Progress: 1408/2366 symbols completed. MSIF took 26.6s. Estimated remaining: 2h 3m 23s. Rate: 7.8 symbols/min [2025-10-27T20:01:23.217951] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:23.267004] [DEBUG] [LOCAL ] MTB: Loaded 47303 existing records from primary storage. [2025-10-27T20:01:23.267394] [INFO ] [MAIN ] MTB: Loaded 47303 existing records. [2025-10-27T20:01:23.456805] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:23.457031] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-27T20:01:23.457077] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-27T20:01:23.457286] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-27T20:01:23.457340] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-27T20:01:23.615337] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-27T20:01:23.830779] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:24.414949] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-27T20:01:24.492478] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T20:01:24.499751] [INFO ] [REMOTE ] MSI: Full fetch complete (57997 records). [2025-10-27T20:01:24.499862] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-27T20:01:24.901478] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-27T20:01:24.901553] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-27T20:01:24.902483] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-27T20:01:24.902544] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-27T20:01:24.903634] [DEBUG] [LOCAL ] MSI: Trimmed 57997 records to 39347 (keeping 200 days of data) [2025-10-27T20:01:25.149942] [DEBUG] [LOCAL ] MSI: Primary data saved (39347 records). [2025-10-27T20:01:25.150105] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-27T20:01:25.150332] [INFO ] [MAIN ] Update Progress: 1409/2366 symbols completed. MSI took 39.6s. Estimated remaining: 2h 3m 11s. Rate: 7.8 symbols/min [2025-10-27T20:01:25.216481] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-27T20:01:25.327866] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:25.359837] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T20:01:25.382590] [DEBUG] [LOCAL ] MTD: Loaded 15336 existing records from primary storage. [2025-10-27T20:01:25.382825] [INFO ] [MAIN ] MTD: Loaded 15336 existing records. [2025-10-27T20:01:25.562609] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:25.562831] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-27T20:01:25.562880] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-27T20:01:25.563193] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-27T20:01:25.563251] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-27T20:01:25.948589] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:26.007905] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T20:01:26.017251] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-27T20:01:26.702959] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:01:26.814964] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-27T20:01:27.614944] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-27T20:01:27.671516] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T20:01:28.379544] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:01:28.414921] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-27T20:01:29.076021] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T20:01:29.214940] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-27T20:01:29.769466] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T20:01:29.890302] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T20:01:30.014961] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-27T20:01:30.814958] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-27T20:01:31.362852] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T20:01:31.614944] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-27T20:01:32.378858] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T20:01:32.414953] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-27T20:01:32.816280] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T20:01:33.214935] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-27T20:01:33.372911] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T20:01:34.014961] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-27T20:01:34.644255] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T20:01:34.815012] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-27T20:01:35.521175] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T20:01:35.613542] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T20:01:35.623062] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-27T20:01:36.415048] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-27T20:01:36.489613] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:01:37.214951] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-27T20:01:37.901854] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T20:01:37.909798] [INFO ] [REMOTE ] MSM: Full fetch complete (51807 records). [2025-10-27T20:01:37.909926] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-27T20:01:38.020091] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-27T20:01:38.303861] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-27T20:01:38.303963] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-27T20:01:38.304830] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-27T20:01:38.304892] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-27T20:01:38.306089] [DEBUG] [LOCAL ] MSM: Trimmed 51807 records to 35329 (keeping 200 days of data) [2025-10-27T20:01:38.523419] [DEBUG] [LOCAL ] MSM: Primary data saved (35329 records). [2025-10-27T20:01:38.523552] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-27T20:01:38.524432] [INFO ] [MAIN ] Update Progress: 1410/2366 symbols completed. MSM took 28.6s. Estimated remaining: 2h 3m 7s. Rate: 7.8 symbols/min [2025-10-27T20:01:38.705809] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:38.777896] [DEBUG] [LOCAL ] MTDR: Loaded 52538 existing records from primary storage. [2025-10-27T20:01:38.804537] [INFO ] [MAIN ] MTDR: Loaded 52538 existing records. [2025-10-27T20:01:38.806105] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:01:38.827055] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-27T20:01:39.110915] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:39.111483] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-27T20:01:39.111593] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-27T20:01:39.112033] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-27T20:01:39.112116] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-27T20:01:39.303504] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T20:01:39.603701] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:39.614915] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-27T20:01:40.402446] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T20:01:40.414915] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-27T20:01:41.138759] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T20:01:41.214957] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-27T20:01:41.843726] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T20:01:42.014972] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-27T20:01:42.701720] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:01:42.814949] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-27T20:01:43.614924] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-27T20:01:43.658658] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T20:01:44.166383] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T20:01:44.414974] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-27T20:01:45.215011] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-27T20:01:45.336096] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T20:01:45.460283] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T20:01:45.469880] [INFO ] [REMOTE ] MT: Full fetch complete (73680 records). [2025-10-27T20:01:45.470002] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-27T20:01:45.856761] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-27T20:01:45.856891] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-27T20:01:45.858055] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-27T20:01:45.858121] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-27T20:01:45.859715] [DEBUG] [LOCAL ] MT: Trimmed 73680 records to 50285 (keeping 200 days of data) [2025-10-27T20:01:46.028867] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-27T20:01:46.159082] [DEBUG] [LOCAL ] MT: Primary data saved (50285 records). [2025-10-27T20:01:46.159222] [INFO ] [MAIN ] MT: Full history saved. [2025-10-27T20:01:46.159714] [INFO ] [MAIN ] Update Progress: 1411/2366 symbols completed. MT took 33.8s. Estimated remaining: 2h 2m 60s. Rate: 7.8 symbols/min [2025-10-27T20:01:46.325780] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:46.378143] [DEBUG] [LOCAL ] MTG: Loaded 51803 existing records from primary storage. [2025-10-27T20:01:46.378514] [INFO ] [MAIN ] MTG: Loaded 51803 existing records. [2025-10-27T20:01:46.557918] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:46.558098] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-27T20:01:46.558144] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-27T20:01:46.558315] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-27T20:01:46.558352] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-27T20:01:46.828723] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-27T20:01:46.943988] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:46.975900] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T20:01:47.335086] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T20:01:47.614933] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-27T20:01:48.329554] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T20:01:48.414913] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-27T20:01:49.214915] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-27T20:01:49.328385] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T20:01:50.015541] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-27T20:01:50.018011] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T20:01:50.541868] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T20:01:50.801175] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T20:01:50.814913] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-27T20:01:51.614963] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-27T20:01:52.414925] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-27T20:01:52.527089] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T20:01:52.536014] [INFO ] [REMOTE ] MTB: Full fetch complete (68285 records). [2025-10-27T20:01:52.536134] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-27T20:01:52.949582] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-27T20:01:52.949821] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-27T20:01:52.951005] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-27T20:01:52.951088] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-27T20:01:52.952700] [DEBUG] [LOCAL ] MTB: Trimmed 68285 records to 46518 (keeping 200 days of data) [2025-10-27T20:01:53.074182] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T20:01:53.216204] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-27T20:01:53.275894] [DEBUG] [LOCAL ] MTB: Primary data saved (46518 records). [2025-10-27T20:01:53.276020] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-27T20:01:53.276095] [INFO ] [MAIN ] Update Progress: 1412/2366 symbols completed. MTB took 30.2s. Estimated remaining: 2h 2m 51s. Rate: 7.8 symbols/min [2025-10-27T20:01:53.443919] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:53.482939] [DEBUG] [LOCAL ] MTH: Loaded 44421 existing records from primary storage. [2025-10-27T20:01:53.483219] [INFO ] [MAIN ] MTH: Loaded 44421 existing records. [2025-10-27T20:01:53.661493] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:53.661866] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-27T20:01:53.662013] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-27T20:01:53.662309] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-27T20:01:53.662372] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-27T20:01:54.027469] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-27T20:01:54.034273] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:54.075099] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:01:54.080110] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T20:01:54.814961] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-27T20:01:55.615001] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-27T20:01:55.824130] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T20:01:56.151520] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-27T20:01:56.155857] [INFO ] [REMOTE ] MTD: Full fetch complete (21511 records). [2025-10-27T20:01:56.156035] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-27T20:01:56.420079] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-27T20:01:56.521520] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-27T20:01:56.521600] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-27T20:01:56.522056] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-27T20:01:56.522116] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-27T20:01:56.522666] [DEBUG] [LOCAL ] MTD: Trimmed 21511 records to 14742 (keeping 200 days of data) [2025-10-27T20:01:56.614543] [DEBUG] [LOCAL ] MTD: Primary data saved (14742 records). [2025-10-27T20:01:56.614707] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-27T20:01:56.614799] [INFO ] [MAIN ] Update Progress: 1413/2366 symbols completed. MTD took 31.5s. Estimated remaining: 2h 2m 41s. Rate: 7.8 symbols/min [2025-10-27T20:01:56.783794] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:01:56.823937] [DEBUG] [LOCAL ] MTN: Loaded 39805 existing records from primary storage. [2025-10-27T20:01:56.824452] [INFO ] [MAIN ] MTN: Loaded 39805 existing records. [2025-10-27T20:01:57.003025] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:01:57.003248] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-27T20:01:57.003420] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-27T20:01:57.003734] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-27T20:01:57.003894] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-27T20:01:57.222667] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-27T20:01:57.341521] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T20:01:57.410051] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:01:57.808412] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:01:58.014953] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-27T20:01:58.814947] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-27T20:01:58.872791] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T20:01:59.506848] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-27T20:01:59.614967] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-27T20:01:59.933755] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T20:02:00.414978] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-27T20:02:01.215006] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-27T20:02:01.259315] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T20:02:01.755921] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T20:02:02.014961] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-27T20:02:02.634736] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-27T20:02:02.815003] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-27T20:02:03.499185] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T20:02:03.615012] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-27T20:02:03.930192] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T20:02:04.415016] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-27T20:02:05.214959] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-27T20:02:05.415364] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T20:02:05.634236] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T20:02:06.015013] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-27T20:02:06.814934] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-27T20:02:06.876589] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T20:02:07.614991] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-27T20:02:07.768281] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T20:02:08.414983] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-27T20:02:08.486599] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T20:02:08.855416] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T20:02:09.214978] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-27T20:02:10.014587] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T20:02:10.024547] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-27T20:02:10.796112] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:02:10.814950] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-27T20:02:11.272061] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T20:02:11.614960] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-27T20:02:12.414958] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-27T20:02:12.816673] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-27T20:02:12.826872] [INFO ] [REMOTE ] MTDR: Full fetch complete (74429 records). [2025-10-27T20:02:12.827015] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-27T20:02:13.235145] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-27T20:02:13.241412] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-27T20:02:13.244672] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-27T20:02:13.246087] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-27T20:02:13.247973] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T20:02:13.248312] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-27T20:02:13.258954] [DEBUG] [LOCAL ] MTDR: Trimmed 74429 records to 51754 (keeping 200 days of data) [2025-10-27T20:02:13.575204] [DEBUG] [LOCAL ] MTDR: Primary data saved (51754 records). [2025-10-27T20:02:13.575351] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-27T20:02:13.576026] [INFO ] [MAIN ] Update Progress: 1414/2366 symbols completed. MTDR took 35.1s. Estimated remaining: 2h 2m 39s. Rate: 7.8 symbols/min [2025-10-27T20:02:13.747599] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:13.747823] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-27T20:02:13.747888] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-27T20:02:13.747999] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-27T20:02:13.748041] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-27T20:02:13.748081] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-27T20:02:13.748112] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-27T20:02:14.015937] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-27T20:02:14.107251] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:14.133603] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T20:02:14.814973] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-27T20:02:14.897017] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T20:02:15.145034] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-27T20:02:15.458066] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:02:15.614987] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-27T20:02:16.414941] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-27T20:02:17.147431] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T20:02:17.214929] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-27T20:02:17.970489] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T20:02:18.014925] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-27T20:02:18.510293] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T20:02:18.815005] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-27T20:02:19.568937] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T20:02:19.579208] [INFO ] [REMOTE ] MTG: Full fetch complete (74330 records). [2025-10-27T20:02:19.579393] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-27T20:02:19.620157] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-27T20:02:19.994639] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-27T20:02:19.994783] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-27T20:02:19.995923] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-27T20:02:19.996009] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-27T20:02:19.997601] [DEBUG] [LOCAL ] MTG: Trimmed 74330 records to 51005 (keeping 200 days of data) [2025-10-27T20:02:20.243474] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T20:02:20.351747] [DEBUG] [LOCAL ] MTG: Primary data saved (51005 records). [2025-10-27T20:02:20.351884] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-27T20:02:20.351977] [INFO ] [MAIN ] Update Progress: 1415/2366 symbols completed. MTG took 34.2s. Estimated remaining: 2h 2m 31s. Rate: 7.8 symbols/min [2025-10-27T20:02:20.420155] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-27T20:02:20.524165] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:20.542934] [DEBUG] [LOCAL ] MTRN: Loaded 18322 existing records from primary storage. [2025-10-27T20:02:20.543215] [INFO ] [MAIN ] MTRN: Loaded 18322 existing records. [2025-10-27T20:02:20.724147] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:20.724353] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-27T20:02:20.724401] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-27T20:02:20.724700] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-27T20:02:20.724758] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-27T20:02:20.764716] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T20:02:21.099451] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:21.124823] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T20:02:21.214932] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-27T20:02:22.014953] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-27T20:02:22.173892] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T20:02:22.814926] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-27T20:02:23.545552] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T20:02:23.553418] [INFO ] [REMOTE ] MTN: Full fetch complete (56701 records). [2025-10-27T20:02:23.553556] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-27T20:02:23.620105] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-27T20:02:23.954770] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-27T20:02:23.954866] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-27T20:02:23.955778] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-27T20:02:23.955839] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-27T20:02:23.956989] [DEBUG] [LOCAL ] MTN: Trimmed 56701 records to 39043 (keeping 200 days of data) [2025-10-27T20:02:24.205824] [DEBUG] [LOCAL ] MTN: Primary data saved (39043 records). [2025-10-27T20:02:24.205962] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-27T20:02:24.206036] [INFO ] [MAIN ] Update Progress: 1416/2366 symbols completed. MTN took 27.6s. Estimated remaining: 2h 2m 21s. Rate: 7.8 symbols/min [2025-10-27T20:02:24.377032] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:24.403456] [DEBUG] [LOCAL ] MTUS: Loaded 27733 existing records from primary storage. [2025-10-27T20:02:24.403731] [INFO ] [MAIN ] MTUS: Loaded 27733 existing records. [2025-10-27T20:02:24.434563] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-27T20:02:24.588682] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:24.589432] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-27T20:02:24.589527] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-27T20:02:24.598173] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T20:02:24.597784] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-27T20:02:24.601808] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-27T20:02:24.731391] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T20:02:24.810213] [INFO ] [REMOTE ] MTH: Full fetch complete (64063 records). [2025-10-27T20:02:24.812211] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-27T20:02:24.888915] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T20:02:25.169834] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:25.224527] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-27T20:02:25.411678] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-27T20:02:25.411762] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-27T20:02:25.412797] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-27T20:02:25.412860] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-27T20:02:25.414091] [DEBUG] [LOCAL ] MTH: Trimmed 64063 records to 43619 (keeping 200 days of data) [2025-10-27T20:02:25.674266] [DEBUG] [LOCAL ] MTH: Primary data saved (43619 records). [2025-10-27T20:02:25.674389] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-27T20:02:25.674465] [INFO ] [MAIN ] Update Progress: 1417/2366 symbols completed. MTH took 32.4s. Estimated remaining: 2h 2m 9s. Rate: 7.8 symbols/min [2025-10-27T20:02:25.770837] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T20:02:25.849991] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:25.875341] [DEBUG] [LOCAL ] MTW: Loaded 26782 existing records from primary storage. [2025-10-27T20:02:25.875569] [INFO ] [MAIN ] MTW: Loaded 26782 existing records. [2025-10-27T20:02:26.020114] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-27T20:02:26.056938] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:26.057293] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-27T20:02:26.057344] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-27T20:02:26.057537] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-27T20:02:26.057594] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-27T20:02:26.421619] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:26.814909] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-27T20:02:26.878423] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T20:02:27.074671] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-27T20:02:27.615001] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-27T20:02:28.414963] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-27T20:02:28.564291] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T20:02:28.990536] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T20:02:29.214941] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-27T20:02:30.014968] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-27T20:02:30.375340] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:02:30.814930] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-27T20:02:31.043446] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T20:02:31.614944] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-27T20:02:32.030571] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T20:02:32.414908] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-27T20:02:32.718052] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T20:02:33.214945] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-27T20:02:33.249164] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T20:02:33.904131] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T20:02:34.014950] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-27T20:02:34.814914] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-27T20:02:35.214405] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:02:35.274106] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T20:02:35.614933] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-27T20:02:36.414961] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-27T20:02:36.716195] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-27T20:02:36.808927] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T20:02:37.214955] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-27T20:02:38.014939] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-27T20:02:38.237165] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T20:02:38.800216] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T20:02:38.814900] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-27T20:02:39.614934] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-27T20:02:39.980090] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T20:02:40.417398] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-27T20:02:40.419750] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T20:02:41.214941] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-27T20:02:41.338058] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T20:02:42.014990] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-27T20:02:42.441218] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T20:02:42.815103] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-27T20:02:42.833791] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T20:02:42.837367] [INFO ] [REMOTE ] MTRN: Full fetch complete (24149 records). [2025-10-27T20:02:42.837440] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-27T20:02:43.230542] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-27T20:02:43.230628] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-27T20:02:43.231434] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-27T20:02:43.231501] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-27T20:02:43.232538] [DEBUG] [LOCAL ] MTRN: Trimmed 24149 records to 17959 (keeping 200 days of data) [2025-10-27T20:02:43.363405] [DEBUG] [LOCAL ] MTRN: Primary data saved (17959 records). [2025-10-27T20:02:43.363554] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-27T20:02:43.363663] [INFO ] [MAIN ] Update Progress: 1418/2366 symbols completed. MTRN took 23.0s. Estimated remaining: 2h 2m 8s. Rate: 7.8 symbols/min [2025-10-27T20:02:43.605307] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:43.619630] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-27T20:02:43.636780] [DEBUG] [LOCAL ] MTX: Loaded 22853 existing records from primary storage. [2025-10-27T20:02:43.637203] [INFO ] [MAIN ] MTX: Loaded 22853 existing records. [2025-10-27T20:02:43.904629] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:43.905094] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-27T20:02:43.905211] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-27T20:02:43.905575] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-27T20:02:43.905690] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-27T20:02:44.149405] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T20:02:44.394749] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:44.414915] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-27T20:02:44.899675] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T20:02:45.214946] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-27T20:02:45.422840] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T20:02:46.014964] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-27T20:02:46.213951] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T20:02:46.814973] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-27T20:02:47.371334] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T20:02:47.614932] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-27T20:02:47.895105] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T20:02:48.416818] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-27T20:02:48.420441] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T20:02:48.717344] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-27T20:02:49.214981] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-27T20:02:50.014937] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-27T20:02:50.306951] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:02:50.311777] [INFO ] [REMOTE ] MTUS: Full fetch complete (40982 records). [2025-10-27T20:02:50.311868] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-27T20:02:50.422344] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T20:02:50.434019] [INFO ] [REMOTE ] MTR: Full fetch complete (2414 records). [2025-10-27T20:02:50.439246] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-27T20:02:50.818706] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-27T20:02:50.838928] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T20:02:50.854929] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:02:50.905675] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:02:50.908034] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-27T20:02:50.908137] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-27T20:02:50.908249] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-27T20:02:50.908375] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-27T20:02:50.908315] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-27T20:02:50.909222] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-27T20:02:50.909336] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-27T20:02:50.909294] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-27T20:02:50.909580] [INFO ] [MAIN ] Update Progress: 1419/2366 symbols completed. MTR took 37.3s. Estimated remaining: 2h 1m 60s. Rate: 7.8 symbols/min [2025-10-27T20:02:50.987040] [DEBUG] [LOCAL ] MTUS: Trimmed 40982 records to 27043 (keeping 200 days of data) [2025-10-27T20:02:51.177514] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:51.274078] [DEBUG] [LOCAL ] MTUS: Primary data saved (27043 records). [2025-10-27T20:02:51.274319] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-27T20:02:51.274427] [INFO ] [MAIN ] Update Progress: 1420/2366 symbols completed. MTUS took 27.1s. Estimated remaining: 2h 1m 47s. Rate: 7.8 symbols/min [2025-10-27T20:02:51.393141] [DEBUG] [LOCAL ] MTZ: Loaded 43305 existing records from primary storage. [2025-10-27T20:02:51.404419] [INFO ] [MAIN ] MTZ: Loaded 43305 existing records. [2025-10-27T20:02:51.561347] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:02:51.617820] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-27T20:02:51.653252] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:51.654249] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-27T20:02:51.657113] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-27T20:02:51.657667] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-27T20:02:51.657753] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-27T20:02:51.748116] [DEBUG] [LOCAL ] MUA: Loaded 11725 existing records from primary storage. [2025-10-27T20:02:51.769765] [INFO ] [MAIN ] MUA: Loaded 11725 existing records. [2025-10-27T20:02:52.147800] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:02:52.175068] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-27T20:02:52.201009] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:02:52.212121] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-27T20:02:52.226556] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-27T20:02:52.247959] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-27T20:02:52.247877] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:52.423201] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-27T20:02:52.610252] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:02:52.626330] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T20:02:53.214962] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-27T20:02:53.688703] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T20:02:54.014979] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-27T20:02:54.431736] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T20:02:54.814922] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-27T20:02:55.123793] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T20:02:55.614939] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-27T20:02:55.823245] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T20:02:56.421689] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-27T20:02:56.426915] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T20:02:57.214987] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-27T20:02:57.342892] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:02:58.015019] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-27T20:02:58.777612] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T20:02:58.814907] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-27T20:02:59.487628] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:02:59.614926] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-27T20:02:59.983578] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T20:03:00.414923] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-27T20:03:00.655803] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T20:03:01.214947] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-27T20:03:01.841166] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T20:03:02.014924] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-27T20:03:02.326404] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T20:03:02.629615] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T20:03:02.814950] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-27T20:03:03.614948] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-27T20:03:04.415020] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-27T20:03:04.549853] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T20:03:04.596597] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T20:03:05.214933] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-27T20:03:05.381029] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T20:03:06.014997] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-27T20:03:06.435971] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-27T20:03:06.441142] [INFO ] [REMOTE ] MTW: Full fetch complete (38177 records). [2025-10-27T20:03:06.441296] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-27T20:03:06.821980] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-27T20:03:06.824288] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-27T20:03:06.824494] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-27T20:03:06.825436] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-27T20:03:06.826327] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-27T20:03:06.858824] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T20:03:06.862625] [DEBUG] [LOCAL ] MTW: Trimmed 38177 records to 26142 (keeping 200 days of data) [2025-10-27T20:03:07.013293] [DEBUG] [LOCAL ] MTW: Primary data saved (26142 records). [2025-10-27T20:03:07.013459] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-27T20:03:07.013806] [INFO ] [MAIN ] Update Progress: 1421/2366 symbols completed. MTW took 41.3s. Estimated remaining: 2h 1m 45s. Rate: 7.8 symbols/min [2025-10-27T20:03:07.187905] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:07.208137] [DEBUG] [LOCAL ] MUC: Loaded 20880 existing records from primary storage. [2025-10-27T20:03:07.208362] [INFO ] [MAIN ] MUC: Loaded 20880 existing records. [2025-10-27T20:03:07.383146] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:07.383357] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-27T20:03:07.383402] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-27T20:03:07.383696] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-27T20:03:07.383754] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-27T20:03:07.620214] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-27T20:03:07.731807] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:08.111516] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T20:03:08.281097] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T20:03:08.414902] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-27T20:03:09.214952] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-27T20:03:10.014944] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-27T20:03:10.071167] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T20:03:10.105263] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T20:03:10.814939] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-27T20:03:11.125273] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:03:11.463191] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T20:03:11.614942] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-27T20:03:12.279507] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T20:03:12.414984] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-27T20:03:13.214950] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-27T20:03:14.014934] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-27T20:03:14.235604] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T20:03:14.291101] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:03:14.815103] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-27T20:03:14.815483] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:03:15.476013] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T20:03:15.479692] [INFO ] [REMOTE ] MTX: Full fetch complete (31374 records). [2025-10-27T20:03:15.479770] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-27T20:03:15.625080] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-27T20:03:15.842010] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-27T20:03:15.842084] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-27T20:03:15.842713] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-27T20:03:15.842774] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-27T20:03:15.843451] [DEBUG] [LOCAL ] MTX: Trimmed 31374 records to 22279 (keeping 200 days of data) [2025-10-27T20:03:15.974440] [DEBUG] [LOCAL ] MTX: Primary data saved (22279 records). [2025-10-27T20:03:15.974564] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-27T20:03:15.974638] [INFO ] [MAIN ] Update Progress: 1422/2366 symbols completed. MTX took 32.6s. Estimated remaining: 2h 1m 38s. Rate: 7.8 symbols/min [2025-10-27T20:03:16.142375] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:16.155602] [DEBUG] [LOCAL ] MUE: Loaded 12306 existing records from primary storage. [2025-10-27T20:03:16.155843] [INFO ] [MAIN ] MUE: Loaded 12306 existing records. [2025-10-27T20:03:16.326934] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:16.327134] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-27T20:03:16.327179] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-27T20:03:16.327347] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-27T20:03:16.327402] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-27T20:03:16.421397] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-27T20:03:16.676975] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:17.022506] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:03:17.055615] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T20:03:17.214929] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-27T20:03:18.014997] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-27T20:03:18.791822] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T20:03:18.800097] [INFO ] [REMOTE ] MTZ: Full fetch complete (63561 records). [2025-10-27T20:03:18.800205] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-27T20:03:18.820988] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-27T20:03:19.197588] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-27T20:03:19.197772] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-27T20:03:19.198890] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-27T20:03:19.198992] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-27T20:03:19.212984] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T20:03:19.217734] [DEBUG] [LOCAL ] MTZ: Trimmed 63561 records to 42571 (keeping 200 days of data) [2025-10-27T20:03:19.472559] [DEBUG] [LOCAL ] MTZ: Primary data saved (42571 records). [2025-10-27T20:03:19.472808] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-27T20:03:19.473485] [INFO ] [MAIN ] Update Progress: 1423/2366 symbols completed. MTZ took 28.6s. Estimated remaining: 2h 1m 27s. Rate: 7.8 symbols/min [2025-10-27T20:03:19.638490] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-27T20:03:19.641898] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:19.696387] [DEBUG] [LOCAL ] MUFG: Loaded 53183 existing records from primary storage. [2025-10-27T20:03:19.696784] [INFO ] [MAIN ] MUFG: Loaded 53183 existing records. [2025-10-27T20:03:19.848892] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T20:03:19.911535] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:19.911851] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-27T20:03:19.911912] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-27T20:03:19.912687] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-27T20:03:19.912747] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-27T20:03:20.281249] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:20.291631] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:03:20.414991] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-27T20:03:21.214941] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-27T20:03:21.352382] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T20:03:21.355313] [INFO ] [REMOTE ] MUA: Full fetch complete (18183 records). [2025-10-27T20:03:21.355427] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-27T20:03:21.729039] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-27T20:03:21.729129] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-27T20:03:21.729576] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-27T20:03:21.729616] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-27T20:03:21.730211] [DEBUG] [LOCAL ] MUA: Trimmed 18183 records to 11426 (keeping 200 days of data) [2025-10-27T20:03:21.804907] [DEBUG] [LOCAL ] MUA: Primary data saved (11426 records). [2025-10-27T20:03:21.805098] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-27T20:03:21.805412] [INFO ] [MAIN ] Update Progress: 1424/2366 symbols completed. MUA took 30.5s. Estimated remaining: 2h 1m 16s. Rate: 7.8 symbols/min [2025-10-27T20:03:21.979315] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:21.985587] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T20:03:22.003743] [DEBUG] [LOCAL ] MUJ: Loaded 13994 existing records from primary storage. [2025-10-27T20:03:22.003980] [INFO ] [MAIN ] MUJ: Loaded 13994 existing records. [2025-10-27T20:03:22.023990] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-27T20:03:22.187093] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:22.187290] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-27T20:03:22.187336] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-27T20:03:22.187499] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-27T20:03:22.187537] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-27T20:03:22.534252] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:22.758738] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T20:03:22.814957] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-27T20:03:23.614910] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-27T20:03:23.896199] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:03:24.383242] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T20:03:24.414935] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-27T20:03:25.214954] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-27T20:03:25.336929] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:03:25.670763] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T20:03:26.014954] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-27T20:03:26.814993] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-27T20:03:26.883217] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:03:27.614924] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-27T20:03:28.414979] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-27T20:03:28.503911] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T20:03:28.576125] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T20:03:29.214921] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-27T20:03:29.458948] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T20:03:30.014946] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-27T20:03:30.088607] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T20:03:30.814944] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-27T20:03:31.114044] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T20:03:31.614992] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-27T20:03:32.132868] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T20:03:32.414915] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-27T20:03:32.445913] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T20:03:33.214936] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-27T20:03:33.238441] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T20:03:34.015010] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-27T20:03:34.404186] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T20:03:34.409197] [INFO ] [REMOTE ] MUC: Full fetch complete (29482 records). [2025-10-27T20:03:34.409325] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-27T20:03:34.820448] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-27T20:03:34.891877] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T20:03:34.892494] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-27T20:03:34.895234] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-27T20:03:34.896736] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-27T20:03:34.896860] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-27T20:03:34.897727] [DEBUG] [LOCAL ] MUC: Trimmed 29482 records to 20369 (keeping 200 days of data) [2025-10-27T20:03:35.017290] [DEBUG] [LOCAL ] MUC: Primary data saved (20369 records). [2025-10-27T20:03:35.017418] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-27T20:03:35.017493] [INFO ] [MAIN ] Update Progress: 1425/2366 symbols completed. MUC took 28.0s. Estimated remaining: 2h 1m 12s. Rate: 7.8 symbols/min [2025-10-27T20:03:35.230844] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:35.281008] [DEBUG] [LOCAL ] MUR: Loaded 53620 existing records from primary storage. [2025-10-27T20:03:35.281334] [INFO ] [MAIN ] MUR: Loaded 53620 existing records. [2025-10-27T20:03:35.464398] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:35.464567] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-27T20:03:35.464616] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-27T20:03:35.464822] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-27T20:03:35.464874] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-27T20:03:35.627261] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-27T20:03:35.843353] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:36.414913] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-27T20:03:36.560895] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:03:36.841678] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T20:03:37.214931] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-27T20:03:37.820875] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T20:03:38.014935] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-27T20:03:38.814947] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-27T20:03:39.110665] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:03:39.614928] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-27T20:03:39.772572] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T20:03:39.805949] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T20:03:40.414929] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-27T20:03:41.089893] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T20:03:41.214910] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-27T20:03:41.676095] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T20:03:41.855432] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T20:03:41.858181] [INFO ] [REMOTE ] MUE: Full fetch complete (15909 records). [2025-10-27T20:03:41.858252] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-27T20:03:42.015166] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-27T20:03:42.241566] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-27T20:03:42.241679] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-27T20:03:42.242079] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-27T20:03:42.242142] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-27T20:03:42.242769] [DEBUG] [LOCAL ] MUE: Trimmed 15909 records to 11990 (keeping 200 days of data) [2025-10-27T20:03:42.312487] [DEBUG] [LOCAL ] MUE: Primary data saved (11990 records). [2025-10-27T20:03:42.312612] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-27T20:03:42.312712] [INFO ] [MAIN ] Update Progress: 1426/2366 symbols completed. MUE took 26.3s. Estimated remaining: 2h 1m 4s. Rate: 7.8 symbols/min [2025-10-27T20:03:42.479376] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:42.502566] [DEBUG] [LOCAL ] MUSA: Loaded 24946 existing records from primary storage. [2025-10-27T20:03:42.502864] [INFO ] [MAIN ] MUSA: Loaded 24946 existing records. [2025-10-27T20:03:42.676303] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:42.676494] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-27T20:03:42.676539] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-27T20:03:42.676781] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-27T20:03:42.676837] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-27T20:03:42.815290] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-27T20:03:43.023057] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:43.488411] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T20:03:43.614912] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-27T20:03:44.414928] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-27T20:03:44.587019] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T20:03:44.849443] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T20:03:45.214905] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-27T20:03:45.520373] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T20:03:46.014958] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-27T20:03:46.533245] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T20:03:46.814976] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-27T20:03:46.837426] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:03:47.614984] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-27T20:03:48.144992] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T20:03:48.414909] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-27T20:03:48.513093] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T20:03:49.214973] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-27T20:03:49.308669] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T20:03:50.014997] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-27T20:03:50.113142] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T20:03:50.815000] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-27T20:03:51.614958] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-27T20:03:51.683361] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T20:03:51.972833] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T20:03:52.414968] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-27T20:03:52.695330] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:03:53.214918] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-27T20:03:53.610382] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T20:03:53.707319] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T20:03:54.015004] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-27T20:03:54.814980] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-27T20:03:55.370718] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T20:03:55.442282] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T20:03:55.614970] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-27T20:03:56.414952] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-27T20:03:56.647447] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T20:03:56.650683] [INFO ] [REMOTE ] MUJ: Full fetch complete (19346 records). [2025-10-27T20:03:56.650808] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-27T20:03:57.046131] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-27T20:03:57.046246] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-27T20:03:57.046837] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-27T20:03:57.046905] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-27T20:03:57.047458] [DEBUG] [LOCAL ] MUJ: Trimmed 19346 records to 13614 (keeping 200 days of data) [2025-10-27T20:03:57.134999] [DEBUG] [LOCAL ] MUJ: Primary data saved (13614 records). [2025-10-27T20:03:57.135150] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-27T20:03:57.135242] [INFO ] [MAIN ] Update Progress: 1427/2366 symbols completed. MUJ took 35.3s. Estimated remaining: 2h 1m 1s. Rate: 7.8 symbols/min [2025-10-27T20:03:57.220110] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-27T20:03:57.326339] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:57.326506] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-27T20:03:57.326544] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-27T20:03:57.326699] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-27T20:03:57.326754] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-27T20:03:57.326797] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-27T20:03:57.326830] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-27T20:03:57.743168] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:58.020078] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-27T20:03:58.039045] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T20:03:58.282635] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:03:58.282987] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-27T20:03:58.283078] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:03:58.283125] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-27T20:03:58.283185] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:03:58.283256] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-27T20:03:58.283319] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-27T20:03:58.283354] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-27T20:03:58.283393] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-27T20:03:58.283445] [INFO ] [MAIN ] Update Progress: 1428/2366 symbols completed. MUSE took 1.1s. Estimated remaining: 2h 0m 49s. Rate: 7.8 symbols/min [2025-10-27T20:03:58.454027] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:03:58.496715] [DEBUG] [LOCAL ] MUX: Loaded 44548 existing records from primary storage. [2025-10-27T20:03:58.497002] [INFO ] [MAIN ] MUX: Loaded 44548 existing records. [2025-10-27T20:03:58.617294] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:03:58.706089] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:03:58.706305] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-27T20:03:58.706368] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-27T20:03:58.706701] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-27T20:03:58.706763] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-27T20:03:58.820004] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-27T20:03:59.072250] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:03:59.614912] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-27T20:03:59.876442] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:04:00.414945] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-27T20:04:01.142941] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T20:04:01.214939] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-27T20:04:01.545542] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T20:04:02.014961] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-27T20:04:02.171438] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T20:04:02.814925] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-27T20:04:03.174803] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T20:04:03.614943] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-27T20:04:04.414937] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-27T20:04:04.456843] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T20:04:04.467460] [INFO ] [REMOTE ] MUFG: Full fetch complete (75874 records). [2025-10-27T20:04:04.467803] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-27T20:04:04.619686] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T20:04:04.919304] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-27T20:04:04.919380] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-27T20:04:04.920403] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-27T20:04:04.920474] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-27T20:04:04.921829] [DEBUG] [LOCAL ] MUFG: Trimmed 75874 records to 52387 (keeping 200 days of data) [2025-10-27T20:04:05.223487] [DEBUG] [LOCAL ] MUFG: Primary data saved (52387 records). [2025-10-27T20:04:05.223600] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-27T20:04:05.223377] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-27T20:04:05.225074] [INFO ] [MAIN ] Update Progress: 1429/2366 symbols completed. MUFG took 45.8s. Estimated remaining: 2h 0m 40s. Rate: 7.8 symbols/min [2025-10-27T20:04:05.398699] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:05.413771] [DEBUG] [LOCAL ] MVF: Loaded 12890 existing records from primary storage. [2025-10-27T20:04:05.414032] [INFO ] [MAIN ] MVF: Loaded 12890 existing records. [2025-10-27T20:04:05.598281] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:05.598428] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-27T20:04:05.598475] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-27T20:04:05.598637] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-27T20:04:05.598718] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-27T20:04:05.971455] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:06.014902] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-27T20:04:06.156112] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T20:04:06.688629] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:04:06.814927] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-27T20:04:06.896786] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:04:06.901398] [INFO ] [REMOTE ] MUSA: Full fetch complete (35746 records). [2025-10-27T20:04:06.901483] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-27T20:04:07.268291] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-27T20:04:07.268373] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-27T20:04:07.269109] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-27T20:04:07.269169] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-27T20:04:07.269952] [DEBUG] [LOCAL ] MUSA: Trimmed 35746 records to 24530 (keeping 200 days of data) [2025-10-27T20:04:07.418035] [DEBUG] [LOCAL ] MUSA: Primary data saved (24530 records). [2025-10-27T20:04:07.418164] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-27T20:04:07.418243] [INFO ] [MAIN ] Update Progress: 1430/2366 symbols completed. MUSA took 25.1s. Estimated remaining: 2h 0m 29s. Rate: 7.8 symbols/min [2025-10-27T20:04:07.588494] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:07.599307] [DEBUG] [LOCAL ] MVO: Loaded 9169 existing records from primary storage. [2025-10-27T20:04:07.599532] [INFO ] [MAIN ] MVO: Loaded 9169 existing records. [2025-10-27T20:04:07.620072] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-27T20:04:07.774544] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:07.774789] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-27T20:04:07.774837] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-27T20:04:07.774978] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-27T20:04:07.775014] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-27T20:04:08.125702] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:08.287268] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T20:04:08.415010] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-27T20:04:09.214926] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-27T20:04:09.268428] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T20:04:09.289935] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:04:10.014996] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-27T20:04:10.197718] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T20:04:10.684726] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T20:04:10.814926] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-27T20:04:11.614997] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-27T20:04:12.069981] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T20:04:12.079992] [INFO ] [REMOTE ] MUR: Full fetch complete (76792 records). [2025-10-27T20:04:12.080129] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-27T20:04:12.420056] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-27T20:04:12.470822] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-27T20:04:12.470950] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-27T20:04:12.472062] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-27T20:04:12.472143] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-27T20:04:12.480175] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T20:04:12.484000] [DEBUG] [LOCAL ] MUR: Trimmed 76792 records to 52812 (keeping 200 days of data) [2025-10-27T20:04:12.848324] [DEBUG] [LOCAL ] MUR: Primary data saved (52812 records). [2025-10-27T20:04:12.848531] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-27T20:04:12.848635] [INFO ] [MAIN ] Update Progress: 1431/2366 symbols completed. MUR took 37.8s. Estimated remaining: 2h 0m 20s. Rate: 7.8 symbols/min [2025-10-27T20:04:13.028328] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:13.041632] [DEBUG] [LOCAL ] MVT: Loaded 9894 existing records from primary storage. [2025-10-27T20:04:13.041950] [INFO ] [MAIN ] MVT: Loaded 9894 existing records. [2025-10-27T20:04:13.166979] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T20:04:13.221326] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-27T20:04:13.258394] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:13.258821] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-27T20:04:13.258882] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-27T20:04:13.259054] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-27T20:04:13.259112] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-27T20:04:13.685419] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:14.003164] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:04:14.014910] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-27T20:04:14.457851] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T20:04:14.814973] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-27T20:04:15.615051] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-27T20:04:15.898304] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T20:04:16.414949] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-27T20:04:16.568831] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T20:04:17.192913] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:04:17.214914] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-27T20:04:17.678429] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T20:04:18.014990] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-27T20:04:18.694939] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T20:04:18.814923] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-27T20:04:19.198730] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T20:04:19.614988] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-27T20:04:20.336926] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T20:04:20.414922] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-27T20:04:20.917529] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T20:04:21.214973] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-27T20:04:21.892475] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T20:04:22.014976] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-27T20:04:22.814962] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-27T20:04:23.615749] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-27T20:04:23.615596] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:04:23.616728] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:04:24.414955] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-27T20:04:24.465523] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T20:04:24.886232] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T20:04:25.214983] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-27T20:04:26.014968] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-27T20:04:26.470282] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T20:04:26.814984] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-27T20:04:26.933810] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T20:04:27.614975] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-27T20:04:28.357267] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-27T20:04:28.415019] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-27T20:04:28.618637] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T20:04:28.956132] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T20:04:29.214950] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-27T20:04:30.014983] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-27T20:04:30.555337] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T20:04:30.814905] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-27T20:04:31.063457] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T20:04:31.073182] [INFO ] [REMOTE ] MUX: Full fetch complete (61847 records). [2025-10-27T20:04:31.073291] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-27T20:04:31.452523] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-27T20:04:31.452613] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-27T20:04:31.453556] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-27T20:04:31.453614] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-27T20:04:31.454926] [DEBUG] [LOCAL ] MUX: Trimmed 61847 records to 43909 (keeping 200 days of data) [2025-10-27T20:04:31.617368] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-27T20:04:31.680103] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T20:04:31.724308] [DEBUG] [LOCAL ] MUX: Primary data saved (43909 records). [2025-10-27T20:04:31.724437] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-27T20:04:31.724514] [INFO ] [MAIN ] Update Progress: 1432/2366 symbols completed. MUX took 33.4s. Estimated remaining: 2h 0m 19s. Rate: 7.8 symbols/min [2025-10-27T20:04:31.892063] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:31.932819] [DEBUG] [LOCAL ] MWA: Loaded 46357 existing records from primary storage. [2025-10-27T20:04:31.933104] [INFO ] [MAIN ] MWA: Loaded 46357 existing records. [2025-10-27T20:04:32.106855] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:32.107108] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-27T20:04:32.107156] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-27T20:04:32.107447] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-27T20:04:32.107507] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-27T20:04:32.399789] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T20:04:32.424693] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-27T20:04:32.465124] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:32.996557] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T20:04:33.214940] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-27T20:04:33.749812] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T20:04:34.014949] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-27T20:04:34.817346] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-27T20:04:34.819527] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:04:35.614960] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-27T20:04:35.783062] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:04:35.786159] [INFO ] [REMOTE ] MVF: Full fetch complete (18580 records). [2025-10-27T20:04:35.786243] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-27T20:04:36.149082] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-27T20:04:36.149163] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-27T20:04:36.149551] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-27T20:04:36.149589] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-27T20:04:36.150222] [DEBUG] [LOCAL ] MVF: Trimmed 18580 records to 12539 (keeping 200 days of data) [2025-10-27T20:04:36.223077] [DEBUG] [LOCAL ] MVF: Primary data saved (12539 records). [2025-10-27T20:04:36.223208] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-27T20:04:36.223283] [INFO ] [MAIN ] Update Progress: 1433/2366 symbols completed. MVF took 31.0s. Estimated remaining: 2h 0m 10s. Rate: 7.8 symbols/min [2025-10-27T20:04:36.386083] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:36.407318] [DEBUG] [LOCAL ] MX: Loaded 22536 existing records from primary storage. [2025-10-27T20:04:36.407548] [INFO ] [MAIN ] MX: Loaded 22536 existing records. [2025-10-27T20:04:36.420204] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-27T20:04:36.589529] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:36.589766] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-27T20:04:36.589815] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-27T20:04:36.589978] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-27T20:04:36.590015] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-27T20:04:36.875748] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T20:04:36.899449] [INFO ] [REMOTE ] MVO: Full fetch complete (14678 records). [2025-10-27T20:04:36.917700] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-27T20:04:37.025025] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:37.220037] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-27T20:04:37.321064] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-27T20:04:37.321142] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-27T20:04:37.321487] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-27T20:04:37.321525] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-27T20:04:37.322025] [DEBUG] [LOCAL ] MVO: Trimmed 14678 records to 8935 (keeping 200 days of data) [2025-10-27T20:04:37.374084] [DEBUG] [LOCAL ] MVO: Primary data saved (8935 records). [2025-10-27T20:04:37.374221] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-27T20:04:37.374303] [INFO ] [MAIN ] Update Progress: 1434/2366 symbols completed. MVO took 30.0s. Estimated remaining: 1h 59m 58s. Rate: 7.8 symbols/min [2025-10-27T20:04:37.553774] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:37.554062] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-27T20:04:37.554204] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-27T20:04:37.554424] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-27T20:04:37.554483] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-27T20:04:37.554529] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-27T20:04:37.554679] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-27T20:04:37.933414] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T20:04:37.963279] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:38.014921] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-27T20:04:38.199416] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T20:04:38.814915] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-27T20:04:39.284744] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T20:04:39.512949] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:04:39.614962] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-27T20:04:40.414959] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-27T20:04:40.445143] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T20:04:41.214964] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-27T20:04:41.453261] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T20:04:41.955282] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T20:04:41.958369] [INFO ] [REMOTE ] MVT: Full fetch complete (13602 records). [2025-10-27T20:04:41.958472] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-27T20:04:42.020153] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-27T20:04:42.329351] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-27T20:04:42.329420] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-27T20:04:42.329684] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-27T20:04:42.329745] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-27T20:04:42.330192] [DEBUG] [LOCAL ] MVT: Trimmed 13602 records to 9507 (keeping 200 days of data) [2025-10-27T20:04:42.384389] [DEBUG] [LOCAL ] MVT: Primary data saved (9507 records). [2025-10-27T20:04:42.384486] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-27T20:04:42.384557] [INFO ] [MAIN ] Update Progress: 1435/2366 symbols completed. MVT took 29.5s. Estimated remaining: 1h 59m 48s. Rate: 7.8 symbols/min [2025-10-27T20:04:42.547327] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:04:42.554666] [DEBUG] [LOCAL ] MXF: Loaded 5612 existing records from primary storage. [2025-10-27T20:04:42.554830] [INFO ] [MAIN ] MXF: Loaded 5612 existing records. [2025-10-27T20:04:42.726475] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:04:42.726720] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-27T20:04:42.726778] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-27T20:04:42.726904] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-27T20:04:42.726941] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-27T20:04:42.820462] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-27T20:04:43.072473] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:04:43.087998] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T20:04:43.106132] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-27T20:04:43.614937] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-27T20:04:44.414927] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-27T20:04:44.791724] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T20:04:45.215030] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-27T20:04:46.014980] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-27T20:04:46.052440] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:04:46.119325] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T20:04:46.789478] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T20:04:46.814903] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-27T20:04:47.614958] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-27T20:04:47.741534] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T20:04:48.414937] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-27T20:04:49.116466] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T20:04:49.214963] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-27T20:04:49.400482] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-27T20:04:49.996289] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:04:50.014906] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-27T20:04:50.814974] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-27T20:04:51.019779] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T20:04:51.585902] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T20:04:51.614926] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-27T20:04:52.326434] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T20:04:52.414931] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-27T20:04:52.763460] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T20:04:53.214983] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-27T20:04:54.014923] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-27T20:04:54.428552] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-27T20:04:54.611550] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T20:04:54.815000] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-27T20:04:55.206197] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T20:04:55.614954] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-27T20:04:55.877795] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-27T20:04:56.415002] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-27T20:04:56.843859] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T20:04:57.215002] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-27T20:04:57.649973] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T20:04:58.014958] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-27T20:04:58.814985] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-27T20:04:59.614926] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-27T20:04:59.663870] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T20:04:59.857501] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T20:05:00.076134] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T20:05:00.414966] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-27T20:05:01.214992] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-27T20:05:01.371754] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T20:05:01.375873] [INFO ] [REMOTE ] MX: Full fetch complete (31723 records). [2025-10-27T20:05:01.375974] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-27T20:05:01.739333] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-27T20:05:01.743107] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-27T20:05:01.744053] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-27T20:05:01.744157] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-27T20:05:01.743303] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T20:05:01.746798] [DEBUG] [LOCAL ] MX: Trimmed 31723 records to 22033 (keeping 200 days of data) [2025-10-27T20:05:01.873610] [DEBUG] [LOCAL ] MX: Primary data saved (22033 records). [2025-10-27T20:05:01.873772] [INFO ] [MAIN ] MX: Full history saved. [2025-10-27T20:05:01.873877] [INFO ] [MAIN ] Update Progress: 1436/2366 symbols completed. MX took 25.7s. Estimated remaining: 1h 59m 48s. Rate: 7.8 symbols/min [2025-10-27T20:05:02.024588] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-27T20:05:02.051335] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:02.067328] [DEBUG] [LOCAL ] MYD: Loaded 13321 existing records from primary storage. [2025-10-27T20:05:02.067727] [INFO ] [MAIN ] MYD: Loaded 13321 existing records. [2025-10-27T20:05:02.250548] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:02.250771] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-27T20:05:02.250821] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-27T20:05:02.250966] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-27T20:05:02.251004] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-27T20:05:02.605445] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T20:05:02.625198] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:02.814977] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-27T20:05:03.272632] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T20:05:03.614950] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-27T20:05:04.155924] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T20:05:04.157235] [INFO ] [REMOTE ] MXE: Full fetch complete (2503 records). [2025-10-27T20:05:04.157329] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-27T20:05:04.362707] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T20:05:04.362889] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:05:04.362936] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:05:04.362977] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-27T20:05:04.363037] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-27T20:05:04.363073] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-27T20:05:04.363113] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-27T20:05:04.363167] [INFO ] [MAIN ] Update Progress: 1437/2366 symbols completed. MXE took 27.0s. Estimated remaining: 1h 59m 37s. Rate: 7.8 symbols/min [2025-10-27T20:05:04.414962] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-27T20:05:05.214972] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-27T20:05:05.266249] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T20:05:05.540235] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T20:05:06.014959] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-27T20:05:06.814989] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-27T20:05:06.913400] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T20:05:07.614979] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-27T20:05:08.414917] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-27T20:05:08.465275] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T20:05:08.566741] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T20:05:08.915125] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T20:05:08.917569] [INFO ] [REMOTE ] MXF: Full fetch complete (9695 records). [2025-10-27T20:05:08.917691] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-27T20:05:09.232004] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-27T20:05:09.309939] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-27T20:05:09.310076] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-27T20:05:09.310314] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-27T20:05:09.310353] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-27T20:05:09.310783] [DEBUG] [LOCAL ] MXF: Trimmed 9695 records to 5454 (keeping 200 days of data) [2025-10-27T20:05:09.343058] [DEBUG] [LOCAL ] MXF: Primary data saved (5454 records). [2025-10-27T20:05:09.343179] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-27T20:05:09.343256] [INFO ] [MAIN ] Update Progress: 1438/2366 symbols completed. MXF took 27.0s. Estimated remaining: 1h 59m 27s. Rate: 7.8 symbols/min [2025-10-27T20:05:10.015031] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-27T20:05:10.227485] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T20:05:10.814962] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-27T20:05:11.162940] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-27T20:05:11.573278] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T20:05:11.614934] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-27T20:05:12.151713] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T20:05:12.414998] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-27T20:05:13.215037] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-27T20:05:13.324177] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T20:05:14.014988] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-27T20:05:14.646711] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T20:05:14.689527] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T20:05:14.814993] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-27T20:05:15.615030] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-27T20:05:15.722360] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T20:05:16.414961] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-27T20:05:17.052461] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T20:05:17.214570] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T20:05:17.217791] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-27T20:05:17.218075] [INFO ] [REMOTE ] MYD: Full fetch complete (20027 records). [2025-10-27T20:05:17.218959] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-27T20:05:17.593003] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-27T20:05:17.593076] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-27T20:05:17.593480] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-27T20:05:17.593517] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-27T20:05:17.594079] [DEBUG] [LOCAL ] MYD: Trimmed 20027 records to 13008 (keeping 200 days of data) [2025-10-27T20:05:17.669550] [DEBUG] [LOCAL ] MYD: Primary data saved (13008 records). [2025-10-27T20:05:17.669709] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-27T20:05:17.669811] [INFO ] [MAIN ] Update Progress: 1439/2366 symbols completed. MYD took 15.8s. Estimated remaining: 1h 59m 20s. Rate: 7.8 symbols/min [2025-10-27T20:05:18.405370] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T20:05:18.414093] [INFO ] [REMOTE ] MWA: Full fetch complete (68093 records). [2025-10-27T20:05:18.414243] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-27T20:05:18.795723] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-27T20:05:18.795815] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-27T20:05:18.796813] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-27T20:05:18.796876] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-27T20:05:18.798235] [DEBUG] [LOCAL ] MWA: Trimmed 68093 records to 45519 (keeping 200 days of data) [2025-10-27T20:05:19.068568] [DEBUG] [LOCAL ] MWA: Primary data saved (45519 records). [2025-10-27T20:05:19.068729] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-27T20:05:19.068819] [INFO ] [MAIN ] Update Progress: 1440/2366 symbols completed. MWA took 47.3s. Estimated remaining: 1h 59m 8s. Rate: 7.8 symbols/min [2025-10-27T20:05:19.685681] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:19.815661] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:19.816767] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:19.840519] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:19.856468] [DEBUG] [LOCAL ] MYN: Loaded 10114 existing records from primary storage. [2025-10-27T20:05:19.856903] [INFO ] [MAIN ] MYN: Loaded 10114 existing records. [2025-10-27T20:05:19.916943] [DEBUG] [LOCAL ] MYI: Loaded 19678 existing records from primary storage. [2025-10-27T20:05:19.961380] [INFO ] [MAIN ] MYI: Loaded 19678 existing records. [2025-10-27T20:05:19.994440] [DEBUG] [LOCAL ] MYE: Loaded 24336 existing records from primary storage. [2025-10-27T20:05:20.057361] [INFO ] [MAIN ] MYE: Loaded 24336 existing records. [2025-10-27T20:05:20.102192] [DEBUG] [LOCAL ] NABL: Loaded 39285 existing records from primary storage. [2025-10-27T20:05:20.215223] [INFO ] [MAIN ] NABL: Loaded 39285 existing records. [2025-10-27T20:05:20.281853] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:20.448897] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-27T20:05:20.492386] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:20.497771] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-27T20:05:20.503119] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-27T20:05:20.523169] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-27T20:05:20.535380] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-27T20:05:20.535273] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-27T20:05:20.557016] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-27T20:05:20.567580] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-27T20:05:20.752067] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:20.809886] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-27T20:05:20.791130] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:20.815632] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-27T20:05:20.826235] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-27T20:05:20.892353] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-27T20:05:20.919740] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-27T20:05:20.965375] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-27T20:05:20.959850] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-27T20:05:20.965555] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-27T20:05:21.724272] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:21.807170] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-27T20:05:22.110208] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:22.120884] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:22.115757] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-27T20:05:22.121144] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-27T20:05:22.158738] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:22.159026] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-27T20:05:22.759074] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T20:05:22.762128] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-27T20:05:23.122221] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T20:05:23.126433] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-27T20:05:23.338296] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T20:05:23.343240] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-27T20:05:23.636778] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:05:23.643968] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-27T20:05:23.904391] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T20:05:24.164088] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T20:05:24.414949] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-27T20:05:25.214922] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-27T20:05:25.258841] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T20:05:25.318310] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T20:05:25.339749] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T20:05:25.941813] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T20:05:26.014910] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-27T20:05:26.814971] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-27T20:05:26.834668] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:05:27.614991] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-27T20:05:28.178850] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T20:05:28.414972] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-27T20:05:28.879292] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T20:05:28.953885] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:05:29.214989] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-27T20:05:30.014953] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-27T20:05:30.640818] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T20:05:30.814947] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-27T20:05:30.827839] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T20:05:31.366006] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T20:05:31.614952] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-27T20:05:32.414976] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-27T20:05:32.621315] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T20:05:33.214948] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-27T20:05:33.424687] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T20:05:34.015004] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-27T20:05:34.810663] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T20:05:34.819905] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-27T20:05:35.079236] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:05:35.465686] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T20:05:35.614994] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-27T20:05:36.414929] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-27T20:05:36.613937] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T20:05:37.214947] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-27T20:05:37.313156] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T20:05:38.014947] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-27T20:05:38.526024] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:05:38.814953] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-27T20:05:38.826854] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T20:05:39.614910] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-27T20:05:39.709288] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T20:05:40.414934] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-27T20:05:40.440157] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T20:05:40.951870] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T20:05:41.214944] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-27T20:05:41.961376] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T20:05:42.014949] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-27T20:05:42.620332] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T20:05:42.814943] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-27T20:05:43.614999] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-27T20:05:44.244739] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:05:44.247306] [INFO ] [REMOTE ] MYN: Full fetch complete (15000 records). [2025-10-27T20:05:44.247499] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-27T20:05:44.363174] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T20:05:44.420811] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-27T20:05:44.641090] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-27T20:05:44.641167] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-27T20:05:44.641580] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-27T20:05:44.641628] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-27T20:05:44.642163] [DEBUG] [LOCAL ] MYN: Trimmed 15000 records to 9807 (keeping 200 days of data) [2025-10-27T20:05:44.699159] [DEBUG] [LOCAL ] MYN: Primary data saved (9807 records). [2025-10-27T20:05:44.699284] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-27T20:05:44.699361] [INFO ] [MAIN ] Update Progress: 1441/2366 symbols completed. MYN took 25.6s. Estimated remaining: 1h 59m 12s. Rate: 7.8 symbols/min [2025-10-27T20:05:44.867188] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:44.890586] [DEBUG] [LOCAL ] NAC: Loaded 24900 existing records from primary storage. [2025-10-27T20:05:44.890870] [INFO ] [MAIN ] NAC: Loaded 24900 existing records. [2025-10-27T20:05:45.061143] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:45.061375] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-27T20:05:45.061435] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-27T20:05:45.061755] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-27T20:05:45.061811] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-27T20:05:45.231478] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-27T20:05:45.434110] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:45.466545] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T20:05:46.014947] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-27T20:05:46.053998] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T20:05:46.814957] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-27T20:05:47.044753] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T20:05:47.614960] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-27T20:05:47.794309] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T20:05:48.399191] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T20:05:48.414906] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-27T20:05:49.215023] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-27T20:05:49.476562] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T20:05:50.014959] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-27T20:05:50.675939] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T20:05:50.683511] [INFO ] [REMOTE ] NABL: Full fetch complete (56801 records). [2025-10-27T20:05:50.683732] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-27T20:05:50.822889] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-27T20:05:51.090823] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-27T20:05:51.091545] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-27T20:05:51.093626] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-27T20:05:51.092491] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:05:51.098146] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-27T20:05:51.098930] [INFO ] [REMOTE ] MYE: Full fetch complete (35977 records). [2025-10-27T20:05:51.099011] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-27T20:05:51.178695] [DEBUG] [LOCAL ] NABL: Trimmed 56801 records to 38498 (keeping 200 days of data) [2025-10-27T20:05:51.620599] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-27T20:05:51.697996] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-27T20:05:51.701076] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-27T20:05:51.716159] [DEBUG] [LOCAL ] NABL: Primary data saved (38498 records). [2025-10-27T20:05:51.716799] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-27T20:05:51.717726] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-27T20:05:51.717829] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-27T20:05:51.718079] [INFO ] [MAIN ] Update Progress: 1442/2366 symbols completed. NABL took 32.6s. Estimated remaining: 1h 59m 4s. Rate: 7.8 symbols/min [2025-10-27T20:05:51.780163] [DEBUG] [LOCAL ] MYE: Trimmed 35977 records to 23771 (keeping 200 days of data) [2025-10-27T20:05:51.780939] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T20:05:52.039755] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:52.075742] [DEBUG] [LOCAL ] MYE: Primary data saved (23771 records). [2025-10-27T20:05:52.075950] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-27T20:05:52.076037] [INFO ] [MAIN ] Update Progress: 1443/2366 symbols completed. MYE took 33.0s. Estimated remaining: 1h 58m 51s. Rate: 7.8 symbols/min [2025-10-27T20:05:52.252095] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:52.263471] [DEBUG] [LOCAL ] NAD: Loaded 33974 existing records from primary storage. [2025-10-27T20:05:52.263907] [INFO ] [MAIN ] NAD: Loaded 33974 existing records. [2025-10-27T20:05:52.371324] [DEBUG] [LOCAL ] NAN: Loaded 8612 existing records from primary storage. [2025-10-27T20:05:52.377351] [INFO ] [MAIN ] NAN: Loaded 8612 existing records. [2025-10-27T20:05:52.424142] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-27T20:05:52.563949] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:52.585666] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-27T20:05:52.608512] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-27T20:05:52.634191] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-27T20:05:52.638036] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-27T20:05:52.637845] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:52.714080] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-27T20:05:52.737337] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-27T20:05:52.741141] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-27T20:05:52.741216] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-27T20:05:53.100113] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T20:05:53.149048] [INFO ] [REMOTE ] MYI: Full fetch complete (29195 records). [2025-10-27T20:05:53.173896] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-27T20:05:53.388121] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:53.415168] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-27T20:05:53.532858] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:53.825147] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-27T20:05:53.825283] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-27T20:05:53.826764] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-27T20:05:53.827847] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-27T20:05:53.827757] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T20:05:53.835381] [DEBUG] [LOCAL ] MYI: Trimmed 29195 records to 19169 (keeping 200 days of data) [2025-10-27T20:05:53.950411] [DEBUG] [LOCAL ] MYI: Primary data saved (19169 records). [2025-10-27T20:05:53.950560] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-27T20:05:53.950637] [INFO ] [MAIN ] Update Progress: 1444/2366 symbols completed. MYI took 34.9s. Estimated remaining: 1h 58m 40s. Rate: 7.8 symbols/min [2025-10-27T20:05:54.022967] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-27T20:05:54.118733] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:05:54.161852] [DEBUG] [LOCAL ] NAT: Loaded 49954 existing records from primary storage. [2025-10-27T20:05:54.162201] [INFO ] [MAIN ] NAT: Loaded 49954 existing records. [2025-10-27T20:05:54.339301] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:05:54.339504] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-27T20:05:54.339551] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-27T20:05:54.339865] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-27T20:05:54.339927] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-27T20:05:54.692674] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:05:54.805208] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T20:05:54.814896] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-27T20:05:54.875918] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T20:05:55.615012] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-27T20:05:55.764390] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T20:05:56.137739] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T20:05:56.414973] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-27T20:05:57.215004] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-27T20:05:57.339359] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T20:05:57.949947] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T20:05:58.014984] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-27T20:05:58.814964] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-27T20:05:59.213019] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:05:59.614986] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-27T20:06:00.127554] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T20:06:00.384598] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:06:00.414899] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-27T20:06:01.215017] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-27T20:06:01.634356] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T20:06:02.015019] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-27T20:06:02.814932] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-27T20:06:02.844892] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T20:06:02.849704] [INFO ] [REMOTE ] NAC: Full fetch complete (35407 records). [2025-10-27T20:06:02.849796] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-27T20:06:03.240610] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-27T20:06:03.240919] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-27T20:06:03.242611] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-27T20:06:03.242833] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-27T20:06:03.244348] [DEBUG] [LOCAL ] NAC: Trimmed 35407 records to 24309 (keeping 200 days of data) [2025-10-27T20:06:03.378274] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-27T20:06:03.450586] [DEBUG] [LOCAL ] NAC: Primary data saved (24309 records). [2025-10-27T20:06:03.450815] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-27T20:06:03.450951] [INFO ] [MAIN ] Update Progress: 1445/2366 symbols completed. NAC took 18.8s. Estimated remaining: 1h 58m 33s. Rate: 7.8 symbols/min [2025-10-27T20:06:03.634315] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-27T20:06:03.638910] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:03.675255] [DEBUG] [LOCAL ] NATL: Loaded 32382 existing records from primary storage. [2025-10-27T20:06:03.675602] [INFO ] [MAIN ] NATL: Loaded 32382 existing records. [2025-10-27T20:06:03.767149] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T20:06:03.874875] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:03.875207] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-27T20:06:03.875268] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-27T20:06:03.875496] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-27T20:06:03.875536] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-27T20:06:04.246992] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:04.414991] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-27T20:06:05.214918] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-27T20:06:05.248034] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T20:06:05.336670] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T20:06:06.014942] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-27T20:06:06.595442] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T20:06:06.814962] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-27T20:06:07.386035] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T20:06:07.614997] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-27T20:06:08.177064] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T20:06:08.414967] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-27T20:06:08.740181] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:06:09.215013] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-27T20:06:10.015032] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-27T20:06:10.129312] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T20:06:10.224275] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T20:06:10.814924] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-27T20:06:11.345701] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T20:06:11.614965] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-27T20:06:12.368744] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T20:06:12.414971] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-27T20:06:12.604011] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T20:06:13.214918] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-27T20:06:13.245400] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T20:06:14.014985] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-27T20:06:14.115552] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T20:06:14.814930] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-27T20:06:14.875755] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T20:06:15.614909] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-27T20:06:15.926798] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T20:06:16.414960] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-27T20:06:17.068009] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T20:06:17.214964] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-27T20:06:18.020096] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-27T20:06:18.036312] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T20:06:18.154674] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T20:06:18.814971] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-27T20:06:19.208491] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T20:06:19.614969] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-27T20:06:20.187320] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T20:06:20.414954] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-27T20:06:20.924890] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T20:06:21.214972] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-27T20:06:21.494141] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:06:21.500459] [INFO ] [REMOTE ] NAD: Full fetch complete (48277 records). [2025-10-27T20:06:21.500613] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-27T20:06:22.015025] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-27T20:06:22.040813] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-27T20:06:22.040932] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-27T20:06:22.042306] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-27T20:06:22.042392] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-27T20:06:22.043941] [DEBUG] [LOCAL ] NAD: Trimmed 48277 records to 33119 (keeping 200 days of data) [2025-10-27T20:06:22.299980] [DEBUG] [LOCAL ] NAD: Primary data saved (33119 records). [2025-10-27T20:06:22.300171] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-27T20:06:22.300300] [INFO ] [MAIN ] Update Progress: 1446/2366 symbols completed. NAD took 30.6s. Estimated remaining: 1h 58m 33s. Rate: 7.8 symbols/min [2025-10-27T20:06:22.507617] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:22.512960] [DEBUG] [LOCAL ] NAZ: Loaded 2708 existing records from primary storage. [2025-10-27T20:06:22.513171] [INFO ] [MAIN ] NAZ: Loaded 2708 existing records. [2025-10-27T20:06:22.662071] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T20:06:22.707382] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:22.709102] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-27T20:06:22.709189] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-27T20:06:22.709442] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-27T20:06:22.709517] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-27T20:06:22.819913] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-27T20:06:22.855997] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T20:06:23.114034] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:23.615000] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-27T20:06:24.233479] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T20:06:24.414948] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-27T20:06:24.824980] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T20:06:25.158832] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T20:06:25.214937] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-27T20:06:25.928320] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:06:26.014949] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-27T20:06:26.569814] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:06:26.572399] [INFO ] [REMOTE ] NAN: Full fetch complete (13558 records). [2025-10-27T20:06:26.572477] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-27T20:06:26.820054] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-27T20:06:26.939383] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-27T20:06:26.939528] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-27T20:06:26.939904] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-27T20:06:26.939964] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-27T20:06:26.940467] [DEBUG] [LOCAL ] NAN: Trimmed 13558 records to 8376 (keeping 200 days of data) [2025-10-27T20:06:26.989997] [DEBUG] [LOCAL ] NAN: Primary data saved (8376 records). [2025-10-27T20:06:26.990111] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-27T20:06:26.990185] [INFO ] [MAIN ] Update Progress: 1447/2366 symbols completed. NAN took 34.9s. Estimated remaining: 1h 58m 23s. Rate: 7.8 symbols/min [2025-10-27T20:06:27.160693] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:27.171886] [DEBUG] [LOCAL ] NBB: Loaded 9144 existing records from primary storage. [2025-10-27T20:06:27.172110] [INFO ] [MAIN ] NBB: Loaded 9144 existing records. [2025-10-27T20:06:27.357101] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:27.357353] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-27T20:06:27.357404] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-27T20:06:27.357572] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-27T20:06:27.357680] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-27T20:06:27.620089] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-27T20:06:27.730899] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:27.746732] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T20:06:27.752214] [INFO ] [REMOTE ] NATL: Full fetch complete (44760 records). [2025-10-27T20:06:27.752315] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-27T20:06:28.168345] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-27T20:06:28.168423] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-27T20:06:28.169374] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-27T20:06:28.169465] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-27T20:06:28.170611] [DEBUG] [LOCAL ] NATL: Trimmed 44760 records to 31608 (keeping 200 days of data) [2025-10-27T20:06:28.358870] [DEBUG] [LOCAL ] NATL: Primary data saved (31608 records). [2025-10-27T20:06:28.359079] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-27T20:06:28.359177] [INFO ] [MAIN ] Update Progress: 1448/2366 symbols completed. NATL took 24.9s. Estimated remaining: 1h 58m 11s. Rate: 7.8 symbols/min [2025-10-27T20:06:28.422380] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-27T20:06:28.531298] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:28.554473] [DEBUG] [LOCAL ] NBHC: Loaded 24147 existing records from primary storage. [2025-10-27T20:06:28.554750] [INFO ] [MAIN ] NBHC: Loaded 24147 existing records. [2025-10-27T20:06:28.724604] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:28.724806] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-27T20:06:28.724852] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-27T20:06:28.725032] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-27T20:06:28.725094] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-27T20:06:29.010673] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:06:29.091417] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:29.118624] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T20:06:29.214929] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-27T20:06:30.014939] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-27T20:06:30.814970] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-27T20:06:30.901499] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T20:06:31.157290] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T20:06:31.471322] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T20:06:31.614942] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-27T20:06:32.063996] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-27T20:06:32.414980] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-27T20:06:33.214938] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-27T20:06:33.386452] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T20:06:33.786807] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:06:34.014940] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-27T20:06:34.814938] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-27T20:06:35.614973] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-27T20:06:35.854430] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T20:06:35.865069] [INFO ] [REMOTE ] NAT: Full fetch complete (72177 records). [2025-10-27T20:06:35.865306] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-27T20:06:35.971105] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T20:06:36.131506] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T20:06:36.287064] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-27T20:06:36.287141] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-27T20:06:36.288206] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-27T20:06:36.288270] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-27T20:06:36.289603] [DEBUG] [LOCAL ] NAT: Trimmed 72177 records to 49154 (keeping 200 days of data) [2025-10-27T20:06:36.446946] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-27T20:06:36.565705] [DEBUG] [LOCAL ] NAT: Primary data saved (49154 records). [2025-10-27T20:06:36.565825] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-27T20:06:36.565899] [INFO ] [MAIN ] Update Progress: 1449/2366 symbols completed. NAT took 42.6s. Estimated remaining: 1h 58m 4s. Rate: 7.8 symbols/min [2025-10-27T20:06:36.747945] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:36.779321] [DEBUG] [LOCAL ] NBR: Loaded 34896 existing records from primary storage. [2025-10-27T20:06:36.779569] [INFO ] [MAIN ] NBR: Loaded 34896 existing records. [2025-10-27T20:06:36.954670] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:36.954911] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-27T20:06:36.954959] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-27T20:06:36.955146] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-27T20:06:36.955203] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-27T20:06:37.217738] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-27T20:06:37.234076] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T20:06:37.311566] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:38.014919] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-27T20:06:38.039413] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:06:38.467794] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T20:06:38.814922] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-27T20:06:39.161413] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-27T20:06:39.614982] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-27T20:06:40.294436] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T20:06:40.414932] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-27T20:06:41.216550] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-27T20:06:41.218630] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T20:06:41.553875] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T20:06:42.014983] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-27T20:06:42.548955] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T20:06:42.814978] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-27T20:06:43.548122] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T20:06:43.614937] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-27T20:06:44.075256] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T20:06:44.414991] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-27T20:06:45.214970] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-27T20:06:45.599962] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T20:06:45.708894] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T20:06:46.015011] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-27T20:06:46.605606] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T20:06:46.814947] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-27T20:06:47.614991] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-27T20:06:47.682742] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T20:06:47.962532] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T20:06:48.414994] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-27T20:06:49.214947] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-27T20:06:49.690273] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T20:06:50.014992] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-27T20:06:50.116208] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T20:06:50.814990] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-27T20:06:51.029359] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T20:06:51.402559] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T20:06:51.403618] [INFO ] [REMOTE ] NAZ: Full fetch complete (4072 records). [2025-10-27T20:06:51.403736] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-27T20:06:51.620108] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-27T20:06:51.775236] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-27T20:06:51.775315] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-27T20:06:51.775487] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-27T20:06:51.775548] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-27T20:06:51.776031] [DEBUG] [LOCAL ] NAZ: Trimmed 4072 records to 2646 (keeping 200 days of data) [2025-10-27T20:06:51.792927] [DEBUG] [LOCAL ] NAZ: Primary data saved (2646 records). [2025-10-27T20:06:51.793023] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-27T20:06:51.793103] [INFO ] [MAIN ] Update Progress: 1450/2366 symbols completed. NAZ took 29.5s. Estimated remaining: 1h 58m 1s. Rate: 7.8 symbols/min [2025-10-27T20:06:51.970270] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:51.993063] [DEBUG] [LOCAL ] NBXG: Loaded 21883 existing records from primary storage. [2025-10-27T20:06:51.993358] [INFO ] [MAIN ] NBXG: Loaded 21883 existing records. [2025-10-27T20:06:52.166578] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:52.166856] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-27T20:06:52.166909] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-27T20:06:52.167068] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-27T20:06:52.167107] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-27T20:06:52.420174] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-27T20:06:52.518406] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:53.026783] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T20:06:53.214954] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-27T20:06:53.664466] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T20:06:54.014971] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-27T20:06:54.272627] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T20:06:54.814921] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-27T20:06:55.144361] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T20:06:55.615000] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-27T20:06:55.940816] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T20:06:56.354520] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T20:06:56.414942] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-27T20:06:56.940219] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:06:56.942415] [INFO ] [REMOTE ] NBB: Full fetch complete (12912 records). [2025-10-27T20:06:56.942484] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-27T20:06:57.220113] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-27T20:06:57.314794] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-27T20:06:57.314885] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-27T20:06:57.315351] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-27T20:06:57.315393] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-27T20:06:57.316048] [DEBUG] [LOCAL ] NBB: Trimmed 12912 records to 8889 (keeping 200 days of data) [2025-10-27T20:06:57.375542] [DEBUG] [LOCAL ] NBB: Primary data saved (8889 records). [2025-10-27T20:06:57.375739] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-27T20:06:57.375840] [INFO ] [MAIN ] Update Progress: 1451/2366 symbols completed. NBB took 30.4s. Estimated remaining: 1h 57m 52s. Rate: 7.8 symbols/min [2025-10-27T20:06:57.564367] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:06:57.568738] [DEBUG] [LOCAL ] NC: Loaded 2014 existing records from primary storage. [2025-10-27T20:06:57.568899] [INFO ] [MAIN ] NC: Loaded 2014 existing records. [2025-10-27T20:06:57.745764] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:06:57.745985] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-27T20:06:57.746037] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-27T20:06:57.746164] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-27T20:06:57.746201] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-27T20:06:58.020159] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-27T20:06:58.122866] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:06:58.362237] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T20:06:58.814942] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-27T20:06:58.857595] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T20:06:59.563712] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:06:59.614928] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-27T20:07:00.414961] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-27T20:07:01.041899] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T20:07:01.214955] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-27T20:07:01.449903] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T20:07:01.686190] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T20:07:02.014999] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-27T20:07:02.814965] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-27T20:07:03.210232] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T20:07:03.291824] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T20:07:03.614992] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-27T20:07:04.414971] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-27T20:07:04.654739] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T20:07:05.214954] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-27T20:07:05.812236] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:07:06.014959] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-27T20:07:06.640112] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T20:07:06.658225] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T20:07:06.664036] [INFO ] [REMOTE ] NBHC: Full fetch complete (33487 records). [2025-10-27T20:07:06.664159] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-27T20:07:06.815063] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-27T20:07:07.035335] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-27T20:07:07.035411] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-27T20:07:07.036132] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-27T20:07:07.036194] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-27T20:07:07.037023] [DEBUG] [LOCAL ] NBHC: Trimmed 33487 records to 23555 (keeping 200 days of data) [2025-10-27T20:07:07.179963] [DEBUG] [LOCAL ] NBHC: Primary data saved (23555 records). [2025-10-27T20:07:07.180101] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-27T20:07:07.180190] [INFO ] [MAIN ] Update Progress: 1452/2366 symbols completed. NBHC took 38.8s. Estimated remaining: 1h 57m 45s. Rate: 7.8 symbols/min [2025-10-27T20:07:07.349501] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:07.360466] [DEBUG] [LOCAL ] NCA: Loaded 9865 existing records from primary storage. [2025-10-27T20:07:07.360665] [INFO ] [MAIN ] NCA: Loaded 9865 existing records. [2025-10-27T20:07:07.467702] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T20:07:07.546337] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:07.546534] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-27T20:07:07.546580] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-27T20:07:07.546826] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-27T20:07:07.546882] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-27T20:07:07.620131] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-27T20:07:07.895401] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:08.414943] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-27T20:07:08.480320] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T20:07:09.214995] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-27T20:07:09.228342] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T20:07:09.672852] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T20:07:10.014935] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-27T20:07:10.814977] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-27T20:07:10.952287] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T20:07:11.253489] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T20:07:11.614992] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-27T20:07:11.930274] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T20:07:12.414979] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-27T20:07:12.810543] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T20:07:13.214936] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-27T20:07:14.014906] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-27T20:07:14.414817] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:07:14.424761] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T20:07:14.814944] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-27T20:07:15.614976] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-27T20:07:15.832893] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T20:07:15.838962] [INFO ] [REMOTE ] NBR: Full fetch complete (49137 records). [2025-10-27T20:07:15.839111] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-27T20:07:16.233710] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-27T20:07:16.233794] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-27T20:07:16.234596] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-27T20:07:16.234636] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-27T20:07:16.235742] [DEBUG] [LOCAL ] NBR: Trimmed 49137 records to 34163 (keeping 200 days of data) [2025-10-27T20:07:16.410542] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:07:16.428903] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-27T20:07:16.460244] [DEBUG] [LOCAL ] NBR: Primary data saved (34163 records). [2025-10-27T20:07:16.460378] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-27T20:07:16.460468] [INFO ] [MAIN ] Update Progress: 1453/2366 symbols completed. NBR took 39.9s. Estimated remaining: 1h 57m 39s. Rate: 7.8 symbols/min [2025-10-27T20:07:16.628755] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:16.651376] [DEBUG] [LOCAL ] NCDL: Loaded 22019 existing records from primary storage. [2025-10-27T20:07:16.651705] [INFO ] [MAIN ] NCDL: Loaded 22019 existing records. [2025-10-27T20:07:16.831052] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:16.831270] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-27T20:07:16.831335] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-27T20:07:16.831519] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-27T20:07:16.831573] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-27T20:07:16.937204] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:07:16.944379] [INFO ] [REMOTE ] NC: Full fetch complete (2735 records). [2025-10-27T20:07:16.944476] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-27T20:07:17.215972] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-27T20:07:17.501253] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:17.576018] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-27T20:07:17.576087] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-27T20:07:17.576188] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-27T20:07:17.576225] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-27T20:07:17.576541] [DEBUG] [LOCAL ] NC: Trimmed 2735 records to 1839 (keeping 200 days of data) [2025-10-27T20:07:17.587909] [DEBUG] [LOCAL ] NC: Primary data saved (1839 records). [2025-10-27T20:07:17.587971] [INFO ] [MAIN ] NC: Full history saved. [2025-10-27T20:07:17.588037] [INFO ] [MAIN ] Update Progress: 1454/2366 symbols completed. NC took 20.2s. Estimated remaining: 1h 57m 27s. Rate: 7.8 symbols/min [2025-10-27T20:07:17.751754] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:17.806287] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-10-27T20:07:17.806880] [INFO ] [MAIN ] NCLH: Loaded 54533 existing records. [2025-10-27T20:07:17.845348] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T20:07:17.990428] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:17.990639] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-27T20:07:17.990719] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-27T20:07:17.990908] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-10-27T20:07:17.990945] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-27T20:07:18.020154] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-27T20:07:18.347176] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:18.814922] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-27T20:07:19.192148] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T20:07:19.519588] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T20:07:19.614911] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-27T20:07:20.414931] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-27T20:07:20.433310] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:07:21.214936] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-27T20:07:21.412333] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T20:07:21.904069] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T20:07:22.014918] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-27T20:07:22.814917] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-27T20:07:22.879306] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T20:07:23.614932] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-27T20:07:24.414944] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-27T20:07:24.546893] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T20:07:24.692781] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:07:24.698156] [INFO ] [REMOTE ] NBXG: Full fetch complete (32341 records). [2025-10-27T20:07:24.698382] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-27T20:07:25.024450] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T20:07:25.111462] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-27T20:07:25.111529] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-27T20:07:25.112225] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-27T20:07:25.112286] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-27T20:07:25.113007] [DEBUG] [LOCAL ] NBXG: Trimmed 32341 records to 21220 (keeping 200 days of data) [2025-10-27T20:07:25.215899] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-27T20:07:25.239897] [DEBUG] [LOCAL ] NBXG: Primary data saved (21220 records). [2025-10-27T20:07:25.240008] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-27T20:07:25.240094] [INFO ] [MAIN ] Update Progress: 1455/2366 symbols completed. NBXG took 33.4s. Estimated remaining: 1h 57m 19s. Rate: 7.8 symbols/min [2025-10-27T20:07:25.404121] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:25.419910] [DEBUG] [LOCAL ] NCV: Loaded 14194 existing records from primary storage. [2025-10-27T20:07:25.420147] [INFO ] [MAIN ] NCV: Loaded 14194 existing records. [2025-10-27T20:07:25.595906] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:25.596127] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-27T20:07:25.596173] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-27T20:07:25.596384] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-27T20:07:25.596423] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-27T20:07:25.934613] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:26.014899] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-27T20:07:26.814943] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-27T20:07:27.114102] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T20:07:27.149369] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T20:07:27.614933] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-27T20:07:27.751035] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:07:28.296957] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T20:07:28.414925] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-27T20:07:29.214944] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-27T20:07:29.268080] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T20:07:29.840948] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T20:07:30.014962] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-27T20:07:30.815041] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-27T20:07:30.827861] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T20:07:31.614960] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-27T20:07:31.710901] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T20:07:32.101534] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T20:07:32.103330] [INFO ] [REMOTE ] NCA: Full fetch complete (14191 records). [2025-10-27T20:07:32.103402] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-27T20:07:32.420083] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-27T20:07:32.494016] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-27T20:07:32.494372] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-27T20:07:32.494959] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-27T20:07:32.495024] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-27T20:07:32.495612] [DEBUG] [LOCAL ] NCA: Trimmed 14191 records to 9447 (keeping 200 days of data) [2025-10-27T20:07:32.555999] [DEBUG] [LOCAL ] NCA: Primary data saved (9447 records). [2025-10-27T20:07:32.556139] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-27T20:07:32.556221] [INFO ] [MAIN ] Update Progress: 1456/2366 symbols completed. NCA took 25.4s. Estimated remaining: 1h 57m 11s. Rate: 7.8 symbols/min [2025-10-27T20:07:32.754349] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:32.771277] [DEBUG] [LOCAL ] NCZ: Loaded 12475 existing records from primary storage. [2025-10-27T20:07:32.771565] [INFO ] [MAIN ] NCZ: Loaded 12475 existing records. [2025-10-27T20:07:32.960967] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:32.961275] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-27T20:07:32.961341] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-27T20:07:32.961683] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-27T20:07:32.961754] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-27T20:07:33.224534] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-27T20:07:33.509876] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T20:07:33.530357] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:34.014946] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-27T20:07:34.455737] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T20:07:34.814957] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-27T20:07:35.240077] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T20:07:35.614932] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-27T20:07:35.759359] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T20:07:36.061912] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T20:07:36.414940] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-27T20:07:37.214936] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-27T20:07:37.314947] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T20:07:38.014940] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-27T20:07:38.814927] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-27T20:07:39.125847] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T20:07:39.307338] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T20:07:39.614942] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-27T20:07:39.763138] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T20:07:40.175135] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T20:07:40.414960] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-27T20:07:41.214949] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-27T20:07:41.284509] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:07:42.014972] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-27T20:07:42.276683] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:07:42.814928] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-27T20:07:43.614925] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-27T20:07:43.852444] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T20:07:44.047403] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T20:07:44.407812] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T20:07:44.414886] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-27T20:07:45.047072] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T20:07:45.214912] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-27T20:07:45.783428] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T20:07:46.015013] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-27T20:07:46.119599] [DEBUG] [REMOTE ] NCLH: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-27T20:07:46.119961] [WARN ] [REMOTE ] NCLH: No data returned for month 2025-05 [2025-10-27T20:07:46.120076] [FATAL] [REMOTE ] NCLH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:07:46.120177] [FATAL] [MAIN ] NCLH: Failed to fetch primary data. [2025-10-27T20:07:46.120240] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:07:46.120297] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-27T20:07:46.120365] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-27T20:07:46.120412] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-27T20:07:46.120594] [DEBUG] [LOCAL ] NCLH: Deleted derivative data file. [2025-10-27T20:07:46.121236] [INFO ] [MAIN ] Update Progress: 1457/2366 symbols completed. NCLH took 28.5s. Estimated remaining: 1h 57m 7s. Rate: 7.8 symbols/min [2025-10-27T20:07:46.297891] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:46.315795] [DEBUG] [LOCAL ] NDMO: Loaded 17206 existing records from primary storage. [2025-10-27T20:07:46.316040] [INFO ] [MAIN ] NDMO: Loaded 17206 existing records. [2025-10-27T20:07:46.490273] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:46.490543] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-27T20:07:46.490610] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-27T20:07:46.490889] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-27T20:07:46.490948] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-27T20:07:46.815464] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-27T20:07:46.838030] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:47.493606] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T20:07:47.614917] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-27T20:07:48.414981] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-27T20:07:48.765723] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:07:48.771103] [INFO ] [REMOTE ] NCDL: Full fetch complete (33013 records). [2025-10-27T20:07:48.771207] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-27T20:07:49.079147] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T20:07:49.171711] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-27T20:07:49.171784] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-27T20:07:49.172572] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-27T20:07:49.172636] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-27T20:07:49.173391] [DEBUG] [LOCAL ] NCDL: Trimmed 33013 records to 21391 (keeping 200 days of data) [2025-10-27T20:07:49.224777] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-27T20:07:49.303735] [DEBUG] [LOCAL ] NCDL: Primary data saved (21391 records). [2025-10-27T20:07:49.303848] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-27T20:07:49.303926] [INFO ] [MAIN ] Update Progress: 1458/2366 symbols completed. NCDL took 32.8s. Estimated remaining: 1h 56m 56s. Rate: 7.8 symbols/min [2025-10-27T20:07:49.474118] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:49.520785] [DEBUG] [LOCAL ] NE: Loaded 53060 existing records from primary storage. [2025-10-27T20:07:49.521084] [INFO ] [MAIN ] NE: Loaded 53060 existing records. [2025-10-27T20:07:49.699741] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:49.699932] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-27T20:07:49.699978] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-27T20:07:49.700166] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-27T20:07:49.700204] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-27T20:07:50.025055] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-27T20:07:50.056527] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:50.069410] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T20:07:50.814927] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-27T20:07:50.926425] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T20:07:50.930421] [INFO ] [REMOTE ] NCV: Full fetch complete (22460 records). [2025-10-27T20:07:50.930541] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-27T20:07:51.290281] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-27T20:07:51.290355] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-27T20:07:51.290821] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-27T20:07:51.290881] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-27T20:07:51.291419] [DEBUG] [LOCAL ] NCV: Trimmed 22460 records to 13799 (keeping 200 days of data) [2025-10-27T20:07:51.372822] [DEBUG] [LOCAL ] NCV: Primary data saved (13799 records). [2025-10-27T20:07:51.372949] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-27T20:07:51.373025] [INFO ] [MAIN ] Update Progress: 1459/2366 symbols completed. NCV took 26.1s. Estimated remaining: 1h 56m 45s. Rate: 7.8 symbols/min [2025-10-27T20:07:51.542184] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:07:51.577358] [DEBUG] [LOCAL ] NEA: Loaded 35611 existing records from primary storage. [2025-10-27T20:07:51.577683] [INFO ] [MAIN ] NEA: Loaded 35611 existing records. [2025-10-27T20:07:51.620039] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-27T20:07:51.760736] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:07:51.760948] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-27T20:07:51.760996] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-27T20:07:51.761329] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-27T20:07:51.761388] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-27T20:07:52.120886] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:07:52.184383] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T20:07:52.414919] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-27T20:07:52.597766] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T20:07:53.214956] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-27T20:07:53.750918] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T20:07:54.014974] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-27T20:07:54.752484] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:07:54.814959] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-27T20:07:54.861552] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T20:07:55.374569] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T20:07:55.614942] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-27T20:07:56.414957] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-27T20:07:56.960222] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T20:07:56.984502] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T20:07:57.214936] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-27T20:07:57.939198] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T20:07:58.014953] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-27T20:07:58.815041] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-27T20:07:59.614974] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-27T20:07:59.660016] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T20:07:59.997243] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T20:08:00.349877] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T20:08:00.414898] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-27T20:08:01.214930] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-27T20:08:01.580926] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T20:08:01.584572] [INFO ] [REMOTE ] NCZ: Full fetch complete (20784 records). [2025-10-27T20:08:01.584671] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-27T20:08:01.942992] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-27T20:08:01.943065] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-27T20:08:01.943538] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-27T20:08:01.943584] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-27T20:08:01.944188] [DEBUG] [LOCAL ] NCZ: Trimmed 20784 records to 12075 (keeping 200 days of data) [2025-10-27T20:08:02.018257] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-27T20:08:02.018343] [DEBUG] [LOCAL ] NCZ: Primary data saved (12075 records). [2025-10-27T20:08:02.018682] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-27T20:08:02.018805] [INFO ] [MAIN ] Update Progress: 1460/2366 symbols completed. NCZ took 29.5s. Estimated remaining: 1h 56m 39s. Rate: 7.8 symbols/min [2025-10-27T20:08:02.188353] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:02.235853] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-10-27T20:08:02.236141] [INFO ] [MAIN ] NEE: Loaded 54487 existing records. [2025-10-27T20:08:02.412165] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:02.412396] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-27T20:08:02.412452] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-27T20:08:02.412907] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-27T20:08:02.412992] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-27T20:08:02.530554] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T20:08:02.799156] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:02.805510] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T20:08:02.814888] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-27T20:08:03.346008] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T20:08:03.615052] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-27T20:08:04.414927] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-27T20:08:05.214982] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-27T20:08:05.693443] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T20:08:05.824796] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T20:08:05.974986] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T20:08:06.014945] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-27T20:08:06.619087] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T20:08:06.814969] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-27T20:08:07.554967] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T20:08:07.614897] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-27T20:08:08.273878] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T20:08:08.414958] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-27T20:08:09.145117] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T20:08:09.148562] [INFO ] [REMOTE ] NDMO: Full fetch complete (23296 records). [2025-10-27T20:08:09.148679] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-27T20:08:09.220077] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-27T20:08:09.543907] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-27T20:08:09.543983] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-27T20:08:09.544507] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-27T20:08:09.544548] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-27T20:08:09.545185] [DEBUG] [LOCAL ] NDMO: Trimmed 23296 records to 16721 (keeping 200 days of data) [2025-10-27T20:08:09.655941] [DEBUG] [LOCAL ] NDMO: Primary data saved (16721 records). [2025-10-27T20:08:09.656117] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-27T20:08:09.656233] [INFO ] [MAIN ] Update Progress: 1461/2366 symbols completed. NDMO took 23.5s. Estimated remaining: 1h 56m 31s. Rate: 7.8 symbols/min [2025-10-27T20:08:09.829597] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:09.880219] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-10-27T20:08:09.880512] [INFO ] [MAIN ] NEM: Loaded 54488 existing records. [2025-10-27T20:08:10.020170] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-27T20:08:10.056182] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:10.056533] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-27T20:08:10.056586] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-27T20:08:10.056830] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-27T20:08:10.056888] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-27T20:08:10.409803] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:10.814962] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-27T20:08:10.930884] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T20:08:11.429571] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T20:08:11.614954] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-27T20:08:12.414963] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-27T20:08:12.463961] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T20:08:12.946969] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T20:08:13.214995] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-27T20:08:13.846306] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T20:08:14.014984] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-27T20:08:14.814948] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-27T20:08:15.095789] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T20:08:15.138482] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T20:08:15.614946] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-27T20:08:16.294547] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:08:16.414912] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-27T20:08:17.003430] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T20:08:17.214974] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-27T20:08:18.014931] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-27T20:08:18.310848] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:08:18.717299] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:08:18.814957] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-27T20:08:19.399689] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T20:08:19.614943] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-27T20:08:20.177538] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T20:08:20.415018] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-27T20:08:21.220057] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-27T20:08:21.244044] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T20:08:22.014948] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-27T20:08:22.220817] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T20:08:22.293703] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T20:08:22.815002] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-27T20:08:23.614983] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-27T20:08:24.057946] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T20:08:24.415038] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-27T20:08:25.046449] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-27T20:08:25.077377] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T20:08:25.084387] [INFO ] [REMOTE ] NEA: Full fetch complete (50872 records). [2025-10-27T20:08:25.084520] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-27T20:08:25.226412] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-27T20:08:25.466426] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-27T20:08:25.466507] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-27T20:08:25.467396] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-27T20:08:25.467457] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-27T20:08:25.468484] [DEBUG] [LOCAL ] NEA: Trimmed 50872 records to 34773 (keeping 200 days of data) [2025-10-27T20:08:25.675326] [DEBUG] [LOCAL ] NEA: Primary data saved (34773 records). [2025-10-27T20:08:25.675458] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-27T20:08:25.675533] [INFO ] [MAIN ] Update Progress: 1462/2366 symbols completed. NEA took 34.3s. Estimated remaining: 1h 56m 29s. Rate: 7.8 symbols/min [2025-10-27T20:08:25.844303] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:25.895310] [DEBUG] [LOCAL ] NET: Loaded 53510 existing records from primary storage. [2025-10-27T20:08:25.905418] [INFO ] [MAIN ] NET: Loaded 53510 existing records. [2025-10-27T20:08:25.997186] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T20:08:26.027871] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-27T20:08:26.046320] [INFO ] [REMOTE ] NE: Full fetch complete (75776 records). [2025-10-27T20:08:26.057044] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-27T20:08:26.223998] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:26.226778] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-27T20:08:26.226883] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-27T20:08:26.243149] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-27T20:08:26.248386] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-27T20:08:26.878015] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-27T20:08:26.888398] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-27T20:08:26.915332] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-27T20:08:26.916551] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-27T20:08:26.920746] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:26.921266] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-27T20:08:26.922712] [DEBUG] [LOCAL ] NE: Trimmed 75776 records to 52277 (keeping 200 days of data) [2025-10-27T20:08:27.237421] [DEBUG] [LOCAL ] NE: Primary data saved (52277 records). [2025-10-27T20:08:27.237563] [INFO ] [MAIN ] NE: Full history saved. [2025-10-27T20:08:27.237669] [INFO ] [MAIN ] Update Progress: 1463/2366 symbols completed. NE took 37.9s. Estimated remaining: 1h 56m 17s. Rate: 7.8 symbols/min [2025-10-27T20:08:27.412844] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:27.423174] [DEBUG] [LOCAL ] NEU: Loaded 8692 existing records from primary storage. [2025-10-27T20:08:27.423381] [INFO ] [MAIN ] NEU: Loaded 8692 existing records. [2025-10-27T20:08:27.603712] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:27.603959] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-27T20:08:27.604105] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-27T20:08:27.604368] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-27T20:08:27.604458] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-27T20:08:27.923468] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-27T20:08:27.992593] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-27T20:08:28.024927] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:28.106580] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-27T20:08:28.414907] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-27T20:08:28.904786] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T20:08:29.215013] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-27T20:08:29.892363] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T20:08:29.925539] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T20:08:29.982951] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T20:08:30.014908] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-27T20:08:30.814995] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-27T20:08:31.614959] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-27T20:08:32.296687] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T20:08:32.414917] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-27T20:08:32.852603] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T20:08:33.214911] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-27T20:08:33.482455] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T20:08:34.014942] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-27T20:08:34.762396] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-27T20:08:34.777741] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-27T20:08:34.777897] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-27T20:08:34.826252] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-27T20:08:35.061192] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T20:08:35.230954] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-27T20:08:35.231028] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-27T20:08:35.232056] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-27T20:08:35.232118] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-27T20:08:35.233500] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 53707 (keeping 200 days of data) [2025-10-27T20:08:35.463986] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T20:08:35.571485] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-10-27T20:08:35.571626] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-27T20:08:35.572358] [INFO ] [MAIN ] Update Progress: 1464/2366 symbols completed. NEE took 33.6s. Estimated remaining: 1h 56m 10s. Rate: 7.8 symbols/min [2025-10-27T20:08:35.620154] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-27T20:08:35.756095] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:35.765076] [DEBUG] [LOCAL ] NEXA: Loaded 5882 existing records from primary storage. [2025-10-27T20:08:35.765321] [INFO ] [MAIN ] NEXA: Loaded 5882 existing records. [2025-10-27T20:08:35.949943] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:35.950136] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-27T20:08:35.950183] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-27T20:08:35.950374] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-27T20:08:35.950432] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-27T20:08:36.307578] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:36.336795] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-27T20:08:36.414907] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-27T20:08:37.215003] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-27T20:08:37.843712] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T20:08:37.872296] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T20:08:38.014936] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-27T20:08:38.141637] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T20:08:38.814942] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-27T20:08:39.394393] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T20:08:39.614951] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-27T20:08:40.059137] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-27T20:08:40.356293] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T20:08:40.414949] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-27T20:08:41.053277] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T20:08:41.214981] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-27T20:08:42.014962] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-27T20:08:42.178087] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T20:08:42.814950] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-27T20:08:43.614921] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-27T20:08:44.081764] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T20:08:44.414936] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-27T20:08:44.455520] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T20:08:45.214924] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-27T20:08:45.394763] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-27T20:08:45.405573] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-27T20:08:45.405743] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-27T20:08:45.791357] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-27T20:08:45.795012] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-27T20:08:45.796740] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T20:08:45.796529] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-27T20:08:45.798634] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-27T20:08:45.799960] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-27T20:08:46.016447] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-27T20:08:46.129215] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-10-27T20:08:46.129365] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-27T20:08:46.129830] [INFO ] [MAIN ] Update Progress: 1465/2366 symbols completed. NEM took 36.5s. Estimated remaining: 1h 56m 4s. Rate: 7.8 symbols/min [2025-10-27T20:08:46.282805] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-27T20:08:46.344413] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:46.382062] [DEBUG] [LOCAL ] NFG: Loaded 38712 existing records from primary storage. [2025-10-27T20:08:46.382341] [INFO ] [MAIN ] NFG: Loaded 38712 existing records. [2025-10-27T20:08:46.567951] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:46.568130] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-27T20:08:46.568178] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-27T20:08:46.568444] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-27T20:08:46.568502] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-27T20:08:46.633180] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:08:46.820212] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-27T20:08:46.951371] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:47.614994] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-27T20:08:48.032282] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T20:08:48.414995] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-27T20:08:48.805990] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T20:08:48.861313] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-27T20:08:49.214950] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-27T20:08:49.788581] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T20:08:50.014983] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-27T20:08:50.418986] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T20:08:50.814947] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-27T20:08:51.129903] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-27T20:08:51.614994] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-27T20:08:52.415004] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-27T20:08:52.458781] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T20:08:53.215002] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-27T20:08:53.570914] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:08:54.014944] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-27T20:08:54.724741] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:08:54.814912] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-27T20:08:55.304198] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T20:08:55.607321] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T20:08:55.610501] [INFO ] [REMOTE ] NEXA: Full fetch complete (8051 records). [2025-10-27T20:08:55.610587] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-27T20:08:55.622292] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-27T20:08:55.990049] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-27T20:08:55.990120] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-27T20:08:55.990321] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-27T20:08:55.990361] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-27T20:08:55.990795] [DEBUG] [LOCAL ] NEXA: Trimmed 8051 records to 5888 (keeping 200 days of data) [2025-10-27T20:08:56.022628] [DEBUG] [LOCAL ] NEXA: Primary data saved (5888 records). [2025-10-27T20:08:56.022725] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-27T20:08:56.022797] [INFO ] [MAIN ] Update Progress: 1466/2366 symbols completed. NEXA took 20.5s. Estimated remaining: 1h 55m 58s. Rate: 7.8 symbols/min [2025-10-27T20:08:56.193810] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:08:56.215458] [DEBUG] [LOCAL ] NFJ: Loaded 20025 existing records from primary storage. [2025-10-27T20:08:56.215736] [INFO ] [MAIN ] NFJ: Loaded 20025 existing records. [2025-10-27T20:08:56.395983] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:08:56.396212] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-27T20:08:56.396267] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-27T20:08:56.396460] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-27T20:08:56.396499] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-27T20:08:56.420133] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-27T20:08:56.766717] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:08:57.136117] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T20:08:57.214907] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-27T20:08:57.254070] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T20:08:57.898043] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T20:08:58.014974] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-27T20:08:58.814987] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-27T20:08:59.092850] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T20:08:59.614942] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-27T20:09:00.414989] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-27T20:09:00.642707] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T20:09:00.959966] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T20:09:00.969965] [INFO ] [REMOTE ] NET: Full fetch complete (76787 records). [2025-10-27T20:09:00.970118] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-27T20:09:01.222153] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-27T20:09:01.295607] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:09:01.338574] [INFO ] [REMOTE ] NEU: Full fetch complete (10840 records). [2025-10-27T20:09:01.360111] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-27T20:09:01.378754] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-27T20:09:01.410596] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-27T20:09:01.451900] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-27T20:09:01.475164] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-27T20:09:01.543417] [DEBUG] [LOCAL ] NET: Trimmed 76787 records to 52707 (keeping 200 days of data) [2025-10-27T20:09:01.963204] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-27T20:09:01.964686] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-27T20:09:01.968064] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-27T20:09:01.968687] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-27T20:09:01.974818] [DEBUG] [LOCAL ] NEU: Trimmed 10840 records to 8561 (keeping 200 days of data) [2025-10-27T20:09:02.025050] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-27T20:09:02.128995] [DEBUG] [LOCAL ] NEU: Primary data saved (8561 records). [2025-10-27T20:09:02.135533] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-27T20:09:02.139899] [INFO ] [MAIN ] Update Progress: 1467/2366 symbols completed. NEU took 34.9s. Estimated remaining: 1h 55m 49s. Rate: 7.8 symbols/min [2025-10-27T20:09:02.383683] [DEBUG] [LOCAL ] NET: Primary data saved (52707 records). [2025-10-27T20:09:02.405820] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:02.405977] [INFO ] [MAIN ] NET: Full history saved. [2025-10-27T20:09:02.406118] [INFO ] [MAIN ] Update Progress: 1468/2366 symbols completed. NET took 36.7s. Estimated remaining: 1h 55m 37s. Rate: 7.8 symbols/min [2025-10-27T20:09:02.601518] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:02.619684] [DEBUG] [LOCAL ] NGG: Loaded 47367 existing records from primary storage. [2025-10-27T20:09:02.620013] [INFO ] [MAIN ] NGG: Loaded 47367 existing records. [2025-10-27T20:09:02.823990] [DEBUG] [LOCAL ] NGL: Loaded 30251 existing records from primary storage. [2025-10-27T20:09:02.822972] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:02.824438] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-27T20:09:02.824881] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-27T20:09:02.824699] [INFO ] [MAIN ] NGL: Loaded 30251 existing records. [2025-10-27T20:09:02.852036] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-27T20:09:02.927866] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T20:09:02.921360] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-27T20:09:03.006130] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-27T20:09:03.174164] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:03.194169] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-27T20:09:03.194058] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T20:09:03.233982] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-27T20:09:03.249615] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-27T20:09:03.285316] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-27T20:09:03.640526] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-27T20:09:03.648956] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:03.860913] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:03.874280] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:09:04.414944] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-27T20:09:04.983122] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:09:05.180832] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T20:09:05.214892] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-27T20:09:06.014909] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-27T20:09:06.074975] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T20:09:06.814968] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-27T20:09:07.572113] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T20:09:07.614926] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-27T20:09:07.825715] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T20:09:08.414971] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-27T20:09:08.671537] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T20:09:09.214995] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-27T20:09:09.660296] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T20:09:10.014983] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-27T20:09:10.102711] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T20:09:10.814959] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-27T20:09:11.616670] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-27T20:09:11.619214] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T20:09:11.874356] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T20:09:12.414934] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-27T20:09:12.707302] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T20:09:13.214978] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-27T20:09:13.811804] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:09:14.014975] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-27T20:09:14.295608] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:09:14.814936] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-27T20:09:15.432686] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T20:09:15.614970] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-27T20:09:16.163684] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T20:09:16.414943] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-27T20:09:16.881825] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T20:09:17.214941] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-27T20:09:17.878303] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T20:09:18.014904] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-27T20:09:18.073779] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T20:09:18.814937] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-27T20:09:19.177476] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T20:09:19.555322] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T20:09:19.614923] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-27T20:09:20.414974] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-27T20:09:21.214957] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-27T20:09:21.239346] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T20:09:21.243588] [INFO ] [REMOTE ] NFJ: Full fetch complete (29372 records). [2025-10-27T20:09:21.243780] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-27T20:09:21.435758] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T20:09:21.658778] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-27T20:09:21.658863] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-27T20:09:21.659518] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-27T20:09:21.659559] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-27T20:09:21.660426] [DEBUG] [LOCAL ] NFJ: Trimmed 29372 records to 19477 (keeping 200 days of data) [2025-10-27T20:09:21.779223] [DEBUG] [LOCAL ] NFJ: Primary data saved (19477 records). [2025-10-27T20:09:21.779353] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-27T20:09:21.779427] [INFO ] [MAIN ] Update Progress: 1469/2366 symbols completed. NFJ took 25.8s. Estimated remaining: 1h 55m 36s. Rate: 7.8 symbols/min [2025-10-27T20:09:21.946869] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:21.957757] [DEBUG] [LOCAL ] NGS: Loaded 10957 existing records from primary storage. [2025-10-27T20:09:21.957941] [INFO ] [MAIN ] NGS: Loaded 10957 existing records. [2025-10-27T20:09:22.020173] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-27T20:09:22.164849] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:22.165252] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-27T20:09:22.165322] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-27T20:09:22.165579] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-27T20:09:22.165804] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-27T20:09:22.280397] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T20:09:22.552464] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:22.814979] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-27T20:09:23.548027] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T20:09:23.596063] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T20:09:23.614905] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-27T20:09:24.415003] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-27T20:09:25.214990] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-27T20:09:25.333049] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T20:09:25.628248] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T20:09:25.633512] [INFO ] [REMOTE ] NGL: Full fetch complete (41621 records). [2025-10-27T20:09:25.633626] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-27T20:09:25.964909] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T20:09:26.019231] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-27T20:09:26.050019] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-27T20:09:26.050104] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-27T20:09:26.051127] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-27T20:09:26.051193] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-27T20:09:26.052172] [DEBUG] [LOCAL ] NGL: Trimmed 41621 records to 29498 (keeping 200 days of data) [2025-10-27T20:09:26.211610] [DEBUG] [LOCAL ] NGL: Primary data saved (29498 records). [2025-10-27T20:09:26.211780] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-27T20:09:26.211875] [INFO ] [MAIN ] Update Progress: 1470/2366 symbols completed. NGL took 23.8s. Estimated remaining: 1h 55m 26s. Rate: 7.8 symbols/min [2025-10-27T20:09:26.377417] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:26.400139] [DEBUG] [LOCAL ] NGVC: Loaded 23038 existing records from primary storage. [2025-10-27T20:09:26.400380] [INFO ] [MAIN ] NGVC: Loaded 23038 existing records. [2025-10-27T20:09:26.595451] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:26.595713] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-27T20:09:26.595781] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-27T20:09:26.595987] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-27T20:09:26.596038] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-27T20:09:26.825597] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-27T20:09:26.948964] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:27.351680] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T20:09:27.614941] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-27T20:09:28.212191] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T20:09:28.373121] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T20:09:28.414920] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-27T20:09:29.214952] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-27T20:09:29.959991] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T20:09:29.967916] [INFO ] [REMOTE ] NFG: Full fetch complete (57234 records). [2025-10-27T20:09:29.968041] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-27T20:09:30.020103] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-27T20:09:30.170422] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T20:09:30.391369] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-27T20:09:30.391466] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-27T20:09:30.392482] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-27T20:09:30.392546] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-27T20:09:30.393800] [DEBUG] [LOCAL ] NFG: Trimmed 57234 records to 38029 (keeping 200 days of data) [2025-10-27T20:09:30.628889] [DEBUG] [LOCAL ] NFG: Primary data saved (38029 records). [2025-10-27T20:09:30.629024] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-27T20:09:30.629544] [INFO ] [MAIN ] Update Progress: 1471/2366 symbols completed. NFG took 44.5s. Estimated remaining: 1h 55m 16s. Rate: 7.8 symbols/min [2025-10-27T20:09:30.810060] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:30.814916] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-27T20:09:30.835221] [DEBUG] [LOCAL ] NGVT: Loaded 23996 existing records from primary storage. [2025-10-27T20:09:30.835540] [INFO ] [MAIN ] NGVT: Loaded 23996 existing records. [2025-10-27T20:09:31.041745] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T20:09:31.045136] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:31.049023] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-27T20:09:31.049073] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-27T20:09:31.049278] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-27T20:09:31.049336] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-27T20:09:31.400430] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:31.614910] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-27T20:09:31.695338] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T20:09:32.414964] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-27T20:09:32.883477] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T20:09:33.023981] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T20:09:33.214934] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-27T20:09:34.014929] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-27T20:09:34.268875] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T20:09:34.814930] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-27T20:09:35.615023] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-27T20:09:35.655610] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T20:09:35.876254] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T20:09:36.384047] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:09:36.414912] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-27T20:09:37.214992] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-27T20:09:37.997784] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T20:09:38.015452] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:09:38.015539] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-27T20:09:38.814937] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-27T20:09:39.384696] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T20:09:39.393393] [INFO ] [REMOTE ] NGG: Full fetch complete (66642 records). [2025-10-27T20:09:39.393505] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-27T20:09:39.623774] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-27T20:09:39.659375] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T20:09:39.816699] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-27T20:09:39.816783] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-27T20:09:39.817981] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-27T20:09:39.818045] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-27T20:09:39.819355] [DEBUG] [LOCAL ] NGG: Trimmed 66642 records to 46547 (keeping 200 days of data) [2025-10-27T20:09:40.088910] [DEBUG] [LOCAL ] NGG: Primary data saved (46547 records). [2025-10-27T20:09:40.089033] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-27T20:09:40.089109] [INFO ] [MAIN ] Update Progress: 1472/2366 symbols completed. NGG took 37.9s. Estimated remaining: 1h 55m 10s. Rate: 7.8 symbols/min [2025-10-27T20:09:40.265756] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:40.286854] [DEBUG] [LOCAL ] NHI: Loaded 22055 existing records from primary storage. [2025-10-27T20:09:40.287098] [INFO ] [MAIN ] NHI: Loaded 22055 existing records. [2025-10-27T20:09:40.416104] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-27T20:09:40.484704] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:40.485029] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-27T20:09:40.485181] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-27T20:09:40.485517] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-27T20:09:40.485709] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-27T20:09:40.628475] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T20:09:40.882219] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:41.214942] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-27T20:09:41.431436] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T20:09:41.433554] [INFO ] [REMOTE ] NGS: Full fetch complete (16516 records). [2025-10-27T20:09:41.433630] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-27T20:09:41.803211] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-27T20:09:41.803283] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-27T20:09:41.803628] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-27T20:09:41.803700] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-27T20:09:41.804193] [DEBUG] [LOCAL ] NGS: Trimmed 16516 records to 10558 (keeping 200 days of data) [2025-10-27T20:09:41.865988] [DEBUG] [LOCAL ] NGS: Primary data saved (10558 records). [2025-10-27T20:09:41.866109] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-27T20:09:41.866183] [INFO ] [MAIN ] Update Progress: 1473/2366 symbols completed. NGS took 20.1s. Estimated remaining: 1h 54m 58s. Rate: 7.8 symbols/min [2025-10-27T20:09:42.023153] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-27T20:09:42.041303] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:42.091485] [DEBUG] [LOCAL ] NI: Loaded 54181 existing records from primary storage. [2025-10-27T20:09:42.091808] [INFO ] [MAIN ] NI: Loaded 54181 existing records. [2025-10-27T20:09:42.228396] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T20:09:42.291075] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:42.291251] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-27T20:09:42.291297] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-27T20:09:42.291477] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-27T20:09:42.291514] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-27T20:09:42.651662] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:42.814927] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-27T20:09:43.288138] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T20:09:43.614960] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-27T20:09:43.830515] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T20:09:44.414926] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-27T20:09:44.708497] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T20:09:45.215008] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-27T20:09:46.014924] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-27T20:09:46.148014] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T20:09:46.744624] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-27T20:09:46.814971] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-27T20:09:46.944910] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T20:09:47.614901] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-27T20:09:47.647236] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T20:09:48.414917] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-27T20:09:48.618979] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T20:09:49.214956] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-27T20:09:50.014911] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-27T20:09:50.042696] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T20:09:50.161212] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T20:09:50.712016] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T20:09:50.814903] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-27T20:09:51.580972] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-27T20:09:51.614923] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-27T20:09:52.400739] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T20:09:52.414934] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-27T20:09:53.162495] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T20:09:53.214965] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-27T20:09:53.925550] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:09:54.014949] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-27T20:09:54.814922] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-27T20:09:55.074799] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T20:09:55.614968] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-27T20:09:55.976203] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T20:09:55.980119] [INFO ] [REMOTE ] NHI: Full fetch complete (30937 records). [2025-10-27T20:09:55.980198] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-27T20:09:56.344186] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-27T20:09:56.344312] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-27T20:09:56.345033] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-27T20:09:56.345112] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-27T20:09:56.346319] [DEBUG] [LOCAL ] NHI: Trimmed 30937 records to 21545 (keeping 200 days of data) [2025-10-27T20:09:56.421773] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-27T20:09:56.422980] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T20:09:56.499280] [DEBUG] [LOCAL ] NHI: Primary data saved (21545 records). [2025-10-27T20:09:56.499393] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-27T20:09:56.499468] [INFO ] [MAIN ] Update Progress: 1474/2366 symbols completed. NHI took 16.4s. Estimated remaining: 1h 54m 55s. Rate: 7.8 symbols/min [2025-10-27T20:09:56.668691] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:09:56.679307] [DEBUG] [LOCAL ] NIC: Loaded 9157 existing records from primary storage. [2025-10-27T20:09:56.679486] [INFO ] [MAIN ] NIC: Loaded 9157 existing records. [2025-10-27T20:09:56.853389] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:09:56.853567] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-27T20:09:56.853632] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-27T20:09:56.853812] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-27T20:09:56.853856] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-27T20:09:57.201822] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:09:57.214898] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-27T20:09:57.236471] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T20:09:57.989239] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T20:09:58.014899] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-27T20:09:58.814952] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-27T20:09:58.936212] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T20:09:59.614936] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-27T20:10:00.022544] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T20:10:00.303946] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T20:10:00.414977] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-27T20:10:01.194070] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:10:01.214985] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-27T20:10:02.014980] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-27T20:10:02.080746] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:10:02.814974] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-27T20:10:03.461569] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:10:03.614924] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-27T20:10:03.711200] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T20:10:03.717780] [INFO ] [REMOTE ] NGVT: Full fetch complete (34128 records). [2025-10-27T20:10:03.717901] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-27T20:10:04.124747] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-27T20:10:04.124915] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-27T20:10:04.125774] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-27T20:10:04.125857] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-27T20:10:04.133596] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T20:10:04.136836] [DEBUG] [LOCAL ] NGVT: Trimmed 34128 records to 23282 (keeping 200 days of data) [2025-10-27T20:10:04.272961] [DEBUG] [LOCAL ] NGVT: Primary data saved (23282 records). [2025-10-27T20:10:04.273119] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-27T20:10:04.273214] [INFO ] [MAIN ] Update Progress: 1475/2366 symbols completed. NGVT took 33.6s. Estimated remaining: 1h 54m 47s. Rate: 7.8 symbols/min [2025-10-27T20:10:04.423015] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-27T20:10:04.442951] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:04.455744] [DEBUG] [LOCAL ] NIE: Loaded 12003 existing records from primary storage. [2025-10-27T20:10:04.455962] [INFO ] [MAIN ] NIE: Loaded 12003 existing records. [2025-10-27T20:10:04.636310] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:10:04.636526] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-27T20:10:04.636571] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-27T20:10:04.636854] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-27T20:10:04.636906] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-27T20:10:05.000373] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:05.214933] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-27T20:10:05.274435] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T20:10:06.014966] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-27T20:10:06.479421] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T20:10:06.539351] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T20:10:06.814962] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-27T20:10:07.614971] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-27T20:10:07.626026] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T20:10:08.415015] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-27T20:10:08.830998] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T20:10:09.215013] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-27T20:10:09.888255] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T20:10:10.014919] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-27T20:10:10.368140] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:10:10.484317] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T20:10:10.814981] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-27T20:10:11.340199] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T20:10:11.614956] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-27T20:10:12.414919] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-27T20:10:12.585406] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T20:10:13.214967] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-27T20:10:14.016973] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-27T20:10:14.020696] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T20:10:14.025489] [INFO ] [REMOTE ] NGVC: Full fetch complete (31154 records). [2025-10-27T20:10:14.025610] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-27T20:10:14.388663] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T20:10:14.471673] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-27T20:10:14.471759] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-27T20:10:14.472362] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-27T20:10:14.472399] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-27T20:10:14.473170] [DEBUG] [LOCAL ] NGVC: Trimmed 31154 records to 22651 (keeping 200 days of data) [2025-10-27T20:10:14.579409] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T20:10:14.616766] [DEBUG] [LOCAL ] NGVC: Primary data saved (22651 records). [2025-10-27T20:10:14.616889] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-27T20:10:14.616967] [INFO ] [MAIN ] Update Progress: 1476/2366 symbols completed. NGVC took 48.4s. Estimated remaining: 1h 54m 41s. Rate: 7.8 symbols/min [2025-10-27T20:10:14.781591] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:14.787514] [DEBUG] [LOCAL ] NIM: Loaded 3564 existing records from primary storage. [2025-10-27T20:10:14.787756] [INFO ] [MAIN ] NIM: Loaded 3564 existing records. [2025-10-27T20:10:14.820219] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-27T20:10:14.967511] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:10:14.967751] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-27T20:10:14.967807] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-27T20:10:14.967948] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-27T20:10:14.967986] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-27T20:10:15.314301] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:15.614964] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-27T20:10:16.206407] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T20:10:16.210453] [INFO ] [REMOTE ] NIC: Full fetch complete (12858 records). [2025-10-27T20:10:16.210548] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-27T20:10:16.420681] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-27T20:10:16.549976] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T20:10:16.634578] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-27T20:10:16.634666] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-27T20:10:16.634959] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-27T20:10:16.634999] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-27T20:10:16.635441] [DEBUG] [LOCAL ] NIC: Trimmed 12858 records to 9015 (keeping 200 days of data) [2025-10-27T20:10:16.688903] [DEBUG] [LOCAL ] NIC: Primary data saved (9015 records). [2025-10-27T20:10:16.689006] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-27T20:10:16.689076] [INFO ] [MAIN ] Update Progress: 1477/2366 symbols completed. NIC took 20.2s. Estimated remaining: 1h 54m 30s. Rate: 7.8 symbols/min [2025-10-27T20:10:17.214903] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-27T20:10:17.240245] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T20:10:17.865191] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T20:10:18.014919] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-27T20:10:18.775991] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T20:10:18.814911] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-27T20:10:19.614924] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-27T20:10:19.742086] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T20:10:20.414953] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-27T20:10:21.034608] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T20:10:21.189601] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:10:21.214909] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-27T20:10:22.014984] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-27T20:10:22.500874] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T20:10:22.814964] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-27T20:10:22.876984] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T20:10:23.468372] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T20:10:23.471597] [INFO ] [REMOTE ] NIE: Full fetch complete (17010 records). [2025-10-27T20:10:23.471694] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-27T20:10:23.620674] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-27T20:10:23.840605] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-27T20:10:23.840718] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-27T20:10:23.841107] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-27T20:10:23.841146] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-27T20:10:23.841634] [DEBUG] [LOCAL ] NIE: Trimmed 17010 records to 11698 (keeping 200 days of data) [2025-10-27T20:10:23.910217] [DEBUG] [LOCAL ] NIE: Primary data saved (11698 records). [2025-10-27T20:10:23.910340] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-27T20:10:23.910415] [INFO ] [MAIN ] Update Progress: 1478/2366 symbols completed. NIE took 19.6s. Estimated remaining: 1h 54m 22s. Rate: 7.8 symbols/min [2025-10-27T20:10:24.414991] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-27T20:10:24.915416] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T20:10:25.214936] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-27T20:10:25.409158] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T20:10:25.860254] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T20:10:26.014945] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-27T20:10:26.815003] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-27T20:10:27.233104] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T20:10:27.614920] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-27T20:10:27.709449] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T20:10:28.185956] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T20:10:28.414957] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-27T20:10:28.850340] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T20:10:29.214937] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-27T20:10:29.787724] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T20:10:30.014944] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-27T20:10:30.814946] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-27T20:10:31.265583] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T20:10:31.614925] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-27T20:10:31.673361] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T20:10:31.924839] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-27T20:10:32.414910] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-27T20:10:33.083511] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:10:33.084582] [INFO ] [REMOTE ] NIM: Full fetch complete (6098 records). [2025-10-27T20:10:33.084677] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-27T20:10:33.220934] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-27T20:10:33.435082] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-27T20:10:33.435152] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-27T20:10:33.435341] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-27T20:10:33.435379] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-27T20:10:33.435768] [DEBUG] [LOCAL ] NIM: Trimmed 6098 records to 3486 (keeping 200 days of data) [2025-10-27T20:10:33.458637] [DEBUG] [LOCAL ] NIM: Primary data saved (3486 records). [2025-10-27T20:10:33.458724] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-27T20:10:33.458798] [INFO ] [MAIN ] Update Progress: 1479/2366 symbols completed. NIM took 18.8s. Estimated remaining: 1h 54m 15s. Rate: 7.8 symbols/min [2025-10-27T20:10:34.893912] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T20:10:34.904127] [INFO ] [REMOTE ] NI: Full fetch complete (77514 records). [2025-10-27T20:10:34.904245] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-27T20:10:35.302547] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-27T20:10:35.302623] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-27T20:10:35.303830] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-27T20:10:35.303894] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-27T20:10:35.305422] [DEBUG] [LOCAL ] NI: Trimmed 77514 records to 53401 (keeping 200 days of data) [2025-10-27T20:10:35.627898] [DEBUG] [LOCAL ] NI: Primary data saved (53401 records). [2025-10-27T20:10:35.628059] [INFO ] [MAIN ] NI: Full history saved. [2025-10-27T20:10:35.628148] [INFO ] [MAIN ] Update Progress: 1480/2366 symbols completed. NI took 53.8s. Estimated remaining: 1h 54m 4s. Rate: 7.8 symbols/min [2025-10-27T20:10:36.127613] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:36.186603] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:36.283607] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:36.315476] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:36.316593] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-27T20:10:36.317328] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-27T20:10:36.317496] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-27T20:10:36.325624] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-27T20:10:36.326009] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-27T20:10:36.326071] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-27T20:10:36.429787] [DEBUG] [LOCAL ] NINE: Loaded 29361 existing records from primary storage. [2025-10-27T20:10:36.449166] [INFO ] [MAIN ] NINE: Loaded 29361 existing records. [2025-10-27T20:10:36.698914] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-27T20:10:36.718783] [INFO ] [MAIN ] NIO: Loaded 54582 existing records. [2025-10-27T20:10:36.803930] [DEBUG] [LOCAL ] NJR: Loaded 38321 existing records from primary storage. [2025-10-27T20:10:36.938050] [INFO ] [MAIN ] NJR: Loaded 38321 existing records. [2025-10-27T20:10:37.023310] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:10:37.106036] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-27T20:10:37.111393] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-27T20:10:37.160300] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-27T20:10:37.175448] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-27T20:10:37.160224] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:37.311122] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-10-27T20:10:37.389277] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:10:37.425205] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-27T20:10:37.441435] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-27T20:10:37.477293] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-27T20:10:37.482738] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-27T20:10:37.540914] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:10:37.616381] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-27T20:10:37.658737] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-27T20:10:37.734131] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-27T20:10:37.751139] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-27T20:10:37.790146] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:10:37.906828] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-10-27T20:10:37.912168] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:10:38.050816] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-27T20:10:38.086280] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:10:38.105598] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-27T20:10:38.080922] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:38.120182] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-27T20:10:38.134430] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-27T20:10:38.145255] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-27T20:10:38.179543] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-27T20:10:38.239274] [INFO ] [MAIN ] Update Progress: 1481/2366 symbols completed. NIQ took 2.6s. Estimated remaining: 1h 53m 53s. Rate: 7.8 symbols/min [2025-10-27T20:10:38.574455] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:38.585383] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-27T20:10:38.758844] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:10:38.733237] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:38.759598] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-27T20:10:38.759758] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-27T20:10:38.760817] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-27T20:10:38.760983] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-27T20:10:38.761028] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-27T20:10:38.761073] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-27T20:10:38.761113] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-27T20:10:39.153591] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:10:39.153962] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-27T20:10:39.845283] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T20:10:39.854967] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-27T20:10:40.176989] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T20:10:40.184925] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-27T20:10:40.647468] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T20:10:40.658421] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-27T20:10:40.695577] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T20:10:40.701453] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-27T20:10:41.739766] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-27T20:10:41.750251] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-27T20:10:41.827483] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T20:10:42.019382] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-27T20:10:42.028212] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T20:10:42.619468] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T20:10:42.814984] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-27T20:10:43.321285] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:10:43.614988] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-27T20:10:44.084298] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-27T20:10:44.414907] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-27T20:10:45.008932] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T20:10:45.220023] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-27T20:10:45.238106] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-27T20:10:46.014949] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-27T20:10:46.262144] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T20:10:46.633265] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-27T20:10:46.814954] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-27T20:10:47.615070] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-27T20:10:48.371069] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-27T20:10:48.414911] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-27T20:10:49.133720] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-27T20:10:49.214911] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-27T20:10:49.271223] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T20:10:50.015000] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-27T20:10:50.822436] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-27T20:10:50.845893] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-27T20:10:51.095730] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:10:51.614984] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-27T20:10:51.735581] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-27T20:10:52.363311] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T20:10:52.414905] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-27T20:10:53.214988] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-27T20:10:53.510727] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T20:10:53.696784] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:10:54.014952] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-27T20:10:54.815013] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-27T20:10:55.614948] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-27T20:10:55.659535] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-27T20:10:55.952724] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T20:10:56.414987] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-27T20:10:56.571732] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-27T20:10:56.787268] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T20:10:57.215043] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-27T20:10:58.014958] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-27T20:10:58.815000] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-27T20:10:59.124362] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-27T20:10:59.427710] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T20:10:59.462793] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T20:10:59.593514] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T20:10:59.614910] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-27T20:11:00.414976] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-27T20:11:01.001301] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T20:11:01.214998] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-27T20:11:02.014954] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-27T20:11:02.365146] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:11:02.814931] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-27T20:11:03.030616] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-27T20:11:03.615059] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-27T20:11:03.683903] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:11:04.178322] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T20:11:04.188113] [INFO ] [REMOTE ] NJR: Full fetch complete (54739 records). [2025-10-27T20:11:04.188249] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-27T20:11:04.426755] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-27T20:11:04.561496] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-27T20:11:04.561582] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-27T20:11:04.562475] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-27T20:11:04.562539] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-27T20:11:04.563712] [DEBUG] [LOCAL ] NJR: Trimmed 54739 records to 37537 (keeping 200 days of data) [2025-10-27T20:11:04.787454] [DEBUG] [LOCAL ] NJR: Primary data saved (37537 records). [2025-10-27T20:11:04.787608] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-27T20:11:04.787720] [INFO ] [MAIN ] Update Progress: 1482/2366 symbols completed. NJR took 29.1s. Estimated remaining: 1h 53m 57s. Rate: 7.8 symbols/min [2025-10-27T20:11:04.985160] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:05.018423] [DEBUG] [LOCAL ] NKX: Loaded 13823 existing records from primary storage. [2025-10-27T20:11:05.018673] [INFO ] [MAIN ] NKX: Loaded 13823 existing records. [2025-10-27T20:11:05.188523] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:05.188735] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-27T20:11:05.188785] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-27T20:11:05.188986] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-27T20:11:05.189043] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-27T20:11:05.220156] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-27T20:11:05.542396] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:05.995132] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T20:11:06.001824] [INFO ] [REMOTE ] NINE: Full fetch complete (43281 records). [2025-10-27T20:11:06.001986] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-27T20:11:06.032627] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-27T20:11:06.422122] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-27T20:11:06.422198] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-27T20:11:06.423093] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-27T20:11:06.423157] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-27T20:11:06.424158] [DEBUG] [LOCAL ] NINE: Trimmed 43281 records to 28917 (keeping 200 days of data) [2025-10-27T20:11:06.557779] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-27T20:11:06.575261] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-27T20:11:06.576461] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-27T20:11:06.754485] [DEBUG] [LOCAL ] NINE: Primary data saved (28917 records). [2025-10-27T20:11:06.764937] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-27T20:11:06.777559] [INFO ] [MAIN ] Update Progress: 1483/2366 symbols completed. NINE took 31.1s. Estimated remaining: 1h 53m 46s. Rate: 7.8 symbols/min [2025-10-27T20:11:07.162268] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:07.168539] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-27T20:11:07.174616] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-27T20:11:07.174530] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T20:11:07.198674] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-27T20:11:07.202684] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-27T20:11:07.202883] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-27T20:11:07.230399] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-27T20:11:07.260719] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-27T20:11:07.279306] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-27T20:11:07.284687] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-27T20:11:07.291321] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-27T20:11:07.292253] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-27T20:11:07.361136] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-27T20:11:07.725950] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:07.728314] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-27T20:11:07.777730] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-27T20:11:07.923336] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T20:11:08.009840] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-27T20:11:08.010035] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-27T20:11:08.010145] [INFO ] [MAIN ] Update Progress: 1484/2366 symbols completed. NIO took 32.4s. Estimated remaining: 1h 53m 34s. Rate: 7.8 symbols/min [2025-10-27T20:11:08.176689] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:08.189216] [DEBUG] [LOCAL ] NLOP: Loaded 11588 existing records from primary storage. [2025-10-27T20:11:08.189436] [INFO ] [MAIN ] NLOP: Loaded 11588 existing records. [2025-10-27T20:11:08.360385] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:08.360585] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-27T20:11:08.360639] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-27T20:11:08.360852] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-27T20:11:08.360891] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-27T20:11:08.420388] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-27T20:11:08.614740] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T20:11:08.737247] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:09.215040] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-27T20:11:09.495963] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:11:09.506602] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-27T20:11:09.506774] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-27T20:11:09.705805] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T20:11:09.706552] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:11:09.706622] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:11:09.706749] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-27T20:11:09.706818] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-27T20:11:09.706853] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-27T20:11:09.706892] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-27T20:11:09.706950] [INFO ] [MAIN ] Update Progress: 1485/2366 symbols completed. NKE took 31.4s. Estimated remaining: 1h 53m 23s. Rate: 7.8 symbols/min [2025-10-27T20:11:09.887857] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:09.899145] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T20:11:09.949133] [DEBUG] [LOCAL ] NLY: Loaded 54343 existing records from primary storage. [2025-10-27T20:11:09.949446] [INFO ] [MAIN ] NLY: Loaded 54343 existing records. [2025-10-27T20:11:10.020132] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-27T20:11:10.139839] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:10.140029] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-27T20:11:10.140075] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-27T20:11:10.140274] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-27T20:11:10.140330] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-27T20:11:10.511052] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:10.505676] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T20:11:10.814925] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-27T20:11:11.614945] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-27T20:11:12.414347] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:11:12.418787] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-27T20:11:12.606708] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:11:13.214982] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-27T20:11:13.239527] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:11:13.748255] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T20:11:14.014977] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-27T20:11:14.728399] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T20:11:14.814963] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-27T20:11:15.391320] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T20:11:15.614946] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-27T20:11:16.210462] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T20:11:16.414999] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-27T20:11:17.004961] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T20:11:17.214945] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-27T20:11:17.613087] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-27T20:11:18.014972] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-27T20:11:18.814993] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-27T20:11:19.327552] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T20:11:19.559460] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T20:11:19.614981] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-27T20:11:20.229235] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T20:11:20.414961] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-27T20:11:21.214987] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-27T20:11:21.700734] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T20:11:22.014984] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-27T20:11:22.317595] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T20:11:22.445347] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T20:11:22.814940] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-27T20:11:23.614919] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-27T20:11:24.213911] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T20:11:24.414914] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-27T20:11:24.807999] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T20:11:25.039333] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T20:11:25.214951] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-27T20:11:25.621909] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-27T20:11:26.014933] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-27T20:11:26.814923] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-27T20:11:26.849575] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T20:11:27.506959] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T20:11:27.614988] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-27T20:11:28.381055] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:11:28.414932] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-27T20:11:29.026263] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-27T20:11:29.214937] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-27T20:11:29.860756] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T20:11:30.014943] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-27T20:11:30.814938] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-27T20:11:30.872391] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T20:11:31.614931] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-27T20:11:31.703613] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T20:11:32.414953] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-27T20:11:33.214918] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-27T20:11:33.236726] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T20:11:33.238199] [INFO ] [REMOTE ] NL: Full fetch complete (6901 records). [2025-10-27T20:11:33.238282] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-27T20:11:33.433942] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T20:11:33.434289] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:11:33.434459] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:11:33.434539] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-27T20:11:33.434639] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-27T20:11:33.434812] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-27T20:11:33.434887] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-27T20:11:33.435042] [INFO ] [MAIN ] Update Progress: 1486/2366 symbols completed. NL took 26.6s. Estimated remaining: 1h 53m 25s. Rate: 7.8 symbols/min [2025-10-27T20:11:33.573585] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T20:11:33.654706] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:33.668612] [DEBUG] [LOCAL ] NMAI: Loaded 12720 existing records from primary storage. [2025-10-27T20:11:33.668866] [INFO ] [MAIN ] NMAI: Loaded 12720 existing records. [2025-10-27T20:11:33.843958] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:33.844167] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-27T20:11:33.844212] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-27T20:11:33.844401] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-27T20:11:33.844439] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-27T20:11:34.018426] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-27T20:11:34.216911] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:34.217865] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T20:11:34.220906] [INFO ] [REMOTE ] NKX: Full fetch complete (18946 records). [2025-10-27T20:11:34.220980] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-27T20:11:34.591332] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-27T20:11:34.591407] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-27T20:11:34.591879] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-27T20:11:34.591960] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-27T20:11:34.592561] [DEBUG] [LOCAL ] NKX: Trimmed 18946 records to 13566 (keeping 200 days of data) [2025-10-27T20:11:34.674319] [DEBUG] [LOCAL ] NKX: Primary data saved (13566 records). [2025-10-27T20:11:34.674453] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-27T20:11:34.674527] [INFO ] [MAIN ] Update Progress: 1487/2366 symbols completed. NKX took 29.9s. Estimated remaining: 1h 53m 13s. Rate: 7.8 symbols/min [2025-10-27T20:11:34.825282] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-27T20:11:34.852379] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:34.852574] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-27T20:11:34.852773] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-27T20:11:34.852897] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-27T20:11:34.852941] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-27T20:11:34.852982] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-27T20:11:34.853016] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-27T20:11:35.226072] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:35.614942] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-10-27T20:11:35.684901] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T20:11:35.687913] [INFO ] [REMOTE ] NLOP: Full fetch complete (17503 records). [2025-10-27T20:11:35.687992] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-27T20:11:35.810889] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:11:35.839220] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-10-27T20:11:35.863966] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:11:35.864039] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-27T20:11:35.864073] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:11:35.864140] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-27T20:11:35.864200] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-27T20:11:35.864234] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-27T20:11:35.864274] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-27T20:11:35.864319] [INFO ] [MAIN ] Update Progress: 1488/2366 symbols completed. NMAX took 1.2s. Estimated remaining: 1h 53m 1s. Rate: 7.8 symbols/min [2025-10-27T20:11:36.156476] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:36.246332] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-27T20:11:36.246520] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-27T20:11:36.246963] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-27T20:11:36.247084] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-27T20:11:36.247770] [DEBUG] [LOCAL ] NLOP: Trimmed 17503 records to 11254 (keeping 200 days of data) [2025-10-27T20:11:36.282307] [DEBUG] [LOCAL ] NMCO: Loaded 16843 existing records from primary storage. [2025-10-27T20:11:36.288364] [INFO ] [MAIN ] NMCO: Loaded 16843 existing records. [2025-10-27T20:11:36.416462] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-27T20:11:36.416976] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-27T20:11:36.547518] [DEBUG] [LOCAL ] NLOP: Primary data saved (11254 records). [2025-10-27T20:11:36.551890] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:36.552096] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-27T20:11:36.552360] [INFO ] [MAIN ] Update Progress: 1489/2366 symbols completed. NLOP took 28.5s. Estimated remaining: 1h 52m 50s. Rate: 7.8 symbols/min [2025-10-27T20:11:36.552256] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-27T20:11:36.558372] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-27T20:11:36.596372] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-27T20:11:36.617626] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-27T20:11:36.871580] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:37.028838] [DEBUG] [LOCAL ] NMG: Loaded 12587 existing records from primary storage. [2025-10-27T20:11:37.050012] [INFO ] [MAIN ] NMG: Loaded 12587 existing records. [2025-10-27T20:11:37.186052] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:37.220020] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-27T20:11:37.286478] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:37.286762] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-27T20:11:37.286811] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-27T20:11:37.286957] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-27T20:11:37.286995] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-27T20:11:37.418899] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T20:11:37.646720] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:38.014959] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-27T20:11:38.132031] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T20:11:38.614490] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T20:11:38.814920] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-27T20:11:39.551467] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T20:11:39.614914] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-27T20:11:40.414997] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-27T20:11:41.214937] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-27T20:11:41.404495] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T20:11:41.538555] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T20:11:41.854206] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T20:11:42.015014] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-27T20:11:42.814990] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-27T20:11:43.566729] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T20:11:43.614913] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-27T20:11:43.732969] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T20:11:44.416807] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-27T20:11:44.418986] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:11:45.214956] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-27T20:11:45.225617] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T20:11:46.014987] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-27T20:11:46.814947] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-27T20:11:47.033007] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T20:11:47.087480] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T20:11:47.615009] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-27T20:11:47.623553] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T20:11:48.220270] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T20:11:48.414959] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-27T20:11:49.212588] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T20:11:49.215705] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-27T20:11:50.014961] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-27T20:11:50.790375] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T20:11:50.814901] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-27T20:11:51.240709] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T20:11:51.279519] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T20:11:51.289841] [INFO ] [REMOTE ] NLY: Full fetch complete (77699 records). [2025-10-27T20:11:51.289964] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-27T20:11:51.620132] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-27T20:11:51.678595] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-27T20:11:51.678699] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-27T20:11:51.679780] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-27T20:11:51.679841] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-27T20:11:51.681319] [DEBUG] [LOCAL ] NLY: Trimmed 77699 records to 53563 (keeping 200 days of data) [2025-10-27T20:11:52.010933] [DEBUG] [LOCAL ] NLY: Primary data saved (53563 records). [2025-10-27T20:11:52.011061] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-27T20:11:52.011149] [INFO ] [MAIN ] Update Progress: 1490/2366 symbols completed. NLY took 42.3s. Estimated remaining: 1h 52m 46s. Rate: 7.8 symbols/min [2025-10-27T20:11:52.182943] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:11:52.191101] [DEBUG] [LOCAL ] NMI: Loaded 4077 existing records from primary storage. [2025-10-27T20:11:52.191288] [INFO ] [MAIN ] NMI: Loaded 4077 existing records. [2025-10-27T20:11:52.419402] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:11:52.419467] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-27T20:11:52.420801] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-27T20:11:52.420866] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-27T20:11:52.421195] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-27T20:11:52.421251] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-27T20:11:52.546287] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T20:11:52.796726] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:11:52.893097] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T20:11:53.214936] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-27T20:11:54.021604] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-27T20:11:54.023227] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T20:11:54.814924] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-27T20:11:55.180712] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T20:11:55.190867] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T20:11:55.615010] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-27T20:11:56.047145] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T20:11:56.415001] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-27T20:11:57.214942] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-27T20:11:57.403993] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T20:11:58.014932] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-27T20:11:58.016547] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:11:58.814922] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-27T20:11:58.848695] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T20:11:59.451535] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T20:11:59.614972] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-27T20:12:00.414982] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-27T20:12:00.437013] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:12:01.214963] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-27T20:12:01.579796] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T20:12:02.014982] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-27T20:12:02.243983] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T20:12:02.252926] [INFO ] [REMOTE ] NMG: Full fetch complete (16403 records). [2025-10-27T20:12:02.253104] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-27T20:12:02.650965] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-27T20:12:02.651058] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-27T20:12:02.651473] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-27T20:12:02.651537] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-27T20:12:02.652331] [DEBUG] [LOCAL ] NMG: Trimmed 16403 records to 12703 (keeping 200 days of data) [2025-10-27T20:12:02.729602] [DEBUG] [LOCAL ] NMG: Primary data saved (12703 records). [2025-10-27T20:12:02.729769] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-27T20:12:02.729852] [INFO ] [MAIN ] Update Progress: 1491/2366 symbols completed. NMG took 26.2s. Estimated remaining: 1h 52m 40s. Rate: 7.8 symbols/min [2025-10-27T20:12:02.820088] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-27T20:12:02.925998] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:02.938932] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T20:12:02.954611] [DEBUG] [LOCAL ] NMM: Loaded 14410 existing records from primary storage. [2025-10-27T20:12:02.954875] [INFO ] [MAIN ] NMM: Loaded 14410 existing records. [2025-10-27T20:12:03.131130] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:03.131359] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-27T20:12:03.131427] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-27T20:12:03.131768] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-27T20:12:03.131835] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-27T20:12:03.483778] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:03.492863] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T20:12:03.614945] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-27T20:12:04.414920] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-27T20:12:04.634410] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T20:12:05.214914] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-27T20:12:05.376227] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T20:12:05.827396] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T20:12:05.830396] [INFO ] [REMOTE ] NMAI: Full fetch complete (19321 records). [2025-10-27T20:12:05.830475] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-27T20:12:06.028985] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-27T20:12:06.257513] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-27T20:12:06.257593] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-27T20:12:06.258073] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-27T20:12:06.258138] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-27T20:12:06.258720] [DEBUG] [LOCAL ] NMAI: Trimmed 19321 records to 12392 (keeping 200 days of data) [2025-10-27T20:12:06.343763] [DEBUG] [LOCAL ] NMAI: Primary data saved (12392 records). [2025-10-27T20:12:06.343919] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-27T20:12:06.344050] [INFO ] [MAIN ] Update Progress: 1492/2366 symbols completed. NMAI took 32.9s. Estimated remaining: 1h 52m 30s. Rate: 7.8 symbols/min [2025-10-27T20:12:06.550944] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:06.585583] [DEBUG] [LOCAL ] NMR: Loaded 35957 existing records from primary storage. [2025-10-27T20:12:06.585918] [INFO ] [MAIN ] NMR: Loaded 35957 existing records. [2025-10-27T20:12:06.794229] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:06.794426] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-27T20:12:06.794513] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-27T20:12:06.794785] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-27T20:12:06.794855] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-27T20:12:06.820134] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-27T20:12:07.093869] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T20:12:07.129019] [INFO ] [REMOTE ] NMCO: Full fetch complete (22822 records). [2025-10-27T20:12:07.139723] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-27T20:12:07.305304] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:07.590719] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-27T20:12:07.596141] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-27T20:12:07.600898] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-27T20:12:07.600984] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-27T20:12:07.602562] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T20:12:07.607050] [DEBUG] [LOCAL ] NMCO: Trimmed 22822 records to 16170 (keeping 200 days of data) [2025-10-27T20:12:07.647712] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-27T20:12:07.707947] [DEBUG] [LOCAL ] NMCO: Primary data saved (16170 records). [2025-10-27T20:12:07.708084] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-27T20:12:07.708177] [INFO ] [MAIN ] Update Progress: 1493/2366 symbols completed. NMCO took 31.8s. Estimated remaining: 1h 52m 19s. Rate: 7.8 symbols/min [2025-10-27T20:12:07.870994] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:07.876166] [DEBUG] [LOCAL ] NMS: Loaded 2947 existing records from primary storage. [2025-10-27T20:12:07.876325] [INFO ] [MAIN ] NMS: Loaded 2947 existing records. [2025-10-27T20:12:08.050388] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:08.050618] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-27T20:12:08.050696] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-27T20:12:08.050860] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-27T20:12:08.050909] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-27T20:12:08.395452] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:08.414893] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-27T20:12:08.557368] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T20:12:08.710142] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-27T20:12:09.214989] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-27T20:12:09.939026] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T20:12:10.014912] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-27T20:12:10.515255] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T20:12:10.814925] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-27T20:12:11.614947] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-27T20:12:12.219467] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T20:12:12.414940] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-27T20:12:12.451296] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T20:12:13.214971] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-27T20:12:13.350240] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:12:13.634947] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T20:12:14.015002] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-27T20:12:14.374985] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T20:12:14.814996] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-27T20:12:15.614924] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-27T20:12:15.636587] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T20:12:16.147468] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T20:12:16.414955] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-27T20:12:17.020763] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T20:12:17.214942] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-27T20:12:17.642560] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T20:12:18.014938] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-27T20:12:18.393831] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T20:12:18.814931] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-27T20:12:19.614938] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-27T20:12:20.190318] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:12:20.414987] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-27T20:12:20.430056] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:12:20.924105] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:12:20.925382] [INFO ] [REMOTE ] NMI: Full fetch complete (5639 records). [2025-10-27T20:12:20.925465] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-27T20:12:21.220105] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-27T20:12:21.310447] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-27T20:12:21.310516] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-27T20:12:21.310700] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-27T20:12:21.310760] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-27T20:12:21.311117] [DEBUG] [LOCAL ] NMI: Trimmed 5639 records to 3954 (keeping 200 days of data) [2025-10-27T20:12:21.333942] [DEBUG] [LOCAL ] NMI: Primary data saved (3954 records). [2025-10-27T20:12:21.334017] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-27T20:12:21.334097] [INFO ] [MAIN ] Update Progress: 1494/2366 symbols completed. NMI took 29.3s. Estimated remaining: 1h 52m 15s. Rate: 7.8 symbols/min [2025-10-27T20:12:21.501964] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:21.507350] [DEBUG] [LOCAL ] NMT: Loaded 2832 existing records from primary storage. [2025-10-27T20:12:21.507557] [INFO ] [MAIN ] NMT: Loaded 2832 existing records. [2025-10-27T20:12:21.682290] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:21.682496] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-27T20:12:21.682543] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-27T20:12:21.682704] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-27T20:12:21.682760] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-27T20:12:21.759160] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T20:12:22.017670] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-27T20:12:22.038575] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:22.814911] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-27T20:12:23.011907] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T20:12:23.272168] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T20:12:23.614964] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-27T20:12:24.105006] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T20:12:24.414933] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-27T20:12:24.858732] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T20:12:25.214937] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-27T20:12:26.014997] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-27T20:12:26.764836] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T20:12:26.791631] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T20:12:26.814907] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-27T20:12:27.614936] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-27T20:12:28.085712] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:12:28.178927] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T20:12:28.414930] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-27T20:12:28.966463] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T20:12:29.214949] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-27T20:12:30.014918] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-27T20:12:30.490840] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T20:12:30.563821] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T20:12:30.814996] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-27T20:12:31.291955] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T20:12:31.614996] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-27T20:12:32.272959] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T20:12:32.276268] [INFO ] [REMOTE ] NMM: Full fetch complete (21550 records). [2025-10-27T20:12:32.276437] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-27T20:12:32.422854] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-27T20:12:32.670562] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-27T20:12:32.670701] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-27T20:12:32.671508] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-27T20:12:32.671557] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-27T20:12:32.672587] [DEBUG] [LOCAL ] NMM: Trimmed 21550 records to 13796 (keeping 200 days of data) [2025-10-27T20:12:32.766542] [DEBUG] [LOCAL ] NMM: Primary data saved (13796 records). [2025-10-27T20:12:32.766833] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-27T20:12:32.766956] [INFO ] [MAIN ] Update Progress: 1495/2366 symbols completed. NMM took 30.0s. Estimated remaining: 1h 52m 9s. Rate: 7.8 symbols/min [2025-10-27T20:12:32.946909] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T20:12:32.969675] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:32.994691] [DEBUG] [LOCAL ] NMZ: Loaded 21603 existing records from primary storage. [2025-10-27T20:12:32.995047] [INFO ] [MAIN ] NMZ: Loaded 21603 existing records. [2025-10-27T20:12:33.173839] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:33.174108] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-27T20:12:33.174159] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-27T20:12:33.174361] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-27T20:12:33.174401] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-27T20:12:33.220304] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-27T20:12:33.552782] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:33.620056] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T20:12:34.015040] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-27T20:12:34.584863] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T20:12:34.585848] [INFO ] [REMOTE ] NMT: Full fetch complete (3874 records). [2025-10-27T20:12:34.585914] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-27T20:12:34.820133] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-27T20:12:34.963114] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-27T20:12:34.963257] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-27T20:12:34.963486] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-27T20:12:34.963550] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-27T20:12:34.963988] [DEBUG] [LOCAL ] NMT: Trimmed 3874 records to 2779 (keeping 200 days of data) [2025-10-27T20:12:34.982400] [DEBUG] [LOCAL ] NMT: Primary data saved (2779 records). [2025-10-27T20:12:34.982498] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-27T20:12:34.982668] [INFO ] [MAIN ] Update Progress: 1496/2366 symbols completed. NMT took 13.6s. Estimated remaining: 1h 51m 58s. Rate: 7.8 symbols/min [2025-10-27T20:12:35.156288] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:35.171401] [DEBUG] [LOCAL ] NNI: Loaded 10574 existing records from primary storage. [2025-10-27T20:12:35.171744] [INFO ] [MAIN ] NNI: Loaded 10574 existing records. [2025-10-27T20:12:35.355661] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:35.355978] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-27T20:12:35.356029] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-27T20:12:35.356224] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-27T20:12:35.356264] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-27T20:12:35.620206] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-27T20:12:35.724500] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:36.217307] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T20:12:36.367763] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:12:36.414902] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-27T20:12:37.215017] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-27T20:12:37.495562] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T20:12:38.014985] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-27T20:12:38.670837] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T20:12:38.690188] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T20:12:38.814932] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-27T20:12:39.444797] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T20:12:39.614991] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-27T20:12:40.414996] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-27T20:12:40.761925] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T20:12:41.214934] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-27T20:12:41.353717] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T20:12:42.014980] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-27T20:12:42.814925] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-27T20:12:42.959928] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T20:12:43.248603] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-27T20:12:43.248469] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T20:12:43.615014] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-27T20:12:44.317854] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T20:12:44.414968] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-27T20:12:45.214914] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-27T20:12:45.404908] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T20:12:45.672759] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T20:12:46.014931] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-27T20:12:46.730104] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T20:12:46.814886] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-27T20:12:47.614941] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-27T20:12:48.059794] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T20:12:48.378577] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T20:12:48.386019] [INFO ] [REMOTE ] NMR: Full fetch complete (51351 records). [2025-10-27T20:12:48.386106] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-27T20:12:48.420160] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-27T20:12:48.755722] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-27T20:12:48.755802] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-27T20:12:48.756660] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-27T20:12:48.756723] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-27T20:12:48.757675] [DEBUG] [LOCAL ] NMR: Trimmed 51351 records to 35173 (keeping 200 days of data) [2025-10-27T20:12:48.842983] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T20:12:48.954571] [DEBUG] [LOCAL ] NMR: Primary data saved (35173 records). [2025-10-27T20:12:48.954723] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-27T20:12:48.954818] [INFO ] [MAIN ] Update Progress: 1497/2366 symbols completed. NMR took 42.6s. Estimated remaining: 1h 51m 54s. Rate: 7.8 symbols/min [2025-10-27T20:12:49.118790] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:49.160177] [DEBUG] [LOCAL ] NNN: Loaded 48874 existing records from primary storage. [2025-10-27T20:12:49.160459] [INFO ] [MAIN ] NNN: Loaded 48874 existing records. [2025-10-27T20:12:49.220128] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-27T20:12:49.335409] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:12:49.335582] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-27T20:12:49.335626] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-27T20:12:49.335839] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-27T20:12:49.335883] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-27T20:12:49.674603] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:12:49.994792] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T20:12:50.014902] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-27T20:12:50.672461] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T20:12:50.814931] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-27T20:12:51.614960] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-27T20:12:52.100513] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T20:12:52.415012] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-27T20:12:52.602546] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:12:53.214990] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-27T20:12:53.614533] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T20:12:53.708570] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T20:12:54.014954] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-27T20:12:54.818068] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-27T20:12:54.821260] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T20:12:55.546374] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T20:12:55.614916] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-27T20:12:56.414925] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-27T20:12:56.486009] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T20:12:56.980939] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T20:12:57.214915] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-27T20:12:57.986866] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:12:58.014905] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-27T20:12:58.814923] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-27T20:12:58.841307] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T20:12:59.358911] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T20:12:59.360150] [INFO ] [REMOTE ] NMS: Full fetch complete (4072 records). [2025-10-27T20:12:59.360225] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-27T20:12:59.620363] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-27T20:12:59.747111] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-27T20:12:59.747187] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-27T20:12:59.747312] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-27T20:12:59.747351] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-27T20:12:59.747714] [DEBUG] [LOCAL ] NMS: Trimmed 4072 records to 2909 (keeping 200 days of data) [2025-10-27T20:12:59.764741] [DEBUG] [LOCAL ] NMS: Primary data saved (2909 records). [2025-10-27T20:12:59.764812] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-27T20:12:59.764878] [INFO ] [MAIN ] Update Progress: 1498/2366 symbols completed. NMS took 52.1s. Estimated remaining: 1h 51m 48s. Rate: 7.8 symbols/min [2025-10-27T20:12:59.928928] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:12:59.936396] [DEBUG] [LOCAL ] NNY: Loaded 5872 existing records from primary storage. [2025-10-27T20:12:59.936582] [INFO ] [MAIN ] NNY: Loaded 5872 existing records. [2025-10-27T20:13:00.110889] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:00.111089] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-27T20:13:00.111139] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-27T20:13:00.111289] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-27T20:13:00.111345] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-27T20:13:00.420253] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-27T20:13:00.459204] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:01.214953] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-27T20:13:01.329129] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T20:13:01.418397] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T20:13:01.420675] [INFO ] [REMOTE ] NNI: Full fetch complete (13187 records). [2025-10-27T20:13:01.420747] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-27T20:13:01.772775] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-27T20:13:01.772849] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-27T20:13:01.773136] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-27T20:13:01.773174] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-27T20:13:01.773621] [DEBUG] [LOCAL ] NNI: Trimmed 13187 records to 10437 (keeping 200 days of data) [2025-10-27T20:13:01.837308] [DEBUG] [LOCAL ] NNI: Primary data saved (10437 records). [2025-10-27T20:13:01.837436] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-27T20:13:01.837511] [INFO ] [MAIN ] Update Progress: 1499/2366 symbols completed. NNI took 26.9s. Estimated remaining: 1h 51m 37s. Rate: 7.8 symbols/min [2025-10-27T20:13:02.000686] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:02.018845] [DEBUG] [LOCAL ] NOA: Loaded 15951 existing records from primary storage. [2025-10-27T20:13:02.018439] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-27T20:13:02.019672] [INFO ] [MAIN ] NOA: Loaded 15951 existing records. [2025-10-27T20:13:02.195320] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:13:02.214367] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:02.218345] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-27T20:13:02.218499] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-27T20:13:02.218622] [INFO ] [REMOTE ] NMZ: Full fetch complete (30909 records). [2025-10-27T20:13:02.218716] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-27T20:13:02.218766] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-27T20:13:02.218935] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-27T20:13:02.828278] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-27T20:13:02.968873] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:02.969340] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-27T20:13:02.969393] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-27T20:13:02.970014] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-27T20:13:02.970074] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-27T20:13:02.970752] [DEBUG] [LOCAL ] NMZ: Trimmed 30909 records to 20790 (keeping 200 days of data) [2025-10-27T20:13:03.108217] [DEBUG] [LOCAL ] NMZ: Primary data saved (20790 records). [2025-10-27T20:13:03.108334] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-27T20:13:03.108404] [INFO ] [MAIN ] Update Progress: 1500/2366 symbols completed. NMZ took 30.3s. Estimated remaining: 1h 51m 26s. Rate: 7.8 symbols/min [2025-10-27T20:13:03.286162] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:03.306353] [DEBUG] [LOCAL ] NOAH: Loaded 19993 existing records from primary storage. [2025-10-27T20:13:03.306576] [INFO ] [MAIN ] NOAH: Loaded 19993 existing records. [2025-10-27T20:13:03.482261] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:03.482520] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-27T20:13:03.482673] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-27T20:13:03.482984] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-27T20:13:03.483035] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-27T20:13:03.608380] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T20:13:03.628147] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-27T20:13:03.844761] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:03.871700] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T20:13:04.340495] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T20:13:04.414958] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-27T20:13:05.031966] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:13:05.214924] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-27T20:13:06.014954] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-27T20:13:06.752078] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T20:13:06.752255] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T20:13:06.814890] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-27T20:13:07.614958] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-27T20:13:07.912492] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T20:13:08.205811] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T20:13:08.414976] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-27T20:13:09.214957] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-27T20:13:09.941488] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T20:13:09.941224] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T20:13:10.014902] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-27T20:13:10.815008] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-27T20:13:11.411467] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T20:13:11.573794] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T20:13:11.614908] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-27T20:13:12.414936] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-27T20:13:12.743507] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T20:13:13.214966] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-27T20:13:13.273945] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T20:13:13.791079] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T20:13:14.015002] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-27T20:13:14.814983] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-27T20:13:15.543861] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T20:13:15.614957] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-27T20:13:15.796009] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T20:13:15.804883] [INFO ] [REMOTE ] NNN: Full fetch complete (70187 records). [2025-10-27T20:13:15.804985] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-27T20:13:16.179634] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-27T20:13:16.179737] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-27T20:13:16.180742] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-27T20:13:16.180803] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-27T20:13:16.182015] [DEBUG] [LOCAL ] NNN: Trimmed 70187 records to 47984 (keeping 200 days of data) [2025-10-27T20:13:16.431275] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-27T20:13:16.460022] [DEBUG] [LOCAL ] NNN: Primary data saved (47984 records). [2025-10-27T20:13:16.460103] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-27T20:13:16.460172] [INFO ] [MAIN ] Update Progress: 1501/2366 symbols completed. NNN took 27.5s. Estimated remaining: 1h 51m 21s. Rate: 7.8 symbols/min [2025-10-27T20:13:16.627609] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:16.666916] [DEBUG] [LOCAL ] NOC: Loaded 42190 existing records from primary storage. [2025-10-27T20:13:16.667334] [INFO ] [MAIN ] NOC: Loaded 42190 existing records. [2025-10-27T20:13:16.798003] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T20:13:16.857515] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:16.858146] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-27T20:13:16.858210] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-27T20:13:16.858500] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-27T20:13:16.858556] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-27T20:13:16.972317] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T20:13:17.209905] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:17.214890] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-27T20:13:18.014923] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-27T20:13:18.428617] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T20:13:18.814909] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-27T20:13:19.101091] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T20:13:19.614970] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-27T20:13:19.727105] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T20:13:20.414934] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-27T20:13:21.214938] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-27T20:13:21.249860] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T20:13:21.358599] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T20:13:21.631186] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T20:13:22.014944] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-27T20:13:22.603445] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-27T20:13:22.814935] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-27T20:13:23.614976] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-27T20:13:23.660002] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T20:13:24.414909] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-27T20:13:24.596827] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T20:13:25.214975] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-27T20:13:25.232386] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:13:26.014949] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-27T20:13:26.544901] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T20:13:26.814920] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-27T20:13:26.878831] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T20:13:27.614945] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-27T20:13:28.414906] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-27T20:13:28.607947] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T20:13:28.609777] [INFO ] [REMOTE ] NNY: Full fetch complete (8435 records). [2025-10-27T20:13:28.609849] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-27T20:13:28.921002] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T20:13:29.008780] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-27T20:13:29.008853] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-27T20:13:29.009100] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-27T20:13:29.009140] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-27T20:13:29.009534] [DEBUG] [LOCAL ] NNY: Trimmed 8435 records to 5772 (keeping 200 days of data) [2025-10-27T20:13:29.042708] [DEBUG] [LOCAL ] NNY: Primary data saved (5772 records). [2025-10-27T20:13:29.042793] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-27T20:13:29.042865] [INFO ] [MAIN ] Update Progress: 1502/2366 symbols completed. NNY took 29.3s. Estimated remaining: 1h 51m 16s. Rate: 7.8 symbols/min [2025-10-27T20:13:29.207331] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:29.214916] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-27T20:13:29.254505] [DEBUG] [LOCAL ] NOG: Loaded 52105 existing records from primary storage. [2025-10-27T20:13:29.254827] [INFO ] [MAIN ] NOG: Loaded 52105 existing records. [2025-10-27T20:13:29.428107] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:29.428288] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-27T20:13:29.428333] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-27T20:13:29.428516] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-27T20:13:29.428553] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-27T20:13:29.688283] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T20:13:29.802029] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:30.011301] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:13:30.018421] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-27T20:13:30.814922] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-27T20:13:30.996215] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T20:13:31.614967] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-27T20:13:31.765424] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:13:32.407790] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T20:13:32.414899] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-27T20:13:33.214990] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-27T20:13:34.015003] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-27T20:13:34.259400] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T20:13:34.573510] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T20:13:34.814928] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-27T20:13:35.075054] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T20:13:35.611025] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-27T20:13:35.614521] [INFO ] [REMOTE ] NOA: Full fetch complete (22634 records). [2025-10-27T20:13:35.614594] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-27T20:13:35.620259] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-27T20:13:35.970257] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-27T20:13:35.970331] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-27T20:13:35.970835] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-27T20:13:35.970895] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-27T20:13:35.971449] [DEBUG] [LOCAL ] NOA: Trimmed 22634 records to 15472 (keeping 200 days of data) [2025-10-27T20:13:36.060998] [DEBUG] [LOCAL ] NOA: Primary data saved (15472 records). [2025-10-27T20:13:36.061124] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-27T20:13:36.061199] [INFO ] [MAIN ] Update Progress: 1503/2366 symbols completed. NOA took 34.2s. Estimated remaining: 1h 51m 8s. Rate: 7.8 symbols/min [2025-10-27T20:13:36.225775] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:36.273098] [DEBUG] [LOCAL ] NOK: Loaded 54402 existing records from primary storage. [2025-10-27T20:13:36.273420] [INFO ] [MAIN ] NOK: Loaded 54402 existing records. [2025-10-27T20:13:36.420215] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-27T20:13:36.449461] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:36.449862] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-27T20:13:36.449912] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-27T20:13:36.450237] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-27T20:13:36.450276] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-27T20:13:36.806688] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:37.214950] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-27T20:13:37.323323] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T20:13:37.365767] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T20:13:37.369684] [INFO ] [REMOTE ] NOAH: Full fetch complete (27035 records). [2025-10-27T20:13:37.369780] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-27T20:13:37.745745] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-27T20:13:37.745825] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-27T20:13:37.746477] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-27T20:13:37.746518] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-27T20:13:37.747282] [DEBUG] [LOCAL ] NOAH: Trimmed 27035 records to 19278 (keeping 200 days of data) [2025-10-27T20:13:37.858706] [DEBUG] [LOCAL ] NOAH: Primary data saved (19278 records). [2025-10-27T20:13:37.858840] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-27T20:13:37.858917] [INFO ] [MAIN ] Update Progress: 1504/2366 symbols completed. NOAH took 34.8s. Estimated remaining: 1h 50m 57s. Rate: 7.8 symbols/min [2025-10-27T20:13:38.016738] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-27T20:13:38.046932] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:38.047155] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-27T20:13:38.047235] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-27T20:13:38.047352] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-27T20:13:38.047394] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-27T20:13:38.047434] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-27T20:13:38.047465] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-27T20:13:38.392683] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:38.659935] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:13:38.814936] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-27T20:13:39.261775] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T20:13:39.614922] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-27T20:13:39.982436] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T20:13:40.414980] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-27T20:13:40.479717] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T20:13:40.771683] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T20:13:41.214998] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-27T20:13:42.014923] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-27T20:13:42.436505] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T20:13:42.734553] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T20:13:42.814904] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-27T20:13:43.614996] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-27T20:13:44.414992] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-27T20:13:44.654424] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T20:13:45.214958] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-27T20:13:45.455616] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T20:13:45.504175] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-27T20:13:46.014981] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-27T20:13:46.509284] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T20:13:46.814971] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-27T20:13:47.139345] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-27T20:13:47.614944] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-27T20:13:47.825383] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:13:48.414948] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-27T20:13:49.192567] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T20:13:49.214898] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-27T20:13:50.014984] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-27T20:13:50.060937] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T20:13:50.354857] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T20:13:50.814986] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-27T20:13:51.235904] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T20:13:51.614943] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-27T20:13:51.937302] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-27T20:13:52.138993] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T20:13:52.414934] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-27T20:13:52.853201] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T20:13:53.214934] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-27T20:13:53.519790] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-27T20:13:54.014973] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-27T20:13:54.814923] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-27T20:13:55.539018] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T20:13:55.614906] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-27T20:13:56.414955] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-27T20:13:56.656726] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T20:13:57.015712] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T20:13:57.016544] [INFO ] [REMOTE ] NOM: Full fetch complete (1537 records). [2025-10-27T20:13:57.016619] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-27T20:13:57.196940] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T20:13:57.215987] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-27T20:13:57.223325] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-27T20:13:57.223720] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:13:57.224691] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:13:57.224764] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-27T20:13:57.224822] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-27T20:13:57.225169] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-27T20:13:57.225237] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-27T20:13:57.225295] [INFO ] [MAIN ] Update Progress: 1505/2366 symbols completed. NOM took 19.4s. Estimated remaining: 1h 50m 56s. Rate: 7.8 symbols/min [2025-10-27T20:13:57.391412] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:13:57.431471] [DEBUG] [LOCAL ] NOMD: Loaded 43894 existing records from primary storage. [2025-10-27T20:13:57.431768] [INFO ] [MAIN ] NOMD: Loaded 43894 existing records. [2025-10-27T20:13:57.605215] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:13:57.605369] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-27T20:13:57.605426] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-27T20:13:57.605679] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-27T20:13:57.605735] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-27T20:13:57.961836] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:13:58.014928] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-27T20:13:58.814967] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-27T20:13:58.870445] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T20:13:59.614931] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-27T20:13:59.722219] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T20:14:00.414961] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-27T20:14:00.534375] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T20:14:00.542162] [INFO ] [REMOTE ] NOC: Full fetch complete (61855 records). [2025-10-27T20:14:00.542313] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-27T20:14:00.929381] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-27T20:14:00.929457] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-27T20:14:00.930416] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-27T20:14:00.930478] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-27T20:14:00.931687] [DEBUG] [LOCAL ] NOC: Trimmed 61855 records to 41335 (keeping 200 days of data) [2025-10-27T20:14:01.185839] [DEBUG] [LOCAL ] NOC: Primary data saved (41335 records). [2025-10-27T20:14:01.185962] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-27T20:14:01.186035] [INFO ] [MAIN ] Update Progress: 1506/2366 symbols completed. NOC took 44.7s. Estimated remaining: 1h 50m 46s. Rate: 7.8 symbols/min [2025-10-27T20:14:01.228962] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-27T20:14:01.380587] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:01.415305] [DEBUG] [LOCAL ] NOTE: Loaded 39862 existing records from primary storage. [2025-10-27T20:14:01.415570] [INFO ] [MAIN ] NOTE: Loaded 39862 existing records. [2025-10-27T20:14:01.599068] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:01.599439] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-27T20:14:01.599511] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-27T20:14:01.599777] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-27T20:14:01.599834] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-27T20:14:01.941399] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T20:14:02.009487] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:02.023460] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-27T20:14:02.048557] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T20:14:02.673479] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T20:14:02.814968] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-27T20:14:03.100234] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T20:14:03.614945] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-27T20:14:04.414931] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-27T20:14:04.752883] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T20:14:05.037285] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T20:14:05.214962] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-27T20:14:05.827970] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T20:14:06.014975] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-27T20:14:06.512961] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T20:14:06.814922] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-27T20:14:07.468019] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T20:14:07.614990] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-27T20:14:08.414949] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-27T20:14:08.462740] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T20:14:09.214944] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-27T20:14:09.558538] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-27T20:14:09.568687] [INFO ] [REMOTE ] NOK: Full fetch complete (77775 records). [2025-10-27T20:14:09.568802] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-27T20:14:09.953909] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-27T20:14:09.954015] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-27T20:14:09.955373] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-27T20:14:09.955480] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-27T20:14:09.980955] [DEBUG] [LOCAL ] NOK: Trimmed 77775 records to 53622 (keeping 200 days of data) [2025-10-27T20:14:09.982009] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-27T20:14:10.039089] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-27T20:14:10.297455] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-27T20:14:10.297576] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-27T20:14:10.297675] [INFO ] [MAIN ] Update Progress: 1507/2366 symbols completed. NOK took 34.2s. Estimated remaining: 1h 50m 39s. Rate: 7.8 symbols/min [2025-10-27T20:14:10.484209] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:10.495818] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T20:14:10.549906] [DEBUG] [LOCAL ] NOV: Loaded 53940 existing records from primary storage. [2025-10-27T20:14:10.550200] [INFO ] [MAIN ] NOV: Loaded 53940 existing records. [2025-10-27T20:14:10.720690] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:10.720867] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-27T20:14:10.720911] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-27T20:14:10.721099] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-27T20:14:10.721136] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-27T20:14:10.816055] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-27T20:14:11.061396] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:11.614920] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-27T20:14:11.999105] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T20:14:12.009180] [INFO ] [REMOTE ] NOG: Full fetch complete (74378 records). [2025-10-27T20:14:12.009311] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-27T20:14:12.430026] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-27T20:14:12.430834] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-27T20:14:12.431768] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-27T20:14:12.433083] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-27T20:14:12.442258] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-27T20:14:12.459533] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T20:14:12.469466] [DEBUG] [LOCAL ] NOG: Trimmed 74378 records to 51328 (keeping 200 days of data) [2025-10-27T20:14:12.804679] [DEBUG] [LOCAL ] NOG: Primary data saved (51328 records). [2025-10-27T20:14:12.804982] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-27T20:14:12.805621] [INFO ] [MAIN ] Update Progress: 1508/2366 symbols completed. NOG took 43.8s. Estimated remaining: 1h 50m 28s. Rate: 7.8 symbols/min [2025-10-27T20:14:12.977223] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:13.051151] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:14:13.063440] [DEBUG] [LOCAL ] NOW: Loaded 48455 existing records from primary storage. [2025-10-27T20:14:13.064439] [INFO ] [MAIN ] NOW: Loaded 48455 existing records. [2025-10-27T20:14:13.219747] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-27T20:14:13.242991] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:13.243369] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-27T20:14:13.243421] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-27T20:14:13.244011] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-27T20:14:13.244070] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-27T20:14:13.599971] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:13.628601] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T20:14:14.014979] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-27T20:14:14.686484] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T20:14:14.814907] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-27T20:14:15.614921] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-27T20:14:15.643025] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T20:14:16.414925] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-27T20:14:16.653537] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T20:14:17.050120] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:14:17.214938] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-27T20:14:17.916394] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:14:18.014928] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-27T20:14:18.677459] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T20:14:18.814947] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-27T20:14:19.614961] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-27T20:14:19.862567] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T20:14:20.414920] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-27T20:14:20.852521] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T20:14:21.214915] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-27T20:14:21.847549] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T20:14:22.014943] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-27T20:14:22.556250] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T20:14:22.630607] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T20:14:22.814921] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-27T20:14:23.399661] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:14:23.614958] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-27T20:14:24.414974] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-27T20:14:24.521542] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T20:14:25.222434] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-27T20:14:25.227465] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T20:14:26.014938] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-27T20:14:26.229431] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T20:14:26.485581] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T20:14:26.490473] [INFO ] [REMOTE ] NOTE: Full fetch complete (60333 records). [2025-10-27T20:14:26.490605] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-27T20:14:26.827550] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-27T20:14:26.881210] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-27T20:14:26.881286] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-27T20:14:26.882197] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-27T20:14:26.882263] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-27T20:14:26.883919] [DEBUG] [LOCAL ] NOTE: Trimmed 60333 records to 39249 (keeping 200 days of data) [2025-10-27T20:14:27.102138] [DEBUG] [LOCAL ] NOTE: Primary data saved (39249 records). [2025-10-27T20:14:27.102274] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-27T20:14:27.102348] [INFO ] [MAIN ] Update Progress: 1509/2366 symbols completed. NOTE took 25.9s. Estimated remaining: 1h 50m 24s. Rate: 7.8 symbols/min [2025-10-27T20:14:27.268552] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:27.268779] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-27T20:14:27.268823] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-27T20:14:27.268928] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-27T20:14:27.268970] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-27T20:14:27.269012] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-27T20:14:27.269044] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-27T20:14:27.623233] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-27T20:14:27.631802] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:27.682177] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T20:14:27.692086] [INFO ] [REMOTE ] NOMD: Full fetch complete (61066 records). [2025-10-27T20:14:27.692238] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-27T20:14:28.063725] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-27T20:14:28.063810] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-27T20:14:28.064752] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-27T20:14:28.064814] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-27T20:14:28.065949] [DEBUG] [LOCAL ] NOMD: Trimmed 61066 records to 43215 (keeping 200 days of data) [2025-10-27T20:14:28.324478] [DEBUG] [LOCAL ] NOMD: Primary data saved (43215 records). [2025-10-27T20:14:28.324598] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-27T20:14:28.324923] [INFO ] [MAIN ] Update Progress: 1510/2366 symbols completed. NOMD took 31.1s. Estimated remaining: 1h 50m 13s. Rate: 7.8 symbols/min [2025-10-27T20:14:28.415788] [INFO ] [REMOTE ] NP: Fetching primary data for 2025-01. [2025-10-27T20:14:28.501538] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:28.501887] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-27T20:14:28.501952] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-27T20:14:28.502147] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-27T20:14:28.502344] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-27T20:14:28.502418] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-27T20:14:28.502532] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-27T20:14:28.638513] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:14:28.698445] [WARN ] [REMOTE ] NP: No data returned for month 2025-01 [2025-10-27T20:14:28.707042] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:14:28.723693] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-27T20:14:28.743104] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T20:14:28.773350] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:14:28.797495] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-27T20:14:28.811886] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-27T20:14:28.818487] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-27T20:14:28.823713] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-27T20:14:28.834298] [INFO ] [MAIN ] Update Progress: 1511/2366 symbols completed. NP took 1.7s. Estimated remaining: 1h 50m 1s. Rate: 7.8 symbols/min [2025-10-27T20:14:29.030070] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:29.100217] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:29.117410] [DEBUG] [LOCAL ] NPCT: Loaded 16625 existing records from primary storage. [2025-10-27T20:14:29.117637] [INFO ] [MAIN ] NPCT: Loaded 16625 existing records. [2025-10-27T20:14:29.216420] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-27T20:14:29.296328] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:29.319096] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-27T20:14:29.319255] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-27T20:14:29.319959] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-27T20:14:29.320030] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-27T20:14:29.320803] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T20:14:29.687896] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:30.014963] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-27T20:14:30.748239] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T20:14:30.814938] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-27T20:14:31.533687] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T20:14:31.614886] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-27T20:14:31.860135] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T20:14:32.415006] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-27T20:14:33.214951] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-27T20:14:33.274179] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T20:14:33.572470] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T20:14:34.014936] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-27T20:14:34.655797] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:14:34.814915] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-27T20:14:35.458113] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T20:14:35.614920] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-27T20:14:36.238941] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T20:14:36.247905] [INFO ] [REMOTE ] NOW: Full fetch complete (70628 records). [2025-10-27T20:14:36.248008] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-27T20:14:36.423681] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-27T20:14:36.652800] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-27T20:14:36.652900] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-27T20:14:36.654011] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-27T20:14:36.654072] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-27T20:14:36.684549] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T20:14:36.683293] [DEBUG] [LOCAL ] NOW: Trimmed 70628 records to 47604 (keeping 200 days of data) [2025-10-27T20:14:36.997510] [DEBUG] [LOCAL ] NOW: Primary data saved (47604 records). [2025-10-27T20:14:36.997630] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-27T20:14:36.998410] [INFO ] [MAIN ] Update Progress: 1512/2366 symbols completed. NOW took 24.2s. Estimated remaining: 1h 49m 54s. Rate: 7.8 symbols/min [2025-10-27T20:14:37.188127] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:37.189156] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T20:14:37.205531] [DEBUG] [LOCAL ] NPFD: Loaded 10191 existing records from primary storage. [2025-10-27T20:14:37.205766] [INFO ] [MAIN ] NPFD: Loaded 10191 existing records. [2025-10-27T20:14:37.220132] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-10-27T20:14:37.395776] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:37.395983] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-27T20:14:37.396029] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-27T20:14:37.396188] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-27T20:14:37.396244] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-27T20:14:37.497980] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:14:37.501408] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-10-27T20:14:37.506847] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:14:37.517270] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-27T20:14:37.540324] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:14:37.559381] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-27T20:14:37.560377] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-27T20:14:37.575486] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-27T20:14:37.621897] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-27T20:14:37.642542] [INFO ] [MAIN ] Update Progress: 1513/2366 symbols completed. NPB took 9.3s. Estimated remaining: 1h 49m 42s. Rate: 7.8 symbols/min [2025-10-27T20:14:37.910783] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:37.928044] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:37.938473] [DEBUG] [LOCAL ] NPK: Loaded 8472 existing records from primary storage. [2025-10-27T20:14:37.938712] [INFO ] [MAIN ] NPK: Loaded 8472 existing records. [2025-10-27T20:14:38.020163] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-27T20:14:38.116676] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:38.116853] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-27T20:14:38.116900] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-27T20:14:38.117049] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-27T20:14:38.117087] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-27T20:14:38.464927] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:38.814966] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-27T20:14:38.934505] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T20:14:39.278418] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T20:14:39.614990] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-27T20:14:40.415000] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-27T20:14:41.168458] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:14:41.214905] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-27T20:14:41.430223] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T20:14:41.708106] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T20:14:42.014969] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-27T20:14:42.586257] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:14:42.814949] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-27T20:14:43.591587] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T20:14:43.614931] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-27T20:14:44.195321] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T20:14:44.414939] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-27T20:14:45.215006] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-27T20:14:45.659962] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T20:14:46.014915] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-27T20:14:46.134815] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T20:14:46.145346] [INFO ] [REMOTE ] NOV: Full fetch complete (77202 records). [2025-10-27T20:14:46.145495] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-27T20:14:46.537260] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-27T20:14:46.537336] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-27T20:14:46.538461] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-27T20:14:46.538522] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-27T20:14:46.539993] [DEBUG] [LOCAL ] NOV: Trimmed 77202 records to 53159 (keeping 200 days of data) [2025-10-27T20:14:46.788109] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:14:46.825037] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-27T20:14:46.874371] [DEBUG] [LOCAL ] NOV: Primary data saved (53159 records). [2025-10-27T20:14:46.874628] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-27T20:14:46.874762] [INFO ] [MAIN ] Update Progress: 1514/2366 symbols completed. NOV took 36.6s. Estimated remaining: 1h 49m 35s. Rate: 7.8 symbols/min [2025-10-27T20:14:47.039011] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:47.076865] [DEBUG] [LOCAL ] NPKI: Loaded 40975 existing records from primary storage. [2025-10-27T20:14:47.077162] [INFO ] [MAIN ] NPKI: Loaded 40975 existing records. [2025-10-27T20:14:47.250205] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:47.250425] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-27T20:14:47.250472] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-27T20:14:47.250730] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-10-27T20:14:47.250789] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-27T20:14:47.543607] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T20:14:47.616514] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:47.616602] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-27T20:14:48.192549] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T20:14:48.414936] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-27T20:14:49.068116] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T20:14:49.214956] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-27T20:14:50.015009] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-27T20:14:50.122891] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T20:14:50.738174] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T20:14:50.814991] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-27T20:14:51.306276] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T20:14:51.614957] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-27T20:14:52.414950] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-27T20:14:52.978632] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T20:14:53.115915] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T20:14:53.214959] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-27T20:14:53.938733] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:14:53.942034] [INFO ] [REMOTE ] NPFD: Full fetch complete (14704 records). [2025-10-27T20:14:53.942151] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-27T20:14:54.020154] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-27T20:14:54.331967] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-27T20:14:54.332058] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-27T20:14:54.332435] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-27T20:14:54.332495] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-27T20:14:54.332983] [DEBUG] [LOCAL ] NPFD: Trimmed 14704 records to 9868 (keeping 200 days of data) [2025-10-27T20:14:54.391903] [DEBUG] [LOCAL ] NPFD: Primary data saved (9868 records). [2025-10-27T20:14:54.392026] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-27T20:14:54.392103] [INFO ] [MAIN ] Update Progress: 1515/2366 symbols completed. NPFD took 17.4s. Estimated remaining: 1h 49m 27s. Rate: 7.8 symbols/min [2025-10-27T20:14:54.556159] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:14:54.571686] [DEBUG] [LOCAL ] NPO: Loaded 13671 existing records from primary storage. [2025-10-27T20:14:54.571918] [INFO ] [MAIN ] NPO: Loaded 13671 existing records. [2025-10-27T20:14:54.746329] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:14:54.746736] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-27T20:14:54.746792] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-27T20:14:54.747033] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-27T20:14:54.747075] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-27T20:14:54.816561] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-27T20:14:54.856107] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T20:14:55.113912] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:14:55.614444] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:14:55.618620] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-27T20:14:56.383280] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T20:14:56.414898] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-27T20:14:57.214989] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-27T20:14:57.232304] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T20:14:57.769408] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T20:14:58.014933] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-27T20:14:58.645459] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T20:14:58.814933] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-27T20:14:59.614953] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-27T20:14:59.830191] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T20:15:00.347340] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T20:15:00.414912] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-27T20:15:01.187176] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:15:01.214910] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-27T20:15:01.975320] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T20:15:02.014911] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-27T20:15:02.706086] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T20:15:02.814999] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-27T20:15:03.614954] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-27T20:15:04.017567] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T20:15:04.258314] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T20:15:04.414957] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-27T20:15:05.215001] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-27T20:15:05.327285] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T20:15:06.009121] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T20:15:06.014896] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-27T20:15:06.814954] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-27T20:15:06.895964] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T20:15:07.614935] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-27T20:15:07.743302] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T20:15:07.746140] [INFO ] [REMOTE ] NPCT: Full fetch complete (24173 records). [2025-10-27T20:15:07.746222] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-27T20:15:08.110595] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-27T20:15:08.110711] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-27T20:15:08.111234] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-27T20:15:08.111277] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-27T20:15:08.112099] [DEBUG] [LOCAL ] NPCT: Trimmed 24173 records to 16200 (keeping 200 days of data) [2025-10-27T20:15:08.213299] [DEBUG] [LOCAL ] NPCT: Primary data saved (16200 records). [2025-10-27T20:15:08.213444] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-27T20:15:08.213528] [INFO ] [MAIN ] Update Progress: 1516/2366 symbols completed. NPCT took 39.4s. Estimated remaining: 1h 49m 23s. Rate: 7.8 symbols/min [2025-10-27T20:15:08.399178] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:08.406533] [DEBUG] [LOCAL ] NPV: Loaded 5424 existing records from primary storage. [2025-10-27T20:15:08.406750] [INFO ] [MAIN ] NPV: Loaded 5424 existing records. [2025-10-27T20:15:08.420129] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-27T20:15:08.587165] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:08.587413] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-27T20:15:08.596769] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:15:08.596368] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-27T20:15:08.600564] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-27T20:15:08.600523] [INFO ] [REMOTE ] NPK: Full fetch complete (11189 records). [2025-10-27T20:15:08.600711] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-27T20:15:08.600785] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-27T20:15:09.216789] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-27T20:15:09.356082] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:09.439926] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T20:15:09.481120] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-27T20:15:09.481203] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-27T20:15:09.481575] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-27T20:15:09.481639] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-27T20:15:09.482185] [DEBUG] [LOCAL ] NPK: Trimmed 11189 records to 8398 (keeping 200 days of data) [2025-10-27T20:15:09.531692] [DEBUG] [LOCAL ] NPK: Primary data saved (8398 records). [2025-10-27T20:15:09.531826] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-27T20:15:09.531902] [INFO ] [MAIN ] Update Progress: 1517/2366 symbols completed. NPK took 31.9s. Estimated remaining: 1h 49m 12s. Rate: 7.8 symbols/min [2025-10-27T20:15:10.015011] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-27T20:15:10.548022] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:15:10.608874] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T20:15:10.814944] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-27T20:15:11.398804] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T20:15:11.614923] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-27T20:15:12.247840] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T20:15:12.415021] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-27T20:15:13.214978] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-27T20:15:13.404719] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T20:15:14.014913] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-27T20:15:14.193980] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T20:15:14.631236] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:15:14.814984] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-27T20:15:15.437054] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T20:15:15.615005] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-27T20:15:16.014698] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-27T20:15:16.414943] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-27T20:15:17.214947] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-27T20:15:17.522880] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T20:15:17.792483] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T20:15:18.014958] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-27T20:15:18.814975] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-27T20:15:19.417842] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T20:15:19.614914] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-27T20:15:19.651137] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T20:15:20.414936] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-27T20:15:20.489343] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T20:15:21.017528] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T20:15:21.214931] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-27T20:15:22.014912] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-27T20:15:22.398878] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T20:15:22.402473] [INFO ] [REMOTE ] NPO: Full fetch complete (19017 records). [2025-10-27T20:15:22.402572] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-27T20:15:22.763760] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-27T20:15:22.763846] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-27T20:15:22.764272] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-27T20:15:22.764312] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-27T20:15:22.765070] [DEBUG] [LOCAL ] NPO: Trimmed 19017 records to 13385 (keeping 200 days of data) [2025-10-27T20:15:22.823879] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-27T20:15:22.850758] [DEBUG] [LOCAL ] NPO: Primary data saved (13385 records). [2025-10-27T20:15:22.850921] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-27T20:15:22.851039] [INFO ] [MAIN ] Update Progress: 1518/2366 symbols completed. NPO took 28.5s. Estimated remaining: 1h 49m 7s. Rate: 7.8 symbols/min [2025-10-27T20:15:23.325142] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T20:15:23.332957] [INFO ] [REMOTE ] NPKI: Full fetch complete (56431 records). [2025-10-27T20:15:23.333076] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-27T20:15:23.438969] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T20:15:23.620041] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-27T20:15:23.734459] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-27T20:15:23.734537] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-27T20:15:23.735547] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-27T20:15:23.735611] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-27T20:15:23.736846] [DEBUG] [LOCAL ] NPKI: Trimmed 56431 records to 40227 (keeping 200 days of data) [2025-10-27T20:15:23.974190] [DEBUG] [LOCAL ] NPKI: Primary data saved (40227 records). [2025-10-27T20:15:23.974312] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-27T20:15:23.974389] [INFO ] [MAIN ] Update Progress: 1519/2366 symbols completed. NPKI took 37.1s. Estimated remaining: 1h 48m 56s. Rate: 7.8 symbols/min [2025-10-27T20:15:24.460334] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T20:15:24.462400] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-27T20:15:25.326399] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T20:15:25.328236] [INFO ] [REMOTE ] NPV: Full fetch complete (7183 records). [2025-10-27T20:15:25.328307] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-27T20:15:25.714287] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-27T20:15:25.714364] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-27T20:15:25.714568] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-27T20:15:25.714607] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-27T20:15:25.715051] [DEBUG] [LOCAL ] NPV: Trimmed 7183 records to 5319 (keeping 200 days of data) [2025-10-27T20:15:25.746968] [DEBUG] [LOCAL ] NPV: Primary data saved (5319 records). [2025-10-27T20:15:25.747090] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-27T20:15:25.747168] [INFO ] [MAIN ] Update Progress: 1520/2366 symbols completed. NPV took 17.5s. Estimated remaining: 1h 48m 45s. Rate: 7.8 symbols/min [2025-10-27T20:15:26.353922] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:26.326159] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:26.428805] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:26.447839] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:26.457149] [DEBUG] [LOCAL ] NREF: Loaded 7897 existing records from primary storage. [2025-10-27T20:15:26.457720] [INFO ] [MAIN ] NREF: Loaded 7897 existing records. [2025-10-27T20:15:26.574094] [DEBUG] [LOCAL ] NQP: Loaded 9155 existing records from primary storage. [2025-10-27T20:15:26.578014] [INFO ] [MAIN ] NQP: Loaded 9155 existing records. [2025-10-27T20:15:26.764101] [DEBUG] [LOCAL ] NPWR: Loaded 44194 existing records from primary storage. [2025-10-27T20:15:26.793838] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:26.793949] [INFO ] [MAIN ] NPWR: Loaded 44194 existing records. [2025-10-27T20:15:26.794515] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-27T20:15:26.794631] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-27T20:15:26.816052] [DEBUG] [LOCAL ] NRDY: Loaded 32551 existing records from primary storage. [2025-10-27T20:15:26.877923] [INFO ] [MAIN ] NRDY: Loaded 32551 existing records. [2025-10-27T20:15:26.872729] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-27T20:15:26.887684] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-27T20:15:27.064381] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:27.137825] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-27T20:15:27.226466] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-27T20:15:27.252929] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-27T20:15:27.263232] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:27.345339] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-27T20:15:27.345402] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-27T20:15:27.429745] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-27T20:15:27.517599] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-27T20:15:27.530992] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-27T20:15:27.525710] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:27.583169] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-27T20:15:27.640048] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-27T20:15:27.680802] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-27T20:15:27.714908] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-27T20:15:28.023251] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:28.075544] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-27T20:15:28.574284] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:28.589567] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-27T20:15:28.578447] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:28.601134] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-27T20:15:28.679558] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:28.679912] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-27T20:15:28.821587] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:15:28.823450] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-27T20:15:29.181710] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:15:29.214953] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-27T20:15:29.390788] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T20:15:29.732215] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T20:15:29.928748] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T20:15:30.014893] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-27T20:15:30.275414] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T20:15:30.814970] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-27T20:15:31.226207] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T20:15:31.239866] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T20:15:31.614979] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-27T20:15:32.414956] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-27T20:15:33.214908] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-27T20:15:33.283381] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:15:33.374505] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T20:15:33.695205] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T20:15:34.015036] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-27T20:15:34.814984] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-27T20:15:35.614999] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-27T20:15:35.665511] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T20:15:35.776492] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T20:15:36.414980] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-27T20:15:36.739865] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T20:15:37.105448] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T20:15:37.215010] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-27T20:15:38.015010] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-27T20:15:38.623278] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T20:15:38.820514] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-27T20:15:38.841934] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T20:15:39.349398] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T20:15:39.614957] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-27T20:15:40.414941] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-27T20:15:41.214905] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-27T20:15:41.316160] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T20:15:41.347784] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T20:15:41.664631] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T20:15:42.014979] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-27T20:15:42.814954] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-27T20:15:43.375818] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T20:15:43.487936] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T20:15:43.614948] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-27T20:15:44.414974] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-27T20:15:45.000120] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T20:15:45.073030] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T20:15:45.214923] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-27T20:15:46.014927] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-27T20:15:46.086730] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T20:15:46.088849] [INFO ] [REMOTE ] NREF: Full fetch complete (10896 records). [2025-10-27T20:15:46.088928] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-27T20:15:46.463755] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-27T20:15:46.463818] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-27T20:15:46.464090] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-27T20:15:46.464127] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-27T20:15:46.464560] [DEBUG] [LOCAL ] NREF: Trimmed 10896 records to 7696 (keeping 200 days of data) [2025-10-27T20:15:46.510937] [DEBUG] [LOCAL ] NREF: Primary data saved (7696 records). [2025-10-27T20:15:46.511084] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-27T20:15:46.511171] [INFO ] [MAIN ] Update Progress: 1521/2366 symbols completed. NREF took 20.8s. Estimated remaining: 1h 48m 44s. Rate: 7.8 symbols/min [2025-10-27T20:15:46.680632] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:46.729516] [DEBUG] [LOCAL ] NRG: Loaded 53559 existing records from primary storage. [2025-10-27T20:15:46.729839] [INFO ] [MAIN ] NRG: Loaded 53559 existing records. [2025-10-27T20:15:46.824491] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-27T20:15:46.904569] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:46.904762] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-27T20:15:46.904810] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-27T20:15:46.904989] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-10-27T20:15:46.905025] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-27T20:15:47.256425] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:47.614939] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-27T20:15:47.626830] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T20:15:47.827272] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T20:15:48.414950] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-27T20:15:49.056234] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:15:49.214913] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-27T20:15:49.768608] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T20:15:49.923007] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T20:15:50.014977] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-27T20:15:50.737380] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T20:15:50.814951] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-27T20:15:51.614921] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-27T20:15:52.057315] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T20:15:52.414957] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-27T20:15:53.214920] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-27T20:15:53.421085] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T20:15:53.786515] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T20:15:54.014923] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-27T20:15:54.082709] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T20:15:54.814936] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-27T20:15:55.315088] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T20:15:55.324314] [INFO ] [REMOTE ] NPWR: Full fetch complete (60974 records). [2025-10-27T20:15:55.324409] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-27T20:15:55.623704] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-27T20:15:55.718822] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-27T20:15:55.718892] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-27T20:15:55.719840] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-27T20:15:55.719918] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-27T20:15:55.721092] [DEBUG] [LOCAL ] NPWR: Trimmed 60974 records to 43554 (keeping 200 days of data) [2025-10-27T20:15:55.957687] [DEBUG] [LOCAL ] NPWR: Primary data saved (43554 records). [2025-10-27T20:15:55.957812] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-27T20:15:55.958467] [INFO ] [MAIN ] Update Progress: 1522/2366 symbols completed. NPWR took 30.2s. Estimated remaining: 1h 48m 37s. Rate: 7.8 symbols/min [2025-10-27T20:15:56.149686] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T20:15:56.148985] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:56.199077] [DEBUG] [LOCAL ] NRGV: Loaded 44662 existing records from primary storage. [2025-10-27T20:15:56.199370] [INFO ] [MAIN ] NRGV: Loaded 44662 existing records. [2025-10-27T20:15:56.372375] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:56.372564] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-27T20:15:56.372610] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-27T20:15:56.372848] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-27T20:15:56.372904] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-27T20:15:56.415159] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-27T20:15:56.482414] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T20:15:56.511078] [INFO ] [REMOTE ] NQP: Full fetch complete (12760 records). [2025-10-27T20:15:56.567725] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-27T20:15:56.895993] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:57.096587] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-27T20:15:57.096697] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-27T20:15:57.097016] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-27T20:15:57.097076] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-27T20:15:57.097542] [DEBUG] [LOCAL ] NQP: Trimmed 12760 records to 8934 (keeping 200 days of data) [2025-10-27T20:15:57.149402] [DEBUG] [LOCAL ] NQP: Primary data saved (8934 records). [2025-10-27T20:15:57.149510] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-27T20:15:57.149582] [INFO ] [MAIN ] Update Progress: 1523/2366 symbols completed. NQP took 31.4s. Estimated remaining: 1h 48m 26s. Rate: 7.8 symbols/min [2025-10-27T20:15:57.222249] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-27T20:15:57.319085] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:57.338861] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T20:15:57.362808] [DEBUG] [LOCAL ] NRK: Loaded 20728 existing records from primary storage. [2025-10-27T20:15:57.363057] [INFO ] [MAIN ] NRK: Loaded 20728 existing records. [2025-10-27T20:15:57.535552] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:15:57.535749] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-27T20:15:57.535798] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-27T20:15:57.536038] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-27T20:15:57.536076] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-27T20:15:57.884148] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:15:58.014948] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-27T20:15:58.745590] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T20:15:58.814908] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-27T20:15:59.066866] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T20:15:59.073121] [INFO ] [REMOTE ] NRDY: Full fetch complete (49600 records). [2025-10-27T20:15:59.073230] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-27T20:15:59.455323] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-27T20:15:59.455413] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-27T20:15:59.456295] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-27T20:15:59.456357] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-27T20:15:59.457344] [DEBUG] [LOCAL ] NRDY: Trimmed 49600 records to 32049 (keeping 200 days of data) [2025-10-27T20:15:59.615108] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-27T20:15:59.640439] [DEBUG] [LOCAL ] NRDY: Primary data saved (32049 records). [2025-10-27T20:15:59.640595] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-27T20:15:59.640706] [INFO ] [MAIN ] Update Progress: 1524/2366 symbols completed. NRDY took 33.9s. Estimated remaining: 1h 48m 15s. Rate: 7.8 symbols/min [2025-10-27T20:15:59.831803] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:15:59.838876] [DEBUG] [LOCAL ] NRP: Loaded 4222 existing records from primary storage. [2025-10-27T20:15:59.839085] [INFO ] [MAIN ] NRP: Loaded 4222 existing records. [2025-10-27T20:16:00.020479] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:00.020883] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-27T20:16:00.021020] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-27T20:16:00.028944] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-27T20:16:00.041245] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-27T20:16:00.073741] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T20:16:00.405327] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:00.414905] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-27T20:16:01.144169] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T20:16:01.214953] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-27T20:16:01.353702] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T20:16:02.014952] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-27T20:16:02.540304] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T20:16:02.735634] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T20:16:02.814935] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-27T20:16:03.590846] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T20:16:03.614912] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-27T20:16:04.328832] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T20:16:04.414932] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-27T20:16:05.214931] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-27T20:16:05.649687] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T20:16:05.782034] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:16:06.014972] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-27T20:16:06.790353] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T20:16:06.814908] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-27T20:16:07.614906] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-27T20:16:07.918562] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T20:16:08.183203] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T20:16:08.414947] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-27T20:16:09.215002] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-27T20:16:09.904618] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T20:16:09.971390] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T20:16:10.014936] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-27T20:16:10.788016] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:16:10.814955] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-27T20:16:11.614919] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-27T20:16:11.693887] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T20:16:12.414942] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-27T20:16:13.214957] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-27T20:16:13.419433] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T20:16:13.740367] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T20:16:13.976133] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T20:16:14.014925] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-27T20:16:14.814944] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-27T20:16:15.345598] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T20:16:15.397481] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T20:16:15.614945] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-27T20:16:16.141661] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:16:16.143041] [INFO ] [REMOTE ] NRP: Full fetch complete (6285 records). [2025-10-27T20:16:16.143108] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-27T20:16:16.415681] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-27T20:16:16.499599] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-27T20:16:16.499749] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-27T20:16:16.500069] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-27T20:16:16.500153] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-27T20:16:16.501071] [DEBUG] [LOCAL ] NRP: Trimmed 6285 records to 4026 (keeping 200 days of data) [2025-10-27T20:16:16.534921] [DEBUG] [LOCAL ] NRP: Primary data saved (4026 records). [2025-10-27T20:16:16.535077] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-27T20:16:16.535181] [INFO ] [MAIN ] Update Progress: 1525/2366 symbols completed. NRP took 16.9s. Estimated remaining: 1h 48m 13s. Rate: 7.8 symbols/min [2025-10-27T20:16:16.716256] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:16.723726] [DEBUG] [LOCAL ] NRT: Loaded 4973 existing records from primary storage. [2025-10-27T20:16:16.723911] [INFO ] [MAIN ] NRT: Loaded 4973 existing records. [2025-10-27T20:16:16.899261] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:16.899553] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-27T20:16:16.899613] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-27T20:16:16.900058] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-27T20:16:16.900116] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-27T20:16:17.220165] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-27T20:16:17.259734] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:18.014940] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-27T20:16:18.622758] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T20:16:18.723575] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-27T20:16:18.771225] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T20:16:18.814905] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-27T20:16:19.614935] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-27T20:16:20.119670] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T20:16:20.133046] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T20:16:20.414935] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-27T20:16:20.920607] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T20:16:21.214962] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-27T20:16:22.014983] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-27T20:16:22.201925] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:16:22.696091] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-27T20:16:22.814935] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-27T20:16:23.614967] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-27T20:16:24.398920] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T20:16:24.414893] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-27T20:16:25.008075] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T20:16:25.214986] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-27T20:16:25.944223] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T20:16:26.014916] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-27T20:16:26.093033] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T20:16:26.509368] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T20:16:26.814932] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-27T20:16:27.614939] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-27T20:16:28.150839] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T20:16:28.414910] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-27T20:16:28.669632] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T20:16:29.214956] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-27T20:16:29.963434] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T20:16:30.014915] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-27T20:16:30.815069] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-27T20:16:31.216703] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-27T20:16:31.614916] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-27T20:16:31.817757] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T20:16:31.828555] [INFO ] [REMOTE ] NRGV: Full fetch complete (62618 records). [2025-10-27T20:16:31.828687] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-27T20:16:31.940867] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T20:16:32.221338] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-27T20:16:32.221419] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-27T20:16:32.222395] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-27T20:16:32.222460] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-27T20:16:32.223774] [DEBUG] [LOCAL ] NRGV: Trimmed 62618 records to 44049 (keeping 200 days of data) [2025-10-27T20:16:32.415303] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-27T20:16:32.473479] [DEBUG] [LOCAL ] NRGV: Primary data saved (44049 records). [2025-10-27T20:16:32.473597] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-27T20:16:32.473695] [INFO ] [MAIN ] Update Progress: 1526/2366 symbols completed. NRGV took 36.5s. Estimated remaining: 1h 48m 10s. Rate: 7.8 symbols/min [2025-10-27T20:16:32.643763] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:32.649318] [DEBUG] [LOCAL ] NRUC: Loaded 3135 existing records from primary storage. [2025-10-27T20:16:32.649510] [INFO ] [MAIN ] NRUC: Loaded 3135 existing records. [2025-10-27T20:16:32.855337] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:32.855564] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-27T20:16:32.855619] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-27T20:16:32.855775] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-27T20:16:32.855824] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-27T20:16:33.206700] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:33.211852] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:16:33.214885] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-27T20:16:33.717055] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T20:16:33.912172] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-27T20:16:34.014906] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-27T20:16:34.708054] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T20:16:34.814942] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-27T20:16:35.614953] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-27T20:16:36.414978] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-27T20:16:36.420401] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T20:16:36.422124] [INFO ] [REMOTE ] NRT: Full fetch complete (7622 records). [2025-10-27T20:16:36.422193] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-27T20:16:36.788560] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-27T20:16:36.788686] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-27T20:16:36.788953] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-27T20:16:36.789086] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-27T20:16:36.789780] [DEBUG] [LOCAL ] NRT: Trimmed 7622 records to 4846 (keeping 200 days of data) [2025-10-27T20:16:36.817456] [DEBUG] [LOCAL ] NRT: Primary data saved (4846 records). [2025-10-27T20:16:36.817678] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-27T20:16:36.817823] [INFO ] [MAIN ] Update Progress: 1527/2366 symbols completed. NRT took 20.3s. Estimated remaining: 1h 48m 0s. Rate: 7.8 symbols/min [2025-10-27T20:16:36.945572] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-27T20:16:37.024509] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:37.063841] [DEBUG] [LOCAL ] NSA: Loaded 45778 existing records from primary storage. [2025-10-27T20:16:37.064120] [INFO ] [MAIN ] NSA: Loaded 45778 existing records. [2025-10-27T20:16:37.215361] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-27T20:16:37.236943] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:37.237288] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-27T20:16:37.237344] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-27T20:16:37.237693] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-27T20:16:37.237769] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-27T20:16:37.623264] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:37.624907] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T20:16:37.629364] [INFO ] [REMOTE ] NRK: Full fetch complete (27724 records). [2025-10-27T20:16:37.629504] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-27T20:16:37.953083] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T20:16:38.020218] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-27T20:16:38.038942] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-27T20:16:38.039037] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-27T20:16:38.039621] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-27T20:16:38.039707] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-27T20:16:38.040901] [DEBUG] [LOCAL ] NRK: Trimmed 27724 records to 20288 (keeping 200 days of data) [2025-10-27T20:16:38.162930] [DEBUG] [LOCAL ] NRK: Primary data saved (20288 records). [2025-10-27T20:16:38.163057] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-27T20:16:38.163132] [INFO ] [MAIN ] Update Progress: 1528/2366 symbols completed. NRK took 41.0s. Estimated remaining: 1h 47m 49s. Rate: 7.8 symbols/min [2025-10-27T20:16:38.336558] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:38.380620] [DEBUG] [LOCAL ] NSC: Loaded 49373 existing records from primary storage. [2025-10-27T20:16:38.380945] [INFO ] [MAIN ] NSC: Loaded 49373 existing records. [2025-10-27T20:16:38.552141] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:38.552339] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-27T20:16:38.552390] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-27T20:16:38.552796] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-10-27T20:16:38.552853] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-27T20:16:38.686318] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T20:16:38.820147] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-27T20:16:38.919990] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:39.614979] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-27T20:16:40.146384] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:16:40.156285] [INFO ] [REMOTE ] NRG: Full fetch complete (76401 records). [2025-10-27T20:16:40.156421] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-27T20:16:40.157260] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:16:40.157357] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:16:40.157428] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:16:40.157502] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-27T20:16:40.157566] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-27T20:16:40.157601] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-27T20:16:40.157770] [DEBUG] [LOCAL ] NRG: Deleted derivative data file. [2025-10-27T20:16:40.157863] [INFO ] [MAIN ] Update Progress: 1529/2366 symbols completed. NRG took 53.6s. Estimated remaining: 1h 47m 38s. Rate: 7.8 symbols/min [2025-10-27T20:16:40.335009] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:40.369188] [DEBUG] [LOCAL ] NSP: Loaded 36269 existing records from primary storage. [2025-10-27T20:16:40.369479] [INFO ] [MAIN ] NSP: Loaded 36269 existing records. [2025-10-27T20:16:40.422292] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-27T20:16:40.541288] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T20:16:40.583986] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:40.584186] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-27T20:16:40.584232] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-27T20:16:40.584497] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-27T20:16:40.584540] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-27T20:16:40.936569] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:41.214953] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-27T20:16:42.014962] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-27T20:16:42.380567] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T20:16:42.408700] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T20:16:42.815004] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-27T20:16:43.380824] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T20:16:43.614935] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-27T20:16:44.117915] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T20:16:44.129268] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T20:16:44.414989] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-27T20:16:45.214947] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-27T20:16:46.014948] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-27T20:16:46.090369] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T20:16:46.719742] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T20:16:46.814902] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-27T20:16:47.341487] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T20:16:47.614943] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-27T20:16:48.241593] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T20:16:48.414938] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-27T20:16:49.081965] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:16:49.214905] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-27T20:16:50.014937] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-27T20:16:50.079990] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T20:16:50.586044] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T20:16:50.814919] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-27T20:16:51.134570] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T20:16:51.614965] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-27T20:16:52.282679] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T20:16:52.294573] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T20:16:52.414936] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-27T20:16:53.116992] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T20:16:53.214907] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-27T20:16:53.665551] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T20:16:54.014993] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-27T20:16:54.814988] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-27T20:16:55.309060] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T20:16:55.409692] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T20:16:55.614993] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-27T20:16:56.414990] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-27T20:16:56.629379] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T20:16:57.214941] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-27T20:16:57.613902] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T20:16:57.828351] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T20:16:57.829600] [INFO ] [REMOTE ] NRUC: Full fetch complete (4900 records). [2025-10-27T20:16:57.829693] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-27T20:16:58.020074] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-27T20:16:58.198406] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-27T20:16:58.198482] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-27T20:16:58.198636] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-27T20:16:58.198714] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-27T20:16:58.199080] [DEBUG] [LOCAL ] NRUC: Trimmed 4900 records to 3083 (keeping 200 days of data) [2025-10-27T20:16:58.217353] [DEBUG] [LOCAL ] NRUC: Primary data saved (3083 records). [2025-10-27T20:16:58.217447] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-27T20:16:58.217521] [INFO ] [MAIN ] Update Progress: 1530/2366 symbols completed. NRUC took 25.7s. Estimated remaining: 1h 47m 36s. Rate: 7.8 symbols/min [2025-10-27T20:16:58.382450] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:16:58.402197] [DEBUG] [LOCAL ] NTB: Loaded 20483 existing records from primary storage. [2025-10-27T20:16:58.402419] [INFO ] [MAIN ] NTB: Loaded 20483 existing records. [2025-10-27T20:16:58.579246] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:16:58.579519] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-27T20:16:58.579572] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-27T20:16:58.579775] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-27T20:16:58.579835] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-27T20:16:58.823720] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-27T20:16:58.937379] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:16:59.614932] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-27T20:17:00.294181] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-27T20:17:00.414916] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-27T20:17:00.902769] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:17:01.165712] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T20:17:01.214904] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-27T20:17:01.904792] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T20:17:02.014927] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-27T20:17:02.814915] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-27T20:17:03.139906] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T20:17:03.614951] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-27T20:17:03.837964] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T20:17:04.145450] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T20:17:04.152344] [INFO ] [REMOTE ] NSP: Full fetch complete (50187 records). [2025-10-27T20:17:04.152439] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-27T20:17:04.153011] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:17:04.153093] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:17:04.153135] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:17:04.153172] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-27T20:17:04.153225] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-27T20:17:04.153258] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-27T20:17:04.153380] [DEBUG] [LOCAL ] NSP: Deleted derivative data file. [2025-10-27T20:17:04.153444] [INFO ] [MAIN ] Update Progress: 1531/2366 symbols completed. NSP took 24.0s. Estimated remaining: 1h 47m 27s. Rate: 7.8 symbols/min [2025-10-27T20:17:04.321237] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:04.321406] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-27T20:17:04.321447] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-27T20:17:04.321557] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-27T20:17:04.321597] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-27T20:17:04.321637] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-27T20:17:04.321711] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-27T20:17:04.418219] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-27T20:17:04.666608] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:05.214996] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-27T20:17:05.358256] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T20:17:05.943486] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T20:17:06.014951] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-27T20:17:06.031275] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T20:17:06.814960] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-27T20:17:07.615045] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-27T20:17:08.337824] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T20:17:08.414940] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-27T20:17:08.485683] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T20:17:08.988971] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T20:17:09.214951] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-27T20:17:09.868418] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T20:17:09.876955] [INFO ] [REMOTE ] NSA: Full fetch complete (62594 records). [2025-10-27T20:17:09.877107] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-27T20:17:09.877849] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:17:09.877940] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:17:09.877981] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:17:09.878017] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-27T20:17:09.878070] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-27T20:17:09.878104] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-27T20:17:09.878235] [DEBUG] [LOCAL ] NSA: Deleted derivative data file. [2025-10-27T20:17:09.878343] [INFO ] [MAIN ] Update Progress: 1532/2366 symbols completed. NSA took 33.1s. Estimated remaining: 1h 47m 18s. Rate: 7.8 symbols/min [2025-10-27T20:17:10.024503] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-27T20:17:10.049857] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:10.096939] [DEBUG] [LOCAL ] NTR: Loaded 53361 existing records from primary storage. [2025-10-27T20:17:10.097237] [INFO ] [MAIN ] NTR: Loaded 53361 existing records. [2025-10-27T20:17:10.273858] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:10.274232] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-27T20:17:10.274293] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-27T20:17:10.274480] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-27T20:17:10.274519] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-27T20:17:10.566727] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T20:17:10.647951] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:10.779786] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T20:17:10.814980] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-27T20:17:11.614990] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-27T20:17:11.906115] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T20:17:12.414967] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-27T20:17:12.514161] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T20:17:13.214940] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-27T20:17:14.015004] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-27T20:17:14.506086] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T20:17:14.555754] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T20:17:14.814992] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-27T20:17:15.614963] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-27T20:17:15.898386] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:17:16.292283] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-27T20:17:16.414961] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-27T20:17:17.139822] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T20:17:17.214991] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-27T20:17:17.759347] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T20:17:18.014997] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-27T20:17:18.792494] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T20:17:18.814976] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-27T20:17:19.231276] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T20:17:19.614982] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-27T20:17:20.220069] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T20:17:20.414923] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-27T20:17:20.488925] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T20:17:21.214942] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-27T20:17:21.341825] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-27T20:17:22.014968] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-27T20:17:22.325937] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:17:22.572020] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T20:17:22.814978] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-27T20:17:23.391531] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T20:17:23.614925] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-27T20:17:24.391420] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T20:17:24.395672] [INFO ] [REMOTE ] NTB: Full fetch complete (30697 records). [2025-10-27T20:17:24.395747] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-27T20:17:24.424281] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-27T20:17:24.762448] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-27T20:17:24.762524] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-27T20:17:24.763115] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-27T20:17:24.763175] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-27T20:17:24.763871] [DEBUG] [LOCAL ] NTB: Trimmed 30697 records to 19938 (keeping 200 days of data) [2025-10-27T20:17:24.878486] [DEBUG] [LOCAL ] NTB: Primary data saved (19938 records). [2025-10-27T20:17:24.878607] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-27T20:17:24.878732] [INFO ] [MAIN ] Update Progress: 1533/2366 symbols completed. NTB took 26.7s. Estimated remaining: 1h 47m 15s. Rate: 7.8 symbols/min [2025-10-27T20:17:25.044224] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:25.083871] [DEBUG] [LOCAL ] NTST: Loaded 44699 existing records from primary storage. [2025-10-27T20:17:25.084151] [INFO ] [MAIN ] NTST: Loaded 44699 existing records. [2025-10-27T20:17:25.221400] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-27T20:17:25.260673] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:25.260817] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-27T20:17:25.260862] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-27T20:17:25.261139] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-27T20:17:25.261196] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-27T20:17:25.615543] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:25.851478] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:17:25.852146] [INFO ] [REMOTE ] NTEST: Full fetch complete (1963 records). [2025-10-27T20:17:25.852214] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-27T20:17:25.852552] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:17:25.852665] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:17:25.852722] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:17:25.852761] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-27T20:17:25.852812] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-27T20:17:25.852844] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-27T20:17:25.852883] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-27T20:17:25.852931] [INFO ] [MAIN ] Update Progress: 1534/2366 symbols completed. NTEST took 21.7s. Estimated remaining: 1h 47m 3s. Rate: 7.8 symbols/min [2025-10-27T20:17:26.025317] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-27T20:17:26.029039] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:26.083680] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-10-27T20:17:26.084035] [INFO ] [MAIN ] NU: Loaded 54526 existing records. [2025-10-27T20:17:26.275871] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:26.276277] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-27T20:17:26.276410] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-27T20:17:26.276833] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-27T20:17:26.276892] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-27T20:17:26.480829] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-27T20:17:26.682287] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:26.814929] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-27T20:17:27.614998] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-27T20:17:28.117936] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T20:17:28.414941] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-27T20:17:28.707147] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T20:17:29.132081] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T20:17:29.214964] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-27T20:17:30.014918] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-27T20:17:30.097684] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:17:30.106192] [INFO ] [REMOTE ] NSC: Full fetch complete (70618 records). [2025-10-27T20:17:30.106305] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-27T20:17:30.107082] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:17:30.107167] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:17:30.107208] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:17:30.107245] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-27T20:17:30.107299] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-27T20:17:30.107333] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-27T20:17:30.107460] [DEBUG] [LOCAL ] NSC: Deleted derivative data file. [2025-10-27T20:17:30.108182] [INFO ] [MAIN ] Update Progress: 1535/2366 symbols completed. NSC took 51.9s. Estimated remaining: 1h 46m 54s. Rate: 7.8 symbols/min [2025-10-27T20:17:30.283115] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:30.283414] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-27T20:17:30.283469] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-27T20:17:30.283610] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-27T20:17:30.283782] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-27T20:17:30.283840] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-27T20:17:30.283873] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-27T20:17:30.449504] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T20:17:30.690508] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:30.814944] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-27T20:17:31.614976] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-27T20:17:31.857938] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T20:17:32.415029] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-27T20:17:32.883463] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-27T20:17:32.975267] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T20:17:33.214963] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-27T20:17:34.015010] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-27T20:17:34.677232] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-27T20:17:34.814961] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-27T20:17:34.941577] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T20:17:35.487191] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T20:17:35.614993] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-27T20:17:36.415027] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-27T20:17:36.733403] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T20:17:37.214920] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-27T20:17:37.664963] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T20:17:38.014902] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-27T20:17:38.445483] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T20:17:38.814969] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-27T20:17:39.486476] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T20:17:39.614917] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-27T20:17:40.114558] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-27T20:17:40.415068] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-27T20:17:40.673598] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-27T20:17:41.214983] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-27T20:17:41.302639] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T20:17:42.014998] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-27T20:17:42.387894] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T20:17:42.814988] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-27T20:17:43.097078] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T20:17:43.615018] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-27T20:17:44.198067] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T20:17:44.275306] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T20:17:44.414942] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-27T20:17:45.215044] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-27T20:17:45.693212] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:17:46.014928] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-27T20:17:46.432856] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-27T20:17:46.757307] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T20:17:46.814905] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-27T20:17:47.617289] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-27T20:17:47.620178] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T20:17:48.022199] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T20:17:48.414990] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-27T20:17:49.214952] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-27T20:17:49.523483] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T20:17:50.014913] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-27T20:17:50.116008] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T20:17:50.814920] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-27T20:17:51.196172] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T20:17:51.206599] [INFO ] [REMOTE ] NTR: Full fetch complete (76471 records). [2025-10-27T20:17:51.206809] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-27T20:17:51.591973] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-27T20:17:51.592045] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-27T20:17:51.593099] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-27T20:17:51.593160] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-27T20:17:51.594528] [DEBUG] [LOCAL ] NTR: Trimmed 76471 records to 52577 (keeping 200 days of data) [2025-10-27T20:17:51.645690] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-27T20:17:51.909539] [DEBUG] [LOCAL ] NTR: Primary data saved (52577 records). [2025-10-27T20:17:51.909690] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-27T20:17:51.909779] [INFO ] [MAIN ] Update Progress: 1536/2366 symbols completed. NTR took 42.0s. Estimated remaining: 1h 46m 54s. Rate: 7.8 symbols/min [2025-10-27T20:17:52.081034] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:52.114050] [DEBUG] [LOCAL ] NUS: Loaded 36495 existing records from primary storage. [2025-10-27T20:17:52.114326] [INFO ] [MAIN ] NUS: Loaded 36495 existing records. [2025-10-27T20:17:52.300269] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:52.300846] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-27T20:17:52.300934] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-27T20:17:52.301160] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-27T20:17:52.301233] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-27T20:17:52.631703] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-27T20:17:52.619879] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T20:17:52.673486] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-27T20:17:52.748203] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:53.214923] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-27T20:17:53.488975] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T20:17:53.959195] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T20:17:54.015012] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-27T20:17:54.475741] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T20:17:54.814958] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-27T20:17:55.614948] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-27T20:17:55.838364] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T20:17:55.979281] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T20:17:55.988929] [INFO ] [REMOTE ] NTST: Full fetch complete (62077 records). [2025-10-27T20:17:55.989051] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-27T20:17:56.416203] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-27T20:17:56.433433] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-27T20:17:56.433491] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-27T20:17:56.434554] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-27T20:17:56.434726] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-27T20:17:56.436119] [DEBUG] [LOCAL ] NTST: Trimmed 62077 records to 43955 (keeping 200 days of data) [2025-10-27T20:17:56.720901] [DEBUG] [LOCAL ] NTST: Primary data saved (43955 records). [2025-10-27T20:17:56.721044] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-27T20:17:56.721559] [INFO ] [MAIN ] Update Progress: 1537/2366 symbols completed. NTST took 31.8s. Estimated remaining: 1h 46m 44s. Rate: 7.8 symbols/min [2025-10-27T20:17:56.840693] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T20:17:56.917291] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:56.940330] [DEBUG] [LOCAL ] NUV: Loaded 23524 existing records from primary storage. [2025-10-27T20:17:56.940567] [INFO ] [MAIN ] NUV: Loaded 23524 existing records. [2025-10-27T20:17:57.119083] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:57.119352] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-27T20:17:57.119403] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-27T20:17:57.119683] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-27T20:17:57.119746] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-27T20:17:57.217161] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-27T20:17:57.482430] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:57.507439] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:17:57.516552] [INFO ] [REMOTE ] NUE: Full fetch complete (74347 records). [2025-10-27T20:17:57.516723] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-27T20:17:57.517457] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:17:57.517541] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:17:57.517582] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:17:57.517664] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-27T20:17:57.517742] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-27T20:17:57.517778] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-27T20:17:57.517816] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-27T20:17:57.517869] [INFO ] [MAIN ] Update Progress: 1538/2366 symbols completed. NUE took 27.4s. Estimated remaining: 1h 46m 33s. Rate: 7.8 symbols/min [2025-10-27T20:17:57.687565] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:17:57.736089] [DEBUG] [LOCAL ] NUVB: Loaded 52488 existing records from primary storage. [2025-10-27T20:17:57.736408] [INFO ] [MAIN ] NUVB: Loaded 52488 existing records. [2025-10-27T20:17:57.909457] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:17:57.909672] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-27T20:17:57.909732] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-27T20:17:57.909945] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-27T20:17:57.909988] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-27T20:17:58.020077] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-27T20:17:58.260226] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:17:58.814947] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-27T20:17:59.234134] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T20:17:59.367779] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T20:17:59.614932] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-27T20:18:00.415022] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-27T20:18:00.621934] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T20:18:01.214945] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-27T20:18:01.768477] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T20:18:01.779804] [INFO ] [REMOTE ] NU: Full fetch complete (77926 records). [2025-10-27T20:18:01.779973] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-27T20:18:02.025290] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-27T20:18:02.063605] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T20:18:02.244363] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-27T20:18:02.244438] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-27T20:18:02.245523] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-27T20:18:02.245790] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-27T20:18:02.247492] [DEBUG] [LOCAL ] NU: Trimmed 77926 records to 53746 (keeping 200 days of data) [2025-10-27T20:18:02.472531] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T20:18:02.596676] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-10-27T20:18:02.596831] [INFO ] [MAIN ] NU: Full history saved. [2025-10-27T20:18:02.596914] [INFO ] [MAIN ] Update Progress: 1539/2366 symbols completed. NU took 36.7s. Estimated remaining: 1h 46m 24s. Rate: 7.8 symbols/min [2025-10-27T20:18:02.764431] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:02.773356] [DEBUG] [LOCAL ] NUW: Loaded 6686 existing records from primary storage. [2025-10-27T20:18:02.773571] [INFO ] [MAIN ] NUW: Loaded 6686 existing records. [2025-10-27T20:18:02.820087] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-27T20:18:02.954109] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:02.954330] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-27T20:18:02.954377] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-27T20:18:02.954547] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-27T20:18:02.954604] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-27T20:18:03.308799] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:03.614947] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-27T20:18:03.905021] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T20:18:03.927702] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T20:18:04.414944] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-27T20:18:04.480576] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:18:05.214932] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-27T20:18:05.813169] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T20:18:06.014924] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-27T20:18:06.293725] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T20:18:06.617387] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T20:18:06.814947] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-27T20:18:07.614949] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-27T20:18:08.414904] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-27T20:18:08.793558] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T20:18:09.011456] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T20:18:09.214935] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-27T20:18:09.320007] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T20:18:10.015010] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-27T20:18:10.658279] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T20:18:10.734027] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T20:18:10.814930] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-27T20:18:11.614949] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-27T20:18:11.790058] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T20:18:12.414936] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-27T20:18:12.947458] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:18:13.214933] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-27T20:18:13.355512] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T20:18:14.014951] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-27T20:18:14.571379] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T20:18:14.814914] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-27T20:18:15.284822] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-27T20:18:15.614941] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-27T20:18:16.400984] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:18:16.414908] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-27T20:18:17.215053] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-27T20:18:17.556232] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T20:18:17.752972] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T20:18:17.926229] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-27T20:18:18.014919] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-27T20:18:18.814957] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-27T20:18:19.546543] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T20:18:19.614968] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-27T20:18:19.998737] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T20:18:20.414927] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-27T20:18:20.921233] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T20:18:21.214995] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-27T20:18:21.254577] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T20:18:22.015179] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-27T20:18:22.724818] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:18:22.758294] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T20:18:22.814927] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-27T20:18:23.614941] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-27T20:18:23.956133] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T20:18:24.414988] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-27T20:18:24.939431] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T20:18:24.940669] [INFO ] [REMOTE ] NUW: Full fetch complete (10656 records). [2025-10-27T20:18:24.940770] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-27T20:18:25.217595] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-27T20:18:25.322454] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-27T20:18:25.322558] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-27T20:18:25.322912] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-27T20:18:25.323072] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-27T20:18:25.323783] [DEBUG] [LOCAL ] NUW: Trimmed 10656 records to 6428 (keeping 200 days of data) [2025-10-27T20:18:25.361998] [DEBUG] [LOCAL ] NUW: Primary data saved (6428 records). [2025-10-27T20:18:25.362108] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-27T20:18:25.362186] [INFO ] [MAIN ] Update Progress: 1540/2366 symbols completed. NUW took 22.8s. Estimated remaining: 1h 46m 24s. Rate: 7.8 symbols/min [2025-10-27T20:18:25.536981] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:25.569954] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T20:18:25.601765] [DEBUG] [LOCAL ] NVG: Loaded 27703 existing records from primary storage. [2025-10-27T20:18:25.602020] [INFO ] [MAIN ] NVG: Loaded 27703 existing records. [2025-10-27T20:18:25.775981] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:25.776190] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-27T20:18:25.776236] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-27T20:18:25.776402] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-27T20:18:25.776439] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-27T20:18:26.017753] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-27T20:18:26.136100] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:26.377612] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T20:18:26.814991] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-27T20:18:27.339854] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T20:18:27.345858] [INFO ] [REMOTE ] NUS: Full fetch complete (52700 records). [2025-10-27T20:18:27.345949] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-27T20:18:27.346537] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:18:27.346620] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:18:27.346719] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:18:27.346760] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-27T20:18:27.346812] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-27T20:18:27.346845] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-27T20:18:27.346977] [DEBUG] [LOCAL ] NUS: Deleted derivative data file. [2025-10-27T20:18:27.347045] [INFO ] [MAIN ] Update Progress: 1541/2366 symbols completed. NUS took 35.4s. Estimated remaining: 1h 46m 13s. Rate: 7.8 symbols/min [2025-10-27T20:18:27.511944] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:27.541936] [DEBUG] [LOCAL ] NVGS: Loaded 30234 existing records from primary storage. [2025-10-27T20:18:27.542231] [INFO ] [MAIN ] NVGS: Loaded 30234 existing records. [2025-10-27T20:18:27.622853] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-27T20:18:27.729947] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:27.730161] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-27T20:18:27.730210] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-27T20:18:27.730376] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-27T20:18:27.730415] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-27T20:18:28.152303] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:28.173817] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T20:18:28.415029] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-27T20:18:29.214949] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-27T20:18:29.458613] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T20:18:29.468764] [INFO ] [REMOTE ] NUVB: Full fetch complete (73556 records). [2025-10-27T20:18:29.468871] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-27T20:18:29.855803] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-27T20:18:29.855991] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-27T20:18:29.869519] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-27T20:18:29.870158] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-27T20:18:29.870614] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T20:18:29.877077] [DEBUG] [LOCAL ] NUVB: Trimmed 73556 records to 51742 (keeping 200 days of data) [2025-10-27T20:18:30.028717] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-27T20:18:30.160299] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T20:18:30.187133] [DEBUG] [LOCAL ] NUVB: Primary data saved (51742 records). [2025-10-27T20:18:30.187549] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-27T20:18:30.188221] [INFO ] [MAIN ] Update Progress: 1542/2366 symbols completed. NUVB took 32.7s. Estimated remaining: 1h 46m 3s. Rate: 7.8 symbols/min [2025-10-27T20:18:30.352368] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:30.402770] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-10-27T20:18:30.403069] [INFO ] [MAIN ] NVO: Loaded 54564 existing records. [2025-10-27T20:18:30.574500] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:30.574734] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-27T20:18:30.574819] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-27T20:18:30.575012] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-27T20:18:30.575050] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-27T20:18:30.820162] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-27T20:18:30.920697] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:31.366005] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T20:18:31.614944] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-27T20:18:32.088673] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T20:18:32.414923] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-27T20:18:32.966273] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T20:18:33.214957] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-27T20:18:34.015018] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-27T20:18:34.656236] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T20:18:34.757863] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-27T20:18:34.814912] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-27T20:18:35.445554] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T20:18:35.614924] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-27T20:18:36.414961] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-27T20:18:36.636755] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T20:18:37.215024] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-27T20:18:37.452628] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-27T20:18:37.680970] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T20:18:37.686607] [INFO ] [REMOTE ] NUV: Full fetch complete (33799 records). [2025-10-27T20:18:37.686747] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-27T20:18:38.024235] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-27T20:18:38.075926] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-27T20:18:38.076007] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-27T20:18:38.076821] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-27T20:18:38.076884] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-27T20:18:38.077819] [DEBUG] [LOCAL ] NUV: Trimmed 33799 records to 22918 (keeping 200 days of data) [2025-10-27T20:18:38.207550] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T20:18:38.240457] [DEBUG] [LOCAL ] NUV: Primary data saved (22918 records). [2025-10-27T20:18:38.240578] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-27T20:18:38.240674] [INFO ] [MAIN ] Update Progress: 1543/2366 symbols completed. NUV took 41.5s. Estimated remaining: 1h 45m 55s. Rate: 7.8 symbols/min [2025-10-27T20:18:38.406712] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:38.424112] [DEBUG] [LOCAL ] NVR: Loaded 18660 existing records from primary storage. [2025-10-27T20:18:38.424361] [INFO ] [MAIN ] NVR: Loaded 18660 existing records. [2025-10-27T20:18:38.599029] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:38.599279] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-27T20:18:38.599329] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-27T20:18:38.599536] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-27T20:18:38.599594] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-27T20:18:38.825781] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-27T20:18:38.948118] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:39.614942] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-27T20:18:40.106379] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T20:18:40.414949] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-27T20:18:40.654919] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-27T20:18:40.833238] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T20:18:41.214942] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-27T20:18:41.738920] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T20:18:42.014945] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-27T20:18:42.814955] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-27T20:18:43.229414] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T20:18:43.596131] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-27T20:18:43.614906] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-27T20:18:43.948246] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:18:44.414951] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-27T20:18:44.958462] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T20:18:45.214948] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-27T20:18:46.014936] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-27T20:18:46.814933] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-27T20:18:46.921008] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-27T20:18:47.276994] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T20:18:47.614985] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-27T20:18:47.724841] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T20:18:48.414965] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-27T20:18:49.214968] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-27T20:18:49.531388] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (4.32 seconds). [2025-10-27T20:18:49.603718] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T20:18:49.835962] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-27T20:18:50.014946] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-27T20:18:50.123060] [DEBUG] [REMOTE ] NVR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-27T20:18:50.123356] [WARN ] [REMOTE ] NVR: No data returned for month 2025-05 [2025-10-27T20:18:50.123448] [FATAL] [REMOTE ] NVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:18:50.123523] [FATAL] [MAIN ] NVR: Failed to fetch primary data. [2025-10-27T20:18:50.123584] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:18:50.123685] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-27T20:18:50.123766] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-27T20:18:50.123807] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-27T20:18:50.123969] [DEBUG] [LOCAL ] NVR: Deleted derivative data file. [2025-10-27T20:18:50.124040] [INFO ] [MAIN ] Update Progress: 1544/2366 symbols completed. NVR took 11.9s. Estimated remaining: 1h 45m 50s. Rate: 7.8 symbols/min [2025-10-27T20:18:50.325444] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:50.361628] [DEBUG] [LOCAL ] NVRI: Loaded 39500 existing records from primary storage. [2025-10-27T20:18:50.361926] [INFO ] [MAIN ] NVRI: Loaded 39500 existing records. [2025-10-27T20:18:50.541792] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:50.542013] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-27T20:18:50.542076] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-27T20:18:50.542293] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-27T20:18:50.542400] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-27T20:18:50.755134] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T20:18:50.820000] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-27T20:18:50.945115] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:51.614953] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-27T20:18:51.904393] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T20:18:52.414953] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-27T20:18:52.622315] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T20:18:53.214931] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-27T20:18:53.542313] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T20:18:53.547802] [INFO ] [REMOTE ] NVG: Full fetch complete (39302 records). [2025-10-27T20:18:53.547924] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-27T20:18:53.956056] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-27T20:18:53.956166] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-27T20:18:53.957174] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-27T20:18:53.957246] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-27T20:18:53.958482] [DEBUG] [LOCAL ] NVG: Trimmed 39302 records to 26970 (keeping 200 days of data) [2025-10-27T20:18:54.020174] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-27T20:18:54.124127] [DEBUG] [LOCAL ] NVG: Primary data saved (26970 records). [2025-10-27T20:18:54.124278] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-27T20:18:54.124376] [INFO ] [MAIN ] Update Progress: 1545/2366 symbols completed. NVG took 28.8s. Estimated remaining: 1h 45m 40s. Rate: 7.8 symbols/min [2025-10-27T20:18:54.294066] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:54.342780] [DEBUG] [LOCAL ] NVS: Loaded 52038 existing records from primary storage. [2025-10-27T20:18:54.343077] [INFO ] [MAIN ] NVS: Loaded 52038 existing records. [2025-10-27T20:18:54.538534] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:54.557683] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-27T20:18:54.557787] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-27T20:18:54.558699] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-27T20:18:54.558613] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T20:18:54.558895] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-27T20:18:54.820057] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-27T20:18:54.917934] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:55.292058] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:18:55.614973] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-27T20:18:56.414957] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-27T20:18:56.979597] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T20:18:57.214923] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-27T20:18:57.307304] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-27T20:18:57.621276] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T20:18:57.626314] [INFO ] [REMOTE ] NVGS: Full fetch complete (42007 records). [2025-10-27T20:18:57.626428] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-27T20:18:57.994812] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-27T20:18:57.994892] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-27T20:18:57.995695] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-27T20:18:57.995758] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-27T20:18:57.996794] [DEBUG] [LOCAL ] NVGS: Trimmed 42007 records to 29490 (keeping 200 days of data) [2025-10-27T20:18:58.047713] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-27T20:18:58.172065] [DEBUG] [LOCAL ] NVGS: Primary data saved (29490 records). [2025-10-27T20:18:58.172183] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-27T20:18:58.172257] [INFO ] [MAIN ] Update Progress: 1546/2366 symbols completed. NVGS took 30.8s. Estimated remaining: 1h 45m 30s. Rate: 7.8 symbols/min [2025-10-27T20:18:58.335145] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:18:58.381576] [DEBUG] [LOCAL ] NVST: Loaded 52176 existing records from primary storage. [2025-10-27T20:18:58.381913] [INFO ] [MAIN ] NVST: Loaded 52176 existing records. [2025-10-27T20:18:58.559793] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:18:58.560011] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-27T20:18:58.560067] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-27T20:18:58.560244] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-27T20:18:58.560281] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-27T20:18:58.835940] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-27T20:18:58.918509] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:18:58.946276] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T20:18:59.296566] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T20:18:59.614952] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-27T20:19:00.414959] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-27T20:19:01.215015] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-27T20:19:01.437973] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-27T20:19:01.633391] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T20:19:01.788231] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T20:19:02.014987] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-27T20:19:02.814930] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-27T20:19:02.858046] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T20:19:03.615186] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-27T20:19:03.969383] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T20:19:04.415019] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-27T20:19:04.867833] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T20:19:05.065374] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-27T20:19:05.214949] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-27T20:19:05.916606] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T20:19:06.014975] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-27T20:19:06.814950] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-27T20:19:07.417732] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T20:19:07.614966] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-27T20:19:07.704292] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-27T20:19:07.715468] [INFO ] [REMOTE ] NVO: Full fetch complete (77964 records). [2025-10-27T20:19:07.715728] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-27T20:19:08.105482] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-27T20:19:08.105560] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-27T20:19:08.106594] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-27T20:19:08.106694] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-27T20:19:08.108152] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 53784 (keeping 200 days of data) [2025-10-27T20:19:08.351712] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T20:19:08.417029] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-27T20:19:08.466501] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-10-27T20:19:08.466669] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-27T20:19:08.467368] [INFO ] [MAIN ] Update Progress: 1547/2366 symbols completed. NVO took 38.3s. Estimated remaining: 1h 45m 24s. Rate: 7.8 symbols/min [2025-10-27T20:19:08.630031] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:08.680706] [DEBUG] [LOCAL ] NVT: Loaded 52162 existing records from primary storage. [2025-10-27T20:19:08.681047] [INFO ] [MAIN ] NVT: Loaded 52162 existing records. [2025-10-27T20:19:08.902580] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:08.902850] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-27T20:19:08.902924] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-27T20:19:08.903255] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-27T20:19:08.903312] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-27T20:19:09.220113] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-27T20:19:09.248977] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:09.434416] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T20:19:09.928005] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T20:19:10.014989] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-27T20:19:10.693552] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:19:10.814942] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-27T20:19:10.961824] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T20:19:11.614943] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-27T20:19:12.414956] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-27T20:19:12.496101] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T20:19:13.206939] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T20:19:13.215540] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-27T20:19:14.014916] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-27T20:19:14.090003] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T20:19:14.474082] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T20:19:14.814939] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-27T20:19:15.249004] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T20:19:15.614956] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-27T20:19:16.415015] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-27T20:19:16.544866] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T20:19:17.214934] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-27T20:19:17.319862] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T20:19:17.387802] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:19:17.396438] [INFO ] [REMOTE ] NVRI: Full fetch complete (55657 records). [2025-10-27T20:19:17.396610] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-27T20:19:17.397606] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:19:17.397716] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:19:17.397760] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:19:17.397825] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-27T20:19:17.397888] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-27T20:19:17.397921] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-27T20:19:17.398046] [DEBUG] [LOCAL ] NVRI: Deleted derivative data file. [2025-10-27T20:19:17.398451] [INFO ] [MAIN ] Update Progress: 1548/2366 symbols completed. NVRI took 27.3s. Estimated remaining: 1h 45m 17s. Rate: 7.8 symbols/min [2025-10-27T20:19:17.566972] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:17.619200] [DEBUG] [LOCAL ] NWG: Loaded 52154 existing records from primary storage. [2025-10-27T20:19:17.619483] [INFO ] [MAIN ] NWG: Loaded 52154 existing records. [2025-10-27T20:19:17.797698] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:17.797900] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-27T20:19:17.797945] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-27T20:19:17.798317] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-27T20:19:17.798356] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-27T20:19:18.020200] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-27T20:19:18.156085] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:18.675006] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T20:19:18.814928] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-27T20:19:19.614944] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-27T20:19:20.133234] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-27T20:19:20.300828] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T20:19:20.311609] [INFO ] [REMOTE ] NVS: Full fetch complete (74972 records). [2025-10-27T20:19:20.311801] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-27T20:19:20.420458] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-27T20:19:20.726840] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-27T20:19:20.726943] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-27T20:19:20.728444] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-27T20:19:20.728511] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-27T20:19:20.730357] [DEBUG] [LOCAL ] NVS: Trimmed 74972 records to 51268 (keeping 200 days of data) [2025-10-27T20:19:21.078100] [DEBUG] [LOCAL ] NVS: Primary data saved (51268 records). [2025-10-27T20:19:21.078412] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-27T20:19:21.078548] [INFO ] [MAIN ] Update Progress: 1549/2366 symbols completed. NVS took 27.0s. Estimated remaining: 1h 45m 7s. Rate: 7.8 symbols/min [2025-10-27T20:19:21.228815] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-27T20:19:21.268019] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:21.302953] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T20:19:21.345045] [DEBUG] [LOCAL ] NWN: Loaded 26689 existing records from primary storage. [2025-10-27T20:19:21.345504] [INFO ] [MAIN ] NWN: Loaded 26689 existing records. [2025-10-27T20:19:21.549050] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:21.549379] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-27T20:19:21.549450] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-27T20:19:21.549754] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-27T20:19:21.549813] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-27T20:19:21.932901] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:22.019759] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-27T20:19:22.023508] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:19:22.814923] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-27T20:19:22.949391] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T20:19:23.521843] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:19:23.614932] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-27T20:19:24.271253] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T20:19:24.414914] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-27T20:19:25.214942] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-27T20:19:25.343598] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T20:19:25.656433] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-27T20:19:26.014985] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-27T20:19:26.814961] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-27T20:19:27.081109] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T20:19:27.308766] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T20:19:27.614959] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-27T20:19:28.264596] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T20:19:28.414985] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-27T20:19:29.099308] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T20:19:29.214897] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-27T20:19:29.508053] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:19:29.517341] [INFO ] [REMOTE ] NVST: Full fetch complete (74073 records). [2025-10-27T20:19:29.517457] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-27T20:19:29.518307] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:19:29.518415] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:19:29.518478] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:19:29.518550] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-27T20:19:29.518614] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-27T20:19:29.518675] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-27T20:19:29.518844] [DEBUG] [LOCAL ] NVST: Deleted derivative data file. [2025-10-27T20:19:29.518931] [INFO ] [MAIN ] Update Progress: 1550/2366 symbols completed. NVST took 31.3s. Estimated remaining: 1h 44m 60s. Rate: 7.8 symbols/min [2025-10-27T20:19:29.686029] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:29.717554] [DEBUG] [LOCAL ] NX: Loaded 33740 existing records from primary storage. [2025-10-27T20:19:29.717835] [INFO ] [MAIN ] NX: Loaded 33740 existing records. [2025-10-27T20:19:29.888271] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:29.888468] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-27T20:19:29.888512] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-27T20:19:29.888726] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-27T20:19:29.888781] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-27T20:19:30.022565] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-27T20:19:30.234008] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:30.815006] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-27T20:19:30.905192] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T20:19:31.211284] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T20:19:31.614945] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-27T20:19:32.375566] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T20:19:32.414916] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-27T20:19:33.031064] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T20:19:33.214941] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-27T20:19:33.674630] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T20:19:34.014983] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-27T20:19:34.803024] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:19:34.814970] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-27T20:19:35.614918] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-27T20:19:36.011906] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-27T20:19:36.045960] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T20:19:36.414992] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-27T20:19:36.560734] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T20:19:37.214972] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-27T20:19:38.014994] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-27T20:19:38.455283] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-27T20:19:38.498423] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T20:19:38.814918] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-27T20:19:39.568740] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T20:19:39.614971] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-27T20:19:40.321908] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T20:19:40.414913] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-27T20:19:40.982174] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T20:19:41.214965] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-27T20:19:42.014985] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-27T20:19:42.372600] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T20:19:42.625349] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T20:19:42.814949] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-27T20:19:42.995739] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T20:19:43.614976] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-27T20:19:43.728010] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:19:43.738210] [INFO ] [REMOTE ] NVT: Full fetch complete (74532 records). [2025-10-27T20:19:43.738373] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-27T20:19:43.739302] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:19:43.739423] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:19:43.739467] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:19:43.739504] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-27T20:19:43.739561] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-27T20:19:43.739595] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-27T20:19:43.739778] [DEBUG] [LOCAL ] NVT: Deleted derivative data file. [2025-10-27T20:19:43.740338] [INFO ] [MAIN ] Update Progress: 1551/2366 symbols completed. NVT took 35.3s. Estimated remaining: 1h 44m 56s. Rate: 7.8 symbols/min [2025-10-27T20:19:43.913019] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:43.920012] [DEBUG] [LOCAL ] NXC: Loaded 4121 existing records from primary storage. [2025-10-27T20:19:43.920229] [INFO ] [MAIN ] NXC: Loaded 4121 existing records. [2025-10-27T20:19:44.096080] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:44.096297] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-27T20:19:44.096345] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-27T20:19:44.096475] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-27T20:19:44.096512] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-27T20:19:44.420088] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-27T20:19:44.450697] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:45.215005] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-27T20:19:45.512723] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T20:19:45.603458] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T20:19:45.924463] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T20:19:46.014913] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-27T20:19:46.528596] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T20:19:46.814959] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-27T20:19:47.614957] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-27T20:19:48.374292] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T20:19:48.414904] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-27T20:19:48.619984] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T20:19:49.025544] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T20:19:49.214952] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-27T20:19:49.793730] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T20:19:50.014953] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-27T20:19:50.815013] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-27T20:19:51.449203] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T20:19:51.614961] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-27T20:19:52.416815] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-27T20:19:52.423373] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T20:19:52.434526] [INFO ] [REMOTE ] NWG: Full fetch complete (74130 records). [2025-10-27T20:19:52.434758] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-27T20:19:52.845005] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-27T20:19:52.845127] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-27T20:19:52.846398] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-27T20:19:52.846589] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-27T20:19:52.868630] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T20:19:52.875832] [DEBUG] [LOCAL ] NWG: Trimmed 74130 records to 51366 (keeping 200 days of data) [2025-10-27T20:19:53.195037] [DEBUG] [LOCAL ] NWG: Primary data saved (51366 records). [2025-10-27T20:19:53.195209] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-27T20:19:53.195700] [INFO ] [MAIN ] Update Progress: 1552/2366 symbols completed. NWG took 35.8s. Estimated remaining: 1h 44m 49s. Rate: 7.8 symbols/min [2025-10-27T20:19:53.224977] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-27T20:19:53.366709] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:53.366906] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-27T20:19:53.366942] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-27T20:19:53.367052] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-27T20:19:53.367091] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-27T20:19:53.367133] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-27T20:19:53.367209] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-27T20:19:53.743191] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:53.753731] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T20:19:54.014924] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-27T20:19:54.087395] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T20:19:54.814985] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-10-27T20:19:54.914553] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T20:19:55.170387] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:19:55.170765] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-10-27T20:19:55.170852] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:19:55.170898] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-27T20:19:55.170955] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:19:55.171030] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-27T20:19:55.171092] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-27T20:19:55.171126] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-27T20:19:55.171164] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-27T20:19:55.171209] [INFO ] [MAIN ] Update Progress: 1553/2366 symbols completed. NXDR took 2.0s. Estimated remaining: 1h 44m 38s. Rate: 7.8 symbols/min [2025-10-27T20:19:55.336762] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:55.351467] [DEBUG] [LOCAL ] NXDT: Loaded 14938 existing records from primary storage. [2025-10-27T20:19:55.351720] [INFO ] [MAIN ] NXDT: Loaded 14938 existing records. [2025-10-27T20:19:55.524287] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:55.524475] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-27T20:19:55.524520] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-27T20:19:55.524712] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-27T20:19:55.524767] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-27T20:19:55.623598] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-27T20:19:55.874782] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:56.368803] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T20:19:56.373949] [INFO ] [REMOTE ] NWN: Full fetch complete (37130 records). [2025-10-27T20:19:56.374079] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-27T20:19:56.374674] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:19:56.374763] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:19:56.374805] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:19:56.374842] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-27T20:19:56.374896] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-27T20:19:56.374928] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-27T20:19:56.375069] [DEBUG] [LOCAL ] NWN: Deleted derivative data file. [2025-10-27T20:19:56.375137] [INFO ] [MAIN ] Update Progress: 1554/2366 symbols completed. NWN took 35.3s. Estimated remaining: 1h 44m 27s. Rate: 7.8 symbols/min [2025-10-27T20:19:56.420147] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-27T20:19:56.551214] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:19:56.600159] [DEBUG] [LOCAL ] NXE: Loaded 53842 existing records from primary storage. [2025-10-27T20:19:56.600483] [INFO ] [MAIN ] NXE: Loaded 53842 existing records. [2025-10-27T20:19:56.773682] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:19:56.773876] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-27T20:19:56.773940] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-27T20:19:56.774127] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-27T20:19:56.774182] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-27T20:19:57.127425] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:19:57.214949] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-27T20:19:57.242354] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T20:19:58.014952] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-27T20:19:58.814917] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-27T20:19:59.077207] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T20:19:59.157310] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T20:19:59.614949] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-27T20:20:00.293692] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T20:20:00.414953] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-27T20:20:01.214925] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-27T20:20:01.458211] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T20:20:01.952775] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T20:20:02.014964] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-27T20:20:02.308738] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T20:20:02.814943] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-27T20:20:03.389853] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T20:20:03.614928] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-27T20:20:03.715273] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T20:20:04.414957] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-27T20:20:05.214938] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-27T20:20:05.551114] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T20:20:05.699265] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T20:20:05.727368] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:20:05.733565] [INFO ] [REMOTE ] NX: Full fetch complete (48177 records). [2025-10-27T20:20:05.733679] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-27T20:20:05.734285] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:20:05.734367] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:20:05.734416] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:20:05.734451] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-27T20:20:05.734504] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-27T20:20:05.734537] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-27T20:20:05.734723] [DEBUG] [LOCAL ] NX: Deleted derivative data file. [2025-10-27T20:20:05.734813] [INFO ] [MAIN ] Update Progress: 1555/2366 symbols completed. NX took 36.2s. Estimated remaining: 1h 44m 20s. Rate: 7.8 symbols/min [2025-10-27T20:20:05.900592] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:05.911008] [DEBUG] [LOCAL ] NXG: Loaded 10624 existing records from primary storage. [2025-10-27T20:20:05.911228] [INFO ] [MAIN ] NXG: Loaded 10624 existing records. [2025-10-27T20:20:06.020020] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-27T20:20:06.091613] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:20:06.091867] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-27T20:20:06.091923] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-27T20:20:06.092221] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-27T20:20:06.092284] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-27T20:20:06.443549] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:06.814974] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-27T20:20:07.614913] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-27T20:20:07.669896] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T20:20:07.854985] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T20:20:08.414960] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-27T20:20:08.454427] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:20:09.179595] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T20:20:09.181493] [INFO ] [REMOTE ] NXC: Full fetch complete (5658 records). [2025-10-27T20:20:09.181688] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-27T20:20:09.224728] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-27T20:20:09.611578] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-27T20:20:09.611675] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-27T20:20:09.611865] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-27T20:20:09.611907] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-27T20:20:09.612340] [DEBUG] [LOCAL ] NXC: Trimmed 5658 records to 4001 (keeping 200 days of data) [2025-10-27T20:20:09.636462] [DEBUG] [LOCAL ] NXC: Primary data saved (4001 records). [2025-10-27T20:20:09.636537] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-27T20:20:09.636607] [INFO ] [MAIN ] Update Progress: 1556/2366 symbols completed. NXC took 25.9s. Estimated remaining: 1h 44m 10s. Rate: 7.8 symbols/min [2025-10-27T20:20:09.808976] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:09.830724] [DEBUG] [LOCAL ] NXJ: Loaded 14894 existing records from primary storage. [2025-10-27T20:20:09.830936] [INFO ] [MAIN ] NXJ: Loaded 14894 existing records. [2025-10-27T20:20:10.008347] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:20:10.008542] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-27T20:20:10.008588] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-27T20:20:10.008777] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-27T20:20:10.008835] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-27T20:20:10.021256] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-27T20:20:10.113992] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:20:10.375245] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:10.824028] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-27T20:20:10.825019] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T20:20:11.460495] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T20:20:11.614966] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-27T20:20:12.414944] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-27T20:20:13.214943] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-27T20:20:13.594308] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T20:20:13.838762] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T20:20:14.015005] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-27T20:20:14.553319] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T20:20:14.815005] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-27T20:20:15.614944] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-27T20:20:15.739235] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T20:20:16.139613] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-27T20:20:16.317120] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T20:20:16.414986] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-27T20:20:17.086073] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T20:20:17.214947] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-27T20:20:18.014947] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-27T20:20:18.281028] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T20:20:18.655338] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T20:20:18.814937] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-27T20:20:19.614952] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-27T20:20:19.883575] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T20:20:20.158729] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T20:20:20.414986] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-27T20:20:21.214943] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-27T20:20:22.014934] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-27T20:20:22.133464] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T20:20:22.814916] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-27T20:20:22.972899] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-27T20:20:22.994032] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T20:20:23.614937] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-27T20:20:23.769845] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:20:24.414984] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-27T20:20:25.214913] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-27T20:20:25.251721] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T20:20:25.255201] [INFO ] [REMOTE ] NXDT: Full fetch complete (23661 records). [2025-10-27T20:20:25.255325] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-27T20:20:25.676012] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-27T20:20:25.676863] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-27T20:20:25.679129] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-27T20:20:25.678193] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-27T20:20:25.679339] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-27T20:20:25.693267] [DEBUG] [LOCAL ] NXDT: Trimmed 23661 records to 14255 (keeping 200 days of data) [2025-10-27T20:20:25.782659] [DEBUG] [LOCAL ] NXDT: Primary data saved (14255 records). [2025-10-27T20:20:25.782876] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-27T20:20:25.782981] [INFO ] [MAIN ] Update Progress: 1557/2366 symbols completed. NXDT took 30.6s. Estimated remaining: 1h 44m 7s. Rate: 7.8 symbols/min [2025-10-27T20:20:26.014948] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-27T20:20:26.214234] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T20:20:26.814916] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-27T20:20:27.095120] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T20:20:27.614924] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-27T20:20:27.831079] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T20:20:28.414994] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-27T20:20:28.587188] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T20:20:29.214967] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-27T20:20:30.014966] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-27T20:20:30.394083] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T20:20:30.571801] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-27T20:20:30.752010] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T20:20:30.754861] [INFO ] [REMOTE ] NXG: Full fetch complete (14727 records). [2025-10-27T20:20:30.755107] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-27T20:20:30.820131] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-27T20:20:31.107274] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-27T20:20:31.107349] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-27T20:20:31.107638] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-27T20:20:31.107718] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-27T20:20:31.108231] [DEBUG] [LOCAL ] NXG: Trimmed 14727 records to 10298 (keeping 200 days of data) [2025-10-27T20:20:31.170823] [DEBUG] [LOCAL ] NXG: Primary data saved (10298 records). [2025-10-27T20:20:31.170965] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-27T20:20:31.171047] [INFO ] [MAIN ] Update Progress: 1558/2366 symbols completed. NXG took 25.4s. Estimated remaining: 1h 43m 58s. Rate: 7.8 symbols/min [2025-10-27T20:20:31.614962] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-27T20:20:31.945377] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T20:20:32.414930] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-27T20:20:33.366841] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:20:33.372132] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-27T20:20:33.750475] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-27T20:20:33.760837] [INFO ] [REMOTE ] NXE: Full fetch complete (76966 records). [2025-10-27T20:20:33.760974] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-27T20:20:34.169082] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-27T20:20:34.169197] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-27T20:20:34.170304] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-27T20:20:34.176326] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-27T20:20:34.177382] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T20:20:34.180285] [INFO ] [REMOTE ] NXJ: Full fetch complete (19938 records). [2025-10-27T20:20:34.180476] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-27T20:20:34.180723] [DEBUG] [LOCAL ] NXE: Trimmed 76966 records to 53066 (keeping 200 days of data) [2025-10-27T20:20:34.825038] [DEBUG] [LOCAL ] NXE: Primary data saved (53066 records). [2025-10-27T20:20:34.835860] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-27T20:20:34.851367] [INFO ] [MAIN ] Update Progress: 1559/2366 symbols completed. NXE took 38.5s. Estimated remaining: 1h 43m 48s. Rate: 7.8 symbols/min [2025-10-27T20:20:34.907396] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-27T20:20:34.907474] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-27T20:20:34.907931] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-27T20:20:34.907992] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-27T20:20:34.908608] [DEBUG] [LOCAL ] NXJ: Trimmed 19938 records to 14487 (keeping 200 days of data) [2025-10-27T20:20:34.998800] [DEBUG] [LOCAL ] NXJ: Primary data saved (14487 records). [2025-10-27T20:20:34.998973] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-27T20:20:34.999082] [INFO ] [MAIN ] Update Progress: 1560/2366 symbols completed. NXJ took 25.4s. Estimated remaining: 1h 43m 37s. Rate: 7.8 symbols/min [2025-10-27T20:20:35.670291] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:35.684672] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-27T20:20:35.687466] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:35.731429] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:35.730505] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:20:35.731569] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-27T20:20:35.732118] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-27T20:20:35.732520] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-27T20:20:35.732626] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-27T20:20:35.732893] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-27T20:20:35.839530] [DEBUG] [LOCAL ] NXP: Loaded 12360 existing records from primary storage. [2025-10-27T20:20:35.848919] [DEBUG] [LOCAL ] NXN: Loaded 2332 existing records from primary storage. [2025-10-27T20:20:35.852760] [INFO ] [MAIN ] NXN: Loaded 2332 existing records. [2025-10-27T20:20:35.852941] [INFO ] [MAIN ] NXP: Loaded 12360 existing records. [2025-10-27T20:20:35.942123] [DEBUG] [LOCAL ] NXRT: Loaded 19105 existing records from primary storage. [2025-10-27T20:20:36.058327] [INFO ] [MAIN ] NXRT: Loaded 19105 existing records. [2025-10-27T20:20:36.502895] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:20:36.601517] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:20:36.606937] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:36.630629] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-27T20:20:36.617576] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-27T20:20:36.644298] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-27T20:20:36.644499] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-27T20:20:36.651529] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-27T20:20:36.671380] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-27T20:20:36.671599] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-27T20:20:36.685513] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:20:36.685711] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-27T20:20:36.695596] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-27T20:20:36.695803] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-27T20:20:36.704453] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-27T20:20:36.748886] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-27T20:20:36.763487] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-27T20:20:37.328290] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T20:20:37.391255] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-27T20:20:37.746623] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:37.732224] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:37.771035] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-27T20:20:37.775435] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:20:37.771259] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-27T20:20:37.775713] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-27T20:20:38.018323] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T20:20:38.019413] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-27T20:20:38.198594] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T20:20:38.659238] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T20:20:38.709588] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T20:20:38.785350] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T20:20:38.814917] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-27T20:20:39.614916] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-27T20:20:39.704379] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:20:40.166925] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T20:20:40.414939] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-27T20:20:41.215006] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-27T20:20:41.410891] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T20:20:41.677706] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T20:20:42.014992] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-27T20:20:42.638981] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:20:42.814973] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-27T20:20:43.313234] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T20:20:43.614987] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-27T20:20:44.189420] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T20:20:44.414969] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-27T20:20:45.214961] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-27T20:20:45.277448] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T20:20:45.775665] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T20:20:46.015035] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-27T20:20:46.701915] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T20:20:46.814952] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-27T20:20:47.615043] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-27T20:20:47.780571] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T20:20:48.250804] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T20:20:48.414995] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-27T20:20:49.214961] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-27T20:20:49.745283] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:20:49.770861] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T20:20:50.014988] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-27T20:20:50.594694] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T20:20:50.814983] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-27T20:20:51.614952] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-27T20:20:51.760420] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T20:20:52.103466] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T20:20:52.414987] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-27T20:20:53.214974] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-27T20:20:53.597388] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T20:20:54.014963] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-27T20:20:54.086790] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:20:54.814905] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-27T20:20:54.900704] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T20:20:55.435016] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T20:20:55.614940] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-27T20:20:56.414967] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-27T20:20:56.701236] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T20:20:56.865254] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T20:20:57.214993] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-27T20:20:57.952141] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:20:58.014942] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-27T20:20:58.814990] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-27T20:20:59.163001] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:20:59.533534] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T20:20:59.614929] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-27T20:21:00.414954] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-27T20:21:00.798608] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T20:21:01.090097] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T20:21:01.091152] [INFO ] [REMOTE ] NXN: Full fetch complete (3446 records). [2025-10-27T20:21:01.091239] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-27T20:21:01.220069] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-27T20:21:01.478252] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-27T20:21:01.478380] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-27T20:21:01.478536] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-27T20:21:01.478578] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-27T20:21:01.479018] [DEBUG] [LOCAL ] NXN: Trimmed 3446 records to 2281 (keeping 200 days of data) [2025-10-27T20:21:01.495337] [DEBUG] [LOCAL ] NXN: Primary data saved (2281 records). [2025-10-27T20:21:01.495494] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-27T20:21:01.495601] [INFO ] [MAIN ] Update Progress: 1561/2366 symbols completed. NXN took 26.5s. Estimated remaining: 1h 43m 39s. Rate: 7.8 symbols/min [2025-10-27T20:21:01.686949] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:01.732314] [DEBUG] [LOCAL ] NYT: Loaded 50104 existing records from primary storage. [2025-10-27T20:21:01.732604] [INFO ] [MAIN ] NYT: Loaded 50104 existing records. [2025-10-27T20:21:01.915307] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:01.915552] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-27T20:21:01.915600] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-27T20:21:01.915835] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-27T20:21:01.915893] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-27T20:21:02.021156] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-27T20:21:02.283856] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:02.312431] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T20:21:02.788095] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T20:21:02.792946] [INFO ] [REMOTE ] NXRT: Full fetch complete (25971 records). [2025-10-27T20:21:02.793026] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-27T20:21:02.793633] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:21:02.793748] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:21:02.793791] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:21:02.793831] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-27T20:21:02.793889] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-27T20:21:02.793924] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-27T20:21:02.794083] [DEBUG] [LOCAL ] NXRT: Deleted derivative data file. [2025-10-27T20:21:02.794174] [INFO ] [MAIN ] Update Progress: 1562/2366 symbols completed. NXRT took 27.7s. Estimated remaining: 1h 43m 27s. Rate: 7.8 symbols/min [2025-10-27T20:21:02.824744] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-27T20:21:02.971482] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:03.000249] [DEBUG] [LOCAL ] NZF: Loaded 29098 existing records from primary storage. [2025-10-27T20:21:03.000517] [INFO ] [MAIN ] NZF: Loaded 29098 existing records. [2025-10-27T20:21:03.189159] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:03.189378] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-27T20:21:03.189503] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-27T20:21:03.189788] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-27T20:21:03.189851] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-27T20:21:03.545537] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:03.614918] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-27T20:21:03.831676] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T20:21:03.834816] [INFO ] [REMOTE ] NXP: Full fetch complete (17022 records). [2025-10-27T20:21:03.834914] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-27T20:21:04.236397] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-27T20:21:04.236484] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-27T20:21:04.236929] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-27T20:21:04.236992] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-27T20:21:04.237716] [DEBUG] [LOCAL ] NXP: Trimmed 17022 records to 12044 (keeping 200 days of data) [2025-10-27T20:21:04.304553] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T20:21:04.322305] [DEBUG] [LOCAL ] NXP: Primary data saved (12044 records). [2025-10-27T20:21:04.322434] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-27T20:21:04.322507] [INFO ] [MAIN ] Update Progress: 1563/2366 symbols completed. NXP took 29.3s. Estimated remaining: 1h 43m 17s. Rate: 7.8 symbols/min [2025-10-27T20:21:04.420224] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-27T20:21:04.502426] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:04.502605] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-27T20:21:04.502871] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-27T20:21:04.502987] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-27T20:21:04.503028] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-27T20:21:04.503068] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-27T20:21:04.503099] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-27T20:21:04.870192] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:05.214950] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-27T20:21:06.014980] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-27T20:21:06.050304] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T20:21:06.814976] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-27T20:21:07.335903] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T20:21:07.615046] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-27T20:21:07.713022] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T20:21:07.919898] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-27T20:21:08.102962] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T20:21:08.104020] [INFO ] [REMOTE ] NYC: Full fetch complete (1837 records). [2025-10-27T20:21:08.104096] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-27T20:21:08.318214] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T20:21:08.318563] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:21:08.318670] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:21:08.318796] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-27T20:21:08.318899] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-27T20:21:08.318958] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-27T20:21:08.319036] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-27T20:21:08.319154] [INFO ] [MAIN ] Update Progress: 1564/2366 symbols completed. NYC took 33.3s. Estimated remaining: 1h 43m 7s. Rate: 7.8 symbols/min [2025-10-27T20:21:08.420085] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-27T20:21:08.527033] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:08.586856] [DEBUG] [LOCAL ] OBDC: Loaded 52497 existing records from primary storage. [2025-10-27T20:21:08.587373] [INFO ] [MAIN ] OBDC: Loaded 52497 existing records. [2025-10-27T20:21:08.814885] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:08.815269] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-27T20:21:08.815335] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-27T20:21:08.815722] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-27T20:21:08.815783] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-27T20:21:09.231516] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-27T20:21:09.279504] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:09.524267] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T20:21:10.015121] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-27T20:21:10.815128] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-27T20:21:11.099032] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T20:21:11.137143] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T20:21:11.614960] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-27T20:21:12.415188] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-27T20:21:12.852838] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-27T20:21:12.928767] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T20:21:13.214992] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-27T20:21:13.907058] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T20:21:14.014963] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-27T20:21:14.814987] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-27T20:21:15.287316] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T20:21:15.614980] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-27T20:21:15.738912] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T20:21:16.203915] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T20:21:16.414959] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-27T20:21:17.215017] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-27T20:21:17.857323] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T20:21:17.885839] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T20:21:18.014895] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-27T20:21:18.414086] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T20:21:18.814942] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-27T20:21:19.614937] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-27T20:21:20.217399] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:21:20.414943] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-27T20:21:20.590503] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T20:21:20.727601] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-27T20:21:21.214942] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-27T20:21:22.020069] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-27T20:21:22.036431] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T20:21:22.107303] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T20:21:22.814987] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-27T20:21:23.614953] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-27T20:21:24.236091] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T20:21:24.373883] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-27T20:21:24.414906] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-27T20:21:25.215017] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-27T20:21:25.342259] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T20:21:26.014951] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-27T20:21:26.814916] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-27T20:21:26.970945] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T20:21:27.063579] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-27T20:21:27.614956] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-27T20:21:27.970838] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T20:21:28.293467] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T20:21:28.414919] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-27T20:21:29.220035] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-27T20:21:29.234186] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T20:21:29.283910] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T20:21:29.289369] [INFO ] [REMOTE ] NZF: Full fetch complete (42075 records). [2025-10-27T20:21:29.289454] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-27T20:21:29.661430] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-27T20:21:29.661504] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-27T20:21:29.662383] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-27T20:21:29.662444] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-27T20:21:29.663337] [DEBUG] [LOCAL ] NZF: Trimmed 42075 records to 28333 (keeping 200 days of data) [2025-10-27T20:21:29.829262] [DEBUG] [LOCAL ] NZF: Primary data saved (28333 records). [2025-10-27T20:21:29.829387] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-27T20:21:29.829462] [INFO ] [MAIN ] Update Progress: 1565/2366 symbols completed. NZF took 27.0s. Estimated remaining: 1h 43m 6s. Rate: 7.8 symbols/min [2025-10-27T20:21:30.018971] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:30.017385] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-27T20:21:30.036720] [DEBUG] [LOCAL ] OBK: Loaded 16594 existing records from primary storage. [2025-10-27T20:21:30.036982] [INFO ] [MAIN ] OBK: Loaded 16594 existing records. [2025-10-27T20:21:30.213106] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:30.213366] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-27T20:21:30.213430] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-27T20:21:30.213741] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-27T20:21:30.213800] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-27T20:21:30.562513] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:30.814917] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-27T20:21:31.356993] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T20:21:31.620060] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-27T20:21:31.637701] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-27T20:21:32.414996] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-27T20:21:32.634581] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T20:21:33.214966] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-27T20:21:33.380263] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T20:21:33.607553] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T20:21:34.014942] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-27T20:21:34.814969] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-27T20:21:35.031501] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T20:21:35.095825] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T20:21:35.614982] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-27T20:21:36.414980] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-27T20:21:36.523340] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T20:21:36.750363] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T20:21:37.031883] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T20:21:37.040528] [INFO ] [REMOTE ] NYT: Full fetch complete (71841 records). [2025-10-27T20:21:37.040685] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-27T20:21:37.041500] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:21:37.041582] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:21:37.041624] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:21:37.041698] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-27T20:21:37.041767] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-27T20:21:37.041802] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-27T20:21:37.041916] [DEBUG] [LOCAL ] NYT: Deleted derivative data file. [2025-10-27T20:21:37.042380] [INFO ] [MAIN ] Update Progress: 1566/2366 symbols completed. NYT took 35.5s. Estimated remaining: 1h 42m 58s. Rate: 7.8 symbols/min [2025-10-27T20:21:37.206353] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:37.214964] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-27T20:21:37.249589] [DEBUG] [LOCAL ] OC: Loaded 45496 existing records from primary storage. [2025-10-27T20:21:37.249926] [INFO ] [MAIN ] OC: Loaded 45496 existing records. [2025-10-27T20:21:37.423808] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:37.424008] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-27T20:21:37.424067] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-27T20:21:37.424304] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-27T20:21:37.424346] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-27T20:21:37.763200] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:38.014930] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-27T20:21:38.814996] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-27T20:21:39.029559] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T20:21:39.614964] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-27T20:21:39.732445] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T20:21:39.937568] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T20:21:40.414987] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-27T20:21:41.214983] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-27T20:21:41.601040] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T20:21:41.621964] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T20:21:41.860067] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T20:21:41.869817] [INFO ] [REMOTE ] O: Full fetch complete (77182 records). [2025-10-27T20:21:41.869922] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-27T20:21:41.870625] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:21:41.870733] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:21:41.870776] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:21:41.870813] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-27T20:21:41.870870] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-27T20:21:41.870905] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-27T20:21:41.870944] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-27T20:21:41.870997] [INFO ] [MAIN ] Update Progress: 1567/2366 symbols completed. O took 37.5s. Estimated remaining: 1h 42m 49s. Rate: 7.8 symbols/min [2025-10-27T20:21:42.019080] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-27T20:21:42.038591] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:42.046449] [DEBUG] [LOCAL ] OCFT: Loaded 7151 existing records from primary storage. [2025-10-27T20:21:42.046803] [INFO ] [MAIN ] OCFT: Loaded 7151 existing records. [2025-10-27T20:21:42.224560] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:42.224893] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-27T20:21:42.224942] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-27T20:21:42.225093] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-27T20:21:42.225148] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-27T20:21:42.565813] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:42.814914] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-27T20:21:43.614994] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-27T20:21:43.818515] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T20:21:43.828628] [INFO ] [REMOTE ] OBDC: Full fetch complete (75427 records). [2025-10-27T20:21:43.828797] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-27T20:21:44.215734] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-27T20:21:44.215830] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-27T20:21:44.216933] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-27T20:21:44.216995] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-27T20:21:44.218471] [DEBUG] [LOCAL ] OBDC: Trimmed 75427 records to 51713 (keeping 200 days of data) [2025-10-27T20:21:44.438922] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T20:21:44.438728] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-27T20:21:44.486161] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T20:21:44.578495] [DEBUG] [LOCAL ] OBDC: Primary data saved (51713 records). [2025-10-27T20:21:44.578622] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-27T20:21:44.579255] [INFO ] [MAIN ] Update Progress: 1568/2366 symbols completed. OBDC took 36.3s. Estimated remaining: 1h 42m 39s. Rate: 7.8 symbols/min [2025-10-27T20:21:44.746334] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:44.756723] [DEBUG] [LOCAL ] ODC: Loaded 8784 existing records from primary storage. [2025-10-27T20:21:44.756938] [INFO ] [MAIN ] ODC: Loaded 8784 existing records. [2025-10-27T20:21:44.928257] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:44.928453] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-27T20:21:44.928502] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-27T20:21:44.928812] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-27T20:21:44.928873] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-27T20:21:45.221617] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-27T20:21:45.281824] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:45.293132] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T20:21:46.015038] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-27T20:21:46.815025] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-27T20:21:47.138907] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T20:21:47.208679] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-27T20:21:47.614943] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-27T20:21:47.703959] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:21:48.349454] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T20:21:48.414965] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-27T20:21:49.017541] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T20:21:49.214974] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-27T20:21:50.014981] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-27T20:21:50.213207] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T20:21:50.814920] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-27T20:21:51.031217] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T20:21:51.615001] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-27T20:21:52.414924] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-27T20:21:52.563861] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:21:52.673867] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T20:21:53.021747] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T20:21:53.214973] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-27T20:21:54.014984] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-27T20:21:54.645014] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T20:21:54.814957] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-27T20:21:55.243228] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T20:21:55.246972] [INFO ] [REMOTE ] OBK: Full fetch complete (24022 records). [2025-10-27T20:21:55.247057] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-27T20:21:55.611696] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-27T20:21:55.611780] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-27T20:21:55.612339] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-27T20:21:55.612378] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-27T20:21:55.613025] [DEBUG] [LOCAL ] OBK: Trimmed 24022 records to 16241 (keeping 200 days of data) [2025-10-27T20:21:55.652427] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-27T20:21:55.709329] [DEBUG] [LOCAL ] OBK: Primary data saved (16241 records). [2025-10-27T20:21:55.709445] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-27T20:21:55.709518] [INFO ] [MAIN ] Update Progress: 1569/2366 symbols completed. OBK took 25.9s. Estimated remaining: 1h 42m 33s. Rate: 7.8 symbols/min [2025-10-27T20:21:55.874614] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:21:55.903233] [DEBUG] [LOCAL ] ODV: Loaded 30608 existing records from primary storage. [2025-10-27T20:21:55.903482] [INFO ] [MAIN ] ODV: Loaded 30608 existing records. [2025-10-27T20:21:56.082003] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:21:56.082225] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-27T20:21:56.082271] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-27T20:21:56.082439] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-27T20:21:56.082475] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-27T20:21:56.363165] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T20:21:56.417824] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-27T20:21:56.447197] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:21:56.474447] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T20:21:57.214956] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-27T20:21:57.346169] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T20:21:58.014933] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-27T20:21:58.434550] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T20:21:58.814967] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-27T20:21:58.901230] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T20:21:59.402725] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T20:21:59.614936] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-27T20:22:00.414993] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-27T20:22:00.580331] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T20:22:01.202343] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T20:22:01.214895] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-27T20:22:02.014938] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-27T20:22:02.362879] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T20:22:02.814950] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-27T20:22:02.860801] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T20:22:03.614999] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-27T20:22:04.290812] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T20:22:04.414993] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-27T20:22:04.569872] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T20:22:05.050319] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T20:22:05.052628] [INFO ] [REMOTE ] ODC: Full fetch complete (11513 records). [2025-10-27T20:22:05.052729] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-27T20:22:05.220125] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-27T20:22:05.408381] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-27T20:22:05.408455] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-27T20:22:05.408766] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-27T20:22:05.408836] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-27T20:22:05.409267] [DEBUG] [LOCAL ] ODC: Trimmed 11513 records to 8637 (keeping 200 days of data) [2025-10-27T20:22:05.459494] [DEBUG] [LOCAL ] ODC: Primary data saved (8637 records). [2025-10-27T20:22:05.459600] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-27T20:22:05.459701] [INFO ] [MAIN ] Update Progress: 1570/2366 symbols completed. ODC took 20.9s. Estimated remaining: 1h 42m 26s. Rate: 7.8 symbols/min [2025-10-27T20:22:05.625624] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:05.662077] [DEBUG] [LOCAL ] OEC: Loaded 37696 existing records from primary storage. [2025-10-27T20:22:05.662338] [INFO ] [MAIN ] OEC: Loaded 37696 existing records. [2025-10-27T20:22:05.855254] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:05.855472] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-27T20:22:05.855517] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-27T20:22:05.855728] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-27T20:22:05.855784] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-27T20:22:06.026316] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-27T20:22:06.111463] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T20:22:06.214867] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:06.814936] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-27T20:22:07.367610] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:22:07.614988] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-27T20:22:07.788688] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T20:22:08.414949] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-27T20:22:08.736984] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T20:22:09.215012] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-27T20:22:09.942088] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T20:22:10.014948] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-27T20:22:10.082319] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T20:22:10.814954] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-27T20:22:11.289878] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T20:22:11.357141] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T20:22:11.614989] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-27T20:22:12.414908] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-27T20:22:12.499510] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T20:22:13.214937] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-27T20:22:13.694444] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T20:22:13.706608] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T20:22:14.014935] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-27T20:22:14.814946] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-27T20:22:15.386845] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T20:22:15.388165] [INFO ] [REMOTE ] OCFT: Full fetch complete (11725 records). [2025-10-27T20:22:15.388262] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-27T20:22:15.625568] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-27T20:22:15.765508] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-27T20:22:15.765729] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-27T20:22:15.766025] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-27T20:22:15.766099] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-27T20:22:15.766784] [DEBUG] [LOCAL ] OCFT: Trimmed 11725 records to 6857 (keeping 200 days of data) [2025-10-27T20:22:15.820358] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T20:22:15.838818] [DEBUG] [LOCAL ] OCFT: Primary data saved (6857 records). [2025-10-27T20:22:15.839238] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-27T20:22:15.839321] [INFO ] [MAIN ] Update Progress: 1571/2366 symbols completed. OCFT took 34.0s. Estimated remaining: 1h 42m 20s. Rate: 7.8 symbols/min [2025-10-27T20:22:16.008319] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:16.028403] [DEBUG] [LOCAL ] OFG: Loaded 20846 existing records from primary storage. [2025-10-27T20:22:16.028613] [INFO ] [MAIN ] OFG: Loaded 20846 existing records. [2025-10-27T20:22:16.206403] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:16.206603] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-27T20:22:16.206700] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-27T20:22:16.207408] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-27T20:22:16.207474] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-27T20:22:16.420088] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-27T20:22:16.566361] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:17.084429] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T20:22:17.214939] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-27T20:22:17.795998] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T20:22:18.014912] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-27T20:22:18.289774] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T20:22:18.814941] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-27T20:22:19.588516] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T20:22:19.614898] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-27T20:22:20.152028] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T20:22:20.414950] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-27T20:22:21.012289] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:22:21.215026] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-27T20:22:21.835756] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T20:22:22.014983] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-27T20:22:22.814959] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-27T20:22:22.932836] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T20:22:22.941824] [INFO ] [REMOTE ] ODV: Full fetch complete (36814 records). [2025-10-27T20:22:22.941941] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-27T20:22:23.315125] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-27T20:22:23.315232] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-27T20:22:23.316156] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-27T20:22:23.316269] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-27T20:22:23.317481] [DEBUG] [LOCAL ] ODV: Trimmed 36814 records to 30457 (keeping 200 days of data) [2025-10-27T20:22:23.436444] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T20:22:23.515695] [DEBUG] [LOCAL ] ODV: Primary data saved (30457 records). [2025-10-27T20:22:23.515827] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-27T20:22:23.515903] [INFO ] [MAIN ] Update Progress: 1572/2366 symbols completed. ODV took 27.8s. Estimated remaining: 1h 42m 12s. Rate: 7.8 symbols/min [2025-10-27T20:22:23.620194] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-27T20:22:23.696487] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:23.738039] [DEBUG] [LOCAL ] OGE: Loaded 46459 existing records from primary storage. [2025-10-27T20:22:23.738360] [INFO ] [MAIN ] OGE: Loaded 46459 existing records. [2025-10-27T20:22:23.915117] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:23.915312] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-27T20:22:23.915357] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-27T20:22:23.915564] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-27T20:22:23.915618] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-27T20:22:24.276922] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:24.350227] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T20:22:24.414972] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-27T20:22:25.203870] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T20:22:25.214908] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-27T20:22:25.732057] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T20:22:26.014968] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-27T20:22:26.526481] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T20:22:26.814963] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-27T20:22:26.947194] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T20:22:26.956421] [INFO ] [REMOTE ] OC: Full fetch complete (64714 records). [2025-10-27T20:22:26.956581] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-27T20:22:26.957353] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:22:26.957438] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:22:26.957480] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:22:26.957519] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-27T20:22:26.957577] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-27T20:22:26.957612] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-27T20:22:26.957774] [DEBUG] [LOCAL ] OC: Deleted derivative data file. [2025-10-27T20:22:26.958195] [INFO ] [MAIN ] Update Progress: 1573/2366 symbols completed. OC took 49.9s. Estimated remaining: 1h 42m 2s. Rate: 7.8 symbols/min [2025-10-27T20:22:27.121673] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:27.172728] [DEBUG] [LOCAL ] OGN: Loaded 53884 existing records from primary storage. [2025-10-27T20:22:27.173068] [INFO ] [MAIN ] OGN: Loaded 53884 existing records. [2025-10-27T20:22:27.345495] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:27.345744] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-27T20:22:27.345797] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-27T20:22:27.346323] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-27T20:22:27.346379] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-27T20:22:27.616949] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-27T20:22:27.702825] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:27.759164] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T20:22:28.414957] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-27T20:22:29.205774] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:22:29.214921] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-27T20:22:29.789369] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T20:22:30.015003] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-27T20:22:30.374729] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T20:22:30.814987] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-27T20:22:31.614937] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-27T20:22:31.760948] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T20:22:32.177168] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T20:22:32.414933] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-27T20:22:32.736095] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T20:22:33.214981] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-27T20:22:33.973172] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T20:22:34.014934] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-27T20:22:34.162273] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T20:22:34.814977] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-27T20:22:35.403684] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T20:22:35.614951] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-27T20:22:36.046312] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T20:22:36.053726] [INFO ] [REMOTE ] OEC: Full fetch complete (53649 records). [2025-10-27T20:22:36.053836] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-27T20:22:36.423564] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-27T20:22:36.442841] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-27T20:22:36.442919] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-27T20:22:36.444001] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-27T20:22:36.444065] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-27T20:22:36.445387] [DEBUG] [LOCAL ] OEC: Trimmed 53649 records to 36893 (keeping 200 days of data) [2025-10-27T20:22:36.669096] [DEBUG] [LOCAL ] OEC: Primary data saved (36893 records). [2025-10-27T20:22:36.669236] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-27T20:22:36.669923] [INFO ] [MAIN ] Update Progress: 1574/2366 symbols completed. OEC took 31.2s. Estimated remaining: 1h 41m 55s. Rate: 7.8 symbols/min [2025-10-27T20:22:36.837435] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T20:22:36.867073] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:36.901165] [DEBUG] [LOCAL ] OGS: Loaded 34304 existing records from primary storage. [2025-10-27T20:22:36.901431] [INFO ] [MAIN ] OGS: Loaded 34304 existing records. [2025-10-27T20:22:37.077522] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:37.077780] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-27T20:22:37.077840] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-27T20:22:37.078091] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-27T20:22:37.078149] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-27T20:22:37.220084] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-27T20:22:37.452746] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:37.840621] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T20:22:38.014923] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-27T20:22:38.295634] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T20:22:38.815005] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-27T20:22:39.614952] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-27T20:22:39.999455] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T20:22:40.192608] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T20:22:40.379095] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T20:22:40.383100] [INFO ] [REMOTE ] OFG: Full fetch complete (33358 records). [2025-10-27T20:22:40.383215] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-27T20:22:40.383716] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:22:40.383807] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:22:40.383877] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:22:40.383967] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-27T20:22:40.384044] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-27T20:22:40.384082] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-27T20:22:40.384202] [DEBUG] [LOCAL ] OFG: Deleted derivative data file. [2025-10-27T20:22:40.384272] [INFO ] [MAIN ] Update Progress: 1575/2366 symbols completed. OFG took 24.5s. Estimated remaining: 1h 41m 46s. Rate: 7.8 symbols/min [2025-10-27T20:22:40.420063] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-27T20:22:40.553551] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:40.598845] [DEBUG] [LOCAL ] OHI: Loaded 52548 existing records from primary storage. [2025-10-27T20:22:40.599174] [INFO ] [MAIN ] OHI: Loaded 52548 existing records. [2025-10-27T20:22:40.774567] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:40.774807] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-27T20:22:40.774868] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-27T20:22:40.775132] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-27T20:22:40.775170] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-27T20:22:41.129045] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:41.214913] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-27T20:22:42.017945] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-27T20:22:42.021182] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T20:22:42.599042] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T20:22:42.814949] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-27T20:22:43.622212] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-27T20:22:43.639086] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T20:22:44.415000] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-27T20:22:44.712175] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T20:22:45.214972] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-27T20:22:45.291095] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T20:22:46.015031] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-27T20:22:46.148851] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T20:22:46.814911] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-27T20:22:47.226902] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-27T20:22:47.589527] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T20:22:47.614900] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-27T20:22:48.414925] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-27T20:22:48.466425] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T20:22:49.060606] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T20:22:49.214914] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-27T20:22:49.461145] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T20:22:50.014987] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-27T20:22:50.536031] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T20:22:50.814949] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-27T20:22:51.115346] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T20:22:51.614940] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-27T20:22:52.414928] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-27T20:22:52.453845] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T20:22:53.065441] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T20:22:53.214920] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-27T20:22:53.416008] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T20:22:53.426127] [INFO ] [REMOTE ] OGN: Full fetch complete (76549 records). [2025-10-27T20:22:53.426279] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-27T20:22:53.427162] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:22:53.427248] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:22:53.427322] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:22:53.427409] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-27T20:22:53.427487] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-27T20:22:53.427537] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-27T20:22:53.427722] [DEBUG] [LOCAL ] OGN: Deleted derivative data file. [2025-10-27T20:22:53.428195] [INFO ] [MAIN ] Update Progress: 1576/2366 symbols completed. OGN took 26.5s. Estimated remaining: 1h 41m 41s. Rate: 7.8 symbols/min [2025-10-27T20:22:53.599571] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:53.646175] [DEBUG] [LOCAL ] OI: Loaded 47691 existing records from primary storage. [2025-10-27T20:22:53.646472] [INFO ] [MAIN ] OI: Loaded 47691 existing records. [2025-10-27T20:22:53.818954] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:53.819175] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-27T20:22:53.819220] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-27T20:22:53.819455] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-27T20:22:53.819509] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-27T20:22:54.023620] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-27T20:22:54.175125] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:22:54.674577] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T20:22:54.815019] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-27T20:22:55.418605] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T20:22:55.614997] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-27T20:22:56.414923] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-27T20:22:57.209823] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T20:22:57.216595] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-27T20:22:57.944008] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T20:22:58.014931] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-27T20:22:58.527895] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:22:58.810628] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (4.00 seconds). [2025-10-27T20:22:58.821188] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-27T20:22:58.962962] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T20:22:58.971545] [INFO ] [REMOTE ] OGE: Full fetch complete (66500 records). [2025-10-27T20:22:58.971726] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-27T20:22:58.972505] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:22:58.972598] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:22:58.972640] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:22:58.972724] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-27T20:22:58.972804] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-27T20:22:58.972860] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-27T20:22:58.972989] [DEBUG] [LOCAL ] OGE: Deleted derivative data file. [2025-10-27T20:22:58.973071] [INFO ] [MAIN ] Update Progress: 1577/2366 symbols completed. OGE took 35.5s. Estimated remaining: 1h 41m 32s. Rate: 7.8 symbols/min [2025-10-27T20:22:59.154879] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:22:59.170934] [DEBUG] [LOCAL ] OIA: Loaded 13200 existing records from primary storage. [2025-10-27T20:22:59.171196] [INFO ] [MAIN ] OIA: Loaded 13200 existing records. [2025-10-27T20:22:59.360628] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:22:59.360867] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-27T20:22:59.360914] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-27T20:22:59.361069] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-27T20:22:59.361106] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-27T20:22:59.622998] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-27T20:22:59.779091] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:00.414926] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-27T20:23:00.599976] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T20:23:01.214950] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-27T20:23:02.015050] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-27T20:23:05.849268] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (6.23 seconds). [2025-10-27T20:23:05.860250] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-27T20:23:06.994678] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (5.78 seconds). [2025-10-27T20:23:06.999607] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-27T20:23:07.210880] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (5.20 seconds). [2025-10-27T20:23:07.224173] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-27T20:23:08.163852] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-27T20:23:08.171546] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-27T20:23:08.721969] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (8.31 seconds). [2025-10-27T20:23:08.731606] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-27T20:23:08.768128] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T20:23:08.772333] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-27T20:23:08.945341] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T20:23:08.956150] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-27T20:23:09.794140] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T20:23:09.801579] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-27T20:23:10.332214] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T20:23:10.342119] [INFO ] [REMOTE ] OHI: Full fetch complete (74879 records). [2025-10-27T20:23:10.342290] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-27T20:23:10.343124] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:23:10.343219] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:23:10.343261] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:23:10.343305] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-27T20:23:10.343360] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-27T20:23:10.343394] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-27T20:23:10.343522] [DEBUG] [LOCAL ] OHI: Deleted derivative data file. [2025-10-27T20:23:10.343593] [INFO ] [MAIN ] Update Progress: 1578/2366 symbols completed. OHI took 30.0s. Estimated remaining: 1h 41m 26s. Rate: 7.8 symbols/min [2025-10-27T20:23:10.515864] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:10.554365] [DEBUG] [LOCAL ] OII: Loaded 42488 existing records from primary storage. [2025-10-27T20:23:10.554677] [INFO ] [MAIN ] OII: Loaded 42488 existing records. [2025-10-27T20:23:10.745034] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:10.755483] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T20:23:10.755122] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-27T20:23:10.759428] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-27T20:23:10.759493] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-27T20:23:10.760456] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-27T20:23:10.760525] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-27T20:23:11.130007] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:11.130439] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-27T20:23:11.158704] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-27T20:23:11.169991] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-27T20:23:11.374673] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T20:23:11.614996] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-27T20:23:11.743792] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T20:23:12.414996] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-27T20:23:12.662991] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T20:23:13.220135] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-27T20:23:13.231417] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T20:23:13.355877] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T20:23:13.551349] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T20:23:14.015009] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-27T20:23:14.645123] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:23:14.655476] [INFO ] [REMOTE ] OGS: Full fetch complete (47653 records). [2025-10-27T20:23:14.655875] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-27T20:23:14.656517] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:23:14.656700] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:23:14.656753] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:23:14.656794] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-27T20:23:14.656861] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-27T20:23:14.656916] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-27T20:23:14.657203] [DEBUG] [LOCAL ] OGS: Deleted derivative data file. [2025-10-27T20:23:14.657295] [INFO ] [MAIN ] Update Progress: 1579/2366 symbols completed. OGS took 38.0s. Estimated remaining: 1h 41m 17s. Rate: 7.8 symbols/min [2025-10-27T20:23:14.814922] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-27T20:23:14.826315] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:14.862742] [DEBUG] [LOCAL ] OIS: Loaded 40385 existing records from primary storage. [2025-10-27T20:23:14.863031] [INFO ] [MAIN ] OIS: Loaded 40385 existing records. [2025-10-27T20:23:15.038216] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:15.038394] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-27T20:23:15.038440] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-27T20:23:15.038678] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-27T20:23:15.038736] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-27T20:23:15.412070] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:15.416069] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-27T20:23:15.614944] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-27T20:23:16.056712] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T20:23:16.414936] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-27T20:23:17.214917] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-27T20:23:17.391227] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T20:23:17.620558] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T20:23:17.979967] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:23:18.014904] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-27T20:23:18.815149] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-27T20:23:19.365829] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T20:23:19.614915] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-27T20:23:19.968756] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T20:23:20.414945] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-27T20:23:20.947348] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T20:23:21.214964] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-27T20:23:22.014921] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-27T20:23:22.159325] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T20:23:22.627983] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T20:23:22.814919] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-27T20:23:23.352122] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T20:23:23.614988] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-27T20:23:24.110716] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:23:24.414953] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-27T20:23:25.214977] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-27T20:23:25.245828] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T20:23:25.996188] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T20:23:26.023117] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-27T20:23:26.028059] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T20:23:26.814941] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-27T20:23:27.614954] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-27T20:23:27.895681] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T20:23:28.414979] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-27T20:23:28.648080] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T20:23:29.178391] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T20:23:29.180703] [INFO ] [REMOTE ] OIA: Full fetch complete (20021 records). [2025-10-27T20:23:29.180780] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-27T20:23:29.220142] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-27T20:23:29.527288] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-27T20:23:29.617059] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-27T20:23:29.617132] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-27T20:23:29.617548] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-27T20:23:29.617586] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-27T20:23:29.618133] [DEBUG] [LOCAL ] OIA: Trimmed 20021 records to 12749 (keeping 200 days of data) [2025-10-27T20:23:29.692755] [DEBUG] [LOCAL ] OIA: Primary data saved (12749 records). [2025-10-27T20:23:29.692889] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-27T20:23:29.692975] [INFO ] [MAIN ] Update Progress: 1580/2366 symbols completed. OIA took 30.7s. Estimated remaining: 1h 41m 12s. Rate: 7.8 symbols/min [2025-10-27T20:23:29.859273] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:29.907347] [DEBUG] [LOCAL ] OKE: Loaded 54356 existing records from primary storage. [2025-10-27T20:23:29.907751] [INFO ] [MAIN ] OKE: Loaded 54356 existing records. [2025-10-27T20:23:30.020037] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-27T20:23:30.115661] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:30.115904] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-27T20:23:30.115976] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-27T20:23:30.116393] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-10-27T20:23:30.116451] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-27T20:23:30.460225] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:30.814931] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-27T20:23:30.962472] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:23:31.615001] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-27T20:23:31.829910] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T20:23:31.890782] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:23:31.900082] [INFO ] [REMOTE ] OI: Full fetch complete (67910 records). [2025-10-27T20:23:31.900222] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-27T20:23:31.900999] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:23:31.901101] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:23:31.901174] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:23:31.901260] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-27T20:23:31.901371] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-27T20:23:31.901444] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-27T20:23:31.901579] [DEBUG] [LOCAL ] OI: Deleted derivative data file. [2025-10-27T20:23:31.902075] [INFO ] [MAIN ] Update Progress: 1581/2366 symbols completed. OI took 38.5s. Estimated remaining: 1h 41m 2s. Rate: 7.8 symbols/min [2025-10-27T20:23:32.070819] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:32.124400] [DEBUG] [LOCAL ] OKLO: Loaded 54599 existing records from primary storage. [2025-10-27T20:23:32.124759] [INFO ] [MAIN ] OKLO: Loaded 54599 existing records. [2025-10-27T20:23:32.307443] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:32.307688] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-27T20:23:32.307747] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-27T20:23:32.307930] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-10-27T20:23:32.307968] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-27T20:23:32.420048] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-27T20:23:32.695854] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:32.757857] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T20:23:33.214948] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-27T20:23:34.014987] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-27T20:23:34.146415] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T20:23:34.814959] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-27T20:23:34.851109] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T20:23:35.614978] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-27T20:23:36.414949] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-27T20:23:36.699608] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-27T20:23:37.213239] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-27T20:23:37.221188] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-27T20:23:37.490674] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T20:23:38.015048] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-27T20:23:38.197107] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T20:23:38.814991] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-27T20:23:39.161813] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:23:39.169208] [INFO ] [REMOTE ] OIS: Full fetch complete (57453 records). [2025-10-27T20:23:39.169320] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-27T20:23:39.547771] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-27T20:23:39.547917] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-27T20:23:39.548995] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-27T20:23:39.549176] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-27T20:23:39.550619] [DEBUG] [LOCAL ] OIS: Trimmed 57453 records to 39608 (keeping 200 days of data) [2025-10-27T20:23:39.628680] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-27T20:23:39.682635] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-27T20:23:39.806675] [DEBUG] [LOCAL ] OIS: Primary data saved (39608 records). [2025-10-27T20:23:39.806851] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-27T20:23:39.806935] [INFO ] [MAIN ] Update Progress: 1582/2366 symbols completed. OIS took 25.1s. Estimated remaining: 1h 40m 54s. Rate: 7.8 symbols/min [2025-10-27T20:23:39.979103] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:40.033363] [DEBUG] [LOCAL ] OLN: Loaded 52761 existing records from primary storage. [2025-10-27T20:23:40.033672] [INFO ] [MAIN ] OLN: Loaded 52761 existing records. [2025-10-27T20:23:40.214287] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:40.214602] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-27T20:23:40.214689] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-27T20:23:40.215064] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-27T20:23:40.215173] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-27T20:23:40.388076] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T20:23:40.426399] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-27T20:23:40.610319] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:41.214921] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-27T20:23:41.474250] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T20:23:41.742506] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:23:41.749917] [INFO ] [REMOTE ] OII: Full fetch complete (61491 records). [2025-10-27T20:23:41.750040] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-27T20:23:41.750739] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:23:41.750823] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:23:41.750865] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:23:41.750937] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-27T20:23:41.751027] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-27T20:23:41.751062] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-27T20:23:41.751209] [DEBUG] [LOCAL ] OII: Deleted derivative data file. [2025-10-27T20:23:41.751298] [INFO ] [MAIN ] Update Progress: 1583/2366 symbols completed. OII took 31.4s. Estimated remaining: 1h 40m 44s. Rate: 7.8 symbols/min [2025-10-27T20:23:41.920073] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:23:41.931704] [DEBUG] [LOCAL ] OLP: Loaded 10216 existing records from primary storage. [2025-10-27T20:23:41.931911] [INFO ] [MAIN ] OLP: Loaded 10216 existing records. [2025-10-27T20:23:42.021933] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-27T20:23:42.110925] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:23:42.111119] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-27T20:23:42.111166] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-27T20:23:42.111314] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-27T20:23:42.111353] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-27T20:23:42.469468] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:23:42.815002] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-27T20:23:43.247704] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-27T20:23:43.614916] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-27T20:23:43.729793] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T20:23:44.414945] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-27T20:23:44.986833] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-27T20:23:45.214949] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-27T20:23:45.800110] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:23:45.803152] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-27T20:23:46.014952] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-27T20:23:46.217748] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T20:23:46.814939] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-27T20:23:47.614966] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-27T20:23:48.034853] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T20:23:48.144584] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T20:23:48.254361] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T20:23:48.415029] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-27T20:23:49.214948] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-27T20:23:50.014936] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-27T20:23:50.824986] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-27T20:23:50.831692] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T20:23:51.197526] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T20:23:51.614996] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-27T20:23:52.415039] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-27T20:23:52.537000] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T20:23:53.214944] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-27T20:23:53.398165] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-27T20:23:53.547928] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (5.13 seconds). [2025-10-27T20:23:53.963240] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T20:23:54.014920] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-27T20:23:54.490211] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:23:54.815008] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-27T20:23:55.386259] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-27T20:23:55.614930] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-27T20:23:56.414969] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-27T20:23:57.009187] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.99 seconds). [2025-10-27T20:23:57.206752] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:23:57.217134] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-27T20:23:58.014963] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-27T20:23:58.579863] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-27T20:23:58.815016] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-27T20:23:59.462815] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T20:23:59.614911] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-27T20:24:00.278748] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-27T20:24:00.414913] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-27T20:24:00.732586] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T20:24:01.214948] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-27T20:24:01.457397] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T20:24:02.014976] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-27T20:24:02.814948] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-27T20:24:02.980747] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-27T20:24:03.167171] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T20:24:03.397140] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T20:24:03.527880] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T20:24:03.614909] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-27T20:24:04.414946] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-27T20:24:05.214930] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-27T20:24:05.664069] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T20:24:06.014925] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-27T20:24:06.093093] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T20:24:06.735855] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:24:06.746181] [INFO ] [REMOTE ] OLN: Full fetch complete (74409 records). [2025-10-27T20:24:06.746339] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-27T20:24:06.747315] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:24:06.747419] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:24:06.747496] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:24:06.747570] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-27T20:24:06.747634] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-27T20:24:06.747717] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-27T20:24:06.747846] [DEBUG] [LOCAL ] OLN: Deleted derivative data file. [2025-10-27T20:24:06.748741] [INFO ] [MAIN ] Update Progress: 1584/2366 symbols completed. OLN took 26.9s. Estimated remaining: 1h 40m 45s. Rate: 7.8 symbols/min [2025-10-27T20:24:06.822088] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-27T20:24:06.924682] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:06.976518] [DEBUG] [LOCAL ] OMC: Loaded 54071 existing records from primary storage. [2025-10-27T20:24:06.976986] [INFO ] [MAIN ] OMC: Loaded 54071 existing records. [2025-10-27T20:24:07.158146] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:07.158386] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-27T20:24:07.158529] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-27T20:24:07.169355] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-10-27T20:24:07.187874] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-27T20:24:07.267063] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-27T20:24:07.587437] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:07.614941] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-27T20:24:07.968283] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:24:07.977972] [INFO ] [REMOTE ] OKE: Full fetch complete (77298 records). [2025-10-27T20:24:07.978122] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-27T20:24:07.978957] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:24:07.979046] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:24:07.979088] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:24:07.979154] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-27T20:24:07.979216] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-27T20:24:07.979251] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-27T20:24:07.979384] [DEBUG] [LOCAL ] OKE: Deleted derivative data file. [2025-10-27T20:24:07.979453] [INFO ] [MAIN ] Update Progress: 1585/2366 symbols completed. OKE took 38.3s. Estimated remaining: 1h 40m 34s. Rate: 7.8 symbols/min [2025-10-27T20:24:08.146476] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:08.187217] [DEBUG] [LOCAL ] OMF: Loaded 47154 existing records from primary storage. [2025-10-27T20:24:08.187535] [INFO ] [MAIN ] OMF: Loaded 47154 existing records. [2025-10-27T20:24:08.364681] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:08.365012] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-27T20:24:08.365074] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-27T20:24:08.365352] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-27T20:24:08.365414] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-27T20:24:08.427736] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-27T20:24:08.758676] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:08.770752] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T20:24:08.781226] [INFO ] [REMOTE ] OKLO: Full fetch complete (77999 records). [2025-10-27T20:24:08.781347] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-27T20:24:09.160904] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-10-27T20:24:09.160999] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-10-27T20:24:09.162106] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-10-27T20:24:09.162171] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-10-27T20:24:09.163636] [DEBUG] [LOCAL ] OKLO: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-27T20:24:09.221152] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-27T20:24:09.281803] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T20:24:09.496709] [DEBUG] [LOCAL ] OKLO: Primary data saved (53819 records). [2025-10-27T20:24:09.496879] [INFO ] [MAIN ] OKLO: Full history saved. [2025-10-27T20:24:09.497276] [INFO ] [MAIN ] Update Progress: 1586/2366 symbols completed. OKLO took 37.6s. Estimated remaining: 1h 40m 23s. Rate: 7.8 symbols/min [2025-10-27T20:24:09.663138] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:09.702632] [DEBUG] [LOCAL ] OMI: Loaded 46882 existing records from primary storage. [2025-10-27T20:24:09.702945] [INFO ] [MAIN ] OMI: Loaded 46882 existing records. [2025-10-27T20:24:09.878745] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:09.878958] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-27T20:24:09.879032] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-27T20:24:09.879241] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-27T20:24:09.879279] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-27T20:24:10.024916] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-27T20:24:10.227544] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:10.771393] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T20:24:10.814900] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-27T20:24:10.832220] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T20:24:10.834912] [INFO ] [REMOTE ] OLP: Full fetch complete (14277 records). [2025-10-27T20:24:10.834981] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-27T20:24:11.194324] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-27T20:24:11.194393] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-27T20:24:11.194722] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-27T20:24:11.194782] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-27T20:24:11.195247] [DEBUG] [LOCAL ] OLP: Trimmed 14277 records to 9975 (keeping 200 days of data) [2025-10-27T20:24:11.253501] [DEBUG] [LOCAL ] OLP: Primary data saved (9975 records). [2025-10-27T20:24:11.253618] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-27T20:24:11.253724] [INFO ] [MAIN ] Update Progress: 1587/2366 symbols completed. OLP took 29.5s. Estimated remaining: 1h 40m 12s. Rate: 7.8 symbols/min [2025-10-27T20:24:11.418685] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:11.427053] [DEBUG] [LOCAL ] ONIT: Loaded 7577 existing records from primary storage. [2025-10-27T20:24:11.427264] [INFO ] [MAIN ] ONIT: Loaded 7577 existing records. [2025-10-27T20:24:11.606165] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:11.606375] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-27T20:24:11.606422] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-27T20:24:11.606573] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-27T20:24:11.606612] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-27T20:24:11.620072] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-27T20:24:11.962930] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:12.414997] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-27T20:24:12.820485] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T20:24:13.209609] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:24:13.217774] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-27T20:24:13.342905] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T20:24:14.014950] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-27T20:24:14.814929] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-27T20:24:14.888370] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T20:24:14.902782] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:24:15.614960] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-27T20:24:16.414950] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-27T20:24:16.685295] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T20:24:17.214913] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-27T20:24:17.309163] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T20:24:17.325888] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T20:24:18.014946] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-27T20:24:18.742302] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T20:24:18.814968] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-27T20:24:18.942781] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T20:24:19.614996] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-27T20:24:20.050554] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T20:24:20.414999] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-27T20:24:21.214977] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-27T20:24:21.328918] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T20:24:21.535634] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T20:24:22.014983] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-27T20:24:22.814987] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-27T20:24:22.998254] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T20:24:23.614975] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-27T20:24:24.102828] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T20:24:24.414961] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-27T20:24:24.866238] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T20:24:24.928177] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T20:24:25.208879] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T20:24:25.214899] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-27T20:24:25.953602] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T20:24:26.014921] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-27T20:24:26.815002] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-27T20:24:27.614999] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-27T20:24:27.740767] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:24:27.925458] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T20:24:28.415011] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-27T20:24:28.889959] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T20:24:29.214967] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-27T20:24:30.024100] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-27T20:24:30.030736] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T20:24:30.814937] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-27T20:24:30.987026] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T20:24:31.366570] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T20:24:31.615159] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-27T20:24:31.617193] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T20:24:32.414980] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-27T20:24:33.112591] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T20:24:33.214957] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-27T20:24:33.994082] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T20:24:34.014886] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-27T20:24:34.083389] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T20:24:34.085000] [INFO ] [REMOTE ] ONIT: Full fetch complete (10887 records). [2025-10-27T20:24:34.085067] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-27T20:24:34.444728] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-27T20:24:34.444806] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-27T20:24:34.445119] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-27T20:24:34.445157] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-27T20:24:34.445576] [DEBUG] [LOCAL ] ONIT: Trimmed 10887 records to 7239 (keeping 200 days of data) [2025-10-27T20:24:34.485602] [DEBUG] [LOCAL ] ONIT: Primary data saved (7239 records). [2025-10-27T20:24:34.485734] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-27T20:24:34.485816] [INFO ] [MAIN ] Update Progress: 1588/2366 symbols completed. ONIT took 23.2s. Estimated remaining: 1h 40m 12s. Rate: 7.8 symbols/min [2025-10-27T20:24:34.655381] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:34.682161] [DEBUG] [LOCAL ] ONL: Loaded 29141 existing records from primary storage. [2025-10-27T20:24:34.682414] [INFO ] [MAIN ] ONL: Loaded 29141 existing records. [2025-10-27T20:24:34.820693] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-27T20:24:34.860303] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:34.860471] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-27T20:24:34.860516] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-27T20:24:34.860748] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-27T20:24:34.860809] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-27T20:24:35.262887] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:35.615043] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-27T20:24:36.054272] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-27T20:24:36.414968] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-27T20:24:36.523217] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T20:24:36.840002] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T20:24:37.215028] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-27T20:24:38.014952] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-27T20:24:38.066408] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T20:24:38.814941] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-27T20:24:39.144119] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T20:24:39.412399] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:24:39.549280] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T20:24:39.614911] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-27T20:24:40.414955] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-27T20:24:41.214935] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-27T20:24:41.287353] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T20:24:41.328412] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:24:41.339313] [INFO ] [REMOTE ] OMI: Full fetch complete (65562 records). [2025-10-27T20:24:41.339497] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-27T20:24:41.340404] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:24:41.340498] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:24:41.340542] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:24:41.340582] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-27T20:24:41.340669] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-27T20:24:41.340728] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-27T20:24:41.340892] [DEBUG] [LOCAL ] OMI: Deleted derivative data file. [2025-10-27T20:24:41.341345] [INFO ] [MAIN ] Update Progress: 1589/2366 symbols completed. OMI took 31.8s. Estimated remaining: 1h 40m 4s. Rate: 7.8 symbols/min [2025-10-27T20:24:41.525793] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:41.579375] [DEBUG] [LOCAL ] ONON: Loaded 54393 existing records from primary storage. [2025-10-27T20:24:41.579730] [INFO ] [MAIN ] ONON: Loaded 54393 existing records. [2025-10-27T20:24:41.783766] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:41.784032] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-27T20:24:41.784082] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-27T20:24:41.784373] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-27T20:24:41.784430] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-27T20:24:42.020177] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-27T20:24:42.156599] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:42.589405] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T20:24:42.814938] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-27T20:24:43.170635] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T20:24:43.614982] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-27T20:24:43.936504] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T20:24:43.946755] [INFO ] [REMOTE ] OMC: Full fetch complete (76904 records). [2025-10-27T20:24:43.947065] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-27T20:24:43.947924] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:24:43.948011] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:24:43.948057] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:24:43.948125] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-27T20:24:43.948190] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-27T20:24:43.948228] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-27T20:24:43.948359] [DEBUG] [LOCAL ] OMC: Deleted derivative data file. [2025-10-27T20:24:43.948955] [INFO ] [MAIN ] Update Progress: 1590/2366 symbols completed. OMC took 37.2s. Estimated remaining: 1h 39m 54s. Rate: 7.8 symbols/min [2025-10-27T20:24:44.134906] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:44.159853] [DEBUG] [LOCAL ] ONTF: Loaded 22818 existing records from primary storage. [2025-10-27T20:24:44.160100] [INFO ] [MAIN ] ONTF: Loaded 22818 existing records. [2025-10-27T20:24:44.344206] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:44.344458] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-27T20:24:44.344505] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-27T20:24:44.344716] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-27T20:24:44.344774] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-27T20:24:44.420058] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-27T20:24:44.695816] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:45.214990] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-27T20:24:45.665429] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-27T20:24:45.913555] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T20:24:46.014962] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-27T20:24:46.489884] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T20:24:46.814937] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-27T20:24:47.127407] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T20:24:47.614938] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-27T20:24:48.376610] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:24:48.414926] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-27T20:24:49.214989] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-27T20:24:49.570682] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-27T20:24:49.583145] [INFO ] [REMOTE ] OMF: Full fetch complete (67898 records). [2025-10-27T20:24:49.583355] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-27T20:24:49.982879] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-27T20:24:49.983019] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-27T20:24:49.984171] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-27T20:24:49.984249] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-27T20:24:49.985901] [DEBUG] [LOCAL ] OMF: Trimmed 67898 records to 46368 (keeping 200 days of data) [2025-10-27T20:24:50.038150] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-27T20:24:50.269163] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T20:24:50.356669] [DEBUG] [LOCAL ] OMF: Primary data saved (46368 records). [2025-10-27T20:24:50.357680] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T20:24:50.361113] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-27T20:24:50.361854] [INFO ] [MAIN ] Update Progress: 1591/2366 symbols completed. OMF took 42.4s. Estimated remaining: 1h 39m 45s. Rate: 7.8 symbols/min [2025-10-27T20:24:50.535750] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:24:50.577321] [DEBUG] [LOCAL ] ONTO: Loaded 47765 existing records from primary storage. [2025-10-27T20:24:50.577634] [INFO ] [MAIN ] ONTO: Loaded 47765 existing records. [2025-10-27T20:24:50.759956] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:24:50.760153] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-27T20:24:50.760198] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-27T20:24:50.760376] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-27T20:24:50.760412] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-27T20:24:50.820845] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-27T20:24:51.113112] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:24:51.155215] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T20:24:51.614975] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-27T20:24:52.414964] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-27T20:24:52.613202] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T20:24:52.907067] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T20:24:53.214938] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-27T20:24:53.527736] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T20:24:54.014929] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-27T20:24:54.814917] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-27T20:24:55.330014] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T20:24:55.393804] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T20:24:55.614906] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-27T20:24:56.011704] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T20:24:56.414944] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-27T20:24:57.215029] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-27T20:24:57.467365] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T20:24:57.524592] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-27T20:24:58.014926] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-27T20:24:58.721046] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T20:24:58.776019] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:24:58.814904] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-27T20:24:59.615013] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-27T20:25:00.414933] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-27T20:25:00.610056] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T20:25:00.841767] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T20:25:01.214935] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-27T20:25:02.014971] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-27T20:25:02.619538] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T20:25:02.809999] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:25:02.816012] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-27T20:25:03.614972] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-27T20:25:04.023459] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T20:25:04.414915] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-27T20:25:04.499501] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T20:25:04.887064] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-27T20:25:05.214957] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-27T20:25:06.014922] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-27T20:25:06.050932] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T20:25:06.490616] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T20:25:06.814951] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-27T20:25:07.351547] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T20:25:07.614945] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-27T20:25:07.727173] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:25:07.731867] [INFO ] [REMOTE ] ONL: Full fetch complete (42228 records). [2025-10-27T20:25:07.731961] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-27T20:25:08.114400] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-27T20:25:08.114473] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-27T20:25:08.115354] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-27T20:25:08.115416] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-27T20:25:08.116300] [DEBUG] [LOCAL ] ONL: Trimmed 42228 records to 28280 (keeping 200 days of data) [2025-10-27T20:25:08.277432] [DEBUG] [LOCAL ] ONL: Primary data saved (28280 records). [2025-10-27T20:25:08.277551] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-27T20:25:08.277628] [INFO ] [MAIN ] Update Progress: 1592/2366 symbols completed. ONL took 33.8s. Estimated remaining: 1h 39m 43s. Rate: 7.8 symbols/min [2025-10-27T20:25:08.420073] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-27T20:25:08.451015] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:08.469938] [DEBUG] [LOCAL ] OOMA: Loaded 18453 existing records from primary storage. [2025-10-27T20:25:08.470189] [INFO ] [MAIN ] OOMA: Loaded 18453 existing records. [2025-10-27T20:25:08.642142] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:08.642323] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-27T20:25:08.642378] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-27T20:25:08.642542] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-27T20:25:08.642579] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-27T20:25:08.985405] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:09.214913] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-27T20:25:09.425434] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T20:25:09.967818] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:25:10.014940] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-27T20:25:10.787148] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-27T20:25:10.814903] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-27T20:25:11.128312] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T20:25:11.615001] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-27T20:25:11.944457] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T20:25:11.949062] [INFO ] [REMOTE ] ONTF: Full fetch complete (31520 records). [2025-10-27T20:25:11.949153] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-27T20:25:12.314804] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-27T20:25:12.314888] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-27T20:25:12.315666] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-27T20:25:12.315728] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-27T20:25:12.316682] [DEBUG] [LOCAL ] ONTF: Trimmed 31520 records to 22513 (keeping 200 days of data) [2025-10-27T20:25:12.416991] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-27T20:25:12.440873] [DEBUG] [LOCAL ] ONTF: Primary data saved (22513 records). [2025-10-27T20:25:12.441134] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-27T20:25:12.441225] [INFO ] [MAIN ] Update Progress: 1593/2366 symbols completed. ONTF took 28.5s. Estimated remaining: 1h 39m 33s. Rate: 7.8 symbols/min [2025-10-27T20:25:12.608263] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:12.634214] [DEBUG] [LOCAL ] OPAD: Loaded 27038 existing records from primary storage. [2025-10-27T20:25:12.634489] [INFO ] [MAIN ] OPAD: Loaded 27038 existing records. [2025-10-27T20:25:12.803771] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:12.804001] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-27T20:25:12.804047] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-27T20:25:12.804219] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-27T20:25:12.804256] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-27T20:25:13.155169] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:13.214895] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-27T20:25:13.246261] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T20:25:14.014943] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-27T20:25:14.053614] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:25:14.815196] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-27T20:25:14.817969] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-27T20:25:14.831186] [INFO ] [REMOTE ] ONON: Full fetch complete (77770 records). [2025-10-27T20:25:14.831330] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-27T20:25:15.277754] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-27T20:25:15.277889] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-27T20:25:15.279016] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-27T20:25:15.279081] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-27T20:25:15.280526] [DEBUG] [LOCAL ] ONON: Trimmed 77770 records to 53613 (keeping 200 days of data) [2025-10-27T20:25:15.390787] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:25:15.615081] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-27T20:25:15.619254] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-10-27T20:25:15.619335] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-27T20:25:15.619776] [INFO ] [MAIN ] Update Progress: 1594/2366 symbols completed. ONON took 34.3s. Estimated remaining: 1h 39m 23s. Rate: 7.8 symbols/min [2025-10-27T20:25:15.784536] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:15.829627] [DEBUG] [LOCAL ] OPFI: Loaded 46562 existing records from primary storage. [2025-10-27T20:25:15.829946] [INFO ] [MAIN ] OPFI: Loaded 46562 existing records. [2025-10-27T20:25:16.001949] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:16.002172] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-27T20:25:16.002219] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-27T20:25:16.002445] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-27T20:25:16.002551] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-27T20:25:16.294926] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T20:25:16.374616] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:16.414916] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-27T20:25:16.824827] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T20:25:17.217820] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-27T20:25:17.220307] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T20:25:18.014935] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-27T20:25:18.822553] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-27T20:25:18.825503] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T20:25:19.149670] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T20:25:19.614937] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-27T20:25:20.414917] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-27T20:25:20.766712] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:25:20.884009] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T20:25:21.214936] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-27T20:25:21.388987] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:25:21.397505] [INFO ] [REMOTE ] ONTO: Full fetch complete (66987 records). [2025-10-27T20:25:21.397681] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-27T20:25:21.398431] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:25:21.398537] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:25:21.398631] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:25:21.398761] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-27T20:25:21.398837] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-27T20:25:21.398873] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-27T20:25:21.398996] [DEBUG] [LOCAL ] ONTO: Deleted derivative data file. [2025-10-27T20:25:21.399077] [INFO ] [MAIN ] Update Progress: 1595/2366 symbols completed. ONTO took 31.0s. Estimated remaining: 1h 39m 15s. Rate: 7.8 symbols/min [2025-10-27T20:25:21.565243] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:21.578279] [DEBUG] [LOCAL ] OPP: Loaded 12586 existing records from primary storage. [2025-10-27T20:25:21.578514] [INFO ] [MAIN ] OPP: Loaded 12586 existing records. [2025-10-27T20:25:21.759073] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:21.759297] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-27T20:25:21.759352] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-27T20:25:21.759500] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-27T20:25:21.759539] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-27T20:25:22.020099] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-27T20:25:22.021406] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-27T20:25:22.146564] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:22.814936] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-27T20:25:23.614926] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-27T20:25:23.664275] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T20:25:23.737986] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:25:24.414944] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-27T20:25:24.924289] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:25:25.085370] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T20:25:25.214940] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-27T20:25:26.014996] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-27T20:25:26.625615] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T20:25:26.814920] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-27T20:25:26.973624] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T20:25:27.367279] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T20:25:27.614936] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-27T20:25:28.414959] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-27T20:25:28.550867] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T20:25:29.214995] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-27T20:25:29.669774] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T20:25:30.015037] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-27T20:25:30.455009] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T20:25:30.603074] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T20:25:30.814996] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-27T20:25:31.471741] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T20:25:31.614950] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-27T20:25:32.415014] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-27T20:25:32.665933] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T20:25:33.215006] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-27T20:25:33.471916] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T20:25:34.014959] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-27T20:25:34.814957] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-27T20:25:34.921720] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T20:25:35.234596] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T20:25:35.614958] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-27T20:25:36.414994] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-27T20:25:36.442247] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:25:36.631065] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T20:25:37.214942] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-27T20:25:37.896070] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T20:25:38.014925] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-27T20:25:38.814949] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-27T20:25:39.498835] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-27T20:25:39.614918] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-27T20:25:39.751927] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T20:25:39.798702] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T20:25:40.414949] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-27T20:25:41.215014] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-27T20:25:41.595249] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T20:25:41.604186] [INFO ] [REMOTE ] OPAD: Full fetch complete (29788 records). [2025-10-27T20:25:41.604328] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-27T20:25:41.979478] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-27T20:25:41.979631] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-27T20:25:41.980292] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-27T20:25:41.980361] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-27T20:25:41.981424] [DEBUG] [LOCAL ] OPAD: Trimmed 29788 records to 27226 (keeping 200 days of data) [2025-10-27T20:25:42.025376] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-27T20:25:42.157985] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T20:25:42.183572] [DEBUG] [LOCAL ] OPAD: Primary data saved (27226 records). [2025-10-27T20:25:42.183909] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-27T20:25:42.184014] [INFO ] [MAIN ] Update Progress: 1596/2366 symbols completed. OPAD took 29.7s. Estimated remaining: 1h 39m 13s. Rate: 7.8 symbols/min [2025-10-27T20:25:42.356825] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:42.357007] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-27T20:25:42.357049] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-27T20:25:42.357161] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-27T20:25:42.357201] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-27T20:25:42.357241] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-27T20:25:42.357271] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-27T20:25:42.614067] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T20:25:42.646526] [INFO ] [REMOTE ] OPP: Full fetch complete (17504 records). [2025-10-27T20:25:42.656607] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-27T20:25:42.827216] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-27T20:25:42.850262] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:43.110196] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-27T20:25:43.110318] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-27T20:25:43.110809] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-27T20:25:43.110886] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-27T20:25:43.111599] [DEBUG] [LOCAL ] OPP: Trimmed 17504 records to 12295 (keeping 200 days of data) [2025-10-27T20:25:43.183055] [DEBUG] [LOCAL ] OPP: Primary data saved (12295 records). [2025-10-27T20:25:43.183188] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-27T20:25:43.183272] [INFO ] [MAIN ] Update Progress: 1597/2366 symbols completed. OPP took 21.8s. Estimated remaining: 1h 39m 2s. Rate: 7.8 symbols/min [2025-10-27T20:25:43.197002] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T20:25:43.614940] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-27T20:25:44.312523] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T20:25:44.315924] [INFO ] [REMOTE ] OOMA: Full fetch complete (25949 records). [2025-10-27T20:25:44.315994] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-27T20:25:44.418135] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-27T20:25:44.693481] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-27T20:25:44.693698] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-27T20:25:44.694407] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-27T20:25:44.694539] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-27T20:25:44.695537] [DEBUG] [LOCAL ] OOMA: Trimmed 25949 records to 18122 (keeping 200 days of data) [2025-10-27T20:25:44.807439] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T20:25:44.837272] [DEBUG] [LOCAL ] OOMA: Primary data saved (18122 records). [2025-10-27T20:25:44.837420] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-27T20:25:44.837504] [INFO ] [MAIN ] Update Progress: 1598/2366 symbols completed. OOMA took 36.6s. Estimated remaining: 1h 38m 52s. Rate: 7.8 symbols/min [2025-10-27T20:25:45.214969] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-27T20:25:45.306712] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T20:25:46.015006] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-27T20:25:46.760252] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T20:25:46.814906] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-27T20:25:47.050792] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T20:25:47.614917] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-27T20:25:47.691763] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T20:25:48.415004] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-27T20:25:49.071453] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T20:25:49.081129] [INFO ] [REMOTE ] OPFI: Full fetch complete (68532 records). [2025-10-27T20:25:49.081311] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-27T20:25:49.497783] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-27T20:25:49.497899] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-27T20:25:49.505086] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T20:25:49.504715] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-27T20:25:49.507875] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-27T20:25:49.507803] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-27T20:25:49.510030] [DEBUG] [LOCAL ] OPFI: Trimmed 68532 records to 45789 (keeping 200 days of data) [2025-10-27T20:25:49.773951] [DEBUG] [LOCAL ] OPFI: Primary data saved (45789 records). [2025-10-27T20:25:49.774076] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-27T20:25:49.774435] [INFO ] [MAIN ] Update Progress: 1599/2366 symbols completed. OPFI took 34.2s. Estimated remaining: 1h 38m 42s. Rate: 7.8 symbols/min [2025-10-27T20:25:50.212588] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T20:25:50.215439] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-27T20:25:50.958676] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:25:50.961415] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-27T20:25:51.952384] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:25:51.954860] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-27T20:25:52.681627] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T20:25:52.683803] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-27T20:25:53.824730] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T20:25:53.827375] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-27T20:25:54.496120] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:25:54.498064] [INFO ] [REMOTE ] OPY: Full fetch complete (10246 records). [2025-10-27T20:25:54.498138] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-27T20:25:54.683533] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T20:25:54.683818] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:25:54.683889] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:25:54.683962] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-27T20:25:54.684025] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-27T20:25:54.684062] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-27T20:25:54.684102] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-27T20:25:54.684156] [INFO ] [MAIN ] Update Progress: 1600/2366 symbols completed. OPY took 12.5s. Estimated remaining: 1h 38m 33s. Rate: 7.8 symbols/min [2025-10-27T20:25:55.352474] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:55.337565] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:55.400915] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:55.381232] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:25:55.401710] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-27T20:25:55.402142] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-27T20:25:55.402257] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-27T20:25:55.402299] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-27T20:25:55.402341] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-27T20:25:55.402373] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-27T20:25:55.759393] [DEBUG] [LOCAL ] ORC: Loaded 53251 existing records from primary storage. [2025-10-27T20:25:55.760398] [DEBUG] [LOCAL ] ORA: Loaded 33555 existing records from primary storage. [2025-10-27T20:25:55.778048] [INFO ] [MAIN ] ORC: Loaded 53251 existing records. [2025-10-27T20:25:55.778873] [DEBUG] [LOCAL ] OR: Loaded 47581 existing records from primary storage. [2025-10-27T20:25:55.808001] [INFO ] [MAIN ] ORA: Loaded 33555 existing records. [2025-10-27T20:25:55.834215] [INFO ] [MAIN ] OR: Loaded 47581 existing records. [2025-10-27T20:25:56.175408] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:56.227131] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-27T20:25:56.313929] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:56.355038] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-27T20:25:56.404706] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-27T20:25:56.411885] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:56.430705] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-27T20:25:56.434868] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:25:56.435183] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-27T20:25:56.436106] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-27T20:25:56.436332] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-27T20:25:56.436422] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-27T20:25:56.441833] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-27T20:25:56.449078] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-27T20:25:56.459749] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-27T20:25:56.472168] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-27T20:25:56.472099] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-27T20:25:57.548845] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:57.601169] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-27T20:25:57.574927] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:57.623626] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-27T20:25:57.649179] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:25:57.650467] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-27T20:25:58.391965] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-27T20:25:58.403081] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-27T20:25:59.215738] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T20:25:59.224240] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-27T20:25:59.383748] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T20:25:59.395582] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-27T20:25:59.831980] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-27T20:25:59.842773] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-27T20:26:00.823183] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T20:26:00.833277] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-27T20:26:00.884080] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T20:26:01.019801] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T20:26:01.214934] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-27T20:26:01.479490] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T20:26:02.014985] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-27T20:26:02.598079] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:26:02.814935] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-27T20:26:03.492005] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-27T20:26:03.603232] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T20:26:03.614895] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-27T20:26:04.414923] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-27T20:26:04.710225] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:26:04.863380] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T20:26:05.214969] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-27T20:26:06.014959] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-27T20:26:06.814966] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-27T20:26:06.842896] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T20:26:07.267973] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-10-27T20:26:07.614939] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-27T20:26:07.678616] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:26:08.414942] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-27T20:26:08.899139] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T20:26:08.971865] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T20:26:09.214951] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-27T20:26:10.022405] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-27T20:26:10.043332] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T20:26:10.529806] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-27T20:26:10.814984] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-27T20:26:11.615020] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-27T20:26:12.414944] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-27T20:26:12.503133] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-27T20:26:12.642037] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-27T20:26:13.142965] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T20:26:13.214904] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-27T20:26:14.014968] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-27T20:26:14.530115] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T20:26:14.590339] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:26:14.814913] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-27T20:26:15.614950] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-27T20:26:16.414922] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-27T20:26:16.880885] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-10-27T20:26:16.936788] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-27T20:26:16.972122] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T20:26:17.040624] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:26:17.047384] [INFO ] [REMOTE ] ORA: Full fetch complete (48638 records). [2025-10-27T20:26:17.047478] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-27T20:26:17.048051] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:26:17.048136] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:26:17.048183] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:26:17.048272] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-27T20:26:17.048348] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-27T20:26:17.048396] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-27T20:26:17.048567] [DEBUG] [LOCAL ] ORA: Deleted derivative data file. [2025-10-27T20:26:17.048698] [INFO ] [MAIN ] Update Progress: 1601/2366 symbols completed. ORA took 22.4s. Estimated remaining: 1h 38m 33s. Rate: 7.8 symbols/min [2025-10-27T20:26:17.214962] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-27T20:26:17.214801] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:17.215225] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-27T20:26:17.216172] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-27T20:26:17.216319] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-27T20:26:17.216382] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-27T20:26:17.216465] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-27T20:26:17.216524] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-27T20:26:17.575764] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:18.014970] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-27T20:26:18.814949] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-27T20:26:19.614914] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-27T20:26:19.835533] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-27T20:26:20.086334] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-27T20:26:20.414960] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-27T20:26:20.602694] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T20:26:21.214916] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-27T20:26:21.445096] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T20:26:22.014983] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-27T20:26:22.688859] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-27T20:26:22.814928] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-27T20:26:22.996992] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T20:26:23.006822] [INFO ] [REMOTE ] OR: Full fetch complete (67189 records). [2025-10-27T20:26:23.006959] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-27T20:26:23.400154] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-27T20:26:23.400274] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-27T20:26:23.401354] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-27T20:26:23.401473] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-27T20:26:23.403161] [DEBUG] [LOCAL ] OR: Trimmed 67189 records to 46888 (keeping 200 days of data) [2025-10-27T20:26:23.534166] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T20:26:23.617533] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-27T20:26:23.733076] [DEBUG] [LOCAL ] OR: Primary data saved (46888 records). [2025-10-27T20:26:23.733236] [INFO ] [MAIN ] OR: Full history saved. [2025-10-27T20:26:23.733363] [INFO ] [MAIN ] Update Progress: 1602/2366 symbols completed. OR took 29.0s. Estimated remaining: 1h 38m 24s. Rate: 7.8 symbols/min [2025-10-27T20:26:23.930525] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:23.960848] [DEBUG] [LOCAL ] ORN: Loaded 31185 existing records from primary storage. [2025-10-27T20:26:23.961142] [INFO ] [MAIN ] ORN: Loaded 31185 existing records. [2025-10-27T20:26:24.148295] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:26:24.148501] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-27T20:26:24.148547] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-27T20:26:24.148752] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-27T20:26:24.148808] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-27T20:26:24.420229] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-27T20:26:24.546778] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:25.221468] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-27T20:26:25.241727] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T20:26:25.332413] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-27T20:26:26.014990] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-27T20:26:26.563959] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T20:26:26.685455] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T20:26:26.814928] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-27T20:26:27.614972] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-27T20:26:27.861232] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-27T20:26:27.886247] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T20:26:28.414999] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-27T20:26:29.154519] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T20:26:29.214905] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-27T20:26:30.014940] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-27T20:26:30.158557] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:26:30.814983] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-27T20:26:31.435092] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T20:26:31.509219] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-27T20:26:31.519064] [INFO ] [REMOTE ] ORC: Full fetch complete (75683 records). [2025-10-27T20:26:31.519173] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-27T20:26:31.616383] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-27T20:26:31.898555] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-27T20:26:31.898625] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-27T20:26:31.899626] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-27T20:26:31.899706] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-27T20:26:31.901059] [DEBUG] [LOCAL ] ORC: Trimmed 75683 records to 52471 (keeping 200 days of data) [2025-10-27T20:26:32.189464] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T20:26:32.242340] [DEBUG] [LOCAL ] ORC: Primary data saved (52471 records). [2025-10-27T20:26:32.242449] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-27T20:26:32.242908] [INFO ] [MAIN ] Update Progress: 1603/2366 symbols completed. ORC took 37.6s. Estimated remaining: 1h 38m 17s. Rate: 7.8 symbols/min [2025-10-27T20:26:32.406864] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:32.414926] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-27T20:26:32.459215] [DEBUG] [LOCAL ] OSCR: Loaded 54549 existing records from primary storage. [2025-10-27T20:26:32.459505] [INFO ] [MAIN ] OSCR: Loaded 54549 existing records. [2025-10-27T20:26:32.630127] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:26:32.630294] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-27T20:26:32.630338] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-27T20:26:32.630515] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-27T20:26:32.630551] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-27T20:26:32.947939] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T20:26:33.014034] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:33.214920] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-27T20:26:34.014966] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-27T20:26:34.253536] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T20:26:34.814920] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-27T20:26:35.184265] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T20:26:35.247346] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T20:26:35.615018] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-27T20:26:36.415003] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-27T20:26:37.119018] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-27T20:26:37.214925] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-27T20:26:37.602726] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T20:26:38.014922] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-27T20:26:38.292320] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:26:38.332837] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T20:26:38.343981] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-27T20:26:38.344203] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-27T20:26:38.345580] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:26:38.345888] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:26:38.345961] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:26:38.346043] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-27T20:26:38.346120] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-27T20:26:38.346165] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-27T20:26:38.346205] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-27T20:26:38.346290] [INFO ] [MAIN ] Update Progress: 1604/2366 symbols completed. ORCL took 43.6s. Estimated remaining: 1h 38m 9s. Rate: 7.8 symbols/min [2025-10-27T20:26:38.530615] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:38.530822] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-27T20:26:38.530865] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-27T20:26:38.530972] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-27T20:26:38.531013] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-27T20:26:38.531052] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-27T20:26:38.531083] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-27T20:26:38.820219] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-27T20:26:38.889416] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:39.502379] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:26:39.614968] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-27T20:26:40.414959] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-27T20:26:40.667615] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T20:26:41.108132] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T20:26:41.214989] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-27T20:26:42.014944] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-27T20:26:42.271303] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T20:26:42.814952] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-27T20:26:42.999986] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:26:43.415344] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T20:26:43.614935] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-27T20:26:44.388039] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T20:26:44.414936] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-27T20:26:45.214933] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-27T20:26:45.307090] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T20:26:45.768142] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T20:26:46.014968] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-27T20:26:46.814954] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-27T20:26:47.216414] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T20:26:47.243908] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T20:26:47.249458] [INFO ] [REMOTE ] ORN: Full fetch complete (45493 records). [2025-10-27T20:26:47.249538] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-27T20:26:47.624995] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-27T20:26:47.641788] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-27T20:26:47.641867] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-27T20:26:47.642791] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-27T20:26:47.642854] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-27T20:26:47.643825] [DEBUG] [LOCAL ] ORN: Trimmed 45493 records to 30520 (keeping 200 days of data) [2025-10-27T20:26:47.821987] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T20:26:47.845921] [INFO ] [REMOTE ] ORI: Full fetch complete (70178 records). [2025-10-27T20:26:47.845811] [DEBUG] [LOCAL ] ORN: Primary data saved (30520 records). [2025-10-27T20:26:47.846047] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-27T20:26:47.846156] [INFO ] [MAIN ] Update Progress: 1605/2366 symbols completed. ORN took 24.1s. Estimated remaining: 1h 38m 2s. Rate: 7.8 symbols/min [2025-10-27T20:26:47.857614] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-27T20:26:47.902435] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:26:47.928485] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:26:47.953273] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:26:47.964247] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-27T20:26:47.979746] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-27T20:26:48.006183] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-27T20:26:48.021968] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-27T20:26:48.025762] [INFO ] [MAIN ] Update Progress: 1606/2366 symbols completed. ORI took 31.0s. Estimated remaining: 1h 37m 50s. Rate: 7.8 symbols/min [2025-10-27T20:26:48.025611] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:48.026011] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-27T20:26:48.057457] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-27T20:26:48.068961] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-27T20:26:48.069033] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-27T20:26:48.089493] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-27T20:26:48.095087] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-27T20:26:48.343074] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:48.420334] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-27T20:26:48.556853] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:48.594504] [DEBUG] [LOCAL ] OTIS: Loaded 53455 existing records from primary storage. [2025-10-27T20:26:48.594873] [INFO ] [MAIN ] OTIS: Loaded 53455 existing records. [2025-10-27T20:26:48.766831] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:26:48.767095] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-27T20:26:48.767145] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-27T20:26:48.767356] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-10-27T20:26:48.767413] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-27T20:26:49.109218] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:49.214909] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-27T20:26:49.596935] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T20:26:50.014980] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-27T20:26:50.153326] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T20:26:50.814978] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-27T20:26:51.024828] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T20:26:51.614946] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-10-27T20:26:52.053259] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:26:52.053563] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-10-27T20:26:52.053680] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:26:52.053761] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-27T20:26:52.053836] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:26:52.053919] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-27T20:26:52.053997] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-27T20:26:52.054046] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-27T20:26:52.054102] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-27T20:26:52.054172] [INFO ] [MAIN ] Update Progress: 1607/2366 symbols completed. OTF took 4.2s. Estimated remaining: 1h 37m 41s. Rate: 7.8 symbols/min [2025-10-27T20:26:52.231673] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:26:52.258917] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T20:26:52.306766] [DEBUG] [LOCAL ] OUT: Loaded 48397 existing records from primary storage. [2025-10-27T20:26:52.307051] [INFO ] [MAIN ] OUT: Loaded 48397 existing records. [2025-10-27T20:26:52.420051] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-27T20:26:52.491586] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:26:52.491883] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-27T20:26:52.491934] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-27T20:26:52.492121] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-27T20:26:52.492159] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-27T20:26:52.861766] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:26:52.897054] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-27T20:26:53.214964] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-27T20:26:54.014917] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-27T20:26:54.098972] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T20:26:54.814948] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-27T20:26:54.920451] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T20:26:55.614934] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-27T20:26:56.394031] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-27T20:26:56.414901] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-27T20:26:56.613246] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T20:26:57.214922] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-27T20:26:57.574750] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T20:26:58.014990] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-27T20:26:58.814916] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-27T20:26:58.900767] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T20:26:58.973825] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-27T20:26:59.614991] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-27T20:27:00.231303] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T20:27:00.414912] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-27T20:27:00.485629] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T20:27:00.959332] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T20:27:01.214981] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-27T20:27:02.014939] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-27T20:27:02.235233] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T20:27:02.814985] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-27T20:27:03.614974] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-27T20:27:03.686276] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-27T20:27:03.696731] [INFO ] [REMOTE ] OSCR: Full fetch complete (77768 records). [2025-10-27T20:27:03.696881] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-27T20:27:04.059536] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T20:27:04.165981] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-27T20:27:04.166173] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-27T20:27:04.167399] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-27T20:27:04.167481] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-27T20:27:04.169235] [DEBUG] [LOCAL ] OSCR: Trimmed 77768 records to 53769 (keeping 200 days of data) [2025-10-27T20:27:04.403581] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:27:04.415289] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-27T20:27:04.534206] [DEBUG] [LOCAL ] OSCR: Primary data saved (53769 records). [2025-10-27T20:27:04.534363] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-27T20:27:04.534877] [INFO ] [MAIN ] Update Progress: 1608/2366 symbols completed. OSCR took 32.3s. Estimated remaining: 1h 37m 35s. Rate: 7.8 symbols/min [2025-10-27T20:27:04.698913] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:04.748094] [DEBUG] [LOCAL ] OVV: Loaded 54274 existing records from primary storage. [2025-10-27T20:27:04.748440] [INFO ] [MAIN ] OVV: Loaded 54274 existing records. [2025-10-27T20:27:04.920918] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:04.921115] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-27T20:27:04.921161] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-27T20:27:04.921391] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-27T20:27:04.921448] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-27T20:27:05.217145] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-27T20:27:05.282871] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:05.321985] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T20:27:06.014963] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-27T20:27:06.302134] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T20:27:06.814953] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-27T20:27:07.234875] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-27T20:27:07.615005] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-27T20:27:08.019174] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-27T20:27:08.415021] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-27T20:27:08.535684] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T20:27:09.146855] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T20:27:09.214944] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-27T20:27:09.887112] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T20:27:10.014927] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-27T20:27:10.223192] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T20:27:10.231754] [INFO ] [REMOTE ] OSK: Full fetch complete (61039 records). [2025-10-27T20:27:10.231889] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-27T20:27:10.232685] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:27:10.232774] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:27:10.232847] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:27:10.232943] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-27T20:27:10.233045] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-27T20:27:10.233122] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-27T20:27:10.233218] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-27T20:27:10.233312] [INFO ] [MAIN ] Update Progress: 1609/2366 symbols completed. OSK took 31.9s. Estimated remaining: 1h 37m 27s. Rate: 7.8 symbols/min [2025-10-27T20:27:10.420925] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:10.476139] [DEBUG] [LOCAL ] OWL: Loaded 54340 existing records from primary storage. [2025-10-27T20:27:10.476493] [INFO ] [MAIN ] OWL: Loaded 54340 existing records. [2025-10-27T20:27:10.673728] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:10.673933] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-27T20:27:10.673979] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-27T20:27:10.674193] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-27T20:27:10.674241] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-27T20:27:10.826229] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-27T20:27:11.037041] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:11.614916] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-27T20:27:11.994570] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-27T20:27:12.429296] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-27T20:27:12.437673] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T20:27:13.214941] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-27T20:27:13.265118] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T20:27:14.014943] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-27T20:27:14.087511] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T20:27:14.814992] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-27T20:27:15.175031] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-27T20:27:15.614978] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-27T20:27:15.976967] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T20:27:16.119615] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T20:27:16.271910] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T20:27:16.282762] [INFO ] [REMOTE ] OTIS: Full fetch complete (75998 records). [2025-10-27T20:27:16.282929] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-27T20:27:16.283955] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:27:16.284041] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:27:16.284084] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:27:16.284153] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-27T20:27:16.284235] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-27T20:27:16.284305] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-27T20:27:16.284603] [DEBUG] [LOCAL ] OTIS: Deleted derivative data file. [2025-10-27T20:27:16.284729] [INFO ] [MAIN ] Update Progress: 1610/2366 symbols completed. OTIS took 28.3s. Estimated remaining: 1h 37m 18s. Rate: 7.8 symbols/min [2025-10-27T20:27:16.427438] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-27T20:27:16.460816] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:16.472598] [DEBUG] [LOCAL ] OWLT: Loaded 10173 existing records from primary storage. [2025-10-27T20:27:16.472901] [INFO ] [MAIN ] OWLT: Loaded 10173 existing records. [2025-10-27T20:27:16.679996] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:16.680236] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-27T20:27:16.680289] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-27T20:27:16.680457] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-27T20:27:16.680513] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-27T20:27:17.043547] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:17.214936] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-27T20:27:18.014935] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-27T20:27:18.207237] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T20:27:18.495231] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T20:27:18.814952] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-27T20:27:19.221639] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T20:27:19.389556] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T20:27:19.614946] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-27T20:27:20.415003] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-27T20:27:21.035166] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:27:21.214927] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-27T20:27:21.678755] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T20:27:22.014970] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-27T20:27:22.814911] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-27T20:27:22.873758] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:27:23.007615] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T20:27:23.016384] [INFO ] [REMOTE ] OUT: Full fetch complete (68837 records). [2025-10-27T20:27:23.016527] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-27T20:27:23.017528] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:27:23.017637] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:27:23.017752] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:27:23.017843] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-27T20:27:23.017915] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-27T20:27:23.017952] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-27T20:27:23.018077] [DEBUG] [LOCAL ] OUT: Deleted derivative data file. [2025-10-27T20:27:23.018151] [INFO ] [MAIN ] Update Progress: 1611/2366 symbols completed. OUT took 31.0s. Estimated remaining: 1h 37m 10s. Rate: 7.8 symbols/min [2025-10-27T20:27:23.193054] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:23.224598] [DEBUG] [LOCAL ] OXM: Loaded 33567 existing records from primary storage. [2025-10-27T20:27:23.224893] [INFO ] [MAIN ] OXM: Loaded 33567 existing records. [2025-10-27T20:27:23.401725] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:23.401909] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-27T20:27:23.401956] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-27T20:27:23.402130] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-27T20:27:23.402170] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-27T20:27:23.621445] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-27T20:27:23.662864] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T20:27:23.763825] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:24.414949] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-27T20:27:25.164497] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T20:27:25.214930] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-27T20:27:25.303528] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T20:27:26.014916] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-27T20:27:26.234007] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T20:27:26.814951] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-27T20:27:27.614943] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-27T20:27:27.816905] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T20:27:27.912604] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T20:27:28.414943] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-27T20:27:29.057840] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:27:29.214968] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-27T20:27:30.014970] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-27T20:27:30.310375] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T20:27:30.373737] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T20:27:30.814997] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-27T20:27:31.614942] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-27T20:27:31.706707] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:27:31.829965] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T20:27:32.414977] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-27T20:27:33.214932] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-27T20:27:33.554544] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T20:27:34.014914] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-27T20:27:34.252768] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T20:27:34.814997] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-27T20:27:34.995205] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T20:27:35.614979] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-27T20:27:36.015035] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T20:27:36.322470] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T20:27:36.414940] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-27T20:27:36.660994] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T20:27:36.670916] [INFO ] [REMOTE ] OVV: Full fetch complete (77133 records). [2025-10-27T20:27:36.671069] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-27T20:27:36.671891] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:27:36.672006] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:27:36.672047] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:27:36.672084] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-27T20:27:36.672137] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-27T20:27:36.672173] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-27T20:27:36.672296] [DEBUG] [LOCAL ] OVV: Deleted derivative data file. [2025-10-27T20:27:36.672755] [INFO ] [MAIN ] Update Progress: 1612/2366 symbols completed. OVV took 32.1s. Estimated remaining: 1h 37m 5s. Rate: 7.8 symbols/min [2025-10-27T20:27:36.845290] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:36.845448] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-27T20:27:36.845484] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-27T20:27:36.845593] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-27T20:27:36.845634] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-27T20:27:36.845718] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-27T20:27:36.845757] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-27T20:27:37.192552] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:37.214921] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-27T20:27:37.751558] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T20:27:38.014929] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-27T20:27:38.814987] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-27T20:27:39.288032] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-27T20:27:39.575626] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T20:27:39.614923] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-27T20:27:40.414921] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-27T20:27:40.449086] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T20:27:41.219023] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-27T20:27:41.224867] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T20:27:42.014936] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-27T20:27:42.404311] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T20:27:42.636483] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T20:27:42.814938] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-27T20:27:43.413228] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T20:27:43.614930] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-27T20:27:43.822412] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T20:27:44.414935] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-27T20:27:45.214959] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-27T20:27:45.782396] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-27T20:27:45.852511] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T20:27:45.856041] [INFO ] [REMOTE ] OWLT: Full fetch complete (12868 records). [2025-10-27T20:27:45.856114] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-27T20:27:46.014949] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-27T20:27:46.247236] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-27T20:27:46.247340] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-27T20:27:46.247857] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-27T20:27:46.247969] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-27T20:27:46.248793] [DEBUG] [LOCAL ] OWLT: Trimmed 12868 records to 10143 (keeping 200 days of data) [2025-10-27T20:27:46.323257] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-27T20:27:46.345886] [DEBUG] [LOCAL ] OWLT: Primary data saved (10143 records). [2025-10-27T20:27:46.346193] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-27T20:27:46.346290] [INFO ] [MAIN ] Update Progress: 1613/2366 symbols completed. OWLT took 30.1s. Estimated remaining: 1h 36m 58s. Rate: 7.8 symbols/min [2025-10-27T20:27:46.515599] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:46.568300] [DEBUG] [LOCAL ] PAAS: Loaded 54405 existing records from primary storage. [2025-10-27T20:27:46.568617] [INFO ] [MAIN ] PAAS: Loaded 54405 existing records. [2025-10-27T20:27:46.742706] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:46.742902] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-27T20:27:46.742946] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-27T20:27:46.743254] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-27T20:27:46.743311] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-27T20:27:46.820106] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-27T20:27:47.098367] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:47.343882] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T20:27:47.614977] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-27T20:27:48.414936] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-27T20:27:48.711982] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T20:27:48.722239] [INFO ] [REMOTE ] OWL: Full fetch complete (77712 records). [2025-10-27T20:27:48.722361] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-27T20:27:49.114370] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-27T20:27:49.114465] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-27T20:27:49.115558] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-27T20:27:49.115619] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-27T20:27:49.117069] [DEBUG] [LOCAL ] OWL: Trimmed 77712 records to 53560 (keeping 200 days of data) [2025-10-27T20:27:49.223047] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-27T20:27:49.446609] [DEBUG] [LOCAL ] OWL: Primary data saved (53560 records). [2025-10-27T20:27:49.446788] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-27T20:27:49.447382] [INFO ] [MAIN ] Update Progress: 1614/2366 symbols completed. OWL took 39.2s. Estimated remaining: 1h 36m 48s. Rate: 7.8 symbols/min [2025-10-27T20:27:49.644346] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:49.674138] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-27T20:27:49.694580] [DEBUG] [LOCAL ] PAC: Loaded 11672 existing records from primary storage. [2025-10-27T20:27:49.694864] [INFO ] [MAIN ] PAC: Loaded 11672 existing records. [2025-10-27T20:27:49.906762] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:49.907219] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-27T20:27:49.914165] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-27T20:27:49.927104] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T20:27:49.927173] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-27T20:27:49.927400] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-27T20:27:50.020078] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-27T20:27:50.285111] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:50.814949] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-27T20:27:50.927503] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:27:50.933567] [INFO ] [REMOTE ] OXM: Full fetch complete (46297 records). [2025-10-27T20:27:50.933689] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-27T20:27:50.934277] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:27:50.934360] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:27:50.934403] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:27:50.934467] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-27T20:27:50.934529] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-27T20:27:50.934563] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-27T20:27:50.934746] [DEBUG] [LOCAL ] OXM: Deleted derivative data file. [2025-10-27T20:27:50.934832] [INFO ] [MAIN ] Update Progress: 1615/2366 symbols completed. OXM took 27.9s. Estimated remaining: 1h 36m 38s. Rate: 7.8 symbols/min [2025-10-27T20:27:51.096746] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:51.125150] [DEBUG] [LOCAL ] PACK: Loaded 32387 existing records from primary storage. [2025-10-27T20:27:51.125430] [INFO ] [MAIN ] PACK: Loaded 32387 existing records. [2025-10-27T20:27:51.299099] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:51.299300] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-27T20:27:51.299346] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-27T20:27:51.299674] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-27T20:27:51.299730] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-27T20:27:51.639579] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-27T20:27:51.644472] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:51.859967] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T20:27:51.926112] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-27T20:27:52.414956] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-27T20:27:53.073034] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T20:27:53.214931] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-27T20:27:53.328373] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T20:27:54.014956] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-27T20:27:54.814915] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-27T20:27:55.370724] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-27T20:27:55.614935] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-27T20:27:55.669066] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T20:27:56.299114] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T20:27:56.414911] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-27T20:27:56.506282] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-27T20:27:56.521107] [DEBUG] [REMOTE ] PAC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-27T20:27:56.521395] [WARN ] [REMOTE ] PAC: No data returned for month 2025-03 [2025-10-27T20:27:56.521483] [FATAL] [REMOTE ] PAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:27:56.521543] [FATAL] [MAIN ] PAC: Failed to fetch primary data. [2025-10-27T20:27:56.521605] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:27:56.521699] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-27T20:27:56.521763] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-27T20:27:56.521797] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-27T20:27:56.521948] [DEBUG] [LOCAL ] PAC: Deleted derivative data file. [2025-10-27T20:27:56.522052] [INFO ] [MAIN ] Update Progress: 1616/2366 symbols completed. PAC took 7.1s. Estimated remaining: 1h 36m 29s. Rate: 7.8 symbols/min [2025-10-27T20:27:56.698417] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:27:56.729809] [DEBUG] [LOCAL ] PACS: Loaded 35157 existing records from primary storage. [2025-10-27T20:27:56.730062] [INFO ] [MAIN ] PACS: Loaded 35157 existing records. [2025-10-27T20:27:56.908517] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:27:56.908758] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-27T20:27:56.908837] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-27T20:27:56.909066] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-27T20:27:56.909108] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-27T20:27:57.223465] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-27T20:27:57.267236] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:27:58.014932] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-27T20:27:58.814946] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-27T20:27:59.403634] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T20:27:59.517494] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-27T20:27:59.614913] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-27T20:28:00.414953] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-27T20:28:00.821275] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T20:28:00.923118] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T20:28:01.214955] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-27T20:28:02.015006] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-27T20:28:02.820148] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-27T20:28:02.834031] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T20:28:02.895571] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-27T20:28:03.289757] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T20:28:03.614924] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-27T20:28:04.414981] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-27T20:28:04.969744] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T20:28:05.214934] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-27T20:28:05.527160] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T20:28:06.012281] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-27T20:28:06.016284] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-27T20:28:06.728738] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T20:28:06.814908] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-27T20:28:07.431417] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T20:28:07.614962] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-27T20:28:07.931907] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T20:28:08.414937] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-27T20:28:08.689853] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T20:28:09.214945] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-27T20:28:09.965588] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T20:28:10.014955] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-27T20:28:10.684379] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T20:28:10.814935] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-27T20:28:11.615002] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-27T20:28:11.797013] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T20:28:12.184299] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T20:28:12.414925] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-27T20:28:13.038578] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T20:28:13.214967] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-27T20:28:14.015007] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-27T20:28:14.273054] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:28:14.317714] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T20:28:14.814957] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-27T20:28:15.054940] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:28:15.062371] [INFO ] [REMOTE ] PACK: Full fetch complete (45657 records). [2025-10-27T20:28:15.062504] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-27T20:28:15.452064] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-27T20:28:15.452172] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-27T20:28:15.453552] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-27T20:28:15.453619] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-27T20:28:15.454989] [DEBUG] [LOCAL ] PACK: Trimmed 45657 records to 31687 (keeping 200 days of data) [2025-10-27T20:28:15.625391] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-27T20:28:15.652463] [DEBUG] [LOCAL ] PACK: Primary data saved (31687 records). [2025-10-27T20:28:15.652720] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-27T20:28:15.652849] [INFO ] [MAIN ] Update Progress: 1617/2366 symbols completed. PACK took 24.7s. Estimated remaining: 1h 36m 27s. Rate: 7.8 symbols/min [2025-10-27T20:28:15.831758] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:15.854299] [DEBUG] [LOCAL ] PAG: Loaded 21581 existing records from primary storage. [2025-10-27T20:28:15.854601] [INFO ] [MAIN ] PAG: Loaded 21581 existing records. [2025-10-27T20:28:16.039866] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:16.040118] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-27T20:28:16.040221] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-27T20:28:16.040433] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-27T20:28:16.040489] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-27T20:28:16.397572] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:16.415004] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-27T20:28:17.179959] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-27T20:28:17.215019] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-27T20:28:17.717459] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T20:28:18.014930] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-27T20:28:18.115095] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-27T20:28:18.814943] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-27T20:28:19.463394] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T20:28:19.614966] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-27T20:28:19.665013] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T20:28:19.771420] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-27T20:28:19.781579] [INFO ] [REMOTE ] PAAS: Full fetch complete (77666 records). [2025-10-27T20:28:19.781745] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-27T20:28:20.166173] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-27T20:28:20.166273] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-27T20:28:20.167522] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-27T20:28:20.167594] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-27T20:28:20.169126] [DEBUG] [LOCAL ] PAAS: Trimmed 77666 records to 53625 (keeping 200 days of data) [2025-10-27T20:28:20.282826] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:28:20.299993] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-27T20:28:20.311637] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-27T20:28:20.316490] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:28:20.320231] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:28:20.320514] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:28:20.320876] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-27T20:28:20.320958] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-27T20:28:20.321234] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-27T20:28:20.321811] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-27T20:28:20.322111] [INFO ] [MAIN ] Update Progress: 1618/2366 symbols completed. OXY took 43.6s. Estimated remaining: 1h 36m 18s. Rate: 7.8 symbols/min [2025-10-27T20:28:20.416879] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-27T20:28:20.599927] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:20.744945] [DEBUG] [LOCAL ] PAAS: Primary data saved (53625 records). [2025-10-27T20:28:20.745104] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-27T20:28:20.745259] [INFO ] [MAIN ] Update Progress: 1619/2366 symbols completed. PAAS took 34.4s. Estimated remaining: 1h 36m 6s. Rate: 7.8 symbols/min [2025-10-27T20:28:20.746127] [DEBUG] [LOCAL ] PAGS: Loaded 53570 existing records from primary storage. [2025-10-27T20:28:20.810026] [INFO ] [MAIN ] PAGS: Loaded 53570 existing records. [2025-10-27T20:28:21.079355] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:21.100019] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:21.100440] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-27T20:28:21.100489] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-27T20:28:21.100756] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-27T20:28:21.100812] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-27T20:28:21.204574] [DEBUG] [LOCAL ] PAI: Loaded 2990 existing records from primary storage. [2025-10-27T20:28:21.204812] [INFO ] [MAIN ] PAI: Loaded 2990 existing records. [2025-10-27T20:28:21.215815] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-27T20:28:21.576734] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:21.592276] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-27T20:28:21.614697] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-27T20:28:21.638314] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-27T20:28:21.640941] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-27T20:28:21.643847] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:22.016173] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:22.016237] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-27T20:28:22.040946] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T20:28:22.154730] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:28:22.814992] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-27T20:28:23.619056] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-27T20:28:23.619951] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T20:28:23.910052] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T20:28:24.414955] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-27T20:28:25.072604] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T20:28:25.079387] [INFO ] [REMOTE ] PACS: Full fetch complete (50234 records). [2025-10-27T20:28:25.079510] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-27T20:28:25.217369] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-27T20:28:25.480131] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T20:28:25.479183] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-27T20:28:25.480253] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-27T20:28:25.486807] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-27T20:28:25.486890] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-27T20:28:25.487988] [DEBUG] [LOCAL ] PACS: Trimmed 50234 records to 34458 (keeping 200 days of data) [2025-10-27T20:28:25.682727] [DEBUG] [LOCAL ] PACS: Primary data saved (34458 records). [2025-10-27T20:28:25.682849] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-27T20:28:25.683534] [INFO ] [MAIN ] Update Progress: 1620/2366 symbols completed. PACS took 29.2s. Estimated remaining: 1h 35m 57s. Rate: 7.8 symbols/min [2025-10-27T20:28:25.783863] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T20:28:25.851603] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:25.851774] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-27T20:28:25.851815] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-27T20:28:25.851947] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-27T20:28:25.852006] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-27T20:28:25.852050] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-27T20:28:25.852081] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-27T20:28:26.019933] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-27T20:28:26.204664] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:26.815008] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-10-27T20:28:27.165228] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:28:27.165537] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-10-27T20:28:27.165624] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:28:27.165711] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-27T20:28:27.165753] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:28:27.165790] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-27T20:28:27.165847] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-27T20:28:27.165924] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-27T20:28:27.165996] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-27T20:28:27.166073] [INFO ] [MAIN ] Update Progress: 1621/2366 symbols completed. PAII took 1.5s. Estimated remaining: 1h 35m 47s. Rate: 7.8 symbols/min [2025-10-27T20:28:27.336289] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:27.366721] [DEBUG] [LOCAL ] PAM: Loaded 29588 existing records from primary storage. [2025-10-27T20:28:27.366983] [INFO ] [MAIN ] PAM: Loaded 29588 existing records. [2025-10-27T20:28:27.555085] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:27.555338] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-27T20:28:27.555542] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-27T20:28:27.555818] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-27T20:28:27.555887] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-27T20:28:27.620114] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-27T20:28:27.921088] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T20:28:27.972524] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:28.322100] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T20:28:28.414955] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-27T20:28:29.214961] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-27T20:28:29.805957] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T20:28:30.002074] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T20:28:30.014901] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-27T20:28:30.814922] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-27T20:28:31.197961] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T20:28:31.615022] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-27T20:28:32.290881] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:28:32.414956] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-27T20:28:33.038268] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T20:28:33.041518] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T20:28:33.214932] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-27T20:28:34.014938] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-27T20:28:34.814932] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-27T20:28:35.148912] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T20:28:35.411689] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T20:28:35.614961] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-27T20:28:36.163960] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T20:28:36.414940] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-27T20:28:37.214997] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-27T20:28:37.492842] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T20:28:37.673103] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T20:28:37.774291] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T20:28:38.014972] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-27T20:28:38.814974] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-27T20:28:39.333453] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T20:28:39.411562] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T20:28:39.614916] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-27T20:28:40.414949] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-27T20:28:40.468344] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T20:28:41.215032] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-27T20:28:42.014981] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-27T20:28:42.068182] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T20:28:42.455262] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T20:28:42.513274] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T20:28:42.814926] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-27T20:28:43.615009] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-27T20:28:43.987738] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T20:28:44.414995] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-27T20:28:45.214940] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-27T20:28:45.326693] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T20:28:45.446384] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T20:28:46.014962] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-27T20:28:46.405483] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T20:28:46.689505] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T20:28:46.815002] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-27T20:28:47.614981] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-27T20:28:47.812184] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T20:28:48.414940] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-27T20:28:48.835364] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T20:28:49.214992] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-27T20:28:49.711294] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T20:28:49.715675] [INFO ] [REMOTE ] PAG: Full fetch complete (30828 records). [2025-10-27T20:28:49.715793] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-27T20:28:49.716318] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:28:49.716396] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:28:49.716462] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:28:49.716532] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-27T20:28:49.716593] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-27T20:28:49.716627] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-27T20:28:49.716824] [DEBUG] [LOCAL ] PAG: Deleted derivative data file. [2025-10-27T20:28:49.716911] [INFO ] [MAIN ] Update Progress: 1622/2366 symbols completed. PAG took 34.1s. Estimated remaining: 1h 35m 46s. Rate: 7.8 symbols/min [2025-10-27T20:28:49.887415] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:49.921613] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T20:28:49.957475] [DEBUG] [LOCAL ] PAR: Loaded 34854 existing records from primary storage. [2025-10-27T20:28:49.957822] [INFO ] [MAIN ] PAR: Loaded 34854 existing records. [2025-10-27T20:28:50.020116] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-27T20:28:50.145715] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:50.145892] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-27T20:28:50.145938] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-27T20:28:50.146127] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-27T20:28:50.146180] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-27T20:28:50.492587] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:50.814911] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-27T20:28:51.449219] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T20:28:51.457073] [INFO ] [REMOTE ] PAM: Full fetch complete (42565 records). [2025-10-27T20:28:51.457270] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-27T20:28:51.557067] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T20:28:51.576376] [INFO ] [REMOTE ] PAI: Full fetch complete (4285 records). [2025-10-27T20:28:51.582471] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-27T20:28:51.624510] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-27T20:28:52.222628] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-27T20:28:52.227928] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-27T20:28:52.239282] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-27T20:28:52.259802] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-27T20:28:52.306130] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-27T20:28:52.306437] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-27T20:28:52.306616] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-27T20:28:52.306347] [DEBUG] [LOCAL ] PAM: Trimmed 42565 records to 29099 (keeping 200 days of data) [2025-10-27T20:28:52.307251] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-27T20:28:52.308189] [DEBUG] [LOCAL ] PAI: Trimmed 4285 records to 2933 (keeping 200 days of data) [2025-10-27T20:28:52.418106] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-27T20:28:52.417975] [DEBUG] [LOCAL ] PAI: Primary data saved (2933 records). [2025-10-27T20:28:52.431203] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-27T20:28:52.442764] [INFO ] [MAIN ] Update Progress: 1623/2366 symbols completed. PAI took 31.7s. Estimated remaining: 1h 35m 36s. Rate: 7.8 symbols/min [2025-10-27T20:28:52.673868] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:52.690591] [DEBUG] [LOCAL ] PAM: Primary data saved (29099 records). [2025-10-27T20:28:52.691003] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-27T20:28:52.691118] [INFO ] [MAIN ] Update Progress: 1624/2366 symbols completed. PAM took 25.5s. Estimated remaining: 1h 35m 25s. Rate: 7.8 symbols/min [2025-10-27T20:28:52.886261] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:28:52.904945] [DEBUG] [LOCAL ] PARR: Loaded 48648 existing records from primary storage. [2025-10-27T20:28:52.905337] [INFO ] [MAIN ] PARR: Loaded 48648 existing records. [2025-10-27T20:28:53.085087] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:53.085497] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-27T20:28:53.085584] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-27T20:28:53.085946] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-27T20:28:53.086009] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-27T20:28:53.357534] [DEBUG] [LOCAL ] PATH: Loaded 54460 existing records from primary storage. [2025-10-27T20:28:53.383337] [INFO ] [MAIN ] PATH: Loaded 54460 existing records. [2025-10-27T20:28:53.574322] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T20:28:53.605511] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:53.612880] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-27T20:28:53.693373] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:28:53.693557] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-27T20:28:53.693605] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-27T20:28:53.694081] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-27T20:28:53.694138] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-27T20:28:54.020694] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-27T20:28:54.047889] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:28:54.079428] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T20:28:54.814906] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-27T20:28:54.851331] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T20:28:55.565034] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T20:28:55.614911] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-27T20:28:56.414949] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-27T20:28:56.835894] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T20:28:57.130225] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-27T20:28:57.214946] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-27T20:28:57.809964] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T20:28:58.014946] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-27T20:28:58.814985] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-27T20:28:59.287183] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-27T20:28:59.407707] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:28:59.614943] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-27T20:29:00.414995] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-27T20:29:00.625251] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T20:29:00.742337] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T20:29:01.214953] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-27T20:29:02.014938] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-27T20:29:02.730071] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-27T20:29:02.814919] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-27T20:29:03.169627] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T20:29:03.281039] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T20:29:03.614990] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-27T20:29:04.414956] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-27T20:29:04.896968] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T20:29:05.214969] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-27T20:29:05.579562] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T20:29:05.673004] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T20:29:06.014976] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-27T20:29:06.814923] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-27T20:29:07.000308] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-27T20:29:07.620033] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-27T20:29:07.630993] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T20:29:08.364195] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T20:29:08.374548] [INFO ] [REMOTE ] PAGS: Full fetch complete (76487 records). [2025-10-27T20:29:08.374699] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-27T20:29:08.420024] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-27T20:29:08.787376] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-27T20:29:08.787450] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-27T20:29:08.788531] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-27T20:29:08.788593] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-27T20:29:08.789986] [DEBUG] [LOCAL ] PAGS: Trimmed 76487 records to 52778 (keeping 200 days of data) [2025-10-27T20:29:09.094454] [DEBUG] [LOCAL ] PAGS: Primary data saved (52778 records). [2025-10-27T20:29:09.094582] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-27T20:29:09.095002] [INFO ] [MAIN ] Update Progress: 1625/2366 symbols completed. PAGS took 48.8s. Estimated remaining: 1h 35m 21s. Rate: 7.8 symbols/min [2025-10-27T20:29:09.220111] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-27T20:29:09.265277] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:09.288876] [DEBUG] [LOCAL ] PAXS: Loaded 21115 existing records from primary storage. [2025-10-27T20:29:09.289126] [INFO ] [MAIN ] PAXS: Loaded 21115 existing records. [2025-10-27T20:29:09.466232] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:09.466455] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-27T20:29:09.466502] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-27T20:29:09.466759] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-27T20:29:09.466817] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-27T20:29:09.815759] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:09.902895] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-27T20:29:10.014915] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-27T20:29:10.489787] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T20:29:10.814904] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-27T20:29:11.000191] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T20:29:11.615061] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-27T20:29:12.204403] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T20:29:12.369420] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-27T20:29:12.414918] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-27T20:29:12.697320] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T20:29:13.214991] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-27T20:29:14.014930] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-27T20:29:14.149831] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T20:29:14.816508] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-27T20:29:14.823090] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T20:29:14.836554] [INFO ] [REMOTE ] PAR: Full fetch complete (49323 records). [2025-10-27T20:29:14.836889] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-27T20:29:14.987573] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T20:29:15.248038] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-27T20:29:15.248123] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-27T20:29:15.249138] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-27T20:29:15.249202] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-27T20:29:15.250306] [DEBUG] [LOCAL ] PAR: Trimmed 49323 records to 34182 (keeping 200 days of data) [2025-10-27T20:29:15.449849] [DEBUG] [LOCAL ] PAR: Primary data saved (34182 records). [2025-10-27T20:29:15.449997] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-27T20:29:15.450082] [INFO ] [MAIN ] Update Progress: 1626/2366 symbols completed. PAR took 25.7s. Estimated remaining: 1h 35m 13s. Rate: 7.8 symbols/min [2025-10-27T20:29:15.634848] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-27T20:29:15.637408] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:15.673319] [DEBUG] [LOCAL ] PAY: Loaded 39036 existing records from primary storage. [2025-10-27T20:29:15.673665] [INFO ] [MAIN ] PAY: Loaded 39036 existing records. [2025-10-27T20:29:15.844450] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:15.844667] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-27T20:29:15.844727] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-27T20:29:15.844932] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-27T20:29:15.844988] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-27T20:29:16.187767] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:16.414920] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-27T20:29:17.050899] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-27T20:29:17.214914] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-27T20:29:17.316212] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T20:29:17.825230] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T20:29:18.014937] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-27T20:29:18.814953] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-27T20:29:19.312893] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T20:29:19.368732] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T20:29:19.614960] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-27T20:29:19.803097] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T20:29:20.158060] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T20:29:20.166292] [INFO ] [REMOTE ] PARR: Full fetch complete (68792 records). [2025-10-27T20:29:20.166414] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-27T20:29:20.167148] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:29:20.167256] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:29:20.167327] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:29:20.167424] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-27T20:29:20.167504] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-27T20:29:20.167541] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-27T20:29:20.167695] [DEBUG] [LOCAL ] PARR: Deleted derivative data file. [2025-10-27T20:29:20.167800] [INFO ] [MAIN ] Update Progress: 1627/2366 symbols completed. PARR took 27.7s. Estimated remaining: 1h 35m 4s. Rate: 7.8 symbols/min [2025-10-27T20:29:20.331394] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:20.365313] [DEBUG] [LOCAL ] PAYC: Loaded 36478 existing records from primary storage. [2025-10-27T20:29:20.365599] [INFO ] [MAIN ] PAYC: Loaded 36478 existing records. [2025-10-27T20:29:20.425115] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-27T20:29:20.542608] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:20.542845] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-27T20:29:20.542913] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-27T20:29:20.543105] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-10-27T20:29:20.543159] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-27T20:29:20.890333] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:21.214974] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-27T20:29:21.789359] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T20:29:22.014960] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-27T20:29:22.774485] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T20:29:22.814943] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-27T20:29:23.614986] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-27T20:29:24.023984] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T20:29:24.414963] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-27T20:29:24.460538] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-27T20:29:24.470794] [INFO ] [REMOTE ] PATH: Full fetch complete (77852 records). [2025-10-27T20:29:24.470926] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-27T20:29:24.868942] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-27T20:29:24.869045] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-27T20:29:24.870224] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-27T20:29:24.870407] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-27T20:29:24.871911] [DEBUG] [LOCAL ] PATH: Trimmed 77852 records to 53680 (keeping 200 days of data) [2025-10-27T20:29:25.120085] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T20:29:25.217717] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-27T20:29:25.228229] [DEBUG] [LOCAL ] PATH: Primary data saved (53680 records). [2025-10-27T20:29:25.228382] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-27T20:29:25.229025] [INFO ] [MAIN ] Update Progress: 1628/2366 symbols completed. PATH took 32.5s. Estimated remaining: 1h 34m 55s. Rate: 7.8 symbols/min [2025-10-27T20:29:25.397540] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:25.435957] [DEBUG] [LOCAL ] PB: Loaded 42965 existing records from primary storage. [2025-10-27T20:29:25.436240] [INFO ] [MAIN ] PB: Loaded 42965 existing records. [2025-10-27T20:29:25.611150] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:25.611377] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-27T20:29:25.611426] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-27T20:29:25.611705] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-27T20:29:25.611764] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-27T20:29:25.984931] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:26.014925] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-27T20:29:26.074977] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T20:29:26.253225] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T20:29:26.815015] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-27T20:29:27.497919] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:29:27.563627] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T20:29:27.614993] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-27T20:29:28.414975] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-27T20:29:29.017720] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T20:29:29.214946] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-27T20:29:29.239355] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T20:29:30.014947] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-27T20:29:30.754201] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T20:29:30.814959] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-27T20:29:31.614986] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-27T20:29:31.723288] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-27T20:29:31.911703] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T20:29:32.414941] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-27T20:29:32.914627] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:29:33.214949] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-27T20:29:33.350714] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T20:29:34.014916] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-27T20:29:34.799705] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:29:34.814905] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-27T20:29:35.179381] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T20:29:35.614959] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-27T20:29:36.359495] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T20:29:36.414898] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-27T20:29:36.727224] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T20:29:37.214926] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-27T20:29:37.696719] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T20:29:38.014935] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-27T20:29:38.815019] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-27T20:29:38.891466] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T20:29:39.551899] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T20:29:39.614968] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-27T20:29:40.222958] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T20:29:40.415000] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-27T20:29:40.699768] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T20:29:41.214993] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-27T20:29:42.014919] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-27T20:29:42.037466] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T20:29:42.296921] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:29:42.304531] [INFO ] [REMOTE ] PAY: Full fetch complete (53875 records). [2025-10-27T20:29:42.304694] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-27T20:29:42.693938] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-27T20:29:42.694010] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-27T20:29:42.694917] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-27T20:29:42.694978] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-27T20:29:42.696021] [DEBUG] [LOCAL ] PAY: Trimmed 53875 records to 38313 (keeping 200 days of data) [2025-10-27T20:29:42.852836] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-27T20:29:42.918751] [DEBUG] [LOCAL ] PAY: Primary data saved (38313 records). [2025-10-27T20:29:42.918916] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-27T20:29:42.919004] [INFO ] [MAIN ] Update Progress: 1629/2366 symbols completed. PAY took 27.5s. Estimated remaining: 1h 34m 51s. Rate: 7.8 symbols/min [2025-10-27T20:29:43.094447] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:43.134586] [DEBUG] [LOCAL ] PBA: Loaded 49882 existing records from primary storage. [2025-10-27T20:29:43.134917] [INFO ] [MAIN ] PBA: Loaded 49882 existing records. [2025-10-27T20:29:43.301295] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T20:29:43.341277] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:43.341768] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-27T20:29:43.341818] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-27T20:29:43.342107] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-27T20:29:43.342163] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-27T20:29:43.616740] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-27T20:29:43.695633] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:44.414953] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-27T20:29:44.638212] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T20:29:45.203900] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T20:29:45.215261] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-27T20:29:46.014915] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-27T20:29:46.103829] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T20:29:46.281603] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T20:29:46.814939] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-27T20:29:47.605429] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:29:47.614891] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-27T20:29:48.411984] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T20:29:48.421206] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-27T20:29:48.815638] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T20:29:49.214968] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-27T20:29:49.356229] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T20:29:49.365619] [INFO ] [REMOTE ] PB: Full fetch complete (59657 records). [2025-10-27T20:29:49.365816] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-27T20:29:49.366867] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:29:49.366961] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:29:49.367004] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:29:49.367047] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-27T20:29:49.367146] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-27T20:29:49.367184] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-27T20:29:49.367359] [DEBUG] [LOCAL ] PB: Deleted derivative data file. [2025-10-27T20:29:49.368110] [INFO ] [MAIN ] Update Progress: 1630/2366 symbols completed. PB took 24.1s. Estimated remaining: 1h 34m 43s. Rate: 7.8 symbols/min [2025-10-27T20:29:49.591255] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:49.652465] [DEBUG] [LOCAL ] PBF: Loaded 53883 existing records from primary storage. [2025-10-27T20:29:49.652931] [INFO ] [MAIN ] PBF: Loaded 53883 existing records. [2025-10-27T20:29:49.844488] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:49.844922] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-27T20:29:49.845057] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-27T20:29:49.845318] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-27T20:29:49.845365] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-27T20:29:50.016215] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-27T20:29:50.268431] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T20:29:50.325826] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:50.814943] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-27T20:29:51.614984] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-27T20:29:51.820383] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T20:29:52.140153] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T20:29:52.161423] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:29:52.169007] [INFO ] [REMOTE ] PAYC: Full fetch complete (52852 records). [2025-10-27T20:29:52.169121] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-27T20:29:52.169750] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:29:52.169833] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:29:52.169875] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:29:52.169937] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-27T20:29:52.170000] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-27T20:29:52.170035] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-27T20:29:52.170170] [DEBUG] [LOCAL ] PAYC: Deleted derivative data file. [2025-10-27T20:29:52.170257] [INFO ] [MAIN ] Update Progress: 1631/2366 symbols completed. PAYC took 32.0s. Estimated remaining: 1h 34m 33s. Rate: 7.8 symbols/min [2025-10-27T20:29:52.333696] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:52.365178] [DEBUG] [LOCAL ] PBH: Loaded 32839 existing records from primary storage. [2025-10-27T20:29:52.365446] [INFO ] [MAIN ] PBH: Loaded 32839 existing records. [2025-10-27T20:29:52.424458] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-27T20:29:52.540119] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:52.540315] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-27T20:29:52.540361] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-27T20:29:52.540773] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-27T20:29:52.540828] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-27T20:29:52.880941] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:53.215001] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-27T20:29:53.963241] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T20:29:54.014908] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-27T20:29:54.089852] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:29:54.814959] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-27T20:29:55.614928] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-27T20:29:55.750453] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:29:55.822198] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T20:29:55.826203] [INFO ] [REMOTE ] PAXS: Full fetch complete (29392 records). [2025-10-27T20:29:55.826278] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-27T20:29:56.193513] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-27T20:29:56.193618] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-27T20:29:56.194525] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-27T20:29:56.194604] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-27T20:29:56.195361] [DEBUG] [LOCAL ] PAXS: Trimmed 29392 records to 20549 (keeping 200 days of data) [2025-10-27T20:29:56.317313] [DEBUG] [LOCAL ] PAXS: Primary data saved (20549 records). [2025-10-27T20:29:56.317429] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-27T20:29:56.317504] [INFO ] [MAIN ] Update Progress: 1632/2366 symbols completed. PAXS took 47.2s. Estimated remaining: 1h 34m 24s. Rate: 7.8 symbols/min [2025-10-27T20:29:56.416279] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-27T20:29:56.486891] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:29:56.532148] [DEBUG] [LOCAL ] PBI: Loaded 50666 existing records from primary storage. [2025-10-27T20:29:56.532439] [INFO ] [MAIN ] PBI: Loaded 50666 existing records. [2025-10-27T20:29:56.704954] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:29:56.705143] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-27T20:29:56.705190] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-27T20:29:56.705596] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-27T20:29:56.705688] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-27T20:29:57.057285] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:29:57.214918] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-27T20:29:57.467517] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T20:29:57.722788] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T20:29:58.014927] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-27T20:29:58.814914] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-27T20:29:58.886171] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T20:29:58.950769] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T20:29:59.614991] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-27T20:30:00.321601] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T20:30:00.414910] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-27T20:30:01.214916] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-27T20:30:01.417807] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T20:30:01.778454] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T20:30:02.014962] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-27T20:30:02.314284] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T20:30:02.814943] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-27T20:30:03.614938] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-27T20:30:03.856976] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T20:30:04.414926] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-27T20:30:04.691504] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T20:30:04.767533] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:30:05.214944] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-27T20:30:06.014914] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-27T20:30:06.469440] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T20:30:06.527516] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:30:06.814930] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-27T20:30:07.614950] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-27T20:30:07.897959] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T20:30:08.209228] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T20:30:08.414943] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-27T20:30:08.850434] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T20:30:09.215011] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-27T20:30:09.768082] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T20:30:09.778948] [INFO ] [REMOTE ] PBA: Full fetch complete (71660 records). [2025-10-27T20:30:09.779185] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-27T20:30:10.020101] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-27T20:30:10.210103] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-27T20:30:10.210189] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-27T20:30:10.211249] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-27T20:30:10.211313] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-27T20:30:10.212664] [DEBUG] [LOCAL ] PBA: Trimmed 71660 records to 49049 (keeping 200 days of data) [2025-10-27T20:30:10.505536] [DEBUG] [LOCAL ] PBA: Primary data saved (49049 records). [2025-10-27T20:30:10.505785] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-27T20:30:10.505899] [INFO ] [MAIN ] Update Progress: 1633/2366 symbols completed. PBA took 27.6s. Estimated remaining: 1h 34m 19s. Rate: 7.8 symbols/min [2025-10-27T20:30:10.675983] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:10.753460] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T20:30:10.765006] [DEBUG] [LOCAL ] PBR: Loaded 54493 existing records from primary storage. [2025-10-27T20:30:10.765583] [INFO ] [MAIN ] PBR: Loaded 54493 existing records. [2025-10-27T20:30:10.820758] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-27T20:30:10.944852] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:10.945059] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-27T20:30:10.945106] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-27T20:30:10.945302] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-27T20:30:10.945356] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-27T20:30:11.283460] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:11.614940] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-27T20:30:12.185056] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T20:30:12.304559] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T20:30:12.414917] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-27T20:30:13.214976] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-27T20:30:13.517178] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:30:14.014953] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-27T20:30:14.086224] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T20:30:14.815028] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-27T20:30:15.513532] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T20:30:15.614911] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-27T20:30:16.221636] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-27T20:30:16.414955] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-27T20:30:16.640206] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-27T20:30:17.214921] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-27T20:30:17.714217] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T20:30:18.014932] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-27T20:30:18.190848] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:30:18.196727] [INFO ] [REMOTE ] PBH: Full fetch complete (44622 records). [2025-10-27T20:30:18.196825] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-27T20:30:18.197333] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:30:18.197416] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:30:18.197462] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:30:18.197531] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-27T20:30:18.197605] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-27T20:30:18.197681] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-27T20:30:18.197896] [DEBUG] [LOCAL ] PBH: Deleted derivative data file. [2025-10-27T20:30:18.198002] [INFO ] [MAIN ] Update Progress: 1634/2366 symbols completed. PBH took 26.0s. Estimated remaining: 1h 34m 11s. Rate: 7.8 symbols/min [2025-10-27T20:30:18.364230] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:18.383988] [DEBUG] [LOCAL ] PBT: Loaded 17508 existing records from primary storage. [2025-10-27T20:30:18.384246] [INFO ] [MAIN ] PBT: Loaded 17508 existing records. [2025-10-27T20:30:18.562183] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:18.562550] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-27T20:30:18.562619] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-27T20:30:18.562933] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-27T20:30:18.563018] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-27T20:30:18.749407] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-27T20:30:18.833626] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-27T20:30:18.956618] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:19.184897] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T20:30:19.614919] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-27T20:30:20.414961] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-27T20:30:20.956282] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-27T20:30:21.214944] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-27T20:30:21.350541] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T20:30:21.850465] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T20:30:21.859889] [INFO ] [REMOTE ] PBF: Full fetch complete (76383 records). [2025-10-27T20:30:21.860030] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-27T20:30:21.860848] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:30:21.860938] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:30:21.860980] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:30:21.861017] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-27T20:30:21.861085] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-27T20:30:21.861119] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-27T20:30:21.861256] [DEBUG] [LOCAL ] PBF: Deleted derivative data file. [2025-10-27T20:30:21.861809] [INFO ] [MAIN ] Update Progress: 1635/2366 symbols completed. PBF took 32.5s. Estimated remaining: 1h 34m 2s. Rate: 7.8 symbols/min [2025-10-27T20:30:22.026238] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-27T20:30:22.028852] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:22.040309] [DEBUG] [LOCAL ] PCF: Loaded 9194 existing records from primary storage. [2025-10-27T20:30:22.040514] [INFO ] [MAIN ] PCF: Loaded 9194 existing records. [2025-10-27T20:30:22.215959] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:22.216166] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-27T20:30:22.216211] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-27T20:30:22.216371] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-27T20:30:22.216407] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-27T20:30:22.584428] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:22.612843] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T20:30:22.814912] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-27T20:30:23.193045] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T20:30:23.432852] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T20:30:23.614947] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-27T20:30:24.414947] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-27T20:30:25.214950] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-27T20:30:25.384271] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T20:30:25.776875] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T20:30:26.014914] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-27T20:30:26.225845] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T20:30:26.814935] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-27T20:30:27.614944] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-27T20:30:28.195490] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-27T20:30:28.414999] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-27T20:30:28.438783] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:30:28.579588] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-27T20:30:29.214957] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-27T20:30:30.014917] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-27T20:30:30.499747] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:30:30.608190] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T20:30:30.814972] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-27T20:30:30.978599] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T20:30:31.614938] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-27T20:30:31.807822] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T20:30:31.817174] [INFO ] [REMOTE ] PBI: Full fetch complete (72100 records). [2025-10-27T20:30:31.817334] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-27T20:30:31.818228] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:30:31.818329] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:30:31.818372] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:30:31.818417] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-27T20:30:31.818472] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-27T20:30:31.818506] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-27T20:30:31.818629] [DEBUG] [LOCAL ] PBI: Deleted derivative data file. [2025-10-27T20:30:31.819065] [INFO ] [MAIN ] Update Progress: 1636/2366 symbols completed. PBI took 35.5s. Estimated remaining: 1h 33m 55s. Rate: 7.8 symbols/min [2025-10-27T20:30:31.985663] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:32.036290] [DEBUG] [LOCAL ] PCG: Loaded 54499 existing records from primary storage. [2025-10-27T20:30:32.036677] [INFO ] [MAIN ] PCG: Loaded 54499 existing records. [2025-10-27T20:30:32.210968] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:32.211183] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-27T20:30:32.211244] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-27T20:30:32.211543] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-10-27T20:30:32.211598] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-27T20:30:32.420105] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-27T20:30:32.572032] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:32.621053] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-27T20:30:33.083824] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T20:30:33.214968] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-27T20:30:34.014923] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-27T20:30:34.195672] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T20:30:34.815008] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-27T20:30:35.533119] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T20:30:35.614925] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-27T20:30:36.278601] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-27T20:30:36.414951] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-27T20:30:36.757440] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T20:30:37.214941] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-27T20:30:37.934629] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T20:30:38.014916] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-27T20:30:38.501364] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-27T20:30:38.814956] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-27T20:30:38.980216] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:30:38.982408] [INFO ] [REMOTE ] PCF: Full fetch complete (13346 records). [2025-10-27T20:30:38.982480] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-27T20:30:39.355790] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-27T20:30:39.355869] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-27T20:30:39.356292] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-27T20:30:39.356374] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-27T20:30:39.356954] [DEBUG] [LOCAL ] PCF: Trimmed 13346 records to 8934 (keeping 200 days of data) [2025-10-27T20:30:39.409900] [DEBUG] [LOCAL ] PCF: Primary data saved (8934 records). [2025-10-27T20:30:39.410030] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-27T20:30:39.410123] [INFO ] [MAIN ] Update Progress: 1637/2366 symbols completed. PCF took 17.5s. Estimated remaining: 1h 33m 47s. Rate: 7.8 symbols/min [2025-10-27T20:30:39.614938] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-27T20:30:40.414954] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-27T20:30:40.767381] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T20:30:40.981735] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-27T20:30:41.214956] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-27T20:30:42.014949] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-27T20:30:42.233384] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T20:30:42.814925] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-27T20:30:43.133773] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T20:30:43.363598] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-27T20:30:43.614944] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-27T20:30:44.414908] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-27T20:30:44.959745] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T20:30:45.214935] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-27T20:30:45.585865] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T20:30:45.836021] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-27T20:30:45.846250] [INFO ] [REMOTE ] PBR: Full fetch complete (77882 records). [2025-10-27T20:30:45.846386] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-27T20:30:46.018616] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-27T20:30:46.242890] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-27T20:30:46.242971] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-27T20:30:46.244074] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-27T20:30:46.244137] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-27T20:30:46.245553] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 53713 (keeping 200 days of data) [2025-10-27T20:30:46.572056] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-10-27T20:30:46.572222] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-27T20:30:46.572335] [INFO ] [MAIN ] Update Progress: 1638/2366 symbols completed. PBR took 36.1s. Estimated remaining: 1h 33m 39s. Rate: 7.8 symbols/min [2025-10-27T20:30:46.953561] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T20:30:46.964727] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-27T20:30:47.285585] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T20:30:47.614933] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-27T20:30:48.684010] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T20:30:48.695353] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-27T20:30:48.827139] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T20:30:49.214987] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-27T20:30:50.083968] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T20:30:50.088326] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-27T20:30:50.824732] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-27T20:30:50.835668] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-27T20:30:51.200266] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T20:30:51.203546] [INFO ] [REMOTE ] PBT: Full fetch complete (24489 records). [2025-10-27T20:30:51.203615] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-27T20:30:51.554865] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-27T20:30:51.554937] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-27T20:30:51.555435] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-27T20:30:51.555473] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-27T20:30:51.556079] [DEBUG] [LOCAL ] PBT: Trimmed 24489 records to 17086 (keeping 200 days of data) [2025-10-27T20:30:51.660151] [DEBUG] [LOCAL ] PBT: Primary data saved (17086 records). [2025-10-27T20:30:51.660317] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-27T20:30:51.660405] [INFO ] [MAIN ] Update Progress: 1639/2366 symbols completed. PBT took 33.5s. Estimated remaining: 1h 33m 30s. Rate: 7.8 symbols/min [2025-10-27T20:30:52.573245] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T20:30:52.584846] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-27T20:30:54.531944] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T20:30:54.543624] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-27T20:30:56.468914] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T20:30:56.480499] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-27T20:30:57.035411] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:30:57.045767] [INFO ] [REMOTE ] PCG: Full fetch complete (77508 records). [2025-10-27T20:30:57.045916] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-27T20:30:57.046758] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:30:57.046860] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:30:57.046918] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:30:57.046958] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-27T20:30:57.047028] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-27T20:30:57.047093] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-27T20:30:57.047278] [DEBUG] [LOCAL ] PCG: Deleted derivative data file. [2025-10-27T20:30:57.047767] [INFO ] [MAIN ] Update Progress: 1640/2366 symbols completed. PCG took 25.2s. Estimated remaining: 1h 33m 22s. Rate: 7.8 symbols/min [2025-10-27T20:30:57.685436] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:57.762574] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:57.798298] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:57.846200] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:30:57.859146] [DEBUG] [LOCAL ] PCQ: Loaded 12380 existing records from primary storage. [2025-10-27T20:30:57.859498] [INFO ] [MAIN ] PCQ: Loaded 12380 existing records. [2025-10-27T20:30:57.858727] [DEBUG] [LOCAL ] PCM: Loaded 6992 existing records from primary storage. [2025-10-27T20:30:57.896772] [INFO ] [MAIN ] PCM: Loaded 6992 existing records. [2025-10-27T20:30:58.096241] [DEBUG] [LOCAL ] PCN: Loaded 25709 existing records from primary storage. [2025-10-27T20:30:58.165903] [INFO ] [MAIN ] PCN: Loaded 25709 existing records. [2025-10-27T20:30:58.217829] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:58.327253] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-27T20:30:58.347797] [DEBUG] [LOCAL ] PCOR: Loaded 47981 existing records from primary storage. [2025-10-27T20:30:58.369556] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-27T20:30:58.386712] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-27T20:30:58.392562] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:58.402181] [INFO ] [MAIN ] PCOR: Loaded 47981 existing records. [2025-10-27T20:30:58.402256] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-27T20:30:58.402364] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-27T20:30:58.422849] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-27T20:30:58.565745] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-27T20:30:58.593047] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-27T20:30:58.677940] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:58.749342] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-27T20:30:58.764456] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-27T20:30:58.785514] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-27T20:30:58.833810] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-27T20:30:59.047918] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:30:59.216822] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-27T20:30:59.251573] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-27T20:30:59.344413] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-27T20:30:59.362234] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-27T20:30:59.706839] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:59.798280] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-27T20:30:59.854766] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:30:59.860272] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-27T20:31:00.127700] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:00.130323] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-27T20:31:00.207451] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:00.207838] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-27T20:31:00.792500] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T20:31:00.795191] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-27T20:31:00.922979] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T20:31:00.925765] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-27T20:31:01.468737] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T20:31:01.473413] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-27T20:31:01.524408] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T20:31:01.527403] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-27T20:31:01.864680] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:31:01.868855] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-27T20:31:02.061141] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T20:31:02.070331] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-27T20:31:02.247479] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T20:31:02.249483] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-27T20:31:02.695947] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T20:31:02.763057] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T20:31:02.814951] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-27T20:31:02.893738] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T20:31:03.614903] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-27T20:31:03.884844] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T20:31:04.168855] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T20:31:04.320229] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T20:31:04.414938] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-27T20:31:05.215115] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-27T20:31:05.231324] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T20:31:06.014941] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-27T20:31:06.602985] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:31:06.814936] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-27T20:31:07.153511] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T20:31:07.614953] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-27T20:31:07.936860] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T20:31:08.414948] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-27T20:31:09.214935] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-27T20:31:09.246904] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T20:31:09.623117] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T20:31:10.014967] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-27T20:31:10.232229] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T20:31:10.814922] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-27T20:31:11.615314] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:31:11.615101] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-27T20:31:11.924166] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T20:31:12.414972] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-27T20:31:12.953721] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T20:31:13.214990] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-27T20:31:14.020027] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-27T20:31:14.038964] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T20:31:14.720009] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T20:31:14.814913] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-27T20:31:14.885547] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T20:31:15.614938] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-27T20:31:15.893074] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T20:31:16.414955] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-27T20:31:16.827055] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T20:31:17.215010] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-27T20:31:17.871829] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T20:31:18.014946] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-27T20:31:18.305988] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:31:18.307966] [INFO ] [REMOTE ] PCM: Full fetch complete (10163 records). [2025-10-27T20:31:18.308037] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-27T20:31:18.665944] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-27T20:31:18.666016] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-27T20:31:18.666256] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-27T20:31:18.666293] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-27T20:31:18.666739] [DEBUG] [LOCAL ] PCM: Trimmed 10163 records to 6775 (keeping 200 days of data) [2025-10-27T20:31:18.704675] [DEBUG] [LOCAL ] PCM: Primary data saved (6775 records). [2025-10-27T20:31:18.704824] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-27T20:31:18.704903] [INFO ] [MAIN ] Update Progress: 1641/2366 symbols completed. PCM took 21.7s. Estimated remaining: 1h 33m 20s. Rate: 7.8 symbols/min [2025-10-27T20:31:18.820168] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-27T20:31:18.875072] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:18.918069] [DEBUG] [LOCAL ] PD: Loaded 49011 existing records from primary storage. [2025-10-27T20:31:18.918415] [INFO ] [MAIN ] PD: Loaded 49011 existing records. [2025-10-27T20:31:19.092299] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:31:19.092504] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-27T20:31:19.092551] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-27T20:31:19.092861] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-27T20:31:19.092919] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-27T20:31:19.439688] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:19.614907] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-27T20:31:19.813417] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:31:19.921266] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T20:31:20.415013] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-27T20:31:21.091267] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:31:21.214970] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-27T20:31:21.830837] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T20:31:22.014985] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-27T20:31:22.614118] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T20:31:22.814985] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-27T20:31:23.608748] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T20:31:23.618229] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-27T20:31:24.414955] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-27T20:31:24.597968] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T20:31:25.042061] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T20:31:25.214973] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-27T20:31:25.997874] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T20:31:26.014935] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-27T20:31:26.246016] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T20:31:26.255263] [INFO ] [REMOTE ] PCOR: Full fetch complete (69110 records). [2025-10-27T20:31:26.255456] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-27T20:31:26.653098] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-27T20:31:26.653211] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-27T20:31:26.655034] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-27T20:31:26.655115] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-27T20:31:26.656778] [DEBUG] [LOCAL ] PCOR: Trimmed 69110 records to 47151 (keeping 200 days of data) [2025-10-27T20:31:26.840947] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-27T20:31:26.956082] [DEBUG] [LOCAL ] PCOR: Primary data saved (47151 records). [2025-10-27T20:31:26.956590] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-27T20:31:26.960526] [INFO ] [MAIN ] Update Progress: 1642/2366 symbols completed. PCOR took 29.9s. Estimated remaining: 1h 33m 13s. Rate: 7.8 symbols/min [2025-10-27T20:31:27.123062] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:31:27.176570] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:27.176823] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-27T20:31:27.176881] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-27T20:31:27.177011] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-27T20:31:27.177062] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-27T20:31:27.177104] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-27T20:31:27.177135] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-27T20:31:27.525710] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:27.614949] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-27T20:31:28.112264] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T20:31:28.174975] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T20:31:28.414984] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-27T20:31:29.214979] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-27T20:31:29.430633] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T20:31:29.433358] [INFO ] [REMOTE ] PCQ: Full fetch complete (17115 records). [2025-10-27T20:31:29.433439] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-27T20:31:29.781530] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T20:31:29.807289] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-27T20:31:29.807350] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-27T20:31:29.807764] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-27T20:31:29.807825] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-27T20:31:29.808332] [DEBUG] [LOCAL ] PCQ: Trimmed 17115 records to 12003 (keeping 200 days of data) [2025-10-27T20:31:29.878422] [DEBUG] [LOCAL ] PCQ: Primary data saved (12003 records). [2025-10-27T20:31:29.878556] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-27T20:31:29.878633] [INFO ] [MAIN ] Update Progress: 1643/2366 symbols completed. PCQ took 32.8s. Estimated remaining: 1h 33m 3s. Rate: 7.8 symbols/min [2025-10-27T20:31:30.021014] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-27T20:31:30.045887] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:30.093014] [DEBUG] [LOCAL ] PDI: Loaded 50949 existing records from primary storage. [2025-10-27T20:31:30.093324] [INFO ] [MAIN ] PDI: Loaded 50949 existing records. [2025-10-27T20:31:30.265176] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:31:30.265390] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-27T20:31:30.265436] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-27T20:31:30.265722] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-27T20:31:30.265777] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-27T20:31:30.588864] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:31:30.617140] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:30.814953] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-27T20:31:31.614962] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-27T20:31:32.055901] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T20:31:32.233407] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T20:31:32.239294] [INFO ] [REMOTE ] PCN: Full fetch complete (34970 records). [2025-10-27T20:31:32.239381] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-27T20:31:32.420134] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-27T20:31:32.598487] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-27T20:31:32.598559] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-27T20:31:32.599281] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-27T20:31:32.599343] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-27T20:31:32.600095] [DEBUG] [LOCAL ] PCN: Trimmed 34970 records to 25100 (keeping 200 days of data) [2025-10-27T20:31:32.749492] [DEBUG] [LOCAL ] PCN: Primary data saved (25100 records). [2025-10-27T20:31:32.749625] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-27T20:31:32.749753] [INFO ] [MAIN ] Update Progress: 1644/2366 symbols completed. PCN took 35.7s. Estimated remaining: 1h 32m 53s. Rate: 7.8 symbols/min [2025-10-27T20:31:32.912894] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:32.945950] [DEBUG] [LOCAL ] PDM: Loaded 40283 existing records from primary storage. [2025-10-27T20:31:32.946225] [INFO ] [MAIN ] PDM: Loaded 40283 existing records. [2025-10-27T20:31:33.103567] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T20:31:33.122417] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:31:33.123828] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-27T20:31:33.123944] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-27T20:31:33.124209] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-27T20:31:33.124252] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-27T20:31:33.220062] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-27T20:31:33.495096] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:34.015011] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-27T20:31:34.814977] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-27T20:31:35.263505] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-27T20:31:35.515330] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T20:31:35.614901] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-27T20:31:36.117117] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T20:31:36.414948] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-27T20:31:37.189491] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T20:31:37.214968] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-27T20:31:38.014941] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-27T20:31:38.382973] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T20:31:38.385492] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T20:31:38.814919] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-27T20:31:39.109036] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T20:31:39.614934] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-27T20:31:40.079716] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-27T20:31:40.388744] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T20:31:40.414898] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-27T20:31:41.214964] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-27T20:31:41.585358] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T20:31:41.712619] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T20:31:42.014951] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-27T20:31:42.814953] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-27T20:31:43.381848] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T20:31:43.614969] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-27T20:31:43.731182] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T20:31:44.415001] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-27T20:31:44.983423] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T20:31:44.984246] [INFO ] [REMOTE ] PDCC: Full fetch complete (1397 records). [2025-10-27T20:31:44.984321] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-27T20:31:45.172003] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T20:31:45.172182] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:31:45.172263] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:31:45.172312] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-27T20:31:45.172369] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-27T20:31:45.172404] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-27T20:31:45.172445] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-27T20:31:45.172501] [INFO ] [MAIN ] Update Progress: 1645/2366 symbols completed. PDCC took 18.2s. Estimated remaining: 1h 32m 47s. Rate: 7.8 symbols/min [2025-10-27T20:31:45.217162] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-27T20:31:45.355857] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:45.392942] [DEBUG] [LOCAL ] PDO: Loaded 31795 existing records from primary storage. [2025-10-27T20:31:45.393222] [INFO ] [MAIN ] PDO: Loaded 31795 existing records. [2025-10-27T20:31:45.594239] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:31:45.606120] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-27T20:31:45.606287] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-27T20:31:45.607948] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T20:31:45.607992] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-27T20:31:45.617539] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-27T20:31:45.967472] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:46.014951] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-27T20:31:46.814976] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-27T20:31:46.950939] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T20:31:47.519900] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T20:31:47.614949] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-27T20:31:48.414954] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-27T20:31:48.850029] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T20:31:48.883457] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T20:31:49.214963] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-27T20:31:49.484572] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T20:31:50.014940] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-27T20:31:50.814918] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-27T20:31:51.011017] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T20:31:51.483373] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:31:51.614953] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-27T20:31:52.214596] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:31:52.414938] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-27T20:31:53.000390] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:31:53.214932] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-27T20:31:54.014977] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-27T20:31:54.259253] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-27T20:31:54.269054] [INFO ] [REMOTE ] PD: Full fetch complete (68352 records). [2025-10-27T20:31:54.269208] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-27T20:31:54.705065] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-27T20:31:54.705188] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-27T20:31:54.706455] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-27T20:31:54.706539] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-27T20:31:54.718349] [DEBUG] [LOCAL ] PD: Trimmed 68352 records to 48212 (keeping 200 days of data) [2025-10-27T20:31:54.733483] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T20:31:54.822685] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-27T20:31:55.161839] [DEBUG] [LOCAL ] PD: Primary data saved (48212 records). [2025-10-27T20:31:55.162343] [INFO ] [MAIN ] PD: Full history saved. [2025-10-27T20:31:55.163463] [INFO ] [MAIN ] Update Progress: 1646/2366 symbols completed. PD took 36.5s. Estimated remaining: 1h 32m 41s. Rate: 7.8 symbols/min [2025-10-27T20:31:55.424671] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:31:55.445075] [DEBUG] [LOCAL ] PDS: Loaded 16903 existing records from primary storage. [2025-10-27T20:31:55.445340] [INFO ] [MAIN ] PDS: Loaded 16903 existing records. [2025-10-27T20:31:55.636752] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-27T20:31:55.636623] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:31:55.637261] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-27T20:31:55.638621] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-27T20:31:55.639340] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-27T20:31:55.639401] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-27T20:31:56.014231] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-27T20:31:56.056322] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:31:56.357342] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T20:31:56.414945] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-27T20:31:57.214930] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-27T20:31:57.311093] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:31:57.526055] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T20:31:58.014910] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-27T20:31:58.365963] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T20:31:58.814978] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-27T20:31:59.534123] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T20:31:59.614937] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-27T20:31:59.941444] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:32:00.414941] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-27T20:32:01.214951] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-27T20:32:01.258022] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T20:32:02.014921] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-27T20:32:02.054930] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T20:32:02.484787] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T20:32:02.814934] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-27T20:32:03.580217] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T20:32:03.586925] [INFO ] [REMOTE ] PDO: Full fetch complete (46676 records). [2025-10-27T20:32:03.587019] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-27T20:32:03.619992] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-27T20:32:03.962225] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-27T20:32:03.962328] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-27T20:32:03.963182] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-27T20:32:03.963243] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-27T20:32:03.964291] [DEBUG] [LOCAL ] PDO: Trimmed 46676 records to 30959 (keeping 200 days of data) [2025-10-27T20:32:04.151052] [DEBUG] [LOCAL ] PDO: Primary data saved (30959 records). [2025-10-27T20:32:04.151179] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-27T20:32:04.151252] [INFO ] [MAIN ] Update Progress: 1647/2366 symbols completed. PDO took 19.0s. Estimated remaining: 1h 32m 33s. Rate: 7.8 symbols/min [2025-10-27T20:32:04.321486] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:04.338694] [DEBUG] [LOCAL ] PDT: Loaded 17663 existing records from primary storage. [2025-10-27T20:32:04.339067] [INFO ] [MAIN ] PDT: Loaded 17663 existing records. [2025-10-27T20:32:04.418148] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-27T20:32:04.537516] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T20:32:04.543379] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:04.550538] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-27T20:32:04.550901] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-27T20:32:04.551556] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-27T20:32:04.552089] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-27T20:32:04.981021] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:05.214931] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-27T20:32:05.442279] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T20:32:06.015027] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-27T20:32:06.217875] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-27T20:32:06.225846] [INFO ] [REMOTE ] PDM: Full fetch complete (57340 records). [2025-10-27T20:32:06.225993] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-27T20:32:06.552668] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T20:32:06.625667] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-27T20:32:06.625758] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-27T20:32:06.626863] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-27T20:32:06.626926] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-27T20:32:06.628156] [DEBUG] [LOCAL ] PDM: Trimmed 57340 records to 39478 (keeping 200 days of data) [2025-10-27T20:32:06.815546] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-27T20:32:06.849431] [DEBUG] [LOCAL ] PDM: Primary data saved (39478 records). [2025-10-27T20:32:06.849910] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-27T20:32:06.850032] [INFO ] [MAIN ] Update Progress: 1648/2366 symbols completed. PDM took 34.1s. Estimated remaining: 1h 32m 24s. Rate: 7.8 symbols/min [2025-10-27T20:32:06.961096] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T20:32:07.033554] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:07.049060] [DEBUG] [LOCAL ] PDX: Loaded 14318 existing records from primary storage. [2025-10-27T20:32:07.049299] [INFO ] [MAIN ] PDX: Loaded 14318 existing records. [2025-10-27T20:32:07.221283] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:07.221518] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-27T20:32:07.221568] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-27T20:32:07.221766] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-27T20:32:07.221821] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-27T20:32:07.566468] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:07.614922] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-27T20:32:08.305379] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:32:08.414929] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-27T20:32:08.828026] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T20:32:09.214949] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-27T20:32:09.608559] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T20:32:10.014944] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-27T20:32:10.214948] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T20:32:10.815001] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-27T20:32:11.274923] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T20:32:11.614931] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-27T20:32:12.403339] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:32:12.416837] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-27T20:32:12.894733] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T20:32:13.214948] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-27T20:32:13.329151] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T20:32:14.014966] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-27T20:32:14.339394] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T20:32:14.814989] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-27T20:32:14.873761] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T20:32:15.614904] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-27T20:32:15.637110] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:32:16.414970] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-27T20:32:16.677678] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T20:32:17.214952] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-27T20:32:17.437808] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T20:32:18.014963] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-27T20:32:18.095575] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T20:32:18.814958] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-27T20:32:18.854414] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T20:32:19.614944] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-27T20:32:19.665501] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T20:32:20.414925] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-27T20:32:21.215028] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-27T20:32:21.245928] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:32:21.283324] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T20:32:22.014896] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-27T20:32:22.031760] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T20:32:22.774415] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T20:32:22.814963] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-27T20:32:23.614971] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-27T20:32:23.991451] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T20:32:23.994787] [INFO ] [REMOTE ] PDS: Full fetch complete (25707 records). [2025-10-27T20:32:23.994907] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-27T20:32:24.355544] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-27T20:32:24.355623] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-27T20:32:24.356184] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-27T20:32:24.356238] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-27T20:32:24.357108] [DEBUG] [LOCAL ] PDS: Trimmed 25707 records to 16191 (keeping 200 days of data) [2025-10-27T20:32:24.422733] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-27T20:32:24.452909] [DEBUG] [LOCAL ] PDS: Primary data saved (16191 records). [2025-10-27T20:32:24.453041] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-27T20:32:24.453117] [INFO ] [MAIN ] Update Progress: 1649/2366 symbols completed. PDS took 29.3s. Estimated remaining: 1h 32m 20s. Rate: 7.8 symbols/min [2025-10-27T20:32:24.620116] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:24.666129] [DEBUG] [LOCAL ] PEB: Loaded 51456 existing records from primary storage. [2025-10-27T20:32:24.666412] [INFO ] [MAIN ] PEB: Loaded 51456 existing records. [2025-10-27T20:32:24.836438] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:24.836623] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-27T20:32:24.836721] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-27T20:32:24.836923] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-27T20:32:24.836961] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-27T20:32:25.182077] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:25.214897] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-27T20:32:25.276411] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T20:32:25.741316] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T20:32:26.014964] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-27T20:32:26.560892] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:32:26.814913] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-27T20:32:27.127978] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T20:32:27.615016] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-27T20:32:28.414966] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-27T20:32:28.445536] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T20:32:28.818598] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T20:32:29.214980] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-27T20:32:29.680509] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:32:30.014969] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-27T20:32:30.786684] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T20:32:30.814933] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-27T20:32:31.608017] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-27T20:32:31.617457] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-27T20:32:31.619457] [INFO ] [REMOTE ] PDI: Full fetch complete (73161 records). [2025-10-27T20:32:31.619619] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-27T20:32:32.009671] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-27T20:32:32.009768] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-27T20:32:32.010908] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-27T20:32:32.010973] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-27T20:32:32.012326] [DEBUG] [LOCAL ] PDI: Trimmed 73161 records to 50169 (keeping 200 days of data) [2025-10-27T20:32:32.312279] [DEBUG] [LOCAL ] PDI: Primary data saved (50169 records). [2025-10-27T20:32:32.312960] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-27T20:32:32.313450] [INFO ] [MAIN ] Update Progress: 1650/2366 symbols completed. PDI took 1m 2s. Estimated remaining: 1h 32m 12s. Rate: 7.8 symbols/min [2025-10-27T20:32:32.414935] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-27T20:32:32.491879] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:32.569180] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T20:32:32.580872] [DEBUG] [LOCAL ] PEG: Loaded 53894 existing records from primary storage. [2025-10-27T20:32:32.582150] [INFO ] [MAIN ] PEG: Loaded 53894 existing records. [2025-10-27T20:32:32.765565] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:32.765832] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-27T20:32:32.765880] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-27T20:32:32.766059] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-10-27T20:32:32.766096] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-27T20:32:33.105014] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T20:32:33.139788] [INFO ] [REMOTE ] PDT: Full fetch complete (25125 records). [2025-10-27T20:32:33.150766] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:33.147460] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-27T20:32:33.220146] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-27T20:32:33.551797] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-27T20:32:33.551958] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-27T20:32:33.552586] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-27T20:32:33.559540] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-27T20:32:33.560324] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:32:33.563741] [INFO ] [REMOTE ] PDX: Full fetch complete (23645 records). [2025-10-27T20:32:33.563906] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-27T20:32:33.564158] [DEBUG] [LOCAL ] PDT: Trimmed 25125 records to 17343 (keeping 200 days of data) [2025-10-27T20:32:33.837441] [DEBUG] [LOCAL ] PDT: Primary data saved (17343 records). [2025-10-27T20:32:33.846137] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-27T20:32:33.855525] [INFO ] [MAIN ] Update Progress: 1651/2366 symbols completed. PDT took 29.7s. Estimated remaining: 1h 32m 2s. Rate: 7.8 symbols/min [2025-10-27T20:32:34.032175] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-27T20:32:34.211893] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:34.212086] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-27T20:32:34.212430] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-27T20:32:34.212985] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-27T20:32:34.213045] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-27T20:32:34.213661] [DEBUG] [LOCAL ] PDX: Trimmed 23645 records to 13856 (keeping 200 days of data) [2025-10-27T20:32:34.306931] [DEBUG] [LOCAL ] PDX: Primary data saved (13856 records). [2025-10-27T20:32:34.307103] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-27T20:32:34.307189] [INFO ] [MAIN ] Update Progress: 1652/2366 symbols completed. PDX took 27.5s. Estimated remaining: 1h 31m 51s. Rate: 7.8 symbols/min [2025-10-27T20:32:34.415306] [DEBUG] [LOCAL ] PEN: Loaded 29866 existing records from primary storage. [2025-10-27T20:32:34.421158] [INFO ] [MAIN ] PEN: Loaded 29866 existing records. [2025-10-27T20:32:34.568054] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:34.672974] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:34.673408] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-27T20:32:34.673481] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-27T20:32:34.673939] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-27T20:32:34.674140] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-27T20:32:34.721182] [DEBUG] [LOCAL ] PEO: Loaded 11239 existing records from primary storage. [2025-10-27T20:32:34.747200] [INFO ] [MAIN ] PEO: Loaded 11239 existing records. [2025-10-27T20:32:35.205316] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:35.211169] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-27T20:32:35.216816] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-27T20:32:35.234322] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-27T20:32:35.257950] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-27T20:32:35.234276] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-27T20:32:35.370289] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-27T20:32:35.364505] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:35.619691] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-27T20:32:35.658999] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:35.859180] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T20:32:36.414941] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-27T20:32:36.774379] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T20:32:37.214963] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-27T20:32:37.375985] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-27T20:32:38.014963] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-27T20:32:38.311453] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T20:32:38.366081] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T20:32:38.814945] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-27T20:32:39.614925] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-27T20:32:39.930055] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T20:32:40.354004] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T20:32:40.415978] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-27T20:32:40.420140] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T20:32:41.214940] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-27T20:32:42.014933] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-27T20:32:42.511701] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-27T20:32:42.718039] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:32:42.814905] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-27T20:32:43.614927] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-27T20:32:43.678962] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T20:32:44.414996] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-27T20:32:45.062240] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-27T20:32:45.100001] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T20:32:45.215073] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-27T20:32:46.014998] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-27T20:32:46.224849] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T20:32:46.653469] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:32:46.814964] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-27T20:32:46.930452] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T20:32:47.505623] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T20:32:47.515422] [INFO ] [REMOTE ] PEB: Full fetch complete (72900 records). [2025-10-27T20:32:47.515562] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-27T20:32:47.516357] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:32:47.516470] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:32:47.516551] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:32:47.516678] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-27T20:32:47.516813] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-27T20:32:47.516869] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-27T20:32:47.517059] [DEBUG] [LOCAL ] PEB: Deleted derivative data file. [2025-10-27T20:32:47.517164] [INFO ] [MAIN ] Update Progress: 1653/2366 symbols completed. PEB took 23.1s. Estimated remaining: 1h 31m 46s. Rate: 7.8 symbols/min [2025-10-27T20:32:47.620121] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-27T20:32:47.707204] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:47.722302] [DEBUG] [LOCAL ] PERF: Loaded 14654 existing records from primary storage. [2025-10-27T20:32:47.722517] [INFO ] [MAIN ] PERF: Loaded 14654 existing records. [2025-10-27T20:32:47.891712] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:47.891901] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-27T20:32:47.891947] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-27T20:32:47.892106] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-27T20:32:47.892143] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-27T20:32:48.235149] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:48.414913] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-27T20:32:49.170755] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T20:32:49.214910] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-27T20:32:49.760388] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:32:50.014924] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-27T20:32:50.279036] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T20:32:50.814909] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-27T20:32:50.970989] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T20:32:51.614949] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-27T20:32:52.050798] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T20:32:52.414990] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-27T20:32:52.995811] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:32:53.214988] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-27T20:32:53.717107] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:32:53.763115] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:32:53.768079] [INFO ] [REMOTE ] PEN: Full fetch complete (43739 records). [2025-10-27T20:32:53.768173] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-27T20:32:53.768719] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:32:53.768811] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:32:53.768887] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:32:53.768974] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-27T20:32:53.769055] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-27T20:32:53.769092] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-27T20:32:53.769206] [DEBUG] [LOCAL ] PEN: Deleted derivative data file. [2025-10-27T20:32:53.769271] [INFO ] [MAIN ] Update Progress: 1654/2366 symbols completed. PEN took 19.9s. Estimated remaining: 1h 31m 37s. Rate: 7.8 symbols/min [2025-10-27T20:32:53.933394] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:53.933575] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-27T20:32:53.933611] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-27T20:32:53.933764] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-27T20:32:53.933825] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-27T20:32:53.933870] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-27T20:32:53.933901] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-27T20:32:54.020061] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-27T20:32:54.279072] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:54.814914] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-27T20:32:55.032950] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T20:32:55.614937] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-27T20:32:55.863674] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T20:32:56.414996] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-10-27T20:32:56.430716] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T20:32:56.906387] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:32:56.906755] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-10-27T20:32:56.906841] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:32:56.906887] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-27T20:32:56.906931] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:32:56.906967] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-27T20:32:56.907021] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-27T20:32:56.907056] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-27T20:32:56.907102] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-27T20:32:56.907148] [INFO ] [MAIN ] Update Progress: 1655/2366 symbols completed. PEW took 3.1s. Estimated remaining: 1h 31m 28s. Rate: 7.8 symbols/min [2025-10-27T20:32:57.072084] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:32:57.079511] [DEBUG] [LOCAL ] PFD: Loaded 5405 existing records from primary storage. [2025-10-27T20:32:57.079725] [INFO ] [MAIN ] PFD: Loaded 5405 existing records. [2025-10-27T20:32:57.220075] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-27T20:32:57.254942] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:32:57.255097] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-27T20:32:57.255142] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-27T20:32:57.255275] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-27T20:32:57.255314] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-27T20:32:57.613158] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:32:57.907206] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T20:32:58.014933] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-27T20:32:58.698768] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T20:32:58.814934] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-27T20:32:59.614956] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-27T20:33:00.395311] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:33:00.414941] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-27T20:33:00.964911] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T20:33:01.214942] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-27T20:33:01.719519] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T20:33:01.814004] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-27T20:33:02.014941] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-27T20:33:02.666260] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T20:33:02.814948] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-27T20:33:03.614955] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-27T20:33:04.185276] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T20:33:04.382544] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:33:04.414956] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-27T20:33:05.215026] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-27T20:33:05.475292] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T20:33:05.784233] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:33:06.014930] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-27T20:33:06.792631] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T20:33:06.814916] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-27T20:33:07.614936] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-27T20:33:07.637228] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T20:33:08.386202] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T20:33:08.388886] [INFO ] [REMOTE ] PEO: Full fetch complete (16331 records). [2025-10-27T20:33:08.388995] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-27T20:33:08.420063] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-27T20:33:08.755031] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-27T20:33:08.755095] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-27T20:33:08.755471] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-27T20:33:08.755509] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-27T20:33:08.756049] [DEBUG] [LOCAL ] PEO: Trimmed 16331 records to 10939 (keeping 200 days of data) [2025-10-27T20:33:08.820479] [DEBUG] [LOCAL ] PEO: Primary data saved (10939 records). [2025-10-27T20:33:08.820601] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-27T20:33:08.820699] [INFO ] [MAIN ] Update Progress: 1656/2366 symbols completed. PEO took 34.5s. Estimated remaining: 1h 31m 22s. Rate: 7.8 symbols/min [2025-10-27T20:33:08.990489] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:09.038294] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-10-27T20:33:09.038585] [INFO ] [MAIN ] PFE: Loaded 54593 existing records. [2025-10-27T20:33:09.211638] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:09.211833] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-27T20:33:09.211879] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-27T20:33:09.212320] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-10-27T20:33:09.212378] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-27T20:33:09.223518] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-27T20:33:09.577248] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:09.887880] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T20:33:10.014960] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-27T20:33:10.498301] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:33:10.814968] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-27T20:33:11.174490] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T20:33:11.614986] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-27T20:33:11.816308] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T20:33:12.414973] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-27T20:33:13.214989] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-27T20:33:13.505120] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T20:33:14.020142] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-27T20:33:14.033795] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-27T20:33:14.807707] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T20:33:14.814882] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-27T20:33:15.033971] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T20:33:15.614934] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-27T20:33:15.977302] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T20:33:15.980371] [INFO ] [REMOTE ] PERF: Full fetch complete (21231 records). [2025-10-27T20:33:15.980438] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-27T20:33:16.344393] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-27T20:33:16.344462] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-27T20:33:16.344861] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-27T20:33:16.344941] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-27T20:33:16.345499] [DEBUG] [LOCAL ] PERF: Trimmed 21231 records to 14553 (keeping 200 days of data) [2025-10-27T20:33:16.416691] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-27T20:33:16.426193] [DEBUG] [LOCAL ] PERF: Primary data saved (14553 records). [2025-10-27T20:33:16.426267] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-27T20:33:16.426339] [INFO ] [MAIN ] Update Progress: 1657/2366 symbols completed. PERF took 28.9s. Estimated remaining: 1h 31m 14s. Rate: 7.8 symbols/min [2025-10-27T20:33:16.601280] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:16.642935] [DEBUG] [LOCAL ] PFGC: Loaded 47284 existing records from primary storage. [2025-10-27T20:33:16.643272] [INFO ] [MAIN ] PFGC: Loaded 47284 existing records. [2025-10-27T20:33:16.820597] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:16.820838] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-27T20:33:16.820884] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-27T20:33:16.821110] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-27T20:33:16.821149] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-27T20:33:17.182525] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:17.214900] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-27T20:33:17.936358] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-27T20:33:18.014911] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-27T20:33:18.108635] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T20:33:18.814941] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-27T20:33:18.938924] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T20:33:19.400074] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T20:33:19.614952] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-27T20:33:20.221438] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-27T20:33:20.316353] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T20:33:20.318013] [INFO ] [REMOTE ] PFD: Full fetch complete (7490 records). [2025-10-27T20:33:20.318083] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-27T20:33:20.422455] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-27T20:33:20.691031] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-27T20:33:20.691100] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-27T20:33:20.691250] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-27T20:33:20.691288] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-27T20:33:20.691680] [DEBUG] [LOCAL ] PFD: Trimmed 7490 records to 5255 (keeping 200 days of data) [2025-10-27T20:33:20.722482] [DEBUG] [LOCAL ] PFD: Primary data saved (5255 records). [2025-10-27T20:33:20.722553] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-27T20:33:20.722622] [INFO ] [MAIN ] Update Progress: 1658/2366 symbols completed. PFD took 23.8s. Estimated remaining: 1h 31m 5s. Rate: 7.8 symbols/min [2025-10-27T20:33:20.911946] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:20.920010] [DEBUG] [LOCAL ] PFH: Loaded 6474 existing records from primary storage. [2025-10-27T20:33:20.920212] [INFO ] [MAIN ] PFH: Loaded 6474 existing records. [2025-10-27T20:33:21.094827] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:21.095041] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-27T20:33:21.095087] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-27T20:33:21.095242] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-27T20:33:21.095296] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-27T20:33:21.229734] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-27T20:33:21.443749] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:22.014969] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-27T20:33:22.814982] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-27T20:33:22.976568] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T20:33:23.021338] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T20:33:23.414863] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-10-27T20:33:23.614959] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-27T20:33:24.414918] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-27T20:33:24.676024] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T20:33:24.706075] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T20:33:25.214996] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-27T20:33:26.014920] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-27T20:33:26.034891] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:33:26.814906] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-27T20:33:27.101580] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-27T20:33:27.123398] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T20:33:27.133980] [INFO ] [REMOTE ] PEG: Full fetch complete (76608 records). [2025-10-27T20:33:27.134112] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-27T20:33:27.134947] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:33:27.135032] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:33:27.135074] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:33:27.135139] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-27T20:33:27.135202] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-27T20:33:27.135236] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-27T20:33:27.135361] [DEBUG] [LOCAL ] PEG: Deleted derivative data file. [2025-10-27T20:33:27.135835] [INFO ] [MAIN ] Update Progress: 1659/2366 symbols completed. PEG took 54.8s. Estimated remaining: 1h 30m 57s. Rate: 7.8 symbols/min [2025-10-27T20:33:27.301550] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:27.317742] [DEBUG] [LOCAL ] PFL: Loaded 14680 existing records from primary storage. [2025-10-27T20:33:27.317996] [INFO ] [MAIN ] PFL: Loaded 14680 existing records. [2025-10-27T20:33:27.494408] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:27.494600] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-27T20:33:27.494665] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-27T20:33:27.494866] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-27T20:33:27.494929] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-27T20:33:27.620036] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-27T20:33:27.884075] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:27.987201] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T20:33:28.415010] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-27T20:33:29.214928] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-27T20:33:29.394006] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T20:33:29.490441] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T20:33:30.014923] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-27T20:33:30.703580] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T20:33:30.815029] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-27T20:33:31.614999] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-27T20:33:31.639758] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T20:33:31.905820] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-27T20:33:32.414986] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-27T20:33:33.024514] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T20:33:33.107085] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T20:33:33.214914] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-27T20:33:34.014938] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-27T20:33:34.814964] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-27T20:33:34.872394] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:33:35.232863] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T20:33:35.448439] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-27T20:33:35.614917] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-27T20:33:36.414943] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-27T20:33:36.747376] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T20:33:37.214939] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-27T20:33:37.282554] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T20:33:38.015016] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-27T20:33:38.814923] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-27T20:33:38.891932] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T20:33:39.582705] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T20:33:39.614938] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-27T20:33:40.414983] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-27T20:33:40.997760] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-10-27T20:33:41.214991] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-27T20:33:41.380152] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T20:33:41.384528] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T20:33:41.940983] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T20:33:41.942498] [INFO ] [REMOTE ] PFH: Full fetch complete (9619 records). [2025-10-27T20:33:41.942585] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-27T20:33:42.020044] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-27T20:33:42.304249] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-27T20:33:42.304321] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-27T20:33:42.304562] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-27T20:33:42.304601] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-27T20:33:42.305019] [DEBUG] [LOCAL ] PFH: Trimmed 9619 records to 6340 (keeping 200 days of data) [2025-10-27T20:33:42.341487] [DEBUG] [LOCAL ] PFH: Primary data saved (6340 records). [2025-10-27T20:33:42.341575] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-27T20:33:42.341669] [INFO ] [MAIN ] Update Progress: 1660/2366 symbols completed. PFH took 21.6s. Estimated remaining: 1h 30m 52s. Rate: 7.8 symbols/min [2025-10-27T20:33:42.506613] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:42.545096] [DEBUG] [LOCAL ] PFLT: Loaded 44870 existing records from primary storage. [2025-10-27T20:33:42.545413] [INFO ] [MAIN ] PFLT: Loaded 44870 existing records. [2025-10-27T20:33:42.726148] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:42.726368] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-27T20:33:42.726419] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-27T20:33:42.726859] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-27T20:33:42.726914] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-27T20:33:42.822415] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-27T20:33:43.096752] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:43.600943] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T20:33:43.614914] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-27T20:33:44.414910] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-27T20:33:44.585217] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-27T20:33:44.674568] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T20:33:45.214941] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-27T20:33:46.015019] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-27T20:33:46.488704] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-27T20:33:46.814929] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-27T20:33:47.257707] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T20:33:47.321473] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T20:33:47.614944] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-27T20:33:48.414922] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-27T20:33:48.563891] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:33:49.214946] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-27T20:33:49.698906] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-27T20:33:50.014999] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-27T20:33:50.097872] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T20:33:50.345475] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T20:33:50.350225] [INFO ] [REMOTE ] PFL: Full fetch complete (20748 records). [2025-10-27T20:33:50.350343] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-27T20:33:50.743216] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-27T20:33:50.743301] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-27T20:33:50.743802] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-27T20:33:50.743866] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-27T20:33:50.744467] [DEBUG] [LOCAL ] PFL: Trimmed 20748 records to 14163 (keeping 200 days of data) [2025-10-27T20:33:50.820815] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-27T20:33:50.829675] [DEBUG] [LOCAL ] PFL: Primary data saved (14163 records). [2025-10-27T20:33:50.829878] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-27T20:33:50.829966] [INFO ] [MAIN ] Update Progress: 1661/2366 symbols completed. PFL took 23.7s. Estimated remaining: 1h 30m 45s. Rate: 7.8 symbols/min [2025-10-27T20:33:51.001567] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:51.022592] [DEBUG] [LOCAL ] PFN: Loaded 22498 existing records from primary storage. [2025-10-27T20:33:51.022956] [INFO ] [MAIN ] PFN: Loaded 22498 existing records. [2025-10-27T20:33:51.242111] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:51.243061] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-27T20:33:51.243160] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-27T20:33:51.244958] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T20:33:51.254320] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-27T20:33:51.254673] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-27T20:33:51.297603] [INFO ] [REMOTE ] PFE: Full fetch complete (77603 records). [2025-10-27T20:33:51.328836] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-27T20:33:51.355033] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:33:51.355231] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:33:51.355301] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:33:51.355729] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-27T20:33:51.361220] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-27T20:33:51.366421] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-27T20:33:51.376936] [DEBUG] [LOCAL ] PFE: Deleted derivative data file. [2025-10-27T20:33:51.406989] [INFO ] [MAIN ] Update Progress: 1662/2366 symbols completed. PFE took 42.6s. Estimated remaining: 1h 30m 34s. Rate: 7.8 symbols/min [2025-10-27T20:33:51.616564] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-27T20:33:51.745395] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:51.854062] [DEBUG] [LOCAL ] PFO: Loaded 6154 existing records from primary storage. [2025-10-27T20:33:51.849852] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:51.854633] [INFO ] [MAIN ] PFO: Loaded 6154 existing records. [2025-10-27T20:33:52.114143] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:52.117314] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T20:33:52.117677] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-27T20:33:52.129916] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-27T20:33:52.130378] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-27T20:33:52.130566] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-27T20:33:52.130518] [INFO ] [REMOTE ] PFGC: Full fetch complete (67318 records). [2025-10-27T20:33:52.130759] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-27T20:33:52.216441] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:33:52.272756] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:33:52.286736] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:33:52.297790] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-27T20:33:52.318760] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-27T20:33:52.337212] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-27T20:33:52.365575] [DEBUG] [LOCAL ] PFGC: Deleted derivative data file. [2025-10-27T20:33:52.403116] [INFO ] [MAIN ] Update Progress: 1663/2366 symbols completed. PFGC took 36.0s. Estimated remaining: 1h 30m 23s. Rate: 7.8 symbols/min [2025-10-27T20:33:52.418091] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-27T20:33:52.842352] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:33:52.859506] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:52.912428] [DEBUG] [LOCAL ] PFS: Loaded 36164 existing records from primary storage. [2025-10-27T20:33:52.912839] [INFO ] [MAIN ] PFS: Loaded 36164 existing records. [2025-10-27T20:33:53.050912] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T20:33:53.136077] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:33:53.136250] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-27T20:33:53.136298] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-27T20:33:53.136710] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-27T20:33:53.136766] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-27T20:33:53.224664] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-27T20:33:53.484586] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:33:53.957795] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T20:33:54.014906] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-27T20:33:54.164988] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T20:33:54.814947] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-27T20:33:55.605191] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T20:33:55.614983] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-27T20:33:55.727964] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T20:33:56.414952] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-27T20:33:56.895229] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T20:33:57.214976] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-27T20:33:57.727466] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T20:33:58.014264] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T20:33:58.016562] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-27T20:33:58.814940] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-27T20:33:59.045808] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T20:33:59.614948] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-27T20:34:00.356904] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:34:00.414904] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-27T20:34:00.678353] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-27T20:34:01.214953] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-27T20:34:02.014941] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-27T20:34:02.422177] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-27T20:34:02.724141] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T20:34:02.802957] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T20:34:02.814907] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-27T20:34:03.614944] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-27T20:34:04.414925] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-27T20:34:04.531099] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T20:34:04.550341] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:34:05.214909] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-27T20:34:05.505671] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T20:34:06.015003] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-27T20:34:06.466483] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T20:34:06.814999] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-27T20:34:07.614977] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-27T20:34:07.992852] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T20:34:08.106047] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T20:34:08.415022] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-27T20:34:09.129328] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T20:34:09.214957] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-27T20:34:09.884689] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T20:34:09.908950] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T20:34:10.014989] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-27T20:34:10.814986] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-27T20:34:11.532932] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:34:11.534445] [INFO ] [REMOTE ] PFO: Full fetch complete (7938 records). [2025-10-27T20:34:11.534519] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-27T20:34:11.620036] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-27T20:34:11.925797] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-27T20:34:11.926020] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-27T20:34:11.926377] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-27T20:34:11.926733] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-27T20:34:11.928175] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-27T20:34:11.937255] [DEBUG] [LOCAL ] PFO: Trimmed 7938 records to 6017 (keeping 200 days of data) [2025-10-27T20:34:11.973401] [DEBUG] [LOCAL ] PFO: Primary data saved (6017 records). [2025-10-27T20:34:11.973522] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-27T20:34:11.973600] [INFO ] [MAIN ] Update Progress: 1664/2366 symbols completed. PFO took 20.6s. Estimated remaining: 1h 30m 21s. Rate: 7.8 symbols/min [2025-10-27T20:34:12.145973] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:12.172836] [DEBUG] [LOCAL ] PFSI: Loaded 29674 existing records from primary storage. [2025-10-27T20:34:12.173097] [INFO ] [MAIN ] PFSI: Loaded 29674 existing records. [2025-10-27T20:34:12.350759] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:12.350965] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-27T20:34:12.351013] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-27T20:34:12.351233] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-27T20:34:12.351289] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-27T20:34:12.420039] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-27T20:34:12.711935] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:12.857019] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T20:34:13.214953] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-27T20:34:14.014948] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-27T20:34:14.286319] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T20:34:14.789953] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:34:14.814896] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-27T20:34:15.317385] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T20:34:15.614938] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-27T20:34:16.360423] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T20:34:16.415039] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-27T20:34:17.097859] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T20:34:17.107199] [INFO ] [REMOTE ] PFLT: Full fetch complete (64443 records). [2025-10-27T20:34:17.107301] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-27T20:34:17.220082] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-27T20:34:17.497898] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-27T20:34:17.497976] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-27T20:34:17.498978] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-27T20:34:17.499039] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-27T20:34:17.500287] [DEBUG] [LOCAL ] PFLT: Trimmed 64443 records to 44070 (keeping 200 days of data) [2025-10-27T20:34:17.719754] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T20:34:17.774988] [DEBUG] [LOCAL ] PFLT: Primary data saved (44070 records). [2025-10-27T20:34:17.775110] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-27T20:34:17.775184] [INFO ] [MAIN ] Update Progress: 1665/2366 symbols completed. PFLT took 35.4s. Estimated remaining: 1h 30m 12s. Rate: 7.8 symbols/min [2025-10-27T20:34:17.941873] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:17.942032] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-27T20:34:17.942069] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-27T20:34:17.942201] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-27T20:34:17.942244] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-27T20:34:17.942288] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-27T20:34:17.942320] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-27T20:34:18.020088] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-27T20:34:18.294713] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:18.367301] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T20:34:18.814968] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-27T20:34:19.614931] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-27T20:34:19.785893] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T20:34:20.151338] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T20:34:20.414982] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-27T20:34:21.215001] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-27T20:34:21.598005] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T20:34:21.642862] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-27T20:34:22.015015] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-27T20:34:22.814977] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-27T20:34:22.876490] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T20:34:23.614997] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-27T20:34:23.877053] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T20:34:24.276151] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-27T20:34:24.414978] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-27T20:34:24.720167] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:34:25.214952] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-27T20:34:26.014942] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-27T20:34:26.193992] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T20:34:26.688234] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:34:26.695444] [INFO ] [REMOTE ] PFS: Full fetch complete (52038 records). [2025-10-27T20:34:26.695623] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-27T20:34:26.696472] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:34:26.696700] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:34:26.696772] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:34:26.696854] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-27T20:34:26.697018] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-27T20:34:26.697075] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-27T20:34:26.697300] [DEBUG] [LOCAL ] PFS: Deleted derivative data file. [2025-10-27T20:34:26.697894] [INFO ] [MAIN ] Update Progress: 1666/2366 symbols completed. PFS took 34.3s. Estimated remaining: 1h 30m 5s. Rate: 7.8 symbols/min [2025-10-27T20:34:26.823308] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-27T20:34:26.902367] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:26.905062] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-27T20:34:26.922210] [DEBUG] [LOCAL ] PGP: Loaded 5784 existing records from primary storage. [2025-10-27T20:34:26.922428] [INFO ] [MAIN ] PGP: Loaded 5784 existing records. [2025-10-27T20:34:27.120760] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:27.120961] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-27T20:34:27.121009] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-27T20:34:27.121151] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-27T20:34:27.121189] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-27T20:34:27.476854] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:27.614916] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-27T20:34:28.103287] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T20:34:28.414943] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-27T20:34:28.855793] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T20:34:29.214943] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-27T20:34:29.867702] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T20:34:30.007837] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T20:34:30.014899] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-27T20:34:30.786852] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T20:34:30.814894] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-27T20:34:31.411758] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T20:34:31.614947] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-27T20:34:32.414985] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-27T20:34:32.691209] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T20:34:33.214949] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-27T20:34:34.014945] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-27T20:34:34.373490] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T20:34:34.490808] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T20:34:34.760392] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T20:34:34.814900] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-27T20:34:35.614958] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-27T20:34:36.309749] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-27T20:34:36.414914] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-27T20:34:36.594946] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T20:34:37.097933] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-27T20:34:37.215005] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-27T20:34:38.014953] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-27T20:34:38.250383] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:34:38.256809] [INFO ] [REMOTE ] PFSI: Full fetch complete (41940 records). [2025-10-27T20:34:38.256885] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-27T20:34:38.624981] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-27T20:34:38.625065] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-27T20:34:38.625910] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-27T20:34:38.625972] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-27T20:34:38.626985] [DEBUG] [LOCAL ] PFSI: Trimmed 41940 records to 28901 (keeping 200 days of data) [2025-10-27T20:34:38.801722] [DEBUG] [LOCAL ] PFSI: Primary data saved (28901 records). [2025-10-27T20:34:38.801848] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-27T20:34:38.801923] [INFO ] [MAIN ] Update Progress: 1667/2366 symbols completed. PFSI took 26.8s. Estimated remaining: 1h 29m 59s. Rate: 7.8 symbols/min [2025-10-27T20:34:38.821993] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-27T20:34:38.983763] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:38.998266] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T20:34:39.047608] [DEBUG] [LOCAL ] PGR: Loaded 53642 existing records from primary storage. [2025-10-27T20:34:39.047945] [INFO ] [MAIN ] PGR: Loaded 53642 existing records. [2025-10-27T20:34:39.228458] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:39.228701] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-27T20:34:39.228758] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-27T20:34:39.228951] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-10-27T20:34:39.229006] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-27T20:34:39.597129] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:39.614920] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-27T20:34:39.748627] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:34:40.415019] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-27T20:34:41.214921] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-27T20:34:41.322019] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T20:34:41.632661] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T20:34:42.015023] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-27T20:34:42.815022] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-27T20:34:43.413009] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T20:34:43.418192] [INFO ] [REMOTE ] PFN: Full fetch complete (31418 records). [2025-10-27T20:34:43.418291] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-27T20:34:43.591568] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-27T20:34:43.622014] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-27T20:34:43.833203] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-27T20:34:43.833277] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-27T20:34:43.833922] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-27T20:34:43.833983] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-27T20:34:43.834684] [DEBUG] [LOCAL ] PFN: Trimmed 31418 records to 21859 (keeping 200 days of data) [2025-10-27T20:34:43.956954] [DEBUG] [LOCAL ] PFN: Primary data saved (21859 records). [2025-10-27T20:34:43.957075] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-27T20:34:43.957150] [INFO ] [MAIN ] Update Progress: 1668/2366 symbols completed. PFN took 53.1s. Estimated remaining: 1h 29m 50s. Rate: 7.8 symbols/min [2025-10-27T20:34:44.149435] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:44.190433] [DEBUG] [LOCAL ] PGRE: Loaded 47652 existing records from primary storage. [2025-10-27T20:34:44.190793] [INFO ] [MAIN ] PGRE: Loaded 47652 existing records. [2025-10-27T20:34:44.367933] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:44.368128] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-27T20:34:44.368174] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-27T20:34:44.368406] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-27T20:34:44.368445] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-27T20:34:44.431471] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-27T20:34:44.727161] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:44.733065] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:34:44.870966] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-27T20:34:45.215000] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-27T20:34:46.014955] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-27T20:34:46.604155] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T20:34:46.673186] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-27T20:34:46.814956] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-27T20:34:47.614934] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-27T20:34:48.063787] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T20:34:48.315899] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T20:34:48.317815] [INFO ] [REMOTE ] PGP: Full fetch complete (8041 records). [2025-10-27T20:34:48.317882] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-27T20:34:48.414987] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-27T20:34:48.671964] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-27T20:34:48.672100] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-27T20:34:48.672305] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-27T20:34:48.672342] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-27T20:34:48.672894] [DEBUG] [LOCAL ] PGP: Trimmed 8041 records to 5599 (keeping 200 days of data) [2025-10-27T20:34:48.704715] [DEBUG] [LOCAL ] PGP: Primary data saved (5599 records). [2025-10-27T20:34:48.704798] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-27T20:34:48.704908] [INFO ] [MAIN ] Update Progress: 1669/2366 symbols completed. PGP took 22.0s. Estimated remaining: 1h 29m 41s. Rate: 7.8 symbols/min [2025-10-27T20:34:48.872420] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:48.879742] [DEBUG] [LOCAL ] PGZ: Loaded 5556 existing records from primary storage. [2025-10-27T20:34:48.879919] [INFO ] [MAIN ] PGZ: Loaded 5556 existing records. [2025-10-27T20:34:49.054143] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:49.054339] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-27T20:34:49.054388] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-27T20:34:49.054535] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-27T20:34:49.054590] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-27T20:34:49.218096] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-27T20:34:49.271558] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-27T20:34:49.443980] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:50.014938] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-27T20:34:50.427271] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T20:34:50.718790] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:34:50.814899] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-27T20:34:51.614915] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-27T20:34:51.886449] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T20:34:52.286343] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:34:52.414904] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-27T20:34:52.452459] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:34:53.214932] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-27T20:34:54.014986] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-27T20:34:54.142106] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T20:34:54.238320] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T20:34:54.814984] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-27T20:34:55.478407] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T20:34:55.488488] [INFO ] [REMOTE ] PG: Full fetch complete (77149 records). [2025-10-27T20:34:55.488709] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-27T20:34:55.489874] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-23) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:34:55.489968] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:34:55.490038] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:34:55.490117] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-27T20:34:55.490193] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-27T20:34:55.490231] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-27T20:34:55.490273] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-27T20:34:55.490366] [INFO ] [MAIN ] Update Progress: 1670/2366 symbols completed. PG took 37.7s. Estimated remaining: 1h 29m 33s. Rate: 7.8 symbols/min [2025-10-27T20:34:55.620134] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-27T20:34:55.679728] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:34:55.720537] [DEBUG] [LOCAL ] PH: Loaded 36966 existing records from primary storage. [2025-10-27T20:34:55.720944] [INFO ] [MAIN ] PH: Loaded 36966 existing records. [2025-10-27T20:34:55.913096] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:34:55.913403] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-27T20:34:55.913525] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-27T20:34:55.913866] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-10-27T20:34:55.913918] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-27T20:34:56.305848] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:34:56.367241] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-27T20:34:56.414899] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-27T20:34:56.636926] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T20:34:57.214993] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-27T20:34:58.014988] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-27T20:34:58.409376] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-27T20:34:58.555390] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T20:34:58.604813] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T20:34:58.814930] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-27T20:34:59.614946] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-27T20:35:00.414960] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-27T20:35:01.099602] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:35:01.214934] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-27T20:35:01.334525] [DEBUG] [REMOTE ] PH: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-27T20:35:01.334991] [WARN ] [REMOTE ] PH: No data returned for month 2025-02 [2025-10-27T20:35:01.335121] [FATAL] [REMOTE ] PH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:35:01.335266] [FATAL] [MAIN ] PH: Failed to fetch primary data. [2025-10-27T20:35:01.335551] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:35:01.335756] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-27T20:35:01.335885] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-27T20:35:01.335955] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-27T20:35:01.336118] [DEBUG] [LOCAL ] PH: Deleted derivative data file. [2025-10-27T20:35:01.336240] [INFO ] [MAIN ] Update Progress: 1671/2366 symbols completed. PH took 5.8s. Estimated remaining: 1h 29m 25s. Rate: 7.8 symbols/min [2025-10-27T20:35:01.528482] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:01.561953] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-27T20:35:01.610483] [DEBUG] [LOCAL ] PHG: Loaded 46074 existing records from primary storage. [2025-10-27T20:35:01.610818] [INFO ] [MAIN ] PHG: Loaded 46074 existing records. [2025-10-27T20:35:01.782877] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:01.783041] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-27T20:35:01.783087] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-27T20:35:01.783268] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-27T20:35:01.783306] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-27T20:35:02.020994] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-27T20:35:02.142569] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:02.174143] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T20:35:02.674022] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:35:02.814948] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-27T20:35:03.614924] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-27T20:35:04.414940] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-27T20:35:05.058078] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-27T20:35:05.202554] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:35:05.214896] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-27T20:35:06.014938] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-27T20:35:06.066224] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T20:35:06.814923] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-27T20:35:06.888832] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:35:06.905165] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T20:35:07.614983] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-27T20:35:08.307350] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T20:35:08.414988] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-27T20:35:08.996051] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T20:35:09.146547] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-27T20:35:09.214973] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-27T20:35:09.835223] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T20:35:09.845305] [INFO ] [REMOTE ] PGR: Full fetch complete (76411 records). [2025-10-27T20:35:09.845455] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-27T20:35:09.846248] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:35:09.846338] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:35:09.846382] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:35:09.846420] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-27T20:35:09.846477] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-27T20:35:09.846511] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-27T20:35:09.846770] [DEBUG] [LOCAL ] PGR: Deleted derivative data file. [2025-10-27T20:35:09.846871] [INFO ] [MAIN ] Update Progress: 1672/2366 symbols completed. PGR took 31.0s. Estimated remaining: 1h 29m 17s. Rate: 7.8 symbols/min [2025-10-27T20:35:10.020741] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-27T20:35:10.024438] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:10.039976] [DEBUG] [LOCAL ] PHI: Loaded 15370 existing records from primary storage. [2025-10-27T20:35:10.040202] [INFO ] [MAIN ] PHI: Loaded 15370 existing records. [2025-10-27T20:35:10.231714] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:10.231945] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-27T20:35:10.231992] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-27T20:35:10.232197] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-27T20:35:10.232236] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-27T20:35:10.592495] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:10.814945] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-27T20:35:11.500630] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T20:35:11.614926] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-27T20:35:12.238507] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T20:35:12.414998] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-27T20:35:13.167351] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T20:35:13.214916] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-27T20:35:13.862291] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T20:35:14.014932] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-27T20:35:14.814929] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-27T20:35:14.854688] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T20:35:15.225636] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T20:35:15.614910] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-27T20:35:15.731559] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T20:35:16.414949] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-27T20:35:17.214938] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-27T20:35:17.722098] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-27T20:35:17.954597] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T20:35:18.014896] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-27T20:35:18.149098] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T20:35:18.157777] [INFO ] [REMOTE ] PGRE: Full fetch complete (64703 records). [2025-10-27T20:35:18.157875] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-27T20:35:18.533955] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-27T20:35:18.534043] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-27T20:35:18.535047] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-27T20:35:18.535107] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-27T20:35:18.536415] [DEBUG] [LOCAL ] PGRE: Trimmed 64703 records to 46857 (keeping 200 days of data) [2025-10-27T20:35:18.794182] [DEBUG] [LOCAL ] PGRE: Primary data saved (46857 records). [2025-10-27T20:35:18.794294] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-27T20:35:18.794734] [INFO ] [MAIN ] Update Progress: 1673/2366 symbols completed. PGRE took 34.8s. Estimated remaining: 1h 29m 10s. Rate: 7.8 symbols/min [2025-10-27T20:35:18.824112] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-27T20:35:18.985093] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T20:35:18.991603] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:19.033483] [DEBUG] [LOCAL ] PHIN: Loaded 31835 existing records from primary storage. [2025-10-27T20:35:19.033823] [INFO ] [MAIN ] PHIN: Loaded 31835 existing records. [2025-10-27T20:35:19.209229] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:19.209443] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-27T20:35:19.209489] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-27T20:35:19.209696] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-27T20:35:19.209751] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-27T20:35:19.370939] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:35:19.433589] [INFO ] [REMOTE ] PGZ: Full fetch complete (8076 records). [2025-10-27T20:35:19.460098] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-27T20:35:19.620506] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-27T20:35:19.691318] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:19.931855] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-27T20:35:19.931933] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-27T20:35:19.932152] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-27T20:35:19.932190] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-27T20:35:19.932564] [DEBUG] [LOCAL ] PGZ: Trimmed 8076 records to 5422 (keeping 200 days of data) [2025-10-27T20:35:19.964401] [DEBUG] [LOCAL ] PGZ: Primary data saved (5422 records). [2025-10-27T20:35:19.964517] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-27T20:35:19.964592] [INFO ] [MAIN ] Update Progress: 1674/2366 symbols completed. PGZ took 31.3s. Estimated remaining: 1h 28m 60s. Rate: 7.8 symbols/min [2025-10-27T20:35:20.128032] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:20.153996] [DEBUG] [LOCAL ] PHK: Loaded 27092 existing records from primary storage. [2025-10-27T20:35:20.154247] [INFO ] [MAIN ] PHK: Loaded 27092 existing records. [2025-10-27T20:35:20.323912] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:20.324110] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-27T20:35:20.324155] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-27T20:35:20.324326] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-27T20:35:20.324363] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-27T20:35:20.420433] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-27T20:35:20.671504] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:21.215047] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-27T20:35:21.500917] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T20:35:21.536506] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-27T20:35:22.014955] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-27T20:35:22.646020] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T20:35:22.814975] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-27T20:35:23.591121] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T20:35:23.614900] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-27T20:35:23.898483] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T20:35:24.414980] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-27T20:35:24.766491] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T20:35:25.214937] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-27T20:35:25.598607] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T20:35:26.020634] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-27T20:35:26.027400] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T20:35:26.814967] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-27T20:35:27.614964] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-27T20:35:28.414937] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-27T20:35:28.714252] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T20:35:29.215011] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-27T20:35:29.314625] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-10-27T20:35:29.478187] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T20:35:30.014941] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-27T20:35:30.410918] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-27T20:35:30.480133] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T20:35:30.814928] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-27T20:35:31.414267] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T20:35:31.615002] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-27T20:35:32.028050] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T20:35:32.415004] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-27T20:35:32.980147] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T20:35:33.214938] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-27T20:35:33.305046] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T20:35:33.311077] [INFO ] [REMOTE ] PHI: Full fetch complete (21461 records). [2025-10-27T20:35:33.311257] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-27T20:35:33.704084] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-27T20:35:33.704192] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-27T20:35:33.704800] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-27T20:35:33.704866] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-27T20:35:33.705675] [DEBUG] [LOCAL ] PHI: Trimmed 21461 records to 15075 (keeping 200 days of data) [2025-10-27T20:35:33.810375] [DEBUG] [LOCAL ] PHI: Primary data saved (15075 records). [2025-10-27T20:35:33.810507] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-27T20:35:33.810585] [INFO ] [MAIN ] Update Progress: 1675/2366 symbols completed. PHI took 24.0s. Estimated remaining: 1h 28m 54s. Rate: 7.8 symbols/min [2025-10-27T20:35:33.976344] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:34.021056] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-27T20:35:34.024363] [DEBUG] [LOCAL ] PHM: Loaded 52443 existing records from primary storage. [2025-10-27T20:35:34.024775] [INFO ] [MAIN ] PHM: Loaded 52443 existing records. [2025-10-27T20:35:34.207552] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:34.207779] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-27T20:35:34.207830] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-27T20:35:34.208088] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-10-27T20:35:34.208130] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-27T20:35:34.564385] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:34.585327] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T20:35:34.593258] [INFO ] [REMOTE ] PHG: Full fetch complete (65816 records). [2025-10-27T20:35:34.593381] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-27T20:35:34.820033] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-27T20:35:34.982827] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-27T20:35:34.982907] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-27T20:35:34.984008] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-27T20:35:34.984070] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-27T20:35:34.985392] [DEBUG] [LOCAL ] PHG: Trimmed 65816 records to 45242 (keeping 200 days of data) [2025-10-27T20:35:35.124816] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T20:35:35.275977] [DEBUG] [LOCAL ] PHG: Primary data saved (45242 records). [2025-10-27T20:35:35.276102] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-27T20:35:35.276182] [INFO ] [MAIN ] Update Progress: 1676/2366 symbols completed. PHG took 33.9s. Estimated remaining: 1h 28m 44s. Rate: 7.8 symbols/min [2025-10-27T20:35:35.483108] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:35:35.517349] [DEBUG] [LOCAL ] PHR: Loaded 38423 existing records from primary storage. [2025-10-27T20:35:35.517621] [INFO ] [MAIN ] PHR: Loaded 38423 existing records. [2025-10-27T20:35:35.620152] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-27T20:35:35.693924] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:35:35.694123] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-27T20:35:35.694174] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-27T20:35:35.694549] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-27T20:35:35.694618] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-27T20:35:36.041630] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:35:36.371425] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T20:35:36.414910] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-27T20:35:37.043302] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T20:35:37.214952] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-27T20:35:37.938796] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T20:35:38.014917] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-27T20:35:38.814940] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-27T20:35:38.875300] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T20:35:39.614925] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-27T20:35:39.722457] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T20:35:40.095235] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-27T20:35:40.414944] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-27T20:35:40.554597] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T20:35:41.214961] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-27T20:35:41.514746] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T20:35:42.014986] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-27T20:35:42.657521] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:35:42.814924] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-27T20:35:43.614959] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-27T20:35:44.098332] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T20:35:44.414953] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-27T20:35:44.491879] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T20:35:45.216872] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-27T20:35:45.219598] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:35:45.711073] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T20:35:46.014936] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-27T20:35:46.332000] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T20:35:46.814992] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-27T20:35:46.946201] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:35:47.614967] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-27T20:35:47.747310] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:35:48.414964] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-27T20:35:49.089689] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T20:35:49.214958] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-27T20:35:49.548588] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T20:35:50.014963] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-27T20:35:50.769551] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T20:35:50.814918] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-27T20:35:51.160684] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:35:51.166693] [INFO ] [REMOTE ] PHK: Full fetch complete (39427 records). [2025-10-27T20:35:51.166786] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-27T20:35:51.551482] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-27T20:35:51.551568] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-27T20:35:51.552400] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-27T20:35:51.552479] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-27T20:35:51.553599] [DEBUG] [LOCAL ] PHK: Trimmed 39427 records to 26352 (keeping 200 days of data) [2025-10-27T20:35:51.635248] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-27T20:35:51.703960] [DEBUG] [LOCAL ] PHK: Primary data saved (26352 records). [2025-10-27T20:35:51.704075] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-27T20:35:51.704148] [INFO ] [MAIN ] Update Progress: 1677/2366 symbols completed. PHK took 31.7s. Estimated remaining: 1h 28m 40s. Rate: 7.8 symbols/min [2025-10-27T20:35:52.290948] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T20:35:52.414930] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-27T20:35:52.831594] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:35:53.214953] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-27T20:35:53.347287] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T20:35:53.352582] [INFO ] [REMOTE ] PHIN: Full fetch complete (47171 records). [2025-10-27T20:35:53.352701] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-27T20:35:53.353862] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:35:53.353945] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:35:53.353987] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:35:53.354050] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-27T20:35:53.354112] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-27T20:35:53.354146] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-27T20:35:53.354289] [DEBUG] [LOCAL ] PHIN: Deleted derivative data file. [2025-10-27T20:35:53.354375] [INFO ] [MAIN ] Update Progress: 1678/2366 symbols completed. PHIN took 34.6s. Estimated remaining: 1h 28m 30s. Rate: 7.8 symbols/min [2025-10-27T20:35:54.014949] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-27T20:35:55.199565] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T20:35:55.210439] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-27T20:35:55.269312] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T20:35:55.614939] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-27T20:35:56.980823] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T20:35:56.991226] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-27T20:35:57.194112] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T20:35:57.214905] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-27T20:35:58.504330] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T20:35:58.516557] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-27T20:35:58.644553] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T20:35:58.652451] [INFO ] [REMOTE ] PHR: Full fetch complete (53414 records). [2025-10-27T20:35:58.652560] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-27T20:35:59.027510] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-27T20:35:59.027599] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-27T20:35:59.028636] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-27T20:35:59.028719] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-27T20:35:59.029830] [DEBUG] [LOCAL ] PHR: Trimmed 53414 records to 37683 (keeping 200 days of data) [2025-10-27T20:35:59.245117] [DEBUG] [LOCAL ] PHR: Primary data saved (37683 records). [2025-10-27T20:35:59.245251] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-27T20:35:59.245327] [INFO ] [MAIN ] Update Progress: 1679/2366 symbols completed. PHR took 24.0s. Estimated remaining: 1h 28m 21s. Rate: 7.8 symbols/min [2025-10-27T20:36:00.211090] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T20:36:00.222085] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-27T20:36:01.956493] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T20:36:01.970632] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-27T20:36:03.162018] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T20:36:03.174860] [INFO ] [REMOTE ] PHM: Full fetch complete (74867 records). [2025-10-27T20:36:03.175028] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-27T20:36:03.175821] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:36:03.175904] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:36:03.175947] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:36:03.175984] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-27T20:36:03.176068] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-27T20:36:03.176124] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-27T20:36:03.176257] [DEBUG] [LOCAL ] PHM: Deleted derivative data file. [2025-10-27T20:36:03.176336] [INFO ] [MAIN ] Update Progress: 1680/2366 symbols completed. PHM took 29.4s. Estimated remaining: 1h 28m 12s. Rate: 7.8 symbols/min [2025-10-27T20:36:03.759598] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:03.803926] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:03.838972] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:03.888235] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:03.892201] [DEBUG] [LOCAL ] PIM: Loaded 4927 existing records from primary storage. [2025-10-27T20:36:03.892681] [INFO ] [MAIN ] PIM: Loaded 4927 existing records. [2025-10-27T20:36:04.005083] [DEBUG] [LOCAL ] PINE: Loaded 14657 existing records from primary storage. [2025-10-27T20:36:04.009074] [INFO ] [MAIN ] PINE: Loaded 14657 existing records. [2025-10-27T20:36:04.186128] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:04.249666] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-27T20:36:04.251849] [DEBUG] [LOCAL ] PII: Loaded 49333 existing records from primary storage. [2025-10-27T20:36:04.257626] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-27T20:36:04.269076] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-10-27T20:36:04.268342] [INFO ] [MAIN ] PII: Loaded 49333 existing records. [2025-10-27T20:36:04.274722] [INFO ] [MAIN ] PINS: Loaded 54473 existing records. [2025-10-27T20:36:04.350106] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-27T20:36:04.399806] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:04.393142] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-27T20:36:04.457729] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-27T20:36:04.473554] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-27T20:36:04.583003] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-27T20:36:04.666264] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-27T20:36:05.022861] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:05.077241] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-27T20:36:05.159886] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-27T20:36:05.153119] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:05.203324] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-27T20:36:05.233175] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-27T20:36:05.253033] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-27T20:36:05.286925] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-27T20:36:05.303118] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-27T20:36:05.361375] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-27T20:36:05.720002] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:05.785154] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-27T20:36:05.784804] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:05.828303] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-27T20:36:06.261367] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:06.267554] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-27T20:36:06.346749] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:06.347110] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-27T20:36:06.351851] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-27T20:36:06.353188] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-27T20:36:06.864947] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T20:36:06.868615] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-27T20:36:07.149847] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:36:07.151226] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-27T20:36:07.903892] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T20:36:07.905590] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-27T20:36:08.369527] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-27T20:36:08.379579] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-27T20:36:08.473191] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T20:36:08.477058] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-27T20:36:08.515282] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T20:36:08.517153] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-27T20:36:08.522363] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-27T20:36:09.214959] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-27T20:36:09.305915] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T20:36:09.359045] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T20:36:10.014923] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-27T20:36:10.814922] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-27T20:36:10.837883] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:36:10.954802] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T20:36:11.334743] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T20:36:11.614996] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-27T20:36:11.671575] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (3.29 seconds). [2025-10-27T20:36:12.414995] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-27T20:36:13.131218] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T20:36:13.214991] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-27T20:36:13.842769] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T20:36:14.014985] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-27T20:36:14.814995] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-27T20:36:15.407610] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T20:36:15.614924] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-27T20:36:15.671961] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T20:36:16.414972] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-27T20:36:17.151011] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T20:36:17.152378] [INFO ] [REMOTE ] PIM: Full fetch complete (6509 records). [2025-10-27T20:36:17.152445] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-27T20:36:17.220550] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-27T20:36:17.473551] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (5.86 seconds). [2025-10-27T20:36:17.577457] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-27T20:36:17.577569] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-27T20:36:17.577773] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-27T20:36:17.577846] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-27T20:36:17.578379] [DEBUG] [LOCAL ] PIM: Trimmed 6509 records to 4814 (keeping 200 days of data) [2025-10-27T20:36:17.605981] [DEBUG] [LOCAL ] PIM: Primary data saved (4814 records). [2025-10-27T20:36:17.606067] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-27T20:36:17.606138] [INFO ] [MAIN ] Update Progress: 1681/2366 symbols completed. PIM took 14.4s. Estimated remaining: 1h 28m 7s. Rate: 7.8 symbols/min [2025-10-27T20:36:17.781050] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-27T20:36:17.817995] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:17.834075] [DEBUG] [LOCAL ] PIPR: Loaded 15121 existing records from primary storage. [2025-10-27T20:36:17.834289] [INFO ] [MAIN ] PIPR: Loaded 15121 existing records. [2025-10-27T20:36:18.005938] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:18.006129] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-27T20:36:18.006208] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-27T20:36:18.006459] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-27T20:36:18.006523] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-27T20:36:18.020145] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-27T20:36:18.360308] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:18.369479] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:36:18.814995] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-27T20:36:19.614954] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-27T20:36:20.057804] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T20:36:20.414934] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-27T20:36:20.547261] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T20:36:21.214991] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-27T20:36:21.684216] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T20:36:22.014933] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-27T20:36:22.211374] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T20:36:22.638174] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-27T20:36:22.814946] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-27T20:36:23.618579] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-27T20:36:23.621699] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T20:36:23.700614] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:36:24.414933] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-27T20:36:25.214972] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-27T20:36:25.699025] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T20:36:26.015035] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-27T20:36:26.033890] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:36:26.370570] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T20:36:26.814939] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-27T20:36:27.222161] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T20:36:27.614965] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-27T20:36:28.362883] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T20:36:28.414904] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-27T20:36:29.063960] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T20:36:29.214912] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-27T20:36:29.228317] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T20:36:30.014975] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-27T20:36:30.815006] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-27T20:36:31.254344] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T20:36:31.452404] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-27T20:36:31.614903] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-27T20:36:31.696383] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:36:31.699888] [INFO ] [REMOTE ] PINE: Full fetch complete (21209 records). [2025-10-27T20:36:31.699958] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-27T20:36:32.055901] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-27T20:36:32.055976] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-27T20:36:32.056486] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-27T20:36:32.056527] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-27T20:36:32.057146] [DEBUG] [LOCAL ] PINE: Trimmed 21209 records to 14362 (keeping 200 days of data) [2025-10-27T20:36:32.141108] [DEBUG] [LOCAL ] PINE: Primary data saved (14362 records). [2025-10-27T20:36:32.141226] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-27T20:36:32.141308] [INFO ] [MAIN ] Update Progress: 1682/2366 symbols completed. PINE took 29.0s. Estimated remaining: 1h 28m 2s. Rate: 7.8 symbols/min [2025-10-27T20:36:32.304971] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:32.324704] [DEBUG] [LOCAL ] PJT: Loaded 21384 existing records from primary storage. [2025-10-27T20:36:32.324930] [INFO ] [MAIN ] PJT: Loaded 21384 existing records. [2025-10-27T20:36:32.420115] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-27T20:36:32.502511] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:32.502729] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-27T20:36:32.502779] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-27T20:36:32.503051] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-27T20:36:32.503108] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-27T20:36:32.843710] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:33.214961] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-27T20:36:33.585030] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T20:36:34.014906] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-27T20:36:34.310866] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T20:36:34.368552] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-27T20:36:34.814962] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-27T20:36:35.053913] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T20:36:35.615027] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-27T20:36:36.415052] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-27T20:36:36.695401] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:36:37.066006] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:36:37.214903] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-27T20:36:38.014962] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-27T20:36:38.332146] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T20:36:38.342316] [INFO ] [REMOTE ] PINS: Full fetch complete (77871 records). [2025-10-27T20:36:38.342446] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-27T20:36:38.659339] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T20:36:38.778118] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-27T20:36:38.778191] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-27T20:36:38.779250] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-27T20:36:38.779313] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-27T20:36:38.780772] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 53693 (keeping 200 days of data) [2025-10-27T20:36:38.828271] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-27T20:36:38.967259] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T20:36:39.106750] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-10-27T20:36:39.106877] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-27T20:36:39.106952] [INFO ] [MAIN ] Update Progress: 1683/2366 symbols completed. PINS took 35.9s. Estimated remaining: 1h 27m 54s. Rate: 7.8 symbols/min [2025-10-27T20:36:39.272755] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:39.318178] [DEBUG] [LOCAL ] PK: Loaded 53520 existing records from primary storage. [2025-10-27T20:36:39.318469] [INFO ] [MAIN ] PK: Loaded 53520 existing records. [2025-10-27T20:36:39.489221] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:39.489443] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-27T20:36:39.489496] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-27T20:36:39.489890] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-27T20:36:39.489956] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-27T20:36:39.624593] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-27T20:36:39.845055] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:40.414897] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-27T20:36:40.444401] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T20:36:40.744344] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T20:36:41.214939] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-27T20:36:41.911382] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T20:36:42.014948] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-27T20:36:42.814973] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-27T20:36:42.869852] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T20:36:42.906375] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T20:36:42.915587] [INFO ] [REMOTE ] PII: Full fetch complete (70928 records). [2025-10-27T20:36:42.915809] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-27T20:36:42.916602] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:36:42.916775] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:36:42.916820] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:36:42.916860] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-27T20:36:42.916919] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-27T20:36:42.916954] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-27T20:36:42.917094] [DEBUG] [LOCAL ] PII: Deleted derivative data file. [2025-10-27T20:36:42.917725] [INFO ] [MAIN ] Update Progress: 1684/2366 symbols completed. PII took 39.7s. Estimated remaining: 1h 27m 45s. Rate: 7.8 symbols/min [2025-10-27T20:36:43.121705] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:43.143214] [DEBUG] [LOCAL ] PKE: Loaded 14464 existing records from primary storage. [2025-10-27T20:36:43.143544] [INFO ] [MAIN ] PKE: Loaded 14464 existing records. [2025-10-27T20:36:43.404487] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:43.404753] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-27T20:36:43.404807] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-27T20:36:43.405024] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-27T20:36:43.405063] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-27T20:36:43.620601] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-27T20:36:43.813175] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:44.159316] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T20:36:44.414990] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-27T20:36:44.669969] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T20:36:45.214937] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-27T20:36:45.248212] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T20:36:45.251418] [INFO ] [REMOTE ] PIPR: Full fetch complete (20897 records). [2025-10-27T20:36:45.251503] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-27T20:36:45.251950] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:36:45.252029] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:36:45.252094] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:36:45.252163] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-27T20:36:45.252223] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-27T20:36:45.252256] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-27T20:36:45.252397] [DEBUG] [LOCAL ] PIPR: Deleted derivative data file. [2025-10-27T20:36:45.252482] [INFO ] [MAIN ] Update Progress: 1685/2366 symbols completed. PIPR took 27.6s. Estimated remaining: 1h 27m 35s. Rate: 7.8 symbols/min [2025-10-27T20:36:45.422328] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:36:45.457039] [DEBUG] [LOCAL ] PKG: Loaded 39291 existing records from primary storage. [2025-10-27T20:36:45.457340] [INFO ] [MAIN ] PKG: Loaded 39291 existing records. [2025-10-27T20:36:45.629960] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:36:45.630139] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-27T20:36:45.630184] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-27T20:36:45.630409] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-10-27T20:36:45.630446] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-27T20:36:45.977572] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:36:46.014920] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-27T20:36:46.814935] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-27T20:36:47.039351] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T20:36:47.429922] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T20:36:47.597492] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T20:36:47.614914] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-27T20:36:48.414973] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-27T20:36:48.666863] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T20:36:49.214980] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-27T20:36:50.014964] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-27T20:36:50.254759] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T20:36:50.494310] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T20:36:50.814976] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-27T20:36:51.049140] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T20:36:51.614961] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-27T20:36:52.414994] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-27T20:36:52.721712] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-27T20:36:53.044935] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T20:36:53.214936] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-27T20:36:53.585291] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T20:36:54.015013] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-27T20:36:54.708421] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T20:36:54.814935] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-27T20:36:54.997489] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T20:36:55.614931] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-27T20:36:56.254987] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T20:36:56.414922] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-27T20:36:57.214993] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-27T20:36:57.715934] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-27T20:36:58.014921] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-27T20:36:58.170971] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-27T20:36:58.188731] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T20:36:58.814941] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-27T20:36:59.614939] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-27T20:36:59.917484] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T20:37:00.103025] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T20:37:00.414939] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-27T20:37:00.876797] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T20:37:01.214940] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-27T20:37:02.014995] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-27T20:37:02.152423] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T20:37:02.265776] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T20:37:02.269844] [INFO ] [REMOTE ] PJT: Full fetch complete (31876 records). [2025-10-27T20:37:02.269968] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-27T20:37:02.270516] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:37:02.270599] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:37:02.270663] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:37:02.270735] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-27T20:37:02.270797] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-27T20:37:02.270832] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-27T20:37:02.270949] [DEBUG] [LOCAL ] PJT: Deleted derivative data file. [2025-10-27T20:37:02.271027] [INFO ] [MAIN ] Update Progress: 1686/2366 symbols completed. PJT took 30.1s. Estimated remaining: 1h 27m 31s. Rate: 7.8 symbols/min [2025-10-27T20:37:02.438566] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:02.457034] [DEBUG] [LOCAL ] PKST: Loaded 18434 existing records from primary storage. [2025-10-27T20:37:02.457301] [INFO ] [MAIN ] PKST: Loaded 18434 existing records. [2025-10-27T20:37:02.631668] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:02.631853] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-27T20:37:02.631901] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-27T20:37:02.632144] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-27T20:37:02.632182] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-27T20:37:02.743859] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T20:37:02.820438] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-27T20:37:02.997132] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:03.614946] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-27T20:37:04.414968] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-27T20:37:04.727323] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T20:37:04.902767] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T20:37:05.214936] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-27T20:37:05.908801] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:37:06.014971] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-27T20:37:06.814915] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-27T20:37:07.154054] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T20:37:07.506268] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T20:37:07.614932] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-27T20:37:07.739857] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:37:08.414942] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-27T20:37:08.969438] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T20:37:09.214952] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-27T20:37:09.546825] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:37:09.933754] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T20:37:10.014996] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-27T20:37:10.814985] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-27T20:37:10.939358] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T20:37:10.946796] [INFO ] [REMOTE ] PKG: Full fetch complete (57464 records). [2025-10-27T20:37:10.946946] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-27T20:37:10.947729] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:37:10.947812] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:37:10.947862] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:37:10.947951] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-27T20:37:10.948035] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-27T20:37:10.948085] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-27T20:37:10.948238] [DEBUG] [LOCAL ] PKG: Deleted derivative data file. [2025-10-27T20:37:10.948747] [INFO ] [MAIN ] Update Progress: 1687/2366 symbols completed. PKG took 25.7s. Estimated remaining: 1h 27m 24s. Rate: 7.8 symbols/min [2025-10-27T20:37:11.121803] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:11.144323] [DEBUG] [LOCAL ] PKX: Loaded 22906 existing records from primary storage. [2025-10-27T20:37:11.144558] [INFO ] [MAIN ] PKX: Loaded 22906 existing records. [2025-10-27T20:37:11.329898] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:11.330091] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-27T20:37:11.330136] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-27T20:37:11.330337] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-27T20:37:11.330379] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-27T20:37:11.620093] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-27T20:37:11.711445] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T20:37:11.754880] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:11.755930] [INFO ] [REMOTE ] PK: Full fetch complete (76153 records). [2025-10-27T20:37:11.756098] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-27T20:37:11.757002] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:37:11.757086] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:37:11.757134] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:37:11.757217] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-27T20:37:11.757296] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-27T20:37:11.757332] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-27T20:37:11.757481] [DEBUG] [LOCAL ] PK: Deleted derivative data file. [2025-10-27T20:37:11.757570] [INFO ] [MAIN ] Update Progress: 1688/2366 symbols completed. PK took 32.7s. Estimated remaining: 1h 27m 13s. Rate: 7.8 symbols/min [2025-10-27T20:37:11.921619] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:11.968345] [DEBUG] [LOCAL ] PL: Loaded 53992 existing records from primary storage. [2025-10-27T20:37:11.968696] [INFO ] [MAIN ] PL: Loaded 53992 existing records. [2025-10-27T20:37:12.144563] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:12.144773] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-27T20:37:12.144822] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-27T20:37:12.145070] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-27T20:37:12.145110] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-27T20:37:12.420818] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-27T20:37:12.499233] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:12.582991] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-27T20:37:13.214946] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-27T20:37:13.837236] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T20:37:14.014943] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-27T20:37:14.101814] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T20:37:14.814956] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-27T20:37:15.614951] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-27T20:37:15.808874] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:37:16.252143] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T20:37:16.414936] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-27T20:37:16.750278] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T20:37:17.214933] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-27T20:37:17.366492] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T20:37:18.015004] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-27T20:37:18.814987] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-27T20:37:19.166977] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:37:19.411745] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-27T20:37:19.614939] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-27T20:37:19.989357] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T20:37:20.414919] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-27T20:37:20.629719] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T20:37:21.215005] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-27T20:37:22.015001] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-27T20:37:22.055251] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T20:37:22.060949] [INFO ] [REMOTE ] PKE: Full fetch complete (18528 records). [2025-10-27T20:37:22.061037] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-27T20:37:22.435336] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-27T20:37:22.435493] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-27T20:37:22.436048] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-27T20:37:22.436153] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-27T20:37:22.437058] [DEBUG] [LOCAL ] PKE: Trimmed 18528 records to 14213 (keeping 200 days of data) [2025-10-27T20:37:22.546205] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T20:37:22.566351] [DEBUG] [LOCAL ] PKE: Primary data saved (14213 records). [2025-10-27T20:37:22.566549] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-27T20:37:22.566696] [INFO ] [MAIN ] Update Progress: 1689/2366 symbols completed. PKE took 39.6s. Estimated remaining: 1h 27m 7s. Rate: 7.8 symbols/min [2025-10-27T20:37:22.731363] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:22.780294] [DEBUG] [LOCAL ] PLD: Loaded 54188 existing records from primary storage. [2025-10-27T20:37:22.780626] [INFO ] [MAIN ] PLD: Loaded 54188 existing records. [2025-10-27T20:37:22.822117] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-27T20:37:22.955208] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:22.955494] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-27T20:37:22.955543] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-27T20:37:22.955842] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-10-27T20:37:22.955897] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-27T20:37:23.310864] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:23.461601] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T20:37:23.613155] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T20:37:23.616593] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-27T20:37:24.414951] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-27T20:37:24.531137] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T20:37:25.214989] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-27T20:37:26.014953] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-27T20:37:26.322704] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T20:37:26.411984] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T20:37:26.814981] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-27T20:37:27.530073] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T20:37:27.614982] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-27T20:37:28.414976] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-27T20:37:28.612104] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T20:37:28.935714] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-27T20:37:29.214944] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-27T20:37:30.014978] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-27T20:37:30.184623] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T20:37:30.815059] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-27T20:37:31.132320] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T20:37:31.614939] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-27T20:37:32.100199] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-10-27T20:37:32.415262] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-27T20:37:32.420996] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T20:37:32.774689] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T20:37:33.215003] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-27T20:37:34.014967] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-27T20:37:34.063940] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T20:37:34.351882] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T20:37:34.814934] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-27T20:37:35.614999] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-27T20:37:35.847815] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T20:37:35.950958] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T20:37:35.955141] [INFO ] [REMOTE ] PKST: Full fetch complete (28886 records). [2025-10-27T20:37:35.955222] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-27T20:37:36.314454] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-27T20:37:36.314542] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-27T20:37:36.315161] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-27T20:37:36.315223] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-27T20:37:36.316096] [DEBUG] [LOCAL ] PKST: Trimmed 28886 records to 17944 (keeping 200 days of data) [2025-10-27T20:37:36.422118] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-27T20:37:36.422008] [DEBUG] [LOCAL ] PKST: Primary data saved (17944 records). [2025-10-27T20:37:36.422596] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-27T20:37:36.422748] [INFO ] [MAIN ] Update Progress: 1690/2366 symbols completed. PKST took 34.2s. Estimated remaining: 1h 27m 1s. Rate: 7.8 symbols/min [2025-10-27T20:37:36.591122] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:36.635056] [DEBUG] [LOCAL ] PLNT: Loaded 48705 existing records from primary storage. [2025-10-27T20:37:36.635354] [INFO ] [MAIN ] PLNT: Loaded 48705 existing records. [2025-10-27T20:37:36.823169] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:36.824285] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T20:37:36.824461] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-27T20:37:36.828400] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-27T20:37:36.829056] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-27T20:37:36.829023] [INFO ] [REMOTE ] PKX: Full fetch complete (35787 records). [2025-10-27T20:37:36.829230] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-27T20:37:36.829169] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-27T20:37:37.215314] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-27T20:37:37.554562] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:37.603681] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-27T20:37:37.603768] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-27T20:37:37.604541] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-27T20:37:37.604624] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-27T20:37:37.605426] [DEBUG] [LOCAL ] PKX: Trimmed 35787 records to 22152 (keeping 200 days of data) [2025-10-27T20:37:37.737613] [DEBUG] [LOCAL ] PKX: Primary data saved (22152 records). [2025-10-27T20:37:37.737766] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-27T20:37:37.737850] [INFO ] [MAIN ] Update Progress: 1691/2366 symbols completed. PKX took 26.8s. Estimated remaining: 1h 26m 51s. Rate: 7.8 symbols/min [2025-10-27T20:37:37.912785] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:37.930621] [DEBUG] [LOCAL ] PLOW: Loaded 19817 existing records from primary storage. [2025-10-27T20:37:37.930871] [INFO ] [MAIN ] PLOW: Loaded 19817 existing records. [2025-10-27T20:37:38.022727] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-27T20:37:38.118493] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:38.118754] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-27T20:37:38.118816] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-27T20:37:38.119079] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-27T20:37:38.119144] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-27T20:37:38.484614] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:38.554171] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-27T20:37:38.814954] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-27T20:37:39.179598] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-27T20:37:39.610432] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T20:37:39.615121] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-27T20:37:39.916375] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T20:37:40.414944] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-27T20:37:40.752248] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T20:37:41.214945] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-27T20:37:42.014965] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-27T20:37:42.163785] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T20:37:42.783677] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T20:37:42.814917] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-27T20:37:43.614949] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-27T20:37:43.659121] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-27T20:37:43.815262] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T20:37:44.415022] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-27T20:37:45.214970] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-27T20:37:45.798502] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T20:37:45.835495] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-27T20:37:46.014928] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-27T20:37:46.814916] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-27T20:37:47.614940] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-27T20:37:48.100367] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-27T20:37:48.246547] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T20:37:48.414954] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-27T20:37:48.560688] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T20:37:48.768101] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T20:37:49.214992] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-27T20:37:50.014925] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-27T20:37:50.591290] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T20:37:50.814983] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-27T20:37:51.151868] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-27T20:37:51.213024] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:37:51.614979] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-27T20:37:52.415034] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-27T20:37:52.775270] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T20:37:53.203144] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-27T20:37:53.213585] [INFO ] [REMOTE ] PL: Full fetch complete (77138 records). [2025-10-27T20:37:53.213783] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-27T20:37:53.226008] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-27T20:37:53.616752] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-27T20:37:53.616849] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-27T20:37:53.617979] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-27T20:37:53.618047] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-27T20:37:53.619526] [DEBUG] [LOCAL ] PL: Trimmed 77138 records to 53218 (keeping 200 days of data) [2025-10-27T20:37:53.946528] [DEBUG] [LOCAL ] PL: Primary data saved (53218 records). [2025-10-27T20:37:53.946739] [INFO ] [MAIN ] PL: Full history saved. [2025-10-27T20:37:53.946829] [INFO ] [MAIN ] Update Progress: 1692/2366 symbols completed. PL took 42.2s. Estimated remaining: 1h 26m 47s. Rate: 7.8 symbols/min [2025-10-27T20:37:54.024106] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-27T20:37:54.120161] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:54.154762] [DEBUG] [LOCAL ] PLYM: Loaded 34879 existing records from primary storage. [2025-10-27T20:37:54.155031] [INFO ] [MAIN ] PLYM: Loaded 34879 existing records. [2025-10-27T20:37:54.334141] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:54.334576] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-27T20:37:54.334625] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-27T20:37:54.334851] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-27T20:37:54.334908] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-27T20:37:54.447619] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T20:37:54.708930] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:54.755045] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-27T20:37:54.814914] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-27T20:37:55.353777] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:37:55.614940] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-27T20:37:55.789481] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T20:37:56.414973] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-27T20:37:56.603937] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T20:37:56.613814] [INFO ] [REMOTE ] PLD: Full fetch complete (77114 records). [2025-10-27T20:37:56.613989] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-27T20:37:56.614784] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:37:56.614868] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:37:56.614910] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:37:56.614948] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-27T20:37:56.615002] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-27T20:37:56.615035] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-27T20:37:56.615163] [DEBUG] [LOCAL ] PLD: Deleted derivative data file. [2025-10-27T20:37:56.615919] [INFO ] [MAIN ] Update Progress: 1693/2366 symbols completed. PLD took 34.0s. Estimated remaining: 1h 26m 37s. Rate: 7.8 symbols/min [2025-10-27T20:37:56.781177] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:37:56.832762] [DEBUG] [LOCAL ] PM: Loaded 54454 existing records from primary storage. [2025-10-27T20:37:56.833111] [INFO ] [MAIN ] PM: Loaded 54454 existing records. [2025-10-27T20:37:57.008574] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:37:57.008785] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-27T20:37:57.008835] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-27T20:37:57.009122] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-10-27T20:37:57.009167] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-27T20:37:57.222758] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-27T20:37:57.357525] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:37:58.014963] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-27T20:37:58.225609] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-27T20:37:58.301770] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T20:37:58.814992] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-27T20:37:59.615005] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-27T20:37:59.931273] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T20:38:00.414937] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-27T20:38:00.446076] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T20:38:00.774985] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T20:38:00.778055] [INFO ] [REMOTE ] PLOW: Full fetch complete (28001 records). [2025-10-27T20:38:00.778148] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-27T20:38:01.139393] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-27T20:38:01.139482] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-27T20:38:01.140075] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-27T20:38:01.140138] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-27T20:38:01.141050] [DEBUG] [LOCAL ] PLOW: Trimmed 28001 records to 19211 (keeping 200 days of data) [2025-10-27T20:38:01.227306] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-27T20:38:01.265847] [DEBUG] [LOCAL ] PLOW: Primary data saved (19211 records). [2025-10-27T20:38:01.265985] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-27T20:38:01.266070] [INFO ] [MAIN ] Update Progress: 1694/2366 symbols completed. PLOW took 23.5s. Estimated remaining: 1h 26m 28s. Rate: 7.8 symbols/min [2025-10-27T20:38:01.460256] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:01.481057] [DEBUG] [LOCAL ] PML: Loaded 22205 existing records from primary storage. [2025-10-27T20:38:01.481292] [INFO ] [MAIN ] PML: Loaded 22205 existing records. [2025-10-27T20:38:01.680288] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:01.680511] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-27T20:38:01.680557] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-27T20:38:01.680767] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-27T20:38:01.680821] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-27T20:38:02.021183] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-27T20:38:02.044231] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:02.137199] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T20:38:02.814940] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-27T20:38:03.010279] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-27T20:38:03.486826] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:38:03.614934] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-27T20:38:04.414917] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-27T20:38:04.747687] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T20:38:05.214914] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-27T20:38:05.457272] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T20:38:05.841327] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T20:38:06.014994] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-27T20:38:06.236717] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-27T20:38:06.814986] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-27T20:38:07.614940] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-27T20:38:07.711854] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T20:38:07.764463] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T20:38:07.774084] [INFO ] [REMOTE ] PLNT: Full fetch complete (70240 records). [2025-10-27T20:38:07.774238] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-27T20:38:07.775001] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:38:07.775090] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:38:07.775133] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:38:07.775170] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-27T20:38:07.775224] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-27T20:38:07.775259] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-27T20:38:07.775462] [DEBUG] [LOCAL ] PLNT: Deleted derivative data file. [2025-10-27T20:38:07.775543] [INFO ] [MAIN ] Update Progress: 1695/2366 symbols completed. PLNT took 31.4s. Estimated remaining: 1h 26m 20s. Rate: 7.8 symbols/min [2025-10-27T20:38:07.940365] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:07.951568] [DEBUG] [LOCAL ] PMM: Loaded 10173 existing records from primary storage. [2025-10-27T20:38:07.951790] [INFO ] [MAIN ] PMM: Loaded 10173 existing records. [2025-10-27T20:38:08.129627] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:08.129857] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-27T20:38:08.129905] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-27T20:38:08.130102] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-27T20:38:08.130142] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-27T20:38:08.418369] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-27T20:38:08.511030] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:08.524306] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T20:38:09.214974] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-27T20:38:09.749918] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:38:10.014980] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-27T20:38:10.323503] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T20:38:10.814956] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-27T20:38:11.620371] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-27T20:38:11.623536] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T20:38:11.981705] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T20:38:12.330826] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T20:38:12.414932] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-27T20:38:13.214977] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-27T20:38:14.014928] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-27T20:38:14.291036] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T20:38:14.558708] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-27T20:38:14.814961] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-27T20:38:15.090707] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T20:38:15.614969] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-27T20:38:16.052158] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T20:38:16.331525] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T20:38:16.415004] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-27T20:38:17.215005] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-27T20:38:17.781992] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T20:38:17.866972] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:38:18.014962] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-27T20:38:18.760409] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T20:38:18.814952] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-27T20:38:19.614951] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-27T20:38:19.674215] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T20:38:20.414985] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-27T20:38:21.214999] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-27T20:38:21.299562] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T20:38:21.412147] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T20:38:22.014978] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-27T20:38:22.310250] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T20:38:22.814990] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-27T20:38:23.331796] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T20:38:23.614986] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-27T20:38:24.095639] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T20:38:24.415003] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-27T20:38:25.214974] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-27T20:38:25.650200] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T20:38:25.657843] [INFO ] [REMOTE ] PLYM: Full fetch complete (48297 records). [2025-10-27T20:38:25.657950] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-27T20:38:26.017075] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-27T20:38:26.052990] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-27T20:38:26.053083] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-27T20:38:26.054370] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-27T20:38:26.054749] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-27T20:38:26.055981] [DEBUG] [LOCAL ] PLYM: Trimmed 48297 records to 34355 (keeping 200 days of data) [2025-10-27T20:38:26.184791] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-27T20:38:26.282596] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T20:38:26.321769] [INFO ] [REMOTE ] PML: Full fetch complete (29720 records). [2025-10-27T20:38:26.324772] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-27T20:38:26.404767] [DEBUG] [LOCAL ] PLYM: Primary data saved (34355 records). [2025-10-27T20:38:26.435174] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-27T20:38:26.437598] [INFO ] [MAIN ] Update Progress: 1696/2366 symbols completed. PLYM took 32.5s. Estimated remaining: 1h 26m 16s. Rate: 7.8 symbols/min [2025-10-27T20:38:26.794410] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:26.820246] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-27T20:38:26.955467] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-27T20:38:26.955247] [DEBUG] [LOCAL ] PMO: Loaded 9502 existing records from primary storage. [2025-10-27T20:38:26.933982] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T20:38:26.958692] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-27T20:38:26.959935] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-27T20:38:26.960207] [INFO ] [MAIN ] PMO: Loaded 9502 existing records. [2025-10-27T20:38:26.960292] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-27T20:38:27.051980] [DEBUG] [LOCAL ] PML: Trimmed 29720 records to 21682 (keeping 200 days of data) [2025-10-27T20:38:27.275588] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:27.288879] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-27T20:38:27.289191] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-27T20:38:27.303748] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-27T20:38:27.304806] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-27T20:38:27.311473] [DEBUG] [LOCAL ] PML: Primary data saved (21682 records). [2025-10-27T20:38:27.334245] [INFO ] [MAIN ] PML: Full history saved. [2025-10-27T20:38:27.344262] [INFO ] [MAIN ] Update Progress: 1697/2366 symbols completed. PML took 26.1s. Estimated remaining: 1h 26m 6s. Rate: 7.8 symbols/min [2025-10-27T20:38:27.621522] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-27T20:38:27.682412] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:27.876819] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:27.903868] [DEBUG] [LOCAL ] PMT: Loaded 41398 existing records from primary storage. [2025-10-27T20:38:27.904151] [INFO ] [MAIN ] PMT: Loaded 41398 existing records. [2025-10-27T20:38:28.080082] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:28.080305] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-27T20:38:28.080353] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-27T20:38:28.080537] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-27T20:38:28.080576] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-27T20:38:28.415283] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-27T20:38:28.438794] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:28.570792] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T20:38:28.963110] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T20:38:29.214939] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-27T20:38:29.844850] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:38:29.855153] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:38:29.859779] [INFO ] [REMOTE ] PM: Full fetch complete (77445 records). [2025-10-27T20:38:29.860480] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-27T20:38:29.861281] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:38:29.861365] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:38:29.861407] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:38:29.861443] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-27T20:38:29.861498] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-27T20:38:29.861531] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-27T20:38:29.861684] [DEBUG] [LOCAL ] PM: Deleted derivative data file. [2025-10-27T20:38:29.862492] [INFO ] [MAIN ] Update Progress: 1698/2366 symbols completed. PM took 33.2s. Estimated remaining: 1h 25m 56s. Rate: 7.8 symbols/min [2025-10-27T20:38:30.026159] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:30.023586] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-27T20:38:30.026535] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-27T20:38:30.027177] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-27T20:38:30.027302] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-27T20:38:30.027344] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-27T20:38:30.027386] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-27T20:38:30.027417] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-27T20:38:30.375224] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:30.762138] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T20:38:30.814956] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-27T20:38:31.503115] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T20:38:31.614962] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-27T20:38:32.239530] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T20:38:32.414983] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-27T20:38:32.919040] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T20:38:33.214991] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-27T20:38:34.015053] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-27T20:38:34.265597] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T20:38:34.815008] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-27T20:38:34.988547] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T20:38:35.614918] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-27T20:38:35.763202] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T20:38:36.414937] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-27T20:38:36.962418] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:38:37.214997] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-27T20:38:37.271522] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T20:38:37.619909] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T20:38:38.015016] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-27T20:38:38.443481] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T20:38:38.814991] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-27T20:38:39.427787] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T20:38:39.614992] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-27T20:38:40.414963] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-27T20:38:40.962064] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T20:38:41.028799] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:38:41.214942] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-27T20:38:42.014947] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-27T20:38:42.024512] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T20:38:42.814935] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-27T20:38:42.920988] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:38:42.923470] [INFO ] [REMOTE ] PMM: Full fetch complete (17189 records). [2025-10-27T20:38:42.923572] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-27T20:38:43.291765] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-27T20:38:43.291842] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-27T20:38:43.292286] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-27T20:38:43.292346] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-27T20:38:43.292984] [DEBUG] [LOCAL ] PMM: Trimmed 17189 records to 9732 (keeping 200 days of data) [2025-10-27T20:38:43.348257] [DEBUG] [LOCAL ] PMM: Primary data saved (9732 records). [2025-10-27T20:38:43.348392] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-27T20:38:43.348475] [INFO ] [MAIN ] Update Progress: 1699/2366 symbols completed. PMM took 35.6s. Estimated remaining: 1h 25m 51s. Rate: 7.8 symbols/min [2025-10-27T20:38:43.514020] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:43.514194] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-27T20:38:43.514231] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-27T20:38:43.514336] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-27T20:38:43.514375] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-27T20:38:43.514414] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-27T20:38:43.514445] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-27T20:38:43.620065] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-27T20:38:43.861096] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:44.351473] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T20:38:44.395987] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T20:38:44.414900] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-27T20:38:45.214934] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-27T20:38:46.014921] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-27T20:38:46.037038] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T20:38:46.039092] [INFO ] [REMOTE ] PMO: Full fetch complete (15690 records). [2025-10-27T20:38:46.039165] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-27T20:38:46.443127] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-27T20:38:46.445949] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-27T20:38:46.446299] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-27T20:38:46.447979] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T20:38:46.446941] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-27T20:38:46.458438] [DEBUG] [LOCAL ] PMO: Trimmed 15690 records to 8998 (keeping 200 days of data) [2025-10-27T20:38:46.511115] [DEBUG] [LOCAL ] PMO: Primary data saved (8998 records). [2025-10-27T20:38:46.511240] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-27T20:38:46.511316] [INFO ] [MAIN ] Update Progress: 1700/2366 symbols completed. PMO took 20.1s. Estimated remaining: 1h 25m 41s. Rate: 7.8 symbols/min [2025-10-27T20:38:46.613421] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T20:38:46.704300] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:46.704453] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-27T20:38:46.704492] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-27T20:38:46.704628] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-27T20:38:46.704718] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-27T20:38:46.704774] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-27T20:38:46.704808] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-27T20:38:46.820049] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-10-27T20:38:47.059207] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:47.252874] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:38:47.253208] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-10-27T20:38:47.253291] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:38:47.253338] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-27T20:38:47.253399] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:38:47.253471] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-27T20:38:47.253534] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-27T20:38:47.253571] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-27T20:38:47.253610] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-27T20:38:47.253679] [INFO ] [MAIN ] Update Progress: 1701/2366 symbols completed. PMTV took 3.9s. Estimated remaining: 1h 25m 31s. Rate: 7.8 symbols/min [2025-10-27T20:38:47.426177] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:47.475911] [DEBUG] [LOCAL ] PNC: Loaded 52824 existing records from primary storage. [2025-10-27T20:38:47.476205] [INFO ] [MAIN ] PNC: Loaded 52824 existing records. [2025-10-27T20:38:47.624624] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-10-27T20:38:47.655332] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:47.655514] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-27T20:38:47.655563] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-27T20:38:47.655812] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-10-27T20:38:47.655871] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-27T20:38:48.016196] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:48.051949] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:38:48.052297] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-10-27T20:38:48.052403] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:38:48.052450] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-27T20:38:48.052482] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:38:48.052521] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-27T20:38:48.052575] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-27T20:38:48.052609] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-27T20:38:48.052679] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-27T20:38:48.052746] [INFO ] [MAIN ] Update Progress: 1702/2366 symbols completed. PMTW took 1.5s. Estimated remaining: 1h 25m 20s. Rate: 7.8 symbols/min [2025-10-27T20:38:48.225925] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:48.233606] [DEBUG] [LOCAL ] PNI: Loaded 6937 existing records from primary storage. [2025-10-27T20:38:48.233849] [INFO ] [MAIN ] PNI: Loaded 6937 existing records. [2025-10-27T20:38:48.408914] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:48.409134] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-27T20:38:48.409182] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-27T20:38:48.409381] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-27T20:38:48.409439] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-27T20:38:48.420279] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-27T20:38:48.766609] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:48.926070] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T20:38:49.214950] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-27T20:38:49.921854] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T20:38:50.014927] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-27T20:38:50.498859] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T20:38:50.814945] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-27T20:38:51.343036] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T20:38:51.614966] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-27T20:38:52.414945] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-27T20:38:52.841791] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T20:38:53.039350] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T20:38:53.214938] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-27T20:38:54.014940] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-27T20:38:54.354149] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T20:38:54.811869] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T20:38:54.821422] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-27T20:38:55.614953] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-27T20:38:55.666331] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T20:38:55.961514] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T20:38:56.414930] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-27T20:38:56.746521] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T20:38:57.214937] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-27T20:38:57.538501] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-27T20:38:57.539237] [INFO ] [REMOTE ] PMTU: Full fetch complete (1167 records). [2025-10-27T20:38:57.539305] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-27T20:38:57.715416] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-27T20:38:57.715580] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:38:57.715670] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:38:57.715740] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-27T20:38:57.715801] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-27T20:38:57.715837] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-27T20:38:57.715877] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-27T20:38:57.715942] [INFO ] [MAIN ] Update Progress: 1703/2366 symbols completed. PMTU took 27.9s. Estimated remaining: 1h 25m 14s. Rate: 7.8 symbols/min [2025-10-27T20:38:57.884038] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:38:57.919027] [DEBUG] [LOCAL ] PNNT: Loaded 33779 existing records from primary storage. [2025-10-27T20:38:57.919306] [INFO ] [MAIN ] PNNT: Loaded 33779 existing records. [2025-10-27T20:38:58.016571] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-27T20:38:58.094382] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:38:58.094568] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-27T20:38:58.094614] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-27T20:38:58.094883] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-27T20:38:58.094934] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-27T20:38:58.440278] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:38:58.814940] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-27T20:38:59.094798] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T20:38:59.615000] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-27T20:39:00.336466] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T20:39:00.414919] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-27T20:39:01.031723] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T20:39:01.051267] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T20:39:01.214937] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-27T20:39:01.979082] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T20:39:02.014943] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-27T20:39:02.815010] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-27T20:39:03.302471] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-27T20:39:03.555736] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T20:39:03.614937] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-27T20:39:04.414967] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-27T20:39:05.157083] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T20:39:05.214917] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-27T20:39:06.021934] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-27T20:39:06.024712] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T20:39:06.654453] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T20:39:06.814915] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-27T20:39:07.272315] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T20:39:07.614942] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-27T20:39:07.964069] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:39:08.414987] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-27T20:39:09.214964] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-27T20:39:09.359752] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T20:39:09.641386] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T20:39:10.014987] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-27T20:39:10.670906] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T20:39:10.815011] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-27T20:39:11.138222] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T20:39:11.150787] [INFO ] [REMOTE ] PMT: Full fetch complete (58536 records). [2025-10-27T20:39:11.150976] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-27T20:39:11.151943] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:11.152075] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:11.152127] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:11.152174] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-27T20:39:11.152310] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-27T20:39:11.152374] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-27T20:39:11.152762] [DEBUG] [LOCAL ] PMT: Deleted derivative data file. [2025-10-27T20:39:11.152878] [INFO ] [MAIN ] Update Progress: 1704/2366 symbols completed. PMT took 43.8s. Estimated remaining: 1h 25m 8s. Rate: 7.8 symbols/min [2025-10-27T20:39:11.353917] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:11.412007] [DEBUG] [LOCAL ] PNR: Loaded 48198 existing records from primary storage. [2025-10-27T20:39:11.412477] [INFO ] [MAIN ] PNR: Loaded 48198 existing records. [2025-10-27T20:39:11.628356] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-27T20:39:11.640822] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:11.641234] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-27T20:39:11.641307] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-27T20:39:11.641589] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-10-27T20:39:11.641698] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-27T20:39:12.040382] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:12.244604] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T20:39:12.246292] [INFO ] [REMOTE ] PNI: Full fetch complete (9634 records). [2025-10-27T20:39:12.246364] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-27T20:39:12.426383] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-27T20:39:12.612167] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-27T20:39:12.612425] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-27T20:39:12.612799] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-27T20:39:12.612881] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-27T20:39:12.613683] [DEBUG] [LOCAL ] PNI: Trimmed 9634 records to 6656 (keeping 200 days of data) [2025-10-27T20:39:12.653815] [DEBUG] [LOCAL ] PNI: Primary data saved (6656 records). [2025-10-27T20:39:12.654019] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-27T20:39:12.654117] [INFO ] [MAIN ] Update Progress: 1705/2366 symbols completed. PNI took 24.6s. Estimated remaining: 1h 24m 58s. Rate: 7.8 symbols/min [2025-10-27T20:39:12.849000] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T20:39:12.866683] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:12.918004] [DEBUG] [LOCAL ] PNW: Loaded 46156 existing records from primary storage. [2025-10-27T20:39:12.918374] [INFO ] [MAIN ] PNW: Loaded 46156 existing records. [2025-10-27T20:39:13.096066] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:13.096280] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-27T20:39:13.096327] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-27T20:39:13.096591] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-10-27T20:39:13.096704] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-27T20:39:13.220190] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-27T20:39:13.471025] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:13.771879] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:39:14.014992] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-27T20:39:14.814950] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-27T20:39:15.135173] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-27T20:39:15.392113] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T20:39:15.615011] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-27T20:39:15.885981] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T20:39:16.414992] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-27T20:39:17.214934] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-27T20:39:17.598774] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-27T20:39:18.014974] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-27T20:39:18.203137] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-27T20:39:18.238628] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T20:39:18.814988] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-27T20:39:19.277308] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T20:39:19.614943] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-27T20:39:20.212056] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T20:39:20.414967] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-27T20:39:20.889380] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T20:39:21.009837] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T20:39:21.019715] [INFO ] [REMOTE ] PNC: Full fetch complete (75403 records). [2025-10-27T20:39:21.019863] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-27T20:39:21.020597] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:21.020714] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:21.020759] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:21.020798] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-27T20:39:21.020857] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-27T20:39:21.020891] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-27T20:39:21.021030] [DEBUG] [LOCAL ] PNC: Deleted derivative data file. [2025-10-27T20:39:21.021099] [INFO ] [MAIN ] Update Progress: 1706/2366 symbols completed. PNC took 33.8s. Estimated remaining: 1h 24m 50s. Rate: 7.8 symbols/min [2025-10-27T20:39:21.196385] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:21.221760] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-27T20:39:21.242440] [DEBUG] [LOCAL ] POR: Loaded 47442 existing records from primary storage. [2025-10-27T20:39:21.242762] [INFO ] [MAIN ] POR: Loaded 47442 existing records. [2025-10-27T20:39:21.417490] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:21.417723] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-27T20:39:21.417777] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-27T20:39:21.417960] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-27T20:39:21.417996] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-27T20:39:21.797990] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:22.014947] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-27T20:39:22.753079] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T20:39:22.814915] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-27T20:39:23.366928] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T20:39:23.614943] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-27T20:39:24.313461] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T20:39:24.414956] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-27T20:39:25.214948] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-27T20:39:25.852027] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:39:26.019700] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-27T20:39:26.019552] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-27T20:39:26.616203] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T20:39:26.814998] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-27T20:39:27.614935] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-27T20:39:28.099522] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T20:39:28.220550] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T20:39:28.414950] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-27T20:39:29.214979] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-27T20:39:29.391697] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T20:39:29.999131] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-27T20:39:30.014889] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-27T20:39:30.617407] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T20:39:30.814980] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-27T20:39:31.615028] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-27T20:39:31.619819] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T20:39:32.414991] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-27T20:39:32.684557] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T20:39:33.214992] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-27T20:39:33.448478] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T20:39:33.831152] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T20:39:34.014988] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-27T20:39:34.814932] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-27T20:39:34.878873] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T20:39:35.615680] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-27T20:39:35.622974] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T20:39:36.414918] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-27T20:39:36.548973] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T20:39:36.986215] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T20:39:37.214983] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-27T20:39:37.398053] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:39:37.404623] [INFO ] [REMOTE ] PNNT: Full fetch complete (47815 records). [2025-10-27T20:39:37.404735] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-27T20:39:37.772498] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-27T20:39:37.772571] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-27T20:39:37.773396] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-27T20:39:37.773455] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-27T20:39:37.774372] [DEBUG] [LOCAL ] PNNT: Trimmed 47815 records to 32889 (keeping 200 days of data) [2025-10-27T20:39:37.959026] [DEBUG] [LOCAL ] PNNT: Primary data saved (32889 records). [2025-10-27T20:39:37.959169] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-27T20:39:37.959805] [INFO ] [MAIN ] Update Progress: 1707/2366 symbols completed. PNNT took 40.2s. Estimated remaining: 1h 24m 46s. Rate: 7.8 symbols/min [2025-10-27T20:39:38.025197] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-27T20:39:38.138233] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:38.181072] [DEBUG] [LOCAL ] POST: Loaded 38919 existing records from primary storage. [2025-10-27T20:39:38.181354] [INFO ] [MAIN ] POST: Loaded 38919 existing records. [2025-10-27T20:39:38.368757] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:38.369138] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-27T20:39:38.369223] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-27T20:39:38.369554] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-27T20:39:38.369711] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-27T20:39:38.735201] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T20:39:38.770316] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:38.814910] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-27T20:39:39.376558] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T20:39:39.615020] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-27T20:39:40.414990] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-27T20:39:40.578610] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T20:39:40.988716] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T20:39:41.214989] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-27T20:39:41.554417] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T20:39:42.014946] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-27T20:39:42.538899] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T20:39:42.814922] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-27T20:39:43.614981] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-27T20:39:44.299194] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T20:39:44.337917] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-27T20:39:44.414958] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-27T20:39:44.953474] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T20:39:45.082498] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:39:45.092124] [INFO ] [REMOTE ] PNR: Full fetch complete (69415 records). [2025-10-27T20:39:45.092300] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-27T20:39:45.093195] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:45.093280] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:45.093346] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:45.093421] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-27T20:39:45.093485] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-27T20:39:45.093521] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-27T20:39:45.093711] [DEBUG] [LOCAL ] PNR: Deleted derivative data file. [2025-10-27T20:39:45.093993] [INFO ] [MAIN ] Update Progress: 1708/2366 symbols completed. PNR took 33.9s. Estimated remaining: 1h 24m 38s. Rate: 7.8 symbols/min [2025-10-27T20:39:45.217925] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-27T20:39:45.298468] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:45.354398] [DEBUG] [LOCAL ] PPG: Loaded 51199 existing records from primary storage. [2025-10-27T20:39:45.354746] [INFO ] [MAIN ] PPG: Loaded 51199 existing records. [2025-10-27T20:39:45.559928] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:45.560117] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-27T20:39:45.560164] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-27T20:39:45.560352] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-10-27T20:39:45.560391] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-27T20:39:45.974632] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:46.014928] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-27T20:39:46.429791] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T20:39:46.814965] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-27T20:39:47.421942] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T20:39:47.614955] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-27T20:39:48.125906] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:39:48.134613] [INFO ] [REMOTE ] PNW: Full fetch complete (65671 records). [2025-10-27T20:39:48.134819] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-27T20:39:48.135668] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:48.135753] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:48.135816] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:48.135855] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-27T20:39:48.135911] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-27T20:39:48.135944] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-27T20:39:48.136076] [DEBUG] [LOCAL ] PNW: Deleted derivative data file. [2025-10-27T20:39:48.136167] [INFO ] [MAIN ] Update Progress: 1709/2366 symbols completed. PNW took 35.5s. Estimated remaining: 1h 24m 29s. Rate: 7.8 symbols/min [2025-10-27T20:39:48.305323] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:48.353739] [DEBUG] [LOCAL ] PPL: Loaded 54284 existing records from primary storage. [2025-10-27T20:39:48.354180] [INFO ] [MAIN ] PPL: Loaded 54284 existing records. [2025-10-27T20:39:48.425578] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-27T20:39:48.457968] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T20:39:48.565176] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:48.565382] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-27T20:39:48.565429] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-27T20:39:48.565616] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-10-27T20:39:48.565695] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-27T20:39:48.911434] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:49.214977] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-27T20:39:50.014924] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-27T20:39:50.188482] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T20:39:50.282504] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T20:39:50.814922] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-27T20:39:51.614964] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-27T20:39:51.761286] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T20:39:52.041031] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T20:39:52.414940] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-27T20:39:53.214965] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-27T20:39:53.450808] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T20:39:53.904296] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T20:39:54.014933] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-27T20:39:54.669263] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:39:54.814905] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-27T20:39:55.614974] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-27T20:39:55.661628] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T20:39:56.414995] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-27T20:39:56.869541] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T20:39:57.086036] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:39:57.093417] [INFO ] [REMOTE ] POST: Full fetch complete (55259 records). [2025-10-27T20:39:57.093543] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-27T20:39:57.094278] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:57.094372] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:57.094455] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:57.094540] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-27T20:39:57.094614] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-27T20:39:57.094691] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-27T20:39:57.094865] [DEBUG] [LOCAL ] POST: Deleted derivative data file. [2025-10-27T20:39:57.094954] [INFO ] [MAIN ] Update Progress: 1710/2366 symbols completed. POST took 19.1s. Estimated remaining: 1h 24m 22s. Rate: 7.8 symbols/min [2025-10-27T20:39:57.220159] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-27T20:39:57.265499] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:57.285010] [DEBUG] [LOCAL ] PPT: Loaded 19827 existing records from primary storage. [2025-10-27T20:39:57.285261] [INFO ] [MAIN ] PPT: Loaded 19827 existing records. [2025-10-27T20:39:57.492357] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:57.492633] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-27T20:39:57.492739] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-27T20:39:57.493056] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-27T20:39:57.493115] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-27T20:39:57.793753] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-27T20:39:57.913519] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:57.938464] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:39:57.946850] [INFO ] [REMOTE ] POR: Full fetch complete (67954 records). [2025-10-27T20:39:57.946966] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-27T20:39:57.947632] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:39:57.947743] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:39:57.947785] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:39:57.947829] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-27T20:39:57.947885] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-27T20:39:57.947919] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-27T20:39:57.948039] [DEBUG] [LOCAL ] POR: Deleted derivative data file. [2025-10-27T20:39:57.948111] [INFO ] [MAIN ] Update Progress: 1711/2366 symbols completed. POR took 36.9s. Estimated remaining: 1h 24m 11s. Rate: 7.8 symbols/min [2025-10-27T20:39:58.020031] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-27T20:39:58.116750] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:39:58.165498] [DEBUG] [LOCAL ] PR: Loaded 54390 existing records from primary storage. [2025-10-27T20:39:58.165850] [INFO ] [MAIN ] PR: Loaded 54390 existing records. [2025-10-27T20:39:58.337542] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:39:58.337794] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-27T20:39:58.337862] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-27T20:39:58.338182] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-27T20:39:58.338219] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-27T20:39:58.683343] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:39:58.814915] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-27T20:39:59.369057] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:39:59.614927] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-27T20:40:00.414934] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-27T20:40:00.744294] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T20:40:01.213182] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:40:01.217182] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-27T20:40:01.639728] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-27T20:40:02.015008] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-27T20:40:02.814939] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-27T20:40:03.175891] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-27T20:40:03.615000] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-27T20:40:03.794565] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T20:40:04.415021] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-27T20:40:04.599339] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T20:40:05.214958] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-27T20:40:05.393451] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-27T20:40:05.551070] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T20:40:06.014959] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-27T20:40:06.814923] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-27T20:40:07.222535] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-27T20:40:07.615013] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-27T20:40:07.835291] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T20:40:08.388537] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T20:40:08.414946] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-27T20:40:08.489147] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T20:40:09.214942] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-27T20:40:10.015010] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-27T20:40:10.300166] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T20:40:10.546236] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:40:10.814989] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-27T20:40:11.452951] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:40:11.614952] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-27T20:40:11.998786] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T20:40:12.414968] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-27T20:40:13.057813] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:40:13.214947] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-27T20:40:13.509407] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T20:40:14.014947] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-27T20:40:14.814915] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-27T20:40:15.077344] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T20:40:15.614920] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-27T20:40:16.181974] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T20:40:16.414984] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-27T20:40:16.767565] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T20:40:17.157221] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T20:40:17.214923] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-27T20:40:18.014964] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-27T20:40:18.257452] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T20:40:18.757512] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T20:40:18.814927] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-27T20:40:19.614988] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-27T20:40:20.063219] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-27T20:40:20.415014] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-27T20:40:20.521962] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T20:40:21.215022] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-27T20:40:21.822673] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T20:40:21.985290] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-27T20:40:22.014984] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-27T20:40:22.547173] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T20:40:22.814907] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-27T20:40:22.994190] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:40:23.003332] [INFO ] [REMOTE ] PPG: Full fetch complete (73507 records). [2025-10-27T20:40:23.003441] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-27T20:40:23.004248] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:40:23.004366] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:40:23.004445] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:40:23.004540] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-27T20:40:23.004620] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-27T20:40:23.004691] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-27T20:40:23.004863] [DEBUG] [LOCAL ] PPG: Deleted derivative data file. [2025-10-27T20:40:23.005467] [INFO ] [MAIN ] Update Progress: 1712/2366 symbols completed. PPG took 37.9s. Estimated remaining: 1h 24m 10s. Rate: 7.8 symbols/min [2025-10-27T20:40:23.171542] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:40:23.204666] [DEBUG] [LOCAL ] PRA: Loaded 34809 existing records from primary storage. [2025-10-27T20:40:23.204920] [INFO ] [MAIN ] PRA: Loaded 34809 existing records. [2025-10-27T20:40:23.379067] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:40:23.379270] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-27T20:40:23.379324] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-27T20:40:23.379513] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-27T20:40:23.379570] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-27T20:40:23.620136] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-27T20:40:23.728365] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:40:24.210576] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T20:40:24.220283] [INFO ] [REMOTE ] PPL: Full fetch complete (77240 records). [2025-10-27T20:40:24.220408] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-27T20:40:24.221210] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:40:24.221301] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:40:24.221343] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:40:24.221379] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-27T20:40:24.221434] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-27T20:40:24.221468] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-27T20:40:24.221618] [DEBUG] [LOCAL ] PPL: Deleted derivative data file. [2025-10-27T20:40:24.221743] [INFO ] [MAIN ] Update Progress: 1713/2366 symbols completed. PPL took 36.1s. Estimated remaining: 1h 23m 60s. Rate: 7.8 symbols/min [2025-10-27T20:40:24.390666] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:40:24.395734] [DEBUG] [LOCAL ] PRCS: Loaded 2818 existing records from primary storage. [2025-10-27T20:40:24.395992] [INFO ] [MAIN ] PRCS: Loaded 2818 existing records. [2025-10-27T20:40:24.425538] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-27T20:40:24.586749] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:40:24.604807] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-27T20:40:24.604898] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-27T20:40:24.605137] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-27T20:40:24.605412] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-27T20:40:24.638427] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T20:40:24.965783] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:40:25.144346] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T20:40:25.214948] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-27T20:40:25.810144] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T20:40:25.813249] [INFO ] [REMOTE ] PPT: Full fetch complete (28330 records). [2025-10-27T20:40:25.813318] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-27T20:40:26.020191] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-27T20:40:26.174502] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-27T20:40:26.174567] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-27T20:40:26.175215] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-27T20:40:26.175277] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-27T20:40:26.176001] [DEBUG] [LOCAL ] PPT: Trimmed 28330 records to 19331 (keeping 200 days of data) [2025-10-27T20:40:26.284104] [DEBUG] [LOCAL ] PPT: Primary data saved (19331 records). [2025-10-27T20:40:26.284227] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-27T20:40:26.284300] [INFO ] [MAIN ] Update Progress: 1714/2366 symbols completed. PPT took 29.2s. Estimated remaining: 1h 23m 50s. Rate: 7.8 symbols/min [2025-10-27T20:40:26.449739] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:40:26.478787] [DEBUG] [LOCAL ] PRG: Loaded 30188 existing records from primary storage. [2025-10-27T20:40:26.479083] [INFO ] [MAIN ] PRG: Loaded 30188 existing records. [2025-10-27T20:40:26.650561] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:40:26.650739] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-27T20:40:26.650787] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-27T20:40:26.650960] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-27T20:40:26.650997] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-27T20:40:26.826057] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-27T20:40:27.001319] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:40:27.013955] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T20:40:27.614941] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-27T20:40:27.802121] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T20:40:27.812054] [INFO ] [REMOTE ] PR: Full fetch complete (77372 records). [2025-10-27T20:40:27.812188] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-27T20:40:27.812975] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:40:27.813077] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:40:27.813151] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:40:27.813247] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-27T20:40:27.813330] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-27T20:40:27.813367] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-27T20:40:27.813492] [DEBUG] [LOCAL ] PR: Deleted derivative data file. [2025-10-27T20:40:27.813564] [INFO ] [MAIN ] Update Progress: 1715/2366 symbols completed. PR took 29.9s. Estimated remaining: 1h 23m 40s. Rate: 7.8 symbols/min [2025-10-27T20:40:27.991221] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:40:28.030945] [DEBUG] [LOCAL ] PRGO: Loaded 47793 existing records from primary storage. [2025-10-27T20:40:28.031238] [INFO ] [MAIN ] PRGO: Loaded 47793 existing records. [2025-10-27T20:40:28.217155] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:40:28.217357] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-27T20:40:28.217436] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-27T20:40:28.217714] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-27T20:40:28.217768] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-27T20:40:28.427171] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-27T20:40:28.573956] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:40:28.967416] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T20:40:29.214971] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-27T20:40:29.710767] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T20:40:30.014908] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-27T20:40:30.373581] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:40:30.815013] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-27T20:40:31.227091] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T20:40:31.615013] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-27T20:40:31.945726] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:40:32.414998] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-27T20:40:33.225764] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-27T20:40:33.228490] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T20:40:33.508175] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T20:40:33.786431] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T20:40:34.015022] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-27T20:40:34.814951] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-27T20:40:35.358969] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T20:40:35.376955] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T20:40:35.614953] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-27T20:40:36.414956] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-27T20:40:37.002552] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T20:40:37.214951] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-27T20:40:37.883270] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T20:40:38.014902] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-27T20:40:38.536299] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T20:40:38.814962] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-27T20:40:39.016765] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T20:40:39.614952] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-27T20:40:40.061455] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T20:40:40.414941] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-27T20:40:40.497368] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T20:40:41.214996] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-27T20:40:41.506618] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T20:40:42.014951] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-27T20:40:42.557966] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-27T20:40:42.686873] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T20:40:42.814959] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-27T20:40:43.417889] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T20:40:43.614993] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-27T20:40:44.080769] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T20:40:44.415017] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-27T20:40:45.214945] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-27T20:40:46.014988] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-27T20:40:46.244025] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T20:40:46.474085] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-27T20:40:46.745599] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T20:40:46.814943] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-27T20:40:47.614962] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-27T20:40:48.099339] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T20:40:48.414974] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-27T20:40:48.747955] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T20:40:48.930749] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T20:40:48.937858] [INFO ] [REMOTE ] PRA: Full fetch complete (45191 records). [2025-10-27T20:40:48.938042] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-27T20:40:48.938806] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:40:48.938895] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:40:48.938938] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:40:48.938976] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-27T20:40:48.939034] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-27T20:40:48.939069] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-27T20:40:48.939194] [DEBUG] [LOCAL ] PRA: Deleted derivative data file. [2025-10-27T20:40:48.939267] [INFO ] [MAIN ] Update Progress: 1716/2366 symbols completed. PRA took 25.9s. Estimated remaining: 1h 23m 37s. Rate: 7.8 symbols/min [2025-10-27T20:40:49.110219] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:40:49.117141] [DEBUG] [LOCAL ] PRH: Loaded 4728 existing records from primary storage. [2025-10-27T20:40:49.117315] [INFO ] [MAIN ] PRH: Loaded 4728 existing records. [2025-10-27T20:40:49.221757] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-27T20:40:49.303538] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:40:49.303763] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-27T20:40:49.303814] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-27T20:40:49.303954] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-27T20:40:49.303990] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-27T20:40:49.710463] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:40:50.014975] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-27T20:40:50.696233] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T20:40:50.814974] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-27T20:40:51.097785] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:40:51.614948] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-27T20:40:51.632103] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T20:40:52.414996] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-27T20:40:53.097917] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T20:40:53.214940] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-27T20:40:53.457072] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T20:40:53.700020] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T20:40:54.014947] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-27T20:40:54.814951] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-27T20:40:54.880314] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T20:40:55.388634] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T20:40:55.614961] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-27T20:40:56.414940] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-27T20:40:56.955116] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T20:40:56.965102] [INFO ] [REMOTE ] PRGO: Full fetch complete (68535 records). [2025-10-27T20:40:56.965230] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-27T20:40:56.965965] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:40:56.966052] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:40:56.966095] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:40:56.966135] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-27T20:40:56.966191] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-27T20:40:56.966226] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-27T20:40:56.966354] [DEBUG] [LOCAL ] PRGO: Deleted derivative data file. [2025-10-27T20:40:56.966423] [INFO ] [MAIN ] Update Progress: 1717/2366 symbols completed. PRGO took 29.2s. Estimated remaining: 1h 23m 30s. Rate: 7.8 symbols/min [2025-10-27T20:40:57.214945] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-27T20:40:57.240756] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T20:40:57.895265] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T20:40:58.014950] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-27T20:40:58.815057] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-27T20:40:59.184406] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T20:40:59.271475] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T20:40:59.614929] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-27T20:41:00.135437] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T20:41:00.136784] [INFO ] [REMOTE ] PRCS: Full fetch complete (3893 records). [2025-10-27T20:41:00.136856] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-27T20:41:00.420953] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-27T20:41:00.528157] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-27T20:41:00.528239] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-27T20:41:00.528417] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-27T20:41:00.528459] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-27T20:41:00.528852] [DEBUG] [LOCAL ] PRCS: Trimmed 3893 records to 2724 (keeping 200 days of data) [2025-10-27T20:41:00.545279] [DEBUG] [LOCAL ] PRCS: Primary data saved (2724 records). [2025-10-27T20:41:00.545383] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-27T20:41:00.545469] [INFO ] [MAIN ] Update Progress: 1718/2366 symbols completed. PRCS took 36.3s. Estimated remaining: 1h 23m 21s. Rate: 7.8 symbols/min [2025-10-27T20:41:01.214950] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-27T20:41:01.535000] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T20:41:02.015081] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-27T20:41:02.028763] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T20:41:02.814995] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-27T20:41:03.296562] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T20:41:03.360829] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T20:41:03.614940] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-27T20:41:04.306274] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T20:41:04.415010] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-27T20:41:04.921138] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:41:04.922388] [INFO ] [REMOTE ] PRH: Full fetch complete (7344 records). [2025-10-27T20:41:04.922455] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-27T20:41:05.220120] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-27T20:41:05.278892] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-27T20:41:05.278965] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-27T20:41:05.279214] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-27T20:41:05.279275] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-27T20:41:05.279706] [DEBUG] [LOCAL ] PRH: Trimmed 7344 records to 4565 (keeping 200 days of data) [2025-10-27T20:41:05.306532] [DEBUG] [LOCAL ] PRH: Primary data saved (4565 records). [2025-10-27T20:41:05.306876] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-27T20:41:05.306966] [INFO ] [MAIN ] Update Progress: 1719/2366 symbols completed. PRH took 16.4s. Estimated remaining: 1h 23m 12s. Rate: 7.8 symbols/min [2025-10-27T20:41:05.736503] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T20:41:05.743191] [INFO ] [REMOTE ] PRG: Full fetch complete (44392 records). [2025-10-27T20:41:05.743302] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-27T20:41:05.743960] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:41:05.744048] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:41:05.744092] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:41:05.744136] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-27T20:41:05.744193] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-27T20:41:05.744230] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-27T20:41:05.744363] [DEBUG] [LOCAL ] PRG: Deleted derivative data file. [2025-10-27T20:41:05.745122] [INFO ] [MAIN ] Update Progress: 1720/2366 symbols completed. PRG took 39.5s. Estimated remaining: 1h 23m 1s. Rate: 7.8 symbols/min [2025-10-27T20:41:06.391953] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:06.513454] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:06.563923] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:06.558015] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:06.588342] [DEBUG] [LOCAL ] PRI: Loaded 17931 existing records from primary storage. [2025-10-27T20:41:06.588625] [INFO ] [MAIN ] PRI: Loaded 17931 existing records. [2025-10-27T20:41:06.719850] [DEBUG] [LOCAL ] PRLB: Loaded 20576 existing records from primary storage. [2025-10-27T20:41:06.736001] [INFO ] [MAIN ] PRLB: Loaded 20576 existing records. [2025-10-27T20:41:06.928852] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:06.930568] [DEBUG] [LOCAL ] PRKS: Loaded 42803 existing records from primary storage. [2025-10-27T20:41:06.963448] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-27T20:41:06.965207] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-27T20:41:06.965393] [INFO ] [MAIN ] PRKS: Loaded 42803 existing records. [2025-10-27T20:41:06.994970] [DEBUG] [LOCAL ] PRIM: Loaded 44712 existing records from primary storage. [2025-10-27T20:41:07.035211] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-27T20:41:07.035135] [INFO ] [MAIN ] PRIM: Loaded 44712 existing records. [2025-10-27T20:41:07.083791] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-27T20:41:07.218775] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:07.279142] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-27T20:41:07.306295] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-27T20:41:07.344004] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-27T20:41:07.354514] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-27T20:41:07.637044] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:07.627640] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:07.698902] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-27T20:41:07.704179] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-27T20:41:07.698757] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-27T20:41:07.746522] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-27T20:41:07.749784] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-27T20:41:07.750027] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-27T20:41:07.817048] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-27T20:41:07.881240] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-27T20:41:08.655250] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:08.681044] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-27T20:41:08.838421] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:08.880411] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-27T20:41:09.209910] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:09.215606] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-27T20:41:09.289223] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:09.289853] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-27T20:41:09.851879] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T20:41:09.856253] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-27T20:41:10.467207] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:41:10.472071] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-27T20:41:10.498158] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T20:41:10.595058] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T20:41:10.653581] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:41:10.814940] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-27T20:41:11.614955] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-27T20:41:11.878917] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:41:12.095487] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T20:41:12.414933] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-27T20:41:13.204676] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:41:13.214906] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-27T20:41:13.239293] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:41:14.014948] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-27T20:41:14.575126] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T20:41:14.814956] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-27T20:41:15.210147] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T20:41:15.614951] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-27T20:41:16.238703] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T20:41:16.414981] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-27T20:41:17.012818] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T20:41:17.214958] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-27T20:41:17.528775] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T20:41:18.014994] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-27T20:41:18.231238] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T20:41:18.814972] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-27T20:41:19.122235] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T20:41:19.614937] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-27T20:41:20.414904] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-27T20:41:20.534991] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-27T20:41:20.744940] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T20:41:21.214956] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-27T20:41:22.015844] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-27T20:41:22.038301] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T20:41:22.216034] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T20:41:22.814990] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-27T20:41:23.378491] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T20:41:23.614937] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-27T20:41:24.124429] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T20:41:24.414982] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-27T20:41:25.214960] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-27T20:41:25.377619] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T20:41:25.402889] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:41:26.014905] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-27T20:41:26.345184] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T20:41:26.769946] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T20:41:26.814918] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-27T20:41:27.620091] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-27T20:41:27.625874] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T20:41:28.414928] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-27T20:41:28.752301] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T20:41:28.776730] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T20:41:28.780038] [INFO ] [REMOTE ] PRI: Full fetch complete (25471 records). [2025-10-27T20:41:28.780107] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-27T20:41:28.780583] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:41:28.780685] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:41:28.780735] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:41:28.780801] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-27T20:41:28.780861] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-27T20:41:28.780896] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-27T20:41:28.781217] [DEBUG] [LOCAL ] PRI: Deleted derivative data file. [2025-10-27T20:41:28.781313] [INFO ] [MAIN ] Update Progress: 1721/2366 symbols completed. PRI took 23.0s. Estimated remaining: 1h 22m 59s. Rate: 7.8 symbols/min [2025-10-27T20:41:28.945901] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:28.983910] [DEBUG] [LOCAL ] PRM: Loaded 44919 existing records from primary storage. [2025-10-27T20:41:28.984248] [INFO ] [MAIN ] PRM: Loaded 44919 existing records. [2025-10-27T20:41:29.154918] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:29.155075] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-27T20:41:29.155120] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-27T20:41:29.155428] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-27T20:41:29.155486] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-27T20:41:29.220138] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-27T20:41:29.507582] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:30.014962] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-27T20:41:30.605799] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T20:41:30.814960] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-27T20:41:31.241798] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T20:41:31.614917] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-27T20:41:32.012796] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T20:41:32.414951] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-27T20:41:32.537708] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T20:41:33.214970] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-27T20:41:33.602871] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T20:41:34.014916] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-27T20:41:34.814977] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-27T20:41:34.966812] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T20:41:35.139433] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T20:41:35.614934] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-27T20:41:36.327572] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T20:41:36.414907] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-27T20:41:37.214958] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-27T20:41:37.279097] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T20:41:37.584973] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T20:41:37.939848] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:41:37.943881] [INFO ] [REMOTE ] PRLB: Full fetch complete (30351 records). [2025-10-27T20:41:37.943978] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-27T20:41:37.944930] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:41:37.945023] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:41:37.945070] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:41:37.945142] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-27T20:41:37.945235] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-27T20:41:37.945283] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-27T20:41:37.945416] [DEBUG] [LOCAL ] PRLB: Deleted derivative data file. [2025-10-27T20:41:37.945506] [INFO ] [MAIN ] Update Progress: 1722/2366 symbols completed. PRLB took 32.2s. Estimated remaining: 1h 22m 52s. Rate: 7.8 symbols/min [2025-10-27T20:41:38.020040] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-27T20:41:38.112794] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:38.166314] [DEBUG] [LOCAL ] PRMB: Loaded 53853 existing records from primary storage. [2025-10-27T20:41:38.166708] [INFO ] [MAIN ] PRMB: Loaded 53853 existing records. [2025-10-27T20:41:38.337573] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:38.337794] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-27T20:41:38.337842] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-27T20:41:38.338031] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-27T20:41:38.338089] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-27T20:41:38.708821] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:38.814957] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-27T20:41:39.198862] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T20:41:39.614931] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-27T20:41:40.318449] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:41:40.414947] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-27T20:41:41.051167] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:41:41.214925] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-27T20:41:41.839362] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T20:41:42.014935] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-27T20:41:42.751862] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T20:41:42.814914] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-27T20:41:43.489933] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T20:41:43.614941] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-27T20:41:44.414914] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-27T20:41:44.799003] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T20:41:45.108361] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T20:41:45.117455] [INFO ] [REMOTE ] PRIM: Full fetch complete (63922 records). [2025-10-27T20:41:45.117694] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-27T20:41:45.223346] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-27T20:41:45.531987] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-27T20:41:45.532105] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-27T20:41:45.533612] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-27T20:41:45.533709] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-27T20:41:45.535563] [DEBUG] [LOCAL ] PRIM: Trimmed 63922 records to 43973 (keeping 200 days of data) [2025-10-27T20:41:45.851802] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:41:45.875460] [DEBUG] [LOCAL ] PRIM: Primary data saved (43973 records). [2025-10-27T20:41:45.876126] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-27T20:41:45.876241] [INFO ] [MAIN ] Update Progress: 1723/2366 symbols completed. PRIM took 40.1s. Estimated remaining: 1h 22m 44s. Rate: 7.8 symbols/min [2025-10-27T20:41:46.020087] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-27T20:41:46.054320] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:46.098194] [DEBUG] [LOCAL ] PRO: Loaded 40709 existing records from primary storage. [2025-10-27T20:41:46.098612] [INFO ] [MAIN ] PRO: Loaded 40709 existing records. [2025-10-27T20:41:46.284994] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:46.285313] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-27T20:41:46.285366] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-27T20:41:46.285594] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-27T20:41:46.285675] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-27T20:41:46.669891] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:46.704254] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T20:41:46.712849] [INFO ] [REMOTE ] PRKS: Full fetch complete (61501 records). [2025-10-27T20:41:46.712980] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-27T20:41:46.814923] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-27T20:41:47.103123] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-27T20:41:47.103203] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-27T20:41:47.104227] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-27T20:41:47.104287] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-27T20:41:47.105530] [DEBUG] [LOCAL ] PRKS: Trimmed 61501 records to 42027 (keeping 200 days of data) [2025-10-27T20:41:47.339573] [DEBUG] [LOCAL ] PRKS: Primary data saved (42027 records). [2025-10-27T20:41:47.339717] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-27T20:41:47.340359] [INFO ] [MAIN ] Update Progress: 1724/2366 symbols completed. PRKS took 41.6s. Estimated remaining: 1h 22m 34s. Rate: 7.8 symbols/min [2025-10-27T20:41:47.507617] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:41:47.529995] [DEBUG] [LOCAL ] PRSU: Loaded 23312 existing records from primary storage. [2025-10-27T20:41:47.530236] [INFO ] [MAIN ] PRSU: Loaded 23312 existing records. [2025-10-27T20:41:47.618505] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-27T20:41:47.712311] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:41:47.712719] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-27T20:41:47.712839] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-27T20:41:47.713238] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-10-27T20:41:47.713295] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-27T20:41:48.093282] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:41:48.096000] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-27T20:41:48.328564] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T20:41:48.414898] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-27T20:41:48.744114] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T20:41:49.214966] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-10-27T20:41:49.819232] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:41:50.014954] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-27T20:41:50.654471] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:41:50.814916] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-10-27T20:41:51.614918] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-27T20:41:51.740574] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T20:41:51.768057] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T20:41:52.414996] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-27T20:41:52.858402] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T20:41:53.214967] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-10-27T20:41:54.014918] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-27T20:41:54.168884] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T20:41:54.448152] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T20:41:54.814993] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-10-27T20:41:55.121775] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T20:41:55.614962] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-27T20:41:56.151966] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:41:56.414967] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-10-27T20:41:56.657423] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T20:41:57.214986] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-27T20:41:57.684163] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T20:41:58.014928] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-27T20:41:58.588545] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T20:41:58.814926] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-10-27T20:41:59.399275] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:41:59.614983] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-27T20:41:59.753737] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T20:42:00.414943] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-10-27T20:42:01.214959] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-27T20:42:01.289773] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T20:42:01.298606] [INFO ] [REMOTE ] PRM: Full fetch complete (64810 records). [2025-10-27T20:42:01.298813] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-27T20:42:01.854010] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-27T20:42:01.854146] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-27T20:42:01.855956] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-27T20:42:01.857212] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-27T20:42:01.859418] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T20:42:01.870172] [DEBUG] [LOCAL ] PRM: Trimmed 64810 records to 44124 (keeping 200 days of data) [2025-10-27T20:42:02.015299] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-27T20:42:02.249209] [DEBUG] [LOCAL ] PRM: Primary data saved (44124 records). [2025-10-27T20:42:02.249356] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-27T20:42:02.249460] [INFO ] [MAIN ] Update Progress: 1725/2366 symbols completed. PRM took 33.5s. Estimated remaining: 1h 22m 29s. Rate: 7.8 symbols/min [2025-10-27T20:42:02.456305] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:02.464152] [DEBUG] [LOCAL ] PRT: Loaded 5120 existing records from primary storage. [2025-10-27T20:42:02.464373] [INFO ] [MAIN ] PRT: Loaded 5120 existing records. [2025-10-27T20:42:02.674440] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:02.674851] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-27T20:42:02.675079] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-27T20:42:02.675272] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-27T20:42:02.675320] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-27T20:42:02.818763] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-10-27T20:42:02.884573] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T20:42:03.074883] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:03.614920] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-27T20:42:03.724373] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T20:42:03.973711] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T20:42:04.414964] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-10-27T20:42:04.836486] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T20:42:05.214987] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-27T20:42:05.403293] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T20:42:06.014994] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-27T20:42:06.712726] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T20:42:06.765098] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:42:06.814891] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-27T20:42:07.409898] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T20:42:07.614932] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-27T20:42:08.414960] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-27T20:42:09.118164] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T20:42:09.128306] [INFO ] [REMOTE ] PRMB: Full fetch complete (76308 records). [2025-10-27T20:42:09.128452] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-27T20:42:09.217734] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-10. [2025-10-27T20:42:09.329191] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-27T20:42:09.522603] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-27T20:42:09.522713] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-27T20:42:09.523817] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-27T20:42:09.523882] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-27T20:42:09.525230] [DEBUG] [LOCAL ] PRMB: Trimmed 76308 records to 53066 (keeping 200 days of data) [2025-10-27T20:42:09.842945] [DEBUG] [LOCAL ] PRMB: Primary data saved (53066 records). [2025-10-27T20:42:09.843065] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-27T20:42:09.843818] [INFO ] [MAIN ] Update Progress: 1726/2366 symbols completed. PRMB took 31.9s. Estimated remaining: 1h 22m 22s. Rate: 7.8 symbols/min [2025-10-27T20:42:10.020623] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:10.018099] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-27T20:42:10.036595] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T20:42:10.040923] [INFO ] [REMOTE ] PRSU: Full fetch complete (33984 records). [2025-10-27T20:42:10.041023] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-27T20:42:10.041589] [FATAL] [VALIDATOR ] PRSU: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:42:10.041696] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:42:10.041749] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:42:10.041813] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-27T20:42:10.041875] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-27T20:42:10.041911] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-27T20:42:10.042064] [DEBUG] [LOCAL ] PRSU: Deleted derivative data file. [2025-10-27T20:42:10.042154] [INFO ] [MAIN ] Update Progress: 1727/2366 symbols completed. PRSU took 22.7s. Estimated remaining: 1h 22m 11s. Rate: 7.8 symbols/min [2025-10-27T20:42:10.272768] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:10.272989] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-27T20:42:10.273041] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-27T20:42:10.274402] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-27T20:42:10.274206] [DEBUG] [LOCAL ] PRU: Loaded 51847 existing records from primary storage. [2025-10-27T20:42:10.274535] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-27T20:42:10.274672] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-27T20:42:10.275017] [INFO ] [MAIN ] PRU: Loaded 51847 existing records. [2025-10-27T20:42:10.274892] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-27T20:42:10.710612] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:10.743263] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-27T20:42:10.743356] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-27T20:42:10.772831] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-10-27T20:42:10.772963] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-27T20:42:10.815416] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-27T20:42:10.945343] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T20:42:10.950828] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:11.219008] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:11.614943] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-27T20:42:12.066609] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-27T20:42:12.216180] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T20:42:12.415023] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-27T20:42:12.894879] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T20:42:13.214968] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-27T20:42:13.900173] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T20:42:14.014917] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-27T20:42:14.466466] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T20:42:14.814927] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-27T20:42:15.349304] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T20:42:15.614972] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-27T20:42:16.322016] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T20:42:16.414956] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-27T20:42:16.924247] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-27T20:42:17.214984] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-27T20:42:18.014940] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-27T20:42:18.591256] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T20:42:18.814943] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-27T20:42:18.872251] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T20:42:19.246122] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T20:42:19.614952] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-27T20:42:20.031256] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T20:42:20.414957] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-27T20:42:21.214986] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-27T20:42:21.865121] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:42:22.014937] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-27T20:42:22.383187] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T20:42:22.561725] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:42:22.563107] [INFO ] [REMOTE ] PRT: Full fetch complete (8417 records). [2025-10-27T20:42:22.563174] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-27T20:42:22.820068] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-27T20:42:22.931525] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-27T20:42:22.931605] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-27T20:42:22.931875] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-27T20:42:22.931938] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-27T20:42:22.932374] [DEBUG] [LOCAL ] PRT: Trimmed 8417 records to 4957 (keeping 200 days of data) [2025-10-27T20:42:22.960685] [DEBUG] [LOCAL ] PRT: Primary data saved (4957 records). [2025-10-27T20:42:22.960788] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-27T20:42:22.960861] [INFO ] [MAIN ] Update Progress: 1728/2366 symbols completed. PRT took 20.7s. Estimated remaining: 1h 22m 5s. Rate: 7.8 symbols/min [2025-10-27T20:42:23.128294] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:23.167838] [DEBUG] [LOCAL ] PSA: Loaded 42639 existing records from primary storage. [2025-10-27T20:42:23.168186] [INFO ] [MAIN ] PSA: Loaded 42639 existing records. [2025-10-27T20:42:23.356331] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:23.356534] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-27T20:42:23.356593] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-27T20:42:23.356814] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-10-27T20:42:23.356869] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-27T20:42:23.620083] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-27T20:42:23.720474] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:24.075943] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T20:42:24.414914] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-27T20:42:24.450263] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T20:42:25.214954] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-27T20:42:26.014921] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-27T20:42:26.111270] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T20:42:26.122080] [INFO ] [REMOTE ] PRO: Full fetch complete (54134 records). [2025-10-27T20:42:26.122318] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-27T20:42:26.547546] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-27T20:42:26.547719] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-27T20:42:26.549349] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-27T20:42:26.549511] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-27T20:42:26.551369] [DEBUG] [LOCAL ] PRO: Trimmed 54134 records to 39989 (keeping 200 days of data) [2025-10-27T20:42:26.692410] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:42:26.816708] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-27T20:42:26.824883] [DEBUG] [LOCAL ] PRO: Primary data saved (39989 records). [2025-10-27T20:42:26.825012] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-27T20:42:26.825176] [INFO ] [MAIN ] Update Progress: 1729/2366 symbols completed. PRO took 40.9s. Estimated remaining: 1h 21m 56s. Rate: 7.8 symbols/min [2025-10-27T20:42:27.000010] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:27.009289] [DEBUG] [LOCAL ] PSBD: Loaded 8353 existing records from primary storage. [2025-10-27T20:42:27.009541] [INFO ] [MAIN ] PSBD: Loaded 8353 existing records. [2025-10-27T20:42:27.190176] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:27.190376] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-27T20:42:27.190424] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-27T20:42:27.190581] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-27T20:42:27.190620] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-27T20:42:27.549982] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:27.624616] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-27T20:42:27.645367] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T20:42:27.993682] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T20:42:28.412498] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T20:42:28.415037] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-27T20:42:28.929722] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T20:42:29.214920] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-27T20:42:29.999405] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:42:30.014902] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-27T20:42:30.814913] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-27T20:42:31.103363] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-27T20:42:31.279943] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T20:42:31.614995] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-27T20:42:32.414958] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-27T20:42:33.214993] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-27T20:42:33.271482] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T20:42:33.955369] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-27T20:42:34.015014] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-27T20:42:34.117126] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T20:42:34.814959] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-27T20:42:35.210237] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T20:42:35.598238] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:42:35.614913] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-27T20:42:36.414966] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-27T20:42:37.041862] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T20:42:37.214915] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-27T20:42:37.314505] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T20:42:37.695264] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T20:42:38.014965] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-27T20:42:38.572190] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T20:42:38.814954] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-27T20:42:39.288049] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T20:42:39.288846] [INFO ] [REMOTE ] PRVS: Full fetch complete (1225 records). [2025-10-27T20:42:39.288912] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-27T20:42:39.461040] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-27T20:42:39.461237] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:42:39.461305] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:42:39.461375] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-27T20:42:39.461436] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-27T20:42:39.461470] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-27T20:42:39.461509] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-27T20:42:39.461561] [INFO ] [MAIN ] Update Progress: 1730/2366 symbols completed. PRVS took 29.4s. Estimated remaining: 1h 21m 50s. Rate: 7.8 symbols/min [2025-10-27T20:42:39.615926] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-27T20:42:39.634738] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:39.644668] [DEBUG] [LOCAL ] PSF: Loaded 6996 existing records from primary storage. [2025-10-27T20:42:39.644878] [INFO ] [MAIN ] PSF: Loaded 6996 existing records. [2025-10-27T20:42:39.817767] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:39.817963] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-27T20:42:39.818010] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-27T20:42:39.818191] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-27T20:42:39.818250] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-27T20:42:40.186015] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:40.414937] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-27T20:42:41.174365] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T20:42:41.214896] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-27T20:42:41.485456] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T20:42:41.739543] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T20:42:42.014933] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-27T20:42:42.714338] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T20:42:42.814924] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-27T20:42:43.614909] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-27T20:42:43.769616] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T20:42:44.160875] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T20:42:44.414941] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-27T20:42:45.214979] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-27T20:42:45.563425] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:42:45.566943] [INFO ] [REMOTE ] PSBD: Full fetch complete (11058 records). [2025-10-27T20:42:45.567039] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-27T20:42:45.918548] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T20:42:45.939713] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-27T20:42:45.939801] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-27T20:42:45.940151] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-27T20:42:45.940210] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-27T20:42:45.941016] [DEBUG] [LOCAL ] PSBD: Trimmed 11058 records to 8254 (keeping 200 days of data) [2025-10-27T20:42:45.992572] [DEBUG] [LOCAL ] PSBD: Primary data saved (8254 records). [2025-10-27T20:42:45.992747] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-27T20:42:45.992845] [INFO ] [MAIN ] Update Progress: 1731/2366 symbols completed. PSBD took 19.2s. Estimated remaining: 1h 21m 42s. Rate: 7.8 symbols/min [2025-10-27T20:42:46.020045] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-27T20:42:46.180217] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:46.209700] [DEBUG] [LOCAL ] PSFE: Loaded 29936 existing records from primary storage. [2025-10-27T20:42:46.209974] [INFO ] [MAIN ] PSFE: Loaded 29936 existing records. [2025-10-27T20:42:46.400169] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:46.400390] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-27T20:42:46.400446] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-27T20:42:46.400627] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-27T20:42:46.400735] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-27T20:42:46.747295] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:46.814932] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-27T20:42:47.459990] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T20:42:47.614907] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-27T20:42:48.015965] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T20:42:48.414987] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-27T20:42:48.894483] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T20:42:49.215024] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-27T20:42:49.478336] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T20:42:49.887435] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T20:42:50.014952] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-27T20:42:50.814958] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-27T20:42:51.345818] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T20:42:51.614942] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-27T20:42:51.712620] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T20:42:52.414961] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-27T20:42:53.062000] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T20:42:53.214958] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-27T20:42:54.014930] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-27T20:42:54.106462] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T20:42:54.822956] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-27T20:42:54.828253] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T20:42:55.063108] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T20:42:55.444417] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T20:42:55.614958] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-27T20:42:56.189697] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-27T20:42:56.414973] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-27T20:42:57.198113] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T20:42:57.199696] [INFO ] [REMOTE ] PSF: Full fetch complete (9632 records). [2025-10-27T20:42:57.199768] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-27T20:42:57.220079] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-27T20:42:57.556203] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-27T20:42:57.556293] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-27T20:42:57.556501] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-27T20:42:57.556560] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-27T20:42:57.557011] [DEBUG] [LOCAL ] PSF: Trimmed 9632 records to 6791 (keeping 200 days of data) [2025-10-27T20:42:57.596216] [DEBUG] [LOCAL ] PSF: Primary data saved (6791 records). [2025-10-27T20:42:57.596303] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-27T20:42:57.596381] [INFO ] [MAIN ] Update Progress: 1732/2366 symbols completed. PSF took 18.1s. Estimated remaining: 1h 21m 36s. Rate: 7.8 symbols/min [2025-10-27T20:42:57.760613] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:42:57.801256] [DEBUG] [LOCAL ] PSN: Loaded 45674 existing records from primary storage. [2025-10-27T20:42:57.801560] [INFO ] [MAIN ] PSN: Loaded 45674 existing records. [2025-10-27T20:42:57.974593] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:42:57.974789] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-27T20:42:57.974834] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-27T20:42:57.975013] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-27T20:42:57.975049] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-27T20:42:58.020163] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-27T20:42:58.324853] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:42:58.669220] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T20:42:58.733410] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:42:58.814929] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-27T20:42:59.614992] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-27T20:43:00.414931] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-27T20:43:00.523587] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T20:43:00.531790] [INFO ] [REMOTE ] PSA: Full fetch complete (59410 records). [2025-10-27T20:43:00.531987] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-27T20:43:00.532940] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:43:00.533024] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:43:00.533068] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:43:00.533126] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-27T20:43:00.533187] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-27T20:43:00.533222] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-27T20:43:00.533342] [DEBUG] [LOCAL ] PSA: Deleted derivative data file. [2025-10-27T20:43:00.533453] [INFO ] [MAIN ] Update Progress: 1733/2366 symbols completed. PSA took 37.6s. Estimated remaining: 1h 21m 26s. Rate: 7.8 symbols/min [2025-10-27T20:43:00.715194] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:00.749844] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T20:43:00.791728] [DEBUG] [LOCAL ] PSO: Loaded 37103 existing records from primary storage. [2025-10-27T20:43:00.791998] [INFO ] [MAIN ] PSO: Loaded 37103 existing records. [2025-10-27T20:43:00.967132] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:00.967360] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-27T20:43:00.967409] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-27T20:43:00.967592] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-27T20:43:00.967629] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-27T20:43:01.222184] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-27T20:43:01.335600] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:01.567479] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:43:02.014964] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-27T20:43:02.621816] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T20:43:02.814916] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-27T20:43:02.917846] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T20:43:02.926895] [INFO ] [REMOTE ] PRU: Full fetch complete (74192 records). [2025-10-27T20:43:02.927009] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-27T20:43:02.927792] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:43:02.927876] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:43:02.927919] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:43:02.927956] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-27T20:43:02.928010] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-27T20:43:02.928045] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-27T20:43:02.928202] [DEBUG] [LOCAL ] PRU: Deleted derivative data file. [2025-10-27T20:43:02.928892] [INFO ] [MAIN ] Update Progress: 1734/2366 symbols completed. PRU took 53.1s. Estimated remaining: 1h 21m 17s. Rate: 7.8 symbols/min [2025-10-27T20:43:03.096339] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:03.130213] [DEBUG] [LOCAL ] PSQH: Loaded 35963 existing records from primary storage. [2025-10-27T20:43:03.130490] [INFO ] [MAIN ] PSQH: Loaded 35963 existing records. [2025-10-27T20:43:03.303218] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:03.303388] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-27T20:43:03.303433] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-27T20:43:03.303686] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-27T20:43:03.303742] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-27T20:43:03.621998] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-27T20:43:03.652480] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:04.251243] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T20:43:04.414912] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-27T20:43:05.174482] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T20:43:05.214957] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-27T20:43:05.915376] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T20:43:06.014897] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-27T20:43:06.538323] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T20:43:06.814987] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-27T20:43:07.374262] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T20:43:07.614956] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-27T20:43:08.414920] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-27T20:43:08.505524] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T20:43:09.016206] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T20:43:09.214961] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-27T20:43:09.934695] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T20:43:10.014901] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-27T20:43:10.744486] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T20:43:10.814929] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-27T20:43:11.614909] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-27T20:43:11.668782] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T20:43:12.363060] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T20:43:12.414909] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-27T20:43:13.077780] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T20:43:13.214907] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-27T20:43:14.014975] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-27T20:43:14.151694] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T20:43:14.272485] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T20:43:14.814943] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-27T20:43:15.328932] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T20:43:15.614950] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-27T20:43:16.034263] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T20:43:16.414916] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-27T20:43:16.825285] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T20:43:17.214991] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-27T20:43:17.541884] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T20:43:18.015056] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-27T20:43:18.675571] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T20:43:18.814971] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-27T20:43:19.614981] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-27T20:43:19.646100] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:43:20.276213] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-27T20:43:20.414903] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-27T20:43:20.544590] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:43:21.214988] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-27T20:43:21.460951] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T20:43:22.014989] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-27T20:43:22.109119] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T20:43:22.814989] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-27T20:43:23.131387] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T20:43:23.614944] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-27T20:43:24.259998] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T20:43:24.414939] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-27T20:43:24.636211] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T20:43:25.214954] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-27T20:43:25.739605] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T20:43:25.744798] [INFO ] [REMOTE ] PSFE: Full fetch complete (43029 records). [2025-10-27T20:43:25.744874] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-27T20:43:26.019281] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-27T20:43:26.122903] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-27T20:43:26.123011] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-27T20:43:26.123949] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-27T20:43:26.124095] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-27T20:43:26.125348] [DEBUG] [LOCAL ] PSFE: Trimmed 43029 records to 29157 (keeping 200 days of data) [2025-10-27T20:43:26.145904] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T20:43:26.242082] [INFO ] [REMOTE ] PSN: Full fetch complete (66383 records). [2025-10-27T20:43:26.249459] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-27T20:43:26.254861] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:43:26.256289] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:43:26.259133] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:43:26.265672] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-27T20:43:26.275227] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-27T20:43:26.275356] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-27T20:43:26.275531] [DEBUG] [LOCAL ] PSN: Deleted derivative data file. [2025-10-27T20:43:26.276090] [INFO ] [MAIN ] Update Progress: 1735/2366 symbols completed. PSN took 28.7s. Estimated remaining: 1h 21m 15s. Rate: 7.8 symbols/min [2025-10-27T20:43:26.434470] [DEBUG] [LOCAL ] PSFE: Primary data saved (29157 records). [2025-10-27T20:43:26.434688] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-27T20:43:26.435094] [INFO ] [MAIN ] Update Progress: 1736/2366 symbols completed. PSFE took 40.4s. Estimated remaining: 1h 21m 4s. Rate: 7.8 symbols/min [2025-10-27T20:43:26.612924] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:26.686029] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:26.718209] [DEBUG] [LOCAL ] PSTL: Loaded 20106 existing records from primary storage. [2025-10-27T20:43:26.718518] [INFO ] [MAIN ] PSTL: Loaded 20106 existing records. [2025-10-27T20:43:26.830840] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-27T20:43:26.854913] [DEBUG] [LOCAL ] PSTG: Loaded 53584 existing records from primary storage. [2025-10-27T20:43:26.912397] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:26.907737] [INFO ] [MAIN ] PSTG: Loaded 53584 existing records. [2025-10-27T20:43:26.944345] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-27T20:43:26.955749] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-27T20:43:26.984027] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-27T20:43:26.989975] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-27T20:43:27.244897] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:27.245246] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-27T20:43:27.245309] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-27T20:43:27.328459] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-27T20:43:27.335375] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-27T20:43:27.601003] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:27.642684] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-27T20:43:27.679019] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T20:43:27.892771] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:28.414928] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-27T20:43:28.539455] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T20:43:28.559102] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:43:29.214990] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-27T20:43:29.931148] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T20:43:30.014889] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-27T20:43:30.094509] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T20:43:30.814934] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-27T20:43:30.982690] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T20:43:31.614962] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-27T20:43:32.266463] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:43:32.414944] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-27T20:43:32.785843] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T20:43:33.214993] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-27T20:43:33.942045] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T20:43:34.014907] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-27T20:43:34.258161] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:43:34.265281] [INFO ] [REMOTE ] PSO: Full fetch complete (52820 records). [2025-10-27T20:43:34.265380] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-27T20:43:34.632233] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-27T20:43:34.632303] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-27T20:43:34.633197] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-27T20:43:34.633259] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-27T20:43:34.634249] [DEBUG] [LOCAL ] PSO: Trimmed 52820 records to 36199 (keeping 200 days of data) [2025-10-27T20:43:34.819547] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-27T20:43:34.846378] [DEBUG] [LOCAL ] PSO: Primary data saved (36199 records). [2025-10-27T20:43:34.846461] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-27T20:43:34.846532] [INFO ] [MAIN ] Update Progress: 1737/2366 symbols completed. PSO took 34.3s. Estimated remaining: 1h 20m 57s. Rate: 7.8 symbols/min [2025-10-27T20:43:35.016272] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:35.067406] [DEBUG] [LOCAL ] PSX: Loaded 53890 existing records from primary storage. [2025-10-27T20:43:35.067758] [INFO ] [MAIN ] PSX: Loaded 53890 existing records. [2025-10-27T20:43:35.239436] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:35.239672] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-27T20:43:35.239738] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-27T20:43:35.239989] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-10-27T20:43:35.240051] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-27T20:43:35.590462] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:35.614927] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-27T20:43:36.126746] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-27T20:43:36.170687] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T20:43:36.178421] [INFO ] [REMOTE ] PSQH: Full fetch complete (53214 records). [2025-10-27T20:43:36.178513] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-27T20:43:36.421610] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-27T20:43:36.547072] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-27T20:43:36.547141] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-27T20:43:36.548039] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-27T20:43:36.548100] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-27T20:43:36.549116] [DEBUG] [LOCAL ] PSQH: Trimmed 53214 records to 35315 (keeping 200 days of data) [2025-10-27T20:43:36.718006] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T20:43:36.766904] [DEBUG] [LOCAL ] PSQH: Primary data saved (35315 records). [2025-10-27T20:43:36.767004] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-27T20:43:36.767712] [INFO ] [MAIN ] Update Progress: 1738/2366 symbols completed. PSQH took 33.8s. Estimated remaining: 1h 20m 47s. Rate: 7.8 symbols/min [2025-10-27T20:43:36.931364] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:36.948822] [DEBUG] [LOCAL ] PTA: Loaded 15775 existing records from primary storage. [2025-10-27T20:43:36.949045] [INFO ] [MAIN ] PTA: Loaded 15775 existing records. [2025-10-27T20:43:37.121022] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:37.121224] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-27T20:43:37.121281] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-27T20:43:37.121445] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-27T20:43:37.121499] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-27T20:43:37.218679] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-27T20:43:37.475065] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:38.014913] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-27T20:43:38.375998] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-27T20:43:38.427936] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T20:43:38.814954] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-27T20:43:39.497549] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:43:39.520597] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T20:43:39.614920] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-27T20:43:40.414987] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-27T20:43:40.717209] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T20:43:41.214960] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-27T20:43:41.571295] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:43:41.966941] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T20:43:42.014969] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-27T20:43:42.734048] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:43:42.739006] [INFO ] [REMOTE ] PSTL: Full fetch complete (29288 records). [2025-10-27T20:43:42.739097] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-27T20:43:42.820109] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-27T20:43:43.168339] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-27T20:43:43.168421] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-27T20:43:43.169240] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-27T20:43:43.169307] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-27T20:43:43.170286] [DEBUG] [LOCAL ] PSTL: Trimmed 29288 records to 19704 (keeping 200 days of data) [2025-10-27T20:43:43.301157] [DEBUG] [LOCAL ] PSTL: Primary data saved (19704 records). [2025-10-27T20:43:43.301289] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-27T20:43:43.301389] [INFO ] [MAIN ] Update Progress: 1739/2366 symbols completed. PSTL took 16.9s. Estimated remaining: 1h 20m 39s. Rate: 7.8 symbols/min [2025-10-27T20:43:43.498571] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:43.536769] [DEBUG] [LOCAL ] PTY: Loaded 38464 existing records from primary storage. [2025-10-27T20:43:43.537061] [INFO ] [MAIN ] PTY: Loaded 38464 existing records. [2025-10-27T20:43:43.615380] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-27T20:43:43.745241] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:43.747000] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T20:43:43.747113] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-27T20:43:43.750120] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-27T20:43:43.751139] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-27T20:43:43.751208] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-27T20:43:44.100121] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:44.414977] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-27T20:43:45.108804] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T20:43:45.131332] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T20:43:45.214910] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-27T20:43:46.014999] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-27T20:43:46.733980] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T20:43:46.814904] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-27T20:43:47.454779] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T20:43:47.614932] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-27T20:43:48.414918] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-27T20:43:48.748314] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T20:43:49.122932] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T20:43:49.214940] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-27T20:43:50.014917] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-27T20:43:50.301378] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T20:43:50.330751] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T20:43:50.814945] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-27T20:43:51.418952] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T20:43:51.614967] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-27T20:43:51.988300] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T20:43:52.414928] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-27T20:43:52.711403] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T20:43:53.214943] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-27T20:43:53.950488] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T20:43:54.014905] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-27T20:43:54.583230] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T20:43:54.734720] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T20:43:54.744133] [INFO ] [REMOTE ] PSTG: Full fetch complete (76294 records). [2025-10-27T20:43:54.744261] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-27T20:43:54.745098] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:43:54.745201] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:43:54.745275] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:43:54.745370] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-27T20:43:54.745449] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-27T20:43:54.745488] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-27T20:43:54.745696] [DEBUG] [LOCAL ] PSTG: Deleted derivative data file. [2025-10-27T20:43:54.745789] [INFO ] [MAIN ] Update Progress: 1740/2366 symbols completed. PSTG took 28.5s. Estimated remaining: 1h 20m 32s. Rate: 7.8 symbols/min [2025-10-27T20:43:54.820141] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-27T20:43:54.916124] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:43:54.955453] [DEBUG] [LOCAL ] PUK: Loaded 44998 existing records from primary storage. [2025-10-27T20:43:54.955754] [INFO ] [MAIN ] PUK: Loaded 44998 existing records. [2025-10-27T20:43:55.132356] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:43:55.132536] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-27T20:43:55.132582] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-27T20:43:55.133046] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-27T20:43:55.133102] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-27T20:43:55.474164] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:43:55.614903] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-27T20:43:55.883944] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:43:56.414982] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-27T20:43:56.900980] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T20:43:57.214960] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-27T20:43:57.458193] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T20:43:58.014989] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-27T20:43:58.766293] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T20:43:58.784771] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T20:43:58.814904] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-27T20:43:59.614953] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-27T20:44:00.414961] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-27T20:44:00.635313] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T20:44:01.215037] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-27T20:44:01.688023] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T20:44:01.729432] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T20:44:01.974124] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T20:44:02.014951] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-27T20:44:02.784437] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T20:44:02.788922] [INFO ] [REMOTE ] PTA: Full fetch complete (22694 records). [2025-10-27T20:44:02.788999] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-27T20:44:02.820026] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-27T20:44:03.152600] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-27T20:44:03.152711] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-27T20:44:03.153169] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-27T20:44:03.153228] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-27T20:44:03.153823] [DEBUG] [LOCAL ] PTA: Trimmed 22694 records to 15268 (keeping 200 days of data) [2025-10-27T20:44:03.244952] [DEBUG] [LOCAL ] PTA: Primary data saved (15268 records). [2025-10-27T20:44:03.245070] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-27T20:44:03.245144] [INFO ] [MAIN ] Update Progress: 1741/2366 symbols completed. PTA took 26.5s. Estimated remaining: 1h 20m 25s. Rate: 7.8 symbols/min [2025-10-27T20:44:03.432741] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:03.475553] [DEBUG] [LOCAL ] PUMP: Loaded 50189 existing records from primary storage. [2025-10-27T20:44:03.475862] [INFO ] [MAIN ] PUMP: Loaded 50189 existing records. [2025-10-27T20:44:03.623180] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-27T20:44:03.653710] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:03.654098] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-27T20:44:03.654195] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-27T20:44:03.654436] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-27T20:44:03.654507] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-27T20:44:04.011099] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:04.414933] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-27T20:44:04.808832] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T20:44:05.215516] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-27T20:44:05.220226] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T20:44:05.860526] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T20:44:06.014917] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-27T20:44:06.814990] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-27T20:44:06.955805] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:44:07.614975] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-27T20:44:07.894342] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-27T20:44:08.414954] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-27T20:44:08.455941] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T20:44:09.214906] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-27T20:44:09.587176] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T20:44:09.611798] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T20:44:10.014954] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-27T20:44:10.814968] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-27T20:44:10.852548] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T20:44:11.354353] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T20:44:11.614996] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-27T20:44:12.203324] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T20:44:12.415013] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-27T20:44:13.184382] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T20:44:13.214896] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-27T20:44:13.959004] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T20:44:14.014908] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-27T20:44:14.600978] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T20:44:14.814968] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-27T20:44:15.373528] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T20:44:15.381707] [INFO ] [REMOTE ] PTY: Full fetch complete (54678 records). [2025-10-27T20:44:15.381830] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-27T20:44:15.624995] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-27T20:44:15.760350] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-27T20:44:15.760436] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-27T20:44:15.761355] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-27T20:44:15.761416] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-27T20:44:15.762504] [DEBUG] [LOCAL ] PTY: Trimmed 54678 records to 37696 (keeping 200 days of data) [2025-10-27T20:44:15.991414] [DEBUG] [LOCAL ] PTY: Primary data saved (37696 records). [2025-10-27T20:44:15.991529] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-27T20:44:15.991601] [INFO ] [MAIN ] Update Progress: 1742/2366 symbols completed. PTY took 32.7s. Estimated remaining: 1h 20m 19s. Rate: 7.8 symbols/min [2025-10-27T20:44:16.165029] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:16.207597] [DEBUG] [LOCAL ] PVH: Loaded 50019 existing records from primary storage. [2025-10-27T20:44:16.216100] [INFO ] [MAIN ] PVH: Loaded 50019 existing records. [2025-10-27T20:44:16.301830] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T20:44:16.419871] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:16.420075] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-27T20:44:16.420127] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-27T20:44:16.420317] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-27T20:44:16.420373] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-27T20:44:16.416936] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-27T20:44:16.776273] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:17.215002] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-27T20:44:17.391453] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T20:44:18.014970] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-27T20:44:18.192425] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T20:44:18.426443] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-27T20:44:18.814950] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-27T20:44:19.418781] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:44:19.614936] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-27T20:44:20.112899] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T20:44:20.414929] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-27T20:44:20.621119] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T20:44:20.631036] [INFO ] [REMOTE ] PSX: Full fetch complete (76740 records). [2025-10-27T20:44:20.631197] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-27T20:44:20.632013] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:44:20.632110] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:44:20.632152] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:44:20.632190] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-27T20:44:20.632266] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-27T20:44:20.632301] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-27T20:44:20.632425] [DEBUG] [LOCAL ] PSX: Deleted derivative data file. [2025-10-27T20:44:20.632523] [INFO ] [MAIN ] Update Progress: 1743/2366 symbols completed. PSX took 45.8s. Estimated remaining: 1h 20m 10s. Rate: 7.8 symbols/min [2025-10-27T20:44:20.814277] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:20.822520] [DEBUG] [LOCAL ] PVL: Loaded 4793 existing records from primary storage. [2025-10-27T20:44:20.822811] [INFO ] [MAIN ] PVL: Loaded 4793 existing records. [2025-10-27T20:44:21.022309] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:21.022536] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-27T20:44:21.022583] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-27T20:44:21.022748] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-27T20:44:21.022805] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-27T20:44:21.220101] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-27T20:44:21.399871] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:22.015020] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-27T20:44:22.053047] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T20:44:22.615961] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:44:22.814933] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-27T20:44:23.342065] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T20:44:23.614940] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-27T20:44:24.414924] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-27T20:44:24.560259] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T20:44:24.969484] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T20:44:25.214927] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-27T20:44:25.228269] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T20:44:26.014919] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-27T20:44:26.762053] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T20:44:26.815024] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-27T20:44:27.099975] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T20:44:27.108633] [INFO ] [REMOTE ] PUK: Full fetch complete (65303 records). [2025-10-27T20:44:27.108777] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-27T20:44:27.492814] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-27T20:44:27.492888] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-27T20:44:27.493875] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-27T20:44:27.493937] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-27T20:44:27.495128] [DEBUG] [LOCAL ] PUK: Trimmed 65303 records to 44209 (keeping 200 days of data) [2025-10-27T20:44:27.615016] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-27T20:44:27.789439] [DEBUG] [LOCAL ] PUK: Primary data saved (44209 records). [2025-10-27T20:44:27.789564] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-27T20:44:27.790010] [INFO ] [MAIN ] Update Progress: 1744/2366 symbols completed. PUK took 33.0s. Estimated remaining: 1h 20m 2s. Rate: 7.8 symbols/min [2025-10-27T20:44:27.960486] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:28.008591] [DEBUG] [LOCAL ] PWR: Loaded 47102 existing records from primary storage. [2025-10-27T20:44:28.009055] [INFO ] [MAIN ] PWR: Loaded 47102 existing records. [2025-10-27T20:44:28.201012] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:28.201326] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-27T20:44:28.201436] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-27T20:44:28.201826] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-10-27T20:44:28.201960] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-27T20:44:28.334731] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T20:44:28.420043] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-27T20:44:28.608097] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:29.200686] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:44:29.214896] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-27T20:44:29.597880] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T20:44:29.734429] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-27T20:44:30.014990] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-27T20:44:30.814997] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-27T20:44:31.614988] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-27T20:44:31.961381] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-27T20:44:32.080118] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:44:32.211489] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T20:44:32.414970] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-27T20:44:32.975135] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T20:44:33.214942] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-27T20:44:34.014960] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-27T20:44:34.826286] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-27T20:44:34.833164] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T20:44:35.577065] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:44:35.614911] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-27T20:44:35.844531] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T20:44:35.854433] [INFO ] [REMOTE ] PUMP: Full fetch complete (71431 records). [2025-10-27T20:44:35.854684] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-27T20:44:35.855779] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:44:35.855873] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:44:35.855917] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:44:35.855959] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-27T20:44:35.856030] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-27T20:44:35.856066] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-27T20:44:35.856232] [DEBUG] [LOCAL ] PUMP: Deleted derivative data file. [2025-10-27T20:44:35.857147] [INFO ] [MAIN ] Update Progress: 1745/2366 symbols completed. PUMP took 32.6s. Estimated remaining: 1h 19m 55s. Rate: 7.8 symbols/min [2025-10-27T20:44:36.031192] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:36.069843] [DEBUG] [LOCAL ] PX: Loaded 34249 existing records from primary storage. [2025-10-27T20:44:36.070214] [INFO ] [MAIN ] PX: Loaded 34249 existing records. [2025-10-27T20:44:36.265419] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:36.265749] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-27T20:44:36.265811] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-27T20:44:36.266174] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-27T20:44:36.266237] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-27T20:44:36.424830] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-27T20:44:36.653852] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:37.178054] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-27T20:44:37.214962] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-27T20:44:37.248771] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T20:44:37.669184] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T20:44:38.014937] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-27T20:44:38.814944] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-27T20:44:39.338020] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T20:44:39.614983] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-27T20:44:39.798874] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T20:44:40.188400] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T20:44:40.189883] [INFO ] [REMOTE ] PVL: Full fetch complete (7089 records). [2025-10-27T20:44:40.189951] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-27T20:44:40.422904] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-27T20:44:40.551670] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-27T20:44:40.551761] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-27T20:44:40.551957] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-27T20:44:40.551997] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-27T20:44:40.552362] [DEBUG] [LOCAL ] PVL: Trimmed 7089 records to 4761 (keeping 200 days of data) [2025-10-27T20:44:40.579701] [DEBUG] [LOCAL ] PVL: Primary data saved (4761 records). [2025-10-27T20:44:40.579806] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-27T20:44:40.579882] [INFO ] [MAIN ] Update Progress: 1746/2366 symbols completed. PVL took 19.9s. Estimated remaining: 1h 19m 46s. Rate: 7.8 symbols/min [2025-10-27T20:44:40.746347] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:40.746489] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-27T20:44:40.746527] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-27T20:44:40.746674] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-27T20:44:40.746743] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-27T20:44:40.746827] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-27T20:44:40.746885] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-27T20:44:41.105562] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:41.214921] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-27T20:44:42.014949] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-27T20:44:42.228275] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:44:42.671286] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-27T20:44:42.814933] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-27T20:44:43.597193] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:44:43.614896] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-27T20:44:44.286789] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T20:44:44.414922] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-27T20:44:45.220054] [INFO ] [REMOTE ] PXED: Fetching primary data for 2025-01. [2025-10-27T20:44:45.236076] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T20:44:45.707699] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:44:45.708022] [WARN ] [REMOTE ] PXED: No data returned for month 2025-01 [2025-10-27T20:44:45.708112] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:44:45.708157] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-27T20:44:45.708217] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:44:45.708287] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-27T20:44:45.708351] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-27T20:44:45.708386] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-27T20:44:45.708424] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-27T20:44:45.708470] [INFO ] [MAIN ] Update Progress: 1747/2366 symbols completed. PXED took 5.1s. Estimated remaining: 1h 19m 37s. Rate: 7.8 symbols/min [2025-10-27T20:44:45.878090] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:45.903826] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T20:44:45.961298] [DEBUG] [LOCAL ] QBTS: Loaded 54600 existing records from primary storage. [2025-10-27T20:44:45.961632] [INFO ] [MAIN ] QBTS: Loaded 54600 existing records. [2025-10-27T20:44:46.021479] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-27T20:44:46.139069] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:46.139268] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-27T20:44:46.139314] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-27T20:44:46.139498] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-10-27T20:44:46.139535] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-27T20:44:46.485765] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:46.814960] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-27T20:44:47.623143] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-27T20:44:47.629302] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T20:44:48.414977] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-27T20:44:48.503716] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T20:44:48.828583] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T20:44:49.214977] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-27T20:44:50.014932] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-27T20:44:50.684685] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T20:44:50.815805] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-27T20:44:50.815723] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-27T20:44:51.545373] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T20:44:51.614941] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-27T20:44:52.250019] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T20:44:52.414971] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-27T20:44:53.060090] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T20:44:53.214957] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-27T20:44:53.762485] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T20:44:53.770346] [INFO ] [REMOTE ] PVH: Full fetch complete (70431 records). [2025-10-27T20:44:53.770488] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-27T20:44:53.771330] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:44:53.771430] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:44:53.771528] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:44:53.771620] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-27T20:44:53.771734] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-27T20:44:53.771780] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-27T20:44:53.771898] [DEBUG] [LOCAL ] PVH: Deleted derivative data file. [2025-10-27T20:44:53.771976] [INFO ] [MAIN ] Update Progress: 1748/2366 symbols completed. PVH took 37.8s. Estimated remaining: 1h 19m 30s. Rate: 7.8 symbols/min [2025-10-27T20:44:53.952399] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:44:53.978701] [DEBUG] [LOCAL ] QD: Loaded 27746 existing records from primary storage. [2025-10-27T20:44:53.978994] [INFO ] [MAIN ] QD: Loaded 27746 existing records. [2025-10-27T20:44:54.021437] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-27T20:44:54.160239] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:44:54.160585] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-27T20:44:54.160807] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-27T20:44:54.173336] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-27T20:44:54.186302] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-27T20:44:54.291107] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:44:54.548310] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:44:54.814956] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-27T20:44:55.615026] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-27T20:44:55.941510] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T20:44:56.414979] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-27T20:44:56.605979] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T20:44:56.824189] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-27T20:44:57.215021] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-27T20:44:58.014949] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-27T20:44:58.424356] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T20:44:58.820139] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-27T20:44:58.822714] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-27T20:44:59.614986] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-27T20:45:00.284875] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:45:00.293585] [INFO ] [REMOTE ] PWR: Full fetch complete (68771 records). [2025-10-27T20:45:00.293730] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-27T20:45:00.294472] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:45:00.294559] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:45:00.294600] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:45:00.294637] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-27T20:45:00.294735] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-27T20:45:00.294773] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-27T20:45:00.294919] [DEBUG] [LOCAL ] PWR: Deleted derivative data file. [2025-10-27T20:45:00.295315] [INFO ] [MAIN ] Update Progress: 1749/2366 symbols completed. PWR took 32.5s. Estimated remaining: 1h 19m 21s. Rate: 7.8 symbols/min [2025-10-27T20:45:00.418322] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-27T20:45:00.485185] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:00.487080] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:45:00.547812] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-27T20:45:00.573353] [DEBUG] [LOCAL ] QGEN: Loaded 49728 existing records from primary storage. [2025-10-27T20:45:00.573660] [INFO ] [MAIN ] QGEN: Loaded 49728 existing records. [2025-10-27T20:45:00.744978] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:00.745184] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-27T20:45:00.745230] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-27T20:45:00.745550] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-27T20:45:00.745587] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-27T20:45:01.094754] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:01.214952] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-27T20:45:01.765955] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T20:45:02.015005] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-27T20:45:02.814969] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-27T20:45:03.178620] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T20:45:03.342171] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T20:45:03.614985] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-27T20:45:04.414996] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-27T20:45:04.916603] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T20:45:04.922076] [INFO ] [REMOTE ] PX: Full fetch complete (49470 records). [2025-10-27T20:45:04.922188] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-27T20:45:05.220163] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-27T20:45:05.321759] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-27T20:45:05.321856] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-27T20:45:05.322750] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-27T20:45:05.322878] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-27T20:45:05.323988] [DEBUG] [LOCAL ] PX: Trimmed 49470 records to 33364 (keeping 200 days of data) [2025-10-27T20:45:05.453877] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-27T20:45:05.564711] [DEBUG] [LOCAL ] PX: Primary data saved (33364 records). [2025-10-27T20:45:05.564849] [INFO ] [MAIN ] PX: Full history saved. [2025-10-27T20:45:05.565548] [INFO ] [MAIN ] Update Progress: 1750/2366 symbols completed. PX took 29.7s. Estimated remaining: 1h 19m 13s. Rate: 7.8 symbols/min [2025-10-27T20:45:05.742077] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:05.792297] [DEBUG] [LOCAL ] QS: Loaded 54540 existing records from primary storage. [2025-10-27T20:45:05.792796] [INFO ] [MAIN ] QS: Loaded 54540 existing records. [2025-10-27T20:45:05.973121] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:05.973318] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-27T20:45:05.973398] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-27T20:45:05.973681] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-27T20:45:05.973737] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-27T20:45:06.023956] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-27T20:45:06.207915] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T20:45:06.433251] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:06.451224] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T20:45:06.814955] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-27T20:45:07.615006] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-27T20:45:08.415033] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-27T20:45:08.638693] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T20:45:08.748353] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-27T20:45:09.215042] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-27T20:45:09.471046] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T20:45:10.014999] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-27T20:45:10.047848] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-27T20:45:10.815028] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-27T20:45:11.543877] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T20:45:11.614926] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-27T20:45:12.147519] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-10-27T20:45:12.247356] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T20:45:12.414975] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-27T20:45:13.137060] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T20:45:13.214957] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-27T20:45:14.015000] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-27T20:45:14.601968] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-27T20:45:14.814943] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-27T20:45:14.902875] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T20:45:15.614944] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-27T20:45:15.948110] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T20:45:16.414958] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-27T20:45:16.648212] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-27T20:45:17.024439] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T20:45:17.214934] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-27T20:45:18.015007] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-27T20:45:18.603803] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T20:45:18.815039] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-27T20:45:19.006215] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:45:19.326492] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T20:45:19.614991] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-27T20:45:20.414935] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-27T20:45:20.526568] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T20:45:21.214926] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-27T20:45:21.841069] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-27T20:45:21.970772] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T20:45:22.014912] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-27T20:45:22.815049] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-27T20:45:22.859922] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T20:45:23.051809] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:45:23.061901] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-27T20:45:23.062028] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-27T20:45:23.062866] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:45:23.062952] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:45:23.062994] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:45:23.063031] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-27T20:45:23.063086] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-27T20:45:23.063119] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-27T20:45:23.063251] [DEBUG] [LOCAL ] QBTS: Deleted derivative data file. [2025-10-27T20:45:23.063330] [INFO ] [MAIN ] Update Progress: 1751/2366 symbols completed. QBTS took 37.4s. Estimated remaining: 1h 19m 9s. Rate: 7.8 symbols/min [2025-10-27T20:45:23.248452] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:23.297465] [DEBUG] [LOCAL ] QSR: Loaded 53166 existing records from primary storage. [2025-10-27T20:45:23.297848] [INFO ] [MAIN ] QSR: Loaded 53166 existing records. [2025-10-27T20:45:23.473164] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:23.473367] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-27T20:45:23.473416] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-27T20:45:23.473600] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-27T20:45:23.473639] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-27T20:45:23.620066] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-27T20:45:23.861744] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:23.901234] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T20:45:24.415016] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-27T20:45:25.215001] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-27T20:45:25.488391] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T20:45:26.000419] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T20:45:26.005396] [INFO ] [REMOTE ] QD: Full fetch complete (39901 records). [2025-10-27T20:45:26.005475] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-27T20:45:26.020064] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-27T20:45:26.196203] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T20:45:26.303693] [INFO ] [REMOTE ] QGEN: Full fetch complete (70752 records). [2025-10-27T20:45:26.331367] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-27T20:45:26.582186] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-27T20:45:26.592157] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-27T20:45:26.608988] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-27T20:45:26.611201] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-27T20:45:26.714595] [DEBUG] [LOCAL ] QD: Trimmed 39901 records to 27303 (keeping 200 days of data) [2025-10-27T20:45:26.837545] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-27T20:45:26.928560] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-27T20:45:26.932984] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-27T20:45:26.935772] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-27T20:45:26.941757] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-27T20:45:26.977051] [DEBUG] [LOCAL ] QGEN: Trimmed 70752 records to 48922 (keeping 200 days of data) [2025-10-27T20:45:27.048478] [DEBUG] [LOCAL ] QD: Primary data saved (27303 records). [2025-10-27T20:45:27.074009] [INFO ] [MAIN ] QD: Full history saved. [2025-10-27T20:45:27.074470] [INFO ] [MAIN ] Update Progress: 1752/2366 symbols completed. QD took 33.3s. Estimated remaining: 1h 18m 60s. Rate: 7.8 symbols/min [2025-10-27T20:45:27.251254] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:27.389781] [DEBUG] [LOCAL ] QTWO: Loaded 39985 existing records from primary storage. [2025-10-27T20:45:27.405750] [INFO ] [MAIN ] QTWO: Loaded 39985 existing records. [2025-10-27T20:45:27.650345] [DEBUG] [LOCAL ] QGEN: Primary data saved (48922 records). [2025-10-27T20:45:27.646855] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:27.650514] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-27T20:45:27.651274] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-27T20:45:27.651216] [INFO ] [MAIN ] Update Progress: 1753/2366 symbols completed. QGEN took 27.4s. Estimated remaining: 1h 18m 49s. Rate: 7.8 symbols/min [2025-10-27T20:45:27.673110] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-27T20:45:27.730777] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-27T20:45:27.736077] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-27T20:45:27.956441] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:28.070501] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-27T20:45:28.117617] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-27T20:45:28.214430] [DEBUG] [LOCAL ] QUAD: Loaded 23268 existing records from primary storage. [2025-10-27T20:45:28.247894] [INFO ] [MAIN ] QUAD: Loaded 23268 existing records. [2025-10-27T20:45:28.344895] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:28.426178] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-27T20:45:28.467638] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:28.468030] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-27T20:45:28.468100] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-27T20:45:28.468320] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-27T20:45:28.468378] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-27T20:45:28.811503] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:29.214975] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-27T20:45:29.413929] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-27T20:45:29.584472] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:45:29.871038] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T20:45:30.014964] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-27T20:45:30.083367] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:45:30.815023] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-27T20:45:31.614945] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-27T20:45:31.828117] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T20:45:32.067253] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T20:45:32.414932] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-27T20:45:33.205365] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:45:33.214912] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-27T20:45:34.015013] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-27T20:45:34.136002] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T20:45:34.341144] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T20:45:34.814964] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-27T20:45:35.542871] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T20:45:35.614900] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-27T20:45:36.414929] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-27T20:45:36.657833] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T20:45:37.214936] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-27T20:45:37.252050] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T20:45:38.015007] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-27T20:45:38.814989] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-27T20:45:38.911528] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T20:45:38.938422] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T20:45:39.013676] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-27T20:45:39.614999] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-27T20:45:39.940440] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T20:45:40.415026] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-27T20:45:41.215039] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-27T20:45:41.456032] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T20:45:42.015038] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-27T20:45:42.293554] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T20:45:42.364811] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T20:45:42.814953] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-27T20:45:42.980542] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T20:45:43.614944] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-27T20:45:43.833834] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T20:45:44.414996] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-27T20:45:45.215057] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-27T20:45:45.336139] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T20:45:46.014961] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-27T20:45:46.089610] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T20:45:46.814944] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-27T20:45:46.866254] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-27T20:45:47.394762] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T20:45:47.614928] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-27T20:45:48.023118] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T20:45:48.414960] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-27T20:45:48.872795] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T20:45:49.214933] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-27T20:45:50.014946] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-27T20:45:50.562515] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-27T20:45:50.573221] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-27T20:45:50.573419] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-27T20:45:50.822797] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-27T20:45:50.903984] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T20:45:51.008422] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-27T20:45:51.008515] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-27T20:45:51.009639] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-27T20:45:51.009732] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-27T20:45:51.011335] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 53760 (keeping 200 days of data) [2025-10-27T20:45:51.335678] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T20:45:51.351708] [INFO ] [REMOTE ] QTWO: Full fetch complete (58180 records). [2025-10-27T20:45:51.352904] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-27T20:45:51.356980] [DEBUG] [LOCAL ] QS: Primary data saved (53760 records). [2025-10-27T20:45:51.389533] [INFO ] [MAIN ] QS: Full history saved. [2025-10-27T20:45:51.422024] [INFO ] [MAIN ] Update Progress: 1754/2366 symbols completed. QS took 45.9s. Estimated remaining: 1h 18m 47s. Rate: 7.8 symbols/min [2025-10-27T20:45:51.619976] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-27T20:45:51.728826] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:51.855452] [DEBUG] [LOCAL ] QVCC: Loaded 8787 existing records from primary storage. [2025-10-27T20:45:51.881869] [INFO ] [MAIN ] QVCC: Loaded 8787 existing records. [2025-10-27T20:45:52.095091] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-27T20:45:52.160828] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:52.155121] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-27T20:45:52.161094] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-27T20:45:52.162547] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-27T20:45:52.162397] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-27T20:45:52.162827] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-27T20:45:52.162961] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-27T20:45:52.163234] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-27T20:45:52.237736] [DEBUG] [LOCAL ] QTWO: Trimmed 58180 records to 39260 (keeping 200 days of data) [2025-10-27T20:45:52.359211] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T20:45:52.490260] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-27T20:45:52.666435] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:52.791366] [DEBUG] [LOCAL ] QTWO: Primary data saved (39260 records). [2025-10-27T20:45:52.791509] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-27T20:45:52.791586] [INFO ] [MAIN ] Update Progress: 1755/2366 symbols completed. QTWO took 25.7s. Estimated remaining: 1h 18m 37s. Rate: 7.8 symbols/min [2025-10-27T20:45:52.957595] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:52.964333] [DEBUG] [LOCAL ] QVCD: Loaded 4594 existing records from primary storage. [2025-10-27T20:45:52.964540] [INFO ] [MAIN ] QVCD: Loaded 4594 existing records. [2025-10-27T20:45:53.150344] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:53.150677] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-27T20:45:53.150774] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-27T20:45:53.151027] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-27T20:45:53.151123] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-27T20:45:53.241595] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-27T20:45:53.568275] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:53.571573] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-27T20:45:53.637713] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:45:54.014907] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-27T20:45:54.163793] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:45:54.814968] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-27T20:45:55.395388] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T20:45:55.614909] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-27T20:45:55.693751] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T20:45:55.703701] [INFO ] [REMOTE ] QSR: Full fetch complete (76048 records). [2025-10-27T20:45:55.703815] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-27T20:45:56.097438] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-27T20:45:56.097514] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-27T20:45:56.098606] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-27T20:45:56.098691] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-27T20:45:56.100027] [DEBUG] [LOCAL ] QSR: Trimmed 76048 records to 52372 (keeping 200 days of data) [2025-10-27T20:45:56.208894] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T20:45:56.417791] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-27T20:45:56.432426] [DEBUG] [LOCAL ] QSR: Primary data saved (52372 records). [2025-10-27T20:45:56.432510] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-27T20:45:56.432584] [INFO ] [MAIN ] Update Progress: 1756/2366 symbols completed. QSR took 33.4s. Estimated remaining: 1h 18m 28s. Rate: 7.8 symbols/min [2025-10-27T20:45:56.606063] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:45:56.653799] [DEBUG] [LOCAL ] QXO: Loaded 54255 existing records from primary storage. [2025-10-27T20:45:56.654095] [INFO ] [MAIN ] QXO: Loaded 54255 existing records. [2025-10-27T20:45:56.829592] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:45:56.829813] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-27T20:45:56.829863] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-27T20:45:56.830113] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-27T20:45:56.830155] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-27T20:45:57.181624] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:45:57.189043] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T20:45:57.214903] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-27T20:45:57.790764] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T20:45:58.014953] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-27T20:45:58.814931] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-27T20:45:58.908402] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T20:45:59.227173] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T20:45:59.614940] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-27T20:46:00.414952] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-27T20:46:00.455594] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T20:46:01.214982] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-27T20:46:02.014994] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-27T20:46:02.036382] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:46:02.234618] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T20:46:02.464215] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T20:46:02.814958] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-27T20:46:03.607859] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T20:46:03.612050] [INFO ] [REMOTE ] QUAD: Full fetch complete (33926 records). [2025-10-27T20:46:03.612126] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-27T20:46:03.623143] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-27T20:46:04.009611] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-27T20:46:04.009724] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-27T20:46:04.010414] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-27T20:46:04.010455] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-27T20:46:04.011382] [DEBUG] [LOCAL ] QUAD: Trimmed 33926 records to 22857 (keeping 200 days of data) [2025-10-27T20:46:04.141623] [DEBUG] [LOCAL ] QUAD: Primary data saved (22857 records). [2025-10-27T20:46:04.141773] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-27T20:46:04.141852] [INFO ] [MAIN ] Update Progress: 1757/2366 symbols completed. QUAD took 36.5s. Estimated remaining: 1h 18m 20s. Rate: 7.8 symbols/min [2025-10-27T20:46:04.414974] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-27T20:46:04.977593] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T20:46:05.070377] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:46:05.214950] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-27T20:46:06.014729] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T20:46:06.016930] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-27T20:46:06.814972] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-27T20:46:06.955762] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T20:46:07.449515] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T20:46:07.614935] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-27T20:46:08.414961] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-27T20:46:08.538964] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T20:46:08.541145] [INFO ] [REMOTE ] QVCC: Full fetch complete (11872 records). [2025-10-27T20:46:08.541216] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-27T20:46:08.945466] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-27T20:46:08.945555] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-27T20:46:08.945886] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-27T20:46:08.945955] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-27T20:46:08.946400] [DEBUG] [LOCAL ] QVCC: Trimmed 11872 records to 8554 (keeping 200 days of data) [2025-10-27T20:46:08.999674] [DEBUG] [LOCAL ] QVCC: Primary data saved (8554 records). [2025-10-27T20:46:08.999808] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-27T20:46:08.999928] [INFO ] [MAIN ] Update Progress: 1758/2366 symbols completed. QVCC took 17.6s. Estimated remaining: 1h 18m 12s. Rate: 7.8 symbols/min [2025-10-27T20:46:09.214998] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-27T20:46:09.935747] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T20:46:10.014905] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-27T20:46:10.214146] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T20:46:10.811531] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:46:10.814889] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-27T20:46:11.553492] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T20:46:11.614920] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-27T20:46:12.066149] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T20:46:12.414949] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-27T20:46:13.102728] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T20:46:13.104239] [INFO ] [REMOTE ] QVCD: Full fetch complete (6179 records). [2025-10-27T20:46:13.104310] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-27T20:46:13.219999] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-27T20:46:13.470818] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-27T20:46:13.470892] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-27T20:46:13.471071] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-27T20:46:13.471110] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-27T20:46:13.471478] [DEBUG] [LOCAL ] QVCD: Trimmed 6179 records to 4443 (keeping 200 days of data) [2025-10-27T20:46:13.498201] [DEBUG] [LOCAL ] QVCD: Primary data saved (4443 records). [2025-10-27T20:46:13.498333] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-27T20:46:13.498413] [INFO ] [MAIN ] Update Progress: 1759/2366 symbols completed. QVCD took 20.7s. Estimated remaining: 1h 18m 3s. Rate: 7.8 symbols/min [2025-10-27T20:46:15.145015] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T20:46:15.155998] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-27T20:46:17.029560] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T20:46:17.040519] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-27T20:46:18.704132] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T20:46:18.715127] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-27T20:46:20.831024] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T20:46:20.843040] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-27T20:46:22.380611] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T20:46:22.391852] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-27T20:46:23.972028] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T20:46:23.983436] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-27T20:46:26.036185] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T20:46:26.046406] [INFO ] [REMOTE ] QXO: Full fetch complete (76397 records). [2025-10-27T20:46:26.046542] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-27T20:46:26.432107] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-27T20:46:26.432188] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-27T20:46:26.433284] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-27T20:46:26.433345] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-27T20:46:26.434712] [DEBUG] [LOCAL ] QXO: Trimmed 76397 records to 53489 (keeping 200 days of data) [2025-10-27T20:46:26.766725] [DEBUG] [LOCAL ] QXO: Primary data saved (53489 records). [2025-10-27T20:46:26.766847] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-27T20:46:26.766929] [INFO ] [MAIN ] Update Progress: 1760/2366 symbols completed. QXO took 30.3s. Estimated remaining: 1h 17m 57s. Rate: 7.8 symbols/min [2025-10-27T20:46:27.402593] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:27.455141] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:27.479970] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:27.550698] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:27.596488] [DEBUG] [LOCAL ] RA: Loaded 22239 existing records from primary storage. [2025-10-27T20:46:27.597446] [DEBUG] [LOCAL ] R: Loaded 28502 existing records from primary storage. [2025-10-27T20:46:27.600636] [INFO ] [MAIN ] R: Loaded 28502 existing records. [2025-10-27T20:46:27.600301] [INFO ] [MAIN ] RA: Loaded 22239 existing records. [2025-10-27T20:46:27.671767] [DEBUG] [LOCAL ] RACE: Loaded 33563 existing records from primary storage. [2025-10-27T20:46:27.732282] [INFO ] [MAIN ] RACE: Loaded 33563 existing records. [2025-10-27T20:46:27.969409] [DEBUG] [LOCAL ] RAMP: Loaded 38175 existing records from primary storage. [2025-10-27T20:46:28.011890] [INFO ] [MAIN ] RAMP: Loaded 38175 existing records. [2025-10-27T20:46:28.227005] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:28.263218] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:28.302825] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-27T20:46:28.366116] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-27T20:46:28.365887] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:28.371421] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-27T20:46:28.377236] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-27T20:46:28.387990] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-27T20:46:28.376998] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-27T20:46:28.398669] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-27T20:46:28.398830] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-27T20:46:28.393292] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-27T20:46:28.411160] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-27T20:46:28.441037] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-27T20:46:28.435801] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-27T20:46:28.645561] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:28.759830] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-27T20:46:28.804287] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-27T20:46:28.911556] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-27T20:46:28.932748] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-27T20:46:29.959603] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:30.005114] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-27T20:46:30.167484] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:30.242039] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-27T20:46:30.283602] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:30.284783] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-27T20:46:30.364823] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:30.365130] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-27T20:46:31.480030] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T20:46:31.485152] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-27T20:46:31.522432] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T20:46:31.529598] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-27T20:46:31.641991] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T20:46:31.648703] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-27T20:46:31.665361] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T20:46:31.671616] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-27T20:46:32.622466] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T20:46:32.627532] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-27T20:46:33.012097] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T20:46:33.019917] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-27T20:46:33.085731] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:46:33.095128] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-27T20:46:33.238183] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T20:46:33.245262] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-27T20:46:33.937001] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T20:46:33.942156] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-27T20:46:34.263633] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T20:46:34.276190] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-27T20:46:34.324731] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T20:46:34.334369] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-27T20:46:34.718866] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-27T20:46:34.728830] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-27T20:46:34.778980] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T20:46:34.784203] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-27T20:46:35.587184] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T20:46:35.595418] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-27T20:46:35.693334] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T20:46:35.701962] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-27T20:46:35.823480] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T20:46:35.827586] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-27T20:46:36.474595] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T20:46:36.483549] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-27T20:46:36.571931] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:46:36.577157] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-27T20:46:37.036135] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T20:46:37.042494] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-27T20:46:37.101540] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:46:37.214941] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-27T20:46:37.646114] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T20:46:37.712604] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T20:46:38.014949] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-27T20:46:38.231734] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T20:46:38.429726] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T20:46:38.814913] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-27T20:46:39.208288] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T20:46:39.614956] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-27T20:46:40.072041] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T20:46:40.415011] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-27T20:46:40.825186] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T20:46:41.214966] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-27T20:46:41.332813] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T20:46:42.011724] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T20:46:42.015986] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-27T20:46:42.814913] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-27T20:46:42.862620] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T20:46:43.614959] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-27T20:46:44.246171] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T20:46:44.414925] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-27T20:46:45.130829] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T20:46:45.214921] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-27T20:46:45.958423] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T20:46:46.014896] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-27T20:46:46.639285] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T20:46:46.814988] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-27T20:46:47.515200] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T20:46:47.614893] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-27T20:46:47.770594] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T20:46:47.775249] [INFO ] [REMOTE ] RA: Full fetch complete (31937 records). [2025-10-27T20:46:47.775322] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-27T20:46:48.151612] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-27T20:46:48.151706] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-27T20:46:48.152334] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-27T20:46:48.152375] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-27T20:46:48.153169] [DEBUG] [LOCAL ] RA: Trimmed 31937 records to 21637 (keeping 200 days of data) [2025-10-27T20:46:48.279491] [DEBUG] [LOCAL ] RA: Primary data saved (21637 records). [2025-10-27T20:46:48.279608] [INFO ] [MAIN ] RA: Full history saved. [2025-10-27T20:46:48.279704] [INFO ] [MAIN ] Update Progress: 1761/2366 symbols completed. RA took 21.5s. Estimated remaining: 1h 17m 54s. Rate: 7.8 symbols/min [2025-10-27T20:46:48.416670] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-27T20:46:48.447062] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:48.489740] [DEBUG] [LOCAL ] RBA: Loaded 46713 existing records from primary storage. [2025-10-27T20:46:48.490020] [INFO ] [MAIN ] RBA: Loaded 46713 existing records. [2025-10-27T20:46:48.663100] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:48.663921] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-27T20:46:48.663980] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-27T20:46:48.664353] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-27T20:46:48.664390] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-27T20:46:49.026459] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:49.046488] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:46:49.054350] [INFO ] [REMOTE ] RAMP: Full fetch complete (54633 records). [2025-10-27T20:46:49.054447] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-27T20:46:49.055032] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:46:49.055113] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:46:49.055154] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:46:49.055215] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-27T20:46:49.055275] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-27T20:46:49.055308] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-27T20:46:49.055448] [DEBUG] [LOCAL ] RAMP: Deleted derivative data file. [2025-10-27T20:46:49.055544] [INFO ] [MAIN ] Update Progress: 1762/2366 symbols completed. RAMP took 22.3s. Estimated remaining: 1h 17m 44s. Rate: 7.8 symbols/min [2025-10-27T20:46:49.239180] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:49.237672] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-27T20:46:49.240873] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T20:46:49.262050] [DEBUG] [LOCAL ] RBC: Loaded 15509 existing records from primary storage. [2025-10-27T20:46:49.262279] [INFO ] [MAIN ] RBC: Loaded 15509 existing records. [2025-10-27T20:46:49.434473] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:49.434689] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-27T20:46:49.434749] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-27T20:46:49.434903] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-27T20:46:49.434940] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-27T20:46:49.779701] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:49.794358] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T20:46:49.799721] [INFO ] [REMOTE ] R: Full fetch complete (42434 records). [2025-10-27T20:46:49.799800] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-27T20:46:49.800339] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:46:49.800439] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:46:49.800485] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:46:49.800523] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-27T20:46:49.800577] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-27T20:46:49.800611] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-27T20:46:49.800782] [DEBUG] [LOCAL ] R: Deleted derivative data file. [2025-10-27T20:46:49.800871] [INFO ] [MAIN ] Update Progress: 1763/2366 symbols completed. R took 23.0s. Estimated remaining: 1h 17m 34s. Rate: 7.8 symbols/min [2025-10-27T20:46:49.963210] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:50.012490] [DEBUG] [LOCAL ] RBLX: Loaded 54497 existing records from primary storage. [2025-10-27T20:46:50.012813] [INFO ] [MAIN ] RBLX: Loaded 54497 existing records. [2025-10-27T20:46:50.023495] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-27T20:46:50.190020] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:50.190230] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-27T20:46:50.190284] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-27T20:46:50.190940] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-27T20:46:50.190996] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-27T20:46:50.535294] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:50.814903] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-27T20:46:51.615005] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-27T20:46:52.183281] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-27T20:46:52.191728] [INFO ] [REMOTE ] RACE: Full fetch complete (49798 records). [2025-10-27T20:46:52.191828] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-27T20:46:52.419895] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-27T20:46:52.591120] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-27T20:46:52.591345] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-27T20:46:52.590980] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T20:46:52.592490] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-27T20:46:52.592626] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-27T20:46:52.597320] [DEBUG] [LOCAL ] RACE: Trimmed 49798 records to 32773 (keeping 200 days of data) [2025-10-27T20:46:52.804344] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T20:46:52.835660] [DEBUG] [LOCAL ] RACE: Primary data saved (32773 records). [2025-10-27T20:46:52.835765] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-27T20:46:52.835840] [INFO ] [MAIN ] Update Progress: 1764/2366 symbols completed. RACE took 26.1s. Estimated remaining: 1h 17m 25s. Rate: 7.8 symbols/min [2025-10-27T20:46:53.017054] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:46:53.025156] [DEBUG] [LOCAL ] RBOT: Loaded 6349 existing records from primary storage. [2025-10-27T20:46:53.025328] [INFO ] [MAIN ] RBOT: Loaded 6349 existing records. [2025-10-27T20:46:53.229485] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:46:53.224693] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-27T20:46:53.229746] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-27T20:46:53.229810] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-27T20:46:53.230007] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-27T20:46:53.230601] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-27T20:46:53.578914] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:46:54.014913] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-27T20:46:54.086424] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T20:46:54.420200] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T20:46:54.814909] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-27T20:46:54.888181] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:46:55.615004] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-27T20:46:56.138553] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T20:46:56.414917] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-27T20:46:56.672425] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T20:46:57.214949] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-27T20:46:58.014938] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-27T20:46:58.099840] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T20:46:58.814910] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-27T20:46:58.852392] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T20:46:58.947268] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-27T20:46:59.616932] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-27T20:46:59.619593] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T20:47:00.414914] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-27T20:47:00.698672] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T20:47:01.214938] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-27T20:47:01.921214] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T20:47:02.014913] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-27T20:47:02.215516] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T20:47:02.814999] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-27T20:47:03.528123] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T20:47:03.614946] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-27T20:47:03.957914] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T20:47:04.414967] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-27T20:47:05.031497] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T20:47:05.214945] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-27T20:47:05.495145] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T20:47:06.014921] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-27T20:47:06.572678] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T20:47:06.814958] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-27T20:47:07.058894] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T20:47:07.532163] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T20:47:07.614949] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-27T20:47:08.414952] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-27T20:47:09.214930] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-27T20:47:09.331113] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T20:47:09.598817] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T20:47:10.014954] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-27T20:47:10.111423] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T20:47:10.814959] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-27T20:47:11.339431] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T20:47:11.614993] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-27T20:47:12.208528] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T20:47:12.414950] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-27T20:47:12.695506] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T20:47:13.214939] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-27T20:47:13.371567] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T20:47:13.374390] [INFO ] [REMOTE ] RBOT: Full fetch complete (9119 records). [2025-10-27T20:47:13.374458] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-27T20:47:13.722776] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-27T20:47:13.722850] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-27T20:47:13.723090] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-27T20:47:13.723129] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-27T20:47:13.723528] [DEBUG] [LOCAL ] RBOT: Trimmed 9119 records to 6283 (keeping 200 days of data) [2025-10-27T20:47:13.757990] [DEBUG] [LOCAL ] RBOT: Primary data saved (6283 records). [2025-10-27T20:47:13.758087] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-27T20:47:13.758158] [INFO ] [MAIN ] Update Progress: 1765/2366 symbols completed. RBOT took 20.9s. Estimated remaining: 1h 17m 21s. Rate: 7.8 symbols/min [2025-10-27T20:47:13.929694] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:13.977339] [DEBUG] [LOCAL ] RBRK: Loaded 53941 existing records from primary storage. [2025-10-27T20:47:13.977694] [INFO ] [MAIN ] RBRK: Loaded 53941 existing records. [2025-10-27T20:47:14.020180] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-27T20:47:14.152585] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:14.152838] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-27T20:47:14.152897] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-27T20:47:14.153158] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-27T20:47:14.153195] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-27T20:47:14.494494] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:14.814922] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-27T20:47:15.206442] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T20:47:15.584307] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-27T20:47:15.614903] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-27T20:47:16.414965] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-27T20:47:16.605291] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:47:17.214954] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-27T20:47:17.359829] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T20:47:17.734935] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T20:47:18.014923] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-27T20:47:18.815021] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-27T20:47:19.012870] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T20:47:19.140629] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T20:47:19.614947] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-27T20:47:20.415007] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-27T20:47:21.169539] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T20:47:21.173157] [INFO ] [REMOTE ] RBC: Full fetch complete (21859 records). [2025-10-27T20:47:21.173229] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-27T20:47:21.173687] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:47:21.173770] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:47:21.173818] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:47:21.173879] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-27T20:47:21.173941] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-27T20:47:21.173975] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-27T20:47:21.174100] [DEBUG] [LOCAL ] RBC: Deleted derivative data file. [2025-10-27T20:47:21.174164] [INFO ] [MAIN ] Update Progress: 1766/2366 symbols completed. RBC took 32.1s. Estimated remaining: 1h 17m 14s. Rate: 7.8 symbols/min [2025-10-27T20:47:21.216818] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-27T20:47:21.352925] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:21.388859] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T20:47:21.441850] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-27T20:47:21.469246] [DEBUG] [LOCAL ] RC: Loaded 49562 existing records from primary storage. [2025-10-27T20:47:21.469530] [INFO ] [MAIN ] RC: Loaded 49562 existing records. [2025-10-27T20:47:21.642352] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:21.642572] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-27T20:47:21.642619] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-27T20:47:21.642938] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-27T20:47:21.642993] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-27T20:47:21.987567] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:22.014907] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-27T20:47:22.721739] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T20:47:22.814909] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-27T20:47:23.614925] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-27T20:47:23.773389] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T20:47:24.121366] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T20:47:24.414932] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-27T20:47:25.214944] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-27T20:47:25.592021] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T20:47:25.602773] [INFO ] [REMOTE ] RBLX: Full fetch complete (77886 records). [2025-10-27T20:47:25.602985] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-27T20:47:25.991279] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-27T20:47:25.991459] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-27T20:47:25.992594] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-27T20:47:25.992679] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-27T20:47:25.994092] [DEBUG] [LOCAL ] RBLX: Trimmed 77886 records to 53717 (keeping 200 days of data) [2025-10-27T20:47:26.042632] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-27T20:47:26.333171] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T20:47:26.348803] [DEBUG] [LOCAL ] RBLX: Primary data saved (53717 records). [2025-10-27T20:47:26.359103] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-27T20:47:26.359615] [INFO ] [MAIN ] Update Progress: 1767/2366 symbols completed. RBLX took 36.6s. Estimated remaining: 1h 17m 5s. Rate: 7.8 symbols/min [2025-10-27T20:47:26.523891] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:26.524062] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-27T20:47:26.524116] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-27T20:47:26.524222] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-27T20:47:26.524262] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-27T20:47:26.524302] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-27T20:47:26.524334] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-27T20:47:26.828724] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-27T20:47:26.869091] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:27.218360] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-27T20:47:27.614942] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-27T20:47:27.697491] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T20:47:27.924753] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T20:47:27.933546] [INFO ] [REMOTE ] RBA: Full fetch complete (66347 records). [2025-10-27T20:47:27.933717] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-27T20:47:27.934455] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:47:27.934558] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:47:27.934633] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:47:27.934762] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-27T20:47:27.934854] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-27T20:47:27.934911] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-27T20:47:27.935042] [DEBUG] [LOCAL ] RBA: Deleted derivative data file. [2025-10-27T20:47:27.935709] [INFO ] [MAIN ] Update Progress: 1768/2366 symbols completed. RBA took 39.7s. Estimated remaining: 1h 16m 55s. Rate: 7.8 symbols/min [2025-10-27T20:47:28.102199] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:28.108019] [DEBUG] [LOCAL ] RCD: Loaded 3401 existing records from primary storage. [2025-10-27T20:47:28.108208] [INFO ] [MAIN ] RCD: Loaded 3401 existing records. [2025-10-27T20:47:28.278326] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:28.278537] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-27T20:47:28.278584] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-27T20:47:28.278749] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-10-27T20:47:28.278804] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-27T20:47:28.418414] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-27T20:47:28.623705] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:29.214927] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-27T20:47:29.647126] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T20:47:29.653759] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-27T20:47:30.014985] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-27T20:47:30.224622] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:47:30.814982] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-27T20:47:31.615083] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-27T20:47:31.980631] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-27T20:47:32.071821] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T20:47:32.414973] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-27T20:47:32.566006] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T20:47:33.214957] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-27T20:47:33.720018] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T20:47:34.014958] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-27T20:47:34.815010] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-27T20:47:35.330442] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T20:47:35.351173] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T20:47:35.597294] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T20:47:35.614920] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-27T20:47:36.414962] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-27T20:47:37.214968] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-27T20:47:37.431315] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T20:47:37.470449] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T20:47:38.014970] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-27T20:47:38.784092] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T20:47:38.815050] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-27T20:47:39.614980] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-27T20:47:40.015976] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T20:47:40.032490] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T20:47:40.414944] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-27T20:47:41.056163] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-27T20:47:41.214928] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-27T20:47:41.940275] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T20:47:42.014941] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-27T20:47:42.216774] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T20:47:42.663713] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:47:42.814942] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-27T20:47:43.455316] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T20:47:43.614973] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-27T20:47:44.414917] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-27T20:47:44.562975] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T20:47:44.577360] [INFO ] [REMOTE ] RC: Full fetch complete (70742 records). [2025-10-27T20:47:44.577622] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-27T20:47:44.578905] [FATAL] [VALIDATOR ] RC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:47:44.579001] [FATAL] [MAIN ] RC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:47:44.579046] [WARN ] [MAIN ] RC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:47:44.579095] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-27T20:47:44.579184] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-27T20:47:44.579232] [INFO ] [LOCAL ] RC: Starting deletion of derivative data. [2025-10-27T20:47:44.579408] [DEBUG] [LOCAL ] RC: Deleted derivative data file. [2025-10-27T20:47:44.579506] [INFO ] [MAIN ] Update Progress: 1769/2366 symbols completed. RC took 23.4s. Estimated remaining: 1h 16m 51s. Rate: 7.8 symbols/min [2025-10-27T20:47:44.750775] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:44.798511] [DEBUG] [LOCAL ] RCI: Loaded 49335 existing records from primary storage. [2025-10-27T20:47:44.798930] [INFO ] [MAIN ] RCI: Loaded 49335 existing records. [2025-10-27T20:47:44.987310] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:44.987709] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-27T20:47:44.987777] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-27T20:47:44.988104] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-27T20:47:44.988146] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-27T20:47:45.222705] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-27T20:47:45.375780] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:45.874094] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T20:47:46.014959] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-27T20:47:46.470066] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-27T20:47:46.480909] [INFO ] [REMOTE ] RBRK: Full fetch complete (76714 records). [2025-10-27T20:47:46.481091] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-27T20:47:46.764774] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T20:47:46.820034] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-27T20:47:46.905191] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-27T20:47:46.905293] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-27T20:47:46.906496] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-27T20:47:46.906560] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-27T20:47:46.908144] [DEBUG] [LOCAL ] RBRK: Trimmed 76714 records to 53161 (keeping 200 days of data) [2025-10-27T20:47:47.214885] [DEBUG] [LOCAL ] RBRK: Primary data saved (53161 records). [2025-10-27T20:47:47.215013] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-27T20:47:47.215090] [INFO ] [MAIN ] Update Progress: 1770/2366 symbols completed. RBRK took 33.5s. Estimated remaining: 1h 16m 41s. Rate: 7.8 symbols/min [2025-10-27T20:47:47.328355] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T20:47:47.392338] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:47.443155] [DEBUG] [LOCAL ] RCL: Loaded 52384 existing records from primary storage. [2025-10-27T20:47:47.443490] [INFO ] [MAIN ] RCL: Loaded 52384 existing records. [2025-10-27T20:47:47.620451] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-27T20:47:47.620345] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:47.621924] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-27T20:47:47.622064] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-27T20:47:47.622594] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-10-27T20:47:47.622756] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-27T20:47:48.010776] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:48.358874] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:47:48.415001] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-27T20:47:49.214995] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-27T20:47:50.014971] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-27T20:47:50.390320] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T20:47:50.456332] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T20:47:50.743340] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T20:47:50.814970] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-27T20:47:51.614982] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-27T20:47:52.054497] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T20:47:52.414927] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-27T20:47:52.517388] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T20:47:52.888342] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-27T20:47:53.214986] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-27T20:47:54.015012] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-27T20:47:54.422523] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T20:47:54.814915] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-27T20:47:54.879083] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T20:47:55.243103] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T20:47:55.244330] [INFO ] [REMOTE ] RCB: Full fetch complete (3689 records). [2025-10-27T20:47:55.244419] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-27T20:47:55.244947] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:47:55.245048] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:47:55.245108] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:47:55.245194] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-27T20:47:55.245296] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-27T20:47:55.245365] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-27T20:47:55.245453] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-27T20:47:55.245555] [INFO ] [MAIN ] Update Progress: 1771/2366 symbols completed. RCB took 28.9s. Estimated remaining: 1h 16m 33s. Rate: 7.8 symbols/min [2025-10-27T20:47:55.428128] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:47:55.441056] [DEBUG] [LOCAL ] RCS: Loaded 12587 existing records from primary storage. [2025-10-27T20:47:55.441287] [INFO ] [MAIN ] RCS: Loaded 12587 existing records. [2025-10-27T20:47:55.611985] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:47:55.612182] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-27T20:47:55.612227] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-27T20:47:55.612407] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-27T20:47:55.612462] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-27T20:47:55.620150] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-27T20:47:55.961756] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:47:56.414945] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-27T20:47:57.203578] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-27T20:47:57.214893] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-27T20:47:57.546473] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T20:47:58.014918] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-27T20:47:58.248902] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T20:47:58.814985] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-27T20:47:59.614927] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-27T20:47:59.743066] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T20:48:00.031896] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T20:48:00.276350] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T20:48:00.414947] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-27T20:48:01.214938] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-27T20:48:01.237676] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T20:48:01.937227] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T20:48:02.014941] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-27T20:48:02.814923] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-27T20:48:02.896958] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T20:48:03.614916] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-27T20:48:04.414990] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-27T20:48:04.587325] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T20:48:04.742397] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T20:48:04.991131] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T20:48:04.992306] [INFO ] [REMOTE ] RCD: Full fetch complete (5767 records). [2025-10-27T20:48:04.992375] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-27T20:48:05.220093] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-27T20:48:05.352937] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-27T20:48:05.353091] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-27T20:48:05.353264] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-27T20:48:05.353303] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-27T20:48:05.353748] [DEBUG] [LOCAL ] RCD: Trimmed 5767 records to 3252 (keeping 200 days of data) [2025-10-27T20:48:05.374581] [DEBUG] [LOCAL ] RCD: Primary data saved (3252 records). [2025-10-27T20:48:05.374690] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-27T20:48:05.374777] [INFO ] [MAIN ] Update Progress: 1772/2366 symbols completed. RCD took 37.4s. Estimated remaining: 1h 16m 27s. Rate: 7.8 symbols/min [2025-10-27T20:48:05.541737] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:05.583508] [DEBUG] [LOCAL ] RCUS: Loaded 43513 existing records from primary storage. [2025-10-27T20:48:05.583816] [INFO ] [MAIN ] RCUS: Loaded 43513 existing records. [2025-10-27T20:48:05.757899] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:05.758113] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-27T20:48:05.758162] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-27T20:48:05.758717] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-27T20:48:05.758776] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-27T20:48:06.018048] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-27T20:48:06.124470] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T20:48:06.129133] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:06.814966] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-27T20:48:07.425006] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:48:07.614949] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-27T20:48:08.298155] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T20:48:08.414988] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-27T20:48:09.215017] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-27T20:48:09.462275] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T20:48:10.014944] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-27T20:48:10.077491] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T20:48:10.262382] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-27T20:48:10.814998] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-27T20:48:11.585373] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T20:48:11.614900] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-27T20:48:12.415036] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-27T20:48:13.066000] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-27T20:48:13.214914] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-27T20:48:13.390266] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T20:48:13.726459] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T20:48:13.860100] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T20:48:14.014904] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-27T20:48:14.814993] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-27T20:48:15.614925] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-27T20:48:15.846075] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T20:48:16.406708] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:48:16.416036] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-27T20:48:17.197434] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T20:48:17.201430] [INFO ] [REMOTE ] RCS: Full fetch complete (18633 records). [2025-10-27T20:48:17.201541] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-27T20:48:17.222691] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-27T20:48:17.628821] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T20:48:17.628947] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-27T20:48:17.638888] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-27T20:48:17.639302] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-27T20:48:17.639488] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-27T20:48:17.640704] [DEBUG] [LOCAL ] RCS: Trimmed 18633 records to 12263 (keeping 200 days of data) [2025-10-27T20:48:17.711332] [DEBUG] [LOCAL ] RCS: Primary data saved (12263 records). [2025-10-27T20:48:17.711454] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-27T20:48:17.711530] [INFO ] [MAIN ] Update Progress: 1773/2366 symbols completed. RCS took 22.5s. Estimated remaining: 1h 16m 20s. Rate: 7.8 symbols/min [2025-10-27T20:48:17.875383] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:17.926758] [DEBUG] [LOCAL ] RDDT: Loaded 54549 existing records from primary storage. [2025-10-27T20:48:17.927087] [INFO ] [MAIN ] RDDT: Loaded 54549 existing records. [2025-10-27T20:48:18.021039] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-27T20:48:18.100752] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:18.100984] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-27T20:48:18.101043] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-27T20:48:18.101251] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-27T20:48:18.101306] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-27T20:48:18.445787] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:18.814917] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-27T20:48:19.065489] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T20:48:19.199350] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T20:48:19.393914] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T20:48:19.402978] [INFO ] [REMOTE ] RCL: Full fetch complete (74981 records). [2025-10-27T20:48:19.403106] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-27T20:48:19.403914] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:48:19.404026] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:48:19.404090] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:48:19.404163] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-27T20:48:19.404226] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-27T20:48:19.404263] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-27T20:48:19.404421] [DEBUG] [LOCAL ] RCL: Deleted derivative data file. [2025-10-27T20:48:19.404513] [INFO ] [MAIN ] Update Progress: 1774/2366 symbols completed. RCL took 32.2s. Estimated remaining: 1h 16m 11s. Rate: 7.8 symbols/min [2025-10-27T20:48:19.567122] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:19.604671] [DEBUG] [LOCAL ] RDN: Loaded 44595 existing records from primary storage. [2025-10-27T20:48:19.604988] [INFO ] [MAIN ] RDN: Loaded 44595 existing records. [2025-10-27T20:48:19.625295] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-27T20:48:19.800280] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:19.800471] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-27T20:48:19.800518] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-27T20:48:19.800810] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-27T20:48:19.800867] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-27T20:48:20.149636] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:20.414951] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-27T20:48:21.214953] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-27T20:48:21.589859] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T20:48:22.014965] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-27T20:48:22.272557] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T20:48:22.509912] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T20:48:22.814937] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-27T20:48:23.614951] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-27T20:48:24.373405] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:48:24.414904] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-27T20:48:24.547672] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-27T20:48:24.842632] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T20:48:25.214950] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-27T20:48:25.706614] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T20:48:26.015001] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-27T20:48:26.814967] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-27T20:48:27.345971] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T20:48:27.615893] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-27T20:48:27.616049] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-27T20:48:28.059222] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T20:48:28.414949] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-27T20:48:29.215017] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-27T20:48:29.335680] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T20:48:30.015050] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-27T20:48:30.533214] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T20:48:30.814930] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-27T20:48:31.115555] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-27T20:48:31.167504] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:48:31.614978] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-27T20:48:32.286967] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T20:48:32.414898] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-27T20:48:32.928232] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:48:32.937954] [INFO ] [REMOTE ] RCUS: Full fetch complete (61043 records). [2025-10-27T20:48:32.938322] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-27T20:48:32.940120] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:48:32.940383] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:48:32.940559] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:48:32.940634] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-27T20:48:32.940751] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-27T20:48:32.940793] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-27T20:48:32.940976] [DEBUG] [LOCAL ] RCUS: Deleted derivative data file. [2025-10-27T20:48:32.941792] [INFO ] [MAIN ] Update Progress: 1775/2366 symbols completed. RCUS took 27.6s. Estimated remaining: 1h 16m 5s. Rate: 7.8 symbols/min [2025-10-27T20:48:33.150400] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:33.154166] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T20:48:33.222800] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-27T20:48:33.227420] [DEBUG] [LOCAL ] RDW: Loaded 53064 existing records from primary storage. [2025-10-27T20:48:33.228005] [INFO ] [MAIN ] RDW: Loaded 53064 existing records. [2025-10-27T20:48:33.408959] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:33.409206] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-27T20:48:33.409265] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-27T20:48:33.409497] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-27T20:48:33.409553] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-27T20:48:33.767521] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:34.014969] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-27T20:48:34.814952] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-27T20:48:35.017683] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T20:48:35.614944] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-27T20:48:36.414971] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-27T20:48:36.516232] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T20:48:36.526153] [INFO ] [REMOTE ] RCI: Full fetch complete (70768 records). [2025-10-27T20:48:36.526310] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-27T20:48:36.934735] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-27T20:48:36.934848] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-27T20:48:36.936037] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-27T20:48:36.936158] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-27T20:48:36.967205] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-27T20:48:36.965861] [DEBUG] [LOCAL ] RCI: Trimmed 70768 records to 48551 (keeping 200 days of data) [2025-10-27T20:48:37.218274] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-27T20:48:37.272791] [DEBUG] [LOCAL ] RCI: Primary data saved (48551 records). [2025-10-27T20:48:37.272909] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-27T20:48:37.272985] [INFO ] [MAIN ] Update Progress: 1776/2366 symbols completed. RCI took 52.7s. Estimated remaining: 1h 15m 56s. Rate: 7.8 symbols/min [2025-10-27T20:48:37.472633] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T20:48:37.475736] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:37.527572] [DEBUG] [LOCAL ] RDY: Loaded 46820 existing records from primary storage. [2025-10-27T20:48:37.527888] [INFO ] [MAIN ] RDY: Loaded 46820 existing records. [2025-10-27T20:48:37.703897] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:37.704156] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-27T20:48:37.704217] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-27T20:48:37.704412] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-27T20:48:37.704467] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-27T20:48:38.021905] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-27T20:48:38.053431] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:38.313774] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-27T20:48:38.814987] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-27T20:48:39.610607] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T20:48:39.618708] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-27T20:48:39.827675] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-27T20:48:40.414964] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-27T20:48:40.666865] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T20:48:41.215000] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-27T20:48:41.418170] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T20:48:42.014943] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-27T20:48:42.820072] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-27T20:48:42.840718] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T20:48:43.016129] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T20:48:43.558801] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T20:48:43.614910] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-27T20:48:44.321411] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T20:48:44.414935] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-27T20:48:45.117133] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:48:45.150735] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T20:48:45.158201] [INFO ] [REMOTE ] RDN: Full fetch complete (65274 records). [2025-10-27T20:48:45.158355] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-27T20:48:45.159160] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:48:45.159254] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:48:45.159295] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:48:45.159367] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-27T20:48:45.159430] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-27T20:48:45.159463] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-27T20:48:45.159591] [DEBUG] [LOCAL ] RDN: Deleted derivative data file. [2025-10-27T20:48:45.159685] [INFO ] [MAIN ] Update Progress: 1777/2366 symbols completed. RDN took 25.8s. Estimated remaining: 1h 15m 48s. Rate: 7.8 symbols/min [2025-10-27T20:48:45.220305] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-27T20:48:45.333272] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:45.375531] [DEBUG] [LOCAL ] RELX: Loaded 49251 existing records from primary storage. [2025-10-27T20:48:45.375882] [INFO ] [MAIN ] RELX: Loaded 49251 existing records. [2025-10-27T20:48:45.549211] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:45.549404] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-27T20:48:45.549449] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-27T20:48:45.549680] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-27T20:48:45.549737] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-27T20:48:45.894798] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:46.014932] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-27T20:48:46.814935] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-27T20:48:46.969806] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T20:48:47.614951] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-27T20:48:48.053452] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T20:48:48.414943] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-27T20:48:48.570017] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-27T20:48:49.215003] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-27T20:48:49.523306] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T20:48:49.755550] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T20:48:50.014983] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-27T20:48:50.814915] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-27T20:48:50.887978] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-27T20:48:51.614991] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-27T20:48:52.117435] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T20:48:52.220275] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T20:48:52.414968] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-27T20:48:53.115730] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T20:48:53.214915] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-27T20:48:54.014980] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-27T20:48:54.358127] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T20:48:54.814953] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-27T20:48:54.901052] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T20:48:55.614928] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-27T20:48:56.414931] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-27T20:48:56.681151] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-27T20:48:56.752824] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-27T20:48:56.763257] [INFO ] [REMOTE ] RDDT: Full fetch complete (77926 records). [2025-10-27T20:48:56.763427] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-27T20:48:57.151143] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-27T20:48:57.151324] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-27T20:48:57.152512] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-27T20:48:57.152635] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-27T20:48:57.154202] [DEBUG] [LOCAL ] RDDT: Trimmed 77926 records to 53769 (keeping 200 days of data) [2025-10-27T20:48:57.239523] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-27T20:48:57.413258] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T20:48:57.525381] [DEBUG] [LOCAL ] RDDT: Primary data saved (53769 records). [2025-10-27T20:48:57.525528] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-27T20:48:57.525990] [INFO ] [MAIN ] Update Progress: 1778/2366 symbols completed. RDDT took 39.8s. Estimated remaining: 1h 15m 42s. Rate: 7.8 symbols/min [2025-10-27T20:48:57.689162] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:48:57.730765] [DEBUG] [LOCAL ] RERE: Loaded 42354 existing records from primary storage. [2025-10-27T20:48:57.731086] [INFO ] [MAIN ] RERE: Loaded 42354 existing records. [2025-10-27T20:48:57.906057] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:48:57.906283] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-27T20:48:57.906336] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-27T20:48:57.906530] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-27T20:48:57.906585] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-27T20:48:58.020059] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-27T20:48:58.254463] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:48:58.445315] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T20:48:58.758161] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T20:48:58.814910] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-27T20:48:59.614961] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-27T20:48:59.789741] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T20:49:00.414922] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-27T20:49:00.480617] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:49:01.190221] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T20:49:01.214908] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-27T20:49:01.995030] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T20:49:02.014952] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-27T20:49:02.814926] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-27T20:49:02.909957] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T20:49:03.078433] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T20:49:03.614942] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-27T20:49:04.414947] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-27T20:49:04.730926] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T20:49:05.214917] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-27T20:49:05.249913] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T20:49:06.014926] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-27T20:49:06.141281] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T20:49:06.814949] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-27T20:49:07.167307] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T20:49:07.175812] [INFO ] [REMOTE ] RDY: Full fetch complete (68385 records). [2025-10-27T20:49:07.175931] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-27T20:49:07.559729] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-27T20:49:07.559841] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-27T20:49:07.560934] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-27T20:49:07.561011] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-27T20:49:07.562520] [DEBUG] [LOCAL ] RDY: Trimmed 68385 records to 46035 (keeping 200 days of data) [2025-10-27T20:49:07.617708] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-27T20:49:07.691111] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-27T20:49:07.884566] [DEBUG] [LOCAL ] RDY: Primary data saved (46035 records). [2025-10-27T20:49:07.884721] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-27T20:49:07.884807] [INFO ] [MAIN ] Update Progress: 1779/2366 symbols completed. RDY took 30.6s. Estimated remaining: 1h 15m 35s. Rate: 7.8 symbols/min [2025-10-27T20:49:08.058888] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:08.099638] [DEBUG] [LOCAL ] RES: Loaded 47576 existing records from primary storage. [2025-10-27T20:49:08.099946] [INFO ] [MAIN ] RES: Loaded 47576 existing records. [2025-10-27T20:49:08.278681] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:08.279092] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-27T20:49:08.279176] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-27T20:49:08.279492] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-27T20:49:08.279558] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-27T20:49:08.422373] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-27T20:49:08.451220] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T20:49:08.676626] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:09.214925] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-27T20:49:09.280147] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T20:49:10.014909] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-27T20:49:10.805347] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-27T20:49:10.815949] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-27T20:49:10.817957] [INFO ] [REMOTE ] RDW: Full fetch complete (75613 records). [2025-10-27T20:49:10.818065] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-27T20:49:11.248418] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-27T20:49:11.244145] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T20:49:11.248836] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-27T20:49:11.259171] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-27T20:49:11.259555] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-27T20:49:11.260144] [INFO ] [REMOTE ] RELX: Full fetch complete (68560 records). [2025-10-27T20:49:11.260231] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-27T20:49:11.326601] [DEBUG] [LOCAL ] RDW: Trimmed 75613 records to 52316 (keeping 200 days of data) [2025-10-27T20:49:11.661430] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T20:49:11.705507] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-27T20:49:11.810625] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-27T20:49:11.816851] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-27T20:49:11.818271] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-27T20:49:11.868307] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-27T20:49:11.908893] [DEBUG] [LOCAL ] RELX: Trimmed 68560 records to 48478 (keeping 200 days of data) [2025-10-27T20:49:12.245960] [DEBUG] [LOCAL ] RDW: Primary data saved (52316 records). [2025-10-27T20:49:12.248853] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-27T20:49:12.250318] [INFO ] [MAIN ] Update Progress: 1780/2366 symbols completed. RDW took 39.3s. Estimated remaining: 1h 15m 26s. Rate: 7.8 symbols/min [2025-10-27T20:49:12.475731] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:12.486294] [DEBUG] [LOCAL ] RELX: Primary data saved (48478 records). [2025-10-27T20:49:12.486524] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-27T20:49:12.486717] [INFO ] [MAIN ] Update Progress: 1781/2366 symbols completed. RELX took 27.3s. Estimated remaining: 1h 15m 16s. Rate: 7.8 symbols/min [2025-10-27T20:49:12.720920] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:12.722997] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-27T20:49:12.734358] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-27T20:49:12.747121] [DEBUG] [LOCAL ] REVG: Loaded 40708 existing records from primary storage. [2025-10-27T20:49:12.747506] [INFO ] [MAIN ] REVG: Loaded 40708 existing records. [2025-10-27T20:49:12.854755] [DEBUG] [LOCAL ] REX: Loaded 14552 existing records from primary storage. [2025-10-27T20:49:12.865639] [INFO ] [MAIN ] REX: Loaded 14552 existing records. [2025-10-27T20:49:13.005072] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:13.028350] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-27T20:49:13.031368] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-27T20:49:13.052501] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-27T20:49:13.052685] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-27T20:49:13.149857] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:13.161906] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-27T20:49:13.162067] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-27T20:49:13.232584] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-27T20:49:13.236967] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T20:49:13.236115] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-27T20:49:13.355973] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-27T20:49:13.688286] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:13.916330] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:14.014908] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-27T20:49:14.386351] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T20:49:14.814916] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-27T20:49:14.941572] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:49:15.129319] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T20:49:15.614931] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-27T20:49:16.229199] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T20:49:16.402939] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T20:49:16.414894] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-27T20:49:17.161717] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T20:49:17.214893] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-27T20:49:18.014910] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-27T20:49:18.382308] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T20:49:18.814934] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-27T20:49:19.318993] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T20:49:19.614939] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-27T20:49:20.260832] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:49:20.335984] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T20:49:20.414989] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-27T20:49:21.214942] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-27T20:49:22.014983] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-27T20:49:22.740947] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T20:49:22.814932] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-27T20:49:22.953088] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-27T20:49:23.614934] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-27T20:49:23.759560] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T20:49:24.103835] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T20:49:24.414999] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-27T20:49:24.915913] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T20:49:25.214911] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-27T20:49:26.015014] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-27T20:49:26.042154] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T20:49:26.814912] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-27T20:49:26.903964] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T20:49:27.614940] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-27T20:49:27.747170] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T20:49:27.755088] [INFO ] [REMOTE ] RERE: Full fetch complete (58222 records). [2025-10-27T20:49:27.755190] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-27T20:49:28.156540] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-27T20:49:28.156766] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-27T20:49:28.157784] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-27T20:49:28.157861] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-27T20:49:28.180286] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T20:49:28.180399] [DEBUG] [LOCAL ] RERE: Trimmed 58222 records to 41754 (keeping 200 days of data) [2025-10-27T20:49:28.422255] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-27T20:49:28.422186] [DEBUG] [LOCAL ] RERE: Primary data saved (41754 records). [2025-10-27T20:49:28.423143] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-27T20:49:28.423536] [INFO ] [MAIN ] Update Progress: 1782/2366 symbols completed. RERE took 30.9s. Estimated remaining: 1h 15m 11s. Rate: 7.8 symbols/min [2025-10-27T20:49:28.592238] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:28.638466] [DEBUG] [LOCAL ] REXR: Loaded 52951 existing records from primary storage. [2025-10-27T20:49:28.638799] [INFO ] [MAIN ] REXR: Loaded 52951 existing records. [2025-10-27T20:49:28.815267] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:28.815506] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-27T20:49:28.815621] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-27T20:49:28.816038] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-27T20:49:28.816094] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-27T20:49:29.210077] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:29.212385] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:49:29.216012] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-27T20:49:30.014966] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-27T20:49:30.206065] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T20:49:30.814971] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-27T20:49:30.989330] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T20:49:31.220843] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T20:49:31.614995] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-27T20:49:32.133462] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T20:49:32.414965] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-27T20:49:32.668078] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T20:49:33.214941] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-27T20:49:33.915726] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-27T20:49:34.014911] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-27T20:49:34.119403] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T20:49:34.814989] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-27T20:49:35.002205] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T20:49:35.615022] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-27T20:49:36.232541] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T20:49:36.414984] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-27T20:49:37.092799] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T20:49:37.214896] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-27T20:49:37.545348] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T20:49:38.014970] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-27T20:49:38.814920] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-27T20:49:39.079545] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T20:49:39.337673] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T20:49:39.346107] [INFO ] [REMOTE ] RES: Full fetch complete (68360 records). [2025-10-27T20:49:39.346208] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-27T20:49:39.346943] [FATAL] [VALIDATOR ] RES: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:49:39.347026] [FATAL] [MAIN ] RES: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:49:39.347067] [WARN ] [MAIN ] RES: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:49:39.347105] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-27T20:49:39.347159] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-27T20:49:39.347193] [INFO ] [LOCAL ] RES: Starting deletion of derivative data. [2025-10-27T20:49:39.347346] [DEBUG] [LOCAL ] RES: Deleted derivative data file. [2025-10-27T20:49:39.347451] [INFO ] [MAIN ] Update Progress: 1783/2366 symbols completed. RES took 31.5s. Estimated remaining: 1h 15m 5s. Rate: 7.8 symbols/min [2025-10-27T20:49:39.517431] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:39.558301] [DEBUG] [LOCAL ] REZI: Loaded 47796 existing records from primary storage. [2025-10-27T20:49:39.558963] [INFO ] [MAIN ] REZI: Loaded 47796 existing records. [2025-10-27T20:49:39.620085] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-27T20:49:39.655329] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T20:49:39.775905] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:39.776126] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-27T20:49:39.776173] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-27T20:49:39.776407] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-27T20:49:39.776445] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-27T20:49:40.128264] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:40.414926] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-27T20:49:41.214974] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-27T20:49:41.483418] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T20:49:41.549366] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T20:49:42.014997] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-27T20:49:42.692298] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T20:49:42.699515] [INFO ] [REMOTE ] REVG: Full fetch complete (57882 records). [2025-10-27T20:49:42.699630] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-27T20:49:42.820165] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-27T20:49:43.093111] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-27T20:49:43.093185] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-27T20:49:43.094116] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-27T20:49:43.094191] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-27T20:49:43.095321] [DEBUG] [LOCAL ] REVG: Trimmed 57882 records to 39843 (keeping 200 days of data) [2025-10-27T20:49:43.332483] [DEBUG] [LOCAL ] REVG: Primary data saved (39843 records). [2025-10-27T20:49:43.332627] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-27T20:49:43.333288] [INFO ] [MAIN ] Update Progress: 1784/2366 symbols completed. REVG took 31.1s. Estimated remaining: 1h 14m 56s. Rate: 7.8 symbols/min [2025-10-27T20:49:43.500808] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:43.557482] [DEBUG] [LOCAL ] RF: Loaded 54413 existing records from primary storage. [2025-10-27T20:49:43.557907] [INFO ] [MAIN ] RF: Loaded 54413 existing records. [2025-10-27T20:49:43.630658] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-27T20:49:43.740606] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:43.741467] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-27T20:49:43.753195] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-27T20:49:43.754470] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T20:49:43.758869] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-10-27T20:49:43.759585] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-27T20:49:43.919724] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T20:49:44.165271] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:44.414935] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-27T20:49:44.925355] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T20:49:44.929304] [INFO ] [REMOTE ] REX: Full fetch complete (21006 records). [2025-10-27T20:49:44.929391] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-27T20:49:44.929879] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:49:44.929964] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:49:44.930005] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:49:44.930042] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-27T20:49:44.930094] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-27T20:49:44.930128] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-27T20:49:44.930270] [DEBUG] [LOCAL ] REX: Deleted derivative data file. [2025-10-27T20:49:44.930356] [INFO ] [MAIN ] Update Progress: 1785/2366 symbols completed. REX took 32.4s. Estimated remaining: 1h 14m 46s. Rate: 7.8 symbols/min [2025-10-27T20:49:45.098802] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:49:45.109095] [DEBUG] [LOCAL ] RFI: Loaded 10368 existing records from primary storage. [2025-10-27T20:49:45.109293] [INFO ] [MAIN ] RFI: Loaded 10368 existing records. [2025-10-27T20:49:45.220125] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-27T20:49:45.309796] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:49:45.312731] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T20:49:45.320904] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-27T20:49:45.321319] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-27T20:49:45.321868] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-27T20:49:45.321925] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-27T20:49:45.660464] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:49:46.014956] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-27T20:49:46.815026] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-27T20:49:47.359297] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-27T20:49:47.615427] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T20:49:47.615525] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-27T20:49:47.767249] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T20:49:48.414896] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-27T20:49:49.156054] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T20:49:49.214898] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-27T20:49:50.014961] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-27T20:49:50.321152] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T20:49:50.790100] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T20:49:50.814911] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-27T20:49:51.025504] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T20:49:51.614993] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-27T20:49:52.414912] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-27T20:49:52.569947] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T20:49:52.998512] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T20:49:53.214970] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-27T20:49:54.014953] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-27T20:49:54.212110] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T20:49:54.814900] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-27T20:49:54.946512] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T20:49:55.014675] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T20:49:55.614951] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-27T20:49:56.085781] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T20:49:56.272134] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T20:49:56.414959] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-27T20:49:57.090866] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T20:49:57.214973] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-27T20:49:58.014971] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-27T20:49:58.112385] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T20:49:58.814954] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-27T20:49:59.614932] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-27T20:49:59.724696] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T20:49:59.766475] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T20:50:00.414991] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-27T20:50:01.082957] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T20:50:01.214926] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-27T20:50:01.977638] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T20:50:02.014950] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-27T20:50:02.814965] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-27T20:50:03.095399] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T20:50:03.614957] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-27T20:50:04.336077] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-27T20:50:04.346271] [INFO ] [REMOTE ] REXR: Full fetch complete (74986 records). [2025-10-27T20:50:04.346441] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-27T20:50:04.347358] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:50:04.347468] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:50:04.347511] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:50:04.347550] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-27T20:50:04.347608] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-27T20:50:04.347668] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-27T20:50:04.347920] [DEBUG] [LOCAL ] REXR: Deleted derivative data file. [2025-10-27T20:50:04.348396] [INFO ] [MAIN ] Update Progress: 1786/2366 symbols completed. REXR took 35.9s. Estimated remaining: 1h 14m 42s. Rate: 7.8 symbols/min [2025-10-27T20:50:04.418020] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-27T20:50:04.548411] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:04.587304] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-27T20:50:04.603562] [DEBUG] [LOCAL ] RFL: Loaded 11473 existing records from primary storage. [2025-10-27T20:50:04.604369] [INFO ] [MAIN ] RFL: Loaded 11473 existing records. [2025-10-27T20:50:04.784669] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:04.784887] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-27T20:50:04.784937] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-27T20:50:04.785099] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-27T20:50:04.785141] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-27T20:50:05.165013] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:05.214900] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-27T20:50:05.446743] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-27T20:50:05.569614] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T20:50:05.863931] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T20:50:06.014935] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-27T20:50:06.814946] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-27T20:50:07.279118] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T20:50:07.614949] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-27T20:50:07.715569] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T20:50:08.414996] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-27T20:50:09.046887] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T20:50:09.214943] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-27T20:50:09.611483] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T20:50:09.754868] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T20:50:10.014989] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-27T20:50:10.710871] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T20:50:10.713100] [INFO ] [REMOTE ] RFI: Full fetch complete (14999 records). [2025-10-27T20:50:10.713171] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-27T20:50:10.820109] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-27T20:50:11.066721] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-27T20:50:11.066799] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-27T20:50:11.067120] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-27T20:50:11.067157] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-27T20:50:11.067601] [DEBUG] [LOCAL ] RFI: Trimmed 14999 records to 9914 (keeping 200 days of data) [2025-10-27T20:50:11.125213] [DEBUG] [LOCAL ] RFI: Primary data saved (9914 records). [2025-10-27T20:50:11.125322] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-27T20:50:11.125395] [INFO ] [MAIN ] Update Progress: 1787/2366 symbols completed. RFI took 26.2s. Estimated remaining: 1h 14m 34s. Rate: 7.8 symbols/min [2025-10-27T20:50:11.292804] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:11.299162] [DEBUG] [LOCAL ] RFM: Loaded 4249 existing records from primary storage. [2025-10-27T20:50:11.299335] [INFO ] [MAIN ] RFM: Loaded 4249 existing records. [2025-10-27T20:50:11.474134] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:11.474454] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-27T20:50:11.474558] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-27T20:50:11.474811] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-27T20:50:11.474918] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-27T20:50:11.618360] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-27T20:50:11.775079] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T20:50:11.796548] [INFO ] [REMOTE ] REZI: Full fetch complete (66001 records). [2025-10-27T20:50:11.825691] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-27T20:50:11.845264] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:50:11.845375] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:50:11.860381] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:50:11.861532] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-27T20:50:11.864948] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:11.865275] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-27T20:50:11.865327] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-27T20:50:11.865450] [DEBUG] [LOCAL ] REZI: Deleted derivative data file. [2025-10-27T20:50:11.865516] [INFO ] [MAIN ] Update Progress: 1788/2366 symbols completed. REZI took 32.5s. Estimated remaining: 1h 14m 24s. Rate: 7.8 symbols/min [2025-10-27T20:50:12.028326] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:12.038035] [DEBUG] [LOCAL ] RFMZ: Loaded 9232 existing records from primary storage. [2025-10-27T20:50:12.038210] [INFO ] [MAIN ] RFMZ: Loaded 9232 existing records. [2025-10-27T20:50:12.213245] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:12.213425] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-27T20:50:12.213472] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-27T20:50:12.213618] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-27T20:50:12.213692] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-27T20:50:12.328106] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T20:50:12.414977] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-27T20:50:12.572201] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:13.214991] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-27T20:50:13.257743] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:50:14.015016] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-27T20:50:14.064101] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T20:50:14.691044] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T20:50:14.814997] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-27T20:50:15.319086] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T20:50:15.614949] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-27T20:50:16.237343] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T20:50:16.414992] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-27T20:50:16.982986] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:50:17.214942] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-27T20:50:18.014994] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-27T20:50:18.814913] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-27T20:50:18.907693] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T20:50:19.195317] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T20:50:19.614909] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-27T20:50:19.802136] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T20:50:20.414929] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-27T20:50:20.578240] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T20:50:21.188610] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T20:50:21.198433] [INFO ] [REMOTE ] RF: Full fetch complete (77408 records). [2025-10-27T20:50:21.198564] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-27T20:50:21.199380] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:50:21.199466] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:50:21.199541] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:50:21.199611] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-27T20:50:21.199704] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-27T20:50:21.199753] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-27T20:50:21.199878] [DEBUG] [LOCAL ] RF: Deleted derivative data file. [2025-10-27T20:50:21.200370] [INFO ] [MAIN ] Update Progress: 1789/2366 symbols completed. RF took 37.9s. Estimated remaining: 1h 14m 17s. Rate: 7.8 symbols/min [2025-10-27T20:50:21.220211] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-27T20:50:21.368774] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:21.402683] [DEBUG] [LOCAL ] RGA: Loaded 29613 existing records from primary storage. [2025-10-27T20:50:21.402962] [INFO ] [MAIN ] RGA: Loaded 29613 existing records. [2025-10-27T20:50:21.576181] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:21.576366] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-27T20:50:21.576411] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-27T20:50:21.576585] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-27T20:50:21.576622] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-27T20:50:21.853608] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T20:50:21.930415] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:22.014908] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-27T20:50:22.525501] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T20:50:22.814989] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-27T20:50:23.455684] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T20:50:23.614926] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-27T20:50:24.134609] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T20:50:24.414938] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-27T20:50:25.215006] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-27T20:50:25.411451] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T20:50:25.756514] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T20:50:26.014971] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-27T20:50:26.766452] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T20:50:26.814911] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-27T20:50:27.614923] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-27T20:50:27.696042] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:50:27.698138] [INFO ] [REMOTE ] RFL: Full fetch complete (13277 records). [2025-10-27T20:50:27.698211] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-27T20:50:28.058167] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-27T20:50:28.058241] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-27T20:50:28.058592] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-27T20:50:28.058632] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-27T20:50:28.059153] [DEBUG] [LOCAL ] RFL: Trimmed 13277 records to 11378 (keeping 200 days of data) [2025-10-27T20:50:28.122334] [DEBUG] [LOCAL ] RFL: Primary data saved (11378 records). [2025-10-27T20:50:28.122486] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-27T20:50:28.122580] [INFO ] [MAIN ] Update Progress: 1790/2366 symbols completed. RFL took 23.8s. Estimated remaining: 1h 14m 9s. Rate: 7.8 symbols/min [2025-10-27T20:50:28.292769] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:28.312534] [DEBUG] [LOCAL ] RGR: Loaded 21185 existing records from primary storage. [2025-10-27T20:50:28.312786] [INFO ] [MAIN ] RGR: Loaded 21185 existing records. [2025-10-27T20:50:28.420113] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-27T20:50:28.490185] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:28.490377] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-27T20:50:28.490422] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-27T20:50:28.490581] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-27T20:50:28.490618] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-27T20:50:28.837036] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:29.025172] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:50:29.191861] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T20:50:29.214988] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-27T20:50:30.015002] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-27T20:50:30.379154] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T20:50:30.547951] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T20:50:30.814948] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-27T20:50:31.332169] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T20:50:31.614909] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-27T20:50:32.414997] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-27T20:50:33.119618] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:50:33.176152] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T20:50:33.214904] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-27T20:50:34.014943] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-27T20:50:34.057033] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T20:50:34.815051] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-27T20:50:35.501433] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T20:50:35.550596] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T20:50:35.614957] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-27T20:50:36.414980] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-27T20:50:36.432804] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:50:37.214992] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-27T20:50:37.581961] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T20:50:37.905017] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T20:50:38.014950] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-27T20:50:38.746510] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T20:50:38.814992] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-27T20:50:39.614964] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-27T20:50:40.043896] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T20:50:40.201360] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-27T20:50:40.414973] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-27T20:50:41.085769] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:50:41.087723] [INFO ] [REMOTE ] RFM: Full fetch complete (5615 records). [2025-10-27T20:50:41.087877] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-27T20:50:41.216824] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-27T20:50:41.492040] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-27T20:50:41.492117] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-27T20:50:41.492268] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-27T20:50:41.492306] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-27T20:50:41.492744] [DEBUG] [LOCAL ] RFM: Trimmed 5615 records to 4090 (keeping 200 days of data) [2025-10-27T20:50:41.516992] [DEBUG] [LOCAL ] RFM: Primary data saved (4090 records). [2025-10-27T20:50:41.517106] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-27T20:50:41.517179] [INFO ] [MAIN ] Update Progress: 1791/2366 symbols completed. RFM took 30.4s. Estimated remaining: 1h 14m 3s. Rate: 7.8 symbols/min [2025-10-27T20:50:41.705809] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:41.710704] [DEBUG] [LOCAL ] RGT: Loaded 2730 existing records from primary storage. [2025-10-27T20:50:41.710855] [INFO ] [MAIN ] RGT: Loaded 2730 existing records. [2025-10-27T20:50:41.883383] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:41.883607] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-27T20:50:41.883679] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-27T20:50:41.883840] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-27T20:50:41.883895] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-27T20:50:42.020123] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-27T20:50:42.233245] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:42.247982] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T20:50:42.814947] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-27T20:50:43.332427] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:50:43.439828] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T20:50:43.614947] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-27T20:50:44.414970] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-27T20:50:44.600480] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T20:50:45.214941] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-27T20:50:45.390857] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-27T20:50:46.014928] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-27T20:50:46.353320] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T20:50:46.814942] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-27T20:50:46.835676] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T20:50:47.614953] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-27T20:50:47.964092] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:50:48.011683] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-27T20:50:48.414940] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-27T20:50:48.849869] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T20:50:48.853606] [INFO ] [REMOTE ] RGR: Full fetch complete (28646 records). [2025-10-27T20:50:48.853719] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-27T20:50:48.854174] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:50:48.854270] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:50:48.854350] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:50:48.854440] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-27T20:50:48.854518] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-27T20:50:48.854556] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-27T20:50:48.854732] [DEBUG] [LOCAL ] RGR: Deleted derivative data file. [2025-10-27T20:50:48.854818] [INFO ] [MAIN ] Update Progress: 1792/2366 symbols completed. RGR took 20.7s. Estimated remaining: 1h 13m 55s. Rate: 7.8 symbols/min [2025-10-27T20:50:49.023745] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:49.067924] [DEBUG] [LOCAL ] RH: Loaded 47727 existing records from primary storage. [2025-10-27T20:50:49.068223] [INFO ] [MAIN ] RH: Loaded 47727 existing records. [2025-10-27T20:50:49.216596] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-27T20:50:49.252330] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:49.252526] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-27T20:50:49.252588] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-27T20:50:49.252824] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-27T20:50:49.252880] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-27T20:50:49.606087] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:50.014999] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-27T20:50:50.324824] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T20:50:50.465195] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T20:50:50.814940] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-27T20:50:51.341342] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:50:51.343941] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12441 records). [2025-10-27T20:50:51.344010] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-27T20:50:51.619176] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-27T20:50:51.701066] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-27T20:50:51.701143] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-27T20:50:51.701452] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-27T20:50:51.701490] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-27T20:50:51.701985] [DEBUG] [LOCAL ] RFMZ: Trimmed 12441 records to 8929 (keeping 200 days of data) [2025-10-27T20:50:51.756429] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8929 records). [2025-10-27T20:50:51.756546] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-27T20:50:51.756621] [INFO ] [MAIN ] Update Progress: 1793/2366 symbols completed. RFMZ took 39.9s. Estimated remaining: 1h 13m 46s. Rate: 7.8 symbols/min [2025-10-27T20:50:51.926165] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:51.969552] [DEBUG] [LOCAL ] RHI: Loaded 50463 existing records from primary storage. [2025-10-27T20:50:51.969902] [INFO ] [MAIN ] RHI: Loaded 50463 existing records. [2025-10-27T20:50:52.146155] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:52.146370] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-27T20:50:52.146416] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-27T20:50:52.146907] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-27T20:50:52.146963] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-27T20:50:52.417553] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-27T20:50:52.497073] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:53.100725] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T20:50:53.214903] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-27T20:50:54.014916] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-27T20:50:54.103497] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T20:50:54.434850] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T20:50:54.440264] [INFO ] [REMOTE ] RGA: Full fetch complete (44555 records). [2025-10-27T20:50:54.440360] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-27T20:50:54.440948] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:50:54.441028] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:50:54.441069] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:50:54.441110] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-27T20:50:54.441204] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-27T20:50:54.441261] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-27T20:50:54.441414] [DEBUG] [LOCAL ] RGA: Deleted derivative data file. [2025-10-27T20:50:54.441503] [INFO ] [MAIN ] Update Progress: 1794/2366 symbols completed. RGA took 33.2s. Estimated remaining: 1h 13m 36s. Rate: 7.8 symbols/min [2025-10-27T20:50:54.608385] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:54.608546] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-27T20:50:54.608581] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-27T20:50:54.608713] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-27T20:50:54.608776] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-27T20:50:54.608845] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-27T20:50:54.608887] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-27T20:50:54.825338] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-27T20:50:54.983718] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:55.007793] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:50:55.604667] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T20:50:55.614903] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-27T20:50:56.415018] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-27T20:50:57.077324] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T20:50:57.214961] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-27T20:50:57.597345] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T20:50:58.014944] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-10-27T20:50:58.050018] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T20:50:58.313575] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T20:50:58.313907] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-10-27T20:50:58.313992] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:50:58.314068] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-27T20:50:58.314131] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:50:58.314201] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-27T20:50:58.314262] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-27T20:50:58.314297] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-27T20:50:58.314335] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-27T20:50:58.314379] [INFO ] [MAIN ] Update Progress: 1795/2366 symbols completed. RHLD took 3.9s. Estimated remaining: 1h 13m 27s. Rate: 7.8 symbols/min [2025-10-27T20:50:58.492023] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:50:58.531820] [DEBUG] [LOCAL ] RHP: Loaded 40779 existing records from primary storage. [2025-10-27T20:50:58.532132] [INFO ] [MAIN ] RHP: Loaded 40779 existing records. [2025-10-27T20:50:58.720179] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:50:58.720403] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-27T20:50:58.720448] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-27T20:50:58.720892] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-27T20:50:58.720948] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-27T20:50:58.820133] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-27T20:50:59.090053] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:50:59.614948] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-27T20:51:00.414949] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-27T20:51:00.601795] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T20:51:00.605092] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T20:51:01.214954] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-27T20:51:01.580606] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T20:51:01.687977] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T20:51:02.014949] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-27T20:51:02.815016] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-27T20:51:03.517138] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:51:03.614985] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-27T20:51:04.414925] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-27T20:51:04.798499] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T20:51:04.840582] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T20:51:05.179170] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T20:51:05.214922] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-27T20:51:06.014934] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-27T20:51:06.814919] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-27T20:51:06.845682] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T20:51:06.887787] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T20:51:07.614942] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-27T20:51:08.283553] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:51:08.284569] [INFO ] [REMOTE ] RGT: Full fetch complete (3916 records). [2025-10-27T20:51:08.284637] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-27T20:51:08.421568] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-27T20:51:08.645548] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-27T20:51:08.645670] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-27T20:51:08.645833] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-27T20:51:08.646013] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-27T20:51:08.646570] [DEBUG] [LOCAL ] RGT: Trimmed 3916 records to 2623 (keeping 200 days of data) [2025-10-27T20:51:08.662455] [DEBUG] [LOCAL ] RGT: Primary data saved (2623 records). [2025-10-27T20:51:08.662629] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-27T20:51:08.662767] [INFO ] [MAIN ] Update Progress: 1796/2366 symbols completed. RGT took 27.1s. Estimated remaining: 1h 13m 21s. Rate: 7.8 symbols/min [2025-10-27T20:51:08.806530] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-27T20:51:08.876196] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:08.922128] [DEBUG] [LOCAL ] RIG: Loaded 54455 existing records from primary storage. [2025-10-27T20:51:08.922459] [INFO ] [MAIN ] RIG: Loaded 54455 existing records. [2025-10-27T20:51:09.097078] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:09.097302] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-27T20:51:09.097351] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-27T20:51:09.097597] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-27T20:51:09.097638] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-27T20:51:09.220065] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-27T20:51:09.451750] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:10.014946] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-27T20:51:10.082420] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:51:10.800146] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:51:10.814902] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-27T20:51:11.614940] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-27T20:51:11.866518] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T20:51:12.329170] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T20:51:12.414898] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-27T20:51:12.729104] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T20:51:13.214937] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-27T20:51:14.014921] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-27T20:51:14.136925] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T20:51:14.814961] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-27T20:51:15.104280] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T20:51:15.620023] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-27T20:51:15.640962] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T20:51:16.414968] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-27T20:51:16.455996] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T20:51:17.215012] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-27T20:51:17.365524] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T20:51:18.015028] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-27T20:51:18.366235] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T20:51:18.814960] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-27T20:51:18.883045] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:51:19.614951] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-27T20:51:19.863299] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T20:51:20.414998] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-27T20:51:20.712902] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:51:20.815101] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T20:51:21.214925] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-27T20:51:22.014986] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-27T20:51:22.162977] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T20:51:22.388152] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T20:51:22.814993] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-27T20:51:23.614913] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-27T20:51:23.751555] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:51:24.261098] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T20:51:24.269332] [INFO ] [REMOTE ] RH: Full fetch complete (66087 records). [2025-10-27T20:51:24.269471] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-27T20:51:24.270224] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:51:24.270325] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:51:24.270382] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:51:24.270421] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-27T20:51:24.270489] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-27T20:51:24.270551] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-27T20:51:24.270763] [DEBUG] [LOCAL ] RH: Deleted derivative data file. [2025-10-27T20:51:24.271173] [INFO ] [MAIN ] Update Progress: 1797/2366 symbols completed. RH took 35.4s. Estimated remaining: 1h 13m 15s. Rate: 7.8 symbols/min [2025-10-27T20:51:24.414922] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-27T20:51:24.539310] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T20:51:24.906106] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T20:51:24.913160] [INFO ] [REMOTE ] RHP: Full fetch complete (57939 records). [2025-10-27T20:51:24.913264] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-27T20:51:24.913952] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:51:24.914036] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:51:24.914078] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:51:24.914114] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-27T20:51:24.914182] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-27T20:51:24.914253] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-27T20:51:24.914434] [DEBUG] [LOCAL ] RHP: Deleted derivative data file. [2025-10-27T20:51:24.915111] [INFO ] [MAIN ] Update Progress: 1798/2366 symbols completed. RHP took 26.6s. Estimated remaining: 1h 13m 5s. Rate: 7.8 symbols/min [2025-10-27T20:51:25.214923] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-27T20:51:26.014932] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-27T20:51:26.548295] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T20:51:26.814986] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-27T20:51:27.850721] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T20:51:27.861562] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-27T20:51:28.501239] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T20:51:28.511932] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-27T20:51:29.514450] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T20:51:29.523814] [INFO ] [REMOTE ] RHI: Full fetch complete (70747 records). [2025-10-27T20:51:29.523970] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-27T20:51:29.524778] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:51:29.524873] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:51:29.524914] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:51:29.524950] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-27T20:51:29.525005] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-27T20:51:29.525041] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-27T20:51:29.525172] [DEBUG] [LOCAL ] RHI: Deleted derivative data file. [2025-10-27T20:51:29.525240] [INFO ] [MAIN ] Update Progress: 1799/2366 symbols completed. RHI took 37.8s. Estimated remaining: 1h 12m 57s. Rate: 7.8 symbols/min [2025-10-27T20:51:29.822794] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-27T20:51:29.834420] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-27T20:51:31.765809] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T20:51:31.777270] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-27T20:51:33.431138] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T20:51:33.442310] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-27T20:51:35.633214] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T20:51:35.643456] [INFO ] [REMOTE ] RIG: Full fetch complete (77845 records). [2025-10-27T20:51:35.643580] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-27T20:51:36.028998] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-27T20:51:36.029078] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-27T20:51:36.030185] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-27T20:51:36.030250] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-27T20:51:36.031705] [DEBUG] [LOCAL ] RIG: Trimmed 77845 records to 53675 (keeping 200 days of data) [2025-10-27T20:51:36.335956] [DEBUG] [LOCAL ] RIG: Primary data saved (53675 records). [2025-10-27T20:51:36.336104] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-27T20:51:36.336187] [INFO ] [MAIN ] Update Progress: 1800/2366 symbols completed. RIG took 27.7s. Estimated remaining: 1h 12m 49s. Rate: 7.8 symbols/min [2025-10-27T20:51:36.835276] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:36.902154] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:37.044615] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:37.041393] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:37.060509] [DEBUG] [LOCAL ] RIV: Loaded 12782 existing records from primary storage. [2025-10-27T20:51:37.060916] [INFO ] [MAIN ] RIV: Loaded 12782 existing records. [2025-10-27T20:51:37.313217] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:37.314522] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-27T20:51:37.314684] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-27T20:51:37.316171] [DEBUG] [LOCAL ] RIO: Loaded 54181 existing records from primary storage. [2025-10-27T20:51:37.317451] [INFO ] [MAIN ] RIO: Loaded 54181 existing records. [2025-10-27T20:51:37.317285] [DEBUG] [LOCAL ] RJF: Loaded 47314 existing records from primary storage. [2025-10-27T20:51:37.316578] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-27T20:51:37.331006] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-27T20:51:37.337434] [INFO ] [MAIN ] RJF: Loaded 47314 existing records. [2025-10-27T20:51:37.379020] [DEBUG] [LOCAL ] RITM: Loaded 53714 existing records from primary storage. [2025-10-27T20:51:37.472055] [INFO ] [MAIN ] RITM: Loaded 53714 existing records. [2025-10-27T20:51:38.043190] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:38.055997] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-27T20:51:37.996932] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:38.071963] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-27T20:51:38.083021] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-27T20:51:38.114946] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-27T20:51:38.120407] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-27T20:51:38.125738] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-27T20:51:38.233094] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:38.238367] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-10-27T20:51:38.296615] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-27T20:51:38.281790] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-27T20:51:38.338576] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-27T20:51:38.397038] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-27T20:51:38.448730] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-27T20:51:38.529264] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:38.602415] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-27T20:51:39.323981] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:39.421440] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-27T20:51:39.421171] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:39.423059] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-27T20:51:39.503221] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:39.503533] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-27T20:51:40.175374] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T20:51:40.178531] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-27T20:51:40.791009] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T20:51:40.800897] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-27T20:51:41.104057] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T20:51:41.106540] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-27T20:51:41.378979] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-27T20:51:41.389444] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-27T20:51:41.422332] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-27T20:51:41.432759] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-27T20:51:42.073727] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T20:51:42.076582] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-27T20:51:42.275982] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T20:51:42.285121] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-27T20:51:42.747224] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T20:51:42.750520] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-27T20:51:42.831311] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T20:51:42.841457] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-27T20:51:42.939712] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T20:51:42.949405] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-27T20:51:43.645840] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T20:51:43.648138] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-27T20:51:44.207335] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T20:51:44.218610] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-27T20:51:44.243807] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T20:51:44.414986] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-27T20:51:44.448361] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T20:51:44.936187] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T20:51:45.127453] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T20:51:45.214940] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-27T20:51:46.014935] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-27T20:51:46.211986] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-27T20:51:46.642312] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T20:51:46.814907] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-27T20:51:47.159199] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T20:51:47.615002] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-27T20:51:48.415001] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-27T20:51:48.583176] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T20:51:49.214959] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-27T20:51:49.422923] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:51:50.014966] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-27T20:51:50.225873] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:51:50.814994] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-27T20:51:51.350804] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T20:51:51.389985] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T20:51:51.614992] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-27T20:51:52.414947] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-27T20:51:52.574700] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T20:51:52.719724] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T20:51:53.214919] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-27T20:51:53.867192] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T20:51:53.870313] [INFO ] [REMOTE ] RIV: Full fetch complete (17593 records). [2025-10-27T20:51:53.870382] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-27T20:51:54.016542] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-27T20:51:54.238661] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-27T20:51:54.238738] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-27T20:51:54.239150] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-27T20:51:54.239190] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-27T20:51:54.239748] [DEBUG] [LOCAL ] RIV: Trimmed 17593 records to 12453 (keeping 200 days of data) [2025-10-27T20:51:54.344738] [DEBUG] [LOCAL ] RIV: Primary data saved (12453 records). [2025-10-27T20:51:54.345415] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-27T20:51:54.346584] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T20:51:54.346755] [INFO ] [MAIN ] Update Progress: 1801/2366 symbols completed. RIV took 18.0s. Estimated remaining: 1h 12m 44s. Rate: 7.8 symbols/min [2025-10-27T20:51:54.523608] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:51:54.576125] [DEBUG] [LOCAL ] RKT: Loaded 54509 existing records from primary storage. [2025-10-27T20:51:54.576445] [INFO ] [MAIN ] RKT: Loaded 54509 existing records. [2025-10-27T20:51:54.754579] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:51:54.754781] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-27T20:51:54.754828] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-27T20:51:54.755013] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-27T20:51:54.755052] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-27T20:51:54.820028] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-27T20:51:55.106098] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:51:55.614951] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-27T20:51:56.414915] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-27T20:51:56.460342] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T20:51:56.618333] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T20:51:57.146547] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T20:51:57.214912] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-27T20:51:58.014975] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-27T20:51:58.354767] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-27T20:51:58.814933] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-27T20:51:59.145564] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-27T20:51:59.614963] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-27T20:52:00.081569] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-27T20:52:00.414933] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-27T20:52:01.068664] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T20:52:01.214914] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-27T20:52:01.293242] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T20:52:01.889508] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T20:52:02.014953] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-27T20:52:02.671291] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T20:52:02.680123] [INFO ] [REMOTE ] RJF: Full fetch complete (68569 records). [2025-10-27T20:52:02.680283] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-27T20:52:02.681088] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:52:02.681177] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:52:02.681218] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:52:02.681256] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-27T20:52:02.681310] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-27T20:52:02.681343] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-27T20:52:02.681465] [DEBUG] [LOCAL ] RJF: Deleted derivative data file. [2025-10-27T20:52:02.681551] [INFO ] [MAIN ] Update Progress: 1802/2366 symbols completed. RJF took 26.3s. Estimated remaining: 1h 12m 37s. Rate: 7.8 symbols/min [2025-10-27T20:52:02.822791] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-27T20:52:02.866286] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:02.910785] [DEBUG] [LOCAL ] RL: Loaded 39763 existing records from primary storage. [2025-10-27T20:52:02.911081] [INFO ] [MAIN ] RL: Loaded 39763 existing records. [2025-10-27T20:52:03.093738] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:03.094137] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-27T20:52:03.094310] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-27T20:52:03.094533] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-10-27T20:52:03.094588] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-27T20:52:03.403380] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-27T20:52:03.491031] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:03.614923] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-27T20:52:04.414907] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-27T20:52:04.901932] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T20:52:05.214982] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-27T20:52:05.304701] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T20:52:06.014948] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-27T20:52:06.211399] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T20:52:06.814952] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-27T20:52:07.301773] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-27T20:52:07.467104] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T20:52:07.615014] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-27T20:52:08.327896] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T20:52:08.338109] [INFO ] [REMOTE ] RITM: Full fetch complete (76742 records). [2025-10-27T20:52:08.338251] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-27T20:52:08.420151] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-27T20:52:08.728953] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-27T20:52:08.729053] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-27T20:52:08.730181] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-27T20:52:08.730244] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-27T20:52:08.731797] [DEBUG] [LOCAL ] RITM: Trimmed 76742 records to 52932 (keeping 200 days of data) [2025-10-27T20:52:09.049636] [DEBUG] [LOCAL ] RITM: Primary data saved (52932 records). [2025-10-27T20:52:09.049796] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-27T20:52:09.049873] [INFO ] [MAIN ] Update Progress: 1803/2366 symbols completed. RITM took 32.7s. Estimated remaining: 1h 12m 29s. Rate: 7.8 symbols/min [2025-10-27T20:52:09.216185] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-27T20:52:09.217685] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:09.251748] [DEBUG] [LOCAL ] RLI: Loaded 35269 existing records from primary storage. [2025-10-27T20:52:09.252022] [INFO ] [MAIN ] RLI: Loaded 35269 existing records. [2025-10-27T20:52:09.430964] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:09.431733] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-27T20:52:09.431930] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-27T20:52:09.432405] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-27T20:52:09.432462] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-27T20:52:09.766033] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T20:52:09.840032] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:09.931672] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T20:52:10.014914] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-27T20:52:10.814910] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-27T20:52:11.256028] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T20:52:11.268819] [INFO ] [REMOTE ] RIO: Full fetch complete (77513 records). [2025-10-27T20:52:11.269055] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-27T20:52:11.634049] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-27T20:52:11.695774] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-27T20:52:11.698361] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-27T20:52:11.698270] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T20:52:11.705831] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-27T20:52:11.705916] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-27T20:52:11.708792] [DEBUG] [LOCAL ] RIO: Trimmed 77513 records to 53401 (keeping 200 days of data) [2025-10-27T20:52:12.037834] [DEBUG] [LOCAL ] RIO: Primary data saved (53401 records). [2025-10-27T20:52:12.037973] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-27T20:52:12.038050] [INFO ] [MAIN ] Update Progress: 1804/2366 symbols completed. RIO took 35.7s. Estimated remaining: 1h 12m 19s. Rate: 7.8 symbols/min [2025-10-27T20:52:12.211295] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:12.251573] [DEBUG] [LOCAL ] RLJ: Loaded 48616 existing records from primary storage. [2025-10-27T20:52:12.251894] [INFO ] [MAIN ] RLJ: Loaded 48616 existing records. [2025-10-27T20:52:12.419287] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-27T20:52:12.440810] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:12.441092] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-27T20:52:12.441995] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-27T20:52:12.442424] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-27T20:52:12.442482] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-27T20:52:12.729198] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T20:52:12.861670] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:13.214921] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-27T20:52:13.581126] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-27T20:52:13.900574] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T20:52:14.014949] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-27T20:52:14.698006] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T20:52:14.814916] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-27T20:52:15.056460] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T20:52:15.614993] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-27T20:52:16.391618] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T20:52:16.414925] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-27T20:52:17.214941] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-27T20:52:18.014908] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-27T20:52:18.050686] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-27T20:52:18.088931] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T20:52:18.429633] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T20:52:18.814947] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-27T20:52:19.288837] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T20:52:19.614994] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-27T20:52:20.174003] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T20:52:20.414930] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-27T20:52:20.877043] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T20:52:21.214948] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-27T20:52:21.667008] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T20:52:22.014948] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-27T20:52:22.814963] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-27T20:52:23.421331] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-27T20:52:23.475266] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T20:52:23.614901] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-27T20:52:24.221629] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T20:52:24.414980] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-27T20:52:25.214919] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-27T20:52:25.335000] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T20:52:25.499476] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T20:52:26.015041] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-27T20:52:26.814996] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-27T20:52:27.253298] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T20:52:27.292390] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-27T20:52:27.614962] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-27T20:52:28.414927] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-27T20:52:28.546803] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T20:52:29.021881] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T20:52:29.027866] [INFO ] [REMOTE ] RL: Full fetch complete (58691 records). [2025-10-27T20:52:29.027962] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-27T20:52:29.028509] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:52:29.028588] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:52:29.028629] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:52:29.028719] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-27T20:52:29.028800] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-27T20:52:29.028856] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-27T20:52:29.028981] [DEBUG] [LOCAL ] RL: Deleted derivative data file. [2025-10-27T20:52:29.029048] [INFO ] [MAIN ] Update Progress: 1805/2366 symbols completed. RL took 26.3s. Estimated remaining: 1h 12m 14s. Rate: 7.8 symbols/min [2025-10-27T20:52:29.196396] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:29.211857] [DEBUG] [LOCAL ] RLTY: Loaded 11106 existing records from primary storage. [2025-10-27T20:52:29.212117] [INFO ] [MAIN ] RLTY: Loaded 11106 existing records. [2025-10-27T20:52:29.223013] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-27T20:52:29.413240] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:29.415693] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-27T20:52:29.417042] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T20:52:29.416279] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-27T20:52:29.423753] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-27T20:52:29.424291] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-27T20:52:29.771788] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:30.014906] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-27T20:52:30.814933] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-27T20:52:30.946146] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T20:52:30.967530] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T20:52:31.614928] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-27T20:52:32.197515] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:52:32.278375] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T20:52:32.414909] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-27T20:52:33.214960] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-27T20:52:34.020014] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-27T20:52:34.034243] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T20:52:34.551506] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T20:52:34.558901] [INFO ] [REMOTE ] RLI: Full fetch complete (49438 records). [2025-10-27T20:52:34.559015] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-27T20:52:34.559630] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:52:34.559751] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:52:34.559793] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:52:34.559829] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-27T20:52:34.559883] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-27T20:52:34.559916] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-27T20:52:34.560039] [DEBUG] [LOCAL ] RLI: Deleted derivative data file. [2025-10-27T20:52:34.560721] [INFO ] [MAIN ] Update Progress: 1806/2366 symbols completed. RLI took 25.5s. Estimated remaining: 1h 12m 6s. Rate: 7.8 symbols/min [2025-10-27T20:52:34.725415] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:34.772892] [DEBUG] [LOCAL ] RLX: Loaded 48812 existing records from primary storage. [2025-10-27T20:52:34.773238] [INFO ] [MAIN ] RLX: Loaded 48812 existing records. [2025-10-27T20:52:34.827106] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-27T20:52:34.959730] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:34.959999] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-27T20:52:34.960073] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-27T20:52:34.960427] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-27T20:52:34.960490] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-27T20:52:35.343812] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-27T20:52:35.348181] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:35.359144] [INFO ] [REMOTE ] RKT: Full fetch complete (77623 records). [2025-10-27T20:52:35.359270] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-27T20:52:35.624054] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-27T20:52:35.744943] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-27T20:52:35.745018] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-27T20:52:35.746118] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-27T20:52:35.746179] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-27T20:52:35.747683] [DEBUG] [LOCAL ] RKT: Trimmed 77623 records to 53729 (keeping 200 days of data) [2025-10-27T20:52:36.069789] [DEBUG] [LOCAL ] RKT: Primary data saved (53729 records). [2025-10-27T20:52:36.069923] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-27T20:52:36.070015] [INFO ] [MAIN ] Update Progress: 1807/2366 symbols completed. RKT took 41.7s. Estimated remaining: 1h 11m 56s. Rate: 7.8 symbols/min [2025-10-27T20:52:36.266796] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:36.275925] [DEBUG] [LOCAL ] RM: Loaded 7553 existing records from primary storage. [2025-10-27T20:52:36.276161] [INFO ] [MAIN ] RM: Loaded 7553 existing records. [2025-10-27T20:52:36.416269] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-27T20:52:36.483555] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:36.484509] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-27T20:52:36.484601] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-27T20:52:36.485020] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-27T20:52:36.485123] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-27T20:52:36.631543] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-27T20:52:36.699040] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T20:52:36.908958] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:37.214941] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-27T20:52:37.846038] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T20:52:38.014926] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-27T20:52:38.167540] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T20:52:38.814955] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-27T20:52:38.980446] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T20:52:39.614998] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-27T20:52:40.212399] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:52:40.230418] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T20:52:40.414940] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-27T20:52:41.214976] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-27T20:52:41.542369] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T20:52:41.551794] [INFO ] [REMOTE ] RLJ: Full fetch complete (69339 records). [2025-10-27T20:52:41.551971] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-27T20:52:41.933780] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T20:52:41.957236] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-27T20:52:41.957321] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-27T20:52:41.958420] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-27T20:52:41.958484] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-27T20:52:41.959882] [DEBUG] [LOCAL ] RLJ: Trimmed 69339 records to 47747 (keeping 200 days of data) [2025-10-27T20:52:42.015593] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-27T20:52:42.248513] [DEBUG] [LOCAL ] RLJ: Primary data saved (47747 records). [2025-10-27T20:52:42.248694] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-27T20:52:42.249119] [INFO ] [MAIN ] Update Progress: 1808/2366 symbols completed. RLJ took 30.2s. Estimated remaining: 1h 11m 48s. Rate: 7.8 symbols/min [2025-10-27T20:52:42.427677] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:42.449708] [DEBUG] [LOCAL ] RMAX: Loaded 21863 existing records from primary storage. [2025-10-27T20:52:42.449973] [INFO ] [MAIN ] RMAX: Loaded 21863 existing records. [2025-10-27T20:52:42.631400] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:42.631619] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-27T20:52:42.631701] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-27T20:52:42.631908] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-27T20:52:42.631966] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-27T20:52:42.818468] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-27T20:52:43.031322] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T20:52:43.036864] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:43.614938] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-27T20:52:43.723077] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T20:52:44.207832] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-27T20:52:44.414929] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-27T20:52:45.027153] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T20:52:45.214951] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-27T20:52:45.781874] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T20:52:46.014954] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-27T20:52:46.814972] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-27T20:52:46.893500] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T20:52:47.614959] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-27T20:52:48.202177] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T20:52:48.414949] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-27T20:52:48.499285] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T20:52:49.215002] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-27T20:52:49.246478] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T20:52:49.249057] [INFO ] [REMOTE ] RLTY: Full fetch complete (17244 records). [2025-10-27T20:52:49.249128] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-27T20:52:49.603434] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-27T20:52:49.603512] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-27T20:52:49.603780] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-27T20:52:49.603840] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-27T20:52:49.604310] [DEBUG] [LOCAL ] RLTY: Trimmed 17244 records to 10808 (keeping 200 days of data) [2025-10-27T20:52:49.667373] [DEBUG] [LOCAL ] RLTY: Primary data saved (10808 records). [2025-10-27T20:52:49.667486] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-27T20:52:49.667562] [INFO ] [MAIN ] Update Progress: 1809/2366 symbols completed. RLTY took 20.6s. Estimated remaining: 1h 11m 40s. Rate: 7.8 symbols/min [2025-10-27T20:52:49.829634] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:52:49.867188] [DEBUG] [LOCAL ] RMD: Loaded 42502 existing records from primary storage. [2025-10-27T20:52:49.867477] [INFO ] [MAIN ] RMD: Loaded 42502 existing records. [2025-10-27T20:52:50.041145] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:52:50.019777] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-27T20:52:50.041482] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-27T20:52:50.042420] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-27T20:52:50.042682] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-10-27T20:52:50.042739] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-27T20:52:50.388282] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:52:50.817320] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-27T20:52:50.819988] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T20:52:50.891247] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T20:52:51.338951] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T20:52:51.614940] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-27T20:52:52.414959] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-27T20:52:53.219206] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-27T20:52:53.224154] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T20:52:53.768786] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T20:52:54.014928] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-27T20:52:54.106570] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T20:52:54.814987] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-27T20:52:55.414800] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T20:52:55.614926] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-27T20:52:55.669106] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-27T20:52:56.414953] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-27T20:52:56.623478] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T20:52:57.215003] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-27T20:52:57.973996] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:52:57.994311] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T20:52:58.014904] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-27T20:52:58.820162] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-27T20:52:58.835237] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T20:52:59.614915] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-27T20:52:59.634481] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T20:53:00.414935] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-27T20:53:01.214929] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-27T20:53:01.313079] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T20:53:01.314787] [INFO ] [REMOTE ] RM: Full fetch complete (11415 records). [2025-10-27T20:53:01.314856] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-27T20:53:01.593570] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T20:53:01.706303] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-27T20:53:01.706375] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-27T20:53:01.706665] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-27T20:53:01.706726] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-27T20:53:01.707141] [DEBUG] [LOCAL ] RM: Trimmed 11415 records to 7343 (keeping 200 days of data) [2025-10-27T20:53:01.752777] [DEBUG] [LOCAL ] RM: Primary data saved (7343 records). [2025-10-27T20:53:01.752909] [INFO ] [MAIN ] RM: Full history saved. [2025-10-27T20:53:01.752989] [INFO ] [MAIN ] Update Progress: 1810/2366 symbols completed. RM took 25.7s. Estimated remaining: 1h 11m 34s. Rate: 7.8 symbols/min [2025-10-27T20:53:01.924367] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:01.930678] [DEBUG] [LOCAL ] RMI: Loaded 4883 existing records from primary storage. [2025-10-27T20:53:01.930917] [INFO ] [MAIN ] RMI: Loaded 4883 existing records. [2025-10-27T20:53:02.024955] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-27T20:53:02.113021] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:02.113345] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-27T20:53:02.113403] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-27T20:53:02.113679] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-27T20:53:02.113751] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-27T20:53:02.284369] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T20:53:02.497684] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:02.814984] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-27T20:53:03.614946] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-27T20:53:03.950544] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T20:53:03.984338] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T20:53:04.414983] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-27T20:53:05.214983] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-27T20:53:05.384244] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T20:53:05.432828] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T20:53:05.809321] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:53:06.014911] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-27T20:53:06.814954] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-27T20:53:07.614932] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-27T20:53:07.653157] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T20:53:08.281100] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T20:53:08.414953] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-27T20:53:08.554872] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T20:53:09.214935] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-27T20:53:09.541726] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T20:53:10.014971] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-27T20:53:10.444891] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T20:53:10.542409] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T20:53:10.814969] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-27T20:53:11.316076] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T20:53:11.614912] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-27T20:53:12.336540] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T20:53:12.414922] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-27T20:53:13.214937] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-27T20:53:13.534236] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T20:53:13.538189] [INFO ] [REMOTE ] RMAX: Full fetch complete (29854 records). [2025-10-27T20:53:13.538267] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-27T20:53:13.912401] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-27T20:53:13.912938] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-27T20:53:13.913100] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T20:53:13.913778] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-27T20:53:13.914979] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-27T20:53:13.916236] [DEBUG] [LOCAL ] RMAX: Trimmed 29854 records to 21402 (keeping 200 days of data) [2025-10-27T20:53:14.015774] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-27T20:53:14.035829] [DEBUG] [LOCAL ] RMAX: Primary data saved (21402 records). [2025-10-27T20:53:14.035919] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-27T20:53:14.035988] [INFO ] [MAIN ] Update Progress: 1811/2366 symbols completed. RMAX took 31.8s. Estimated remaining: 1h 11m 28s. Rate: 7.8 symbols/min [2025-10-27T20:53:14.202107] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:14.214349] [DEBUG] [LOCAL ] RMM: Loaded 11153 existing records from primary storage. [2025-10-27T20:53:14.214562] [INFO ] [MAIN ] RMM: Loaded 11153 existing records. [2025-10-27T20:53:14.387437] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:14.387630] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-27T20:53:14.387711] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-27T20:53:14.387911] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-27T20:53:14.387966] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-27T20:53:14.742792] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:14.814923] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-27T20:53:15.579418] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T20:53:15.614926] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-27T20:53:15.759426] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T20:53:16.415001] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-27T20:53:17.033338] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T20:53:17.095918] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T20:53:17.214912] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-27T20:53:17.924984] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T20:53:18.014994] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-27T20:53:18.814979] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-27T20:53:18.901032] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T20:53:19.614945] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-27T20:53:20.085897] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T20:53:20.414949] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-27T20:53:20.901573] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T20:53:20.973495] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T20:53:21.214914] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-27T20:53:22.014970] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-27T20:53:22.414899] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T20:53:22.814958] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-27T20:53:22.837019] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:53:23.614943] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-27T20:53:24.390792] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T20:53:24.400856] [INFO ] [REMOTE ] RLX: Full fetch complete (69975 records). [2025-10-27T20:53:24.401066] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-27T20:53:24.423075] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-27T20:53:24.524558] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T20:53:24.800575] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-27T20:53:24.800815] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-27T20:53:24.801859] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-27T20:53:24.801919] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-27T20:53:24.803146] [DEBUG] [LOCAL ] RLX: Trimmed 69975 records to 47964 (keeping 200 days of data) [2025-10-27T20:53:25.069985] [DEBUG] [LOCAL ] RLX: Primary data saved (47964 records). [2025-10-27T20:53:25.070109] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-27T20:53:25.070619] [INFO ] [MAIN ] Update Progress: 1812/2366 symbols completed. RLX took 50.5s. Estimated remaining: 1h 11m 21s. Rate: 7.8 symbols/min [2025-10-27T20:53:25.211668] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T20:53:25.216889] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-27T20:53:25.268016] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:25.269535] [INFO ] [REMOTE ] RMD: Full fetch complete (61424 records). [2025-10-27T20:53:25.269689] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-27T20:53:25.270410] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:53:25.270588] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:53:25.270680] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:53:25.270755] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-27T20:53:25.270820] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-27T20:53:25.270856] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-27T20:53:25.270990] [DEBUG] [LOCAL ] RMD: Deleted derivative data file. [2025-10-27T20:53:25.271078] [INFO ] [MAIN ] Update Progress: 1813/2366 symbols completed. RMD took 35.6s. Estimated remaining: 1h 11m 11s. Rate: 7.8 symbols/min [2025-10-27T20:53:25.356488] [DEBUG] [LOCAL ] RMMZ: Loaded 4852 existing records from primary storage. [2025-10-27T20:53:25.375699] [INFO ] [MAIN ] RMMZ: Loaded 4852 existing records. [2025-10-27T20:53:25.573857] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:25.630931] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:25.631402] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-27T20:53:25.631484] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-27T20:53:25.631705] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-27T20:53:25.631763] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-27T20:53:25.821861] [DEBUG] [LOCAL ] RMT: Loaded 17331 existing records from primary storage. [2025-10-27T20:53:25.868849] [INFO ] [MAIN ] RMT: Loaded 17331 existing records. [2025-10-27T20:53:26.015662] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-27T20:53:26.136127] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-27T20:53:26.179966] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:26.199613] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:26.202004] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-27T20:53:26.202060] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-27T20:53:26.202257] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-27T20:53:26.202312] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-27T20:53:26.549606] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:26.749414] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T20:53:26.814916] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-27T20:53:27.444260] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:53:27.445757] [INFO ] [REMOTE ] RMI: Full fetch complete (6178 records). [2025-10-27T20:53:27.445826] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-27T20:53:27.617798] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-27T20:53:27.815971] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-27T20:53:27.816078] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-27T20:53:27.816310] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-27T20:53:27.816368] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-27T20:53:27.816811] [DEBUG] [LOCAL ] RMI: Trimmed 6178 records to 4737 (keeping 200 days of data) [2025-10-27T20:53:27.845846] [DEBUG] [LOCAL ] RMI: Primary data saved (4737 records). [2025-10-27T20:53:27.845977] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-27T20:53:27.846055] [INFO ] [MAIN ] Update Progress: 1814/2366 symbols completed. RMI took 26.1s. Estimated remaining: 1h 11m 2s. Rate: 7.8 symbols/min [2025-10-27T20:53:28.010312] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:28.049903] [DEBUG] [LOCAL ] RNG: Loaded 48663 existing records from primary storage. [2025-10-27T20:53:28.050300] [INFO ] [MAIN ] RNG: Loaded 48663 existing records. [2025-10-27T20:53:28.221742] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:28.221942] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-27T20:53:28.221988] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-27T20:53:28.222243] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-27T20:53:28.222300] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-27T20:53:28.367680] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T20:53:28.421402] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-27T20:53:28.590406] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:29.214991] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-27T20:53:29.378579] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T20:53:29.965787] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T20:53:30.014966] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-27T20:53:30.670782] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T20:53:30.814946] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-27T20:53:31.614932] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-27T20:53:31.866977] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T20:53:32.069819] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T20:53:32.414924] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-27T20:53:33.214981] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-27T20:53:33.241344] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T20:53:33.243951] [INFO ] [REMOTE ] RMM: Full fetch complete (14944 records). [2025-10-27T20:53:33.244029] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-27T20:53:33.620114] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-27T20:53:33.620202] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-27T20:53:33.620568] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-27T20:53:33.620661] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-27T20:53:33.621228] [DEBUG] [LOCAL ] RMM: Trimmed 14944 records to 10696 (keeping 200 days of data) [2025-10-27T20:53:33.685167] [DEBUG] [LOCAL ] RMM: Primary data saved (10696 records). [2025-10-27T20:53:33.685307] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-27T20:53:33.685388] [INFO ] [MAIN ] Update Progress: 1815/2366 symbols completed. RMM took 19.6s. Estimated remaining: 1h 10m 53s. Rate: 7.8 symbols/min [2025-10-27T20:53:33.802055] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T20:53:33.863011] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:33.882277] [DEBUG] [LOCAL ] RNGR: Loaded 20973 existing records from primary storage. [2025-10-27T20:53:33.882502] [INFO ] [MAIN ] RNGR: Loaded 20973 existing records. [2025-10-27T20:53:34.020067] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-27T20:53:34.055153] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:34.055501] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-27T20:53:34.055547] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-27T20:53:34.055767] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-27T20:53:34.055824] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-27T20:53:34.404963] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:34.814931] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-27T20:53:35.614913] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-27T20:53:35.713331] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T20:53:35.733935] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:53:36.321051] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-27T20:53:36.414936] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-27T20:53:37.214943] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-27T20:53:37.549603] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T20:53:38.015016] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-27T20:53:38.431637] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T20:53:38.602918] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T20:53:38.814952] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-27T20:53:39.614899] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-27T20:53:39.636391] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:53:40.068039] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T20:53:40.414943] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-27T20:53:41.214988] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-27T20:53:42.014938] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-27T20:53:42.076980] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T20:53:42.125706] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T20:53:42.701640] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T20:53:42.814943] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-27T20:53:43.614971] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-27T20:53:43.892840] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T20:53:44.409481] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T20:53:44.414901] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-27T20:53:45.214966] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-27T20:53:45.582298] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T20:53:46.014940] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-27T20:53:46.093274] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T20:53:46.497864] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-27T20:53:46.814955] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-27T20:53:47.615011] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-27T20:53:47.739597] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T20:53:48.364862] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-27T20:53:48.414954] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-27T20:53:48.907632] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T20:53:49.214969] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-27T20:53:49.643801] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T20:53:50.015031] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-27T20:53:50.703565] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T20:53:50.814902] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-27T20:53:51.614947] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-27T20:53:52.004907] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T20:53:52.080701] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T20:53:52.082208] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6583 records). [2025-10-27T20:53:52.082303] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-27T20:53:52.420042] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-27T20:53:52.444122] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-27T20:53:52.444197] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-27T20:53:52.444403] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-27T20:53:52.444451] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-27T20:53:52.444923] [DEBUG] [LOCAL ] RMMZ: Trimmed 6583 records to 4722 (keeping 200 days of data) [2025-10-27T20:53:52.478599] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4722 records). [2025-10-27T20:53:52.478762] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-27T20:53:52.478879] [INFO ] [MAIN ] Update Progress: 1816/2366 symbols completed. RMMZ took 27.4s. Estimated remaining: 1h 10m 49s. Rate: 7.8 symbols/min [2025-10-27T20:53:52.643284] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:52.659603] [DEBUG] [LOCAL ] RNP: Loaded 16090 existing records from primary storage. [2025-10-27T20:53:52.659865] [INFO ] [MAIN ] RNP: Loaded 16090 existing records. [2025-10-27T20:53:52.833508] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:52.833742] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-27T20:53:52.833812] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-27T20:53:52.833994] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-27T20:53:52.834051] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-27T20:53:53.178682] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:53:53.214904] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-27T20:53:53.573556] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:53:53.925323] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T20:53:54.014913] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-27T20:53:54.814993] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-27T20:53:55.497454] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T20:53:55.577221] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T20:53:55.614950] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-27T20:53:56.414936] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-27T20:53:56.679225] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T20:53:57.214961] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-27T20:53:58.014984] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-27T20:53:58.303527] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T20:53:58.353719] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T20:53:58.814910] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-27T20:53:59.105546] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T20:53:59.109745] [INFO ] [REMOTE ] RNGR: Full fetch complete (28374 records). [2025-10-27T20:53:59.109826] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-27T20:53:59.482890] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-27T20:53:59.483007] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-27T20:53:59.483607] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-27T20:53:59.483672] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-27T20:53:59.484351] [DEBUG] [LOCAL ] RNGR: Trimmed 28374 records to 20643 (keeping 200 days of data) [2025-10-27T20:53:59.605128] [DEBUG] [LOCAL ] RNGR: Primary data saved (20643 records). [2025-10-27T20:53:59.605238] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-27T20:53:59.605315] [INFO ] [MAIN ] Update Progress: 1817/2366 symbols completed. RNGR took 25.9s. Estimated remaining: 1h 10m 41s. Rate: 7.8 symbols/min [2025-10-27T20:53:59.620038] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-27T20:53:59.771524] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:53:59.803669] [DEBUG] [LOCAL ] RNR: Loaded 33952 existing records from primary storage. [2025-10-27T20:53:59.803926] [INFO ] [MAIN ] RNR: Loaded 33952 existing records. [2025-10-27T20:53:59.979141] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:53:59.979509] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-27T20:53:59.979681] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-27T20:53:59.979975] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-27T20:53:59.980155] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-27T20:54:00.283329] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T20:54:00.368569] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:00.414908] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-27T20:54:00.708149] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T20:54:01.214951] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-27T20:54:02.014933] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-27T20:54:02.059135] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T20:54:02.083160] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T20:54:02.814985] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-27T20:54:03.065499] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T20:54:03.614958] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-27T20:54:03.960698] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T20:54:04.414928] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-27T20:54:04.661751] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T20:54:05.214961] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-27T20:54:06.014941] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-27T20:54:06.208025] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T20:54:06.392804] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T20:54:06.814921] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-27T20:54:07.098692] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T20:54:07.102420] [INFO ] [REMOTE ] RMT: Full fetch complete (25280 records). [2025-10-27T20:54:07.102499] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-27T20:54:07.462342] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-27T20:54:07.462415] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-27T20:54:07.462939] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-27T20:54:07.463001] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-27T20:54:07.463606] [DEBUG] [LOCAL ] RMT: Trimmed 25280 records to 17005 (keeping 200 days of data) [2025-10-27T20:54:07.563376] [DEBUG] [LOCAL ] RMT: Primary data saved (17005 records). [2025-10-27T20:54:07.563505] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-27T20:54:07.563590] [INFO ] [MAIN ] Update Progress: 1818/2366 symbols completed. RMT took 42.3s. Estimated remaining: 1h 10m 33s. Rate: 7.8 symbols/min [2025-10-27T20:54:07.620184] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-27T20:54:07.738434] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:07.770734] [DEBUG] [LOCAL ] RNST: Loaded 36378 existing records from primary storage. [2025-10-27T20:54:07.771021] [INFO ] [MAIN ] RNST: Loaded 36378 existing records. [2025-10-27T20:54:07.942637] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:07.942859] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-27T20:54:07.942924] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-27T20:54:07.943132] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-27T20:54:07.943194] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-27T20:54:08.319684] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:08.421985] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-27T20:54:08.444549] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:54:09.214911] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-27T20:54:09.359162] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T20:54:09.728799] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T20:54:10.014953] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-27T20:54:10.596146] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:54:10.814944] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-27T20:54:11.187038] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T20:54:11.614943] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-27T20:54:12.292942] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T20:54:12.414926] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-27T20:54:12.628794] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-27T20:54:12.638289] [INFO ] [REMOTE ] RNG: Full fetch complete (69935 records). [2025-10-27T20:54:12.638437] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-27T20:54:13.028800] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-27T20:54:13.028874] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-27T20:54:13.029875] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-27T20:54:13.029937] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-27T20:54:13.031173] [DEBUG] [LOCAL ] RNG: Trimmed 69935 records to 47862 (keeping 200 days of data) [2025-10-27T20:54:13.223509] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-27T20:54:13.300452] [DEBUG] [LOCAL ] RNG: Primary data saved (47862 records). [2025-10-27T20:54:13.300578] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-27T20:54:13.300674] [INFO ] [MAIN ] Update Progress: 1819/2366 symbols completed. RNG took 45.5s. Estimated remaining: 1h 10m 25s. Rate: 7.8 symbols/min [2025-10-27T20:54:13.472420] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:13.485942] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-27T20:54:13.507069] [DEBUG] [LOCAL ] ROG: Loaded 21760 existing records from primary storage. [2025-10-27T20:54:13.507328] [INFO ] [MAIN ] ROG: Loaded 21760 existing records. [2025-10-27T20:54:13.677529] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:13.677758] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-27T20:54:13.677808] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-27T20:54:13.678035] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-27T20:54:13.678095] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-27T20:54:14.018215] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-27T20:54:14.018122] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:14.815003] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-27T20:54:14.863071] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T20:54:15.323380] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T20:54:15.614938] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-27T20:54:15.992429] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T20:54:16.414969] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-27T20:54:16.993543] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T20:54:17.157510] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T20:54:17.214950] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-27T20:54:18.015002] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-27T20:54:18.715795] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:54:18.814909] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-27T20:54:19.130596] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T20:54:19.614921] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-27T20:54:20.114400] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T20:54:20.340268] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T20:54:20.344317] [INFO ] [REMOTE ] RNP: Full fetch complete (23275 records). [2025-10-27T20:54:20.344388] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-27T20:54:20.420170] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-27T20:54:20.704588] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-27T20:54:20.704699] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-27T20:54:20.705212] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-27T20:54:20.705253] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-27T20:54:20.705857] [DEBUG] [LOCAL ] RNP: Trimmed 23275 records to 15772 (keeping 200 days of data) [2025-10-27T20:54:20.802282] [DEBUG] [LOCAL ] RNP: Primary data saved (15772 records). [2025-10-27T20:54:20.802432] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-27T20:54:20.802538] [INFO ] [MAIN ] Update Progress: 1820/2366 symbols completed. RNP took 28.3s. Estimated remaining: 1h 10m 17s. Rate: 7.8 symbols/min [2025-10-27T20:54:20.965704] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:21.005635] [DEBUG] [LOCAL ] ROK: Loaded 43229 existing records from primary storage. [2025-10-27T20:54:21.005959] [INFO ] [MAIN ] ROK: Loaded 43229 existing records. [2025-10-27T20:54:21.175601] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:21.175811] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-27T20:54:21.175856] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-27T20:54:21.176060] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-10-27T20:54:21.176115] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-27T20:54:21.220036] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-27T20:54:21.528374] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:21.682132] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T20:54:22.014996] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-27T20:54:22.371921] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T20:54:22.814937] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-27T20:54:23.105183] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T20:54:23.615048] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-27T20:54:24.407237] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T20:54:24.415002] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-27T20:54:25.216268] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-27T20:54:25.218735] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T20:54:25.906338] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-27T20:54:26.014903] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-27T20:54:26.511680] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T20:54:26.814915] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-27T20:54:27.206871] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T20:54:27.614964] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-27T20:54:28.227290] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T20:54:28.414969] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-27T20:54:29.021546] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T20:54:29.214988] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-27T20:54:29.587601] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T20:54:30.014939] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-27T20:54:30.814917] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-27T20:54:30.984025] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T20:54:31.056465] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:54:31.062989] [INFO ] [REMOTE ] RNST: Full fetch complete (52558 records). [2025-10-27T20:54:31.063103] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-27T20:54:31.063721] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:54:31.063807] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:54:31.063850] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:54:31.063888] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-27T20:54:31.063943] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-27T20:54:31.063977] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-27T20:54:31.064145] [DEBUG] [LOCAL ] RNST: Deleted derivative data file. [2025-10-27T20:54:31.064243] [INFO ] [MAIN ] Update Progress: 1821/2366 symbols completed. RNST took 23.5s. Estimated remaining: 1h 10m 10s. Rate: 7.8 symbols/min [2025-10-27T20:54:31.230304] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:31.274672] [DEBUG] [LOCAL ] ROL: Loaded 50981 existing records from primary storage. [2025-10-27T20:54:31.274972] [INFO ] [MAIN ] ROL: Loaded 50981 existing records. [2025-10-27T20:54:31.449514] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:31.449766] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-27T20:54:31.449817] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-27T20:54:31.450084] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-10-27T20:54:31.450123] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-27T20:54:31.620188] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-27T20:54:31.802193] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:32.414939] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-27T20:54:32.535800] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T20:54:32.582365] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T20:54:33.214971] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-27T20:54:34.014964] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-27T20:54:34.097339] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T20:54:34.120914] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T20:54:34.814965] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-27T20:54:35.614923] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-27T20:54:35.846908] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-27T20:54:35.918684] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T20:54:36.414926] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-27T20:54:36.986497] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T20:54:37.214920] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-27T20:54:37.843188] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T20:54:38.014917] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-27T20:54:38.742109] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T20:54:38.814927] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-27T20:54:38.931101] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T20:54:38.937362] [INFO ] [REMOTE ] RNR: Full fetch complete (50682 records). [2025-10-27T20:54:38.937462] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-27T20:54:38.938184] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:54:38.938270] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:54:38.938312] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:54:38.938377] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-27T20:54:38.938439] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-27T20:54:38.938473] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-27T20:54:38.938594] [DEBUG] [LOCAL ] RNR: Deleted derivative data file. [2025-10-27T20:54:38.938926] [INFO ] [MAIN ] Update Progress: 1822/2366 symbols completed. RNR took 39.3s. Estimated remaining: 1h 10m 3s. Rate: 7.8 symbols/min [2025-10-27T20:54:39.105990] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:39.145954] [DEBUG] [LOCAL ] RPM: Loaded 42639 existing records from primary storage. [2025-10-27T20:54:39.146258] [INFO ] [MAIN ] RPM: Loaded 42639 existing records. [2025-10-27T20:54:39.330370] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:39.330560] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-27T20:54:39.330631] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-27T20:54:39.330992] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-27T20:54:39.331065] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-27T20:54:39.620028] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-27T20:54:39.694805] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:39.989006] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T20:54:40.414934] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-27T20:54:41.214916] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-27T20:54:41.477563] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T20:54:41.919487] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T20:54:42.014939] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-27T20:54:42.514337] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T20:54:42.814923] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-27T20:54:42.973676] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T20:54:43.614936] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-27T20:54:44.224261] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T20:54:44.414946] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-27T20:54:45.214921] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-27T20:54:45.253388] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T20:54:45.732724] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T20:54:45.927330] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T20:54:45.930284] [INFO ] [REMOTE ] ROG: Full fetch complete (30578 records). [2025-10-27T20:54:45.930378] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-27T20:54:45.930834] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:54:45.930928] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:54:45.931005] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:54:45.931114] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-27T20:54:45.931193] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-27T20:54:45.931230] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-27T20:54:45.931377] [DEBUG] [LOCAL ] ROG: Deleted derivative data file. [2025-10-27T20:54:45.931461] [INFO ] [MAIN ] Update Progress: 1823/2366 symbols completed. ROG took 32.6s. Estimated remaining: 1h 9m 55s. Rate: 7.8 symbols/min [2025-10-27T20:54:46.020048] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-27T20:54:46.098743] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:46.116367] [DEBUG] [LOCAL ] RPT: Loaded 19162 existing records from primary storage. [2025-10-27T20:54:46.116579] [INFO ] [MAIN ] RPT: Loaded 19162 existing records. [2025-10-27T20:54:46.292927] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:46.293163] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-27T20:54:46.293220] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-27T20:54:46.293375] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-27T20:54:46.293413] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-27T20:54:46.657986] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:46.814939] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-27T20:54:47.489572] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T20:54:47.614958] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-27T20:54:47.655425] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T20:54:48.414929] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-27T20:54:49.185164] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T20:54:49.214895] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-27T20:54:49.858814] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T20:54:50.014903] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-27T20:54:50.814957] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-27T20:54:50.948576] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T20:54:51.615000] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-27T20:54:51.824481] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T20:54:51.852953] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:54:51.859695] [INFO ] [REMOTE ] ROK: Full fetch complete (62229 records). [2025-10-27T20:54:51.859821] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-27T20:54:51.860482] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:54:51.860567] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:54:51.860609] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:54:51.860701] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-27T20:54:51.860767] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-27T20:54:51.860801] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-27T20:54:51.860922] [DEBUG] [LOCAL ] ROK: Deleted derivative data file. [2025-10-27T20:54:51.861611] [INFO ] [MAIN ] Update Progress: 1824/2366 symbols completed. ROK took 31.1s. Estimated remaining: 1h 9m 47s. Rate: 7.8 symbols/min [2025-10-27T20:54:52.030058] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:54:52.061747] [DEBUG] [LOCAL ] RQI: Loaded 29097 existing records from primary storage. [2025-10-27T20:54:52.062000] [INFO ] [MAIN ] RQI: Loaded 29097 existing records. [2025-10-27T20:54:52.233211] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:54:52.233398] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-27T20:54:52.233442] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-27T20:54:52.233628] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-27T20:54:52.233720] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-27T20:54:52.424055] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-27T20:54:52.580173] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:54:53.005395] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T20:54:53.214980] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-27T20:54:53.860535] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T20:54:54.014951] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-27T20:54:54.682324] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T20:54:54.814973] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-27T20:54:55.614941] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-27T20:54:55.917104] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T20:54:56.011628] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T20:54:56.415062] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-27T20:54:56.789232] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T20:54:57.214989] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-27T20:54:57.797718] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T20:54:58.020130] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-27T20:54:58.026772] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T20:54:58.814981] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-27T20:54:59.416477] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T20:54:59.614929] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-27T20:55:00.159776] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T20:55:00.414909] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-27T20:55:01.075287] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T20:55:01.215034] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-27T20:55:01.441846] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T20:55:01.451589] [INFO ] [REMOTE ] ROL: Full fetch complete (72823 records). [2025-10-27T20:55:01.451788] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-27T20:55:01.452604] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:55:01.452736] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:55:01.452778] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:55:01.452815] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-27T20:55:01.452870] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-27T20:55:01.452904] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-27T20:55:01.453032] [DEBUG] [LOCAL ] ROL: Deleted derivative data file. [2025-10-27T20:55:01.453104] [INFO ] [MAIN ] Update Progress: 1825/2366 symbols completed. ROL took 30.4s. Estimated remaining: 1h 9m 39s. Rate: 7.8 symbols/min [2025-10-27T20:55:01.623301] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:01.670548] [DEBUG] [LOCAL ] RRC: Loaded 53691 existing records from primary storage. [2025-10-27T20:55:01.670883] [INFO ] [MAIN ] RRC: Loaded 53691 existing records. [2025-10-27T20:55:01.846266] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:01.846486] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-27T20:55:01.846531] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-27T20:55:01.846855] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-27T20:55:01.846919] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-27T20:55:02.020562] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-27T20:55:02.204248] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:02.814965] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-27T20:55:03.089481] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T20:55:03.211679] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T20:55:03.614955] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-27T20:55:04.414968] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-27T20:55:04.710237] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-27T20:55:05.132249] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T20:55:05.214901] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-27T20:55:06.014911] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-27T20:55:06.049466] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:55:06.713825] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T20:55:06.814918] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-27T20:55:07.614973] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-27T20:55:07.738843] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T20:55:08.359768] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T20:55:08.414929] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-27T20:55:08.634550] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T20:55:09.214997] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-27T20:55:10.014940] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-27T20:55:10.054582] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T20:55:10.814903] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-27T20:55:10.830228] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T20:55:10.913732] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T20:55:11.614944] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-27T20:55:12.122836] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T20:55:12.414967] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-27T20:55:12.523468] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T20:55:13.215030] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-27T20:55:14.014921] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-27T20:55:14.304477] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T20:55:14.358791] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T20:55:14.814960] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-27T20:55:14.922567] [DEBUG] [REMOTE ] RPM: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-27T20:55:14.922899] [WARN ] [REMOTE ] RPM: No data returned for month 2025-10 [2025-10-27T20:55:14.922990] [FATAL] [REMOTE ] RPM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T20:55:14.923069] [FATAL] [MAIN ] RPM: Failed to fetch primary data. [2025-10-27T20:55:14.923106] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T20:55:14.923170] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-27T20:55:14.923231] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-27T20:55:14.923267] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-27T20:55:14.923384] [DEBUG] [LOCAL ] RPM: Deleted derivative data file. [2025-10-27T20:55:14.923803] [INFO ] [MAIN ] Update Progress: 1826/2366 symbols completed. RPM took 36.0s. Estimated remaining: 1h 9m 33s. Rate: 7.8 symbols/min [2025-10-27T20:55:15.120556] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:15.163763] [DEBUG] [LOCAL ] RRX: Loaded 41304 existing records from primary storage. [2025-10-27T20:55:15.164101] [INFO ] [MAIN ] RRX: Loaded 41304 existing records. [2025-10-27T20:55:15.367002] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:15.367206] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-27T20:55:15.367253] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-27T20:55:15.367467] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-27T20:55:15.367523] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-27T20:55:15.615741] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-27T20:55:15.706535] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T20:55:15.804721] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:16.414979] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-27T20:55:16.500436] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T20:55:16.504315] [INFO ] [REMOTE ] RPT: Full fetch complete (28149 records). [2025-10-27T20:55:16.504414] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-27T20:55:16.926914] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-27T20:55:16.926998] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-27T20:55:16.927909] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-27T20:55:16.927975] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-27T20:55:16.928804] [DEBUG] [LOCAL ] RPT: Trimmed 28149 records to 18695 (keeping 200 days of data) [2025-10-27T20:55:17.042968] [DEBUG] [LOCAL ] RPT: Primary data saved (18695 records). [2025-10-27T20:55:17.043121] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-27T20:55:17.043222] [INFO ] [MAIN ] Update Progress: 1827/2366 symbols completed. RPT took 31.1s. Estimated remaining: 1h 9m 24s. Rate: 7.8 symbols/min [2025-10-27T20:55:17.229448] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-27T20:55:17.233688] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:17.258155] [DEBUG] [LOCAL ] RS: Loaded 24971 existing records from primary storage. [2025-10-27T20:55:17.258436] [INFO ] [MAIN ] RS: Loaded 24971 existing records. [2025-10-27T20:55:17.432207] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:17.432410] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-27T20:55:17.432457] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-27T20:55:17.432678] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-27T20:55:17.432737] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-27T20:55:17.787808] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:17.880797] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T20:55:18.014964] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-27T20:55:18.662696] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T20:55:18.814981] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-27T20:55:19.225485] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T20:55:19.614976] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-27T20:55:19.886999] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T20:55:20.414930] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-27T20:55:21.114443] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T20:55:21.214982] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-27T20:55:22.007663] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:55:22.018507] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-27T20:55:22.595143] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T20:55:22.600567] [INFO ] [REMOTE ] RQI: Full fetch complete (42574 records). [2025-10-27T20:55:22.600699] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-27T20:55:22.823374] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-27T20:55:22.987376] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-27T20:55:22.987452] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-27T20:55:22.988311] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-27T20:55:22.988372] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-27T20:55:22.989345] [DEBUG] [LOCAL ] RQI: Trimmed 42574 records to 28409 (keeping 200 days of data) [2025-10-27T20:55:23.157275] [DEBUG] [LOCAL ] RQI: Primary data saved (28409 records). [2025-10-27T20:55:23.157404] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-27T20:55:23.157482] [INFO ] [MAIN ] Update Progress: 1828/2366 symbols completed. RQI took 31.3s. Estimated remaining: 1h 9m 16s. Rate: 7.8 symbols/min [2025-10-27T20:55:23.327278] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:23.333631] [DEBUG] [LOCAL ] RSF: Loaded 4285 existing records from primary storage. [2025-10-27T20:55:23.333842] [INFO ] [MAIN ] RSF: Loaded 4285 existing records. [2025-10-27T20:55:23.512846] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:23.513040] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-27T20:55:23.513093] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-27T20:55:23.513276] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-27T20:55:23.513336] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-27T20:55:23.615578] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-27T20:55:23.880591] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:23.905830] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T20:55:24.180536] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T20:55:24.414940] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-27T20:55:25.215012] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-27T20:55:25.402434] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T20:55:25.712405] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:55:25.952104] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T20:55:26.014926] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-27T20:55:26.814993] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-27T20:55:27.462477] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T20:55:27.614915] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-27T20:55:28.414938] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-27T20:55:28.754374] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T20:55:28.822087] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-27T20:55:29.214947] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-27T20:55:30.008223] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T20:55:30.015300] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-27T20:55:30.423419] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T20:55:30.591836] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T20:55:30.814940] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-27T20:55:31.614955] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-27T20:55:32.152773] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T20:55:32.414970] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-27T20:55:33.214972] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-27T20:55:33.578118] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T20:55:33.734886] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T20:55:34.014943] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-27T20:55:34.472875] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T20:55:34.814967] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-27T20:55:35.614955] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-27T20:55:35.735943] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T20:55:36.151708] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T20:55:36.189524] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:55:36.414959] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-27T20:55:37.061209] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T20:55:37.214991] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-27T20:55:37.705810] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T20:55:38.014948] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-27T20:55:38.815000] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-27T20:55:39.615257] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-27T20:55:39.618373] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T20:55:39.858544] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T20:55:39.869756] [INFO ] [REMOTE ] RRC: Full fetch complete (76370 records). [2025-10-27T20:55:39.870003] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-27T20:55:39.871153] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:55:39.871247] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:55:39.871292] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:55:39.871333] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-27T20:55:39.871400] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-27T20:55:39.871434] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-27T20:55:39.871607] [DEBUG] [LOCAL ] RRC: Deleted derivative data file. [2025-10-27T20:55:39.871722] [INFO ] [MAIN ] Update Progress: 1829/2366 symbols completed. RRC took 38.4s. Estimated remaining: 1h 9m 11s. Rate: 7.8 symbols/min [2025-10-27T20:55:40.053566] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:40.095604] [DEBUG] [LOCAL ] RSG: Loaded 47994 existing records from primary storage. [2025-10-27T20:55:40.095963] [INFO ] [MAIN ] RSG: Loaded 47994 existing records. [2025-10-27T20:55:40.218406] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T20:55:40.280106] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:40.280317] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-27T20:55:40.280365] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-27T20:55:40.280672] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-10-27T20:55:40.280731] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-27T20:55:40.430057] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-27T20:55:40.640366] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:41.214965] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-27T20:55:41.404520] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:55:41.411689] [INFO ] [REMOTE ] RRX: Full fetch complete (58447 records). [2025-10-27T20:55:41.411788] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-27T20:55:41.413003] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:55:41.413087] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:55:41.413155] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:55:41.413224] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-27T20:55:41.413286] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-27T20:55:41.413320] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-27T20:55:41.413453] [DEBUG] [LOCAL ] RRX: Deleted derivative data file. [2025-10-27T20:55:41.414020] [INFO ] [MAIN ] Update Progress: 1830/2366 symbols completed. RRX took 26.5s. Estimated remaining: 1h 9m 1s. Rate: 7.8 symbols/min [2025-10-27T20:55:41.577151] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:41.620860] [DEBUG] [LOCAL ] RSI: Loaded 47711 existing records from primary storage. [2025-10-27T20:55:41.621131] [INFO ] [MAIN ] RSI: Loaded 47711 existing records. [2025-10-27T20:55:41.792977] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:41.793187] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-27T20:55:41.793269] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-27T20:55:41.793452] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-27T20:55:41.793491] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-27T20:55:42.025468] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-27T20:55:42.067182] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T20:55:42.147578] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:42.814915] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-27T20:55:43.493727] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T20:55:43.614958] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-27T20:55:44.229742] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T20:55:44.415009] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-27T20:55:45.168564] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T20:55:45.214959] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-27T20:55:45.724356] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T20:55:46.014954] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-27T20:55:46.554899] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T20:55:46.814994] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-27T20:55:47.458978] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T20:55:47.614923] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-27T20:55:47.674563] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T20:55:48.414990] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-27T20:55:49.014188] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T20:55:49.214937] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-27T20:55:49.796587] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T20:55:50.014938] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-27T20:55:50.814961] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-27T20:55:50.918271] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T20:55:51.360053] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T20:55:51.614943] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-27T20:55:51.761821] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T20:55:52.414940] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-27T20:55:53.161094] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T20:55:53.199261] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T20:55:53.214902] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-27T20:55:53.705721] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T20:55:53.710312] [INFO ] [REMOTE ] RS: Full fetch complete (38279 records). [2025-10-27T20:55:53.710391] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-27T20:55:53.710885] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:55:53.710966] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:55:53.711008] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:55:53.711073] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-27T20:55:53.711135] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-27T20:55:53.711169] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-27T20:55:53.711286] [DEBUG] [LOCAL ] RS: Deleted derivative data file. [2025-10-27T20:55:53.711350] [INFO ] [MAIN ] Update Progress: 1831/2366 symbols completed. RS took 36.7s. Estimated remaining: 1h 8m 55s. Rate: 7.8 symbols/min [2025-10-27T20:55:53.874073] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:53.904775] [DEBUG] [LOCAL ] RSKD: Loaded 33786 existing records from primary storage. [2025-10-27T20:55:53.905026] [INFO ] [MAIN ] RSKD: Loaded 33786 existing records. [2025-10-27T20:55:54.020121] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-27T20:55:54.079389] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:54.079525] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-27T20:55:54.079570] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-27T20:55:54.079760] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-27T20:55:54.079815] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-27T20:55:54.429733] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:54.814915] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-27T20:55:55.598732] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T20:55:55.614899] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-27T20:55:56.326094] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T20:55:56.414904] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-27T20:55:57.214969] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-27T20:55:57.323779] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T20:55:57.392104] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T20:55:57.708389] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T20:55:57.709758] [INFO ] [REMOTE ] RSF: Full fetch complete (5567 records). [2025-10-27T20:55:57.709826] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-27T20:55:58.020121] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-27T20:55:58.057391] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-27T20:55:58.057478] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-27T20:55:58.057671] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-27T20:55:58.057733] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-27T20:55:58.058096] [DEBUG] [LOCAL ] RSF: Trimmed 5567 records to 4184 (keeping 200 days of data) [2025-10-27T20:55:58.083446] [DEBUG] [LOCAL ] RSF: Primary data saved (4184 records). [2025-10-27T20:55:58.083526] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-27T20:55:58.083599] [INFO ] [MAIN ] Update Progress: 1832/2366 symbols completed. RSF took 34.9s. Estimated remaining: 1h 8m 46s. Rate: 7.8 symbols/min [2025-10-27T20:55:58.248896] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:55:58.292904] [DEBUG] [LOCAL ] RTO: Loaded 40455 existing records from primary storage. [2025-10-27T20:55:58.293212] [INFO ] [MAIN ] RTO: Loaded 40455 existing records. [2025-10-27T20:55:58.469111] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:55:58.469316] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-27T20:55:58.469385] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-27T20:55:58.469821] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-27T20:55:58.469879] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-27T20:55:58.818547] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-27T20:55:58.824495] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:55:59.615140] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-27T20:56:00.009736] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T20:56:00.091926] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T20:56:00.415012] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-27T20:56:01.214937] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-27T20:56:01.350229] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-27T20:56:01.484458] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T20:56:02.014970] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-27T20:56:02.814999] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-27T20:56:03.091163] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T20:56:03.614934] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-27T20:56:03.788388] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T20:56:04.344279] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T20:56:04.414966] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-27T20:56:04.883554] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T20:56:05.214942] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-27T20:56:06.014925] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-27T20:56:06.225687] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T20:56:06.814953] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-27T20:56:07.090505] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T20:56:07.419291] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-27T20:56:07.614954] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-27T20:56:08.339746] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T20:56:08.414977] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-27T20:56:09.214989] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T20:56:09.215122] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-27T20:56:10.014977] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-27T20:56:10.330792] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T20:56:10.341135] [INFO ] [REMOTE ] RSI: Full fetch complete (69684 records). [2025-10-27T20:56:10.341254] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-27T20:56:10.737699] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-27T20:56:10.737838] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-27T20:56:10.738912] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-27T20:56:10.738973] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-27T20:56:10.740251] [DEBUG] [LOCAL ] RSI: Trimmed 69684 records to 46926 (keeping 200 days of data) [2025-10-27T20:56:10.821101] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-27T20:56:11.013064] [DEBUG] [LOCAL ] RSI: Primary data saved (46926 records). [2025-10-27T20:56:11.013198] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-27T20:56:11.013601] [INFO ] [MAIN ] Update Progress: 1833/2366 symbols completed. RSI took 29.6s. Estimated remaining: 1h 8m 40s. Rate: 7.8 symbols/min [2025-10-27T20:56:11.209084] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:11.217459] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T20:56:11.279576] [DEBUG] [LOCAL ] RTX: Loaded 54485 existing records from primary storage. [2025-10-27T20:56:11.279912] [INFO ] [MAIN ] RTX: Loaded 54485 existing records. [2025-10-27T20:56:11.455799] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:56:11.456134] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-27T20:56:11.456230] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-27T20:56:11.456562] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-27T20:56:11.456616] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-27T20:56:11.632236] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-27T20:56:11.831564] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:11.858997] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-27T20:56:12.382915] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T20:56:12.414950] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-27T20:56:13.214958] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-27T20:56:13.523056] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T20:56:14.014990] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-27T20:56:14.526131] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T20:56:14.556168] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T20:56:14.564614] [INFO ] [REMOTE ] RSG: Full fetch complete (68062 records). [2025-10-27T20:56:14.564747] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-27T20:56:14.565400] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:56:14.565512] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:56:14.565554] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:56:14.565592] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-27T20:56:14.565670] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-27T20:56:14.565727] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-27T20:56:14.565926] [DEBUG] [LOCAL ] RSG: Deleted derivative data file. [2025-10-27T20:56:14.566037] [INFO ] [MAIN ] Update Progress: 1834/2366 symbols completed. RSG took 34.7s. Estimated remaining: 1h 8m 31s. Rate: 7.8 symbols/min [2025-10-27T20:56:14.747633] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:14.776752] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-27T20:56:14.823526] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-27T20:56:14.826001] [DEBUG] [LOCAL ] RVLV: Loaded 47974 existing records from primary storage. [2025-10-27T20:56:14.826246] [INFO ] [MAIN ] RVLV: Loaded 47974 existing records. [2025-10-27T20:56:15.006462] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:56:15.006721] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-27T20:56:15.006824] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-27T20:56:15.007032] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-27T20:56:15.007087] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-27T20:56:15.346341] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:15.614969] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-27T20:56:16.392276] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T20:56:16.414900] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-27T20:56:16.916124] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T20:56:16.923598] [INFO ] [REMOTE ] RSKD: Full fetch complete (48498 records). [2025-10-27T20:56:16.923790] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-27T20:56:17.220154] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-27T20:56:17.327688] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-27T20:56:17.327784] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-27T20:56:17.328688] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-27T20:56:17.328751] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-27T20:56:17.329778] [DEBUG] [LOCAL ] RSKD: Trimmed 48498 records to 33127 (keeping 200 days of data) [2025-10-27T20:56:17.509799] [DEBUG] [LOCAL ] RSKD: Primary data saved (33127 records). [2025-10-27T20:56:17.509948] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-27T20:56:17.510028] [INFO ] [MAIN ] Update Progress: 1835/2366 symbols completed. RSKD took 23.8s. Estimated remaining: 1h 8m 22s. Rate: 7.8 symbols/min [2025-10-27T20:56:17.672961] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:17.699901] [DEBUG] [LOCAL ] RVT: Loaded 26410 existing records from primary storage. [2025-10-27T20:56:17.700149] [INFO ] [MAIN ] RVT: Loaded 26410 existing records. [2025-10-27T20:56:17.869571] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:56:17.869809] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-27T20:56:17.869857] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-27T20:56:17.870076] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-27T20:56:17.870131] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-27T20:56:18.020914] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-27T20:56:18.234997] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:18.464248] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T20:56:18.499825] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T20:56:18.814946] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-27T20:56:19.614947] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-27T20:56:19.810829] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:56:20.414975] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-27T20:56:20.945559] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-27T20:56:21.002009] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T20:56:21.214914] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-27T20:56:21.944709] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-27T20:56:22.014911] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-27T20:56:22.814915] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-27T20:56:22.989819] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T20:56:23.581168] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T20:56:23.614914] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-27T20:56:24.085017] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T20:56:24.414937] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-27T20:56:25.123148] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T20:56:25.214952] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-27T20:56:25.239967] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T20:56:26.015061] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-27T20:56:26.257010] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T20:56:26.814990] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-27T20:56:27.120298] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T20:56:27.614982] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-27T20:56:28.414977] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-27T20:56:28.484358] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T20:56:28.492430] [INFO ] [REMOTE ] RTO: Full fetch complete (58976 records). [2025-10-27T20:56:28.492524] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-27T20:56:28.878135] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-27T20:56:28.878207] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-27T20:56:28.879148] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-27T20:56:28.879209] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-27T20:56:28.880295] [DEBUG] [LOCAL ] RTO: Trimmed 58976 records to 39710 (keeping 200 days of data) [2025-10-27T20:56:29.112052] [DEBUG] [LOCAL ] RTO: Primary data saved (39710 records). [2025-10-27T20:56:29.112188] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-27T20:56:29.112919] [INFO ] [MAIN ] Update Progress: 1836/2366 symbols completed. RTO took 31.0s. Estimated remaining: 1h 8m 15s. Rate: 7.8 symbols/min [2025-10-27T20:56:29.220118] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-27T20:56:29.278768] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:29.323890] [DEBUG] [LOCAL ] RVTY: Loaded 48517 existing records from primary storage. [2025-10-27T20:56:29.324173] [INFO ] [MAIN ] RVTY: Loaded 48517 existing records. [2025-10-27T20:56:29.514753] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:56:29.514968] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-27T20:56:29.515013] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-27T20:56:29.515249] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-10-27T20:56:29.515306] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-27T20:56:29.877318] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:30.010899] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-27T20:56:30.021118] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-27T20:56:30.095506] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T20:56:30.278775] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T20:56:30.814951] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-27T20:56:31.614933] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-27T20:56:31.758211] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T20:56:32.415002] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-27T20:56:32.839329] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T20:56:33.204327] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-27T20:56:33.215254] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-27T20:56:33.707533] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T20:56:34.014925] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-27T20:56:34.484187] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T20:56:34.814980] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-27T20:56:35.615008] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-27T20:56:35.934589] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T20:56:36.414996] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-27T20:56:36.633742] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T20:56:36.695850] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T20:56:37.214946] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-27T20:56:38.014907] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-27T20:56:38.107488] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-27T20:56:38.814927] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-27T20:56:38.890673] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T20:56:38.963246] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T20:56:39.614939] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-27T20:56:40.423280] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-27T20:56:40.442357] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T20:56:41.214927] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-27T20:56:41.362544] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T20:56:41.397992] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T20:56:41.407735] [INFO ] [REMOTE ] RTX: Full fetch complete (77487 records). [2025-10-27T20:56:41.407863] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-27T20:56:41.408749] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:56:41.408836] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:56:41.408878] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:56:41.408917] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-27T20:56:41.408974] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-27T20:56:41.409009] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-27T20:56:41.409141] [DEBUG] [LOCAL ] RTX: Deleted derivative data file. [2025-10-27T20:56:41.409667] [INFO ] [MAIN ] Update Progress: 1837/2366 symbols completed. RTX took 30.4s. Estimated remaining: 1h 8m 9s. Rate: 7.8 symbols/min [2025-10-27T20:56:42.014928] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-27T20:56:42.815022] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-27T20:56:42.951041] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T20:56:43.531891] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T20:56:43.614910] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-27T20:56:43.990041] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T20:56:44.414961] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-27T20:56:45.202934] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T20:56:45.214903] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-27T20:56:45.267325] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T20:56:45.274328] [INFO ] [REMOTE ] RVT: Full fetch complete (38929 records). [2025-10-27T20:56:45.274455] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-27T20:56:45.652008] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-27T20:56:45.652088] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-27T20:56:45.652871] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-27T20:56:45.652934] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-27T20:56:45.653869] [DEBUG] [LOCAL ] RVT: Trimmed 38929 records to 25758 (keeping 200 days of data) [2025-10-27T20:56:45.805636] [DEBUG] [LOCAL ] RVT: Primary data saved (25758 records). [2025-10-27T20:56:45.805805] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-27T20:56:45.805887] [INFO ] [MAIN ] Update Progress: 1838/2366 symbols completed. RVT took 28.3s. Estimated remaining: 1h 8m 0s. Rate: 7.8 symbols/min [2025-10-27T20:56:46.015029] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-27T20:56:47.135693] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-27T20:56:47.146001] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-27T20:56:47.714580] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T20:56:47.724469] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-27T20:56:48.753991] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T20:56:48.763953] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-27T20:56:49.009050] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T20:56:49.214899] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-27T20:56:50.140818] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:56:50.150589] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-27T20:56:50.597856] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T20:56:50.814923] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-27T20:56:51.143048] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T20:56:51.152151] [INFO ] [REMOTE ] RVTY: Full fetch complete (67935 records). [2025-10-27T20:56:51.152299] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-27T20:56:51.153081] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:56:51.153176] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:56:51.153218] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:56:51.153256] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-27T20:56:51.153337] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-27T20:56:51.153443] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-27T20:56:51.153623] [DEBUG] [LOCAL ] RVTY: Deleted derivative data file. [2025-10-27T20:56:51.154314] [INFO ] [MAIN ] Update Progress: 1839/2366 symbols completed. RVTY took 22.0s. Estimated remaining: 1h 7m 52s. Rate: 7.8 symbols/min [2025-10-27T20:56:52.065559] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T20:56:52.074366] [INFO ] [REMOTE ] RVLV: Full fetch complete (68898 records). [2025-10-27T20:56:52.074477] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-27T20:56:52.461232] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-27T20:56:52.461310] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-27T20:56:52.462360] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-27T20:56:52.462422] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-27T20:56:52.463719] [DEBUG] [LOCAL ] RVLV: Trimmed 68898 records to 47137 (keeping 200 days of data) [2025-10-27T20:56:52.750898] [DEBUG] [LOCAL ] RVLV: Primary data saved (47137 records). [2025-10-27T20:56:52.751041] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-27T20:56:52.751138] [INFO ] [MAIN ] Update Progress: 1840/2366 symbols completed. RVLV took 38.2s. Estimated remaining: 1h 7m 42s. Rate: 7.8 symbols/min [2025-10-27T20:56:53.289630] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:53.365680] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-27T20:56:53.420618] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:53.448438] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:53.448578] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-27T20:56:53.450717] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-27T20:56:53.452717] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:56:53.453311] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-27T20:56:53.453608] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-27T20:56:53.453703] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-27T20:56:53.453545] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-27T20:56:53.453913] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-27T20:56:53.454168] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-27T20:56:53.454126] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-27T20:56:53.454298] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-27T20:56:53.454568] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-27T20:56:53.454676] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-27T20:56:53.454435] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-27T20:56:53.468767] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-27T20:56:53.483903] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-27T20:56:53.510830] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-27T20:56:53.537307] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-27T20:56:54.012879] [DEBUG] [LOCAL ] RWT: Loaded 40951 existing records from primary storage. [2025-10-27T20:56:54.051390] [INFO ] [MAIN ] RWT: Loaded 40951 existing records. [2025-10-27T20:56:54.627387] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:54.659229] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-10-27T20:56:54.658713] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:54.674209] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-27T20:56:54.738417] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:54.760594] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-27T20:56:54.814615] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:56:54.814872] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-27T20:56:54.814923] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-27T20:56:54.815304] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-27T20:56:54.815360] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-27T20:56:55.154950] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:56:55.155222] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-27T20:56:55.183851] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T20:56:55.185009] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-10-27T20:56:55.306769] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T20:56:55.526242] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T20:56:55.614964] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-27T20:56:55.935615] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T20:56:56.050292] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T20:56:56.414963] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-27T20:56:56.443362] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T20:56:56.968335] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-27T20:56:57.214935] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-27T20:56:57.801998] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T20:56:58.014990] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-10-27T20:56:58.501744] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T20:56:58.814998] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-10-27T20:56:59.274619] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T20:56:59.614955] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-27T20:57:00.168678] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T20:57:00.414970] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-27T20:57:01.214984] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-27T20:57:01.763462] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-27T20:57:02.014986] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-10-27T20:57:02.061947] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-27T20:57:02.509797] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T20:57:02.815023] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-27T20:57:03.614964] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-10-27T20:57:04.216201] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T20:57:04.414916] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-27T20:57:04.482016] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T20:57:04.887728] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T20:57:05.214947] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-27T20:57:05.855284] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T20:57:06.014955] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-27T20:57:06.553217] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T20:57:06.815021] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-27T20:57:07.565105] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-27T20:57:07.614911] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-27T20:57:08.414996] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-27T20:57:08.671851] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T20:57:08.878437] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T20:57:09.214995] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-10-27T20:57:10.015229] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-27T20:57:10.015504] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:57:10.563269] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T20:57:10.814998] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-10-27T20:57:11.614955] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-27T20:57:12.414960] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-27T20:57:12.932818] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-27T20:57:13.214939] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-27T20:57:14.014939] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-10-27T20:57:14.089212] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-27T20:57:14.090203] [INFO ] [REMOTE ] RWTO: Full fetch complete (4790 records). [2025-10-27T20:57:14.090268] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-27T20:57:14.273315] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T20:57:14.273578] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:57:14.273677] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:57:14.273737] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-27T20:57:14.273796] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-27T20:57:14.273831] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-27T20:57:14.273869] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-27T20:57:14.273927] [INFO ] [MAIN ] Update Progress: 1841/2366 symbols completed. RWTO took 21.5s. Estimated remaining: 1h 7m 38s. Rate: 7.8 symbols/min [2025-10-27T20:57:14.449706] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:14.495552] [DEBUG] [LOCAL ] RXO: Loaded 49160 existing records from primary storage. [2025-10-27T20:57:14.495884] [INFO ] [MAIN ] RXO: Loaded 49160 existing records. [2025-10-27T20:57:14.598309] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T20:57:14.678093] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:14.678319] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-27T20:57:14.678366] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-27T20:57:14.678748] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-27T20:57:14.678804] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-27T20:57:14.817782] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-10. [2025-10-27T20:57:15.047302] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:15.060016] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-27T20:57:15.614944] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-27T20:57:15.632853] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-27T20:57:16.414932] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-27T20:57:17.214943] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-27T20:57:17.285414] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-27T20:57:17.286350] [INFO ] [REMOTE ] RWTP: Full fetch complete (4730 records). [2025-10-27T20:57:17.286419] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-27T20:57:17.460139] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-27T20:57:17.460410] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:57:17.460498] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:57:17.460591] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-27T20:57:17.460703] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-27T20:57:17.460767] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-27T20:57:17.460814] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-27T20:57:17.460872] [INFO ] [MAIN ] Update Progress: 1842/2366 symbols completed. RWTP took 24.7s. Estimated remaining: 1h 7m 29s. Rate: 7.8 symbols/min [2025-10-27T20:57:17.625880] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:17.668340] [DEBUG] [LOCAL ] RY: Loaded 48118 existing records from primary storage. [2025-10-27T20:57:17.668662] [INFO ] [MAIN ] RY: Loaded 48118 existing records. [2025-10-27T20:57:17.844899] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:17.845063] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-27T20:57:17.845107] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-27T20:57:17.845307] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-27T20:57:17.845361] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-27T20:57:18.185707] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:18.185969] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-27T20:57:19.795938] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T20:57:19.805111] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-27T20:57:21.054011] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T20:57:21.062995] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-27T20:57:22.716442] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T20:57:22.728426] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-27T20:57:24.596500] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T20:57:24.608350] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-27T20:57:27.334828] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-27T20:57:27.345159] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-27T20:57:27.933612] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (12.32 seconds). [2025-10-27T20:57:27.942970] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-27T20:57:28.086772] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (11.67 seconds). [2025-10-27T20:57:28.087729] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-27T20:57:28.879135] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T20:57:28.880782] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-27T20:57:28.916260] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T20:57:28.926164] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-27T20:57:29.075692] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T20:57:29.085213] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-27T20:57:29.307950] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T20:57:29.309534] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-27T20:57:29.700208] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (12.49 seconds). [2025-10-27T20:57:29.709486] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-27T20:57:29.813967] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T20:57:29.815134] [INFO ] [REMOTE ] RWTN: Full fetch complete (3175 records). [2025-10-27T20:57:29.815210] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-27T20:57:30.016406] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T20:57:30.016752] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:57:30.016827] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:57:30.016905] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-27T20:57:30.017008] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-27T20:57:30.017082] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-27T20:57:30.017160] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-27T20:57:30.017257] [INFO ] [MAIN ] Update Progress: 1843/2366 symbols completed. RWTN took 37.3s. Estimated remaining: 1h 7m 23s. Rate: 7.8 symbols/min [2025-10-27T20:57:30.194300] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:30.230522] [DEBUG] [LOCAL ] RYAM: Loaded 35519 existing records from primary storage. [2025-10-27T20:57:30.230912] [INFO ] [MAIN ] RYAM: Loaded 35519 existing records. [2025-10-27T20:57:30.420726] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:30.421376] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-27T20:57:30.421548] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-27T20:57:30.421946] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-27T20:57:30.422083] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-27T20:57:30.598911] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T20:57:30.690685] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-27T20:57:30.852202] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:30.852822] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-27T20:57:30.911866] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T20:57:30.924715] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T20:57:30.933585] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-27T20:57:30.934038] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-27T20:57:31.843380] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T20:57:31.849420] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-27T20:57:32.384995] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T20:57:32.414998] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-27T20:57:32.481621] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T20:57:32.599409] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T20:57:32.820530] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T20:57:33.214931] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-27T20:57:33.744346] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T20:57:34.014947] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-27T20:57:34.814954] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-27T20:57:34.897672] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T20:57:35.353296] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T20:57:35.614947] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-27T20:57:35.895138] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T20:57:36.414991] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-27T20:57:37.177278] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T20:57:37.214898] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-27T20:57:37.860916] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T20:57:37.869890] [INFO ] [REMOTE ] RY: Full fetch complete (69197 records). [2025-10-27T20:57:37.870003] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-27T20:57:38.021441] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-27T20:57:38.257050] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-27T20:57:38.257122] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-27T20:57:38.258179] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-27T20:57:38.258242] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-27T20:57:38.259486] [DEBUG] [LOCAL ] RY: Trimmed 69197 records to 47292 (keeping 200 days of data) [2025-10-27T20:57:38.561859] [DEBUG] [LOCAL ] RY: Primary data saved (47292 records). [2025-10-27T20:57:38.562047] [INFO ] [MAIN ] RY: Full history saved. [2025-10-27T20:57:38.562131] [INFO ] [MAIN ] Update Progress: 1844/2366 symbols completed. RY took 21.1s. Estimated remaining: 1h 7m 15s. Rate: 7.8 symbols/min [2025-10-27T20:57:38.729202] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:38.771763] [DEBUG] [LOCAL ] RYAN: Loaded 45649 existing records from primary storage. [2025-10-27T20:57:38.772161] [INFO ] [MAIN ] RYAN: Loaded 45649 existing records. [2025-10-27T20:57:38.825478] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-27T20:57:38.975665] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T20:57:38.981921] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:38.992739] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-27T20:57:38.992834] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-27T20:57:38.993497] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-27T20:57:38.993567] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-27T20:57:39.375768] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T20:57:39.424199] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:39.614929] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-27T20:57:40.403903] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T20:57:40.414902] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-27T20:57:41.214962] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-27T20:57:41.270018] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T20:57:41.356971] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T20:57:41.363954] [INFO ] [REMOTE ] RWT: Full fetch complete (57800 records). [2025-10-27T20:57:41.364063] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-27T20:57:41.365417] [FATAL] [VALIDATOR ] RWT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:57:41.365502] [FATAL] [MAIN ] RWT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:57:41.365544] [WARN ] [MAIN ] RWT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:57:41.365611] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-27T20:57:41.365709] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-27T20:57:41.365757] [INFO ] [LOCAL ] RWT: Starting deletion of derivative data. [2025-10-27T20:57:41.365888] [DEBUG] [LOCAL ] RWT: Deleted derivative data file. [2025-10-27T20:57:41.366323] [INFO ] [MAIN ] Update Progress: 1845/2366 symbols completed. RWT took 48.6s. Estimated remaining: 1h 7m 6s. Rate: 7.8 symbols/min [2025-10-27T20:57:41.534778] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:41.556719] [DEBUG] [LOCAL ] RYI: Loaded 22032 existing records from primary storage. [2025-10-27T20:57:41.556952] [INFO ] [MAIN ] RYI: Loaded 22032 existing records. [2025-10-27T20:57:41.752160] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:41.752404] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-27T20:57:41.752456] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-27T20:57:41.752625] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-27T20:57:41.752708] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-27T20:57:42.020479] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-27T20:57:42.100379] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:42.454900] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T20:57:42.814960] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-27T20:57:43.614921] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-27T20:57:43.687277] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T20:57:43.698082] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T20:57:44.414960] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-27T20:57:45.174523] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T20:57:45.214950] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-27T20:57:45.485368] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T20:57:46.014951] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-27T20:57:46.445006] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T20:57:46.814938] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-27T20:57:46.939331] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T20:57:47.614952] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-27T20:57:48.010897] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T20:57:48.414930] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-27T20:57:49.045232] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T20:57:49.214908] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-27T20:57:49.557812] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T20:57:50.014935] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-27T20:57:50.448340] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T20:57:50.819793] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-27T20:57:50.821415] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T20:57:51.614984] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-27T20:57:52.414958] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-27T20:57:52.539746] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T20:57:52.651443] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T20:57:53.192876] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T20:57:53.214907] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-27T20:57:54.014938] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-27T20:57:54.087980] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T20:57:54.814943] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-27T20:57:55.330259] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T20:57:55.337060] [INFO ] [REMOTE ] RYAM: Full fetch complete (49207 records). [2025-10-27T20:57:55.337181] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-27T20:57:55.620560] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-27T20:57:55.729858] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-27T20:57:55.729963] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-27T20:57:55.731091] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-27T20:57:55.737054] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-27T20:57:55.747431] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T20:57:55.753417] [DEBUG] [LOCAL ] RYAM: Trimmed 49207 records to 34795 (keeping 200 days of data) [2025-10-27T20:57:55.943327] [DEBUG] [LOCAL ] RYAM: Primary data saved (34795 records). [2025-10-27T20:57:55.943456] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-27T20:57:55.943532] [INFO ] [MAIN ] Update Progress: 1846/2366 symbols completed. RYAM took 25.9s. Estimated remaining: 1h 7m 1s. Rate: 7.8 symbols/min [2025-10-27T20:57:56.108070] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:56.147797] [DEBUG] [LOCAL ] RYN: Loaded 46443 existing records from primary storage. [2025-10-27T20:57:56.148100] [INFO ] [MAIN ] RYN: Loaded 46443 existing records. [2025-10-27T20:57:56.318823] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:56.319025] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-27T20:57:56.319071] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-27T20:57:56.319279] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-27T20:57:56.319370] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-27T20:57:56.415934] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-27T20:57:56.667477] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:57.053282] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T20:57:57.214951] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-27T20:57:57.578753] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T20:57:57.680080] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T20:57:57.689172] [INFO ] [REMOTE ] RXO: Full fetch complete (68745 records). [2025-10-27T20:57:57.689313] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-27T20:57:57.690059] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:57:57.690146] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:57:57.690208] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:57:57.690292] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-27T20:57:57.690369] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-27T20:57:57.690416] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-27T20:57:57.690565] [DEBUG] [LOCAL ] RXO: Deleted derivative data file. [2025-10-27T20:57:57.691147] [INFO ] [MAIN ] Update Progress: 1847/2366 symbols completed. RXO took 43.4s. Estimated remaining: 1h 6m 51s. Rate: 7.8 symbols/min [2025-10-27T20:57:57.861005] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:57.871264] [DEBUG] [LOCAL ] RZB: Loaded 5925 existing records from primary storage. [2025-10-27T20:57:57.871561] [INFO ] [MAIN ] RZB: Loaded 5925 existing records. [2025-10-27T20:57:58.020246] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-27T20:57:58.081161] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:58.081381] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-27T20:57:58.081431] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-27T20:57:58.081676] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-27T20:57:58.081735] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-27T20:57:58.509221] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:57:58.814994] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-27T20:57:58.873073] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T20:57:58.877373] [INFO ] [REMOTE ] RYI: Full fetch complete (31783 records). [2025-10-27T20:57:58.877471] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-27T20:57:59.260162] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-27T20:57:59.260298] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-27T20:57:59.261759] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-27T20:57:59.261828] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-27T20:57:59.262931] [DEBUG] [LOCAL ] RYI: Trimmed 31783 records to 21465 (keeping 200 days of data) [2025-10-27T20:57:59.401054] [DEBUG] [LOCAL ] RYI: Primary data saved (21465 records). [2025-10-27T20:57:59.401225] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-27T20:57:59.401325] [INFO ] [MAIN ] Update Progress: 1848/2366 symbols completed. RYI took 18.0s. Estimated remaining: 1h 6m 42s. Rate: 7.8 symbols/min [2025-10-27T20:57:59.611920] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:57:59.615019] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-27T20:57:59.623522] [DEBUG] [LOCAL ] RZC: Loaded 6527 existing records from primary storage. [2025-10-27T20:57:59.623860] [INFO ] [MAIN ] RZC: Loaded 6527 existing records. [2025-10-27T20:57:59.804276] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:57:59.804592] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-27T20:57:59.804671] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-27T20:57:59.804920] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-27T20:57:59.804963] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-27T20:58:00.180500] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:00.240824] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T20:58:00.414934] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-27T20:58:01.000080] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:58:01.215008] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-27T20:58:01.242330] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T20:58:01.805281] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T20:58:02.015002] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-27T20:58:02.555308] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T20:58:02.814941] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-27T20:58:03.614978] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-27T20:58:04.415020] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-27T20:58:04.478413] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T20:58:04.812151] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T20:58:04.981341] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T20:58:05.215048] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-27T20:58:06.015025] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-27T20:58:06.612297] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T20:58:06.814959] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-27T20:58:07.029920] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T20:58:07.614990] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-27T20:58:07.632657] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T20:58:08.415011] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-27T20:58:09.081759] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T20:58:09.214948] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-27T20:58:10.014958] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-27T20:58:10.072109] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T20:58:10.394273] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T20:58:10.550321] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T20:58:10.814932] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-27T20:58:11.614980] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-27T20:58:12.164375] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T20:58:12.269561] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T20:58:12.414968] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-27T20:58:13.214940] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-27T20:58:13.726087] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T20:58:14.006731] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T20:58:14.015567] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-27T20:58:14.814989] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-27T20:58:15.069727] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T20:58:15.614994] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-27T20:58:16.185563] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T20:58:16.195376] [INFO ] [REMOTE ] RYAN: Full fetch complete (64606 records). [2025-10-27T20:58:16.195571] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-27T20:58:16.196384] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:58:16.196480] [FATAL] [MAIN ] RYAN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:58:16.196522] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:58:16.196560] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-27T20:58:16.196618] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-27T20:58:16.196722] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-27T20:58:16.196845] [DEBUG] [LOCAL ] RYAN: Deleted derivative data file. [2025-10-27T20:58:16.196941] [INFO ] [MAIN ] Update Progress: 1849/2366 symbols completed. RYAN took 37.6s. Estimated remaining: 1h 6m 37s. Rate: 7.8 symbols/min [2025-10-27T20:58:16.367596] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:16.393746] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T20:58:16.425618] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-27T20:58:16.451015] [DEBUG] [LOCAL ] S: Loaded 54316 existing records from primary storage. [2025-10-27T20:58:16.451334] [INFO ] [MAIN ] S: Loaded 54316 existing records. [2025-10-27T20:58:16.622276] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:58:16.622461] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-27T20:58:16.622506] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-27T20:58:16.622725] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-27T20:58:16.622781] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-27T20:58:16.965903] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:17.214912] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-27T20:58:18.014974] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-27T20:58:18.161166] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T20:58:18.739746] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T20:58:18.814904] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-27T20:58:18.870681] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T20:58:19.387779] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T20:58:19.614924] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-27T20:58:20.299794] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-27T20:58:20.414934] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-27T20:58:20.867727] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T20:58:20.869226] [INFO ] [REMOTE ] RZB: Full fetch complete (8248 records). [2025-10-27T20:58:20.869298] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-27T20:58:21.232535] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-27T20:58:21.280032] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-27T20:58:21.280106] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-27T20:58:21.280336] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-27T20:58:21.280374] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-27T20:58:21.280871] [DEBUG] [LOCAL ] RZB: Trimmed 8248 records to 5780 (keeping 200 days of data) [2025-10-27T20:58:21.318290] [DEBUG] [LOCAL ] RZB: Primary data saved (5780 records). [2025-10-27T20:58:21.318407] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-27T20:58:21.318483] [INFO ] [MAIN ] Update Progress: 1850/2366 symbols completed. RZB took 23.6s. Estimated remaining: 1h 6m 28s. Rate: 7.8 symbols/min [2025-10-27T20:58:21.508684] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:21.554623] [DEBUG] [LOCAL ] SA: Loaded 45282 existing records from primary storage. [2025-10-27T20:58:21.554990] [INFO ] [MAIN ] SA: Loaded 45282 existing records. [2025-10-27T20:58:21.751940] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:58:21.752191] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-27T20:58:21.752238] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-27T20:58:21.752443] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-27T20:58:21.752499] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-27T20:58:22.020018] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-27T20:58:22.103525] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:22.814906] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-27T20:58:23.223506] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T20:58:23.469594] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T20:58:23.572022] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T20:58:23.614941] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-27T20:58:24.414977] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-27T20:58:25.210760] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T20:58:25.220871] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-27T20:58:26.014922] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-27T20:58:26.091410] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T20:58:26.798932] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T20:58:26.823728] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-27T20:58:26.842183] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T20:58:27.614979] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-27T20:58:28.393735] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T20:58:28.414901] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-27T20:58:29.214990] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-27T20:58:29.681145] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T20:58:29.834007] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T20:58:29.946191] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T20:58:30.014903] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-27T20:58:30.814954] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-27T20:58:31.614952] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-27T20:58:31.732374] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T20:58:31.741430] [INFO ] [REMOTE ] RYN: Full fetch complete (65532 records). [2025-10-27T20:58:31.741584] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-27T20:58:31.742380] [FATAL] [VALIDATOR ] RYN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:58:31.742472] [FATAL] [MAIN ] RYN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:58:31.742516] [WARN ] [MAIN ] RYN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:58:31.742583] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-27T20:58:31.742671] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-27T20:58:31.742731] [INFO ] [LOCAL ] RYN: Starting deletion of derivative data. [2025-10-27T20:58:31.742962] [DEBUG] [LOCAL ] RYN: Deleted derivative data file. [2025-10-27T20:58:31.743055] [INFO ] [MAIN ] Update Progress: 1851/2366 symbols completed. RYN took 35.8s. Estimated remaining: 1h 6m 21s. Rate: 7.8 symbols/min [2025-10-27T20:58:31.911370] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:31.952271] [DEBUG] [LOCAL ] SABA: Loaded 9294 existing records from primary storage. [2025-10-27T20:58:31.952566] [INFO ] [MAIN ] SABA: Loaded 9294 existing records. [2025-10-27T20:58:32.017474] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-27T20:58:32.140423] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:58:32.140667] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-27T20:58:32.140727] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-27T20:58:32.140878] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-27T20:58:32.140915] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-27T20:58:32.420062] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-27T20:58:32.492409] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:33.214905] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-27T20:58:33.283220] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T20:58:33.445105] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T20:58:34.014948] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-27T20:58:34.814991] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-27T20:58:35.094957] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T20:58:35.220843] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-27T20:58:35.614986] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-27T20:58:35.968788] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:58:36.414950] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-27T20:58:37.214964] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-27T20:58:37.528410] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T20:58:37.906181] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-27T20:58:37.953170] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T20:58:38.014898] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-27T20:58:38.814954] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-27T20:58:39.614961] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-27T20:58:39.648870] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T20:58:39.749201] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T20:58:40.325267] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T20:58:40.414996] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-27T20:58:41.049962] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:58:41.051394] [INFO ] [REMOTE ] RZC: Full fetch complete (9570 records). [2025-10-27T20:58:41.051462] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-27T20:58:41.223387] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-27T20:58:41.414035] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-27T20:58:41.414105] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-27T20:58:41.414351] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-27T20:58:41.414390] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-27T20:58:41.414849] [DEBUG] [LOCAL ] RZC: Trimmed 9570 records to 6300 (keeping 200 days of data) [2025-10-27T20:58:41.451480] [DEBUG] [LOCAL ] RZC: Primary data saved (6300 records). [2025-10-27T20:58:41.451572] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-27T20:58:41.451664] [INFO ] [MAIN ] Update Progress: 1852/2366 symbols completed. RZC took 42.1s. Estimated remaining: 1h 6m 14s. Rate: 7.8 symbols/min [2025-10-27T20:58:41.623072] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:41.653786] [DEBUG] [LOCAL ] SAFE: Loaded 30182 existing records from primary storage. [2025-10-27T20:58:41.654065] [INFO ] [MAIN ] SAFE: Loaded 30182 existing records. [2025-10-27T20:58:41.833329] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:58:41.833588] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-27T20:58:41.833666] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-27T20:58:41.834017] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-27T20:58:41.834073] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-27T20:58:42.020103] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-27T20:58:42.190133] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:42.537858] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T20:58:42.814982] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-27T20:58:43.614961] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-27T20:58:44.131050] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T20:58:44.414976] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-27T20:58:44.467902] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T20:58:45.002459] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T20:58:45.214966] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-27T20:58:45.322785] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T20:58:46.014950] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-27T20:58:46.814982] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-27T20:58:46.917767] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T20:58:46.927422] [INFO ] [REMOTE ] SA: Full fetch complete (63684 records). [2025-10-27T20:58:46.927554] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-27T20:58:47.034728] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T20:58:47.310198] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-27T20:58:47.310272] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-27T20:58:47.311189] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-27T20:58:47.311260] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-27T20:58:47.312442] [DEBUG] [LOCAL ] SA: Trimmed 63684 records to 44537 (keeping 200 days of data) [2025-10-27T20:58:47.561775] [DEBUG] [LOCAL ] SA: Primary data saved (44537 records). [2025-10-27T20:58:47.561893] [INFO ] [MAIN ] SA: Full history saved. [2025-10-27T20:58:47.562632] [INFO ] [MAIN ] Update Progress: 1853/2366 symbols completed. SA took 26.2s. Estimated remaining: 1h 6m 6s. Rate: 7.8 symbols/min [2025-10-27T20:58:47.624011] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-27T20:58:47.736309] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:47.757883] [DEBUG] [LOCAL ] SAH: Loaded 21167 existing records from primary storage. [2025-10-27T20:58:47.758111] [INFO ] [MAIN ] SAH: Loaded 21167 existing records. [2025-10-27T20:58:47.935255] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:58:47.935502] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-27T20:58:47.935575] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-27T20:58:47.935863] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-27T20:58:47.935910] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-27T20:58:48.286064] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T20:58:48.305476] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:48.414900] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-27T20:58:49.178903] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-27T20:58:49.214893] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-27T20:58:50.014973] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-27T20:58:50.047621] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-27T20:58:50.417703] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T20:58:50.814983] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-27T20:58:51.413974] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T20:58:51.614910] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-27T20:58:51.649555] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T20:58:52.414994] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-27T20:58:52.602774] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T20:58:53.214977] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-27T20:58:53.719380] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:58:54.014954] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-27T20:58:54.815025] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-27T20:58:55.163524] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T20:58:55.380894] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-27T20:58:55.397786] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T20:58:55.397907] [INFO ] [REMOTE ] S: Full fetch complete (77657 records). [2025-10-27T20:58:55.400363] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-27T20:58:55.623324] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-27T20:58:55.788351] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-27T20:58:55.788426] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-27T20:58:55.789518] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-27T20:58:55.789585] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-27T20:58:55.790948] [DEBUG] [LOCAL ] S: Trimmed 77657 records to 53536 (keeping 200 days of data) [2025-10-27T20:58:56.106814] [DEBUG] [LOCAL ] S: Primary data saved (53536 records). [2025-10-27T20:58:56.106939] [INFO ] [MAIN ] S: Full history saved. [2025-10-27T20:58:56.107022] [INFO ] [MAIN ] Update Progress: 1854/2366 symbols completed. S took 39.9s. Estimated remaining: 1h 5m 58s. Rate: 7.8 symbols/min [2025-10-27T20:58:56.277703] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:58:56.277949] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-27T20:58:56.278007] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-27T20:58:56.278125] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-27T20:58:56.278172] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-27T20:58:56.278271] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-27T20:58:56.278332] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-27T20:58:56.420122] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-27T20:58:56.633885] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:58:56.959392] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T20:58:57.214947] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-27T20:58:57.239816] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T20:58:58.014964] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-27T20:58:58.170978] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T20:58:58.814915] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-27T20:58:58.874562] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T20:58:59.614943] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-27T20:59:00.143385] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T20:59:00.413251] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T20:59:00.415400] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-27T20:59:01.214978] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-27T20:59:01.473889] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T20:59:02.014921] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-27T20:59:02.105530] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T20:59:02.814935] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-27T20:59:02.995042] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T20:59:03.614945] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-27T20:59:03.920411] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T20:59:04.415005] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-27T20:59:05.052998] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T20:59:05.154090] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-27T20:59:05.214941] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-27T20:59:06.004059] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T20:59:06.008776] [INFO ] [REMOTE ] SAFE: Full fetch complete (43440 records). [2025-10-27T20:59:06.008877] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-27T20:59:06.009440] [FATAL] [VALIDATOR ] SAFE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:59:06.009523] [FATAL] [MAIN ] SAFE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:59:06.009565] [WARN ] [MAIN ] SAFE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:59:06.009602] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-27T20:59:06.009681] [DEBUG] [LOCAL ] SAFE: No primary data file found to delete. [2025-10-27T20:59:06.009734] [INFO ] [LOCAL ] SAFE: Starting deletion of derivative data. [2025-10-27T20:59:06.009886] [DEBUG] [LOCAL ] SAFE: Deleted derivative data file. [2025-10-27T20:59:06.009970] [INFO ] [MAIN ] Update Progress: 1855/2366 symbols completed. SAFE took 24.6s. Estimated remaining: 1h 5m 51s. Rate: 7.8 symbols/min [2025-10-27T20:59:06.020868] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-27T20:59:06.183907] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:06.203467] [DEBUG] [LOCAL ] SAM: Loaded 21603 existing records from primary storage. [2025-10-27T20:59:06.203734] [INFO ] [MAIN ] SAM: Loaded 21603 existing records. [2025-10-27T20:59:06.384838] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:59:06.385005] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-27T20:59:06.385054] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-27T20:59:06.385233] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-27T20:59:06.385272] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-27T20:59:06.653286] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T20:59:06.685675] [INFO ] [REMOTE ] SAH: Full fetch complete (30936 records). [2025-10-27T20:59:06.696469] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-27T20:59:06.708042] [FATAL] [VALIDATOR ] SAH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:59:06.713289] [FATAL] [MAIN ] SAH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:59:06.723606] [WARN ] [MAIN ] SAH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:59:06.736755] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-27T20:59:06.755874] [DEBUG] [LOCAL ] SAH: No primary data file found to delete. [2025-10-27T20:59:06.756262] [INFO ] [LOCAL ] SAH: Starting deletion of derivative data. [2025-10-27T20:59:06.778044] [DEBUG] [LOCAL ] SAH: Deleted derivative data file. [2025-10-27T20:59:06.778172] [INFO ] [MAIN ] Update Progress: 1856/2366 symbols completed. SAH took 19.2s. Estimated remaining: 1h 5m 41s. Rate: 7.8 symbols/min [2025-10-27T20:59:06.777990] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:06.820032] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-27T20:59:06.947027] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:06.996679] [DEBUG] [LOCAL ] SAN: Loaded 53725 existing records from primary storage. [2025-10-27T20:59:06.997016] [INFO ] [MAIN ] SAN: Loaded 53725 existing records. [2025-10-27T20:59:07.173736] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:59:07.173934] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-27T20:59:07.173982] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-27T20:59:07.174283] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-27T20:59:07.174328] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-27T20:59:07.525899] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:07.614898] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-27T20:59:07.764358] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T20:59:08.414923] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-27T20:59:08.536468] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T20:59:09.214959] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-27T20:59:09.868522] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T20:59:09.885245] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T20:59:09.887398] [INFO ] [REMOTE ] SABA: Full fetch complete (14995 records). [2025-10-27T20:59:09.887471] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-27T20:59:10.023553] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-27T20:59:10.243378] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-27T20:59:10.243458] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-27T20:59:10.243829] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-27T20:59:10.243890] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-27T20:59:10.244347] [DEBUG] [LOCAL ] SABA: Trimmed 14995 records to 9051 (keeping 200 days of data) [2025-10-27T20:59:10.296933] [DEBUG] [LOCAL ] SABA: Primary data saved (9051 records). [2025-10-27T20:59:10.297049] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-27T20:59:10.297125] [INFO ] [MAIN ] Update Progress: 1857/2366 symbols completed. SABA took 38.6s. Estimated remaining: 1h 5m 33s. Rate: 7.8 symbols/min [2025-10-27T20:59:10.462998] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:10.507346] [DEBUG] [LOCAL ] SAP: Loaded 50620 existing records from primary storage. [2025-10-27T20:59:10.507676] [INFO ] [MAIN ] SAP: Loaded 50620 existing records. [2025-10-27T20:59:10.678986] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:59:10.679191] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-27T20:59:10.679249] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-27T20:59:10.679506] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-27T20:59:10.679543] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-27T20:59:10.823334] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-27T20:59:11.027711] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:11.300574] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T20:59:11.542986] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T20:59:11.614966] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-27T20:59:12.414935] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-27T20:59:13.215006] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-27T20:59:13.267098] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-27T20:59:13.673388] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T20:59:13.676072] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T20:59:14.014958] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-27T20:59:14.814974] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-27T20:59:15.233989] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T20:59:15.614926] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-27T20:59:15.991690] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T20:59:16.414941] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-27T20:59:16.499925] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T20:59:16.826840] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T20:59:17.214941] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-27T20:59:18.014946] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-27T20:59:18.814974] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-27T20:59:19.127290] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T20:59:19.531855] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T20:59:19.614897] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-27T20:59:20.111473] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:59:20.414905] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-27T20:59:20.812763] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-27T20:59:21.214973] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-27T20:59:21.508117] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T20:59:21.696068] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T20:59:22.014971] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-27T20:59:22.815022] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-27T20:59:23.022112] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T20:59:23.430239] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T20:59:23.614932] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-27T20:59:24.414967] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-27T20:59:24.859379] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T20:59:25.214915] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-27T20:59:25.342207] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-27T20:59:26.014961] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-27T20:59:26.397913] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T20:59:26.398739] [INFO ] [REMOTE ] SAJ: Full fetch complete (1014 records). [2025-10-27T20:59:26.398805] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-27T20:59:26.578185] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-27T20:59:26.578420] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:59:26.578488] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:59:26.578685] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-27T20:59:26.578805] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-27T20:59:26.578872] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-27T20:59:26.579016] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-27T20:59:26.579131] [INFO ] [MAIN ] Update Progress: 1858/2366 symbols completed. SAJ took 30.5s. Estimated remaining: 1h 5m 27s. Rate: 7.8 symbols/min [2025-10-27T20:59:26.775449] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:26.773232] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T20:59:26.800736] [DEBUG] [LOCAL ] SAR: Loaded 17321 existing records from primary storage. [2025-10-27T20:59:26.800980] [INFO ] [MAIN ] SAR: Loaded 17321 existing records. [2025-10-27T20:59:26.820497] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-27T20:59:26.975482] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:59:26.975742] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-27T20:59:26.975794] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-27T20:59:26.975971] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-27T20:59:26.976007] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-27T20:59:27.323516] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:27.614996] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-27T20:59:28.414914] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-27T20:59:28.836979] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T20:59:29.214963] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-27T20:59:29.419390] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T20:59:29.723385] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T20:59:30.015002] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-27T20:59:30.122611] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T20:59:30.814945] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-27T20:59:31.621901] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-27T20:59:31.644233] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T20:59:31.704478] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-27T20:59:32.414929] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-27T20:59:33.079323] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T20:59:33.214891] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-27T20:59:33.314791] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T20:59:34.014980] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-27T20:59:34.466711] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T20:59:34.814969] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-27T20:59:35.356293] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T20:59:35.614927] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-27T20:59:36.414916] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-27T20:59:36.608073] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T20:59:37.032618] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T20:59:37.142362] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T20:59:37.214898] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-27T20:59:37.955792] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T20:59:38.014905] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-27T20:59:38.814921] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-27T20:59:39.093756] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T20:59:39.206734] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-27T20:59:39.210680] [INFO ] [REMOTE ] SAM: Full fetch complete (31109 records). [2025-10-27T20:59:39.210776] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-27T20:59:39.211286] [FATAL] [VALIDATOR ] SAM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T20:59:39.211366] [FATAL] [MAIN ] SAM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T20:59:39.211408] [WARN ] [MAIN ] SAM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T20:59:39.211446] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-27T20:59:39.211504] [DEBUG] [LOCAL ] SAM: No primary data file found to delete. [2025-10-27T20:59:39.211537] [INFO ] [LOCAL ] SAM: Starting deletion of derivative data. [2025-10-27T20:59:39.211708] [DEBUG] [LOCAL ] SAM: Deleted derivative data file. [2025-10-27T20:59:39.211790] [INFO ] [MAIN ] Update Progress: 1859/2366 symbols completed. SAM took 33.2s. Estimated remaining: 1h 5m 21s. Rate: 7.8 symbols/min [2025-10-27T20:59:39.377256] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:39.420790] [DEBUG] [LOCAL ] SARO: Loaded 48929 existing records from primary storage. [2025-10-27T20:59:39.421118] [INFO ] [MAIN ] SARO: Loaded 48929 existing records. [2025-10-27T20:59:39.592819] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T20:59:39.593028] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-27T20:59:39.593096] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-27T20:59:39.593290] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-27T20:59:39.593327] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-27T20:59:39.621444] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-27T20:59:39.949781] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:40.414960] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-27T20:59:41.214901] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-27T20:59:41.459571] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T20:59:41.496752] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T20:59:42.014998] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-27T20:59:42.780128] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T20:59:42.790279] [INFO ] [REMOTE ] SAN: Full fetch complete (76613 records). [2025-10-27T20:59:42.790414] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-27T20:59:42.820917] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-27T20:59:43.198573] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-27T20:59:43.198671] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-27T20:59:43.199810] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-27T20:59:43.199870] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-27T20:59:43.201235] [DEBUG] [LOCAL ] SAN: Trimmed 76613 records to 52944 (keeping 200 days of data) [2025-10-27T20:59:43.503366] [DEBUG] [LOCAL ] SAN: Primary data saved (52944 records). [2025-10-27T20:59:43.503487] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-27T20:59:43.503562] [INFO ] [MAIN ] Update Progress: 1860/2366 symbols completed. SAN took 36.7s. Estimated remaining: 1h 5m 12s. Rate: 7.8 symbols/min [2025-10-27T20:59:43.620044] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-27T20:59:43.673835] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:43.674124] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-27T20:59:43.674202] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-27T20:59:43.674336] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-27T20:59:43.674404] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-27T20:59:43.674541] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-27T20:59:43.674590] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-27T20:59:44.027525] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:44.055116] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-27T20:59:44.414922] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-27T20:59:44.460091] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T20:59:44.611485] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-27T20:59:44.825595] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T20:59:45.214944] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-27T20:59:46.015006] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-27T20:59:46.271930] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T20:59:46.814959] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-27T20:59:47.614950] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-27T20:59:47.931444] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T20:59:48.419455] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-27T20:59:48.426037] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T20:59:48.686020] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T20:59:49.215015] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-27T20:59:49.823003] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T20:59:49.834097] [INFO ] [REMOTE ] SAP: Full fetch complete (72359 records). [2025-10-27T20:59:49.834334] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-27T20:59:50.017743] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-27T20:59:50.237171] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-27T20:59:50.237289] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-27T20:59:50.238400] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-27T20:59:50.238463] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-27T20:59:50.239914] [DEBUG] [LOCAL ] SAP: Trimmed 72359 records to 49830 (keeping 200 days of data) [2025-10-27T20:59:50.513638] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T20:59:50.574959] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T20:59:50.593019] [DEBUG] [LOCAL ] SAP: Primary data saved (49830 records). [2025-10-27T20:59:50.593125] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-27T20:59:50.593200] [INFO ] [MAIN ] Update Progress: 1861/2366 symbols completed. SAP took 40.3s. Estimated remaining: 1h 5m 4s. Rate: 7.8 symbols/min [2025-10-27T20:59:50.763867] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:50.764081] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-27T20:59:50.764124] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-27T20:59:50.764237] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-27T20:59:50.764277] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-27T20:59:50.764319] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-27T20:59:50.764352] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-27T20:59:50.820027] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-27T20:59:51.148398] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:51.413297] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T20:59:51.614940] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-27T20:59:52.090329] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-27T20:59:52.414952] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-27T20:59:52.885186] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T20:59:53.214966] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-27T20:59:53.956482] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T20:59:54.014912] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-27T20:59:54.814917] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-27T20:59:55.180440] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T20:59:55.184923] [INFO ] [REMOTE ] SAR: Full fetch complete (24150 records). [2025-10-27T20:59:55.185028] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-27T20:59:55.538484] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-27T20:59:55.538563] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-27T20:59:55.539105] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-27T20:59:55.539171] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-27T20:59:55.539838] [DEBUG] [LOCAL ] SAR: Trimmed 24150 records to 16865 (keeping 200 days of data) [2025-10-27T20:59:55.616036] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-27T20:59:55.642439] [DEBUG] [LOCAL ] SAR: Primary data saved (16865 records). [2025-10-27T20:59:55.642545] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-27T20:59:55.642618] [INFO ] [MAIN ] Update Progress: 1862/2366 symbols completed. SAR took 29.1s. Estimated remaining: 1h 4m 56s. Rate: 7.8 symbols/min [2025-10-27T20:59:55.806858] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T20:59:55.807021] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-27T20:59:55.807056] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-27T20:59:55.807166] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-27T20:59:55.807207] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-27T20:59:55.807247] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-27T20:59:55.807278] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-27T20:59:56.084546] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-27T20:59:56.165709] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T20:59:56.225778] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T20:59:56.414956] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-27T20:59:56.835876] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T20:59:57.214930] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-27T20:59:58.014997] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-27T20:59:58.474266] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T20:59:58.814944] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-27T20:59:58.975341] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T20:59:59.198520] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-27T20:59:59.614919] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-27T20:59:59.965793] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-27T21:00:00.414974] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-27T21:00:00.870077] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T21:00:01.214958] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-27T21:00:02.015006] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-27T21:00:02.398834] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T21:00:02.631962] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T21:00:02.814985] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-27T21:00:03.385525] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T21:00:03.614975] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-27T21:00:04.132269] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T21:00:04.414978] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-27T21:00:05.214950] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-27T21:00:05.794023] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T21:00:05.918457] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T21:00:06.014992] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-27T21:00:06.815003] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-27T21:00:07.432408] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T21:00:07.480120] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:00:07.614962] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-27T21:00:08.196055] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T21:00:08.414939] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-27T21:00:09.215244] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-27T21:00:09.668422] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T21:00:10.014948] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-27T21:00:10.135217] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T21:00:10.615841] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T21:00:10.814989] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-27T21:00:11.232888] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-27T21:00:11.614943] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-27T21:00:12.039866] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T21:00:12.414957] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-27T21:00:13.214946] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-27T21:00:13.653259] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T21:00:14.014918] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-27T21:00:14.047086] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T21:00:14.058370] [INFO ] [REMOTE ] SARO: Full fetch complete (69010 records). [2025-10-27T21:00:14.058559] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-27T21:00:14.470927] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-27T21:00:14.471005] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-27T21:00:14.472072] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-27T21:00:14.472134] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-27T21:00:14.473399] [DEBUG] [LOCAL ] SARO: Trimmed 69010 records to 48144 (keeping 200 days of data) [2025-10-27T21:00:14.532306] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T21:00:14.781300] [DEBUG] [LOCAL ] SARO: Primary data saved (48144 records). [2025-10-27T21:00:14.781440] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-27T21:00:14.781908] [INFO ] [MAIN ] Update Progress: 1863/2366 symbols completed. SARO took 35.6s. Estimated remaining: 1h 4m 51s. Rate: 7.8 symbols/min [2025-10-27T21:00:14.820107] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-27T21:00:14.964918] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:15.003683] [DEBUG] [LOCAL ] SB: Loaded 32901 existing records from primary storage. [2025-10-27T21:00:15.004008] [INFO ] [MAIN ] SB: Loaded 32901 existing records. [2025-10-27T21:00:15.248690] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:15.248985] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-27T21:00:15.249054] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-27T21:00:15.249289] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-27T21:00:15.249348] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-27T21:00:15.379352] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-27T21:00:15.620201] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-27T21:00:15.759615] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:16.091411] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T21:00:16.092287] [INFO ] [REMOTE ] SAT: Full fetch complete (1477 records). [2025-10-27T21:00:16.092364] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-27T21:00:16.306210] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-27T21:00:16.306410] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:00:16.306492] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:00:16.306578] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-27T21:00:16.306708] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-27T21:00:16.306799] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-27T21:00:16.306861] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-27T21:00:16.306920] [INFO ] [MAIN ] Update Progress: 1864/2366 symbols completed. SAT took 32.8s. Estimated remaining: 1h 4m 42s. Rate: 7.8 symbols/min [2025-10-27T21:00:16.420096] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-27T21:00:16.511835] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:16.512009] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-27T21:00:16.512081] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-27T21:00:16.512243] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-27T21:00:16.512309] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-27T21:00:16.512384] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-27T21:00:16.512431] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-27T21:00:16.874559] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:17.214989] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-10-27T21:00:17.493247] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:00:17.513855] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:00:17.514070] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-10-27T21:00:17.514154] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:00:17.514219] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-27T21:00:17.514283] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:00:17.514352] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-27T21:00:17.514413] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-27T21:00:17.514448] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-27T21:00:17.514486] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-27T21:00:17.514528] [INFO ] [MAIN ] Update Progress: 1865/2366 symbols completed. SBDS took 1.2s. Estimated remaining: 1h 4m 32s. Rate: 7.8 symbols/min [2025-10-27T21:00:17.678477] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:17.724345] [DEBUG] [LOCAL ] SBH: Loaded 50564 existing records from primary storage. [2025-10-27T21:00:17.724679] [INFO ] [MAIN ] SBH: Loaded 50564 existing records. [2025-10-27T21:00:17.904949] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:17.905176] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-27T21:00:17.905225] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-27T21:00:17.905415] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-27T21:00:17.905455] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-27T21:00:18.020057] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-27T21:00:18.281226] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:18.814957] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-27T21:00:19.189517] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:00:19.190379] [INFO ] [REMOTE ] SAY: Full fetch complete (1388 records). [2025-10-27T21:00:19.190466] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-27T21:00:19.364718] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T21:00:19.364905] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:00:19.364973] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:00:19.365043] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-27T21:00:19.365104] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-27T21:00:19.365138] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-27T21:00:19.365177] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-27T21:00:19.365229] [INFO ] [MAIN ] Update Progress: 1866/2366 symbols completed. SAY took 28.8s. Estimated remaining: 1h 4m 23s. Rate: 7.8 symbols/min [2025-10-27T21:00:19.536697] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:19.546282] [DEBUG] [LOCAL ] SBI: Loaded 7835 existing records from primary storage. [2025-10-27T21:00:19.546491] [INFO ] [MAIN ] SBI: Loaded 7835 existing records. [2025-10-27T21:00:19.620122] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-27T21:00:19.700785] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T21:00:19.766979] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:19.768056] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-27T21:00:19.768119] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-27T21:00:19.768272] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-27T21:00:19.768310] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-27T21:00:20.118883] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:20.414927] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-27T21:00:21.184032] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T21:00:21.214909] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-27T21:00:21.353208] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T21:00:21.727754] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T21:00:22.014940] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-27T21:00:22.555229] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T21:00:22.814926] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-27T21:00:23.614985] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-27T21:00:24.022120] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T21:00:24.415056] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-27T21:00:24.601687] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:00:24.828298] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-27T21:00:25.215003] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-27T21:00:26.014960] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-27T21:00:26.802228] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T21:00:26.820288] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-27T21:00:26.819038] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-27T21:00:27.300909] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T21:00:27.614967] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-27T21:00:28.414960] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-27T21:00:29.214991] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-27T21:00:29.346065] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T21:00:29.518403] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T21:00:29.631518] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T21:00:29.632329] [INFO ] [REMOTE ] SAZ: Full fetch complete (1863 records). [2025-10-27T21:00:29.632396] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-27T21:00:29.805076] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T21:00:29.805253] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:00:29.805320] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:00:29.805392] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-27T21:00:29.805454] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-27T21:00:29.805489] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-27T21:00:29.805527] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-27T21:00:29.805579] [INFO ] [MAIN ] Update Progress: 1867/2366 symbols completed. SAZ took 34.2s. Estimated remaining: 1h 4m 16s. Rate: 7.8 symbols/min [2025-10-27T21:00:29.972322] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:29.982063] [DEBUG] [LOCAL ] SBR: Loaded 7939 existing records from primary storage. [2025-10-27T21:00:29.982236] [INFO ] [MAIN ] SBR: Loaded 7939 existing records. [2025-10-27T21:00:30.020151] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-27T21:00:30.157075] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:30.157293] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-27T21:00:30.157339] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-27T21:00:30.157520] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-27T21:00:30.157575] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-27T21:00:30.504772] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:30.814971] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-27T21:00:31.414184] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:00:31.614934] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-27T21:00:32.189219] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-27T21:00:32.306378] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:00:32.414938] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-27T21:00:33.214997] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-27T21:00:33.912333] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T21:00:33.955050] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T21:00:34.014904] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-27T21:00:34.815002] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-27T21:00:35.333251] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:00:35.614926] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-27T21:00:35.684044] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T21:00:36.414951] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-27T21:00:36.551857] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T21:00:37.160285] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T21:00:37.214922] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-27T21:00:38.014999] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-27T21:00:38.083707] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T21:00:38.814989] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-27T21:00:39.082805] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T21:00:39.438493] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:00:39.614949] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-27T21:00:40.414942] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-27T21:00:41.214970] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-27T21:00:41.275149] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T21:00:41.345523] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T21:00:41.729948] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T21:00:42.014926] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-27T21:00:42.814933] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-27T21:00:42.861598] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T21:00:43.614968] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-27T21:00:44.138450] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:00:44.140825] [INFO ] [REMOTE ] SBI: Full fetch complete (10575 records). [2025-10-27T21:00:44.140997] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-27T21:00:44.417021] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-27T21:00:44.549784] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-27T21:00:44.550202] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-27T21:00:44.553004] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-27T21:00:44.553506] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-27T21:00:44.563683] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-27T21:00:44.564828] [DEBUG] [LOCAL ] SBI: Trimmed 10575 records to 7458 (keeping 200 days of data) [2025-10-27T21:00:44.607820] [DEBUG] [LOCAL ] SBI: Primary data saved (7458 records). [2025-10-27T21:00:44.607936] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-27T21:00:44.608026] [INFO ] [MAIN ] Update Progress: 1868/2366 symbols completed. SBI took 25.2s. Estimated remaining: 1h 4m 10s. Rate: 7.8 symbols/min [2025-10-27T21:00:44.770245] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:44.813502] [DEBUG] [LOCAL ] SBS: Loaded 49990 existing records from primary storage. [2025-10-27T21:00:44.813837] [INFO ] [MAIN ] SBS: Loaded 49990 existing records. [2025-10-27T21:00:44.988087] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:44.988323] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-27T21:00:44.988383] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-27T21:00:44.989180] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-27T21:00:44.989251] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-27T21:00:45.221821] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-27T21:00:45.265361] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T21:00:45.342925] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:46.014947] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-27T21:00:46.355177] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T21:00:46.814971] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-27T21:00:46.877073] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T21:00:47.615029] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-27T21:00:48.403988] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T21:00:48.414919] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-27T21:00:48.867284] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T21:00:49.214945] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-27T21:00:49.936230] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T21:00:50.014980] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-27T21:00:50.632777] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T21:00:50.814924] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-27T21:00:50.858056] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-27T21:00:51.322300] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:00:51.332454] [INFO ] [REMOTE ] SBH: Full fetch complete (72619 records). [2025-10-27T21:00:51.332609] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-27T21:00:51.333476] [FATAL] [VALIDATOR ] SBH: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:00:51.333572] [FATAL] [MAIN ] SBH: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:00:51.333615] [WARN ] [MAIN ] SBH: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:00:51.333684] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-27T21:00:51.333756] [DEBUG] [LOCAL ] SBH: No primary data file found to delete. [2025-10-27T21:00:51.333792] [INFO ] [LOCAL ] SBH: Starting deletion of derivative data. [2025-10-27T21:00:51.333959] [DEBUG] [LOCAL ] SBH: Deleted derivative data file. [2025-10-27T21:00:51.334886] [INFO ] [MAIN ] Update Progress: 1869/2366 symbols completed. SBH took 33.8s. Estimated remaining: 1h 4m 2s. Rate: 7.8 symbols/min [2025-10-27T21:00:51.537338] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:51.555179] [DEBUG] [LOCAL ] SBSI: Loaded 15036 existing records from primary storage. [2025-10-27T21:00:51.555439] [INFO ] [MAIN ] SBSI: Loaded 15036 existing records. [2025-10-27T21:00:51.620150] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-27T21:00:51.776239] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:51.776498] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-27T21:00:51.776559] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-27T21:00:51.776868] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-27T21:00:51.776939] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-27T21:00:52.151401] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:52.414944] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-27T21:00:52.711196] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T21:00:53.214986] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-27T21:00:53.547596] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:00:54.014959] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-27T21:00:54.583696] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T21:00:54.814980] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-27T21:00:55.027165] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T21:00:55.033375] [INFO ] [REMOTE ] SB: Full fetch complete (49200 records). [2025-10-27T21:00:55.033478] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-27T21:00:55.426569] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-27T21:00:55.426687] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-27T21:00:55.427746] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-27T21:00:55.427809] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-27T21:00:55.429080] [DEBUG] [LOCAL ] SB: Trimmed 49200 records to 32237 (keeping 200 days of data) [2025-10-27T21:00:55.615665] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-27T21:00:55.619527] [DEBUG] [LOCAL ] SB: Primary data saved (32237 records). [2025-10-27T21:00:55.619703] [INFO ] [MAIN ] SB: Full history saved. [2025-10-27T21:00:55.619817] [INFO ] [MAIN ] Update Progress: 1870/2366 symbols completed. SB took 40.8s. Estimated remaining: 1h 3m 53s. Rate: 7.8 symbols/min [2025-10-27T21:00:55.779998] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T21:00:55.818112] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:55.814262] [INFO ] [REMOTE ] SBR: Full fetch complete (11440 records). [2025-10-27T21:00:55.818686] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-27T21:00:56.219994] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-27T21:00:56.219853] [DEBUG] [LOCAL ] SBSW: Loaded 53964 existing records from primary storage. [2025-10-27T21:00:56.220170] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-27T21:00:56.220633] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-27T21:00:56.220739] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-27T21:00:56.220915] [INFO ] [MAIN ] SBSW: Loaded 53964 existing records. [2025-10-27T21:00:56.270756] [DEBUG] [LOCAL ] SBR: Trimmed 11440 records to 7713 (keeping 200 days of data) [2025-10-27T21:00:56.419195] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-27T21:00:56.419298] [DEBUG] [LOCAL ] SBR: Primary data saved (7713 records). [2025-10-27T21:00:56.446248] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-27T21:00:56.450479] [INFO ] [MAIN ] Update Progress: 1871/2366 symbols completed. SBR took 26.6s. Estimated remaining: 1h 3m 44s. Rate: 7.8 symbols/min [2025-10-27T21:00:56.478120] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:00:56.512886] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-27T21:00:56.518095] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-27T21:00:56.523612] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-27T21:00:56.537541] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-27T21:00:56.827412] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:00:56.843878] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-27T21:00:56.843949] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-27T21:00:56.844099] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-27T21:00:56.877927] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-27T21:00:56.889053] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-27T21:00:56.908970] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-27T21:00:57.159994] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:57.220481] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-27T21:00:57.404569] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:00:57.441417] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:00:57.441175] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T21:00:58.014965] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-27T21:00:58.359495] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-27T21:00:58.814939] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-27T21:00:59.088109] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T21:00:59.301104] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:00:59.614937] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-27T21:00:59.983773] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-27T21:01:00.414964] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-27T21:01:00.876700] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-27T21:01:01.215016] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-27T21:01:01.670096] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T21:01:02.014915] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-27T21:01:02.648447] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T21:01:02.815035] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-27T21:01:03.529025] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T21:01:03.615061] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-27T21:01:04.414966] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-27T21:01:05.214972] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-27T21:01:05.608294] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-27T21:01:05.771197] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-27T21:01:06.014940] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-27T21:01:06.098009] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T21:01:06.815010] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-27T21:01:07.597437] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T21:01:07.614901] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-27T21:01:08.127879] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T21:01:08.414950] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-27T21:01:09.222065] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-27T21:01:09.245968] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:01:09.539265] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T21:01:10.014975] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-27T21:01:10.814943] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-27T21:01:10.952825] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T21:01:11.614953] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-27T21:01:11.898878] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-27T21:01:11.980632] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T21:01:12.414945] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-27T21:01:13.099689] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T21:01:13.214984] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-27T21:01:13.420325] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T21:01:14.014988] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-27T21:01:14.752067] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T21:01:14.814908] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-27T21:01:15.614952] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-27T21:01:15.988261] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T21:01:16.387868] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-27T21:01:16.397411] [INFO ] [REMOTE ] SBS: Full fetch complete (70701 records). [2025-10-27T21:01:16.397584] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-27T21:01:16.424907] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-27T21:01:16.736918] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:01:16.839488] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-27T21:01:16.839586] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-27T21:01:16.840865] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-27T21:01:16.840933] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-27T21:01:16.842386] [DEBUG] [LOCAL ] SBS: Trimmed 70701 records to 49193 (keeping 200 days of data) [2025-10-27T21:01:17.126386] [DEBUG] [LOCAL ] SBS: Primary data saved (49193 records). [2025-10-27T21:01:17.126527] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-27T21:01:17.126669] [INFO ] [MAIN ] Update Progress: 1872/2366 symbols completed. SBS took 32.5s. Estimated remaining: 1h 3m 40s. Rate: 7.8 symbols/min [2025-10-27T21:01:17.222478] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-27T21:01:17.294093] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:01:17.337353] [DEBUG] [LOCAL ] SCCO: Loaded 50276 existing records from primary storage. [2025-10-27T21:01:17.337669] [INFO ] [MAIN ] SCCO: Loaded 50276 existing records. [2025-10-27T21:01:17.509337] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:01:17.509534] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-27T21:01:17.509579] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-27T21:01:17.509781] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-27T21:01:17.509839] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-27T21:01:17.856458] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:01:17.941477] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T21:01:18.014901] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-27T21:01:18.719326] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-27T21:01:18.814911] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-27T21:01:19.063000] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T21:01:19.614950] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-27T21:01:20.042518] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T21:01:20.182176] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T21:01:20.415033] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-27T21:01:20.793057] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T21:01:20.793806] [INFO ] [REMOTE ] SBXD: Full fetch complete (3142 records). [2025-10-27T21:01:20.793874] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-27T21:01:20.966278] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-27T21:01:20.966451] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:01:20.966496] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:01:20.966533] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-27T21:01:20.966585] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-27T21:01:20.966618] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-27T21:01:20.966725] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-27T21:01:20.966781] [INFO ] [MAIN ] Update Progress: 1873/2366 symbols completed. SBXD took 24.5s. Estimated remaining: 1h 3m 31s. Rate: 7.8 symbols/min [2025-10-27T21:01:21.155779] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:01:21.171249] [DEBUG] [LOCAL ] SCD: Loaded 13746 existing records from primary storage. [2025-10-27T21:01:21.171494] [INFO ] [MAIN ] SCD: Loaded 13746 existing records. [2025-10-27T21:01:21.223601] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-27T21:01:21.350611] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:01:21.350843] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-27T21:01:21.350890] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-27T21:01:21.351136] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-27T21:01:21.351191] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-27T21:01:21.693086] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:01:21.965216] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:01:22.014937] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-27T21:01:22.380928] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:01:22.384266] [INFO ] [REMOTE ] SBSI: Full fetch complete (21293 records). [2025-10-27T21:01:22.384336] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-27T21:01:22.384768] [FATAL] [VALIDATOR ] SBSI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:01:22.384847] [FATAL] [MAIN ] SBSI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:01:22.384888] [WARN ] [MAIN ] SBSI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:01:22.384978] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-27T21:01:22.385051] [DEBUG] [LOCAL ] SBSI: No primary data file found to delete. [2025-10-27T21:01:22.385086] [INFO ] [LOCAL ] SBSI: Starting deletion of derivative data. [2025-10-27T21:01:22.385207] [DEBUG] [LOCAL ] SBSI: Deleted derivative data file. [2025-10-27T21:01:22.385290] [INFO ] [MAIN ] Update Progress: 1874/2366 symbols completed. SBSI took 31.1s. Estimated remaining: 1h 3m 21s. Rate: 7.8 symbols/min [2025-10-27T21:01:22.562759] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:01:22.622832] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-27T21:01:22.623176] [INFO ] [MAIN ] SCHW: Loaded 54465 existing records. [2025-10-27T21:01:22.796302] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:01:22.796518] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-27T21:01:22.796581] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-27T21:01:22.796826] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-27T21:01:22.796888] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-27T21:01:22.820012] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-27T21:01:23.149631] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:01:23.456231] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T21:01:23.614970] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-27T21:01:24.414918] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-27T21:01:25.214922] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-27T21:01:25.394638] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-27T21:01:25.715624] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T21:01:25.742464] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T21:01:26.014946] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-27T21:01:26.814947] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-27T21:01:26.839873] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T21:01:27.614944] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-27T21:01:28.251484] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:01:28.414907] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-27T21:01:29.214929] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-27T21:01:29.924827] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-27T21:01:30.014929] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-27T21:01:30.814914] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-27T21:01:31.170825] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-27T21:01:31.209978] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-27T21:01:31.543752] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T21:01:31.614909] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-27T21:01:31.681959] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T21:01:32.148410] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T21:01:32.414929] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-27T21:01:33.214955] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-27T21:01:34.014908] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-27T21:01:34.079757] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T21:01:34.090127] [INFO ] [REMOTE ] SBSW: Full fetch complete (76786 records). [2025-10-27T21:01:34.090262] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-27T21:01:34.487343] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-27T21:01:34.487438] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-27T21:01:34.488706] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-27T21:01:34.488773] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-27T21:01:34.490327] [DEBUG] [LOCAL ] SBSW: Trimmed 76786 records to 53183 (keeping 200 days of data) [2025-10-27T21:01:34.792174] [DEBUG] [LOCAL ] SBSW: Primary data saved (53183 records). [2025-10-27T21:01:34.792303] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-27T21:01:34.792795] [INFO ] [MAIN ] Update Progress: 1875/2366 symbols completed. SBSW took 39.2s. Estimated remaining: 1h 3m 15s. Rate: 7.8 symbols/min [2025-10-27T21:01:34.822265] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-27T21:01:34.964070] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:01:35.008368] [DEBUG] [LOCAL ] SCI: Loaded 46687 existing records from primary storage. [2025-10-27T21:01:35.008708] [INFO ] [MAIN ] SCI: Loaded 46687 existing records. [2025-10-27T21:01:35.187874] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:01:35.188205] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-27T21:01:35.188364] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-27T21:01:35.188627] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-27T21:01:35.188718] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-27T21:01:35.499110] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-27T21:01:35.592579] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:01:35.614916] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-27T21:01:35.663170] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T21:01:35.746024] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T21:01:36.414992] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-27T21:01:37.214960] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-27T21:01:37.681227] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T21:01:37.856028] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-27T21:01:38.014959] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-27T21:01:38.689746] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T21:01:38.814943] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-27T21:01:39.614905] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-27T21:01:40.153023] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-27T21:01:40.414933] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-27T21:01:40.463160] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T21:01:41.214970] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-27T21:01:41.323034] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T21:01:42.014917] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-27T21:01:42.189400] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-27T21:01:42.703821] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T21:01:42.814971] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-27T21:01:43.614974] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-27T21:01:44.044624] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-27T21:01:44.236128] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T21:01:44.335888] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T21:01:44.414970] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-27T21:01:45.214941] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-27T21:01:45.600823] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:01:46.014998] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-27T21:01:46.815040] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-27T21:01:46.859614] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T21:01:47.614909] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-27T21:01:47.767609] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T21:01:47.770781] [INFO ] [REMOTE ] SCD: Full fetch complete (17281 records). [2025-10-27T21:01:47.770857] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-27T21:01:48.152138] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-27T21:01:48.152234] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-27T21:01:48.152619] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-27T21:01:48.152718] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-27T21:01:48.153460] [DEBUG] [LOCAL ] SCD: Trimmed 17281 records to 13576 (keeping 200 days of data) [2025-10-27T21:01:48.255480] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-27T21:01:48.267308] [INFO ] [REMOTE ] SCCO: Full fetch complete (71874 records). [2025-10-27T21:01:48.267970] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-27T21:01:48.363979] [DEBUG] [LOCAL ] SCD: Primary data saved (13576 records). [2025-10-27T21:01:48.375437] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-27T21:01:48.375577] [INFO ] [MAIN ] Update Progress: 1876/2366 symbols completed. SCD took 27.4s. Estimated remaining: 1h 3m 9s. Rate: 7.8 symbols/min [2025-10-27T21:01:48.429955] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-27T21:01:48.755753] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:01:48.855122] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-27T21:01:48.855202] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-27T21:01:48.856278] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-27T21:01:48.856354] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-27T21:01:48.862742] [DEBUG] [LOCAL ] SCL: Loaded 15455 existing records from primary storage. [2025-10-27T21:01:48.863107] [INFO ] [MAIN ] SCL: Loaded 15455 existing records. [2025-10-27T21:01:48.937790] [DEBUG] [LOCAL ] SCCO: Trimmed 71874 records to 49479 (keeping 200 days of data) [2025-10-27T21:01:49.134012] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:01:49.140041] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-27T21:01:49.140113] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-27T21:01:49.146978] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-27T21:01:49.147362] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-27T21:01:49.683886] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:01:49.732909] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-27T21:01:49.768431] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-27T21:01:49.782892] [DEBUG] [LOCAL ] SCCO: Primary data saved (49479 records). [2025-10-27T21:01:49.783346] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-27T21:01:49.783449] [INFO ] [MAIN ] Update Progress: 1877/2366 symbols completed. SCCO took 32.7s. Estimated remaining: 1h 2m 59s. Rate: 7.8 symbols/min [2025-10-27T21:01:50.014997] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-27T21:01:50.605367] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-27T21:01:50.671667] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-27T21:01:50.814958] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-27T21:01:51.311217] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T21:01:51.614924] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-27T21:01:52.414921] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-27T21:01:52.871202] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T21:01:52.902190] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-27T21:01:53.147112] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T21:01:53.214948] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-27T21:01:54.018603] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-27T21:01:54.021821] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T21:01:54.815007] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-27T21:01:55.598727] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T21:01:55.614898] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-27T21:01:55.939560] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T21:01:56.399719] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T21:01:56.414893] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-27T21:01:57.167080] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T21:01:57.214900] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-27T21:01:58.014966] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-27T21:01:58.114586] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T21:01:58.814952] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-27T21:01:59.614980] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-27T21:01:59.787762] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T21:01:59.974404] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T21:02:00.414908] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-27T21:02:00.488321] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T21:02:00.498447] [INFO ] [REMOTE ] SCHW: Full fetch complete (77475 records). [2025-10-27T21:02:00.498570] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-27T21:02:00.499442] [FATAL] [VALIDATOR ] SCHW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:02:00.499546] [FATAL] [MAIN ] SCHW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:02:00.499609] [WARN ] [MAIN ] SCHW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:02:00.499704] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-27T21:02:00.499781] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-10-27T21:02:00.499836] [INFO ] [LOCAL ] SCHW: Starting deletion of derivative data. [2025-10-27T21:02:00.499950] [DEBUG] [LOCAL ] SCHW: Deleted derivative data file. [2025-10-27T21:02:00.500419] [INFO ] [MAIN ] Update Progress: 1878/2366 symbols completed. SCHW took 38.1s. Estimated remaining: 1h 2m 52s. Rate: 7.8 symbols/min [2025-10-27T21:02:01.214949] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-27T21:02:01.401690] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T21:02:02.015043] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-27T21:02:02.488433] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T21:02:02.492081] [INFO ] [REMOTE ] SCL: Full fetch complete (21625 records). [2025-10-27T21:02:02.492224] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-27T21:02:02.492732] [FATAL] [VALIDATOR ] SCL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:02:02.492814] [FATAL] [MAIN ] SCL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:02:02.492881] [WARN ] [MAIN ] SCL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:02:02.492948] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-27T21:02:02.493010] [DEBUG] [LOCAL ] SCL: No primary data file found to delete. [2025-10-27T21:02:02.493045] [INFO ] [LOCAL ] SCL: Starting deletion of derivative data. [2025-10-27T21:02:02.493163] [DEBUG] [LOCAL ] SCL: Deleted derivative data file. [2025-10-27T21:02:02.493228] [INFO ] [MAIN ] Update Progress: 1879/2366 symbols completed. SCL took 14.1s. Estimated remaining: 1h 2m 43s. Rate: 7.8 symbols/min [2025-10-27T21:02:02.809898] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T21:02:02.825902] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-27T21:02:04.652639] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-27T21:02:04.661948] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-27T21:02:05.196271] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T21:02:05.204999] [INFO ] [REMOTE ] SCI: Full fetch complete (67046 records). [2025-10-27T21:02:05.205124] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-27T21:02:05.205883] [FATAL] [VALIDATOR ] SCI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:02:05.205970] [FATAL] [MAIN ] SCI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:02:05.206012] [WARN ] [MAIN ] SCI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:02:05.206049] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-27T21:02:05.206103] [DEBUG] [LOCAL ] SCI: No primary data file found to delete. [2025-10-27T21:02:05.206138] [INFO ] [LOCAL ] SCI: Starting deletion of derivative data. [2025-10-27T21:02:05.206269] [DEBUG] [LOCAL ] SCI: Deleted derivative data file. [2025-10-27T21:02:05.206706] [INFO ] [MAIN ] Update Progress: 1880/2366 symbols completed. SCI took 30.4s. Estimated remaining: 1h 2m 34s. Rate: 7.8 symbols/min [2025-10-27T21:02:05.849780] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:05.899739] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:05.957496] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:05.979403] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:05.995739] [DEBUG] [LOCAL ] SDHC: Loaded 10495 existing records from primary storage. [2025-10-27T21:02:05.996107] [INFO ] [MAIN ] SDHC: Loaded 10495 existing records. [2025-10-27T21:02:06.107671] [DEBUG] [LOCAL ] SCM: Loaded 20440 existing records from primary storage. [2025-10-27T21:02:06.126274] [INFO ] [MAIN ] SCM: Loaded 20440 existing records. [2025-10-27T21:02:06.260755] [DEBUG] [LOCAL ] SD: Loaded 28572 existing records from primary storage. [2025-10-27T21:02:06.230165] [DEBUG] [LOCAL ] SCS: Loaded 43785 existing records from primary storage. [2025-10-27T21:02:06.313329] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:06.304590] [INFO ] [MAIN ] SD: Loaded 28572 existing records. [2025-10-27T21:02:06.324511] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-27T21:02:06.329862] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-27T21:02:06.318852] [INFO ] [MAIN ] SCS: Loaded 43785 existing records. [2025-10-27T21:02:06.365218] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-27T21:02:06.387128] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-27T21:02:06.700308] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:06.747040] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-27T21:02:06.770265] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-27T21:02:06.801829] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-27T21:02:06.866212] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-27T21:02:06.937796] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:07.055859] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-27T21:02:07.070602] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-27T21:02:07.055746] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:07.080475] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-27T21:02:07.136745] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-27T21:02:07.152020] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-27T21:02:07.161343] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-27T21:02:07.167006] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-27T21:02:07.206191] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-27T21:02:07.907019] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:07.965020] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-27T21:02:08.211663] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:08.212638] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-27T21:02:08.402742] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:08.406508] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:08.407806] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-27T21:02:08.407139] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-27T21:02:08.784515] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-27T21:02:08.788070] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-27T21:02:09.183682] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T21:02:09.187616] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-27T21:02:09.457418] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T21:02:09.462731] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-27T21:02:09.585252] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T21:02:09.808744] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T21:02:10.014960] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-27T21:02:10.084844] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T21:02:10.814942] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-27T21:02:10.974808] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T21:02:11.614923] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-27T21:02:11.774240] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T21:02:12.177836] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T21:02:12.384407] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T21:02:12.414894] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-27T21:02:13.214983] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-27T21:02:13.371950] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T21:02:14.015014] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-27T21:02:14.778791] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T21:02:14.814958] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-27T21:02:15.122919] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T21:02:15.614934] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-27T21:02:16.345130] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T21:02:16.414952] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-27T21:02:16.515077] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T21:02:17.214979] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-27T21:02:17.938078] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:02:18.014914] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-27T21:02:18.809890] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T21:02:18.818424] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-27T21:02:19.365635] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T21:02:19.611350] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-27T21:02:19.614893] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-27T21:02:20.414951] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-27T21:02:20.433403] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T21:02:21.215008] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-27T21:02:21.765695] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T21:02:22.014923] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-27T21:02:22.358904] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:02:22.814963] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-27T21:02:23.401627] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:02:23.451073] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T21:02:23.614983] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-27T21:02:24.226704] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T21:02:24.229481] [INFO ] [REMOTE ] SDHC: Full fetch complete (16621 records). [2025-10-27T21:02:24.229570] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-27T21:02:24.424768] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-27T21:02:24.600198] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-27T21:02:24.600276] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-27T21:02:24.600704] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-27T21:02:24.600767] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-27T21:02:24.601346] [DEBUG] [LOCAL ] SDHC: Trimmed 16621 records to 10241 (keeping 200 days of data) [2025-10-27T21:02:24.664050] [DEBUG] [LOCAL ] SDHC: Primary data saved (10241 records). [2025-10-27T21:02:24.664235] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-27T21:02:24.664339] [INFO ] [MAIN ] Update Progress: 1881/2366 symbols completed. SDHC took 19.5s. Estimated remaining: 1h 2m 29s. Rate: 7.8 symbols/min [2025-10-27T21:02:24.831035] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:24.843521] [DEBUG] [LOCAL ] SDHY: Loaded 11380 existing records from primary storage. [2025-10-27T21:02:24.843766] [INFO ] [MAIN ] SDHY: Loaded 11380 existing records. [2025-10-27T21:02:25.034914] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:25.035117] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-27T21:02:25.035164] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-27T21:02:25.035335] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-27T21:02:25.035392] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-27T21:02:25.219126] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-27T21:02:25.400017] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:25.423929] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-27T21:02:26.014955] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-27T21:02:26.437428] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T21:02:26.814934] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-27T21:02:27.058731] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T21:02:27.614928] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-27T21:02:27.981083] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T21:02:28.414988] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-27T21:02:28.917208] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T21:02:29.214943] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-27T21:02:29.676544] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:02:30.014933] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-27T21:02:30.722256] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:02:30.814954] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-27T21:02:31.012721] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T21:02:31.615029] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-27T21:02:31.703950] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-27T21:02:32.414930] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-27T21:02:33.214953] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-27T21:02:33.337258] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T21:02:33.342700] [INFO ] [REMOTE ] SD: Full fetch complete (40601 records). [2025-10-27T21:02:33.342837] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-27T21:02:33.722766] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-27T21:02:33.722944] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-27T21:02:33.723814] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-27T21:02:33.723892] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-27T21:02:33.750243] [DEBUG] [LOCAL ] SD: Trimmed 40601 records to 27795 (keeping 200 days of data) [2025-10-27T21:02:33.751714] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-27T21:02:33.938611] [DEBUG] [LOCAL ] SD: Primary data saved (27795 records). [2025-10-27T21:02:33.938775] [INFO ] [MAIN ] SD: Full history saved. [2025-10-27T21:02:33.938906] [INFO ] [MAIN ] Update Progress: 1882/2366 symbols completed. SD took 28.7s. Estimated remaining: 1h 2m 22s. Rate: 7.8 symbols/min [2025-10-27T21:02:34.020046] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-27T21:02:34.109385] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:34.146104] [DEBUG] [LOCAL ] SDRL: Loaded 41771 existing records from primary storage. [2025-10-27T21:02:34.146408] [INFO ] [MAIN ] SDRL: Loaded 41771 existing records. [2025-10-27T21:02:34.327409] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:34.327709] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-27T21:02:34.327834] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-27T21:02:34.328230] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-27T21:02:34.328270] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-27T21:02:34.588939] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T21:02:34.703356] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:34.814898] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-27T21:02:35.614959] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-27T21:02:35.896157] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T21:02:36.159137] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T21:02:36.414945] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-27T21:02:36.623101] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T21:02:36.628447] [INFO ] [REMOTE ] SCM: Full fetch complete (29594 records). [2025-10-27T21:02:36.628531] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-27T21:02:36.990202] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-27T21:02:36.990300] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-27T21:02:36.990920] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-27T21:02:36.990981] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-27T21:02:36.991624] [DEBUG] [LOCAL ] SCM: Trimmed 29594 records to 19935 (keeping 200 days of data) [2025-10-27T21:02:37.114430] [DEBUG] [LOCAL ] SCM: Primary data saved (19935 records). [2025-10-27T21:02:37.114567] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-27T21:02:37.114669] [INFO ] [MAIN ] Update Progress: 1883/2366 symbols completed. SCM took 31.9s. Estimated remaining: 1h 2m 13s. Rate: 7.8 symbols/min [2025-10-27T21:02:37.216959] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-27T21:02:37.293452] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:37.343915] [DEBUG] [LOCAL ] SE: Loaded 54079 existing records from primary storage. [2025-10-27T21:02:37.344236] [INFO ] [MAIN ] SE: Loaded 54079 existing records. [2025-10-27T21:02:37.452820] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:02:37.534884] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:37.535103] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-27T21:02:37.535151] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-27T21:02:37.535344] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-27T21:02:37.535383] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-27T21:02:37.898055] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:38.014929] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-27T21:02:38.493859] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T21:02:38.502310] [INFO ] [REMOTE ] SCS: Full fetch complete (61022 records). [2025-10-27T21:02:38.502407] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-27T21:02:38.827903] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-27T21:02:38.881927] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-27T21:02:38.881994] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-27T21:02:38.882978] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-27T21:02:38.883042] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-27T21:02:38.884166] [DEBUG] [LOCAL ] SCS: Trimmed 61022 records to 43002 (keeping 200 days of data) [2025-10-27T21:02:39.143750] [DEBUG] [LOCAL ] SCS: Primary data saved (43002 records). [2025-10-27T21:02:39.143868] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-27T21:02:39.144674] [INFO ] [MAIN ] Update Progress: 1884/2366 symbols completed. SCS took 33.9s. Estimated remaining: 1h 2m 4s. Rate: 7.8 symbols/min [2025-10-27T21:02:39.319089] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:39.364973] [DEBUG] [LOCAL ] SEE: Loaded 48764 existing records from primary storage. [2025-10-27T21:02:39.365286] [INFO ] [MAIN ] SEE: Loaded 48764 existing records. [2025-10-27T21:02:39.531823] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T21:02:39.584252] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:39.584527] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-27T21:02:39.584583] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-27T21:02:39.584847] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-27T21:02:39.584932] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-27T21:02:39.620115] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-27T21:02:39.760365] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T21:02:40.012585] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:40.414930] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-27T21:02:41.214958] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-27T21:02:41.298575] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T21:02:41.341698] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T21:02:42.014957] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-27T21:02:42.814916] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-27T21:02:42.859696] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T21:02:43.238064] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T21:02:43.614947] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-27T21:02:44.014941] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:02:44.414935] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-27T21:02:44.964292] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T21:02:45.214942] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-27T21:02:45.798794] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-27T21:02:45.835388] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T21:02:46.014949] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-27T21:02:46.814955] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-27T21:02:47.593177] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T21:02:47.614910] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-27T21:02:48.414959] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-27T21:02:48.650310] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T21:02:49.021970] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T21:02:49.214929] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-27T21:02:49.830095] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:02:49.861868] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-27T21:02:50.014956] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-27T21:02:50.814964] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-27T21:02:51.614964] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-27T21:02:51.857729] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T21:02:52.414945] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-27T21:02:52.644424] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T21:02:52.741851] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-27T21:02:53.214946] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-27T21:02:53.638873] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T21:02:54.014957] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-27T21:02:54.814916] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-27T21:02:54.912350] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T21:02:55.258316] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:02:55.450253] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T21:02:55.614936] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-27T21:02:56.414962] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-27T21:02:57.214918] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-27T21:02:57.753205] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T21:02:58.014911] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-27T21:02:58.089455] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T21:02:58.092835] [INFO ] [REMOTE ] SDHY: Full fetch complete (16097 records). [2025-10-27T21:02:58.092912] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-27T21:02:58.458240] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-27T21:02:58.458342] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-27T21:02:58.458845] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-27T21:02:58.458920] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-27T21:02:58.459606] [DEBUG] [LOCAL ] SDHY: Trimmed 16097 records to 11160 (keeping 200 days of data) [2025-10-27T21:02:58.560357] [DEBUG] [LOCAL ] SDHY: Primary data saved (11160 records). [2025-10-27T21:02:58.560996] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-27T21:02:58.562600] [INFO ] [MAIN ] Update Progress: 1885/2366 symbols completed. SDHY took 33.9s. Estimated remaining: 1h 1m 59s. Rate: 7.8 symbols/min [2025-10-27T21:02:58.562459] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-27T21:02:58.750919] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:02:58.765094] [DEBUG] [LOCAL ] SEG: Loaded 12604 existing records from primary storage. [2025-10-27T21:02:58.765325] [INFO ] [MAIN ] SEG: Loaded 12604 existing records. [2025-10-27T21:02:58.827192] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-27T21:02:58.942615] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:02:58.943268] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-27T21:02:58.943318] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-27T21:02:58.943902] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-27T21:02:58.943959] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-27T21:02:59.293590] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:02:59.614923] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-27T21:03:00.077033] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-27T21:03:00.084582] [INFO ] [REMOTE ] SDRL: Full fetch complete (61255 records). [2025-10-27T21:03:00.084711] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-27T21:03:00.422128] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-27T21:03:00.476151] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-27T21:03:00.476325] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-27T21:03:00.477392] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-27T21:03:00.477502] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-27T21:03:00.478748] [DEBUG] [LOCAL ] SDRL: Trimmed 61255 records to 40933 (keeping 200 days of data) [2025-10-27T21:03:00.596604] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-27T21:03:00.757599] [DEBUG] [LOCAL ] SDRL: Primary data saved (40933 records). [2025-10-27T21:03:00.757755] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-27T21:03:00.757840] [INFO ] [MAIN ] Update Progress: 1886/2366 symbols completed. SDRL took 26.8s. Estimated remaining: 1h 1m 50s. Rate: 7.8 symbols/min [2025-10-27T21:03:00.932171] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:00.996126] [DEBUG] [LOCAL ] SEI: Loaded 50795 existing records from primary storage. [2025-10-27T21:03:00.996454] [INFO ] [MAIN ] SEI: Loaded 50795 existing records. [2025-10-27T21:03:01.225450] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-27T21:03:01.241865] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:01.251239] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-27T21:03:01.252004] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-27T21:03:01.253961] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T21:03:01.260076] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-27T21:03:01.260210] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-27T21:03:01.821410] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T21:03:01.801530] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:02.015017] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-27T21:03:02.822355] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-27T21:03:02.852159] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:03:03.614949] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-27T21:03:03.852591] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T21:03:03.938525] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:03:04.414946] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-27T21:03:05.078041] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T21:03:05.214972] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-27T21:03:06.014917] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-27T21:03:06.752878] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T21:03:06.792284] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-27T21:03:06.815097] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-27T21:03:07.322837] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-27T21:03:07.614929] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-27T21:03:07.645381] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T21:03:08.415004] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-27T21:03:09.194495] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T21:03:09.214905] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-27T21:03:09.374210] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T21:03:09.384452] [INFO ] [REMOTE ] SE: Full fetch complete (77306 records). [2025-10-27T21:03:09.384586] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-27T21:03:09.778610] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-27T21:03:09.778716] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-27T21:03:09.779822] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-27T21:03:09.779903] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-27T21:03:09.781315] [DEBUG] [LOCAL ] SE: Trimmed 77306 records to 53300 (keeping 200 days of data) [2025-10-27T21:03:10.015285] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-27T21:03:10.116118] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T21:03:10.134581] [DEBUG] [LOCAL ] SE: Primary data saved (53300 records). [2025-10-27T21:03:10.134713] [INFO ] [MAIN ] SE: Full history saved. [2025-10-27T21:03:10.134809] [INFO ] [MAIN ] Update Progress: 1887/2366 symbols completed. SE took 33.0s. Estimated remaining: 1h 1m 43s. Rate: 7.8 symbols/min [2025-10-27T21:03:10.298393] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:10.338095] [DEBUG] [LOCAL ] SEM: Loaded 43751 existing records from primary storage. [2025-10-27T21:03:10.338404] [INFO ] [MAIN ] SEM: Loaded 43751 existing records. [2025-10-27T21:03:10.509812] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:10.510017] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-27T21:03:10.510063] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-27T21:03:10.510478] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-27T21:03:10.510534] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-27T21:03:10.820138] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-27T21:03:10.854685] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:11.230899] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T21:03:11.615005] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-27T21:03:12.083536] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:03:12.414947] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-27T21:03:13.214928] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-27T21:03:13.254874] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T21:03:13.844973] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:03:14.014975] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-27T21:03:14.815167] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-27T21:03:14.823990] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T21:03:15.603891] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T21:03:15.622001] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-27T21:03:15.624357] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T21:03:16.414999] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-27T21:03:16.788924] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T21:03:17.214978] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-27T21:03:17.750446] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T21:03:18.014973] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-27T21:03:18.814917] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-27T21:03:18.905760] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T21:03:19.435367] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T21:03:19.614957] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-27T21:03:20.106366] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T21:03:20.115610] [INFO ] [REMOTE ] SEE: Full fetch complete (69716 records). [2025-10-27T21:03:20.115950] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-27T21:03:20.116942] [FATAL] [VALIDATOR ] SEE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:03:20.117088] [FATAL] [MAIN ] SEE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:03:20.117155] [WARN ] [MAIN ] SEE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:03:20.117226] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-27T21:03:20.117290] [DEBUG] [LOCAL ] SEE: No primary data file found to delete. [2025-10-27T21:03:20.117325] [INFO ] [LOCAL ] SEE: Starting deletion of derivative data. [2025-10-27T21:03:20.117474] [DEBUG] [LOCAL ] SEE: Deleted derivative data file. [2025-10-27T21:03:20.117565] [INFO ] [MAIN ] Update Progress: 1888/2366 symbols completed. SEE took 41.0s. Estimated remaining: 1h 1m 36s. Rate: 7.8 symbols/min [2025-10-27T21:03:20.320745] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:03:20.323040] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:20.370574] [DEBUG] [LOCAL ] SEMR: Loaded 42648 existing records from primary storage. [2025-10-27T21:03:20.370897] [INFO ] [MAIN ] SEMR: Loaded 42648 existing records. [2025-10-27T21:03:20.422221] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-27T21:03:20.554819] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:20.555023] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-27T21:03:20.555071] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-27T21:03:20.555244] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-27T21:03:20.555282] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-27T21:03:20.906134] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:21.214981] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-27T21:03:21.887454] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T21:03:22.014929] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-27T21:03:22.218324] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-27T21:03:22.814959] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-27T21:03:23.450476] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:03:23.614945] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-27T21:03:24.065635] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:03:24.414944] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-27T21:03:24.559112] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T21:03:25.214988] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-27T21:03:25.814025] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T21:03:25.816358] [INFO ] [REMOTE ] SEG: Full fetch complete (19797 records). [2025-10-27T21:03:25.816425] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-27T21:03:26.021827] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-27T21:03:26.185420] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-27T21:03:26.185612] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-27T21:03:26.186311] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-27T21:03:26.186372] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-27T21:03:26.187024] [DEBUG] [LOCAL ] SEG: Trimmed 19797 records to 12236 (keeping 200 days of data) [2025-10-27T21:03:26.262551] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-27T21:03:26.281947] [DEBUG] [LOCAL ] SEG: Primary data saved (12236 records). [2025-10-27T21:03:26.291819] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-27T21:03:26.292060] [INFO ] [MAIN ] Update Progress: 1889/2366 symbols completed. SEG took 27.7s. Estimated remaining: 1h 1m 28s. Rate: 7.8 symbols/min [2025-10-27T21:03:26.459517] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:26.509633] [DEBUG] [LOCAL ] SES: Loaded 52393 existing records from primary storage. [2025-10-27T21:03:26.509947] [INFO ] [MAIN ] SES: Loaded 52393 existing records. [2025-10-27T21:03:26.683141] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:26.683364] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-27T21:03:26.683410] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-27T21:03:26.683592] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-27T21:03:26.683629] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-27T21:03:26.820147] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-27T21:03:27.029136] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:27.359701] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T21:03:27.614951] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-27T21:03:28.414941] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-27T21:03:28.579598] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T21:03:29.214941] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-27T21:03:29.998802] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-27T21:03:30.019226] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-27T21:03:30.022460] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T21:03:30.822156] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-27T21:03:30.839056] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T21:03:31.112828] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T21:03:31.614932] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-27T21:03:32.414929] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-27T21:03:32.715707] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T21:03:33.214914] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-27T21:03:33.563057] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T21:03:33.772066] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-27T21:03:34.014953] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-27T21:03:34.573498] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T21:03:34.581178] [INFO ] [REMOTE ] SEM: Full fetch complete (61171 records). [2025-10-27T21:03:34.581273] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-27T21:03:34.581951] [FATAL] [VALIDATOR ] SEM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:03:34.582056] [FATAL] [MAIN ] SEM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:03:34.582099] [WARN ] [MAIN ] SEM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:03:34.582136] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-27T21:03:34.582191] [DEBUG] [LOCAL ] SEM: No primary data file found to delete. [2025-10-27T21:03:34.582225] [INFO ] [LOCAL ] SEM: Starting deletion of derivative data. [2025-10-27T21:03:34.582375] [DEBUG] [LOCAL ] SEM: Deleted derivative data file. [2025-10-27T21:03:34.582465] [INFO ] [MAIN ] Update Progress: 1890/2366 symbols completed. SEM took 24.4s. Estimated remaining: 1h 1m 20s. Rate: 7.8 symbols/min [2025-10-27T21:03:34.747198] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:34.784790] [DEBUG] [LOCAL ] SF: Loaded 41965 existing records from primary storage. [2025-10-27T21:03:34.785069] [INFO ] [MAIN ] SF: Loaded 41965 existing records. [2025-10-27T21:03:34.820217] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-27T21:03:34.962253] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:34.962422] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-27T21:03:34.962466] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-27T21:03:34.962692] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-27T21:03:34.962749] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-27T21:03:35.317761] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:35.345459] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-27T21:03:35.614934] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-27T21:03:36.295899] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T21:03:36.414962] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-27T21:03:37.214919] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-27T21:03:37.682266] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-27T21:03:37.692949] [INFO ] [REMOTE ] SEI: Full fetch complete (71455 records). [2025-10-27T21:03:37.693188] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-27T21:03:37.873538] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T21:03:38.020055] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-27T21:03:38.114698] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-27T21:03:38.114779] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-27T21:03:38.115846] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-27T21:03:38.115908] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-27T21:03:38.117267] [DEBUG] [LOCAL ] SEI: Trimmed 71455 records to 50033 (keeping 200 days of data) [2025-10-27T21:03:38.415559] [DEBUG] [LOCAL ] SEI: Primary data saved (50033 records). [2025-10-27T21:03:38.415717] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-27T21:03:38.415806] [INFO ] [MAIN ] Update Progress: 1891/2366 symbols completed. SEI took 37.7s. Estimated remaining: 1h 1m 11s. Rate: 7.8 symbols/min [2025-10-27T21:03:38.580117] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:38.586342] [DEBUG] [LOCAL ] SFB: Loaded 3715 existing records from primary storage. [2025-10-27T21:03:38.586515] [INFO ] [MAIN ] SFB: Loaded 3715 existing records. [2025-10-27T21:03:38.756822] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:38.757033] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-27T21:03:38.757080] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-27T21:03:38.757229] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-27T21:03:38.757284] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-27T21:03:38.823941] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-27T21:03:39.106569] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:03:39.528576] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-27T21:03:39.614919] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-27T21:03:39.653024] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T21:03:40.086320] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T21:03:40.087505] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T21:03:40.414998] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-27T21:03:41.160490] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T21:03:41.214905] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-27T21:03:41.831410] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T21:03:42.015052] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-27T21:03:42.814954] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-27T21:03:43.255839] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T21:03:43.614977] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-27T21:03:44.415006] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-27T21:03:44.636109] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-27T21:03:45.220081] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-27T21:03:45.233509] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T21:03:45.654788] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T21:03:46.014937] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-27T21:03:46.480363] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:03:46.814951] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-27T21:03:47.573808] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-27T21:03:47.614943] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-27T21:03:48.158916] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T21:03:48.414946] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-27T21:03:48.890174] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T21:03:49.214975] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-27T21:03:50.014972] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-27T21:03:50.274754] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T21:03:50.627541] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T21:03:50.814941] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-27T21:03:51.621725] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-27T21:03:51.632532] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-27T21:03:51.957471] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:03:52.358045] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T21:03:52.414979] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-27T21:03:52.812079] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T21:03:53.214968] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-27T21:03:54.014964] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-27T21:03:54.815019] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-27T21:03:55.200425] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-27T21:03:55.605610] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:03:55.614902] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-27T21:03:56.414990] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-27T21:03:57.115294] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T21:03:57.130781] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T21:03:57.214935] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-27T21:03:57.351960] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-27T21:03:58.015026] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-27T21:03:58.589485] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T21:03:58.590676] [INFO ] [REMOTE ] SFB: Full fetch complete (5673 records). [2025-10-27T21:03:58.590746] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-27T21:03:58.820170] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-27T21:03:58.976248] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-27T21:03:58.985281] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-27T21:03:58.996469] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-27T21:03:58.996769] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-27T21:03:59.001168] [DEBUG] [LOCAL ] SFB: Trimmed 5673 records to 3585 (keeping 200 days of data) [2025-10-27T21:03:59.001045] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T21:03:59.031061] [DEBUG] [LOCAL ] SFB: Primary data saved (3585 records). [2025-10-27T21:03:59.031134] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-27T21:03:59.031207] [INFO ] [MAIN ] Update Progress: 1892/2366 symbols completed. SFB took 20.6s. Estimated remaining: 1h 1m 7s. Rate: 7.8 symbols/min [2025-10-27T21:03:59.197738] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:03:59.218734] [DEBUG] [LOCAL ] SFBS: Loaded 21716 existing records from primary storage. [2025-10-27T21:03:59.219021] [INFO ] [MAIN ] SFBS: Loaded 21716 existing records. [2025-10-27T21:03:59.390580] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:03:59.390795] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-27T21:03:59.390843] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-27T21:03:59.391026] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-27T21:03:59.391072] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-27T21:03:59.622568] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-27T21:03:59.740052] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:00.341217] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T21:04:00.414917] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-27T21:04:01.214939] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-27T21:04:01.497994] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T21:04:01.698488] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T21:04:01.707604] [INFO ] [REMOTE ] SEMR: Full fetch complete (60742 records). [2025-10-27T21:04:01.707826] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-27T21:04:02.020054] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-27T21:04:02.090546] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-27T21:04:02.090633] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-27T21:04:02.091750] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-27T21:04:02.091813] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-27T21:04:02.093074] [DEBUG] [LOCAL ] SEMR: Trimmed 60742 records to 41931 (keeping 200 days of data) [2025-10-27T21:04:02.324788] [DEBUG] [LOCAL ] SEMR: Primary data saved (41931 records). [2025-10-27T21:04:02.325080] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-27T21:04:02.325862] [INFO ] [MAIN ] Update Progress: 1893/2366 symbols completed. SEMR took 42.2s. Estimated remaining: 1h 0m 58s. Rate: 7.8 symbols/min [2025-10-27T21:04:02.496689] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:02.540043] [DEBUG] [LOCAL ] SFL: Loaded 45839 existing records from primary storage. [2025-10-27T21:04:02.540390] [INFO ] [MAIN ] SFL: Loaded 45839 existing records. [2025-10-27T21:04:02.722201] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:02.722576] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-27T21:04:02.722679] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-27T21:04:02.722953] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-27T21:04:02.723029] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-27T21:04:02.817023] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-27T21:04:02.861359] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T21:04:03.146223] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:03.274021] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T21:04:03.614987] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-27T21:04:04.414936] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-27T21:04:04.825255] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-27T21:04:04.971220] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T21:04:04.979013] [INFO ] [REMOTE ] SF: Full fetch complete (60171 records). [2025-10-27T21:04:04.979113] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-27T21:04:04.979797] [FATAL] [VALIDATOR ] SF: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:04:04.979883] [FATAL] [MAIN ] SF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:04:04.979925] [WARN ] [MAIN ] SF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:04:04.979962] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-27T21:04:04.980034] [DEBUG] [LOCAL ] SF: No primary data file found to delete. [2025-10-27T21:04:04.980108] [INFO ] [LOCAL ] SF: Starting deletion of derivative data. [2025-10-27T21:04:04.980260] [DEBUG] [LOCAL ] SF: Deleted derivative data file. [2025-10-27T21:04:04.980352] [INFO ] [MAIN ] Update Progress: 1894/2366 symbols completed. SF took 30.4s. Estimated remaining: 1h 0m 49s. Rate: 7.8 symbols/min [2025-10-27T21:04:05.150252] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:05.173011] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T21:04:05.224522] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-27T21:04:05.227365] [DEBUG] [LOCAL ] SG: Loaded 54281 existing records from primary storage. [2025-10-27T21:04:05.227751] [INFO ] [MAIN ] SG: Loaded 54281 existing records. [2025-10-27T21:04:05.402798] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:05.402990] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-27T21:04:05.403038] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-27T21:04:05.403222] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-27T21:04:05.403260] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-27T21:04:05.753361] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:06.014946] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-27T21:04:06.516058] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T21:04:06.814947] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-27T21:04:07.445434] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:04:07.614912] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-27T21:04:08.414974] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-27T21:04:08.630113] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T21:04:08.803297] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T21:04:09.214942] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-27T21:04:09.951196] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T21:04:10.014922] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-27T21:04:10.404358] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T21:04:10.814959] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-27T21:04:11.614975] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-27T21:04:11.822271] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T21:04:11.832577] [INFO ] [REMOTE ] SES: Full fetch complete (75647 records). [2025-10-27T21:04:11.832740] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-27T21:04:12.226943] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-27T21:04:12.227053] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-27T21:04:12.228316] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-27T21:04:12.228412] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-27T21:04:12.259955] [DEBUG] [LOCAL ] SES: Trimmed 75647 records to 51646 (keeping 200 days of data) [2025-10-27T21:04:12.262884] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-27T21:04:12.436756] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-27T21:04:12.580681] [DEBUG] [LOCAL ] SES: Primary data saved (51646 records). [2025-10-27T21:04:12.580837] [INFO ] [MAIN ] SES: Full history saved. [2025-10-27T21:04:12.581268] [INFO ] [MAIN ] Update Progress: 1895/2366 symbols completed. SES took 46.3s. Estimated remaining: 1h 0m 41s. Rate: 7.8 symbols/min [2025-10-27T21:04:12.759029] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:12.802199] [DEBUG] [LOCAL ] SGHC: Loaded 47979 existing records from primary storage. [2025-10-27T21:04:12.802494] [INFO ] [MAIN ] SGHC: Loaded 47979 existing records. [2025-10-27T21:04:12.995375] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:12.995738] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-27T21:04:12.995862] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-27T21:04:12.996310] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-27T21:04:12.996441] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-27T21:04:13.199246] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T21:04:13.215095] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-27T21:04:13.409938] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:14.014907] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-27T21:04:14.104150] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-27T21:04:14.207521] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:04:14.814973] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-27T21:04:15.615056] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-27T21:04:15.699143] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T21:04:16.415032] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-27T21:04:16.759780] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:04:16.835338] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T21:04:17.214941] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-27T21:04:17.457213] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T21:04:18.014938] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-27T21:04:18.468323] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:04:18.814916] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-27T21:04:18.934162] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T21:04:19.614937] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-27T21:04:20.414905] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-27T21:04:20.437180] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T21:04:20.507798] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T21:04:21.214951] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-27T21:04:21.588467] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T21:04:22.014962] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-27T21:04:22.814932] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-27T21:04:23.182507] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:04:23.239271] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T21:04:23.614982] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-27T21:04:24.060007] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T21:04:24.414936] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-27T21:04:25.214943] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-27T21:04:25.319741] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T21:04:25.798940] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-27T21:04:26.014916] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-27T21:04:26.814942] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-27T21:04:26.899667] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T21:04:27.614931] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-27T21:04:27.832072] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-27T21:04:27.993133] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T21:04:28.415006] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-27T21:04:29.132201] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:04:29.214942] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-27T21:04:29.672233] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T21:04:30.014987] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-27T21:04:30.814929] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-27T21:04:31.106489] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:04:31.117140] [INFO ] [REMOTE ] SG: Full fetch complete (77486 records). [2025-10-27T21:04:31.117282] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-27T21:04:31.555860] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-27T21:04:31.556190] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-27T21:04:31.558046] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-27T21:04:31.559470] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T21:04:31.569636] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-27T21:04:31.571921] [DEBUG] [LOCAL ] SG: Trimmed 77486 records to 53500 (keeping 200 days of data) [2025-10-27T21:04:31.619019] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-27T21:04:31.906145] [DEBUG] [LOCAL ] SG: Primary data saved (53500 records). [2025-10-27T21:04:31.906302] [INFO ] [MAIN ] SG: Full history saved. [2025-10-27T21:04:31.906416] [INFO ] [MAIN ] Update Progress: 1896/2366 symbols completed. SG took 26.9s. Estimated remaining: 1h 0m 36s. Rate: 7.8 symbols/min [2025-10-27T21:04:32.106463] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:32.106837] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-27T21:04:32.106912] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-27T21:04:32.130507] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-27T21:04:32.130676] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-27T21:04:32.130935] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-27T21:04:32.131356] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-27T21:04:32.132451] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T21:04:32.214911] [INFO ] [REMOTE ] SFL: Full fetch complete (65895 records). [2025-10-27T21:04:32.228072] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-27T21:04:32.418522] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-27T21:04:32.858881] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:32.928539] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-27T21:04:32.928723] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-27T21:04:32.929861] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-27T21:04:32.929997] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-27T21:04:32.931442] [DEBUG] [LOCAL ] SFL: Trimmed 65895 records to 45033 (keeping 200 days of data) [2025-10-27T21:04:33.057916] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T21:04:33.224205] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-27T21:04:33.238890] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T21:04:33.248266] [DEBUG] [LOCAL ] SFL: Primary data saved (45033 records). [2025-10-27T21:04:33.248965] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-27T21:04:33.249782] [INFO ] [MAIN ] Update Progress: 1897/2366 symbols completed. SFL took 30.9s. Estimated remaining: 1h 0m 27s. Rate: 7.8 symbols/min [2025-10-27T21:04:33.280352] [INFO ] [REMOTE ] SFBS: Full fetch complete (30489 records). [2025-10-27T21:04:33.319318] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-27T21:04:33.353029] [FATAL] [VALIDATOR ] SFBS: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:04:33.358714] [FATAL] [MAIN ] SFBS: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:04:33.369143] [WARN ] [MAIN ] SFBS: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:04:33.379593] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-27T21:04:33.407991] [DEBUG] [LOCAL ] SFBS: No primary data file found to delete. [2025-10-27T21:04:33.427222] [INFO ] [LOCAL ] SFBS: Starting deletion of derivative data. [2025-10-27T21:04:33.427115] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:33.427797] [DEBUG] [LOCAL ] SFBS: Deleted derivative data file. [2025-10-27T21:04:33.427970] [INFO ] [MAIN ] Update Progress: 1898/2366 symbols completed. SFBS took 34.4s. Estimated remaining: 1h 0m 17s. Rate: 7.8 symbols/min [2025-10-27T21:04:33.546901] [DEBUG] [LOCAL ] SGU: Loaded 6548 existing records from primary storage. [2025-10-27T21:04:33.558166] [INFO ] [MAIN ] SGU: Loaded 6548 existing records. [2025-10-27T21:04:33.711563] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:33.799934] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:33.800222] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-27T21:04:33.801435] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-27T21:04:33.801612] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-27T21:04:33.801707] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-27T21:04:34.020562] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-10-27T21:04:34.106108] [DEBUG] [LOCAL ] SHAK: Loaded 49337 existing records from primary storage. [2025-10-27T21:04:34.109850] [INFO ] [MAIN ] SHAK: Loaded 49337 existing records. [2025-10-27T21:04:34.306738] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:34.378525] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:34.378784] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-27T21:04:34.378849] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-27T21:04:34.379333] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-27T21:04:34.379389] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-27T21:04:34.422311] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:04:34.449699] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-10-27T21:04:34.460791] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:04:34.483019] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-27T21:04:34.488960] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:04:34.499291] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-27T21:04:34.509631] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-27T21:04:34.522920] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-27T21:04:34.528142] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-27T21:04:34.534876] [INFO ] [MAIN ] Update Progress: 1899/2366 symbols completed. SGI took 2.6s. Estimated remaining: 1h 0m 8s. Rate: 7.8 symbols/min [2025-10-27T21:04:34.816729] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-27T21:04:34.905247] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:34.927337] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:34.952137] [DEBUG] [LOCAL ] SHCO: Loaded 25577 existing records from primary storage. [2025-10-27T21:04:34.952398] [INFO ] [MAIN ] SHCO: Loaded 25577 existing records. [2025-10-27T21:04:35.132270] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T21:04:35.171618] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:35.172292] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-27T21:04:35.172636] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-27T21:04:35.172899] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-27T21:04:35.172941] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-27T21:04:35.530809] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T21:04:35.534330] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:35.614917] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-27T21:04:36.414946] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-27T21:04:36.450291] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-27T21:04:37.215004] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-27T21:04:38.014978] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-27T21:04:38.075958] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T21:04:38.368316] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T21:04:38.726268] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-27T21:04:38.814972] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-27T21:04:39.614965] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-27T21:04:39.900538] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T21:04:40.203862] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T21:04:40.414993] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-27T21:04:41.214994] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-27T21:04:41.891078] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T21:04:42.015017] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-27T21:04:42.654300] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:04:42.815023] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-27T21:04:43.614918] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-27T21:04:43.680693] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T21:04:43.808330] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T21:04:44.414976] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-27T21:04:45.051179] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T21:04:45.215376] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T21:04:45.215452] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-27T21:04:45.721204] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-27T21:04:46.014949] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-27T21:04:46.814967] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-27T21:04:47.201270] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:04:47.356365] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T21:04:47.614992] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-27T21:04:48.236613] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:04:48.414982] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-27T21:04:49.215071] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-27T21:04:49.217741] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T21:04:50.014933] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-27T21:04:50.814918] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-27T21:04:51.091904] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-27T21:04:51.525472] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T21:04:51.526923] [INFO ] [REMOTE ] SGU: Full fetch complete (8877 records). [2025-10-27T21:04:51.526992] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-27T21:04:51.618073] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-27T21:04:51.904212] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-27T21:04:51.904395] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-27T21:04:51.904725] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-27T21:04:51.904810] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-27T21:04:51.914602] [DEBUG] [LOCAL ] SGU: Trimmed 8877 records to 6395 (keeping 200 days of data) [2025-10-27T21:04:51.932878] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-27T21:04:51.971397] [INFO ] [REMOTE ] SGHC: Full fetch complete (66050 records). [2025-10-27T21:04:51.972690] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-27T21:04:52.015965] [DEBUG] [LOCAL ] SGU: Primary data saved (6395 records). [2025-10-27T21:04:52.059360] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-27T21:04:52.083762] [INFO ] [MAIN ] Update Progress: 1900/2366 symbols completed. SGU took 18.8s. Estimated remaining: 1h 0m 3s. Rate: 7.8 symbols/min [2025-10-27T21:04:52.418735] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-27T21:04:52.428371] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:52.607418] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-27T21:04:52.608376] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T21:04:52.608033] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-27T21:04:52.609842] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-27T21:04:52.614331] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-27T21:04:52.615813] [DEBUG] [LOCAL ] SGHC: Trimmed 66050 records to 47273 (keeping 200 days of data) [2025-10-27T21:04:52.769380] [DEBUG] [LOCAL ] SHEL: Loaded 54455 existing records from primary storage. [2025-10-27T21:04:52.769750] [INFO ] [MAIN ] SHEL: Loaded 54455 existing records. [2025-10-27T21:04:53.084630] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:53.101173] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-27T21:04:53.104639] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-27T21:04:53.107930] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-27T21:04:53.108221] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-27T21:04:53.140067] [DEBUG] [LOCAL ] SGHC: Primary data saved (47273 records). [2025-10-27T21:04:53.140155] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-27T21:04:53.171928] [INFO ] [MAIN ] Update Progress: 1901/2366 symbols completed. SGHC took 40.6s. Estimated remaining: 59m 53s. Rate: 7.8 symbols/min [2025-10-27T21:04:53.229430] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-27T21:04:53.519619] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:04:53.640892] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:53.649682] [DEBUG] [LOCAL ] SHG: Loaded 27055 existing records from primary storage. [2025-10-27T21:04:53.649880] [INFO ] [MAIN ] SHG: Loaded 27055 existing records. [2025-10-27T21:04:53.823242] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:04:53.823420] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-27T21:04:53.823466] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-27T21:04:53.823638] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-27T21:04:53.823721] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-27T21:04:54.024542] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-27T21:04:54.174850] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:04:54.320556] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-27T21:04:54.356616] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-27T21:04:54.814982] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-27T21:04:55.614947] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-27T21:04:55.735143] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T21:04:55.963411] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-27T21:04:56.414936] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-27T21:04:57.214998] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-27T21:04:57.500099] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T21:04:57.547533] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:04:58.014974] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-27T21:04:58.814957] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-27T21:04:58.911027] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T21:04:59.131823] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T21:04:59.614940] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-27T21:05:00.338448] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T21:05:00.414915] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-27T21:05:01.214974] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-27T21:05:01.886369] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T21:05:01.997389] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-27T21:05:02.014979] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-27T21:05:02.815052] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-27T21:05:02.959535] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:05:03.614935] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-27T21:05:03.641915] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T21:05:03.724632] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T21:05:03.730242] [INFO ] [REMOTE ] SHCO: Full fetch complete (37627 records). [2025-10-27T21:05:03.730346] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-27T21:05:04.109315] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-27T21:05:04.109396] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-27T21:05:04.110182] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-27T21:05:04.110243] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-27T21:05:04.111090] [DEBUG] [LOCAL ] SHCO: Trimmed 37627 records to 24877 (keeping 200 days of data) [2025-10-27T21:05:04.250530] [DEBUG] [LOCAL ] SHCO: Primary data saved (24877 records). [2025-10-27T21:05:04.250686] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-27T21:05:04.250779] [INFO ] [MAIN ] Update Progress: 1902/2366 symbols completed. SHCO took 29.7s. Estimated remaining: 59m 46s. Rate: 7.8 symbols/min [2025-10-27T21:05:04.424981] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-27T21:05:04.429330] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:04.477164] [DEBUG] [LOCAL ] SHO: Loaded 49713 existing records from primary storage. [2025-10-27T21:05:04.477601] [INFO ] [MAIN ] SHO: Loaded 49713 existing records. [2025-10-27T21:05:04.682812] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:04.683034] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-27T21:05:04.683080] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-27T21:05:04.683605] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-27T21:05:04.683709] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-27T21:05:05.105839] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:05.214931] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-27T21:05:05.386469] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T21:05:05.414610] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:05:06.014944] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-27T21:05:06.814952] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-27T21:05:07.616857] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-27T21:05:07.622161] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-27T21:05:07.777780] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-27T21:05:08.082231] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T21:05:08.414932] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-27T21:05:08.596517] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:05:09.214936] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-27T21:05:10.014910] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-27T21:05:10.071826] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T21:05:10.812919] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T21:05:10.816366] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-27T21:05:10.902688] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T21:05:10.914993] [INFO ] [REMOTE ] SHAK: Full fetch complete (70859 records). [2025-10-27T21:05:10.915142] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-27T21:05:10.916020] [FATAL] [VALIDATOR ] SHAK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:05:10.916131] [FATAL] [MAIN ] SHAK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:05:10.916206] [WARN ] [MAIN ] SHAK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:05:10.916297] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-27T21:05:10.916392] [DEBUG] [LOCAL ] SHAK: No primary data file found to delete. [2025-10-27T21:05:10.916448] [INFO ] [LOCAL ] SHAK: Starting deletion of derivative data. [2025-10-27T21:05:10.917149] [DEBUG] [LOCAL ] SHAK: Deleted derivative data file. [2025-10-27T21:05:10.917258] [INFO ] [MAIN ] Update Progress: 1903/2366 symbols completed. SHAK took 37.5s. Estimated remaining: 59m 38s. Rate: 7.8 symbols/min [2025-10-27T21:05:11.102189] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:11.107794] [DEBUG] [LOCAL ] SHOC: Loaded 3055 existing records from primary storage. [2025-10-27T21:05:11.107947] [INFO ] [MAIN ] SHOC: Loaded 3055 existing records. [2025-10-27T21:05:11.287400] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:11.287686] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-27T21:05:11.287744] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-27T21:05:11.287873] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-27T21:05:11.287910] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-27T21:05:11.627174] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-27T21:05:11.633172] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:12.414937] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-27T21:05:12.451328] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:05:13.024291] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T21:05:13.041245] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T21:05:13.214935] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-27T21:05:13.773890] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T21:05:14.014917] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-27T21:05:14.814942] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-27T21:05:15.012147] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:05:15.614947] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-27T21:05:16.415000] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-27T21:05:16.697753] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T21:05:17.086766] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T21:05:17.154864] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-27T21:05:17.214924] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-27T21:05:18.014953] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-27T21:05:18.820080] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-27T21:05:18.833418] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T21:05:19.096469] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T21:05:19.569325] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T21:05:19.614917] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-27T21:05:20.414938] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-27T21:05:21.214926] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-27T21:05:21.306823] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T21:05:21.546186] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T21:05:21.785232] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T21:05:22.014942] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-27T21:05:22.815004] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-27T21:05:23.157973] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:05:23.163863] [INFO ] [REMOTE ] SHG: Full fetch complete (41377 records). [2025-10-27T21:05:23.163949] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-27T21:05:23.534513] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-27T21:05:23.534585] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-27T21:05:23.535515] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-27T21:05:23.535577] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-27T21:05:23.536473] [DEBUG] [LOCAL ] SHG: Trimmed 41377 records to 26469 (keeping 200 days of data) [2025-10-27T21:05:23.622065] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-27T21:05:23.694938] [DEBUG] [LOCAL ] SHG: Primary data saved (26469 records). [2025-10-27T21:05:23.695057] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-27T21:05:23.695159] [INFO ] [MAIN ] Update Progress: 1904/2366 symbols completed. SHG took 30.5s. Estimated remaining: 59m 32s. Rate: 7.8 symbols/min [2025-10-27T21:05:23.859861] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:23.910205] [DEBUG] [LOCAL ] SHW: Loaded 51141 existing records from primary storage. [2025-10-27T21:05:23.910513] [INFO ] [MAIN ] SHW: Loaded 51141 existing records. [2025-10-27T21:05:24.081429] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:24.081667] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-27T21:05:24.081726] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-27T21:05:24.081911] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-27T21:05:24.081948] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-27T21:05:24.415181] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-27T21:05:24.437143] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:24.711115] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-27T21:05:24.928164] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T21:05:25.096681] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T21:05:25.214915] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-27T21:05:25.877619] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T21:05:26.014925] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-27T21:05:26.814957] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-27T21:05:27.244952] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T21:05:27.614917] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-27T21:05:27.715797] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T21:05:27.726304] [INFO ] [REMOTE ] SHEL: Full fetch complete (77838 records). [2025-10-27T21:05:27.726444] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-27T21:05:28.166060] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-27T21:05:28.165939] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T21:05:28.166211] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-27T21:05:28.169205] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-27T21:05:28.169277] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-27T21:05:28.171016] [DEBUG] [LOCAL ] SHEL: Trimmed 77838 records to 53675 (keeping 200 days of data) [2025-10-27T21:05:28.416211] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-27T21:05:28.512228] [DEBUG] [LOCAL ] SHEL: Primary data saved (53675 records). [2025-10-27T21:05:28.512357] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-27T21:05:28.512430] [INFO ] [MAIN ] Update Progress: 1905/2366 symbols completed. SHEL took 36.4s. Estimated remaining: 59m 24s. Rate: 7.8 symbols/min [2025-10-27T21:05:28.676271] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:28.676438] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-27T21:05:28.676474] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-27T21:05:28.676580] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-27T21:05:28.676640] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-27T21:05:28.676729] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-27T21:05:28.676764] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-27T21:05:29.015251] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:29.214986] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-10-27T21:05:29.528346] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:05:29.528708] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-10-27T21:05:29.528794] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:05:29.528840] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-27T21:05:29.528897] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:05:29.528967] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-27T21:05:29.529047] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-27T21:05:29.529083] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-27T21:05:29.529122] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-27T21:05:29.529166] [INFO ] [MAIN ] Update Progress: 1906/2366 symbols completed. SI took 1.0s. Estimated remaining: 59m 14s. Rate: 7.8 symbols/min [2025-10-27T21:05:29.698609] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:29.737743] [DEBUG] [LOCAL ] SID: Loaded 43537 existing records from primary storage. [2025-10-27T21:05:29.738017] [INFO ] [MAIN ] SID: Loaded 43537 existing records. [2025-10-27T21:05:29.910941] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:29.911230] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-27T21:05:29.911283] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-27T21:05:29.911466] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-27T21:05:29.911503] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-27T21:05:30.019606] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-27T21:05:30.262111] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:30.288438] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T21:05:30.511759] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T21:05:30.512967] [INFO ] [REMOTE ] SHOC: Full fetch complete (6669 records). [2025-10-27T21:05:30.513035] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-27T21:05:30.820937] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-27T21:05:30.862700] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-27T21:05:30.862780] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-27T21:05:30.862965] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-27T21:05:30.863028] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-27T21:05:30.863384] [DEBUG] [LOCAL ] SHOC: Trimmed 6669 records to 2916 (keeping 200 days of data) [2025-10-27T21:05:30.882450] [DEBUG] [LOCAL ] SHOC: Primary data saved (2916 records). [2025-10-27T21:05:30.882516] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-27T21:05:30.882582] [INFO ] [MAIN ] Update Progress: 1907/2366 symbols completed. SHOC took 20.0s. Estimated remaining: 59m 5s. Rate: 7.8 symbols/min [2025-10-27T21:05:31.049373] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:31.088725] [DEBUG] [LOCAL ] SIG: Loaded 45788 existing records from primary storage. [2025-10-27T21:05:31.088999] [INFO ] [MAIN ] SIG: Loaded 45788 existing records. [2025-10-27T21:05:31.260595] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:31.260782] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-27T21:05:31.260828] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-27T21:05:31.261036] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-27T21:05:31.261096] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-27T21:05:31.600194] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:31.614896] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-27T21:05:32.414940] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-27T21:05:32.766530] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T21:05:33.061400] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T21:05:33.214951] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-27T21:05:34.015027] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-27T21:05:34.173588] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:05:34.640705] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:05:34.814952] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-27T21:05:35.614934] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-27T21:05:35.671914] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T21:05:36.414934] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-27T21:05:36.675519] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T21:05:37.006917] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T21:05:37.214948] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-27T21:05:37.893714] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T21:05:38.014920] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-27T21:05:38.548261] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T21:05:38.814938] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-27T21:05:39.311374] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T21:05:39.615004] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-27T21:05:40.373303] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:05:40.414896] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-27T21:05:41.214926] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-27T21:05:41.505444] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T21:05:42.014931] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-27T21:05:42.230572] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T21:05:42.814938] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-27T21:05:43.063207] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T21:05:43.614970] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-27T21:05:43.748573] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T21:05:44.107821] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T21:05:44.115973] [INFO ] [REMOTE ] SHO: Full fetch complete (70331 records). [2025-10-27T21:05:44.116125] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-27T21:05:44.116887] [FATAL] [VALIDATOR ] SHO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:05:44.116977] [FATAL] [MAIN ] SHO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:05:44.117020] [WARN ] [MAIN ] SHO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:05:44.117059] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-27T21:05:44.117115] [DEBUG] [LOCAL ] SHO: No primary data file found to delete. [2025-10-27T21:05:44.117149] [INFO ] [LOCAL ] SHO: Starting deletion of derivative data. [2025-10-27T21:05:44.117309] [DEBUG] [LOCAL ] SHO: Deleted derivative data file. [2025-10-27T21:05:44.117401] [INFO ] [MAIN ] Update Progress: 1908/2366 symbols completed. SHO took 39.9s. Estimated remaining: 58m 58s. Rate: 7.8 symbols/min [2025-10-27T21:05:44.286595] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:44.314332] [DEBUG] [LOCAL ] SII: Loaded 24414 existing records from primary storage. [2025-10-27T21:05:44.314665] [INFO ] [MAIN ] SII: Loaded 24414 existing records. [2025-10-27T21:05:44.415960] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-27T21:05:44.499036] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:44.499301] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-27T21:05:44.499358] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-27T21:05:44.499616] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-27T21:05:44.499758] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-27T21:05:44.885967] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:44.888314] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-27T21:05:45.214975] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-27T21:05:45.838503] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T21:05:46.014964] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-27T21:05:46.739430] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T21:05:46.811688] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T21:05:46.814988] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-27T21:05:47.614936] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-27T21:05:48.414955] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-27T21:05:48.750011] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T21:05:49.031279] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T21:05:49.214897] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-27T21:05:49.611197] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T21:05:50.014929] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-27T21:05:50.814960] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-27T21:05:51.109712] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T21:05:51.248177] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-27T21:05:51.615143] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-27T21:05:52.354601] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:05:52.415006] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-27T21:05:53.036354] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:05:53.214969] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-27T21:05:53.985513] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T21:05:54.014942] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-27T21:05:54.045131] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T21:05:54.814993] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-27T21:05:55.447783] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T21:05:55.458461] [INFO ] [REMOTE ] SHW: Full fetch complete (73004 records). [2025-10-27T21:05:55.458707] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-27T21:05:55.460420] [FATAL] [VALIDATOR ] SHW: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:05:55.460737] [FATAL] [MAIN ] SHW: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:05:55.460809] [WARN ] [MAIN ] SHW: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:05:55.460885] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-27T21:05:55.460955] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-10-27T21:05:55.460992] [INFO ] [LOCAL ] SHW: Starting deletion of derivative data. [2025-10-27T21:05:55.461119] [DEBUG] [LOCAL ] SHW: Deleted derivative data file. [2025-10-27T21:05:55.461625] [INFO ] [MAIN ] Update Progress: 1909/2366 symbols completed. SHW took 31.8s. Estimated remaining: 58m 52s. Rate: 7.8 symbols/min [2025-10-27T21:05:55.618207] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-27T21:05:55.645207] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:05:55.674459] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T21:05:55.717967] [DEBUG] [LOCAL ] SILA: Loaded 30192 existing records from primary storage. [2025-10-27T21:05:55.718394] [INFO ] [MAIN ] SILA: Loaded 30192 existing records. [2025-10-27T21:05:55.906298] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:05:55.906614] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-27T21:05:55.906727] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-27T21:05:55.906970] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-27T21:05:55.907016] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-27T21:05:56.279738] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:05:56.414922] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-27T21:05:57.214952] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-27T21:05:57.884261] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T21:05:58.014930] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-27T21:05:58.656348] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:05:58.814907] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-27T21:05:59.130527] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-27T21:05:59.614939] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-27T21:06:00.107579] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T21:06:00.310695] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T21:06:00.414936] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-27T21:06:00.578882] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T21:06:01.214944] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-27T21:06:01.878352] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T21:06:01.887443] [INFO ] [REMOTE ] SID: Full fetch complete (61099 records). [2025-10-27T21:06:01.887595] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-27T21:06:02.020164] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-27T21:06:02.303525] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-27T21:06:02.303616] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-27T21:06:02.304847] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-27T21:06:02.304932] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-27T21:06:02.306306] [DEBUG] [LOCAL ] SID: Trimmed 61099 records to 42838 (keeping 200 days of data) [2025-10-27T21:06:02.565232] [DEBUG] [LOCAL ] SID: Primary data saved (42838 records). [2025-10-27T21:06:02.565360] [INFO ] [MAIN ] SID: Full history saved. [2025-10-27T21:06:02.566062] [INFO ] [MAIN ] Update Progress: 1910/2366 symbols completed. SID took 33.0s. Estimated remaining: 58m 44s. Rate: 7.8 symbols/min [2025-10-27T21:06:02.783208] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:02.818848] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-27T21:06:02.821824] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T21:06:02.867072] [DEBUG] [LOCAL ] SITC: Loaded 42374 existing records from primary storage. [2025-10-27T21:06:02.867403] [INFO ] [MAIN ] SITC: Loaded 42374 existing records. [2025-10-27T21:06:03.066755] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:03.067045] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-27T21:06:03.067121] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-27T21:06:03.067587] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-27T21:06:03.067680] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-27T21:06:03.450791] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:03.452766] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:06:03.614951] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-27T21:06:03.833086] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-27T21:06:04.414936] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-27T21:06:05.004159] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:06:05.214953] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-27T21:06:05.752684] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:06:06.014941] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-27T21:06:06.216543] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-27T21:06:06.814940] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-27T21:06:07.622481] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-27T21:06:07.628112] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T21:06:08.189512] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T21:06:08.414985] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-27T21:06:09.215001] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-27T21:06:09.624558] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T21:06:09.942269] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T21:06:10.014996] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-27T21:06:10.814916] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-27T21:06:10.916190] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T21:06:11.450976] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T21:06:11.614940] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-27T21:06:11.678702] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T21:06:12.414979] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-27T21:06:12.927794] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T21:06:13.214966] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-27T21:06:13.770117] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T21:06:14.014942] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-27T21:06:14.264924] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T21:06:14.814984] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-27T21:06:14.991432] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T21:06:14.996694] [INFO ] [REMOTE ] SII: Full fetch complete (31729 records). [2025-10-27T21:06:14.996796] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-27T21:06:15.367777] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-27T21:06:15.367856] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-27T21:06:15.368487] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-27T21:06:15.368526] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-27T21:06:15.369226] [DEBUG] [LOCAL ] SII: Trimmed 31729 records to 23928 (keeping 200 days of data) [2025-10-27T21:06:15.514148] [DEBUG] [LOCAL ] SII: Primary data saved (23928 records). [2025-10-27T21:06:15.514262] [INFO ] [MAIN ] SII: Full history saved. [2025-10-27T21:06:15.514346] [INFO ] [MAIN ] Update Progress: 1911/2366 symbols completed. SII took 31.4s. Estimated remaining: 58m 37s. Rate: 7.8 symbols/min [2025-10-27T21:06:15.615155] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-27T21:06:15.687511] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:15.722211] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T21:06:15.739823] [DEBUG] [LOCAL ] SITE: Loaded 36005 existing records from primary storage. [2025-10-27T21:06:15.740118] [INFO ] [MAIN ] SITE: Loaded 36005 existing records. [2025-10-27T21:06:15.915832] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:15.916039] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-27T21:06:15.916088] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-27T21:06:15.916268] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-27T21:06:15.916309] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-27T21:06:16.301093] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:16.355613] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T21:06:16.363315] [INFO ] [REMOTE ] SIG: Full fetch complete (67080 records). [2025-10-27T21:06:16.363429] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-27T21:06:16.364190] [FATAL] [VALIDATOR ] SIG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:06:16.364288] [FATAL] [MAIN ] SIG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:06:16.364335] [WARN ] [MAIN ] SIG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:06:16.364373] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-27T21:06:16.364428] [DEBUG] [LOCAL ] SIG: No primary data file found to delete. [2025-10-27T21:06:16.364462] [INFO ] [LOCAL ] SIG: Starting deletion of derivative data. [2025-10-27T21:06:16.364621] [DEBUG] [LOCAL ] SIG: Deleted derivative data file. [2025-10-27T21:06:16.364747] [INFO ] [MAIN ] Update Progress: 1912/2366 symbols completed. SIG took 45.5s. Estimated remaining: 58m 28s. Rate: 7.8 symbols/min [2025-10-27T21:06:16.420168] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-27T21:06:16.537774] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:16.585090] [DEBUG] [LOCAL ] SJM: Loaded 50779 existing records from primary storage. [2025-10-27T21:06:16.585380] [INFO ] [MAIN ] SJM: Loaded 50779 existing records. [2025-10-27T21:06:16.762207] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:16.762381] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-27T21:06:16.762427] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-27T21:06:16.762623] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-27T21:06:16.762711] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-27T21:06:17.107969] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:17.214927] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-27T21:06:17.670512] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T21:06:18.014958] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-27T21:06:18.814944] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-27T21:06:19.431983] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T21:06:19.614978] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-27T21:06:19.813041] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T21:06:19.820387] [INFO ] [REMOTE ] SILA: Full fetch complete (44211 records). [2025-10-27T21:06:19.820514] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-27T21:06:20.122900] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-27T21:06:20.240349] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-27T21:06:20.240432] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-27T21:06:20.241331] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-27T21:06:20.241391] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-27T21:06:20.242261] [DEBUG] [LOCAL ] SILA: Trimmed 44211 records to 29508 (keeping 200 days of data) [2025-10-27T21:06:20.415777] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-27T21:06:20.420172] [DEBUG] [LOCAL ] SILA: Primary data saved (29508 records). [2025-10-27T21:06:20.421239] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-27T21:06:20.421334] [INFO ] [MAIN ] Update Progress: 1913/2366 symbols completed. SILA took 25.0s. Estimated remaining: 58m 19s. Rate: 7.8 symbols/min [2025-10-27T21:06:20.616990] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:20.638179] [DEBUG] [LOCAL ] SJT: Loaded 22871 existing records from primary storage. [2025-10-27T21:06:20.638429] [INFO ] [MAIN ] SJT: Loaded 22871 existing records. [2025-10-27T21:06:20.820196] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:20.820495] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-27T21:06:20.820568] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-27T21:06:20.820972] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-27T21:06:20.821047] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-27T21:06:20.997876] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T21:06:21.206676] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:21.214899] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-27T21:06:21.830815] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T21:06:21.929558] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T21:06:22.014936] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-27T21:06:22.814971] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-27T21:06:23.162242] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T21:06:23.614932] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-27T21:06:24.351372] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T21:06:24.414960] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-27T21:06:24.555094] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T21:06:25.214936] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-27T21:06:25.649091] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T21:06:26.014941] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-27T21:06:26.617253] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T21:06:26.814944] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-27T21:06:27.614916] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-27T21:06:27.716770] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T21:06:28.413681] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T21:06:28.422928] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-27T21:06:28.677419] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-27T21:06:28.988247] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T21:06:28.998592] [INFO ] [REMOTE ] SITC: Full fetch complete (60368 records). [2025-10-27T21:06:28.998798] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-27T21:06:28.999793] [FATAL] [VALIDATOR ] SITC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:06:28.999913] [FATAL] [MAIN ] SITC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:06:28.999967] [WARN ] [MAIN ] SITC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:06:29.000042] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-27T21:06:29.000166] [DEBUG] [LOCAL ] SITC: No primary data file found to delete. [2025-10-27T21:06:29.000218] [INFO ] [LOCAL ] SITC: Starting deletion of derivative data. [2025-10-27T21:06:29.000362] [DEBUG] [LOCAL ] SITC: Deleted derivative data file. [2025-10-27T21:06:29.000456] [INFO ] [MAIN ] Update Progress: 1914/2366 symbols completed. SITC took 26.4s. Estimated remaining: 58m 12s. Rate: 7.8 symbols/min [2025-10-27T21:06:29.193858] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:29.214935] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-27T21:06:29.230269] [DEBUG] [LOCAL ] SKE: Loaded 37860 existing records from primary storage. [2025-10-27T21:06:29.230546] [INFO ] [MAIN ] SKE: Loaded 37860 existing records. [2025-10-27T21:06:29.403764] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:29.403979] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-27T21:06:29.404048] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-27T21:06:29.404223] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-27T21:06:29.404260] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-27T21:06:29.749166] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:30.014934] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-27T21:06:30.295923] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T21:06:30.814942] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-27T21:06:31.339582] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T21:06:31.614935] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-27T21:06:32.241472] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T21:06:32.414929] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-27T21:06:32.544355] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T21:06:33.214953] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-27T21:06:33.755045] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T21:06:34.014993] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-27T21:06:34.347320] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T21:06:34.814922] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-27T21:06:35.614949] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-27T21:06:35.744972] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T21:06:36.188246] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T21:06:36.414964] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-27T21:06:36.512371] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T21:06:37.215003] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-27T21:06:37.801815] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T21:06:38.014995] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-27T21:06:38.802857] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T21:06:38.814895] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-27T21:06:39.178170] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T21:06:39.615022] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-27T21:06:40.414947] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-27T21:06:40.860556] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T21:06:40.930826] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T21:06:41.214988] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-27T21:06:41.862405] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T21:06:42.014951] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-27T21:06:42.820022] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-27T21:06:42.839118] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T21:06:43.344470] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T21:06:43.614927] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-27T21:06:43.907594] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T21:06:44.414942] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-27T21:06:44.491849] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T21:06:44.501102] [INFO ] [REMOTE ] SJM: Full fetch complete (71929 records). [2025-10-27T21:06:44.501250] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-27T21:06:44.501919] [FATAL] [VALIDATOR ] SJM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:06:44.502004] [FATAL] [MAIN ] SJM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:06:44.502045] [WARN ] [MAIN ] SJM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:06:44.502094] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-27T21:06:44.502187] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-10-27T21:06:44.502234] [INFO ] [LOCAL ] SJM: Starting deletion of derivative data. [2025-10-27T21:06:44.502393] [DEBUG] [LOCAL ] SJM: Deleted derivative data file. [2025-10-27T21:06:44.502499] [INFO ] [MAIN ] Update Progress: 1915/2366 symbols completed. SJM took 28.1s. Estimated remaining: 58m 6s. Rate: 7.8 symbols/min [2025-10-27T21:06:44.667887] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:44.677250] [DEBUG] [LOCAL ] SKIL: Loaded 7037 existing records from primary storage. [2025-10-27T21:06:44.677469] [INFO ] [MAIN ] SKIL: Loaded 7037 existing records. [2025-10-27T21:06:44.874496] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:44.874734] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-27T21:06:44.874791] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-27T21:06:44.874940] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-27T21:06:44.874979] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-27T21:06:45.225824] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-27T21:06:45.232379] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:45.521764] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T21:06:46.014983] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-27T21:06:46.738403] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:06:46.814979] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-27T21:06:47.463453] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:06:47.614949] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-27T21:06:48.009282] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T21:06:48.414935] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-27T21:06:49.144141] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T21:06:49.214908] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-27T21:06:49.365255] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T21:06:50.014967] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-27T21:06:50.429999] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:06:50.814909] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-27T21:06:51.296318] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T21:06:51.576906] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T21:06:51.614909] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-27T21:06:52.414919] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-27T21:06:52.762541] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T21:06:52.767280] [INFO ] [REMOTE ] SJT: Full fetch complete (31997 records). [2025-10-27T21:06:52.767371] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-27T21:06:53.108299] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-27T21:06:53.146036] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-27T21:06:53.146120] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-27T21:06:53.146851] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-27T21:06:53.146912] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-27T21:06:53.147761] [DEBUG] [LOCAL ] SJT: Trimmed 31997 records to 22426 (keeping 200 days of data) [2025-10-27T21:06:53.229488] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-27T21:06:53.279415] [DEBUG] [LOCAL ] SJT: Primary data saved (22426 records). [2025-10-27T21:06:53.279577] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-27T21:06:53.279724] [INFO ] [MAIN ] Update Progress: 1916/2366 symbols completed. SJT took 32.9s. Estimated remaining: 57m 58s. Rate: 7.8 symbols/min [2025-10-27T21:06:53.460516] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:06:53.473467] [DEBUG] [LOCAL ] SKLZ: Loaded 11680 existing records from primary storage. [2025-10-27T21:06:53.473723] [INFO ] [MAIN ] SKLZ: Loaded 11680 existing records. [2025-10-27T21:06:53.645282] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:06:53.645492] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-27T21:06:53.645538] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-27T21:06:53.645736] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-27T21:06:53.645792] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-27T21:06:53.988767] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:06:54.014968] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-27T21:06:54.635551] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T21:06:54.814917] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-27T21:06:54.918571] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T21:06:54.928301] [INFO ] [REMOTE ] SKE: Full fetch complete (52711 records). [2025-10-27T21:06:54.928425] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-27T21:06:55.314907] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-27T21:06:55.315013] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-27T21:06:55.315979] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-27T21:06:55.316041] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-27T21:06:55.317137] [DEBUG] [LOCAL ] SKE: Trimmed 52711 records to 37289 (keeping 200 days of data) [2025-10-27T21:06:55.529950] [DEBUG] [LOCAL ] SKE: Primary data saved (37289 records). [2025-10-27T21:06:55.530082] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-27T21:06:55.530610] [INFO ] [MAIN ] Update Progress: 1917/2366 symbols completed. SKE took 26.5s. Estimated remaining: 57m 49s. Rate: 7.8 symbols/min [2025-10-27T21:06:55.571742] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T21:06:55.614903] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-27T21:06:56.414910] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-27T21:06:56.596715] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T21:06:56.920325] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T21:06:57.214930] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-27T21:06:57.788238] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T21:06:58.014924] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-27T21:06:58.814948] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-27T21:06:59.433451] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T21:06:59.441578] [INFO ] [REMOTE ] SITE: Full fetch complete (51049 records). [2025-10-27T21:06:59.441767] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-27T21:06:59.617718] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-27T21:06:59.719507] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-27T21:06:59.842634] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-27T21:06:59.842740] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-27T21:06:59.843686] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-27T21:06:59.843749] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-27T21:06:59.844812] [DEBUG] [LOCAL ] SITE: Trimmed 51049 records to 35349 (keeping 200 days of data) [2025-10-27T21:07:00.061869] [DEBUG] [LOCAL ] SITE: Primary data saved (35349 records). [2025-10-27T21:07:00.062035] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-27T21:07:00.062139] [INFO ] [MAIN ] Update Progress: 1918/2366 symbols completed. SITE took 44.5s. Estimated remaining: 57m 41s. Rate: 7.8 symbols/min [2025-10-27T21:07:00.259108] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-27T21:07:00.414973] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-27T21:07:01.214978] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-27T21:07:01.327702] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T21:07:02.015039] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-27T21:07:02.232305] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T21:07:02.716412] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T21:07:02.815037] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-27T21:07:03.553814] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:07:03.614898] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-27T21:07:04.245578] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T21:07:04.248321] [INFO ] [REMOTE ] SKIL: Full fetch complete (10507 records). [2025-10-27T21:07:04.248390] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-27T21:07:04.421709] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-27T21:07:04.607730] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-27T21:07:04.607810] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-27T21:07:04.608080] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-27T21:07:04.608119] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-27T21:07:04.608535] [DEBUG] [LOCAL ] SKIL: Trimmed 10507 records to 7006 (keeping 200 days of data) [2025-10-27T21:07:04.647782] [DEBUG] [LOCAL ] SKIL: Primary data saved (7006 records). [2025-10-27T21:07:04.647884] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-27T21:07:04.647956] [INFO ] [MAIN ] Update Progress: 1919/2366 symbols completed. SKIL took 20.1s. Estimated remaining: 57m 32s. Rate: 7.8 symbols/min [2025-10-27T21:07:05.162955] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-27T21:07:05.214947] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-27T21:07:05.925070] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-27T21:07:06.014942] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-27T21:07:06.825600] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T21:07:06.828058] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-27T21:07:07.665764] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T21:07:07.669515] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-27T21:07:08.593987] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T21:07:08.597546] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-27T21:07:09.769341] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:07:09.772327] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-27T21:07:10.659294] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T21:07:10.661840] [INFO ] [REMOTE ] SKLZ: Full fetch complete (17598 records). [2025-10-27T21:07:10.661907] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-27T21:07:11.015266] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-27T21:07:11.015338] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-27T21:07:11.015732] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-27T21:07:11.015792] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-27T21:07:11.016274] [DEBUG] [LOCAL ] SKLZ: Trimmed 17598 records to 11398 (keeping 200 days of data) [2025-10-27T21:07:11.083281] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11398 records). [2025-10-27T21:07:11.083495] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-27T21:07:11.083583] [INFO ] [MAIN ] Update Progress: 1920/2366 symbols completed. SKLZ took 17.8s. Estimated remaining: 57m 24s. Rate: 7.8 symbols/min [2025-10-27T21:07:11.616874] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:11.792835] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:11.797214] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:11.818603] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:11.848529] [DEBUG] [LOCAL ] SKYH: Loaded 15911 existing records from primary storage. [2025-10-27T21:07:11.848842] [INFO ] [MAIN ] SKYH: Loaded 15911 existing records. [2025-10-27T21:07:11.977023] [DEBUG] [LOCAL ] SKT: Loaded 42760 existing records from primary storage. [2025-10-27T21:07:12.015454] [DEBUG] [LOCAL ] SKM: Loaded 35723 existing records from primary storage. [2025-10-27T21:07:12.015924] [INFO ] [MAIN ] SKM: Loaded 35723 existing records. [2025-10-27T21:07:12.015738] [INFO ] [MAIN ] SKT: Loaded 42760 existing records. [2025-10-27T21:07:12.128233] [DEBUG] [LOCAL ] SKY: Loaded 39089 existing records from primary storage. [2025-10-27T21:07:12.301227] [INFO ] [MAIN ] SKY: Loaded 39089 existing records. [2025-10-27T21:07:12.295932] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:12.321560] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-27T21:07:12.338083] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-27T21:07:12.436384] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-27T21:07:12.552994] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:12.480277] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-27T21:07:12.619727] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-27T21:07:12.645082] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-27T21:07:12.680161] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:12.692615] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-27T21:07:12.717679] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-27T21:07:12.718688] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-27T21:07:12.761272] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:12.779615] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-27T21:07:12.822022] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-27T21:07:12.822343] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-27T21:07:12.844402] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-27T21:07:12.839183] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-27T21:07:12.886764] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-27T21:07:12.902879] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-27T21:07:13.955025] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:14.084693] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-27T21:07:14.163068] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:14.169015] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:14.202934] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-27T21:07:14.200226] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-27T21:07:14.234340] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:14.234807] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-27T21:07:15.210882] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T21:07:15.213925] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-27T21:07:15.325707] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:07:15.333277] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-27T21:07:15.372438] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T21:07:15.378354] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-27T21:07:15.487032] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T21:07:15.614951] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-27T21:07:15.835380] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T21:07:16.414967] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-27T21:07:16.622491] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T21:07:16.760934] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T21:07:17.014475] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T21:07:17.214951] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-27T21:07:17.237890] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T21:07:18.014922] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-27T21:07:18.630515] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T21:07:18.814943] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-27T21:07:19.169925] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T21:07:19.614942] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-27T21:07:20.055689] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T21:07:20.414962] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-27T21:07:20.604466] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:07:21.214944] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-27T21:07:21.580363] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T21:07:21.934859] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T21:07:22.014923] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-27T21:07:22.814940] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-27T21:07:23.557516] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:07:23.614932] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-27T21:07:24.171048] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:07:24.414931] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-27T21:07:25.214935] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-27T21:07:25.647585] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T21:07:25.888851] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T21:07:25.936335] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T21:07:26.014920] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-27T21:07:26.814942] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-27T21:07:27.025207] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T21:07:27.556965] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-27T21:07:27.614912] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-27T21:07:28.414941] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-27T21:07:29.103111] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:07:29.214925] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-27T21:07:29.865780] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T21:07:30.014939] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-27T21:07:30.334497] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:07:30.814934] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-27T21:07:31.067996] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-27T21:07:31.614914] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-27T21:07:31.760360] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T21:07:32.241128] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T21:07:32.414941] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-27T21:07:32.793820] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T21:07:32.799837] [INFO ] [REMOTE ] SKYH: Full fetch complete (22408 records). [2025-10-27T21:07:32.800105] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-27T21:07:33.216218] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-27T21:07:33.251730] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-27T21:07:33.251820] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-27T21:07:33.252396] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-27T21:07:33.252438] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-27T21:07:33.253170] [DEBUG] [LOCAL ] SKYH: Trimmed 22408 records to 15393 (keeping 200 days of data) [2025-10-27T21:07:33.344753] [DEBUG] [LOCAL ] SKYH: Primary data saved (15393 records). [2025-10-27T21:07:33.344919] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-27T21:07:33.344998] [INFO ] [MAIN ] Update Progress: 1921/2366 symbols completed. SKYH took 22.2s. Estimated remaining: 57m 20s. Rate: 7.8 symbols/min [2025-10-27T21:07:33.526852] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:33.527042] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-27T21:07:33.527089] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-27T21:07:33.527221] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-27T21:07:33.527273] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-27T21:07:33.527325] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-27T21:07:33.527365] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-27T21:07:33.883965] [INFO ] [REMOTE ] SLAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:34.014937] [INFO ] [REMOTE ] SLAI: Fetching primary data for 2025-01. [2025-10-27T21:07:34.297433] [DEBUG] [REMOTE ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:07:34.297772] [WARN ] [REMOTE ] SLAI: No data returned for month 2025-01 [2025-10-27T21:07:34.297859] [FATAL] [REMOTE ] SLAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:07:34.297904] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-27T21:07:34.297936] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:07:34.297972] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-27T21:07:34.298040] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-27T21:07:34.298075] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-27T21:07:34.298113] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-27T21:07:34.298158] [INFO ] [MAIN ] Update Progress: 1922/2366 symbols completed. SLAI took 1.0s. Estimated remaining: 57m 11s. Rate: 7.8 symbols/min [2025-10-27T21:07:34.466195] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:34.515160] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-10-27T21:07:34.515469] [INFO ] [MAIN ] SLB: Loaded 54477 existing records. [2025-10-27T21:07:34.696660] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:34.696977] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-27T21:07:34.697034] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-27T21:07:34.697271] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-27T21:07:34.697327] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-27T21:07:34.820039] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-27T21:07:35.067215] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:35.076475] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T21:07:35.615039] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-27T21:07:36.020370] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T21:07:36.414975] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-27T21:07:36.877132] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T21:07:37.215010] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-27T21:07:37.990955] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T21:07:38.014904] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-27T21:07:38.563991] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T21:07:38.570967] [INFO ] [REMOTE ] SKM: Full fetch complete (49562 records). [2025-10-27T21:07:38.571087] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-27T21:07:38.825022] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-27T21:07:38.953388] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-27T21:07:38.953466] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-27T21:07:38.954374] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-27T21:07:38.954434] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-27T21:07:38.955558] [DEBUG] [LOCAL ] SKM: Trimmed 49562 records to 35082 (keeping 200 days of data) [2025-10-27T21:07:39.166242] [DEBUG] [LOCAL ] SKM: Primary data saved (35082 records). [2025-10-27T21:07:39.166381] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-27T21:07:39.166463] [INFO ] [MAIN ] Update Progress: 1923/2366 symbols completed. SKM took 28.1s. Estimated remaining: 57m 2s. Rate: 7.8 symbols/min [2025-10-27T21:07:39.335287] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:39.368505] [DEBUG] [LOCAL ] SLF: Loaded 38710 existing records from primary storage. [2025-10-27T21:07:39.368792] [INFO ] [MAIN ] SLF: Loaded 38710 existing records. [2025-10-27T21:07:39.549208] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:39.549533] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-27T21:07:39.549611] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-27T21:07:39.549968] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-27T21:07:39.550066] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-27T21:07:39.619066] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-27T21:07:39.838615] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T21:07:39.958776] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:40.413135] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:07:40.421610] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-27T21:07:41.122802] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T21:07:41.215000] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-27T21:07:41.488685] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:07:42.014959] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-27T21:07:42.635823] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T21:07:42.643574] [INFO ] [REMOTE ] SKT: Full fetch complete (60422 records). [2025-10-27T21:07:42.643773] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-27T21:07:42.644526] [FATAL] [VALIDATOR ] SKT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:07:42.644611] [FATAL] [MAIN ] SKT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:07:42.644698] [WARN ] [MAIN ] SKT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:07:42.644781] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-27T21:07:42.644845] [DEBUG] [LOCAL ] SKT: No primary data file found to delete. [2025-10-27T21:07:42.644882] [INFO ] [LOCAL ] SKT: Starting deletion of derivative data. [2025-10-27T21:07:42.645021] [DEBUG] [LOCAL ] SKT: Deleted derivative data file. [2025-10-27T21:07:42.645109] [INFO ] [MAIN ] Update Progress: 1924/2366 symbols completed. SKT took 31.6s. Estimated remaining: 56m 54s. Rate: 7.8 symbols/min [2025-10-27T21:07:42.818679] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-27T21:07:42.822027] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:42.863799] [DEBUG] [LOCAL ] SLG: Loaded 46485 existing records from primary storage. [2025-10-27T21:07:42.864126] [INFO ] [MAIN ] SLG: Loaded 46485 existing records. [2025-10-27T21:07:43.056421] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:43.074866] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-27T21:07:43.074967] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-27T21:07:43.076567] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-27T21:07:43.076524] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T21:07:43.076748] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-27T21:07:43.426435] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:43.614966] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-27T21:07:44.310807] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T21:07:44.414955] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-27T21:07:44.922391] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T21:07:45.214926] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-27T21:07:45.682615] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T21:07:46.014937] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-27T21:07:46.814961] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-27T21:07:47.448480] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-27T21:07:47.584120] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T21:07:47.614911] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-27T21:07:48.078842] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T21:07:48.414948] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-27T21:07:48.847427] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T21:07:49.214938] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-27T21:07:50.014917] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-27T21:07:50.327840] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-27T21:07:50.445393] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T21:07:50.814949] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-27T21:07:51.295819] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T21:07:51.303140] [INFO ] [REMOTE ] SKY: Full fetch complete (53973 records). [2025-10-27T21:07:51.303250] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-27T21:07:51.303852] [FATAL] [VALIDATOR ] SKY: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:07:51.303942] [FATAL] [MAIN ] SKY: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:07:51.303984] [WARN ] [MAIN ] SKY: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:07:51.304020] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-27T21:07:51.304075] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-27T21:07:51.304108] [INFO ] [LOCAL ] SKY: Starting deletion of derivative data. [2025-10-27T21:07:51.304228] [DEBUG] [LOCAL ] SKY: Deleted derivative data file. [2025-10-27T21:07:51.304294] [INFO ] [MAIN ] Update Progress: 1925/2366 symbols completed. SKY took 40.2s. Estimated remaining: 56m 46s. Rate: 7.8 symbols/min [2025-10-27T21:07:51.468682] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:07:51.504971] [DEBUG] [LOCAL ] SLGN: Loaded 41649 existing records from primary storage. [2025-10-27T21:07:51.505255] [INFO ] [MAIN ] SLGN: Loaded 41649 existing records. [2025-10-27T21:07:51.620144] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-27T21:07:51.680118] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:07:51.680302] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-27T21:07:51.680349] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-27T21:07:51.680578] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-27T21:07:51.680615] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-27T21:07:52.040064] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:07:52.081264] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-27T21:07:52.414939] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-27T21:07:52.910131] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T21:07:53.214975] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-27T21:07:53.819678] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T21:07:54.015018] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-27T21:07:54.814997] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-27T21:07:55.382444] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-27T21:07:55.516980] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T21:07:55.614931] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-27T21:07:55.954527] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T21:07:56.414986] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-27T21:07:57.133009] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:07:57.214911] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-27T21:07:57.743263] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:07:58.014946] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-27T21:07:58.814910] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-27T21:07:58.899952] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T21:07:59.513764] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-27T21:07:59.614928] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-27T21:08:00.179040] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T21:08:00.414950] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-27T21:08:01.214956] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-27T21:08:01.327510] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:08:02.001265] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:08:02.014905] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-27T21:08:02.814977] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-27T21:08:03.004620] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T21:08:03.470717] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-27T21:08:03.477326] [INFO ] [REMOTE ] SLF: Full fetch complete (56105 records). [2025-10-27T21:08:03.477476] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-27T21:08:03.620020] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-27T21:08:03.867746] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-27T21:08:03.867831] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-27T21:08:03.868775] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-27T21:08:03.868839] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-27T21:08:03.869964] [DEBUG] [LOCAL ] SLF: Trimmed 56105 records to 37845 (keeping 200 days of data) [2025-10-27T21:08:04.100458] [DEBUG] [LOCAL ] SLF: Primary data saved (37845 records). [2025-10-27T21:08:04.100889] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-27T21:08:04.101683] [INFO ] [MAIN ] Update Progress: 1926/2366 symbols completed. SLF took 24.9s. Estimated remaining: 56m 40s. Rate: 7.8 symbols/min [2025-10-27T21:08:04.273560] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:04.273776] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-27T21:08:04.273917] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-27T21:08:04.274045] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-27T21:08:04.274112] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-27T21:08:04.274259] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-27T21:08:04.274358] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-27T21:08:04.406714] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:08:04.415660] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-27T21:08:04.667588] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:04.849119] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T21:08:05.214992] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-27T21:08:06.014963] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-27T21:08:06.083629] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T21:08:06.388989] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T21:08:06.771034] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T21:08:06.814911] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-27T21:08:07.614944] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-27T21:08:08.007617] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:08:08.414940] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-27T21:08:08.877172] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T21:08:09.214916] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-27T21:08:09.352678] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:08:09.755163] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T21:08:09.764944] [INFO ] [REMOTE ] SLB: Full fetch complete (77487 records). [2025-10-27T21:08:09.765068] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-27T21:08:09.765872] [FATAL] [VALIDATOR ] SLB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:08:09.765961] [FATAL] [MAIN ] SLB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:08:09.766002] [WARN ] [MAIN ] SLB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:08:09.766041] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-27T21:08:09.766095] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-27T21:08:09.766128] [INFO ] [LOCAL ] SLB: Starting deletion of derivative data. [2025-10-27T21:08:09.766278] [DEBUG] [LOCAL ] SLB: Deleted derivative data file. [2025-10-27T21:08:09.766607] [INFO ] [MAIN ] Update Progress: 1927/2366 symbols completed. SLB took 35.5s. Estimated remaining: 56m 31s. Rate: 7.8 symbols/min [2025-10-27T21:08:09.932633] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:09.973435] [DEBUG] [LOCAL ] SLQT: Loaded 43908 existing records from primary storage. [2025-10-27T21:08:09.973753] [INFO ] [MAIN ] SLQT: Loaded 43908 existing records. [2025-10-27T21:08:10.020114] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-27T21:08:10.154260] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:10.154473] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-27T21:08:10.154528] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-27T21:08:10.154736] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-27T21:08:10.154791] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-27T21:08:10.545484] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:10.814993] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-27T21:08:11.235226] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-27T21:08:11.490066] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:08:11.614916] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-27T21:08:12.414917] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-27T21:08:13.119248] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T21:08:13.214918] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-27T21:08:13.847416] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T21:08:14.014940] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-27T21:08:14.564893] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T21:08:14.814988] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-27T21:08:15.244924] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T21:08:15.445069] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-27T21:08:15.614965] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-27T21:08:16.414955] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-27T21:08:17.138063] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T21:08:17.214925] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-27T21:08:17.303963] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T21:08:17.313380] [INFO ] [REMOTE ] SLG: Full fetch complete (64958 records). [2025-10-27T21:08:17.313534] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-27T21:08:17.314355] [FATAL] [VALIDATOR ] SLG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:08:17.314454] [FATAL] [MAIN ] SLG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:08:17.314496] [WARN ] [MAIN ] SLG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:08:17.314561] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-27T21:08:17.314626] [DEBUG] [LOCAL ] SLG: No primary data file found to delete. [2025-10-27T21:08:17.314696] [INFO ] [LOCAL ] SLG: Starting deletion of derivative data. [2025-10-27T21:08:17.314824] [DEBUG] [LOCAL ] SLG: Deleted derivative data file. [2025-10-27T21:08:17.314893] [INFO ] [MAIN ] Update Progress: 1928/2366 symbols completed. SLG took 34.7s. Estimated remaining: 56m 24s. Rate: 7.8 symbols/min [2025-10-27T21:08:17.499850] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:17.528166] [DEBUG] [LOCAL ] SLVM: Loaded 28055 existing records from primary storage. [2025-10-27T21:08:17.528433] [INFO ] [MAIN ] SLVM: Loaded 28055 existing records. [2025-10-27T21:08:17.709297] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:17.709514] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-27T21:08:17.709574] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-27T21:08:17.709769] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-27T21:08:17.709826] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-27T21:08:18.023403] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-27T21:08:18.063462] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:18.421772] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-27T21:08:18.659878] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:08:18.814975] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-27T21:08:19.614952] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-27T21:08:20.368722] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T21:08:20.414965] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-27T21:08:20.826991] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T21:08:21.214941] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-27T21:08:21.503473] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T21:08:21.689893] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T21:08:21.698416] [INFO ] [REMOTE ] SLGN: Full fetch complete (59197 records). [2025-10-27T21:08:21.698552] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-27T21:08:21.699323] [FATAL] [VALIDATOR ] SLGN: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:08:21.699407] [FATAL] [MAIN ] SLGN: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:08:21.699450] [WARN ] [MAIN ] SLGN: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:08:21.699514] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-27T21:08:21.699577] [DEBUG] [LOCAL ] SLGN: No primary data file found to delete. [2025-10-27T21:08:21.699610] [INFO ] [LOCAL ] SLGN: Starting deletion of derivative data. [2025-10-27T21:08:21.699768] [DEBUG] [LOCAL ] SLGN: Deleted derivative data file. [2025-10-27T21:08:21.699870] [INFO ] [MAIN ] Update Progress: 1929/2366 symbols completed. SLGN took 30.4s. Estimated remaining: 56m 15s. Rate: 7.8 symbols/min [2025-10-27T21:08:21.866759] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:21.913285] [DEBUG] [LOCAL ] SM: Loaded 53126 existing records from primary storage. [2025-10-27T21:08:21.913603] [INFO ] [MAIN ] SM: Loaded 53126 existing records. [2025-10-27T21:08:22.020058] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-27T21:08:22.092736] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:22.092941] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-27T21:08:22.092988] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-27T21:08:22.093198] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-27T21:08:22.093256] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-27T21:08:22.492710] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:22.814948] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-27T21:08:23.422113] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T21:08:23.614995] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-27T21:08:24.046532] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T21:08:24.414959] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-27T21:08:24.788926] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T21:08:24.872932] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T21:08:25.214946] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-27T21:08:26.014989] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-27T21:08:26.814926] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-27T21:08:26.877279] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-27T21:08:27.023072] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T21:08:27.614959] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-27T21:08:27.784059] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T21:08:28.059965] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:08:28.414944] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-27T21:08:29.214935] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-27T21:08:30.006039] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-27T21:08:30.015488] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-27T21:08:30.411692] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:08:30.814931] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-27T21:08:31.184455] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-27T21:08:31.283978] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T21:08:31.614925] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-27T21:08:32.161532] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T21:08:32.415018] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-27T21:08:33.214987] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-27T21:08:33.283467] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T21:08:34.014961] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-27T21:08:34.475888] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T21:08:34.814936] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-27T21:08:34.985762] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:08:35.248822] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:08:35.249541] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1053 records). [2025-10-27T21:08:35.249608] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-27T21:08:35.426492] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T21:08:35.426684] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:08:35.426753] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:08:35.426824] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-27T21:08:35.426899] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-27T21:08:35.426953] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-27T21:08:35.426995] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-27T21:08:35.427049] [INFO ] [MAIN ] Update Progress: 1930/2366 symbols completed. SLNZ took 31.3s. Estimated remaining: 56m 9s. Rate: 7.8 symbols/min [2025-10-27T21:08:35.594293] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:35.594428] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-27T21:08:35.594465] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-27T21:08:35.594573] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-27T21:08:35.594613] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-27T21:08:35.594681] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-27T21:08:35.594731] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-27T21:08:35.623007] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-27T21:08:35.941791] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:36.414994] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-27T21:08:37.214950] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-27T21:08:37.401323] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T21:08:37.466684] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T21:08:38.014988] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-27T21:08:38.228804] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:08:38.814973] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-27T21:08:39.614931] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-10-27T21:08:39.655161] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:08:39.885900] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T21:08:39.939748] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:08:39.940055] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-10-27T21:08:39.940142] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:08:39.940189] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-27T21:08:39.940249] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:08:39.940319] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-27T21:08:39.940380] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-27T21:08:39.940415] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-27T21:08:39.940454] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-27T21:08:39.940500] [INFO ] [MAIN ] Update Progress: 1931/2366 symbols completed. SMA took 4.5s. Estimated remaining: 56m 0s. Rate: 7.8 symbols/min [2025-10-27T21:08:40.110199] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:40.120955] [DEBUG] [LOCAL ] SMBK: Loaded 8404 existing records from primary storage. [2025-10-27T21:08:40.121200] [INFO ] [MAIN ] SMBK: Loaded 8404 existing records. [2025-10-27T21:08:40.296730] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:40.296969] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-27T21:08:40.297016] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-27T21:08:40.297191] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-27T21:08:40.297228] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-27T21:08:40.420082] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-27T21:08:40.652475] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:41.214995] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-27T21:08:41.852548] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:08:42.014972] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-27T21:08:42.422174] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T21:08:42.430682] [INFO ] [REMOTE ] SLQT: Full fetch complete (63599 records). [2025-10-27T21:08:42.430806] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-27T21:08:42.811292] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-27T21:08:42.811374] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-27T21:08:42.812455] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-27T21:08:42.812517] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-27T21:08:42.813703] [DEBUG] [LOCAL ] SLQT: Trimmed 63599 records to 43116 (keeping 200 days of data) [2025-10-27T21:08:42.814935] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-27T21:08:43.054888] [DEBUG] [LOCAL ] SLQT: Primary data saved (43116 records). [2025-10-27T21:08:43.055072] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-27T21:08:43.055546] [INFO ] [MAIN ] Update Progress: 1932/2366 symbols completed. SLQT took 33.3s. Estimated remaining: 55m 52s. Rate: 7.8 symbols/min [2025-10-27T21:08:43.230379] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:43.243809] [DEBUG] [LOCAL ] SMC: Loaded 11019 existing records from primary storage. [2025-10-27T21:08:43.244030] [INFO ] [MAIN ] SMC: Loaded 11019 existing records. [2025-10-27T21:08:43.371468] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T21:08:43.450852] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:43.451088] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-27T21:08:43.451138] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-27T21:08:43.451324] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-27T21:08:43.451381] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-27T21:08:43.629568] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-27T21:08:43.825069] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:44.268374] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T21:08:44.273889] [INFO ] [REMOTE ] SLVM: Full fetch complete (39884 records). [2025-10-27T21:08:44.274061] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-27T21:08:44.274694] [FATAL] [VALIDATOR ] SLVM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:08:44.274777] [FATAL] [MAIN ] SLVM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:08:44.274820] [WARN ] [MAIN ] SLVM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:08:44.274866] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-27T21:08:44.274930] [DEBUG] [LOCAL ] SLVM: No primary data file found to delete. [2025-10-27T21:08:44.274967] [INFO ] [LOCAL ] SLVM: Starting deletion of derivative data. [2025-10-27T21:08:44.275116] [DEBUG] [LOCAL ] SLVM: Deleted derivative data file. [2025-10-27T21:08:44.275203] [INFO ] [MAIN ] Update Progress: 1933/2366 symbols completed. SLVM took 27.0s. Estimated remaining: 55m 42s. Rate: 7.8 symbols/min [2025-10-27T21:08:44.427879] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-27T21:08:44.462695] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:08:44.505502] [DEBUG] [LOCAL ] SMFG: Loaded 48970 existing records from primary storage. [2025-10-27T21:08:44.505871] [INFO ] [MAIN ] SMFG: Loaded 48970 existing records. [2025-10-27T21:08:44.686135] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:08:44.686326] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-27T21:08:44.686372] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-27T21:08:44.686911] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-27T21:08:44.686967] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-27T21:08:45.054693] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:08:45.082183] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T21:08:45.214908] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-27T21:08:45.473851] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T21:08:46.014959] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-27T21:08:46.814919] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-27T21:08:46.938132] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T21:08:46.937850] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T21:08:47.614936] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-27T21:08:48.218601] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T21:08:48.251446] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T21:08:48.414929] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-27T21:08:49.091953] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T21:08:49.214937] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-27T21:08:50.014951] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-27T21:08:50.093093] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T21:08:50.717063] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T21:08:50.814916] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-27T21:08:51.565302] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T21:08:51.614910] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-27T21:08:52.414976] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-27T21:08:53.071857] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T21:08:53.214931] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-27T21:08:53.777205] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T21:08:54.014934] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-27T21:08:54.078501] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T21:08:54.814937] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-27T21:08:55.618639] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-27T21:08:55.623746] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T21:08:56.272361] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T21:08:56.414966] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-27T21:08:56.781077] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-27T21:08:57.214951] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-27T21:08:57.788687] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T21:08:58.015002] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-27T21:08:58.303910] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T21:08:58.814955] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-27T21:08:58.837075] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T21:08:59.614931] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-27T21:09:00.414937] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-27T21:09:00.452324] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T21:09:00.462114] [INFO ] [REMOTE ] SM: Full fetch complete (75556 records). [2025-10-27T21:09:00.462250] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-27T21:09:00.463114] [FATAL] [VALIDATOR ] SM: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:09:00.463203] [FATAL] [MAIN ] SM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:09:00.463247] [WARN ] [MAIN ] SM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:09:00.463307] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-27T21:09:00.463363] [DEBUG] [LOCAL ] SM: No primary data file found to delete. [2025-10-27T21:09:00.463396] [INFO ] [LOCAL ] SM: Starting deletion of derivative data. [2025-10-27T21:09:00.463514] [DEBUG] [LOCAL ] SM: Deleted derivative data file. [2025-10-27T21:09:00.463583] [INFO ] [MAIN ] Update Progress: 1934/2366 symbols completed. SM took 38.8s. Estimated remaining: 55m 37s. Rate: 7.8 symbols/min [2025-10-27T21:09:00.647287] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:00.685631] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T21:09:00.734259] [DEBUG] [LOCAL ] SMG: Loaded 43177 existing records from primary storage. [2025-10-27T21:09:00.734684] [INFO ] [MAIN ] SMG: Loaded 43177 existing records. [2025-10-27T21:09:00.923441] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:00.923772] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-27T21:09:00.923832] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-27T21:09:00.924380] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-27T21:09:00.924438] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-27T21:09:01.219752] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-27T21:09:01.315734] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:01.317077] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-27T21:09:02.014979] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-27T21:09:02.628987] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:09:02.814959] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-27T21:09:03.419472] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T21:09:03.614923] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-27T21:09:03.650403] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T21:09:04.391099] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T21:09:04.414920] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-27T21:09:05.214983] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-27T21:09:05.276095] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-27T21:09:06.014965] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-27T21:09:06.765102] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T21:09:06.814974] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-27T21:09:07.322243] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-27T21:09:07.364353] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T21:09:07.614955] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-27T21:09:08.414943] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-27T21:09:09.039456] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:09:09.100144] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T21:09:09.214905] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-27T21:09:10.014992] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-27T21:09:10.794021] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T21:09:10.814895] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-27T21:09:11.614949] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-27T21:09:11.974328] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-27T21:09:12.274347] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T21:09:12.276699] [INFO ] [REMOTE ] SMBK: Full fetch complete (11840 records). [2025-10-27T21:09:12.276768] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-27T21:09:12.421207] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-27T21:09:12.658350] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-27T21:09:12.658470] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-27T21:09:12.658804] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-27T21:09:12.658866] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-27T21:09:12.659385] [DEBUG] [LOCAL ] SMBK: Trimmed 11840 records to 8191 (keeping 200 days of data) [2025-10-27T21:09:12.713880] [DEBUG] [LOCAL ] SMBK: Primary data saved (8191 records). [2025-10-27T21:09:12.714026] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-27T21:09:12.714209] [INFO ] [MAIN ] Update Progress: 1935/2366 symbols completed. SMBK took 32.8s. Estimated remaining: 55m 30s. Rate: 7.8 symbols/min [2025-10-27T21:09:12.866706] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T21:09:12.928591] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:12.942812] [DEBUG] [LOCAL ] SMHI: Loaded 12759 existing records from primary storage. [2025-10-27T21:09:12.943042] [INFO ] [MAIN ] SMHI: Loaded 12759 existing records. [2025-10-27T21:09:13.118389] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:13.118598] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-27T21:09:13.118665] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-27T21:09:13.118846] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-27T21:09:13.118885] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-27T21:09:13.215156] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-27T21:09:13.462608] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:14.014914] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-27T21:09:14.135108] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T21:09:14.442021] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T21:09:14.745129] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T21:09:14.814974] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-27T21:09:15.543124] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T21:09:15.546492] [INFO ] [REMOTE ] SMC: Full fetch complete (16452 records). [2025-10-27T21:09:15.546590] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-27T21:09:15.620161] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-27T21:09:15.960519] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-27T21:09:15.960626] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-27T21:09:15.961227] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-27T21:09:15.961281] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-27T21:09:15.962109] [DEBUG] [LOCAL ] SMC: Trimmed 16452 records to 10460 (keeping 200 days of data) [2025-10-27T21:09:16.027332] [DEBUG] [LOCAL ] SMC: Primary data saved (10460 records). [2025-10-27T21:09:16.027524] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-27T21:09:16.027620] [INFO ] [MAIN ] Update Progress: 1936/2366 symbols completed. SMC took 33.0s. Estimated remaining: 55m 21s. Rate: 7.8 symbols/min [2025-10-27T21:09:16.216004] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:16.236999] [DEBUG] [LOCAL ] SMP: Loaded 18950 existing records from primary storage. [2025-10-27T21:09:16.237409] [INFO ] [MAIN ] SMP: Loaded 18950 existing records. [2025-10-27T21:09:16.425909] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-27T21:09:16.432631] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:16.433259] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-27T21:09:16.434342] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-27T21:09:16.434699] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-27T21:09:16.445322] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-27T21:09:16.446499] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T21:09:16.801700] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:17.215002] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-27T21:09:17.651398] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T21:09:18.014971] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-27T21:09:18.324273] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T21:09:18.814914] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-27T21:09:19.341619] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T21:09:19.350755] [INFO ] [REMOTE ] SMFG: Full fetch complete (69295 records). [2025-10-27T21:09:19.350863] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-27T21:09:19.620100] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-27T21:09:19.738147] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-27T21:09:19.738224] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-27T21:09:19.739290] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-27T21:09:19.739353] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-27T21:09:19.740678] [DEBUG] [LOCAL ] SMFG: Trimmed 69295 records to 48106 (keeping 200 days of data) [2025-10-27T21:09:20.015587] [DEBUG] [LOCAL ] SMFG: Primary data saved (48106 records). [2025-10-27T21:09:20.015724] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-27T21:09:20.015812] [INFO ] [MAIN ] Update Progress: 1937/2366 symbols completed. SMFG took 35.7s. Estimated remaining: 55m 13s. Rate: 7.8 symbols/min [2025-10-27T21:09:20.184705] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:20.233007] [DEBUG] [LOCAL ] SMR: Loaded 54579 existing records from primary storage. [2025-10-27T21:09:20.233295] [INFO ] [MAIN ] SMR: Loaded 54579 existing records. [2025-10-27T21:09:20.419935] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-27T21:09:20.442600] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T21:09:20.440873] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:20.452375] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-27T21:09:20.460330] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T21:09:20.460088] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-27T21:09:20.463724] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-27T21:09:20.463781] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-27T21:09:20.809911] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:21.210078] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T21:09:21.214981] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-27T21:09:21.869390] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T21:09:22.014934] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-27T21:09:22.644865] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T21:09:22.814988] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-27T21:09:23.411122] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T21:09:23.614953] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-27T21:09:24.414948] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-27T21:09:25.214920] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-27T21:09:25.434485] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:09:25.652025] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-27T21:09:25.909692] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T21:09:26.014971] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-27T21:09:26.814980] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-27T21:09:27.468195] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:09:27.614984] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-27T21:09:28.414937] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-27T21:09:28.703310] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-27T21:09:29.093401] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T21:09:29.214935] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-27T21:09:29.407576] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T21:09:30.014964] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-27T21:09:30.045469] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T21:09:30.053987] [INFO ] [REMOTE ] SMG: Full fetch complete (62449 records). [2025-10-27T21:09:30.054158] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-27T21:09:30.055102] [FATAL] [VALIDATOR ] SMG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:09:30.055199] [FATAL] [MAIN ] SMG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:09:30.055276] [WARN ] [MAIN ] SMG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:09:30.055360] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-27T21:09:30.055426] [DEBUG] [LOCAL ] SMG: No primary data file found to delete. [2025-10-27T21:09:30.055463] [INFO ] [LOCAL ] SMG: Starting deletion of derivative data. [2025-10-27T21:09:30.055694] [DEBUG] [LOCAL ] SMG: Deleted derivative data file. [2025-10-27T21:09:30.055821] [INFO ] [MAIN ] Update Progress: 1938/2366 symbols completed. SMG took 29.6s. Estimated remaining: 55m 5s. Rate: 7.8 symbols/min [2025-10-27T21:09:30.290855] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:30.350787] [DEBUG] [LOCAL ] SMRT: Loaded 44278 existing records from primary storage. [2025-10-27T21:09:30.351410] [INFO ] [MAIN ] SMRT: Loaded 44278 existing records. [2025-10-27T21:09:30.550498] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:30.550805] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-27T21:09:30.550864] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-27T21:09:30.551474] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-27T21:09:30.551533] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-27T21:09:30.750329] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:09:30.818866] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-27T21:09:30.939715] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:31.614952] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-27T21:09:32.164440] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T21:09:32.414968] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-27T21:09:32.953802] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T21:09:32.955830] [INFO ] [REMOTE ] SMHI: Full fetch complete (20894 records). [2025-10-27T21:09:32.955899] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-27T21:09:33.223921] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-27T21:09:33.315619] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-27T21:09:33.315718] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-27T21:09:33.316156] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-27T21:09:33.316193] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-27T21:09:33.316753] [DEBUG] [LOCAL ] SMHI: Trimmed 20894 records to 12130 (keeping 200 days of data) [2025-10-27T21:09:33.381873] [DEBUG] [LOCAL ] SMHI: Primary data saved (12130 records). [2025-10-27T21:09:33.381989] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-27T21:09:33.382064] [INFO ] [MAIN ] Update Progress: 1939/2366 symbols completed. SMHI took 20.7s. Estimated remaining: 54m 57s. Rate: 7.8 symbols/min [2025-10-27T21:09:33.551537] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:33.581106] [DEBUG] [LOCAL ] SMWB: Loaded 31857 existing records from primary storage. [2025-10-27T21:09:33.581385] [INFO ] [MAIN ] SMWB: Loaded 31857 existing records. [2025-10-27T21:09:33.779742] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:33.797285] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-27T21:09:33.807209] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-27T21:09:33.807418] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-27T21:09:33.807838] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-27T21:09:33.808746] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T21:09:34.020726] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-27T21:09:34.180519] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:34.630953] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T21:09:34.814957] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-27T21:09:35.013853] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T21:09:35.614956] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-27T21:09:35.950288] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:09:36.415004] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-27T21:09:36.701126] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T21:09:37.214943] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-27T21:09:37.942202] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T21:09:38.014908] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-27T21:09:38.815069] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-27T21:09:38.820097] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-27T21:09:39.205404] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T21:09:39.615005] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-27T21:09:39.937561] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T21:09:40.415002] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-27T21:09:40.827874] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T21:09:41.215007] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-27T21:09:41.792296] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T21:09:42.015021] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-27T21:09:42.279953] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-27T21:09:42.814958] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-27T21:09:43.520432] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T21:09:43.575927] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T21:09:43.579571] [INFO ] [REMOTE ] SMP: Full fetch complete (26580 records). [2025-10-27T21:09:43.579689] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-27T21:09:43.580203] [FATAL] [VALIDATOR ] SMP: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:09:43.580293] [FATAL] [MAIN ] SMP: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:09:43.580335] [WARN ] [MAIN ] SMP: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:09:43.580372] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-27T21:09:43.580427] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-27T21:09:43.580462] [INFO ] [LOCAL ] SMP: Starting deletion of derivative data. [2025-10-27T21:09:43.580590] [DEBUG] [LOCAL ] SMP: Deleted derivative data file. [2025-10-27T21:09:43.580682] [INFO ] [MAIN ] Update Progress: 1940/2366 symbols completed. SMP took 27.6s. Estimated remaining: 54m 50s. Rate: 7.8 symbols/min [2025-10-27T21:09:43.620094] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-27T21:09:43.765566] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:09:43.827939] [DEBUG] [LOCAL ] SN: Loaded 50731 existing records from primary storage. [2025-10-27T21:09:43.828390] [INFO ] [MAIN ] SN: Loaded 50731 existing records. [2025-10-27T21:09:44.022351] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:09:44.022559] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-27T21:09:44.022605] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-27T21:09:44.022873] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-27T21:09:44.022940] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-27T21:09:44.364508] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:09:44.414908] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-27T21:09:45.214969] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-27T21:09:45.723660] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T21:09:46.014927] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-27T21:09:46.047322] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-27T21:09:46.471854] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T21:09:46.815009] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-27T21:09:47.108531] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T21:09:47.614947] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-27T21:09:48.415001] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-27T21:09:48.881595] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T21:09:49.214988] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-27T21:09:49.307757] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-27T21:09:49.698501] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T21:09:50.014977] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-27T21:09:50.269322] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T21:09:50.814943] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-27T21:09:51.187610] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:09:51.615024] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-27T21:09:52.414987] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-27T21:09:52.977384] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T21:09:53.215009] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-27T21:09:53.321578] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-27T21:09:54.014973] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-27T21:09:54.216501] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T21:09:54.814992] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-27T21:09:55.105722] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T21:09:55.615011] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-27T21:09:55.791636] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T21:09:56.414926] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-27T21:09:56.539868] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-27T21:09:57.148913] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T21:09:57.214977] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-27T21:09:57.389671] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-27T21:09:58.014948] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-27T21:09:58.802116] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:09:58.814903] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-27T21:09:59.508586] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T21:09:59.614985] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-27T21:09:59.975700] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:09:59.983554] [INFO ] [REMOTE ] SMRT: Full fetch complete (62553 records). [2025-10-27T21:09:59.983699] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-27T21:10:00.359373] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-27T21:10:00.359446] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-27T21:10:00.360423] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-27T21:10:00.360484] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-27T21:10:00.361786] [DEBUG] [LOCAL ] SMRT: Trimmed 62553 records to 43592 (keeping 200 days of data) [2025-10-27T21:10:00.416180] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-27T21:10:00.602889] [DEBUG] [LOCAL ] SMRT: Primary data saved (43592 records). [2025-10-27T21:10:00.603003] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-27T21:10:00.603075] [INFO ] [MAIN ] Update Progress: 1941/2366 symbols completed. SMRT took 30.5s. Estimated remaining: 54m 44s. Rate: 7.8 symbols/min [2025-10-27T21:10:00.770125] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:00.793217] [DEBUG] [LOCAL ] SNA: Loaded 26036 existing records from primary storage. [2025-10-27T21:10:00.793448] [INFO ] [MAIN ] SNA: Loaded 26036 existing records. [2025-10-27T21:10:00.968958] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:00.969248] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-27T21:10:00.969350] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-27T21:10:00.969766] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-27T21:10:00.969941] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-27T21:10:01.230774] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-27T21:10:01.316302] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T21:10:01.368094] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:01.397740] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T21:10:02.014976] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-27T21:10:02.814945] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-27T21:10:02.887949] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T21:10:02.893089] [INFO ] [REMOTE ] SMWB: Full fetch complete (48338 records). [2025-10-27T21:10:02.893213] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-27T21:10:03.266106] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-27T21:10:03.266180] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-27T21:10:03.267105] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-27T21:10:03.267165] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-27T21:10:03.268227] [DEBUG] [LOCAL ] SMWB: Trimmed 48338 records to 31282 (keeping 200 days of data) [2025-10-27T21:10:03.438877] [DEBUG] [LOCAL ] SMWB: Primary data saved (31282 records). [2025-10-27T21:10:03.439006] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-27T21:10:03.439703] [INFO ] [MAIN ] Update Progress: 1942/2366 symbols completed. SMWB took 30.1s. Estimated remaining: 54m 35s. Rate: 7.8 symbols/min [2025-10-27T21:10:03.601534] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:03.615005] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-27T21:10:03.651963] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-27T21:10:03.652283] [INFO ] [MAIN ] SNAP: Loaded 54576 existing records. [2025-10-27T21:10:03.829465] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:03.829714] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-27T21:10:03.829769] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-27T21:10:03.829972] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-27T21:10:03.830027] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-27T21:10:04.180535] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:04.242872] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-27T21:10:04.414944] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-27T21:10:04.579236] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:10:04.702518] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T21:10:05.214990] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-27T21:10:06.014995] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-27T21:10:06.303049] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T21:10:06.330708] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T21:10:06.814969] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-27T21:10:07.614996] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-27T21:10:08.414962] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-27T21:10:08.492751] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T21:10:08.659771] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-27T21:10:08.670372] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-27T21:10:08.670495] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-27T21:10:08.898315] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T21:10:09.156183] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-27T21:10:09.156281] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-27T21:10:09.157596] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-27T21:10:09.157687] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-27T21:10:09.159253] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 53799 (keeping 200 days of data) [2025-10-27T21:10:09.220933] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-27T21:10:09.482873] [DEBUG] [LOCAL ] SMR: Primary data saved (53799 records). [2025-10-27T21:10:09.483002] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-27T21:10:09.483079] [INFO ] [MAIN ] Update Progress: 1943/2366 symbols completed. SMR took 49.5s. Estimated remaining: 54m 27s. Rate: 7.8 symbols/min [2025-10-27T21:10:09.646416] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:09.653196] [DEBUG] [LOCAL ] SNDA: Loaded 4515 existing records from primary storage. [2025-10-27T21:10:09.653376] [INFO ] [MAIN ] SNDA: Loaded 4515 existing records. [2025-10-27T21:10:09.826167] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:09.826380] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-27T21:10:09.826434] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-27T21:10:09.826580] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-27T21:10:09.826707] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-27T21:10:10.030355] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-27T21:10:10.185688] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:10.508362] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-27T21:10:10.765625] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:10:10.814906] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-27T21:10:11.464146] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T21:10:11.614990] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-27T21:10:11.883966] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T21:10:12.415026] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-27T21:10:12.993272] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T21:10:13.214926] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-27T21:10:13.687713] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-27T21:10:14.014936] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-27T21:10:14.172130] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T21:10:14.547264] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-27T21:10:14.814938] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-27T21:10:15.516328] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-27T21:10:15.614920] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-27T21:10:16.182174] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T21:10:16.414934] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-27T21:10:17.215002] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-27T21:10:17.677759] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T21:10:17.905797] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T21:10:18.015202] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-27T21:10:18.814965] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-27T21:10:19.614949] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-27T21:10:19.912376] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-27T21:10:20.281914] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T21:10:20.347439] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-27T21:10:20.358422] [INFO ] [REMOTE ] SN: Full fetch complete (71917 records). [2025-10-27T21:10:20.358616] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-27T21:10:20.421145] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-27T21:10:20.794065] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-27T21:10:20.794159] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-27T21:10:20.795279] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-27T21:10:20.795344] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-27T21:10:20.796842] [DEBUG] [LOCAL ] SN: Trimmed 71917 records to 49918 (keeping 200 days of data) [2025-10-27T21:10:21.089035] [DEBUG] [LOCAL ] SN: Primary data saved (49918 records). [2025-10-27T21:10:21.089169] [INFO ] [MAIN ] SN: Full history saved. [2025-10-27T21:10:21.089590] [INFO ] [MAIN ] Update Progress: 1944/2366 symbols completed. SN took 37.5s. Estimated remaining: 54m 20s. Rate: 7.8 symbols/min [2025-10-27T21:10:21.227493] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-27T21:10:21.260385] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:21.302506] [DEBUG] [LOCAL ] SNDR: Loaded 42192 existing records from primary storage. [2025-10-27T21:10:21.302841] [INFO ] [MAIN ] SNDR: Loaded 42192 existing records. [2025-10-27T21:10:21.488231] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:21.488559] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-27T21:10:21.488724] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-27T21:10:21.489049] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-27T21:10:21.489147] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-27T21:10:21.623632] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T21:10:21.910754] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:22.014960] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-27T21:10:22.814957] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-27T21:10:23.542974] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-27T21:10:23.609504] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T21:10:23.617589] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-27T21:10:23.805096] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T21:10:24.414944] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-27T21:10:25.215442] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T21:10:25.214999] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-27T21:10:25.621473] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-27T21:10:26.014936] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-27T21:10:26.347511] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:10:26.462837] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T21:10:26.814939] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-27T21:10:27.546522] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T21:10:27.614921] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-27T21:10:28.319174] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T21:10:28.320461] [INFO ] [REMOTE ] SNDA: Full fetch complete (7331 records). [2025-10-27T21:10:28.320529] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-27T21:10:28.418752] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-27T21:10:28.675698] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-27T21:10:28.675778] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-27T21:10:28.675988] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-27T21:10:28.676029] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-27T21:10:28.676413] [DEBUG] [LOCAL ] SNDA: Trimmed 7331 records to 4410 (keeping 200 days of data) [2025-10-27T21:10:28.701265] [DEBUG] [LOCAL ] SNDA: Primary data saved (4410 records). [2025-10-27T21:10:28.701369] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-27T21:10:28.701442] [INFO ] [MAIN ] Update Progress: 1945/2366 symbols completed. SNDA took 19.2s. Estimated remaining: 54m 12s. Rate: 7.8 symbols/min [2025-10-27T21:10:28.868056] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:28.904733] [DEBUG] [LOCAL ] SNN: Loaded 44967 existing records from primary storage. [2025-10-27T21:10:28.905050] [INFO ] [MAIN ] SNN: Loaded 44967 existing records. [2025-10-27T21:10:29.077519] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:29.077753] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-27T21:10:29.077823] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-27T21:10:29.078061] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-27T21:10:29.078101] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-27T21:10:29.220094] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-27T21:10:29.447848] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:30.014957] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-27T21:10:30.443575] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:10:30.697441] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-27T21:10:30.814950] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-27T21:10:31.614938] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-27T21:10:31.705887] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T21:10:32.414997] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-27T21:10:32.833525] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-27T21:10:32.905487] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T21:10:33.214960] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-27T21:10:33.923280] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:10:33.946155] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T21:10:33.951229] [INFO ] [REMOTE ] SNA: Full fetch complete (38809 records). [2025-10-27T21:10:33.951320] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-27T21:10:33.951950] [FATAL] [VALIDATOR ] SNA: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:10:33.952035] [FATAL] [MAIN ] SNA: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:10:33.952077] [WARN ] [MAIN ] SNA: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:10:33.952116] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-27T21:10:33.952170] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-27T21:10:33.952203] [INFO ] [LOCAL ] SNA: Starting deletion of derivative data. [2025-10-27T21:10:33.952317] [DEBUG] [LOCAL ] SNA: Deleted derivative data file. [2025-10-27T21:10:33.952382] [INFO ] [MAIN ] Update Progress: 1946/2366 symbols completed. SNA took 33.3s. Estimated remaining: 54m 4s. Rate: 7.8 symbols/min [2025-10-27T21:10:34.020010] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-27T21:10:34.124808] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:34.177955] [DEBUG] [LOCAL ] SNOW: Loaded 54357 existing records from primary storage. [2025-10-27T21:10:34.178269] [INFO ] [MAIN ] SNOW: Loaded 54357 existing records. [2025-10-27T21:10:34.362029] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:34.362181] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-27T21:10:34.362245] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-27T21:10:34.362422] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-27T21:10:34.362460] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-27T21:10:34.728962] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:34.814913] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-27T21:10:35.176939] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T21:10:35.614972] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-27T21:10:36.414952] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-27T21:10:36.613045] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T21:10:37.215040] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-27T21:10:37.498186] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T21:10:37.710821] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:10:38.014944] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-27T21:10:38.333050] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:10:38.814994] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-27T21:10:39.614948] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-27T21:10:39.882202] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T21:10:40.414906] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-27T21:10:40.647613] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-27T21:10:40.657902] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-27T21:10:40.658070] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-27T21:10:41.052171] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-27T21:10:41.052350] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-27T21:10:41.053478] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-27T21:10:41.053540] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-27T21:10:41.054926] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-27T21:10:41.217721] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-27T21:10:41.303479] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-27T21:10:41.403977] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-27T21:10:41.404132] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-27T21:10:41.404806] [INFO ] [MAIN ] Update Progress: 1947/2366 symbols completed. SNAP took 38.0s. Estimated remaining: 53m 56s. Rate: 7.8 symbols/min [2025-10-27T21:10:41.569891] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:41.613148] [DEBUG] [LOCAL ] SNV: Loaded 49797 existing records from primary storage. [2025-10-27T21:10:41.613440] [INFO ] [MAIN ] SNV: Loaded 49797 existing records. [2025-10-27T21:10:41.786835] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:41.787029] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-27T21:10:41.787078] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-27T21:10:41.787515] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-27T21:10:41.787552] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-27T21:10:42.021453] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-27T21:10:42.136386] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:42.330462] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-27T21:10:42.780115] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T21:10:42.814948] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-27T21:10:43.255738] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T21:10:43.614931] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-27T21:10:43.853420] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T21:10:44.414942] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-27T21:10:45.214916] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-27T21:10:45.314571] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T21:10:45.493086] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T21:10:46.014973] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-27T21:10:46.572705] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T21:10:46.814947] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-27T21:10:47.527981] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T21:10:47.614961] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-27T21:10:48.414959] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-27T21:10:48.497708] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T21:10:48.507284] [INFO ] [REMOTE ] SNDR: Full fetch complete (59980 records). [2025-10-27T21:10:48.507472] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-27T21:10:48.509253] [FATAL] [VALIDATOR ] SNDR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:10:48.509354] [FATAL] [MAIN ] SNDR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:10:48.509399] [WARN ] [MAIN ] SNDR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:10:48.509441] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-27T21:10:48.509505] [DEBUG] [LOCAL ] SNDR: No primary data file found to delete. [2025-10-27T21:10:48.509542] [INFO ] [LOCAL ] SNDR: Starting deletion of derivative data. [2025-10-27T21:10:48.509719] [DEBUG] [LOCAL ] SNDR: Deleted derivative data file. [2025-10-27T21:10:48.510172] [INFO ] [MAIN ] Update Progress: 1948/2366 symbols completed. SNDR took 27.4s. Estimated remaining: 53m 48s. Rate: 7.8 symbols/min [2025-10-27T21:10:48.703807] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:10:48.752187] [DEBUG] [LOCAL ] SNX: Loaded 39416 existing records from primary storage. [2025-10-27T21:10:48.752576] [INFO ] [MAIN ] SNX: Loaded 39416 existing records. [2025-10-27T21:10:48.966752] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T21:10:49.000773] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:10:49.001218] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-27T21:10:49.001884] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-27T21:10:49.002469] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-27T21:10:49.002537] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-27T21:10:49.220102] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-27T21:10:49.361320] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:10:49.714961] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:10:50.014980] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-27T21:10:50.814974] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-27T21:10:51.614952] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-27T21:10:51.660161] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T21:10:51.721776] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-27T21:10:52.275784] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T21:10:52.414918] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-27T21:10:52.950022] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T21:10:53.214995] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-27T21:10:54.018290] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-27T21:10:54.023586] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:10:54.814951] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-27T21:10:55.056948] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T21:10:55.199931] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T21:10:55.614937] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-27T21:10:55.966880] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T21:10:56.414942] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-27T21:10:57.214967] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-27T21:10:57.374389] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T21:10:58.015046] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-27T21:10:58.051222] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T21:10:58.814942] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-27T21:10:59.101977] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-27T21:10:59.614984] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-27T21:10:59.883079] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T21:11:00.160422] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:11:00.414992] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-27T21:11:01.195167] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T21:11:01.214912] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-27T21:11:01.984032] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T21:11:02.014951] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-27T21:11:02.585103] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T21:11:02.814944] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-27T21:11:03.380323] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T21:11:03.614986] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-27T21:11:04.414973] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-27T21:11:05.215014] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-27T21:11:05.726017] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-27T21:11:05.995182] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T21:11:06.014898] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-27T21:11:06.321922] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-27T21:11:06.330558] [INFO ] [REMOTE ] SNN: Full fetch complete (63051 records). [2025-10-27T21:11:06.330723] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-27T21:11:06.714745] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:11:06.760902] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-27T21:11:06.761335] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-27T21:11:06.762509] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-27T21:11:06.762574] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-27T21:11:06.763776] [DEBUG] [LOCAL ] SNN: Trimmed 63051 records to 44156 (keeping 200 days of data) [2025-10-27T21:11:06.815093] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-27T21:11:07.029616] [DEBUG] [LOCAL ] SNN: Primary data saved (44156 records). [2025-10-27T21:11:07.029774] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-27T21:11:07.029857] [INFO ] [MAIN ] Update Progress: 1949/2366 symbols completed. SNN took 38.3s. Estimated remaining: 53m 43s. Rate: 7.8 symbols/min [2025-10-27T21:11:07.196159] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:07.243588] [DEBUG] [LOCAL ] SO: Loaded 54394 existing records from primary storage. [2025-10-27T21:11:07.243915] [INFO ] [MAIN ] SO: Loaded 54394 existing records. [2025-10-27T21:11:07.424382] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:07.424604] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-27T21:11:07.424685] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-27T21:11:07.425187] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-27T21:11:07.425228] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-27T21:11:07.629670] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-27T21:11:07.784202] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:08.415006] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-27T21:11:08.848222] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-27T21:11:08.858794] [INFO ] [REMOTE ] SNOW: Full fetch complete (77716 records). [2025-10-27T21:11:08.858930] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-27T21:11:09.261973] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-27T21:11:09.262217] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-27T21:11:09.263390] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-27T21:11:09.263473] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-27T21:11:09.286694] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T21:11:09.285670] [DEBUG] [LOCAL ] SNOW: Trimmed 77716 records to 53575 (keeping 200 days of data) [2025-10-27T21:11:09.295893] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-27T21:11:09.552054] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (3.54 seconds). [2025-10-27T21:11:09.566994] [INFO ] [REMOTE ] SNV: Full fetch complete (71514 records). [2025-10-27T21:11:09.568169] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-27T21:11:09.612338] [FATAL] [VALIDATOR ] SNV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:11:09.619152] [FATAL] [MAIN ] SNV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:11:09.640791] [WARN ] [MAIN ] SNV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:11:09.649747] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-27T21:11:09.659475] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-27T21:11:09.662959] [INFO ] [LOCAL ] SNV: Starting deletion of derivative data. [2025-10-27T21:11:09.663015] [DEBUG] [LOCAL ] SNOW: Primary data saved (53575 records). [2025-10-27T21:11:09.663133] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-27T21:11:09.663277] [INFO ] [MAIN ] Update Progress: 1950/2366 symbols completed. SNOW took 35.7s. Estimated remaining: 53m 34s. Rate: 7.8 symbols/min [2025-10-27T21:11:09.694075] [DEBUG] [LOCAL ] SNV: Deleted derivative data file. [2025-10-27T21:11:09.725207] [INFO ] [MAIN ] Update Progress: 1951/2366 symbols completed. SNV took 28.3s. Estimated remaining: 53m 25s. Rate: 7.8 symbols/min [2025-10-27T21:11:09.969770] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:10.002418] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:10.062339] [DEBUG] [LOCAL ] SOC: Loaded 52006 existing records from primary storage. [2025-10-27T21:11:10.063429] [INFO ] [MAIN ] SOC: Loaded 52006 existing records. [2025-10-27T21:11:10.169181] [DEBUG] [LOCAL ] SOBO: Loaded 39954 existing records from primary storage. [2025-10-27T21:11:10.189013] [INFO ] [MAIN ] SOBO: Loaded 39954 existing records. [2025-10-27T21:11:10.381297] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:10.411219] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-27T21:11:10.421726] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-27T21:11:10.502000] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:10.502135] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-27T21:11:10.502525] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-27T21:11:10.502712] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-27T21:11:10.514638] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-27T21:11:10.547860] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-27T21:11:10.556494] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-27T21:11:10.798131] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-27T21:11:10.872540] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-27T21:11:11.486541] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:11.541889] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:11.542529] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-27T21:11:11.549770] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T21:11:11.614917] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-27T21:11:12.344015] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T21:11:12.414900] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-27T21:11:12.844130] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T21:11:12.896685] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-27T21:11:13.214949] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-27T21:11:13.875222] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T21:11:14.014941] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-27T21:11:14.269612] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T21:11:14.815037] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-27T21:11:15.608667] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T21:11:15.619225] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-27T21:11:16.414923] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-27T21:11:16.799062] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T21:11:17.214933] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-27T21:11:17.322140] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T21:11:18.015064] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-27T21:11:18.303705] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T21:11:18.444926] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T21:11:18.814991] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-27T21:11:19.399432] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T21:11:19.614930] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-27T21:11:20.031709] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-27T21:11:20.414963] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-27T21:11:21.214974] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-27T21:11:21.267915] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T21:11:21.780920] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-27T21:11:21.788453] [INFO ] [REMOTE ] SNX: Full fetch complete (56949 records). [2025-10-27T21:11:21.788557] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-27T21:11:21.790347] [FATAL] [VALIDATOR ] SNX: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:11:21.790466] [FATAL] [MAIN ] SNX: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:11:21.790530] [WARN ] [MAIN ] SNX: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:11:21.790576] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-27T21:11:21.790671] [DEBUG] [LOCAL ] SNX: No primary data file found to delete. [2025-10-27T21:11:21.790744] [INFO ] [LOCAL ] SNX: Starting deletion of derivative data. [2025-10-27T21:11:21.791285] [DEBUG] [LOCAL ] SNX: Deleted derivative data file. [2025-10-27T21:11:21.791922] [INFO ] [MAIN ] Update Progress: 1952/2366 symbols completed. SNX took 33.3s. Estimated remaining: 53m 18s. Rate: 7.8 symbols/min [2025-10-27T21:11:21.966921] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:21.995635] [DEBUG] [LOCAL ] SOJC: Loaded 4623 existing records from primary storage. [2025-10-27T21:11:21.993113] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T21:11:21.995883] [INFO ] [MAIN ] SOJC: Loaded 4623 existing records. [2025-10-27T21:11:22.024173] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-27T21:11:22.179055] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:22.179237] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-27T21:11:22.179335] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-27T21:11:22.179482] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-27T21:11:22.179519] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-27T21:11:22.520935] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:22.814926] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-27T21:11:23.620073] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-27T21:11:23.640511] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T21:11:24.286598] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T21:11:24.414917] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-27T21:11:25.011178] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:11:25.214969] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-27T21:11:25.799950] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T21:11:26.014970] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-27T21:11:26.814944] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-27T21:11:27.001908] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T21:11:27.097349] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T21:11:27.318700] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-27T21:11:27.614957] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-27T21:11:28.278283] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T21:11:28.414932] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-27T21:11:28.977270] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T21:11:28.987102] [INFO ] [REMOTE ] SO: Full fetch complete (77387 records). [2025-10-27T21:11:28.987231] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-27T21:11:28.987977] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:11:28.988069] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:11:28.988140] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:11:28.988223] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-27T21:11:28.988292] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-10-27T21:11:28.988358] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-10-27T21:11:28.988548] [DEBUG] [LOCAL ] SO: Deleted derivative data file. [2025-10-27T21:11:28.988639] [INFO ] [MAIN ] Update Progress: 1953/2366 symbols completed. SO took 22.0s. Estimated remaining: 53m 10s. Rate: 7.8 symbols/min [2025-10-27T21:11:29.163788] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:29.178901] [DEBUG] [LOCAL ] SOJD: Loaded 12733 existing records from primary storage. [2025-10-27T21:11:29.179139] [INFO ] [MAIN ] SOJD: Loaded 12733 existing records. [2025-10-27T21:11:29.220204] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-27T21:11:29.355896] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:29.356085] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-27T21:11:29.356131] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-27T21:11:29.356287] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-27T21:11:29.356337] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-27T21:11:29.697232] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:30.014945] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-27T21:11:30.418382] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T21:11:30.814935] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-27T21:11:31.053826] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:11:31.614932] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-27T21:11:32.271053] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:11:32.287531] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T21:11:32.414910] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-27T21:11:33.214974] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-27T21:11:33.436965] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T21:11:33.444862] [INFO ] [REMOTE ] SOBO: Full fetch complete (58507 records). [2025-10-27T21:11:33.444966] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-27T21:11:33.822585] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-27T21:11:33.822685] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-27T21:11:33.823732] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-27T21:11:33.823831] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-27T21:11:33.825058] [DEBUG] [LOCAL ] SOBO: Trimmed 58507 records to 39066 (keeping 200 days of data) [2025-10-27T21:11:33.923111] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T21:11:34.035831] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-27T21:11:34.070037] [DEBUG] [LOCAL ] SOBO: Primary data saved (39066 records). [2025-10-27T21:11:34.070181] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-27T21:11:34.071000] [INFO ] [MAIN ] Update Progress: 1954/2366 symbols completed. SOBO took 24.4s. Estimated remaining: 53m 2s. Rate: 7.8 symbols/min [2025-10-27T21:11:34.236588] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:34.247272] [DEBUG] [LOCAL ] SOJE: Loaded 8815 existing records from primary storage. [2025-10-27T21:11:34.247477] [INFO ] [MAIN ] SOJE: Loaded 8815 existing records. [2025-10-27T21:11:34.417260] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:34.417456] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-27T21:11:34.417504] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-27T21:11:34.417691] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-27T21:11:34.417747] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-27T21:11:34.759141] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:34.814923] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-27T21:11:35.436930] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T21:11:35.614926] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-27T21:11:35.856904] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T21:11:36.110974] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T21:11:36.414940] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-27T21:11:37.185894] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:11:37.214956] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-27T21:11:38.014953] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-27T21:11:38.814964] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-27T21:11:38.937188] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T21:11:38.971282] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:11:39.614922] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-27T21:11:39.689747] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T21:11:40.414992] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-27T21:11:41.089510] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T21:11:41.214913] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-27T21:11:41.740940] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-27T21:11:41.785714] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T21:11:42.014984] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-27T21:11:42.658887] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-27T21:11:42.814942] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-27T21:11:43.609275] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T21:11:43.614889] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-27T21:11:44.360060] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T21:11:44.414923] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-27T21:11:45.146834] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-27T21:11:45.214967] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-27T21:11:46.014994] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-27T21:11:46.822143] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-27T21:11:46.843241] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T21:11:46.996823] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:11:47.539944] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T21:11:47.614934] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-27T21:11:48.239898] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:11:48.415001] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-27T21:11:49.214927] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-27T21:11:49.295679] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T21:11:49.943330] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T21:11:50.014964] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-27T21:11:50.441804] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:11:50.443006] [INFO ] [REMOTE ] SOJC: Full fetch complete (7169 records). [2025-10-27T21:11:50.443074] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-27T21:11:50.794098] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-27T21:11:50.794175] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-27T21:11:50.794370] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-27T21:11:50.794406] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-27T21:11:50.794809] [DEBUG] [LOCAL ] SOJC: Trimmed 7169 records to 4435 (keeping 200 days of data) [2025-10-27T21:11:50.821291] [DEBUG] [LOCAL ] SOJC: Primary data saved (4435 records). [2025-10-27T21:11:50.821459] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-27T21:11:50.821619] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-27T21:11:50.821981] [INFO ] [MAIN ] Update Progress: 1955/2366 symbols completed. SOJC took 29.0s. Estimated remaining: 52m 56s. Rate: 7.8 symbols/min [2025-10-27T21:11:50.987012] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:50.987165] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-27T21:11:50.987201] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-27T21:11:50.987309] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-27T21:11:50.987349] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-27T21:11:50.987388] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-27T21:11:50.987419] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-27T21:11:51.333530] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:51.614920] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-27T21:11:51.698010] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T21:11:52.414951] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-27T21:11:53.074873] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T21:11:53.076843] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:11:53.214945] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-27T21:11:54.014950] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-27T21:11:54.049204] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T21:11:54.664263] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T21:11:54.814936] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-27T21:11:55.614951] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-27T21:11:55.643164] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T21:11:56.161509] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T21:11:56.163509] [INFO ] [REMOTE ] SOJE: Full fetch complete (13387 records). [2025-10-27T21:11:56.163580] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-27T21:11:56.420133] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-10-27T21:11:56.521408] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-27T21:11:56.521482] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-27T21:11:56.521802] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-27T21:11:56.521862] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-27T21:11:56.522316] [DEBUG] [LOCAL ] SOJE: Trimmed 13387 records to 8594 (keeping 200 days of data) [2025-10-27T21:11:56.576161] [DEBUG] [LOCAL ] SOJE: Primary data saved (8594 records). [2025-10-27T21:11:56.576328] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-27T21:11:56.576431] [INFO ] [MAIN ] Update Progress: 1956/2366 symbols completed. SOJE took 22.5s. Estimated remaining: 52m 48s. Rate: 7.8 symbols/min [2025-10-27T21:11:56.740488] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:11:56.754383] [DEBUG] [LOCAL ] SOL: Loaded 13703 existing records from primary storage. [2025-10-27T21:11:56.754593] [INFO ] [MAIN ] SOL: Loaded 13703 existing records. [2025-10-27T21:11:56.924606] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:11:56.924886] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-27T21:11:56.924933] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-27T21:11:56.925166] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-27T21:11:56.925222] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-27T21:11:57.219157] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-27T21:11:57.277472] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:11:57.598682] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T21:11:58.014918] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-27T21:11:58.136604] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T21:11:58.815036] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-27T21:11:59.449720] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T21:11:59.614936] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-27T21:11:59.874999] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-27T21:11:59.885394] [INFO ] [REMOTE ] SOC: Full fetch complete (72473 records). [2025-10-27T21:11:59.885554] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-27T21:12:00.290189] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-27T21:12:00.290286] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-27T21:12:00.291492] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-27T21:12:00.291562] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-27T21:12:00.293061] [DEBUG] [LOCAL ] SOC: Trimmed 72473 records to 51235 (keeping 200 days of data) [2025-10-27T21:12:00.457002] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-10-27T21:12:00.593779] [DEBUG] [LOCAL ] SOC: Primary data saved (51235 records). [2025-10-27T21:12:00.593917] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-27T21:12:00.593997] [INFO ] [MAIN ] Update Progress: 1957/2366 symbols completed. SOC took 50.9s. Estimated remaining: 52m 39s. Rate: 7.8 symbols/min [2025-10-27T21:12:01.174253] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T21:12:01.203614] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T21:12:01.214910] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-27T21:12:02.014936] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-10-27T21:12:02.337632] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T21:12:02.814950] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-27T21:12:02.842218] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T21:12:03.614951] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-10-27T21:12:03.698546] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T21:12:04.414953] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-27T21:12:04.472871] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-27T21:12:05.053506] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T21:12:05.056286] [INFO ] [REMOTE ] SOJD: Full fetch complete (19033 records). [2025-10-27T21:12:05.056371] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-27T21:12:05.221179] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-27T21:12:05.444501] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-27T21:12:05.444593] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-27T21:12:05.445011] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-27T21:12:05.445071] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-27T21:12:05.445679] [DEBUG] [LOCAL ] SOJD: Trimmed 19033 records to 12400 (keeping 200 days of data) [2025-10-27T21:12:05.518578] [DEBUG] [LOCAL ] SOJD: Primary data saved (12400 records). [2025-10-27T21:12:05.518730] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-27T21:12:05.518815] [INFO ] [MAIN ] Update Progress: 1958/2366 symbols completed. SOJD took 36.5s. Estimated remaining: 52m 31s. Rate: 7.8 symbols/min [2025-10-27T21:12:06.015032] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-10-27T21:12:06.352799] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T21:12:06.481915] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:12:06.814947] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-10-27T21:12:07.429203] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T21:12:07.615005] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-10-27T21:12:08.176093] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T21:12:08.414972] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-10-27T21:12:09.215026] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-27T21:12:09.231699] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T21:12:09.899106] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T21:12:10.014949] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-27T21:12:10.815001] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-10-27T21:12:11.119534] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T21:12:11.297290] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T21:12:11.614928] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-27T21:12:12.414930] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-10. [2025-10-27T21:12:12.633635] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T21:12:12.893660] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-27T21:12:12.895311] [INFO ] [REMOTE ] SOJF: Full fetch complete (14216 records). [2025-10-27T21:12:12.895378] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-27T21:12:13.074995] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T21:12:13.075261] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:12:13.075328] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:12:13.075377] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-27T21:12:13.075431] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-27T21:12:13.075465] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-27T21:12:13.075502] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-27T21:12:13.075555] [INFO ] [MAIN ] Update Progress: 1959/2366 symbols completed. SOJF took 22.3s. Estimated remaining: 52m 23s. Rate: 7.8 symbols/min [2025-10-27T21:12:13.214944] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-27T21:12:13.825802] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T21:12:14.014908] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-27T21:12:14.925812] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T21:12:14.928888] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-27T21:12:15.723766] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T21:12:15.727608] [INFO ] [REMOTE ] SOL: Full fetch complete (20806 records). [2025-10-27T21:12:15.727719] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-27T21:12:16.079478] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-27T21:12:16.079560] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-27T21:12:16.080031] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-27T21:12:16.080090] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-27T21:12:16.080688] [DEBUG] [LOCAL ] SOL: Trimmed 20806 records to 13500 (keeping 200 days of data) [2025-10-27T21:12:16.157048] [DEBUG] [LOCAL ] SOL: Primary data saved (13500 records). [2025-10-27T21:12:16.157177] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-27T21:12:16.157253] [INFO ] [MAIN ] Update Progress: 1960/2366 symbols completed. SOL took 19.6s. Estimated remaining: 52m 15s. Rate: 7.8 symbols/min [2025-10-27T21:12:16.696436] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:16.743331] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:16.843889] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:16.878616] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:16.882542] [DEBUG] [LOCAL ] SOR: Loaded 2842 existing records from primary storage. [2025-10-27T21:12:16.883341] [INFO ] [MAIN ] SOR: Loaded 2842 existing records. [2025-10-27T21:12:17.028876] [DEBUG] [LOCAL ] SOLV: Loaded 44046 existing records from primary storage. [2025-10-27T21:12:17.061993] [INFO ] [MAIN ] SOLV: Loaded 44046 existing records. [2025-10-27T21:12:17.193114] [DEBUG] [LOCAL ] SONY: Loaded 54151 existing records from primary storage. [2025-10-27T21:12:17.227018] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:17.227609] [INFO ] [MAIN ] SONY: Loaded 54151 existing records. [2025-10-27T21:12:17.232994] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-27T21:12:17.227335] [DEBUG] [LOCAL ] SON: Loaded 44308 existing records from primary storage. [2025-10-27T21:12:17.238323] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-27T21:12:17.243857] [INFO ] [MAIN ] SON: Loaded 44308 existing records. [2025-10-27T21:12:17.291544] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-27T21:12:17.307998] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-27T21:12:17.714402] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:17.787553] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-27T21:12:17.787723] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-27T21:12:17.811990] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:17.817272] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:17.807511] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-27T21:12:17.823333] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-27T21:12:17.838891] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-27T21:12:17.817591] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-27T21:12:17.844140] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-27T21:12:17.890767] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-27T21:12:17.890898] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-27T21:12:17.914886] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-27T21:12:17.948115] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-27T21:12:17.966089] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-27T21:12:18.547625] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:18.692067] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-27T21:12:19.057816] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:19.079471] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-27T21:12:19.136287] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:19.142090] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-27T21:12:19.209223] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:19.209705] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-27T21:12:19.468835] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T21:12:19.470451] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-27T21:12:20.002581] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T21:12:20.003826] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-27T21:12:20.603260] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T21:12:20.605070] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-27T21:12:20.745031] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:12:20.849910] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T21:12:20.881968] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T21:12:21.214973] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-27T21:12:21.268902] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T21:12:22.014944] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-27T21:12:22.392461] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T21:12:22.466811] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T21:12:22.814939] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-27T21:12:23.614939] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-27T21:12:23.967553] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T21:12:24.414974] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-27T21:12:24.851979] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T21:12:25.214976] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-27T21:12:25.532467] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T21:12:25.665216] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:12:26.014937] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-27T21:12:26.460498] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T21:12:26.814940] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-27T21:12:27.614931] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-27T21:12:28.283202] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T21:12:28.414902] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-27T21:12:28.833801] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-27T21:12:29.214923] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-27T21:12:29.975708] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T21:12:30.014898] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-27T21:12:30.815029] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-27T21:12:30.868747] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T21:12:31.361387] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T21:12:31.614977] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-27T21:12:32.334322] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T21:12:32.414898] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-27T21:12:33.106275] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T21:12:33.214900] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-27T21:12:33.939517] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:12:34.014900] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-27T21:12:34.815004] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-27T21:12:35.247120] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T21:12:35.614910] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-27T21:12:36.050708] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-27T21:12:36.344382] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T21:12:36.414899] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-27T21:12:37.214958] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-27T21:12:37.337841] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T21:12:37.551520] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T21:12:37.638615] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T21:12:38.014963] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-27T21:12:38.639715] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T21:12:38.641077] [INFO ] [REMOTE ] SOR: Full fetch complete (4336 records). [2025-10-27T21:12:38.641162] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-27T21:12:38.827042] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-27T21:12:39.043897] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-27T21:12:39.043999] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-27T21:12:39.044200] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-27T21:12:39.044243] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-27T21:12:39.044782] [DEBUG] [LOCAL ] SOR: Trimmed 4336 records to 2796 (keeping 200 days of data) [2025-10-27T21:12:39.063230] [DEBUG] [LOCAL ] SOR: Primary data saved (2796 records). [2025-10-27T21:12:39.063418] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-27T21:12:39.063529] [INFO ] [MAIN ] Update Progress: 1961/2366 symbols completed. SOR took 22.9s. Estimated remaining: 52m 10s. Rate: 7.8 symbols/min [2025-10-27T21:12:39.238900] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:39.251370] [DEBUG] [LOCAL ] SOS: Loaded 9787 existing records from primary storage. [2025-10-27T21:12:39.251688] [INFO ] [MAIN ] SOS: Loaded 9787 existing records. [2025-10-27T21:12:39.448758] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:39.449091] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-27T21:12:39.449162] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-27T21:12:39.449374] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-27T21:12:39.449433] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-27T21:12:39.622024] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-27T21:12:39.857292] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:40.414914] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-27T21:12:40.512268] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T21:12:40.883447] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:12:41.214911] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-27T21:12:41.602754] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:12:42.015001] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-27T21:12:42.697089] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T21:12:42.814930] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-27T21:12:43.191434] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T21:12:43.484568] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T21:12:43.614936] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-27T21:12:44.096879] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T21:12:44.414981] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-27T21:12:44.942750] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T21:12:45.214945] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-27T21:12:45.686804] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:12:46.014941] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-27T21:12:46.716667] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T21:12:46.814972] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-27T21:12:47.614939] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-27T21:12:47.976967] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:12:48.414983] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-27T21:12:48.533342] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T21:12:48.542662] [INFO ] [REMOTE ] SON: Full fetch complete (62780 records). [2025-10-27T21:12:48.542819] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-27T21:12:48.543756] [FATAL] [VALIDATOR ] SON: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:12:48.543848] [FATAL] [MAIN ] SON: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:12:48.543894] [WARN ] [MAIN ] SON: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:12:48.543937] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-27T21:12:48.544003] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-27T21:12:48.544066] [INFO ] [LOCAL ] SON: Starting deletion of derivative data. [2025-10-27T21:12:48.544214] [DEBUG] [LOCAL ] SON: Deleted derivative data file. [2025-10-27T21:12:48.544297] [INFO ] [MAIN ] Update Progress: 1962/2366 symbols completed. SON took 32.4s. Estimated remaining: 52m 3s. Rate: 7.8 symbols/min [2025-10-27T21:12:48.719257] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:48.753319] [DEBUG] [LOCAL ] SPB: Loaded 34283 existing records from primary storage. [2025-10-27T21:12:48.753610] [INFO ] [MAIN ] SPB: Loaded 34283 existing records. [2025-10-27T21:12:48.928735] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:48.928943] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-27T21:12:48.928988] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-27T21:12:48.929172] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-27T21:12:48.929209] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-27T21:12:49.220163] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-27T21:12:49.281251] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:50.014943] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-27T21:12:50.280674] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T21:12:50.507351] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T21:12:50.723172] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T21:12:50.814964] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-27T21:12:51.614943] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-27T21:12:52.056481] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:12:52.414973] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-27T21:12:53.214948] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-27T21:12:53.270081] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T21:12:53.454855] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T21:12:53.457460] [INFO ] [REMOTE ] SOS: Full fetch complete (11268 records). [2025-10-27T21:12:53.457544] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-27T21:12:53.813705] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-27T21:12:53.813808] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-27T21:12:53.814080] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-27T21:12:53.814120] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-27T21:12:53.814612] [DEBUG] [LOCAL ] SOS: Trimmed 11268 records to 9774 (keeping 200 days of data) [2025-10-27T21:12:53.868482] [DEBUG] [LOCAL ] SOS: Primary data saved (9774 records). [2025-10-27T21:12:53.868599] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-27T21:12:53.868697] [INFO ] [MAIN ] Update Progress: 1963/2366 symbols completed. SOS took 14.8s. Estimated remaining: 51m 55s. Rate: 7.8 symbols/min [2025-10-27T21:12:54.020480] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-27T21:12:54.046991] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:54.096934] [DEBUG] [LOCAL ] SPCE: Loaded 50808 existing records from primary storage. [2025-10-27T21:12:54.097299] [INFO ] [MAIN ] SPCE: Loaded 50808 existing records. [2025-10-27T21:12:54.270099] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:54.270339] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-27T21:12:54.270386] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-27T21:12:54.270584] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-27T21:12:54.270677] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-27T21:12:54.625397] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:54.693479] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T21:12:54.814974] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-27T21:12:55.614981] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-27T21:12:55.903030] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T21:12:55.913148] [INFO ] [REMOTE ] SONY: Full fetch complete (77408 records). [2025-10-27T21:12:55.913264] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-27T21:12:56.301436] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-27T21:12:56.301524] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-27T21:12:56.302825] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-27T21:12:56.302890] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-27T21:12:56.304630] [DEBUG] [LOCAL ] SONY: Trimmed 77408 records to 53367 (keeping 200 days of data) [2025-10-27T21:12:56.419729] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-27T21:12:56.640597] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T21:12:56.650870] [DEBUG] [LOCAL ] SONY: Primary data saved (53367 records). [2025-10-27T21:12:56.651315] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-27T21:12:56.658558] [INFO ] [MAIN ] Update Progress: 1964/2366 symbols completed. SONY took 40.5s. Estimated remaining: 51m 46s. Rate: 7.8 symbols/min [2025-10-27T21:12:56.828860] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:56.859821] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-27T21:12:56.873596] [DEBUG] [LOCAL ] SPE: Loaded 6203 existing records from primary storage. [2025-10-27T21:12:56.873861] [INFO ] [MAIN ] SPE: Loaded 6203 existing records. [2025-10-27T21:12:57.048160] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:57.048435] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-27T21:12:57.048485] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-27T21:12:57.048635] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-27T21:12:57.048732] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-27T21:12:57.219966] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-27T21:12:57.408131] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:57.432732] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T21:12:57.441605] [INFO ] [REMOTE ] SOLV: Full fetch complete (63112 records). [2025-10-27T21:12:57.441869] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-27T21:12:57.443089] [FATAL] [VALIDATOR ] SOLV: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:12:57.443191] [FATAL] [MAIN ] SOLV: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:12:57.443236] [WARN ] [MAIN ] SOLV: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:12:57.443344] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-27T21:12:57.443443] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-27T21:12:57.443504] [INFO ] [LOCAL ] SOLV: Starting deletion of derivative data. [2025-10-27T21:12:57.443698] [DEBUG] [LOCAL ] SOLV: Deleted derivative data file. [2025-10-27T21:12:57.443802] [INFO ] [MAIN ] Update Progress: 1965/2366 symbols completed. SOLV took 41.3s. Estimated remaining: 51m 37s. Rate: 7.8 symbols/min [2025-10-27T21:12:57.648729] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:12:57.706323] [DEBUG] [LOCAL ] SPG: Loaded 50667 existing records from primary storage. [2025-10-27T21:12:57.706995] [INFO ] [MAIN ] SPG: Loaded 50667 existing records. [2025-10-27T21:12:57.892557] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:12:57.892897] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-27T21:12:57.892949] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-27T21:12:57.893547] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-27T21:12:57.893604] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-27T21:12:58.020163] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-27T21:12:58.277495] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:12:58.755836] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T21:12:58.814979] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-27T21:12:59.028829] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T21:12:59.348079] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T21:12:59.614969] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-27T21:13:00.415003] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-27T21:13:01.052994] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T21:13:01.214987] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-27T21:13:01.585366] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T21:13:01.754278] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-27T21:13:02.014995] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-27T21:13:02.814966] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-27T21:13:03.108494] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T21:13:03.614987] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-27T21:13:04.222633] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T21:13:04.414931] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-27T21:13:04.497700] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T21:13:05.214944] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-27T21:13:05.517407] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T21:13:05.731480] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T21:13:06.014943] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-27T21:13:06.814990] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-27T21:13:07.614944] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-27T21:13:07.642872] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T21:13:07.905164] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T21:13:08.414933] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-27T21:13:08.984783] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T21:13:09.214984] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-27T21:13:10.014919] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-27T21:13:10.052959] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T21:13:10.452346] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T21:13:10.815015] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-27T21:13:11.517458] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T21:13:11.614936] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-27T21:13:12.085204] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T21:13:12.387322] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T21:13:12.414899] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-27T21:13:13.214999] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-27T21:13:14.014981] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-27T21:13:14.084568] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:13:14.583022] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T21:13:14.814925] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-27T21:13:15.481520] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-27T21:13:15.614962] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-27T21:13:15.875368] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T21:13:16.414948] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-27T21:13:17.214964] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-27T21:13:17.533564] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:13:17.990050] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T21:13:18.014965] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-27T21:13:18.429850] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T21:13:18.814991] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-27T21:13:19.615023] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-27T21:13:19.861909] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-27T21:13:19.954975] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T21:13:20.414957] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-27T21:13:21.198355] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:13:21.214931] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-27T21:13:21.359522] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T21:13:22.014962] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-27T21:13:22.815003] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-27T21:13:22.884180] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T21:13:22.890465] [INFO ] [REMOTE ] SPB: Full fetch complete (47511 records). [2025-10-27T21:13:22.890604] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-27T21:13:23.322297] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-27T21:13:23.326088] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-27T21:13:23.328336] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-27T21:13:23.328977] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-27T21:13:23.330916] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-27T21:13:23.344494] [DEBUG] [LOCAL ] SPB: Trimmed 47511 records to 33564 (keeping 200 days of data) [2025-10-27T21:13:23.502188] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T21:13:23.518103] [INFO ] [REMOTE ] SPCE: Full fetch complete (72708 records). [2025-10-27T21:13:23.519684] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-27T21:13:23.617925] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-27T21:13:23.820381] [DEBUG] [LOCAL ] SPB: Primary data saved (33564 records). [2025-10-27T21:13:23.840829] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-27T21:13:23.881582] [INFO ] [MAIN ] Update Progress: 1966/2366 symbols completed. SPB took 35.3s. Estimated remaining: 51m 33s. Rate: 7.8 symbols/min [2025-10-27T21:13:24.189741] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-27T21:13:24.195012] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-27T21:13:24.201488] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-27T21:13:24.201581] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-27T21:13:24.266469] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:24.267476] [DEBUG] [LOCAL ] SPCE: Trimmed 72708 records to 50083 (keeping 200 days of data) [2025-10-27T21:13:24.449045] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-27T21:13:24.556828] [DEBUG] [LOCAL ] SPGI: Loaded 46599 existing records from primary storage. [2025-10-27T21:13:24.587480] [INFO ] [MAIN ] SPGI: Loaded 46599 existing records. [2025-10-27T21:13:24.740148] [DEBUG] [LOCAL ] SPCE: Primary data saved (50083 records). [2025-10-27T21:13:24.750724] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-27T21:13:24.764024] [INFO ] [MAIN ] Update Progress: 1967/2366 symbols completed. SPCE took 30.9s. Estimated remaining: 51m 24s. Rate: 7.8 symbols/min [2025-10-27T21:13:24.883560] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:24.914018] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-27T21:13:24.916874] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-27T21:13:24.922678] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-27T21:13:24.927888] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-27T21:13:25.032398] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:25.110340] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T21:13:25.235123] [DEBUG] [LOCAL ] SPH: Loaded 16659 existing records from primary storage. [2025-10-27T21:13:25.234282] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-27T21:13:25.251058] [INFO ] [MAIN ] SPH: Loaded 16659 existing records. [2025-10-27T21:13:25.486903] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:25.564622] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:25.564927] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-27T21:13:25.564985] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-27T21:13:25.565160] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-27T21:13:25.565201] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-27T21:13:25.785429] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-27T21:13:25.987263] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:26.014931] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-27T21:13:26.095414] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T21:13:26.097360] [INFO ] [REMOTE ] SPE: Full fetch complete (9758 records). [2025-10-27T21:13:26.097432] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-27T21:13:26.467710] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-27T21:13:26.467799] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-27T21:13:26.468148] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-27T21:13:26.468238] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-27T21:13:26.468733] [DEBUG] [LOCAL ] SPE: Trimmed 9758 records to 6006 (keeping 200 days of data) [2025-10-27T21:13:26.508883] [DEBUG] [LOCAL ] SPE: Primary data saved (6006 records). [2025-10-27T21:13:26.509011] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-27T21:13:26.509110] [INFO ] [MAIN ] Update Progress: 1968/2366 symbols completed. SPE took 29.9s. Estimated remaining: 51m 15s. Rate: 7.8 symbols/min [2025-10-27T21:13:26.685477] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:26.729117] [DEBUG] [LOCAL ] SPHR: Loaded 41291 existing records from primary storage. [2025-10-27T21:13:26.729536] [INFO ] [MAIN ] SPHR: Loaded 41291 existing records. [2025-10-27T21:13:26.818463] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-27T21:13:26.930099] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:26.930497] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-27T21:13:26.930551] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-27T21:13:26.930809] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-27T21:13:26.930868] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-27T21:13:27.127064] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T21:13:27.349920] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:27.614963] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-27T21:13:28.414992] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-27T21:13:28.569913] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T21:13:28.774329] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T21:13:29.214939] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-27T21:13:29.244958] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T21:13:30.014964] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-27T21:13:30.230506] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:13:30.814987] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-27T21:13:31.359096] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T21:13:31.368348] [INFO ] [REMOTE ] SPG: Full fetch complete (71669 records). [2025-10-27T21:13:31.368555] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-27T21:13:31.383607] [FATAL] [VALIDATOR ] SPG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:13:31.392994] [FATAL] [MAIN ] SPG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:13:31.393091] [WARN ] [MAIN ] SPG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:13:31.393362] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-27T21:13:31.394692] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T21:13:31.394793] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-10-27T21:13:31.403804] [INFO ] [LOCAL ] SPG: Starting deletion of derivative data. [2025-10-27T21:13:31.404194] [DEBUG] [LOCAL ] SPG: Deleted derivative data file. [2025-10-27T21:13:31.404892] [INFO ] [MAIN ] Update Progress: 1969/2366 symbols completed. SPG took 34.0s. Estimated remaining: 51m 6s. Rate: 7.8 symbols/min [2025-10-27T21:13:31.574797] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:31.613676] [DEBUG] [LOCAL ] SPIR: Loaded 37930 existing records from primary storage. [2025-10-27T21:13:31.614009] [INFO ] [MAIN ] SPIR: Loaded 37930 existing records. [2025-10-27T21:13:31.620044] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-27T21:13:31.823380] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:31.823882] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-27T21:13:31.823953] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-27T21:13:31.824197] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-27T21:13:31.824254] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-27T21:13:32.174751] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:32.414942] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-27T21:13:33.214988] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-27T21:13:33.357885] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T21:13:33.474746] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T21:13:34.014958] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-27T21:13:34.571859] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:13:34.814998] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-27T21:13:35.552881] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:13:35.614901] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-27T21:13:36.414970] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-27T21:13:36.457780] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:13:36.949970] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T21:13:37.212683] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T21:13:37.218560] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-27T21:13:38.014943] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-27T21:13:38.645080] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:13:38.814947] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-27T21:13:39.615012] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-27T21:13:40.087118] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-27T21:13:40.151558] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-27T21:13:40.414951] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-27T21:13:40.474329] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T21:13:41.214952] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-27T21:13:41.869216] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T21:13:42.014964] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-27T21:13:42.295903] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T21:13:42.814941] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-27T21:13:43.495547] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T21:13:43.614923] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-27T21:13:43.817922] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:13:44.414941] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-27T21:13:45.214923] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-27T21:13:45.356202] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:13:45.506789] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-27T21:13:46.014944] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-27T21:13:46.358293] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T21:13:46.814914] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-27T21:13:46.839859] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T21:13:47.614943] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-27T21:13:48.316993] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:13:48.414904] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-27T21:13:49.214955] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-27T21:13:49.552115] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T21:13:49.628365] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T21:13:50.014937] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-27T21:13:50.074987] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T21:13:50.814979] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-27T21:13:51.614999] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-27T21:13:51.751021] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:13:52.240455] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T21:13:52.381407] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T21:13:52.414913] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-27T21:13:53.214961] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-27T21:13:54.014941] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-27T21:13:54.092033] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T21:13:54.119750] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T21:13:54.479552] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-27T21:13:54.488636] [INFO ] [REMOTE ] SPGI: Full fetch complete (67486 records). [2025-10-27T21:13:54.488785] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-27T21:13:54.489511] [FATAL] [VALIDATOR ] SPGI: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:13:54.489595] [FATAL] [MAIN ] SPGI: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:13:54.489685] [WARN ] [MAIN ] SPGI: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:13:54.489745] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-27T21:13:54.489801] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-10-27T21:13:54.489835] [INFO ] [LOCAL ] SPGI: Starting deletion of derivative data. [2025-10-27T21:13:54.490150] [DEBUG] [LOCAL ] SPGI: Deleted derivative data file. [2025-10-27T21:13:54.490236] [INFO ] [MAIN ] Update Progress: 1970/2366 symbols completed. SPGI took 30.6s. Estimated remaining: 51m 2s. Rate: 7.8 symbols/min [2025-10-27T21:13:54.654478] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:54.662985] [DEBUG] [LOCAL ] SPMC: Loaded 5362 existing records from primary storage. [2025-10-27T21:13:54.663181] [INFO ] [MAIN ] SPMC: Loaded 5362 existing records. [2025-10-27T21:13:54.817181] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-27T21:13:54.838639] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:54.838865] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-27T21:13:54.838915] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-27T21:13:54.839054] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-27T21:13:54.839091] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-27T21:13:55.226025] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:55.528090] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T21:13:55.615004] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-27T21:13:56.414999] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-27T21:13:56.903435] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:13:57.214900] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-27T21:13:57.483138] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T21:13:57.491898] [INFO ] [REMOTE ] SPHR: Full fetch complete (58813 records). [2025-10-27T21:13:57.492005] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-27T21:13:57.863603] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-27T21:13:57.863717] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-27T21:13:57.864687] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-27T21:13:57.864748] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-27T21:13:57.865919] [DEBUG] [LOCAL ] SPHR: Trimmed 58813 records to 40518 (keeping 200 days of data) [2025-10-27T21:13:57.992387] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T21:13:57.998553] [INFO ] [REMOTE ] SPH: Full fetch complete (27629 records). [2025-10-27T21:13:57.999295] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-27T21:13:58.021922] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-27T21:13:58.504685] [DEBUG] [LOCAL ] SPHR: Primary data saved (40518 records). [2025-10-27T21:13:58.530090] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-27T21:13:58.543517] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-27T21:13:58.543329] [INFO ] [MAIN ] Update Progress: 1971/2366 symbols completed. SPHR took 32.0s. Estimated remaining: 50m 53s. Rate: 7.8 symbols/min [2025-10-27T21:13:58.543727] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-27T21:13:58.555998] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-27T21:13:58.576812] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-27T21:13:58.638855] [DEBUG] [LOCAL ] SPH: Trimmed 27629 records to 16274 (keeping 200 days of data) [2025-10-27T21:13:58.795128] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:58.796329] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-27T21:13:58.804317] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-27T21:13:58.804572] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-27T21:13:58.804694] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-27T21:13:58.804777] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-27T21:13:58.810601] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-27T21:13:58.818039] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T21:13:58.817430] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-27T21:13:58.941104] [DEBUG] [LOCAL ] SPH: Primary data saved (16274 records). [2025-10-27T21:13:58.946973] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-27T21:13:58.947083] [INFO ] [MAIN ] Update Progress: 1972/2366 symbols completed. SPH took 34.2s. Estimated remaining: 50m 44s. Rate: 7.8 symbols/min [2025-10-27T21:13:59.307159] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:13:59.369706] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:59.397503] [DEBUG] [LOCAL ] SPNT: Loaded 34643 existing records from primary storage. [2025-10-27T21:13:59.397794] [INFO ] [MAIN ] SPNT: Loaded 34643 existing records. [2025-10-27T21:13:59.598204] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:13:59.598412] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-27T21:13:59.598459] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-27T21:13:59.598837] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-27T21:13:59.598893] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-27T21:13:59.620056] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-10-27T21:13:59.954575] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:13:59.982457] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:13:59.982811] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-10-27T21:13:59.982920] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:13:59.983012] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-27T21:13:59.983102] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:13:59.983195] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-27T21:13:59.983277] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-27T21:13:59.983316] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-27T21:13:59.983356] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-27T21:13:59.983402] [INFO ] [MAIN ] Update Progress: 1973/2366 symbols completed. SPME took 1.4s. Estimated remaining: 50m 35s. Rate: 7.8 symbols/min [2025-10-27T21:14:00.154292] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:00.204134] [DEBUG] [LOCAL ] SPOT: Loaded 50911 existing records from primary storage. [2025-10-27T21:14:00.204449] [INFO ] [MAIN ] SPOT: Loaded 50911 existing records. [2025-10-27T21:14:00.376817] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:00.377002] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-27T21:14:00.377052] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-27T21:14:00.377229] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-27T21:14:00.377270] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-27T21:14:00.419493] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-27T21:14:00.741043] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:00.761922] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T21:14:01.214996] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-27T21:14:01.380718] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T21:14:02.014955] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-27T21:14:02.579331] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T21:14:02.814914] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-27T21:14:03.614995] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-27T21:14:04.219469] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T21:14:04.222563] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-27T21:14:04.414956] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-27T21:14:05.147860] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T21:14:05.214909] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-27T21:14:05.484016] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T21:14:06.014994] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-27T21:14:06.814949] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-27T21:14:06.864228] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T21:14:06.871377] [INFO ] [REMOTE ] SPIR: Full fetch complete (54188 records). [2025-10-27T21:14:06.871501] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-27T21:14:07.248954] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-27T21:14:07.249108] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-27T21:14:07.250158] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-27T21:14:07.250269] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-27T21:14:07.271934] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T21:14:07.279509] [DEBUG] [LOCAL ] SPIR: Trimmed 54188 records to 37107 (keeping 200 days of data) [2025-10-27T21:14:07.488920] [DEBUG] [LOCAL ] SPIR: Primary data saved (37107 records). [2025-10-27T21:14:07.489047] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-27T21:14:07.489730] [INFO ] [MAIN ] Update Progress: 1974/2366 symbols completed. SPIR took 36.1s. Estimated remaining: 50m 27s. Rate: 7.8 symbols/min [2025-10-27T21:14:07.623590] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-27T21:14:07.654203] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:07.693742] [DEBUG] [LOCAL ] SPR: Loaded 41211 existing records from primary storage. [2025-10-27T21:14:07.694027] [INFO ] [MAIN ] SPR: Loaded 41211 existing records. [2025-10-27T21:14:07.867383] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:07.867633] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-27T21:14:07.867713] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-27T21:14:07.867900] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-27T21:14:07.867955] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-27T21:14:08.207892] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:08.414908] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-27T21:14:08.520969] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T21:14:08.767779] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-27T21:14:09.214955] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-27T21:14:09.646339] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T21:14:10.014949] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-27T21:14:10.626808] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T21:14:10.814915] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-27T21:14:11.349777] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-27T21:14:11.615000] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-27T21:14:12.068575] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T21:14:12.420893] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-27T21:14:12.422191] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-27T21:14:13.026202] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T21:14:13.214987] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-27T21:14:13.883498] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T21:14:14.014939] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-27T21:14:14.732921] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T21:14:14.814958] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-27T21:14:15.614943] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-27T21:14:15.787098] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:14:16.414996] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-27T21:14:17.215001] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-27T21:14:17.581718] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:14:17.686437] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-27T21:14:17.688602] [INFO ] [REMOTE ] SPMC: Full fetch complete (8451 records). [2025-10-27T21:14:17.688736] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-27T21:14:18.024414] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-27T21:14:18.038717] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-27T21:14:18.091148] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-27T21:14:18.091220] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-27T21:14:18.091427] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-27T21:14:18.091464] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-27T21:14:18.091892] [DEBUG] [LOCAL ] SPMC: Trimmed 8451 records to 5211 (keeping 200 days of data) [2025-10-27T21:14:18.122110] [DEBUG] [LOCAL ] SPMC: Primary data saved (5211 records). [2025-10-27T21:14:18.122209] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-27T21:14:18.122282] [INFO ] [MAIN ] Update Progress: 1975/2366 symbols completed. SPMC took 23.6s. Estimated remaining: 50m 20s. Rate: 7.8 symbols/min [2025-10-27T21:14:18.285319] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:18.296487] [DEBUG] [LOCAL ] SPRU: Loaded 10078 existing records from primary storage. [2025-10-27T21:14:18.296719] [INFO ] [MAIN ] SPRU: Loaded 10078 existing records. [2025-10-27T21:14:18.467054] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:18.467250] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-27T21:14:18.467296] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-27T21:14:18.467436] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-27T21:14:18.467473] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-27T21:14:18.808495] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:18.814897] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-27T21:14:19.131102] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T21:14:19.293442] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T21:14:19.614929] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-27T21:14:20.414937] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-27T21:14:20.848980] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T21:14:21.214944] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-27T21:14:22.015003] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-27T21:14:22.514523] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T21:14:22.815582] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-27T21:14:22.815743] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-27T21:14:23.390604] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T21:14:23.614995] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-27T21:14:24.412454] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T21:14:24.420782] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-27T21:14:24.791716] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T21:14:24.923689] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T21:14:25.214951] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-27T21:14:26.014962] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-27T21:14:26.802743] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:14:26.814899] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-27T21:14:27.167760] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:14:27.614930] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-27T21:14:28.073766] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T21:14:28.414984] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-27T21:14:29.031361] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T21:14:29.214971] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-27T21:14:29.328410] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-27T21:14:29.700463] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-27T21:14:29.706073] [INFO ] [REMOTE ] SPNT: Full fetch complete (48196 records). [2025-10-27T21:14:29.706167] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-27T21:14:29.706885] [FATAL] [VALIDATOR ] SPNT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:14:29.706973] [FATAL] [MAIN ] SPNT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:14:29.707016] [WARN ] [MAIN ] SPNT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:14:29.707054] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-27T21:14:29.707110] [DEBUG] [LOCAL ] SPNT: No primary data file found to delete. [2025-10-27T21:14:29.707145] [INFO ] [LOCAL ] SPNT: Starting deletion of derivative data. [2025-10-27T21:14:29.707274] [DEBUG] [LOCAL ] SPNT: Deleted derivative data file. [2025-10-27T21:14:29.707361] [INFO ] [MAIN ] Update Progress: 1976/2366 symbols completed. SPNT took 30.8s. Estimated remaining: 50m 13s. Rate: 7.8 symbols/min [2025-10-27T21:14:29.871026] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:29.893589] [DEBUG] [LOCAL ] SPXC: Loaded 23428 existing records from primary storage. [2025-10-27T21:14:29.893864] [INFO ] [MAIN ] SPXC: Loaded 23428 existing records. [2025-10-27T21:14:30.020017] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-27T21:14:30.089590] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:30.089842] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-27T21:14:30.089892] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-27T21:14:30.090107] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-27T21:14:30.090150] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-27T21:14:30.438911] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:30.694695] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T21:14:30.814961] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-27T21:14:31.614965] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-27T21:14:31.939188] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:14:32.414996] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-27T21:14:33.214914] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-27T21:14:33.557880] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:14:33.635732] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-27T21:14:33.772066] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:14:34.014973] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-27T21:14:34.814946] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-27T21:14:35.223966] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T21:14:35.615000] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-27T21:14:36.414950] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-27T21:14:36.491499] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T21:14:36.553613] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T21:14:37.019210] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T21:14:37.214970] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-27T21:14:38.015025] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-27T21:14:38.204352] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:14:38.806662] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T21:14:38.814890] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-27T21:14:39.413468] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T21:14:39.614971] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-27T21:14:40.415049] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-27T21:14:41.215028] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-27T21:14:41.386931] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T21:14:41.390614] [INFO ] [REMOTE ] SPRU: Full fetch complete (12189 records). [2025-10-27T21:14:41.390736] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-27T21:14:41.775729] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-27T21:14:41.775940] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-27T21:14:41.776381] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-27T21:14:41.776564] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-27T21:14:41.801243] [DEBUG] [LOCAL ] SPRU: Trimmed 12189 records to 9926 (keeping 200 days of data) [2025-10-27T21:14:41.803388] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T21:14:41.858081] [INFO ] [REMOTE ] SPOT: Full fetch complete (73753 records). [2025-10-27T21:14:41.875728] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-27T21:14:41.875597] [DEBUG] [LOCAL ] SPRU: Primary data saved (9926 records). [2025-10-27T21:14:41.875919] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-27T21:14:41.876219] [INFO ] [MAIN ] Update Progress: 1977/2366 symbols completed. SPRU took 23.8s. Estimated remaining: 50m 6s. Rate: 7.8 symbols/min [2025-10-27T21:14:42.015397] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-27T21:14:42.256336] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:42.368309] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T21:14:42.433811] [DEBUG] [LOCAL ] SPXX: Loaded 9227 existing records from primary storage. [2025-10-27T21:14:42.447377] [INFO ] [MAIN ] SPXX: Loaded 9227 existing records. [2025-10-27T21:14:42.594447] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-27T21:14:42.594863] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-27T21:14:42.606456] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-27T21:14:42.616750] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-27T21:14:42.671058] [DEBUG] [LOCAL ] SPOT: Trimmed 73753 records to 50113 (keeping 200 days of data) [2025-10-27T21:14:42.677199] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:42.677941] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-27T21:14:42.678070] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-27T21:14:42.678247] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-27T21:14:42.678286] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-27T21:14:42.817797] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-27T21:14:43.354917] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:43.372988] [DEBUG] [LOCAL ] SPOT: Primary data saved (50113 records). [2025-10-27T21:14:43.373926] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-27T21:14:43.374432] [INFO ] [MAIN ] Update Progress: 1978/2366 symbols completed. SPOT took 43.4s. Estimated remaining: 49m 57s. Rate: 7.8 symbols/min [2025-10-27T21:14:43.541943] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:43.566789] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T21:14:43.614612] [DEBUG] [LOCAL ] SQM: Loaded 49634 existing records from primary storage. [2025-10-27T21:14:43.614959] [INFO ] [MAIN ] SQM: Loaded 49634 existing records. [2025-10-27T21:14:43.615095] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-27T21:14:43.793398] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:43.793726] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-27T21:14:43.793837] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-27T21:14:43.794126] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-27T21:14:43.794271] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-27T21:14:43.945989] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T21:14:44.159598] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:44.414947] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-27T21:14:44.966952] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T21:14:45.214959] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-27T21:14:45.285939] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-27T21:14:46.023892] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-27T21:14:46.026389] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T21:14:46.814966] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-27T21:14:46.957570] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-27T21:14:47.615005] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-27T21:14:48.393214] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T21:14:48.414949] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-27T21:14:48.638867] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T21:14:48.650776] [INFO ] [REMOTE ] SPR: Full fetch complete (59736 records). [2025-10-27T21:14:48.650986] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-27T21:14:49.130063] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-27T21:14:49.130152] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-27T21:14:49.131352] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-27T21:14:49.131419] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-27T21:14:49.132992] [DEBUG] [LOCAL ] SPR: Trimmed 59736 records to 40319 (keeping 200 days of data) [2025-10-27T21:14:49.227613] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-27T21:14:49.403555] [DEBUG] [LOCAL ] SPR: Primary data saved (40319 records). [2025-10-27T21:14:49.403707] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-27T21:14:49.404536] [INFO ] [MAIN ] Update Progress: 1979/2366 symbols completed. SPR took 41.9s. Estimated remaining: 49m 49s. Rate: 7.8 symbols/min [2025-10-27T21:14:49.593815] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:14:49.618210] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T21:14:49.653002] [DEBUG] [LOCAL ] SQNS: Loaded 28484 existing records from primary storage. [2025-10-27T21:14:49.653316] [INFO ] [MAIN ] SQNS: Loaded 28484 existing records. [2025-10-27T21:14:49.827389] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:14:49.827587] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-27T21:14:49.827634] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-27T21:14:49.827994] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-27T21:14:49.828050] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-27T21:14:50.020701] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-27T21:14:50.178063] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:14:50.454287] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T21:14:50.814914] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-27T21:14:50.964523] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T21:14:51.615013] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-27T21:14:52.329269] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T21:14:52.414912] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-27T21:14:52.774940] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T21:14:53.214994] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-27T21:14:54.014937] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-27T21:14:54.075551] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T21:14:54.120070] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T21:14:54.695781] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T21:14:54.814915] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-27T21:14:55.482170] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T21:14:55.614904] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-27T21:14:56.414915] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-27T21:14:56.494446] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T21:14:56.916807] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T21:14:57.214932] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-27T21:14:57.775803] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-27T21:14:58.015000] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-27T21:14:58.814987] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-27T21:14:59.420202] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T21:14:59.499079] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T21:14:59.614947] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-27T21:15:00.399824] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T21:15:00.414894] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-27T21:15:01.095138] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T21:15:01.214952] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-27T21:15:01.911915] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-27T21:15:02.014963] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-27T21:15:02.814992] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-27T21:15:03.010493] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T21:15:03.013246] [INFO ] [REMOTE ] SPXX: Full fetch complete (13464 records). [2025-10-27T21:15:03.013315] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-27T21:15:03.393868] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-27T21:15:03.393949] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-27T21:15:03.394302] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-27T21:15:03.394342] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-27T21:15:03.395001] [DEBUG] [LOCAL ] SPXX: Trimmed 13464 records to 8945 (keeping 200 days of data) [2025-10-27T21:15:03.448364] [DEBUG] [LOCAL ] SPXX: Primary data saved (8945 records). [2025-10-27T21:15:03.448498] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-27T21:15:03.448573] [INFO ] [MAIN ] Update Progress: 1980/2366 symbols completed. SPXX took 21.6s. Estimated remaining: 49m 43s. Rate: 7.8 symbols/min [2025-10-27T21:15:03.614437] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:03.614982] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-27T21:15:03.646509] [DEBUG] [LOCAL ] SR: Loaded 32679 existing records from primary storage. [2025-10-27T21:15:03.646846] [INFO ] [MAIN ] SR: Loaded 32679 existing records. [2025-10-27T21:15:03.768867] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T21:15:03.832030] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:03.832207] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-27T21:15:03.832253] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-27T21:15:03.832559] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-27T21:15:03.832613] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-27T21:15:04.180195] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:04.414921] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-27T21:15:05.214916] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-27T21:15:05.320679] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-27T21:15:05.452923] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:15:06.014918] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-27T21:15:06.247842] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T21:15:06.788929] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:15:06.793454] [INFO ] [REMOTE ] SPXC: Full fetch complete (33840 records). [2025-10-27T21:15:06.793638] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-27T21:15:06.794231] [FATAL] [VALIDATOR ] SPXC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:15:06.794312] [FATAL] [MAIN ] SPXC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:15:06.794354] [WARN ] [MAIN ] SPXC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:15:06.794392] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-27T21:15:06.794449] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-27T21:15:06.794485] [INFO ] [LOCAL ] SPXC: Starting deletion of derivative data. [2025-10-27T21:15:06.794616] [DEBUG] [LOCAL ] SPXC: Deleted derivative data file. [2025-10-27T21:15:06.794745] [INFO ] [MAIN ] Update Progress: 1981/2366 symbols completed. SPXC took 37.1s. Estimated remaining: 49m 34s. Rate: 7.8 symbols/min [2025-10-27T21:15:06.823130] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-27T21:15:06.965821] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:07.014437] [DEBUG] [LOCAL ] SRE: Loaded 54174 existing records from primary storage. [2025-10-27T21:15:07.014773] [INFO ] [MAIN ] SRE: Loaded 54174 existing records. [2025-10-27T21:15:07.192527] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:07.192748] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-27T21:15:07.192802] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-27T21:15:07.193026] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-27T21:15:07.193083] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-27T21:15:07.549408] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:07.614951] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-27T21:15:07.993228] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T21:15:08.414950] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-27T21:15:09.214960] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-27T21:15:09.668396] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T21:15:09.753419] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-27T21:15:10.014997] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-27T21:15:10.820239] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-27T21:15:10.837999] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T21:15:11.210024] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:15:11.614988] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-27T21:15:12.414919] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-27T21:15:12.761958] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-27T21:15:13.223536] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-27T21:15:13.228799] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T21:15:14.014953] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-27T21:15:14.086171] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T21:15:14.650266] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T21:15:14.814998] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-27T21:15:15.614932] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-27T21:15:16.015435] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T21:15:16.112343] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-27T21:15:16.414942] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-27T21:15:17.141124] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T21:15:17.214949] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-27T21:15:18.024467] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-27T21:15:18.046331] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:15:18.772349] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T21:15:18.814919] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-27T21:15:19.615268] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-27T21:15:19.619598] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-27T21:15:20.323206] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:15:20.414901] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-27T21:15:20.485215] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-27T21:15:20.490188] [INFO ] [REMOTE ] SQNS: Full fetch complete (33330 records). [2025-10-27T21:15:20.490265] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-27T21:15:20.852801] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-27T21:15:20.852871] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-27T21:15:20.853457] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-27T21:15:20.853516] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-27T21:15:20.854308] [DEBUG] [LOCAL ] SQNS: Trimmed 33330 records to 28649 (keeping 200 days of data) [2025-10-27T21:15:21.007415] [DEBUG] [LOCAL ] SQNS: Primary data saved (28649 records). [2025-10-27T21:15:21.007537] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-27T21:15:21.007612] [INFO ] [MAIN ] Update Progress: 1982/2366 symbols completed. SQNS took 31.6s. Estimated remaining: 49m 28s. Rate: 7.8 symbols/min [2025-10-27T21:15:21.173301] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:21.184118] [DEBUG] [LOCAL ] SREA: Loaded 9747 existing records from primary storage. [2025-10-27T21:15:21.184286] [INFO ] [MAIN ] SREA: Loaded 9747 existing records. [2025-10-27T21:15:21.220135] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-27T21:15:21.381937] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:21.382128] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-27T21:15:21.382172] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-27T21:15:21.382323] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-27T21:15:21.382358] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-27T21:15:21.742274] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:21.765092] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:15:22.014955] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-27T21:15:22.808841] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T21:15:22.819480] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-27T21:15:23.084771] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T21:15:23.614982] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-27T21:15:23.750538] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T21:15:24.414938] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-27T21:15:24.799723] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T21:15:24.805105] [INFO ] [REMOTE ] SR: Full fetch complete (45955 records). [2025-10-27T21:15:24.805193] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-27T21:15:24.805805] [FATAL] [VALIDATOR ] SR: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:15:24.805888] [FATAL] [MAIN ] SR: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:15:24.805929] [WARN ] [MAIN ] SR: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:15:24.805985] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-27T21:15:24.806041] [DEBUG] [LOCAL ] SR: No primary data file found to delete. [2025-10-27T21:15:24.806078] [INFO ] [LOCAL ] SR: Starting deletion of derivative data. [2025-10-27T21:15:24.806180] [DEBUG] [LOCAL ] SR: Deleted derivative data file. [2025-10-27T21:15:24.806244] [INFO ] [MAIN ] Update Progress: 1983/2366 symbols completed. SR took 21.4s. Estimated remaining: 49m 19s. Rate: 7.8 symbols/min [2025-10-27T21:15:24.972690] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:25.009128] [DEBUG] [LOCAL ] SRFM: Loaded 40757 existing records from primary storage. [2025-10-27T21:15:25.009424] [INFO ] [MAIN ] SRFM: Loaded 40757 existing records. [2025-10-27T21:15:25.192039] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:25.192293] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-27T21:15:25.192450] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-27T21:15:25.192759] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-27T21:15:25.192818] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-27T21:15:25.222236] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-27T21:15:25.504431] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:15:25.564088] [INFO ] [REMOTE ] SQM: Full fetch complete (69875 records). [2025-10-27T21:15:25.567172] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-27T21:15:25.660543] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:25.984194] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-27T21:15:25.984270] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-27T21:15:25.985314] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-27T21:15:25.985375] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-27T21:15:25.986666] [DEBUG] [LOCAL ] SQM: Trimmed 69875 records to 48867 (keeping 200 days of data) [2025-10-27T21:15:26.033233] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-27T21:15:26.263393] [DEBUG] [LOCAL ] SQM: Primary data saved (48867 records). [2025-10-27T21:15:26.263514] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-27T21:15:26.264068] [INFO ] [MAIN ] Update Progress: 1984/2366 symbols completed. SQM took 42.9s. Estimated remaining: 49m 10s. Rate: 7.8 symbols/min [2025-10-27T21:15:26.436817] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:26.453082] [DEBUG] [LOCAL ] SRG: Loaded 14928 existing records from primary storage. [2025-10-27T21:15:26.453324] [INFO ] [MAIN ] SRG: Loaded 14928 existing records. [2025-10-27T21:15:26.630183] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:26.630456] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-27T21:15:26.630564] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-27T21:15:26.630795] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-27T21:15:26.630847] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-27T21:15:26.825507] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-27T21:15:26.788976] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T21:15:26.987985] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T21:15:27.057439] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:27.614939] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-27T21:15:28.309403] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T21:15:28.414921] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-27T21:15:28.487772] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T21:15:29.214999] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-27T21:15:29.380898] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T21:15:30.014953] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-27T21:15:30.252411] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:15:30.814956] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-27T21:15:31.008408] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T21:15:31.614954] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-27T21:15:31.643456] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T21:15:32.414972] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-27T21:15:33.140557] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:15:33.162723] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T21:15:33.214906] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-27T21:15:34.014915] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-27T21:15:34.331745] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T21:15:34.804867] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T21:15:34.814905] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-27T21:15:35.614974] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-27T21:15:35.931235] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:15:36.415001] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-27T21:15:36.506094] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T21:15:37.138459] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T21:15:37.214975] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-27T21:15:38.015029] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-27T21:15:38.263507] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T21:15:38.815002] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-27T21:15:39.614939] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-27T21:15:39.769728] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T21:15:39.830440] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-27T21:15:40.277905] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T21:15:40.414961] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-27T21:15:41.214944] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-27T21:15:42.015004] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-27T21:15:42.143713] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T21:15:42.814937] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-27T21:15:42.833494] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T21:15:43.566292] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T21:15:43.620038] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-27T21:15:43.640459] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T21:15:44.414916] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-27T21:15:44.522489] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T21:15:44.532728] [INFO ] [REMOTE ] SRE: Full fetch complete (77097 records). [2025-10-27T21:15:44.532891] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-27T21:15:44.533889] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:15:44.534001] [FATAL] [MAIN ] SRE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:15:44.534043] [WARN ] [MAIN ] SRE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:15:44.534082] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-27T21:15:44.534136] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-10-27T21:15:44.534170] [INFO ] [LOCAL ] SRE: Starting deletion of derivative data. [2025-10-27T21:15:44.534333] [DEBUG] [LOCAL ] SRE: Deleted derivative data file. [2025-10-27T21:15:44.534442] [INFO ] [MAIN ] Update Progress: 1985/2366 symbols completed. SRE took 37.7s. Estimated remaining: 49m 5s. Rate: 7.8 symbols/min [2025-10-27T21:15:44.710174] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:44.734819] [DEBUG] [LOCAL ] SRI: Loaded 26448 existing records from primary storage. [2025-10-27T21:15:44.735081] [INFO ] [MAIN ] SRI: Loaded 26448 existing records. [2025-10-27T21:15:44.923783] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:44.923990] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-27T21:15:44.924036] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-27T21:15:44.924225] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-27T21:15:44.924281] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-27T21:15:45.220027] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-27T21:15:45.280637] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:45.914955] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-27T21:15:46.014958] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-27T21:15:46.059679] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T21:15:46.814997] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-27T21:15:46.854919] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T21:15:47.615012] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-27T21:15:48.256558] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T21:15:48.414952] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-27T21:15:48.837925] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T21:15:49.072685] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T21:15:49.214940] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-27T21:15:50.014984] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-27T21:15:50.040429] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T21:15:50.815016] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-27T21:15:51.106201] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T21:15:51.615011] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-27T21:15:51.728328] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T21:15:51.731699] [INFO ] [REMOTE ] SRG: Full fetch complete (23242 records). [2025-10-27T21:15:51.731779] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-27T21:15:52.124373] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-27T21:15:52.124621] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-27T21:15:52.125338] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-27T21:15:52.128117] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-27T21:15:52.131605] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:15:52.134159] [INFO ] [REMOTE ] SREA: Full fetch complete (14606 records). [2025-10-27T21:15:52.134271] [DEBUG] [LOCAL ] SRG: Trimmed 23242 records to 14441 (keeping 200 days of data) [2025-10-27T21:15:52.134515] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-27T21:15:52.417840] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-27T21:15:52.414406] [DEBUG] [LOCAL ] SRG: Primary data saved (14441 records). [2025-10-27T21:15:52.439383] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-27T21:15:52.489918] [INFO ] [MAIN ] Update Progress: 1986/2366 symbols completed. SRG took 26.2s. Estimated remaining: 48m 57s. Rate: 7.8 symbols/min [2025-10-27T21:15:52.808692] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:52.817204] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-27T21:15:52.817281] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-27T21:15:52.817730] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-27T21:15:52.817803] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-27T21:15:52.817080] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-27T21:15:52.817981] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-27T21:15:52.818579] [DEBUG] [LOCAL ] SREA: Trimmed 14606 records to 9512 (keeping 200 days of data) [2025-10-27T21:15:52.818677] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-27T21:15:52.818750] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-27T21:15:52.819070] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-27T21:15:52.819268] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-27T21:15:53.016497] [DEBUG] [LOCAL ] SREA: Primary data saved (9512 records). [2025-10-27T21:15:53.021818] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-27T21:15:53.034574] [INFO ] [MAIN ] Update Progress: 1987/2366 symbols completed. SREA took 32.0s. Estimated remaining: 48m 48s. Rate: 7.8 symbols/min [2025-10-27T21:15:53.236270] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-27T21:15:53.418035] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:53.439038] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:53.448804] [DEBUG] [LOCAL ] SRV: Loaded 7466 existing records from primary storage. [2025-10-27T21:15:53.449127] [INFO ] [MAIN ] SRV: Loaded 7466 existing records. [2025-10-27T21:15:53.629921] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:53.630124] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-27T21:15:53.630170] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-27T21:15:53.630392] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-27T21:15:53.630448] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-27T21:15:53.939719] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T21:15:54.011050] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:54.014901] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-27T21:15:54.815000] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-27T21:15:54.915864] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T21:15:55.163628] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-27T21:15:55.173633] [INFO ] [REMOTE ] SRFM: Full fetch complete (51710 records). [2025-10-27T21:15:55.173809] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-27T21:15:55.557357] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-27T21:15:55.557433] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-27T21:15:55.558443] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-27T21:15:55.558506] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-27T21:15:55.559568] [DEBUG] [LOCAL ] SRFM: Trimmed 51710 records to 40662 (keeping 200 days of data) [2025-10-27T21:15:55.639269] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-27T21:15:55.784733] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T21:15:55.826041] [DEBUG] [LOCAL ] SRFM: Primary data saved (40662 records). [2025-10-27T21:15:55.826183] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-27T21:15:55.826265] [INFO ] [MAIN ] Update Progress: 1988/2366 symbols completed. SRFM took 31.0s. Estimated remaining: 48m 39s. Rate: 7.8 symbols/min [2025-10-27T21:15:55.995555] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:15:56.034112] [DEBUG] [LOCAL ] SSB: Loaded 43425 existing records from primary storage. [2025-10-27T21:15:56.034389] [INFO ] [MAIN ] SSB: Loaded 43425 existing records. [2025-10-27T21:15:56.210745] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:15:56.210960] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-27T21:15:56.211036] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-27T21:15:56.211351] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-27T21:15:56.211421] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-27T21:15:56.396397] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T21:15:56.420913] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-27T21:15:56.580529] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:15:56.937770] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T21:15:57.214961] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-27T21:15:57.896867] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T21:15:58.015054] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-27T21:15:58.814938] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-27T21:15:59.258596] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T21:15:59.279145] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T21:15:59.614950] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-27T21:16:00.414957] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-27T21:16:00.902374] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T21:16:00.904352] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T21:16:01.214957] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-27T21:16:02.014986] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-27T21:16:02.624176] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-27T21:16:02.640859] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T21:16:02.814944] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-27T21:16:03.369816] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T21:16:03.614944] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-27T21:16:04.414921] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-27T21:16:04.492561] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T21:16:04.890414] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-27T21:16:05.214937] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-27T21:16:06.014930] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-27T21:16:06.121266] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T21:16:06.814917] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-27T21:16:07.577130] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-27T21:16:07.614896] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-27T21:16:07.712765] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-27T21:16:08.415002] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-27T21:16:09.042750] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:16:09.214935] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-27T21:16:09.274222] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T21:16:09.717088] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-27T21:16:10.014936] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-27T21:16:10.814947] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-27T21:16:11.170386] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T21:16:11.563075] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T21:16:11.614938] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-27T21:16:12.162675] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T21:16:12.164504] [INFO ] [REMOTE ] SRV: Full fetch complete (11217 records). [2025-10-27T21:16:12.164571] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-27T21:16:12.420139] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-27T21:16:12.545800] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-27T21:16:12.545878] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-27T21:16:12.546200] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-27T21:16:12.546238] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-27T21:16:12.546755] [DEBUG] [LOCAL ] SRV: Trimmed 11217 records to 7153 (keeping 200 days of data) [2025-10-27T21:16:12.590403] [DEBUG] [LOCAL ] SRV: Primary data saved (7153 records). [2025-10-27T21:16:12.590532] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-27T21:16:12.590611] [INFO ] [MAIN ] Update Progress: 1989/2366 symbols completed. SRV took 19.6s. Estimated remaining: 48m 33s. Rate: 7.8 symbols/min [2025-10-27T21:16:12.765574] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:12.787689] [DEBUG] [LOCAL ] SSD: Loaded 22635 existing records from primary storage. [2025-10-27T21:16:12.787931] [INFO ] [MAIN ] SSD: Loaded 22635 existing records. [2025-10-27T21:16:12.962415] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:12.964658] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T21:16:12.964825] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-27T21:16:12.965893] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-27T21:16:12.966068] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-27T21:16:12.966106] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-27T21:16:13.220070] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-27T21:16:13.316931] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:13.624112] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:16:14.014943] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-27T21:16:14.814944] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-27T21:16:15.008746] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T21:16:15.614947] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-27T21:16:15.729756] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T21:16:16.414934] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-27T21:16:16.951875] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T21:16:17.214922] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-27T21:16:17.416563] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T21:16:18.014945] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-27T21:16:18.180492] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T21:16:18.461303] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T21:16:18.814927] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-27T21:16:19.265126] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T21:16:19.266178] [INFO ] [REMOTE ] SRL: Full fetch complete (1639 records). [2025-10-27T21:16:19.266249] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-27T21:16:19.446194] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-27T21:16:19.446385] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:16:19.446453] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:16:19.446524] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-27T21:16:19.446588] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-27T21:16:19.446682] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-27T21:16:19.446745] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-27T21:16:19.446804] [INFO ] [MAIN ] Update Progress: 1990/2366 symbols completed. SRL took 27.0s. Estimated remaining: 48m 25s. Rate: 7.8 symbols/min [2025-10-27T21:16:19.613633] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:19.614906] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-27T21:16:19.655188] [DEBUG] [LOCAL ] SSL: Loaded 42027 existing records from primary storage. [2025-10-27T21:16:19.655470] [INFO ] [MAIN ] SSL: Loaded 42027 existing records. [2025-10-27T21:16:19.835088] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:19.835295] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-27T21:16:19.835341] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-27T21:16:19.835514] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-27T21:16:19.835553] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-27T21:16:20.199063] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:20.417326] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-27T21:16:20.420711] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-27T21:16:21.214922] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-27T21:16:21.243144] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T21:16:22.014936] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-27T21:16:22.814968] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-27T21:16:22.938555] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T21:16:23.046751] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T21:16:23.614945] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-27T21:16:24.085066] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T21:16:24.409425] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-27T21:16:24.414888] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-27T21:16:25.214924] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-27T21:16:25.250066] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T21:16:25.985668] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:16:25.989618] [INFO ] [REMOTE ] SRI: Full fetch complete (39414 records). [2025-10-27T21:16:25.989740] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-27T21:16:26.020101] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-27T21:16:26.362636] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-27T21:16:26.362741] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-27T21:16:26.363550] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-27T21:16:26.363611] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-27T21:16:26.364473] [DEBUG] [LOCAL ] SRI: Trimmed 39414 records to 25815 (keeping 200 days of data) [2025-10-27T21:16:26.504032] [DEBUG] [LOCAL ] SRI: Primary data saved (25815 records). [2025-10-27T21:16:26.504159] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-27T21:16:26.504236] [INFO ] [MAIN ] Update Progress: 1991/2366 symbols completed. SRI took 42.0s. Estimated remaining: 48m 17s. Rate: 7.8 symbols/min [2025-10-27T21:16:26.668598] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:26.680747] [DEBUG] [LOCAL ] SST: Loaded 11437 existing records from primary storage. [2025-10-27T21:16:26.680963] [INFO ] [MAIN ] SST: Loaded 11437 existing records. [2025-10-27T21:16:26.820110] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-27T21:16:26.855870] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:26.856075] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-27T21:16:26.856143] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-27T21:16:26.856293] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-27T21:16:26.856329] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-27T21:16:27.237822] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:27.614911] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-27T21:16:27.780034] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:16:28.077400] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:16:28.414163] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T21:16:28.419581] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-27T21:16:29.016428] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T21:16:29.214985] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-27T21:16:30.014999] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-27T21:16:30.707261] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T21:16:30.814922] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-27T21:16:30.905449] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T21:16:31.614949] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-27T21:16:31.984092] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:16:32.305183] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T21:16:32.414966] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-27T21:16:33.215024] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-27T21:16:33.728348] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-27T21:16:34.014930] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-27T21:16:34.814919] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-27T21:16:34.906018] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T21:16:35.162997] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T21:16:35.615007] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-27T21:16:35.697390] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T21:16:36.414951] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-27T21:16:37.214928] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-27T21:16:37.289514] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T21:16:37.407305] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T21:16:38.014947] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-27T21:16:38.728995] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T21:16:38.779799] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T21:16:38.814901] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-27T21:16:39.614985] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-27T21:16:39.786254] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:16:40.414952] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-27T21:16:41.117190] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-27T21:16:41.121340] [INFO ] [REMOTE ] SSD: Full fetch complete (32346 records). [2025-10-27T21:16:41.121474] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-27T21:16:41.122052] [FATAL] [VALIDATOR ] SSD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:16:41.122133] [FATAL] [MAIN ] SSD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:16:41.122174] [WARN ] [MAIN ] SSD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:16:41.122238] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-27T21:16:41.122299] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-27T21:16:41.122333] [INFO ] [LOCAL ] SSD: Starting deletion of derivative data. [2025-10-27T21:16:41.122474] [DEBUG] [LOCAL ] SSD: Deleted derivative data file. [2025-10-27T21:16:41.122558] [INFO ] [MAIN ] Update Progress: 1992/2366 symbols completed. SSD took 28.5s. Estimated remaining: 48m 11s. Rate: 7.8 symbols/min [2025-10-27T21:16:41.222083] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-27T21:16:41.301389] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:41.327876] [DEBUG] [LOCAL ] SSTK: Loaded 25564 existing records from primary storage. [2025-10-27T21:16:41.328184] [INFO ] [MAIN ] SSTK: Loaded 25564 existing records. [2025-10-27T21:16:41.533446] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:41.546137] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-27T21:16:41.546070] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-27T21:16:41.554788] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-27T21:16:41.555448] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-27T21:16:41.555508] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-27T21:16:41.915819] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:42.014911] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-27T21:16:42.254786] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T21:16:42.814956] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-27T21:16:43.615040] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-27T21:16:43.668149] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T21:16:43.725557] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T21:16:44.414996] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-27T21:16:45.001576] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T21:16:45.214955] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-27T21:16:45.420006] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T21:16:45.739459] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:16:45.747797] [INFO ] [REMOTE ] SSB: Full fetch complete (61259 records). [2025-10-27T21:16:45.747951] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-27T21:16:45.748696] [FATAL] [VALIDATOR ] SSB: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:16:45.748784] [FATAL] [MAIN ] SSB: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:16:45.748826] [WARN ] [MAIN ] SSB: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:16:45.748867] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-27T21:16:45.748927] [DEBUG] [LOCAL ] SSB: No primary data file found to delete. [2025-10-27T21:16:45.748984] [INFO ] [LOCAL ] SSB: Starting deletion of derivative data. [2025-10-27T21:16:45.749128] [DEBUG] [LOCAL ] SSB: Deleted derivative data file. [2025-10-27T21:16:45.749217] [INFO ] [MAIN ] Update Progress: 1993/2366 symbols completed. SSB took 49.9s. Estimated remaining: 48m 3s. Rate: 7.8 symbols/min [2025-10-27T21:16:45.929230] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:45.978847] [DEBUG] [LOCAL ] ST: Loaded 50376 existing records from primary storage. [2025-10-27T21:16:45.979168] [INFO ] [MAIN ] ST: Loaded 50376 existing records. [2025-10-27T21:16:46.020097] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-27T21:16:46.196694] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:46.196967] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-27T21:16:46.197029] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-27T21:16:46.197277] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-27T21:16:46.197354] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-27T21:16:46.654194] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:46.814994] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-27T21:16:47.186778] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T21:16:47.320182] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:16:47.321764] [INFO ] [REMOTE ] SST: Full fetch complete (17667 records). [2025-10-27T21:16:47.321839] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-27T21:16:47.620135] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-27T21:16:47.695839] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-27T21:16:47.695915] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-27T21:16:47.696299] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-27T21:16:47.696337] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-27T21:16:47.696884] [DEBUG] [LOCAL ] SST: Trimmed 17667 records to 11226 (keeping 200 days of data) [2025-10-27T21:16:47.757727] [DEBUG] [LOCAL ] SST: Primary data saved (11226 records). [2025-10-27T21:16:47.757840] [INFO ] [MAIN ] SST: Full history saved. [2025-10-27T21:16:47.757915] [INFO ] [MAIN ] Update Progress: 1994/2366 symbols completed. SST took 21.3s. Estimated remaining: 47m 54s. Rate: 7.8 symbols/min [2025-10-27T21:16:47.927769] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:47.972596] [DEBUG] [LOCAL ] STAG: Loaded 50774 existing records from primary storage. [2025-10-27T21:16:47.972921] [INFO ] [MAIN ] STAG: Loaded 50774 existing records. [2025-10-27T21:16:48.148493] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:48.148718] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-27T21:16:48.148773] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-27T21:16:48.149272] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-27T21:16:48.149309] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-27T21:16:48.420111] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-27T21:16:48.499294] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:49.214969] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-27T21:16:49.296952] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T21:16:49.612113] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:16:50.014979] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-27T21:16:50.655008] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T21:16:50.814926] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-27T21:16:51.614956] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-27T21:16:51.677345] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T21:16:51.689468] [INFO ] [REMOTE ] SSL: Full fetch complete (60073 records). [2025-10-27T21:16:51.689686] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-27T21:16:52.077626] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-27T21:16:52.077729] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-27T21:16:52.078711] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-27T21:16:52.078773] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-27T21:16:52.079943] [DEBUG] [LOCAL ] SSL: Trimmed 60073 records to 41245 (keeping 200 days of data) [2025-10-27T21:16:52.311100] [DEBUG] [LOCAL ] SSL: Primary data saved (41245 records). [2025-10-27T21:16:52.311214] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-27T21:16:52.311705] [INFO ] [MAIN ] Update Progress: 1995/2366 symbols completed. SSL took 32.9s. Estimated remaining: 47m 46s. Rate: 7.8 symbols/min [2025-10-27T21:16:52.419204] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-27T21:16:52.490994] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:16:52.521872] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:16:52.543627] [DEBUG] [LOCAL ] STC: Loaded 17730 existing records from primary storage. [2025-10-27T21:16:52.543881] [INFO ] [MAIN ] STC: Loaded 17730 existing records. [2025-10-27T21:16:52.720108] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:16:52.720309] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-27T21:16:52.720393] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-27T21:16:52.720619] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-27T21:16:52.720698] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-27T21:16:53.068003] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:16:53.214931] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-27T21:16:53.392560] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T21:16:53.897494] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-27T21:16:54.014127] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T21:16:54.018445] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-27T21:16:54.814947] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-27T21:16:55.424162] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T21:16:55.573942] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-27T21:16:55.614900] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-27T21:16:56.420031] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-27T21:16:56.425564] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T21:16:57.214950] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-27T21:16:57.471626] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T21:16:58.014987] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-27T21:16:58.043752] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-27T21:16:58.815008] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-27T21:16:59.463905] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T21:16:59.613035] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T21:16:59.618879] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-27T21:17:00.414957] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-27T21:17:01.214831] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T21:17:01.215006] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-27T21:17:01.602930] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T21:17:02.015004] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-27T21:17:02.814993] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-27T21:17:03.015807] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T21:17:03.331116] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T21:17:03.609949] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T21:17:03.614886] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-27T21:17:04.414935] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-27T21:17:04.874625] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:17:05.214993] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-27T21:17:05.605564] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-27T21:17:05.962424] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T21:17:06.014931] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-27T21:17:06.814943] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-27T21:17:07.555381] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:17:07.614914] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-27T21:17:07.810302] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-27T21:17:07.988345] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:17:07.991695] [INFO ] [REMOTE ] STC: Full fetch complete (25435 records). [2025-10-27T21:17:07.991770] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-27T21:17:07.992246] [FATAL] [VALIDATOR ] STC: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:07.992329] [FATAL] [MAIN ] STC: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:07.992372] [WARN ] [MAIN ] STC: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:07.992414] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-27T21:17:07.992471] [DEBUG] [LOCAL ] STC: No primary data file found to delete. [2025-10-27T21:17:07.992516] [INFO ] [LOCAL ] STC: Starting deletion of derivative data. [2025-10-27T21:17:07.992679] [DEBUG] [LOCAL ] STC: Deleted derivative data file. [2025-10-27T21:17:07.992768] [INFO ] [MAIN ] Update Progress: 1996/2366 symbols completed. STC took 15.7s. Estimated remaining: 47m 39s. Rate: 7.8 symbols/min [2025-10-27T21:17:08.167609] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:08.202219] [DEBUG] [LOCAL ] STE: Loaded 35501 existing records from primary storage. [2025-10-27T21:17:08.202562] [INFO ] [MAIN ] STE: Loaded 35501 existing records. [2025-10-27T21:17:08.391211] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:08.391448] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-27T21:17:08.391495] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-27T21:17:08.391733] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-27T21:17:08.391789] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-27T21:17:08.420112] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-27T21:17:08.793877] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:09.215023] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-27T21:17:09.720376] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T21:17:10.014943] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-27T21:17:10.814923] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-27T21:17:10.930542] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T21:17:11.138233] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T21:17:11.614949] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-27T21:17:12.414928] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-27T21:17:12.501871] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T21:17:13.214950] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-27T21:17:13.275936] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T21:17:13.858735] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T21:17:14.014971] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-27T21:17:14.223478] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T21:17:14.815004] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-27T21:17:15.291155] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T21:17:15.614970] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-27T21:17:16.112240] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:17:16.414968] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-27T21:17:16.913927] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T21:17:17.214974] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-27T21:17:17.806864] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:17:18.014944] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-27T21:17:18.514393] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T21:17:18.814949] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-27T21:17:19.431488] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T21:17:19.614948] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-27T21:17:20.057249] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:17:20.361961] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T21:17:20.367208] [INFO ] [REMOTE ] SSTK: Full fetch complete (40986 records). [2025-10-27T21:17:20.367291] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-27T21:17:20.367840] [FATAL] [VALIDATOR ] SSTK: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:20.367939] [FATAL] [MAIN ] SSTK: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:20.367980] [WARN ] [MAIN ] SSTK: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:20.368039] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-27T21:17:20.368103] [DEBUG] [LOCAL ] SSTK: No primary data file found to delete. [2025-10-27T21:17:20.368136] [INFO ] [LOCAL ] SSTK: Starting deletion of derivative data. [2025-10-27T21:17:20.368259] [DEBUG] [LOCAL ] SSTK: Deleted derivative data file. [2025-10-27T21:17:20.368325] [INFO ] [MAIN ] Update Progress: 1997/2366 symbols completed. SSTK took 39.2s. Estimated remaining: 47m 32s. Rate: 7.8 symbols/min [2025-10-27T21:17:20.414912] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-27T21:17:20.855933] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T21:17:20.864916] [INFO ] [REMOTE ] ST: Full fetch complete (71769 records). [2025-10-27T21:17:20.865029] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-27T21:17:20.865727] [FATAL] [VALIDATOR ] ST: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:20.865823] [FATAL] [MAIN ] ST: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:20.865893] [WARN ] [MAIN ] ST: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:20.865985] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-27T21:17:20.866067] [DEBUG] [LOCAL ] ST: No primary data file found to delete. [2025-10-27T21:17:20.866105] [INFO ] [LOCAL ] ST: Starting deletion of derivative data. [2025-10-27T21:17:20.866225] [DEBUG] [LOCAL ] ST: Deleted derivative data file. [2025-10-27T21:17:20.866293] [INFO ] [MAIN ] Update Progress: 1998/2366 symbols completed. ST took 35.1s. Estimated remaining: 47m 23s. Rate: 7.8 symbols/min [2025-10-27T21:17:21.214966] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-27T21:17:22.014976] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-27T21:17:22.668020] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T21:17:22.814904] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-27T21:17:23.858634] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T21:17:23.870779] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-27T21:17:23.975916] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:17:24.414992] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-27T21:17:25.682810] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T21:17:25.693134] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-27T21:17:25.760071] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:17:26.015009] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-27T21:17:26.922008] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T21:17:26.930015] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-27T21:17:27.015310] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T21:17:27.430515] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T21:17:27.436749] [INFO ] [REMOTE ] STE: Full fetch complete (50550 records). [2025-10-27T21:17:27.436854] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-27T21:17:27.437464] [FATAL] [VALIDATOR ] STE: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:27.437587] [FATAL] [MAIN ] STE: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:27.437694] [WARN ] [MAIN ] STE: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:27.437785] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-27T21:17:27.437860] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-27T21:17:27.437897] [INFO ] [LOCAL ] STE: Starting deletion of derivative data. [2025-10-27T21:17:27.438022] [DEBUG] [LOCAL ] STE: Deleted derivative data file. [2025-10-27T21:17:27.438375] [INFO ] [MAIN ] Update Progress: 1999/2366 symbols completed. STE took 19.4s. Estimated remaining: 47m 15s. Rate: 7.8 symbols/min [2025-10-27T21:17:27.614967] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-27T21:17:28.192299] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T21:17:28.201408] [INFO ] [REMOTE ] STAG: Full fetch complete (72199 records). [2025-10-27T21:17:28.201517] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-27T21:17:28.202285] [FATAL] [VALIDATOR ] STAG: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:28.202372] [FATAL] [MAIN ] STAG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:28.202414] [WARN ] [MAIN ] STAG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:28.202450] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-27T21:17:28.202505] [DEBUG] [LOCAL ] STAG: No primary data file found to delete. [2025-10-27T21:17:28.202537] [INFO ] [LOCAL ] STAG: Starting deletion of derivative data. [2025-10-27T21:17:28.202713] [DEBUG] [LOCAL ] STAG: Deleted derivative data file. [2025-10-27T21:17:28.202799] [INFO ] [MAIN ] Update Progress: 2000/2366 symbols completed. STAG took 40.4s. Estimated remaining: 47m 6s. Rate: 7.8 symbols/min [2025-10-27T21:17:28.800365] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:28.884363] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:28.894490] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:28.895092] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-27T21:17:28.900925] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-27T21:17:28.906562] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-27T21:17:28.912022] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-27T21:17:28.917697] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-27T21:17:28.932168] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-27T21:17:29.022441] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:29.119382] [DEBUG] [LOCAL ] STEW: Loaded 15263 existing records from primary storage. [2025-10-27T21:17:29.132164] [INFO ] [MAIN ] STEW: Loaded 15263 existing records. [2025-10-27T21:17:29.217986] [DEBUG] [LOCAL ] STEM: Loaded 38856 existing records from primary storage. [2025-10-27T21:17:29.337027] [DEBUG] [LOCAL ] STEL: Loaded 22596 existing records from primary storage. [2025-10-27T21:17:29.295738] [INFO ] [MAIN ] STEM: Loaded 38856 existing records. [2025-10-27T21:17:29.438443] [INFO ] [MAIN ] STEL: Loaded 22596 existing records. [2025-10-27T21:17:29.768947] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:29.944151] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-27T21:17:29.943961] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:29.965404] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-27T21:17:29.986728] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-27T21:17:29.997229] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-27T21:17:29.980730] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:30.022732] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-27T21:17:30.032383] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-27T21:17:30.061306] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:30.070997] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-27T21:17:30.117737] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-27T21:17:30.132031] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-27T21:17:30.131940] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-27T21:17:30.150384] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-27T21:17:30.204868] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-27T21:17:30.255277] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-27T21:17:30.684542] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-27T21:17:30.746325] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-27T21:17:31.070911] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:31.152866] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-27T21:17:31.142058] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:31.188662] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-27T21:17:31.211198] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:31.246069] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T21:17:31.614953] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-27T21:17:31.831962] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T21:17:31.990146] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T21:17:32.414944] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-27T21:17:32.821827] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-27T21:17:33.214941] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-27T21:17:33.539969] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-27T21:17:34.014995] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-27T21:17:34.197116] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T21:17:34.402592] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-27T21:17:34.814985] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-27T21:17:35.614978] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-27T21:17:35.948387] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T21:17:36.414962] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-27T21:17:36.794052] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T21:17:36.990836] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T21:17:37.214969] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-27T21:17:37.719455] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T21:17:38.014976] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-27T21:17:38.659682] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-27T21:17:38.814935] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-27T21:17:39.614923] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-27T21:17:39.914277] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T21:17:40.414924] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-27T21:17:41.214931] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-27T21:17:41.254971] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T21:17:41.594342] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T21:17:41.715304] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:17:42.014969] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-27T21:17:42.814952] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-27T21:17:43.420549] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T21:17:43.541005] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T21:17:43.614920] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-27T21:17:44.414996] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-27T21:17:44.469245] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T21:17:45.188911] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T21:17:45.214964] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-27T21:17:45.576842] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T21:17:45.577620] [INFO ] [REMOTE ] STG: Full fetch complete (2490 records). [2025-10-27T21:17:45.577713] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-27T21:17:45.757248] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-27T21:17:45.757448] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:45.757518] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:45.757588] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-27T21:17:45.757672] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-27T21:17:45.757728] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-27T21:17:45.757773] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-27T21:17:45.757827] [INFO ] [MAIN ] Update Progress: 2001/2366 symbols completed. STG took 17.6s. Estimated remaining: 47m 1s. Rate: 7.8 symbols/min [2025-10-27T21:17:45.926468] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:45.937471] [DEBUG] [LOCAL ] STK: Loaded 9856 existing records from primary storage. [2025-10-27T21:17:45.937673] [INFO ] [MAIN ] STK: Loaded 9856 existing records. [2025-10-27T21:17:46.020121] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-27T21:17:46.115716] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:46.115949] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-27T21:17:46.116034] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-27T21:17:46.116202] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-27T21:17:46.116238] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-27T21:17:46.484197] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:46.814944] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-27T21:17:47.247990] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T21:17:47.458834] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T21:17:47.614960] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-27T21:17:48.290375] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T21:17:48.414948] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-27T21:17:49.215015] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-27T21:17:49.411606] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:17:50.014950] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-27T21:17:50.152793] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T21:17:50.814979] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-27T21:17:50.872952] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T21:17:51.572258] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T21:17:51.614938] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-27T21:17:52.414937] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-27T21:17:52.819550] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T21:17:53.214984] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-27T21:17:53.293329] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T21:17:53.871341] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T21:17:54.015031] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-27T21:17:54.629802] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T21:17:54.815041] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-27T21:17:55.399892] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T21:17:55.614945] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-27T21:17:56.294799] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T21:17:56.297677] [INFO ] [REMOTE ] STEW: Full fetch complete (21794 records). [2025-10-27T21:17:56.297756] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-27T21:17:56.420063] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-27T21:17:56.660877] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-27T21:17:56.660948] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-27T21:17:56.661398] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-27T21:17:56.661436] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-27T21:17:56.662026] [DEBUG] [LOCAL ] STEW: Trimmed 21794 records to 14632 (keeping 200 days of data) [2025-10-27T21:17:56.749372] [DEBUG] [LOCAL ] STEW: Primary data saved (14632 records). [2025-10-27T21:17:56.749501] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-27T21:17:56.749579] [INFO ] [MAIN ] Update Progress: 2002/2366 symbols completed. STEW took 28.5s. Estimated remaining: 46m 53s. Rate: 7.8 symbols/min [2025-10-27T21:17:56.914173] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:56.925701] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:17:56.929981] [INFO ] [REMOTE ] STEL: Full fetch complete (32235 records). [2025-10-27T21:17:56.930084] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-27T21:17:56.930690] [FATAL] [VALIDATOR ] STEL: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:17:56.930902] [FATAL] [MAIN ] STEL: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:17:56.930982] [WARN ] [MAIN ] STEL: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:17:56.931065] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-27T21:17:56.931141] [DEBUG] [LOCAL ] STEL: No primary data file found to delete. [2025-10-27T21:17:56.931192] [INFO ] [LOCAL ] STEL: Starting deletion of derivative data. [2025-10-27T21:17:56.931335] [DEBUG] [LOCAL ] STEL: Deleted derivative data file. [2025-10-27T21:17:56.931440] [INFO ] [MAIN ] Update Progress: 2003/2366 symbols completed. STEL took 28.7s. Estimated remaining: 46m 44s. Rate: 7.8 symbols/min [2025-10-27T21:17:57.113895] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:17:57.130366] [DEBUG] [LOCAL ] STLA: Loaded 54332 existing records from primary storage. [2025-10-27T21:17:57.130719] [INFO ] [MAIN ] STLA: Loaded 54332 existing records. [2025-10-27T21:17:57.226488] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-27T21:17:57.311180] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:57.311926] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-27T21:17:57.312070] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-27T21:17:57.312587] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-27T21:17:57.312714] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-27T21:17:57.461143] [DEBUG] [LOCAL ] STM: Loaded 54353 existing records from primary storage. [2025-10-27T21:17:57.477055] [INFO ] [MAIN ] STM: Loaded 54353 existing records. [2025-10-27T21:17:57.848953] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:17:57.849228] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-27T21:17:57.849325] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-27T21:17:57.855243] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-27T21:17:57.860458] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-27T21:17:58.025013] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-27T21:17:58.045697] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:58.292065] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:17:58.814971] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-27T21:17:58.854770] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:17:58.998295] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T21:17:59.614980] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-27T21:18:00.414986] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-27T21:18:00.850213] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-27T21:18:01.214945] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-27T21:18:01.300685] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T21:18:01.638372] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T21:18:02.014945] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-27T21:18:02.814924] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-27T21:18:02.910420] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T21:18:03.322626] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T21:18:03.614945] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-27T21:18:04.414928] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-27T21:18:04.461915] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T21:18:04.796044] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T21:18:05.214955] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-27T21:18:06.014949] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-27T21:18:06.160151] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T21:18:06.814961] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-27T21:18:07.354262] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-27T21:18:07.458633] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T21:18:07.614912] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-27T21:18:07.728491] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:18:08.249219] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T21:18:08.414960] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-27T21:18:09.215000] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-27T21:18:10.014962] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-27T21:18:10.194422] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T21:18:10.629318] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T21:18:10.646239] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T21:18:10.814954] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-27T21:18:11.614962] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-27T21:18:12.414948] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-27T21:18:12.722683] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T21:18:12.970076] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-27T21:18:13.214937] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-27T21:18:14.015001] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-27T21:18:14.625915] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T21:18:14.814940] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-27T21:18:14.919528] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T21:18:15.535463] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-27T21:18:15.543764] [INFO ] [REMOTE ] STEM: Full fetch complete (60321 records). [2025-10-27T21:18:15.543943] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-27T21:18:15.620029] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-27T21:18:15.919793] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-27T21:18:15.919895] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-27T21:18:15.920893] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-27T21:18:15.920954] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-27T21:18:15.922109] [DEBUG] [LOCAL ] STEM: Trimmed 60321 records to 38072 (keeping 200 days of data) [2025-10-27T21:18:16.136280] [DEBUG] [LOCAL ] STEM: Primary data saved (38072 records). [2025-10-27T21:18:16.136412] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-27T21:18:16.136488] [INFO ] [MAIN ] Update Progress: 2004/2366 symbols completed. STEM took 47.9s. Estimated remaining: 46m 39s. Rate: 7.8 symbols/min [2025-10-27T21:18:16.306713] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:16.331210] [DEBUG] [LOCAL ] STN: Loaded 22808 existing records from primary storage. [2025-10-27T21:18:16.331587] [INFO ] [MAIN ] STN: Loaded 22808 existing records. [2025-10-27T21:18:16.427870] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-27T21:18:16.510218] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:16.549559] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-27T21:18:16.550112] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-27T21:18:16.551475] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T21:18:16.562109] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-27T21:18:16.562903] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-27T21:18:16.936957] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:17.103567] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T21:18:17.106437] [INFO ] [REMOTE ] STK: Full fetch complete (14419 records). [2025-10-27T21:18:17.106513] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-27T21:18:17.218079] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-27T21:18:17.573331] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-27T21:18:17.573436] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-27T21:18:17.573938] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-27T21:18:17.574001] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-27T21:18:17.574534] [DEBUG] [LOCAL ] STK: Trimmed 14419 records to 9509 (keeping 200 days of data) [2025-10-27T21:18:17.662235] [DEBUG] [LOCAL ] STK: Primary data saved (9509 records). [2025-10-27T21:18:17.663951] [INFO ] [MAIN ] STK: Full history saved. [2025-10-27T21:18:17.664098] [INFO ] [MAIN ] Update Progress: 2005/2366 symbols completed. STK took 31.9s. Estimated remaining: 46m 30s. Rate: 7.8 symbols/min [2025-10-27T21:18:17.663865] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T21:18:17.840020] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:17.878239] [DEBUG] [LOCAL ] STNG: Loaded 43856 existing records from primary storage. [2025-10-27T21:18:17.878523] [INFO ] [MAIN ] STNG: Loaded 43856 existing records. [2025-10-27T21:18:18.021456] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-27T21:18:18.062017] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:18.062245] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-27T21:18:18.062292] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-27T21:18:18.062490] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-27T21:18:18.062560] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-27T21:18:18.420292] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:18.814998] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-27T21:18:18.984250] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T21:18:18.985245] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T21:18:19.614920] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-27T21:18:20.414933] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-27T21:18:21.216007] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-27T21:18:21.243253] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-27T21:18:21.288441] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:18:22.014953] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-27T21:18:22.153633] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T21:18:22.208325] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T21:18:22.814944] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-27T21:18:23.592521] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T21:18:23.614911] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-27T21:18:24.067907] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T21:18:24.414940] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-27T21:18:25.214955] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-27T21:18:25.340765] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-27T21:18:25.591299] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T21:18:26.015002] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-27T21:18:26.815017] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-27T21:18:26.984056] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T21:18:27.620117] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-27T21:18:27.643335] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T21:18:27.743671] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-27T21:18:28.415013] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-27T21:18:29.070965] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T21:18:29.214972] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-27T21:18:29.362913] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-27T21:18:30.014971] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-27T21:18:30.814952] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-27T21:18:30.839531] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T21:18:31.564895] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-27T21:18:31.614957] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-27T21:18:31.968635] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-27T21:18:32.415006] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-27T21:18:32.539515] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T21:18:33.215047] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-27T21:18:34.014994] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-27T21:18:34.392612] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T21:18:34.402930] [INFO ] [REMOTE ] STM: Full fetch complete (77696 records). [2025-10-27T21:18:34.403058] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-27T21:18:34.812781] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-27T21:18:34.812855] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-27T21:18:34.813997] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-27T21:18:34.814066] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-27T21:18:34.814963] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-27T21:18:34.816675] [DEBUG] [LOCAL ] STM: Trimmed 77696 records to 53572 (keeping 200 days of data) [2025-10-27T21:18:35.169564] [DEBUG] [LOCAL ] STM: Primary data saved (53572 records). [2025-10-27T21:18:35.169763] [INFO ] [MAIN ] STM: Full history saved. [2025-10-27T21:18:35.169901] [INFO ] [MAIN ] Update Progress: 2006/2366 symbols completed. STM took 38.2s. Estimated remaining: 46m 24s. Rate: 7.8 symbols/min [2025-10-27T21:18:35.355262] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:35.403488] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-27T21:18:35.403982] [DEBUG] [LOCAL ] STRV: Loaded 10789 existing records from primary storage. [2025-10-27T21:18:35.414726] [INFO ] [MAIN ] STRV: Loaded 10789 existing records. [2025-10-27T21:18:35.450588] [INFO ] [REMOTE ] STLA: Full fetch complete (77659 records). [2025-10-27T21:18:35.477941] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-27T21:18:35.768363] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:35.812568] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-27T21:18:35.842788] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-27T21:18:35.862087] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-27T21:18:35.900485] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-27T21:18:36.064763] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-27T21:18:36.152773] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-27T21:18:36.189927] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-27T21:18:36.195474] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-27T21:18:36.202133] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-27T21:18:36.219663] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-27T21:18:36.287289] [DEBUG] [LOCAL ] STLA: Trimmed 77659 records to 53547 (keeping 200 days of data) [2025-10-27T21:18:36.401853] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-27T21:18:36.448045] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-27T21:18:36.643883] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:36.869890] [DEBUG] [LOCAL ] STLA: Primary data saved (53547 records). [2025-10-27T21:18:36.870043] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-27T21:18:36.870554] [INFO ] [MAIN ] Update Progress: 2007/2366 symbols completed. STLA took 40.1s. Estimated remaining: 46m 15s. Rate: 7.8 symbols/min [2025-10-27T21:18:37.045934] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:37.103857] [DEBUG] [LOCAL ] STT: Loaded 51873 existing records from primary storage. [2025-10-27T21:18:37.104220] [INFO ] [MAIN ] STT: Loaded 51873 existing records. [2025-10-27T21:18:37.220157] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-27T21:18:37.288853] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:37.289182] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-27T21:18:37.289395] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-27T21:18:37.289751] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-27T21:18:37.289806] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-27T21:18:37.564572] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-27T21:18:37.676147] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:37.811305] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T21:18:38.014972] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-27T21:18:38.345935] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:18:38.815005] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-27T21:18:39.056692] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T21:18:39.060686] [INFO ] [REMOTE ] STN: Full fetch complete (32625 records). [2025-10-27T21:18:39.060773] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-27T21:18:39.419438] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-27T21:18:39.419507] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-27T21:18:39.420153] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-27T21:18:39.420212] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-27T21:18:39.420922] [DEBUG] [LOCAL ] STN: Trimmed 32625 records to 22127 (keeping 200 days of data) [2025-10-27T21:18:39.555578] [DEBUG] [LOCAL ] STN: Primary data saved (22127 records). [2025-10-27T21:18:39.555724] [INFO ] [MAIN ] STN: Full history saved. [2025-10-27T21:18:39.555829] [INFO ] [MAIN ] Update Progress: 2008/2366 symbols completed. STN took 23.4s. Estimated remaining: 46m 6s. Rate: 7.8 symbols/min [2025-10-27T21:18:39.620194] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-27T21:18:39.722220] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:39.722341] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-27T21:18:39.722376] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-27T21:18:39.722480] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-27T21:18:39.722519] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-27T21:18:39.722560] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-27T21:18:39.722603] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-27T21:18:40.070191] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:40.395288] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T21:18:40.414895] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-27T21:18:40.960536] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T21:18:41.214933] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-27T21:18:41.783913] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T21:18:42.014972] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-27T21:18:42.182810] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T21:18:42.814963] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-10-27T21:18:43.256166] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:18:43.256465] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-10-27T21:18:43.256553] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:18:43.256681] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-27T21:18:43.256746] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:18:43.256985] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-27T21:18:43.257107] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-27T21:18:43.257269] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-27T21:18:43.257337] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-27T21:18:43.270922] [INFO ] [MAIN ] Update Progress: 2009/2366 symbols completed. STUB took 3.7s. Estimated remaining: 45m 58s. Rate: 7.8 symbols/min [2025-10-27T21:18:43.349530] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:18:43.460324] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:43.485921] [DEBUG] [LOCAL ] STVN: Loaded 27085 existing records from primary storage. [2025-10-27T21:18:43.486159] [INFO ] [MAIN ] STVN: Loaded 27085 existing records. [2025-10-27T21:18:43.622594] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-27T21:18:43.660777] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:43.660926] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-27T21:18:43.660971] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-27T21:18:43.661148] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-27T21:18:43.661203] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-27T21:18:44.014079] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:44.414931] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-27T21:18:45.078843] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T21:18:45.214957] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-27T21:18:45.807946] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T21:18:46.014955] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-27T21:18:46.814995] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-27T21:18:46.967415] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T21:18:47.145795] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:18:47.512346] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T21:18:47.614918] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-27T21:18:48.414960] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-27T21:18:48.446832] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T21:18:49.215006] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-27T21:18:49.507231] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T21:18:49.514949] [INFO ] [REMOTE ] STNG: Full fetch complete (63875 records). [2025-10-27T21:18:49.515048] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-27T21:18:49.930204] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-27T21:18:49.930368] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-27T21:18:49.931418] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-27T21:18:49.931517] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-27T21:18:49.933055] [DEBUG] [LOCAL ] STNG: Trimmed 63875 records to 42971 (keeping 200 days of data) [2025-10-27T21:18:49.944242] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-27T21:18:50.034104] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-27T21:18:50.203503] [DEBUG] [LOCAL ] STNG: Primary data saved (42971 records). [2025-10-27T21:18:50.203609] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-27T21:18:50.203717] [INFO ] [MAIN ] Update Progress: 2010/2366 symbols completed. STNG took 32.5s. Estimated remaining: 45m 50s. Rate: 7.8 symbols/min [2025-10-27T21:18:50.376903] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:18:50.425379] [DEBUG] [LOCAL ] STWD: Loaded 52724 existing records from primary storage. [2025-10-27T21:18:50.425689] [INFO ] [MAIN ] STWD: Loaded 52724 existing records. [2025-10-27T21:18:50.607552] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:18:50.607783] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-27T21:18:50.607862] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-27T21:18:50.608098] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-27T21:18:50.608154] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-27T21:18:50.820138] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-27T21:18:50.932978] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-27T21:18:50.989492] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:18:51.614967] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-27T21:18:52.064335] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T21:18:52.414960] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-27T21:18:53.214997] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-27T21:18:53.425523] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T21:18:53.752523] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T21:18:54.014960] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-27T21:18:54.102063] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-27T21:18:54.814940] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-27T21:18:55.614970] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-27T21:18:55.737290] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T21:18:55.776802] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:18:56.414944] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-27T21:18:57.152740] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T21:18:57.214921] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-27T21:18:57.251291] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T21:18:58.015033] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-27T21:18:58.814965] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-27T21:18:58.999309] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:18:59.069197] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T21:18:59.614938] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-27T21:19:00.414932] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-27T21:19:00.592381] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T21:19:01.214935] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-27T21:19:01.620514] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T21:19:01.729281] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T21:19:02.014949] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-27T21:19:02.131286] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T21:19:02.815005] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-27T21:19:03.614979] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-27T21:19:03.765723] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T21:19:04.251988] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:19:04.414910] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-27T21:19:04.847272] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T21:19:05.214938] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-27T21:19:05.622077] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T21:19:05.991014] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:19:06.014909] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-27T21:19:06.814981] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-27T21:19:07.347785] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T21:19:07.357439] [INFO ] [REMOTE ] STT: Full fetch complete (74165 records). [2025-10-27T21:19:07.357618] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-27T21:19:07.358482] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:19:07.358580] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:19:07.358624] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:19:07.358707] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-27T21:19:07.358777] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-27T21:19:07.358816] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-10-27T21:19:07.358966] [DEBUG] [LOCAL ] STT: Deleted derivative data file. [2025-10-27T21:19:07.359439] [INFO ] [MAIN ] Update Progress: 2011/2366 symbols completed. STT took 30.5s. Estimated remaining: 45m 44s. Rate: 7.8 symbols/min [2025-10-27T21:19:07.534638] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:07.538549] [DEBUG] [LOCAL ] STXD: Loaded 1361 existing records from primary storage. [2025-10-27T21:19:07.538750] [INFO ] [MAIN ] STXD: Loaded 1361 existing records. [2025-10-27T21:19:07.617201] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-27T21:19:07.728687] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:07.728964] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-27T21:19:07.729068] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-27T21:19:07.729345] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-27T21:19:07.729438] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-27T21:19:08.140153] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:08.142282] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-27T21:19:08.414925] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-27T21:19:08.514923] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-27T21:19:08.517325] [INFO ] [REMOTE ] STRV: Full fetch complete (17127 records). [2025-10-27T21:19:08.517408] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-27T21:19:08.882803] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-27T21:19:08.882875] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-27T21:19:08.883283] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-27T21:19:08.883349] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-27T21:19:08.883878] [DEBUG] [LOCAL ] STRV: Trimmed 17127 records to 10323 (keeping 200 days of data) [2025-10-27T21:19:08.945285] [DEBUG] [LOCAL ] STRV: Primary data saved (10323 records). [2025-10-27T21:19:08.945404] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-27T21:19:08.945480] [INFO ] [MAIN ] Update Progress: 2012/2366 symbols completed. STRV took 33.8s. Estimated remaining: 45m 35s. Rate: 7.8 symbols/min [2025-10-27T21:19:09.112927] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:09.117289] [DEBUG] [LOCAL ] STXE: Loaded 2082 existing records from primary storage. [2025-10-27T21:19:09.117443] [INFO ] [MAIN ] STXE: Loaded 2082 existing records. [2025-10-27T21:19:09.215542] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-27T21:19:09.294096] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:09.294303] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-27T21:19:09.294350] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-27T21:19:09.294477] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-27T21:19:09.294514] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-27T21:19:09.684726] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:09.688258] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T21:19:09.858089] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T21:19:10.014931] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-27T21:19:10.814943] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-27T21:19:11.291005] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-27T21:19:11.327744] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T21:19:11.614934] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-27T21:19:12.101385] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-27T21:19:12.414960] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-27T21:19:12.902015] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:19:13.214943] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-27T21:19:13.665416] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-27T21:19:14.014968] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-27T21:19:14.448342] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-27T21:19:14.814934] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-27T21:19:15.192670] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T21:19:15.614939] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-27T21:19:16.414976] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-27T21:19:16.558810] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T21:19:16.564311] [INFO ] [REMOTE ] STVN: Full fetch complete (39113 records). [2025-10-27T21:19:16.564407] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-27T21:19:16.995273] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-27T21:19:16.995363] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-27T21:19:16.996362] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-27T21:19:16.996429] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-27T21:19:16.997416] [DEBUG] [LOCAL ] STVN: Trimmed 39113 records to 26459 (keeping 200 days of data) [2025-10-27T21:19:17.163856] [DEBUG] [LOCAL ] STVN: Primary data saved (26459 records). [2025-10-27T21:19:17.164010] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-27T21:19:17.164100] [INFO ] [MAIN ] Update Progress: 2013/2366 symbols completed. STVN took 33.9s. Estimated remaining: 45m 28s. Rate: 7.8 symbols/min [2025-10-27T21:19:17.220079] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-27T21:19:17.380500] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:17.384877] [DEBUG] [LOCAL ] STXG: Loaded 2333 existing records from primary storage. [2025-10-27T21:19:17.385047] [INFO ] [MAIN ] STXG: Loaded 2333 existing records. [2025-10-27T21:19:17.588164] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:17.588381] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-27T21:19:17.588439] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-27T21:19:17.588711] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-27T21:19:17.588771] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-27T21:19:17.921796] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T21:19:18.001536] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:18.014897] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-27T21:19:18.230934] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T21:19:18.508555] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:19:18.814939] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-27T21:19:19.263565] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:19:19.614938] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-27T21:19:20.232465] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T21:19:20.414954] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-27T21:19:21.214992] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-27T21:19:21.674668] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T21:19:21.870334] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:19:22.014960] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-27T21:19:22.697932] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T21:19:22.814996] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-27T21:19:23.158049] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T21:19:23.615007] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-27T21:19:24.154190] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-27T21:19:24.414972] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-27T21:19:24.924626] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:19:24.925670] [INFO ] [REMOTE ] STXD: Full fetch complete (2162 records). [2025-10-27T21:19:24.925742] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-27T21:19:25.220135] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-27T21:19:25.293766] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-27T21:19:25.293836] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-27T21:19:25.293940] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-27T21:19:25.293978] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-27T21:19:25.294297] [DEBUG] [LOCAL ] STXD: Trimmed 2162 records to 1302 (keeping 200 days of data) [2025-10-27T21:19:25.303029] [DEBUG] [LOCAL ] STXD: Primary data saved (1302 records). [2025-10-27T21:19:25.303089] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-27T21:19:25.303156] [INFO ] [MAIN ] Update Progress: 2014/2366 symbols completed. STXD took 17.9s. Estimated remaining: 45m 20s. Rate: 7.8 symbols/min [2025-10-27T21:19:25.478922] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:25.482843] [DEBUG] [LOCAL ] STXK: Loaded 1497 existing records from primary storage. [2025-10-27T21:19:25.482982] [INFO ] [MAIN ] STXK: Loaded 1497 existing records. [2025-10-27T21:19:25.661712] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:25.661923] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-27T21:19:25.661967] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-27T21:19:25.662109] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-27T21:19:25.662165] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-27T21:19:25.789566] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T21:19:26.026863] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-27T21:19:26.032676] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:26.657265] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T21:19:26.667453] [INFO ] [REMOTE ] STWD: Full fetch complete (74981 records). [2025-10-27T21:19:26.667602] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-27T21:19:26.668284] [FATAL] [VALIDATOR ] STWD: Data is stale - most recent date (2025-10-24) is before last completed trading day (2025-10-27). Symbol may be delisted or halted. [2025-10-27T21:19:26.668372] [FATAL] [MAIN ] STWD: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:19:26.668414] [WARN ] [MAIN ] STWD: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:19:26.668452] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-27T21:19:26.668507] [DEBUG] [LOCAL ] STWD: No primary data file found to delete. [2025-10-27T21:19:26.668541] [INFO ] [LOCAL ] STWD: Starting deletion of derivative data. [2025-10-27T21:19:26.668705] [DEBUG] [LOCAL ] STWD: Deleted derivative data file. [2025-10-27T21:19:26.668808] [INFO ] [MAIN ] Update Progress: 2015/2366 symbols completed. STWD took 36.5s. Estimated remaining: 45m 11s. Rate: 7.8 symbols/min [2025-10-27T21:19:26.820207] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-27T21:19:26.843890] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:26.844115] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-27T21:19:26.844159] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-27T21:19:26.844265] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-27T21:19:26.844305] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-27T21:19:26.844345] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-27T21:19:26.844377] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-27T21:19:27.212288] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:27.431462] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-27T21:19:27.614918] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-27T21:19:28.170680] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:19:28.414958] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-27T21:19:28.914454] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T21:19:29.214930] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-27T21:19:29.783568] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-27T21:19:30.014953] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-27T21:19:30.547254] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T21:19:30.814965] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-27T21:19:31.389480] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T21:19:31.615057] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-27T21:19:32.015299] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T21:19:32.414966] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-27T21:19:32.909434] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:19:33.214956] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-27T21:19:33.797811] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T21:19:34.014946] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-27T21:19:34.513995] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-27T21:19:34.814980] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-27T21:19:35.173530] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T21:19:35.614980] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-27T21:19:35.986902] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T21:19:36.414937] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-27T21:19:36.891096] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T21:19:37.214955] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-27T21:19:37.652244] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T21:19:38.014997] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-27T21:19:38.584297] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-27T21:19:38.815022] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-27T21:19:39.220590] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T21:19:39.221589] [INFO ] [REMOTE ] STXE: Full fetch complete (3464 records). [2025-10-27T21:19:39.221681] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-27T21:19:39.572144] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-27T21:19:39.572215] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-27T21:19:39.572334] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-27T21:19:39.572371] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-27T21:19:39.572728] [DEBUG] [LOCAL ] STXE: Trimmed 3464 records to 2018 (keeping 200 days of data) [2025-10-27T21:19:39.585080] [DEBUG] [LOCAL ] STXE: Primary data saved (2018 records). [2025-10-27T21:19:39.585140] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-27T21:19:39.585214] [INFO ] [MAIN ] Update Progress: 2016/2366 symbols completed. STXE took 30.6s. Estimated remaining: 45m 4s. Rate: 7.8 symbols/min [2025-10-27T21:19:39.620156] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-27T21:19:39.757252] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:39.761905] [DEBUG] [LOCAL ] STXT: Loaded 2551 existing records from primary storage. [2025-10-27T21:19:39.762061] [INFO ] [MAIN ] STXT: Loaded 2551 existing records. [2025-10-27T21:19:39.936260] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:39.936486] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-27T21:19:39.936534] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-27T21:19:39.936706] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-27T21:19:39.936763] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-27T21:19:40.213544] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T21:19:40.309918] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:40.414930] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-27T21:19:40.822660] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T21:19:41.214991] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-27T21:19:41.727859] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T21:19:42.014982] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-27T21:19:42.615338] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T21:19:42.814935] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-27T21:19:43.203974] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T21:19:43.614973] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-27T21:19:44.163332] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T21:19:44.414985] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-27T21:19:44.862701] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T21:19:45.214987] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-27T21:19:45.720068] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-27T21:19:46.014999] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-27T21:19:46.596872] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-27T21:19:46.814965] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-27T21:19:47.267916] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T21:19:47.614996] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-27T21:19:47.996027] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T21:19:48.414948] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-27T21:19:48.807590] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T21:19:49.214958] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-27T21:19:49.586869] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-27T21:19:50.015001] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-27T21:19:50.561513] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T21:19:50.814966] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-27T21:19:51.211136] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:19:51.614969] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-27T21:19:52.066087] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T21:19:52.414950] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-27T21:19:52.973148] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:19:53.214961] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-27T21:19:53.686311] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T21:19:54.014970] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-27T21:19:54.477673] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T21:19:54.814941] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-27T21:19:55.344058] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T21:19:55.345060] [INFO ] [REMOTE ] STXK: Full fetch complete (2379 records). [2025-10-27T21:19:55.345128] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-27T21:19:55.620705] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-27T21:19:55.703161] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-27T21:19:55.703240] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-27T21:19:55.703360] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-27T21:19:55.703406] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-27T21:19:55.703774] [DEBUG] [LOCAL ] STXK: Trimmed 2379 records to 1440 (keeping 200 days of data) [2025-10-27T21:19:55.712671] [DEBUG] [LOCAL ] STXK: Primary data saved (1440 records). [2025-10-27T21:19:55.712731] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-27T21:19:55.712797] [INFO ] [MAIN ] Update Progress: 2017/2366 symbols completed. STXK took 30.4s. Estimated remaining: 44m 58s. Rate: 7.8 symbols/min [2025-10-27T21:19:55.888528] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:19:55.893133] [DEBUG] [LOCAL ] STXV: Loaded 1482 existing records from primary storage. [2025-10-27T21:19:55.893400] [INFO ] [MAIN ] STXV: Loaded 1482 existing records. [2025-10-27T21:19:56.084148] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:19:56.084459] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-27T21:19:56.084530] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-27T21:19:56.084822] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-27T21:19:56.084887] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-27T21:19:56.199974] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T21:19:56.420064] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-27T21:19:56.458973] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:19:56.912369] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:19:57.214947] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-27T21:19:57.621929] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T21:19:58.015014] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-27T21:19:58.417932] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-27T21:19:58.814993] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-27T21:19:59.232590] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T21:19:59.614940] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-27T21:19:59.967864] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T21:19:59.968573] [INFO ] [REMOTE ] STXM: Full fetch complete (1375 records). [2025-10-27T21:19:59.968637] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-27T21:20:00.148905] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-27T21:20:00.149077] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:20:00.149163] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:20:00.149210] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-27T21:20:00.149266] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-27T21:20:00.149301] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-27T21:20:00.149340] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-27T21:20:00.149393] [INFO ] [MAIN ] Update Progress: 2018/2366 symbols completed. STXM took 33.5s. Estimated remaining: 44m 50s. Rate: 7.8 symbols/min [2025-10-27T21:20:00.319626] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:00.370072] [DEBUG] [LOCAL ] STZ: Loaded 53174 existing records from primary storage. [2025-10-27T21:20:00.370378] [INFO ] [MAIN ] STZ: Loaded 53174 existing records. [2025-10-27T21:20:00.422921] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-27T21:20:00.550387] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:00.550633] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-27T21:20:00.550714] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-27T21:20:00.550924] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-27T21:20:00.550963] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-27T21:20:00.923207] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:00.974494] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T21:20:00.975528] [INFO ] [REMOTE ] STXG: Full fetch complete (4025 records). [2025-10-27T21:20:00.975597] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-27T21:20:01.224304] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-27T21:20:01.350503] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-27T21:20:01.350578] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-27T21:20:01.350747] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-27T21:20:01.350809] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-27T21:20:01.351164] [DEBUG] [LOCAL ] STXG: Trimmed 4025 records to 2194 (keeping 200 days of data) [2025-10-27T21:20:01.365192] [DEBUG] [LOCAL ] STXG: Primary data saved (2194 records). [2025-10-27T21:20:01.365320] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-27T21:20:01.365403] [INFO ] [MAIN ] Update Progress: 2019/2366 symbols completed. STXG took 44.2s. Estimated remaining: 44m 41s. Rate: 7.8 symbols/min [2025-10-27T21:20:01.543210] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:01.593286] [DEBUG] [LOCAL ] SU: Loaded 54206 existing records from primary storage. [2025-10-27T21:20:01.593625] [INFO ] [MAIN ] SU: Loaded 54206 existing records. [2025-10-27T21:20:01.786816] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:01.787097] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-27T21:20:01.787146] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-27T21:20:01.787353] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-27T21:20:01.787409] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-27T21:20:02.028149] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-27T21:20:02.182047] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:02.542962] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:20:02.544069] [INFO ] [REMOTE ] STXT: Full fetch complete (3872 records). [2025-10-27T21:20:02.544137] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-27T21:20:02.821039] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-27T21:20:02.915258] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-27T21:20:02.915339] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-27T21:20:02.915508] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-27T21:20:02.915551] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-27T21:20:02.915928] [DEBUG] [LOCAL ] STXT: Trimmed 3872 records to 2504 (keeping 200 days of data) [2025-10-27T21:20:02.931752] [DEBUG] [LOCAL ] STXT: Primary data saved (2504 records). [2025-10-27T21:20:02.931821] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-27T21:20:02.931887] [INFO ] [MAIN ] Update Progress: 2020/2366 symbols completed. STXT took 23.3s. Estimated remaining: 44m 32s. Rate: 7.8 symbols/min [2025-10-27T21:20:03.104159] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:03.144918] [DEBUG] [LOCAL ] SUI: Loaded 42361 existing records from primary storage. [2025-10-27T21:20:03.145200] [INFO ] [MAIN ] SUI: Loaded 42361 existing records. [2025-10-27T21:20:03.350766] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:03.351151] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-27T21:20:03.351231] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-27T21:20:03.351495] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-27T21:20:03.351670] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-27T21:20:03.533104] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-27T21:20:03.564542] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-27T21:20:03.647630] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-27T21:20:03.767421] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:04.414938] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-27T21:20:05.214946] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-27T21:20:05.464512] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-27T21:20:05.927884] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T21:20:06.014933] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-27T21:20:06.814960] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-27T21:20:07.215787] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T21:20:07.359512] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T21:20:07.614996] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-27T21:20:07.821691] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T21:20:08.015010] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T21:20:08.414933] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-27T21:20:09.214972] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-27T21:20:09.875590] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-27T21:20:10.014951] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-27T21:20:10.062844] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-27T21:20:10.814944] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-27T21:20:11.614978] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-27T21:20:12.186976] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-27T21:20:12.257984] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T21:20:12.414944] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-27T21:20:12.866724] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T21:20:13.124404] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:20:13.214896] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-27T21:20:14.014943] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-27T21:20:14.406995] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:20:14.814956] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-27T21:20:15.615160] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-27T21:20:15.851688] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T21:20:16.015980] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:20:16.406864] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:20:16.415133] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-27T21:20:17.214982] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-27T21:20:17.866112] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T21:20:18.014957] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-27T21:20:18.411722] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T21:20:18.524212] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T21:20:18.814946] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-27T21:20:19.614940] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-27T21:20:20.167324] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T21:20:20.414918] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-27T21:20:21.214941] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-27T21:20:21.762477] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-27T21:20:21.898858] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-27T21:20:21.899670] [INFO ] [REMOTE ] STXV: Full fetch complete (2512 records). [2025-10-27T21:20:21.899738] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-27T21:20:22.019361] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-27T21:20:22.226349] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T21:20:22.316635] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-27T21:20:22.316748] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-27T21:20:22.316894] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-27T21:20:22.316934] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-27T21:20:22.317272] [DEBUG] [LOCAL ] STXV: Trimmed 2512 records to 1426 (keeping 200 days of data) [2025-10-27T21:20:22.326385] [DEBUG] [LOCAL ] STXV: Primary data saved (1426 records). [2025-10-27T21:20:22.326456] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-27T21:20:22.326534] [INFO ] [MAIN ] Update Progress: 2021/2366 symbols completed. STXV took 26.6s. Estimated remaining: 44m 26s. Rate: 7.8 symbols/min [2025-10-27T21:20:22.492353] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:22.530666] [DEBUG] [LOCAL ] SUN: Loaded 39278 existing records from primary storage. [2025-10-27T21:20:22.530940] [INFO ] [MAIN ] SUN: Loaded 39278 existing records. [2025-10-27T21:20:22.706873] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:22.707077] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-27T21:20:22.707122] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-27T21:20:22.707395] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-27T21:20:22.707451] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-27T21:20:22.820094] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-27T21:20:23.066488] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:23.618825] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-27T21:20:23.624375] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:20:24.414957] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-27T21:20:24.634075] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T21:20:25.215048] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-27T21:20:25.881588] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-27T21:20:25.923216] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-27T21:20:26.015044] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-27T21:20:26.585537] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T21:20:26.814940] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-27T21:20:27.121477] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T21:20:27.614949] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-27T21:20:27.987741] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T21:20:27.995365] [INFO ] [REMOTE ] SUI: Full fetch complete (60602 records). [2025-10-27T21:20:27.995463] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-27T21:20:28.365005] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-27T21:20:28.365077] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-27T21:20:28.366075] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-27T21:20:28.366137] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-27T21:20:28.367270] [DEBUG] [LOCAL ] SUI: Trimmed 60602 records to 41573 (keeping 200 days of data) [2025-10-27T21:20:28.420417] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-27T21:20:28.625287] [DEBUG] [LOCAL ] SUI: Primary data saved (41573 records). [2025-10-27T21:20:28.625430] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-27T21:20:28.626007] [INFO ] [MAIN ] Update Progress: 2022/2366 symbols completed. SUI took 25.7s. Estimated remaining: 44m 18s. Rate: 7.8 symbols/min [2025-10-27T21:20:28.789375] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:28.835438] [DEBUG] [LOCAL ] SUPV: Loaded 48820 existing records from primary storage. [2025-10-27T21:20:28.835746] [INFO ] [MAIN ] SUPV: Loaded 48820 existing records. [2025-10-27T21:20:29.006049] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:29.006237] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-27T21:20:29.006283] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-27T21:20:29.006469] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-27T21:20:29.006506] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-27T21:20:29.220814] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-27T21:20:29.357912] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:29.632788] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-27T21:20:29.907852] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T21:20:30.014994] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-27T21:20:30.814969] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-27T21:20:31.113437] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-27T21:20:31.614932] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-27T21:20:31.724354] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T21:20:32.414927] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-27T21:20:32.510297] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T21:20:33.016267] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-27T21:20:33.214981] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-27T21:20:33.460298] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T21:20:34.014945] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-27T21:20:34.814973] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-27T21:20:35.063618] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T21:20:35.614984] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-27T21:20:35.713342] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T21:20:36.414984] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-27T21:20:36.660513] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T21:20:37.114330] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T21:20:37.214926] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-27T21:20:37.914621] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T21:20:38.014995] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-27T21:20:38.814951] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-27T21:20:39.060478] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T21:20:39.348141] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:20:39.614983] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-27T21:20:40.414960] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-27T21:20:40.703195] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:20:40.713273] [INFO ] [REMOTE ] SU: Full fetch complete (77566 records). [2025-10-27T21:20:40.713403] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-27T21:20:41.107787] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-27T21:20:41.107887] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-27T21:20:41.109024] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-27T21:20:41.109166] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-27T21:20:41.110721] [DEBUG] [LOCAL ] SU: Trimmed 77566 records to 53426 (keeping 200 days of data) [2025-10-27T21:20:41.219438] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-27T21:20:41.259913] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T21:20:41.493169] [DEBUG] [LOCAL ] SU: Primary data saved (53426 records). [2025-10-27T21:20:41.493312] [INFO ] [MAIN ] SU: Full history saved. [2025-10-27T21:20:41.493391] [INFO ] [MAIN ] Update Progress: 2023/2366 symbols completed. SU took 40.1s. Estimated remaining: 44m 12s. Rate: 7.8 symbols/min [2025-10-27T21:20:41.656231] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:41.695397] [DEBUG] [LOCAL ] SUZ: Loaded 46126 existing records from primary storage. [2025-10-27T21:20:41.695746] [INFO ] [MAIN ] SUZ: Loaded 46126 existing records. [2025-10-27T21:20:41.866908] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:41.867116] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-27T21:20:41.867163] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-27T21:20:41.867344] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-27T21:20:41.867381] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-27T21:20:42.024965] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-27T21:20:42.221364] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:42.580018] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-27T21:20:42.644011] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:20:42.814964] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-27T21:20:43.443461] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-27T21:20:43.615029] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-27T21:20:44.041096] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-27T21:20:44.414952] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-27T21:20:44.667561] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T21:20:45.214942] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-27T21:20:45.962670] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T21:20:45.972814] [INFO ] [REMOTE ] STZ: Full fetch complete (76198 records). [2025-10-27T21:20:45.972965] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-27T21:20:46.020060] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-27T21:20:46.373901] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-27T21:20:46.373979] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-27T21:20:46.375083] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-27T21:20:46.375146] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-27T21:20:46.376528] [DEBUG] [LOCAL ] STZ: Trimmed 76198 records to 52389 (keeping 200 days of data) [2025-10-27T21:20:46.717346] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T21:20:46.732625] [INFO ] [REMOTE ] SUN: Full fetch complete (55735 records). [2025-10-27T21:20:46.734731] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-27T21:20:46.820365] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-27T21:20:46.878835] [DEBUG] [LOCAL ] STZ: Primary data saved (52389 records). [2025-10-27T21:20:46.884269] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-27T21:20:46.894699] [INFO ] [MAIN ] Update Progress: 2024/2366 symbols completed. STZ took 46.7s. Estimated remaining: 44m 3s. Rate: 7.8 symbols/min [2025-10-27T21:20:47.298882] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:47.375471] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-27T21:20:47.375605] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-27T21:20:47.376913] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-27T21:20:47.377189] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-27T21:20:47.379178] [DEBUG] [LOCAL ] SUN: Trimmed 55735 records to 38670 (keeping 200 days of data) [2025-10-27T21:20:47.541160] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T21:20:47.558040] [DEBUG] [LOCAL ] SVV: Loaded 40891 existing records from primary storage. [2025-10-27T21:20:47.559143] [INFO ] [MAIN ] SVV: Loaded 40891 existing records. [2025-10-27T21:20:47.623613] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-27T21:20:47.832245] [DEBUG] [LOCAL ] SUN: Primary data saved (38670 records). [2025-10-27T21:20:47.858423] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-27T21:20:47.864667] [INFO ] [MAIN ] Update Progress: 2025/2366 symbols completed. SUN took 25.5s. Estimated remaining: 43m 55s. Rate: 7.8 symbols/min [2025-10-27T21:20:47.985031] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:48.008520] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-27T21:20:48.019458] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-27T21:20:48.071395] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-27T21:20:48.090752] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-27T21:20:48.090670] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:48.348219] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T21:20:48.425185] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-27T21:20:48.503217] [DEBUG] [LOCAL ] SW: Loaded 53955 existing records from primary storage. [2025-10-27T21:20:48.532759] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:48.533222] [INFO ] [MAIN ] SW: Loaded 53955 existing records. [2025-10-27T21:20:48.708389] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:48.708603] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-27T21:20:48.708737] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-27T21:20:48.708948] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-27T21:20:48.708986] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-27T21:20:49.059159] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:49.214916] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-27T21:20:49.267614] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T21:20:49.669635] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T21:20:50.014952] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-27T21:20:50.509281] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-27T21:20:50.814948] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-27T21:20:51.555429] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T21:20:51.614907] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-27T21:20:52.358558] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:20:52.414907] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-27T21:20:52.942576] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:20:53.214945] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-27T21:20:53.555564] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:20:54.014946] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-27T21:20:54.644846] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T21:20:54.814915] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-27T21:20:54.958321] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T21:20:55.614946] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-27T21:20:56.414959] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-27T21:20:56.506408] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T21:20:56.965166] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T21:20:56.974984] [INFO ] [REMOTE ] SUPV: Full fetch complete (69038 records). [2025-10-27T21:20:56.975110] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-27T21:20:57.225855] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-27T21:20:57.354915] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-27T21:20:57.354992] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-27T21:20:57.356035] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-27T21:20:57.356134] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-27T21:20:57.357443] [DEBUG] [LOCAL ] SUPV: Trimmed 69038 records to 48100 (keeping 200 days of data) [2025-10-27T21:20:57.637150] [DEBUG] [LOCAL ] SUPV: Primary data saved (48100 records). [2025-10-27T21:20:57.637272] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-27T21:20:57.637981] [INFO ] [MAIN ] Update Progress: 2026/2366 symbols completed. SUPV took 29.0s. Estimated remaining: 43m 47s. Rate: 7.8 symbols/min [2025-10-27T21:20:57.804935] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:20:57.854323] [DEBUG] [LOCAL ] SWK: Loaded 53110 existing records from primary storage. [2025-10-27T21:20:57.854621] [INFO ] [MAIN ] SWK: Loaded 53110 existing records. [2025-10-27T21:20:58.024739] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-27T21:20:58.056071] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:20:58.059287] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-27T21:20:58.062315] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T21:20:58.060756] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-27T21:20:58.072205] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-27T21:20:58.072376] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-27T21:20:58.510600] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T21:20:58.509059] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:20:58.814955] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-27T21:20:59.614969] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-27T21:20:59.890063] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-27T21:21:00.414943] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-27T21:21:00.568332] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-27T21:21:00.843223] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T21:21:01.215042] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-27T21:21:01.935482] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-27T21:21:02.014985] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-27T21:21:02.814912] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-27T21:21:03.419859] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T21:21:03.614943] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-27T21:21:04.415052] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-27T21:21:04.646922] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T21:21:05.215033] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-27T21:21:05.556490] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T21:21:05.925981] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (4.71 seconds). [2025-10-27T21:21:06.014916] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-27T21:21:06.814923] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-27T21:21:06.908550] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (4.09 seconds). [2025-10-27T21:21:07.160813] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-27T21:21:07.169556] [INFO ] [REMOTE ] SUZ: Full fetch complete (66603 records). [2025-10-27T21:21:07.169698] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-27T21:21:07.579486] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-27T21:21:07.579593] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-27T21:21:07.580761] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-27T21:21:07.580844] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-27T21:21:07.582273] [DEBUG] [LOCAL ] SUZ: Trimmed 66603 records to 45267 (keeping 200 days of data) [2025-10-27T21:21:07.630154] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-27T21:21:07.705766] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T21:21:07.879193] [DEBUG] [LOCAL ] SUZ: Primary data saved (45267 records). [2025-10-27T21:21:07.879314] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-27T21:21:07.879388] [INFO ] [MAIN ] Update Progress: 2027/2366 symbols completed. SUZ took 26.4s. Estimated remaining: 43m 40s. Rate: 7.8 symbols/min [2025-10-27T21:21:08.051801] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:08.080759] [DEBUG] [LOCAL ] SWX: Loaded 30913 existing records from primary storage. [2025-10-27T21:21:08.081015] [INFO ] [MAIN ] SWX: Loaded 30913 existing records. [2025-10-27T21:21:08.265909] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:08.266093] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-27T21:21:08.266141] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-27T21:21:08.266465] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-27T21:21:08.266502] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-27T21:21:08.420301] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-27T21:21:08.588874] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T21:21:08.664901] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:08.978724] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T21:21:09.214947] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-27T21:21:10.014922] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-27T21:21:10.299246] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T21:21:10.689449] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:21:10.814942] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-27T21:21:11.570157] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:21:11.614934] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-27T21:21:12.414949] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-27T21:21:12.623992] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T21:21:12.702427] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-27T21:21:13.214949] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-27T21:21:13.751150] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-27T21:21:14.014953] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-27T21:21:14.074172] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T21:21:14.814928] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-27T21:21:15.614903] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-27T21:21:15.643322] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-27T21:21:15.678563] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-27T21:21:16.414996] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-27T21:21:17.214946] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-27T21:21:17.395088] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T21:21:17.746363] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T21:21:18.014994] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-27T21:21:18.702276] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T21:21:18.814905] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-27T21:21:19.435590] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T21:21:19.446800] [INFO ] [REMOTE ] SW: Full fetch complete (77131 records). [2025-10-27T21:21:19.446924] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-27T21:21:19.624392] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-27T21:21:19.842777] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-27T21:21:19.842851] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-27T21:21:19.843949] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-27T21:21:19.844010] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-27T21:21:19.845365] [DEBUG] [LOCAL ] SW: Trimmed 77131 records to 53172 (keeping 200 days of data) [2025-10-27T21:21:20.154923] [DEBUG] [LOCAL ] SW: Primary data saved (53172 records). [2025-10-27T21:21:20.155054] [INFO ] [MAIN ] SW: Full history saved. [2025-10-27T21:21:20.155357] [INFO ] [MAIN ] Update Progress: 2028/2366 symbols completed. SW took 32.3s. Estimated remaining: 43m 33s. Rate: 7.8 symbols/min [2025-10-27T21:21:20.323304] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:20.332007] [DEBUG] [LOCAL ] SWZ: Loaded 6024 existing records from primary storage. [2025-10-27T21:21:20.332211] [INFO ] [MAIN ] SWZ: Loaded 6024 existing records. [2025-10-27T21:21:20.424142] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-27T21:21:20.526700] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:20.527019] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-27T21:21:20.527150] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-27T21:21:20.527526] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-27T21:21:20.527594] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-27T21:21:20.957676] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:20.960524] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-27T21:21:21.027240] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T21:21:21.214932] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-27T21:21:21.853145] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:21:22.014953] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-27T21:21:22.354431] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:21:22.363028] [INFO ] [REMOTE ] SVV: Full fetch complete (57593 records). [2025-10-27T21:21:22.363133] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-27T21:21:22.761197] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-27T21:21:22.761269] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-27T21:21:22.762210] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-27T21:21:22.762272] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-27T21:21:22.763380] [DEBUG] [LOCAL ] SVV: Trimmed 57593 records to 40123 (keeping 200 days of data) [2025-10-27T21:21:22.817509] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-27T21:21:22.991051] [DEBUG] [LOCAL ] SVV: Primary data saved (40123 records). [2025-10-27T21:21:22.991169] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-27T21:21:22.991240] [INFO ] [MAIN ] Update Progress: 2029/2366 symbols completed. SVV took 36.1s. Estimated remaining: 43m 24s. Rate: 7.8 symbols/min [2025-10-27T21:21:23.157605] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:23.197248] [DEBUG] [LOCAL ] SXC: Loaded 42081 existing records from primary storage. [2025-10-27T21:21:23.197594] [INFO ] [MAIN ] SXC: Loaded 42081 existing records. [2025-10-27T21:21:23.308147] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:21:23.382624] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:23.383015] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-27T21:21:23.383254] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-27T21:21:23.383527] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-27T21:21:23.383599] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-27T21:21:23.620492] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-27T21:21:23.769726] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-27T21:21:23.772804] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:24.414994] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-27T21:21:24.672198] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T21:21:24.775352] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T21:21:25.214937] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-27T21:21:26.014944] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-27T21:21:26.814959] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-27T21:21:26.940182] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-27T21:21:26.950413] [INFO ] [REMOTE ] SWK: Full fetch complete (75536 records). [2025-10-27T21:21:26.950558] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-27T21:21:27.278078] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T21:21:27.381998] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-27T21:21:27.382730] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-27T21:21:27.384830] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-27T21:21:27.384921] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-27T21:21:27.383530] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T21:21:27.393783] [DEBUG] [LOCAL ] SWK: Trimmed 75536 records to 52318 (keeping 200 days of data) [2025-10-27T21:21:27.617725] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-27T21:21:27.712079] [DEBUG] [LOCAL ] SWK: Primary data saved (52318 records). [2025-10-27T21:21:27.712218] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-27T21:21:27.712886] [INFO ] [MAIN ] Update Progress: 2030/2366 symbols completed. SWK took 30.1s. Estimated remaining: 43m 16s. Rate: 7.8 symbols/min [2025-10-27T21:21:27.878612] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:27.893829] [DEBUG] [LOCAL ] SXI: Loaded 12150 existing records from primary storage. [2025-10-27T21:21:27.894050] [INFO ] [MAIN ] SXI: Loaded 12150 existing records. [2025-10-27T21:21:28.066527] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:28.066765] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-27T21:21:28.066814] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-27T21:21:28.067006] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-27T21:21:28.067062] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-27T21:21:28.249799] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-27T21:21:28.424474] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-27T21:21:28.429787] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:29.215029] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-27T21:21:29.683519] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:21:29.947605] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T21:21:30.014930] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-27T21:21:30.815005] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-27T21:21:31.271162] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:21:31.292308] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T21:21:31.614977] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-27T21:21:32.414965] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-27T21:21:32.795125] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T21:21:32.851555] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-27T21:21:33.215005] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-27T21:21:33.610890] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:21:34.014938] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-27T21:21:34.814938] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-27T21:21:34.848303] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T21:21:35.614936] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-27T21:21:35.725495] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T21:21:35.983273] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T21:21:36.414986] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-27T21:21:37.004048] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T21:21:37.005551] [INFO ] [REMOTE ] SWZ: Full fetch complete (8264 records). [2025-10-27T21:21:37.005621] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-27T21:21:37.220108] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-27T21:21:37.353851] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-27T21:21:37.353918] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-27T21:21:37.354109] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-27T21:21:37.354147] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-27T21:21:37.354529] [DEBUG] [LOCAL ] SWZ: Trimmed 8264 records to 5900 (keeping 200 days of data) [2025-10-27T21:21:37.385783] [DEBUG] [LOCAL ] SWZ: Primary data saved (5900 records). [2025-10-27T21:21:37.385859] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-27T21:21:37.385929] [INFO ] [MAIN ] Update Progress: 2031/2366 symbols completed. SWZ took 17.2s. Estimated remaining: 43m 9s. Rate: 7.8 symbols/min [2025-10-27T21:21:37.549484] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:37.578200] [DEBUG] [LOCAL ] SXT: Loaded 29944 existing records from primary storage. [2025-10-27T21:21:37.578451] [INFO ] [MAIN ] SXT: Loaded 29944 existing records. [2025-10-27T21:21:37.755588] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:37.755813] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-27T21:21:37.755863] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-27T21:21:37.756077] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-27T21:21:37.756114] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-27T21:21:38.020372] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-27T21:21:38.099448] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:38.682031] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T21:21:38.814907] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-27T21:21:39.338268] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:21:39.614936] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-27T21:21:39.889627] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T21:21:40.327412] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T21:21:40.414907] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-27T21:21:41.214944] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-27T21:21:41.439530] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:21:41.792230] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T21:21:42.014923] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-27T21:21:42.813459] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T21:21:42.818597] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-27T21:21:43.614944] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-27T21:21:44.175313] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T21:21:44.414939] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-27T21:21:44.607366] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:21:45.214932] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-27T21:21:45.940985] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:21:46.014913] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-27T21:21:46.033557] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-27T21:21:46.814970] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-27T21:21:47.506156] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-27T21:21:47.579524] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-27T21:21:47.614907] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-27T21:21:48.414965] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-27T21:21:48.794965] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:21:49.214951] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-27T21:21:49.654888] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:21:50.014955] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-27T21:21:50.073835] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T21:21:50.814965] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-27T21:21:50.976226] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T21:21:51.519978] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T21:21:51.525585] [INFO ] [REMOTE ] SWX: Full fetch complete (43757 records). [2025-10-27T21:21:51.525714] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-27T21:21:51.620208] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-27T21:21:51.949840] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-27T21:21:51.949949] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-27T21:21:51.950867] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-27T21:21:51.950968] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-27T21:21:51.951982] [DEBUG] [LOCAL ] SWX: Trimmed 43757 records to 30113 (keeping 200 days of data) [2025-10-27T21:21:52.130023] [DEBUG] [LOCAL ] SWX: Primary data saved (30113 records). [2025-10-27T21:21:52.130155] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-27T21:21:52.130233] [INFO ] [MAIN ] Update Progress: 2032/2366 symbols completed. SWX took 44.3s. Estimated remaining: 43m 2s. Rate: 7.8 symbols/min [2025-10-27T21:21:52.303188] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:21:52.314603] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T21:21:52.362192] [DEBUG] [LOCAL ] SYF: Loaded 54231 existing records from primary storage. [2025-10-27T21:21:52.362506] [INFO ] [MAIN ] SYF: Loaded 54231 existing records. [2025-10-27T21:21:52.423343] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-27T21:21:52.547181] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:21:52.547397] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-27T21:21:52.547446] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-27T21:21:52.547833] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-27T21:21:52.547891] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-27T21:21:52.908962] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:21:53.214958] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-27T21:21:53.751703] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T21:21:54.014931] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-27T21:21:54.640286] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T21:21:54.814962] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-27T21:21:55.341475] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T21:21:55.614908] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-27T21:21:55.845117] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T21:21:56.400970] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-27T21:21:56.414921] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-27T21:21:57.214931] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-27T21:21:57.646205] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T21:21:57.741806] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-27T21:21:58.014945] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-27T21:21:58.641360] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T21:21:58.814974] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-27T21:21:59.614946] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-27T21:21:59.999981] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:22:00.414938] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-27T21:22:01.214942] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-27T21:22:01.293964] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T21:22:01.299949] [INFO ] [REMOTE ] SXT: Full fetch complete (39689 records). [2025-10-27T21:22:01.300051] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-27T21:22:01.689393] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-27T21:22:01.689562] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-27T21:22:01.690563] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-27T21:22:01.690703] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-27T21:22:01.692135] [DEBUG] [LOCAL ] SXT: Trimmed 39689 records to 29243 (keeping 200 days of data) [2025-10-27T21:22:01.828428] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-27T21:22:01.920297] [DEBUG] [LOCAL ] SXT: Primary data saved (29243 records). [2025-10-27T21:22:01.920436] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-27T21:22:01.920512] [INFO ] [MAIN ] Update Progress: 2033/2366 symbols completed. SXT took 24.5s. Estimated remaining: 42m 55s. Rate: 7.8 symbols/min [2025-10-27T21:22:02.020019] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-27T21:22:02.091636] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:02.134334] [DEBUG] [LOCAL ] SYK: Loaded 47477 existing records from primary storage. [2025-10-27T21:22:02.134620] [INFO ] [MAIN ] SYK: Loaded 47477 existing records. [2025-10-27T21:22:02.311053] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:02.311270] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-27T21:22:02.311316] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-27T21:22:02.311493] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-27T21:22:02.311530] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-27T21:22:02.679292] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:02.702281] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T21:22:02.710754] [INFO ] [REMOTE ] SXC: Full fetch complete (60830 records). [2025-10-27T21:22:02.710883] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-27T21:22:02.820063] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-27T21:22:03.104935] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-27T21:22:03.105010] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-27T21:22:03.106032] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-27T21:22:03.106094] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-27T21:22:03.107462] [DEBUG] [LOCAL ] SXC: Trimmed 60830 records to 41299 (keeping 200 days of data) [2025-10-27T21:22:03.354192] [DEBUG] [LOCAL ] SXC: Primary data saved (41299 records). [2025-10-27T21:22:03.354311] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-27T21:22:03.354386] [INFO ] [MAIN ] Update Progress: 2034/2366 symbols completed. SXC took 40.4s. Estimated remaining: 42m 46s. Rate: 7.8 symbols/min [2025-10-27T21:22:03.536832] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:03.618088] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T21:22:03.618212] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-27T21:22:03.632559] [DEBUG] [LOCAL ] SYY: Loaded 53973 existing records from primary storage. [2025-10-27T21:22:03.633575] [INFO ] [MAIN ] SYY: Loaded 53973 existing records. [2025-10-27T21:22:03.768473] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T21:22:03.830086] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:03.830330] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-27T21:22:03.830377] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-27T21:22:03.831003] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-27T21:22:03.831061] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-27T21:22:04.179285] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:04.414958] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-27T21:22:05.092661] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T21:22:05.214938] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-27T21:22:05.821830] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T21:22:05.827731] [INFO ] [REMOTE ] SXI: Full fetch complete (15978 records). [2025-10-27T21:22:05.827969] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-27T21:22:06.018716] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-27T21:22:06.356407] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T21:22:06.452449] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-27T21:22:06.452531] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-27T21:22:06.452941] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-27T21:22:06.453003] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-27T21:22:06.453537] [DEBUG] [LOCAL ] SXI: Trimmed 15978 records to 11922 (keeping 200 days of data) [2025-10-27T21:22:06.539485] [DEBUG] [LOCAL ] SXI: Primary data saved (11922 records). [2025-10-27T21:22:06.539703] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-27T21:22:06.540035] [INFO ] [MAIN ] Update Progress: 2035/2366 symbols completed. SXI took 38.8s. Estimated remaining: 42m 37s. Rate: 7.8 symbols/min [2025-10-27T21:22:06.722317] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:06.773253] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-27T21:22:06.773573] [INFO ] [MAIN ] T: Loaded 54578 existing records. [2025-10-27T21:22:06.820079] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-27T21:22:06.948545] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:06.948774] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-27T21:22:06.948823] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-27T21:22:06.949009] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-27T21:22:06.949046] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-27T21:22:07.288108] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:07.450885] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:22:07.614959] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-27T21:22:08.414962] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-27T21:22:08.603839] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-27T21:22:09.083506] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T21:22:09.214943] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-27T21:22:10.014948] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-27T21:22:10.145398] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T21:22:10.814940] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-27T21:22:10.994308] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T21:22:11.614924] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-27T21:22:11.775314] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T21:22:12.415003] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-27T21:22:12.895005] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T21:22:13.144913] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:22:13.214920] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-27T21:22:14.014968] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-27T21:22:14.097292] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T21:22:14.650372] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:22:14.815102] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-27T21:22:15.614935] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-27T21:22:16.078126] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T21:22:16.384520] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T21:22:16.414905] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-27T21:22:17.214941] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-27T21:22:18.014990] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-27T21:22:18.108811] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-27T21:22:18.336438] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T21:22:18.814986] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-27T21:22:19.006400] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T21:22:19.016599] [INFO ] [REMOTE ] SYF: Full fetch complete (77577 records). [2025-10-27T21:22:19.016796] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-27T21:22:19.410030] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-27T21:22:19.410184] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-27T21:22:19.411361] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-27T21:22:19.411499] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-27T21:22:19.413019] [DEBUG] [LOCAL ] SYF: Trimmed 77577 records to 53447 (keeping 200 days of data) [2025-10-27T21:22:19.634229] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-27T21:22:19.680848] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-27T21:22:19.794463] [DEBUG] [LOCAL ] SYF: Primary data saved (53447 records). [2025-10-27T21:22:19.794601] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-27T21:22:19.794707] [INFO ] [MAIN ] Update Progress: 2036/2366 symbols completed. SYF took 27.7s. Estimated remaining: 42m 31s. Rate: 7.8 symbols/min [2025-10-27T21:22:19.964192] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:20.005843] [DEBUG] [LOCAL ] TAC: Loaded 44150 existing records from primary storage. [2025-10-27T21:22:20.006160] [INFO ] [MAIN ] TAC: Loaded 44150 existing records. [2025-10-27T21:22:20.184497] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:20.184820] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-27T21:22:20.184871] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-27T21:22:20.185218] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-27T21:22:20.185276] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-27T21:22:20.373612] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:22:20.415491] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-27T21:22:20.601164] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:21.214919] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-27T21:22:22.014976] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-27T21:22:22.096063] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-27T21:22:22.242216] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-27T21:22:22.478747] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T21:22:22.814995] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-27T21:22:23.615170] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-27T21:22:23.683720] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T21:22:23.969290] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T21:22:24.415054] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-27T21:22:25.088926] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T21:22:25.214994] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-27T21:22:26.015005] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-27T21:22:26.692414] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-27T21:22:26.729058] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T21:22:26.814949] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-27T21:22:27.614956] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-27T21:22:27.652137] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-27T21:22:28.415016] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-27T21:22:29.128384] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-27T21:22:29.201102] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T21:22:29.214904] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-27T21:22:29.875027] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T21:22:30.014983] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-27T21:22:30.432996] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T21:22:30.815046] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-27T21:22:31.615015] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-27T21:22:32.252748] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:22:32.334862] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-27T21:22:32.414975] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-27T21:22:33.214948] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-27T21:22:33.314541] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-27T21:22:34.014996] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-27T21:22:34.166383] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-27T21:22:34.237275] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T21:22:34.815015] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-27T21:22:35.618587] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-27T21:22:35.620833] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T21:22:35.630869] [INFO ] [REMOTE ] SYK: Full fetch complete (69107 records). [2025-10-27T21:22:35.630986] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-27T21:22:36.024319] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-27T21:22:36.024526] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-27T21:22:36.025612] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-27T21:22:36.039593] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-27T21:22:36.050960] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T21:22:36.060180] [DEBUG] [LOCAL ] SYK: Trimmed 69107 records to 46656 (keeping 200 days of data) [2025-10-27T21:22:36.355983] [DEBUG] [LOCAL ] SYK: Primary data saved (46656 records). [2025-10-27T21:22:36.356102] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-27T21:22:36.356539] [INFO ] [MAIN ] Update Progress: 2037/2366 symbols completed. SYK took 34.4s. Estimated remaining: 42m 24s. Rate: 7.8 symbols/min [2025-10-27T21:22:36.414913] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-27T21:22:37.215020] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-27T21:22:38.130879] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-27T21:22:38.143112] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-27T21:22:38.212691] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T21:22:38.348827] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T21:22:38.815002] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-27T21:22:39.614971] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-27T21:22:40.088293] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-27T21:22:40.099295] [INFO ] [REMOTE ] SYY: Full fetch complete (77254 records). [2025-10-27T21:22:40.099468] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-27T21:22:40.554804] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-27T21:22:40.557576] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-27T21:22:40.558809] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-27T21:22:40.558893] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-27T21:22:40.561265] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-27T21:22:40.571933] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-27T21:22:40.572019] [DEBUG] [LOCAL ] SYY: Trimmed 77254 records to 53192 (keeping 200 days of data) [2025-10-27T21:22:40.572186] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-27T21:22:41.344806] [DEBUG] [LOCAL ] SYY: Primary data saved (53192 records). [2025-10-27T21:22:41.344685] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-27T21:22:41.345178] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-27T21:22:41.345451] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-27T21:22:41.347210] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-27T21:22:41.347576] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-27T21:22:41.347381] [INFO ] [MAIN ] Update Progress: 2038/2366 symbols completed. SYY took 38.0s. Estimated remaining: 42m 16s. Rate: 7.8 symbols/min [2025-10-27T21:22:41.384379] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T21:22:41.384722] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-27T21:22:41.396107] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-27T21:22:41.767167] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-27T21:22:41.767337] [INFO ] [MAIN ] T: Full history saved. [2025-10-27T21:22:41.768018] [INFO ] [MAIN ] Update Progress: 2039/2366 symbols completed. T took 35.2s. Estimated remaining: 42m 7s. Rate: 7.8 symbols/min [2025-10-27T21:22:42.898069] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T21:22:42.907599] [INFO ] [REMOTE ] TAC: Full fetch complete (64802 records). [2025-10-27T21:22:42.907728] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-27T21:22:43.289178] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-27T21:22:43.289253] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-27T21:22:43.290296] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-27T21:22:43.290357] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-27T21:22:43.291538] [DEBUG] [LOCAL ] TAC: Trimmed 64802 records to 43453 (keeping 200 days of data) [2025-10-27T21:22:43.555187] [DEBUG] [LOCAL ] TAC: Primary data saved (43453 records). [2025-10-27T21:22:43.555306] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-27T21:22:43.555380] [INFO ] [MAIN ] Update Progress: 2040/2366 symbols completed. TAC took 23.8s. Estimated remaining: 41m 59s. Rate: 7.8 symbols/min [2025-10-27T21:22:44.152006] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:44.147535] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:44.238100] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:44.293490] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:22:44.390904] [DEBUG] [LOCAL ] TAP: Loaded 53722 existing records from primary storage. [2025-10-27T21:22:44.421209] [INFO ] [MAIN ] TAP: Loaded 53722 existing records. [2025-10-27T21:22:44.433104] [DEBUG] [LOCAL ] TALO: Loaded 51719 existing records from primary storage. [2025-10-27T21:22:44.421029] [DEBUG] [LOCAL ] TAL: Loaded 52442 existing records from primary storage. [2025-10-27T21:22:44.456364] [INFO ] [MAIN ] TAL: Loaded 52442 existing records. [2025-10-27T21:22:44.456236] [INFO ] [MAIN ] TALO: Loaded 51719 existing records. [2025-10-27T21:22:44.523301] [DEBUG] [LOCAL ] TAK: Loaded 50930 existing records from primary storage. [2025-10-27T21:22:44.615363] [INFO ] [MAIN ] TAK: Loaded 50930 existing records. [2025-10-27T21:22:45.119312] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:45.175239] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-27T21:22:45.226734] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:45.237295] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-27T21:22:45.249139] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-27T21:22:45.237165] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:45.249232] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-27T21:22:45.270194] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-27T21:22:45.270352] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-27T21:22:45.280252] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-27T21:22:45.302702] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-27T21:22:45.280157] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:22:45.286709] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-27T21:22:45.330525] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-27T21:22:45.336119] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-27T21:22:45.373540] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-27T21:22:45.357174] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-27T21:22:45.404347] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-27T21:22:45.459776] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-27T21:22:45.526431] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-27T21:22:46.450885] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:46.540041] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-27T21:22:46.660661] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:46.700208] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-27T21:22:46.826475] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:46.831278] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-27T21:22:46.916252] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:22:46.916588] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-27T21:22:48.025770] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T21:22:48.035966] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-27T21:22:48.415803] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T21:22:48.426962] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-27T21:22:48.457748] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:22:48.468054] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-27T21:22:48.497849] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T21:22:48.508042] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-27T21:22:49.385040] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T21:22:49.395666] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-27T21:22:49.544293] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T21:22:49.554857] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-27T21:22:49.582890] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-27T21:22:49.592364] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-27T21:22:49.655040] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T21:22:50.015000] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-27T21:22:50.823962] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:22:50.839858] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-27T21:22:51.143176] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T21:22:51.221254] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T21:22:51.614920] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-27T21:22:51.755197] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-27T21:22:52.206339] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-27T21:22:52.414986] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-27T21:22:52.819569] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:22:53.214997] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-27T21:22:54.015012] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-27T21:22:54.392058] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T21:22:54.464225] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T21:22:54.814971] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-27T21:22:55.614928] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-27T21:22:55.645078] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:22:56.117845] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-27T21:22:56.415114] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-27T21:22:57.038422] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T21:22:57.214946] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-27T21:22:57.818308] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T21:22:58.014949] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-27T21:22:58.814984] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-27T21:22:58.913932] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-27T21:22:59.614981] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-27T21:22:59.682714] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:23:00.163452] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-27T21:23:00.414947] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-27T21:23:01.036591] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T21:23:01.215009] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-27T21:23:02.014974] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-27T21:23:02.815009] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-27T21:23:06.060033] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (5.65 seconds). [2025-10-27T21:23:06.070826] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-27T21:23:07.203941] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (5.19 seconds). [2025-10-27T21:23:07.214986] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-27T21:23:07.543104] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (6.33 seconds). [2025-10-27T21:23:07.554421] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-27T21:23:07.892415] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (5.08 seconds). [2025-10-27T21:23:07.904776] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-27T21:23:07.939941] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T21:23:07.952769] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-27T21:23:08.633608] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T21:23:08.644855] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-27T21:23:09.194145] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T21:23:09.205192] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-27T21:23:09.417549] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T21:23:09.440473] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T21:23:09.439187] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-27T21:23:09.451234] [INFO ] [REMOTE ] TALO: Full fetch complete (73390 records). [2025-10-27T21:23:09.451410] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-27T21:23:09.852866] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-27T21:23:09.852983] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-27T21:23:09.854414] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-27T21:23:09.854521] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-27T21:23:09.856163] [DEBUG] [LOCAL ] TALO: Trimmed 73390 records to 50918 (keeping 200 days of data) [2025-10-27T21:23:10.001136] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T21:23:10.092601] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-27T21:23:10.184977] [DEBUG] [LOCAL ] TALO: Primary data saved (50918 records). [2025-10-27T21:23:10.185177] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-27T21:23:10.185296] [INFO ] [MAIN ] Update Progress: 2041/2366 symbols completed. TALO took 26.6s. Estimated remaining: 41m 54s. Rate: 7.8 symbols/min [2025-10-27T21:23:10.349779] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:10.360748] [DEBUG] [LOCAL ] TBB: Loaded 11390 existing records from primary storage. [2025-10-27T21:23:10.360938] [INFO ] [MAIN ] TBB: Loaded 11390 existing records. [2025-10-27T21:23:10.539077] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:10.539244] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-27T21:23:10.539289] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-27T21:23:10.539452] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-27T21:23:10.539509] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-27T21:23:10.896877] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:10.897302] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-27T21:23:10.924828] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T21:23:10.935579] [INFO ] [REMOTE ] TAP: Full fetch complete (76514 records). [2025-10-27T21:23:10.935788] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-27T21:23:11.239731] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-27T21:23:11.382446] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-27T21:23:11.382542] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-27T21:23:11.383699] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-27T21:23:11.383779] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-27T21:23:11.385330] [DEBUG] [LOCAL ] TAP: Trimmed 76514 records to 52942 (keeping 200 days of data) [2025-10-27T21:23:11.526008] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T21:23:11.636966] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-27T21:23:11.740842] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T21:23:11.765857] [DEBUG] [LOCAL ] TAP: Primary data saved (52942 records). [2025-10-27T21:23:11.765968] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-27T21:23:11.766532] [INFO ] [MAIN ] Update Progress: 2042/2366 symbols completed. TAP took 28.2s. Estimated remaining: 41m 45s. Rate: 7.8 symbols/min [2025-10-27T21:23:11.930993] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:11.966708] [DEBUG] [LOCAL ] TBBB: Loaded 36125 existing records from primary storage. [2025-10-27T21:23:11.967017] [INFO ] [MAIN ] TBBB: Loaded 36125 existing records. [2025-10-27T21:23:12.139390] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:12.139581] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-27T21:23:12.139665] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-27T21:23:12.139863] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-27T21:23:12.139901] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-27T21:23:12.420043] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-27T21:23:12.486171] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:13.214931] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-27T21:23:13.228440] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T21:23:13.518919] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T21:23:14.014931] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-27T21:23:14.561926] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T21:23:14.571477] [INFO ] [REMOTE ] TAK: Full fetch complete (72037 records). [2025-10-27T21:23:14.571582] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-27T21:23:14.822138] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-27T21:23:14.870350] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T21:23:14.965077] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-27T21:23:14.965154] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-27T21:23:14.966241] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-27T21:23:14.966303] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-27T21:23:14.967819] [DEBUG] [LOCAL ] TAK: Trimmed 72037 records to 50158 (keeping 200 days of data) [2025-10-27T21:23:15.259533] [DEBUG] [LOCAL ] TAK: Primary data saved (50158 records). [2025-10-27T21:23:15.259680] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-27T21:23:15.259782] [INFO ] [MAIN ] Update Progress: 2043/2366 symbols completed. TAK took 31.7s. Estimated remaining: 41m 37s. Rate: 7.8 symbols/min [2025-10-27T21:23:15.424405] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:15.445495] [DEBUG] [LOCAL ] TBI: Loaded 23059 existing records from primary storage. [2025-10-27T21:23:15.445751] [INFO ] [MAIN ] TBI: Loaded 23059 existing records. [2025-10-27T21:23:15.619758] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-27T21:23:15.619668] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:15.620605] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-27T21:23:15.620685] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-27T21:23:15.620926] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-27T21:23:15.620964] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-27T21:23:15.964521] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:23:15.997738] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:16.209596] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T21:23:16.414915] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-27T21:23:17.214921] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-27T21:23:17.377952] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T21:23:18.014943] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-27T21:23:18.776579] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T21:23:18.794841] [INFO ] [REMOTE ] TAL: Full fetch complete (75686 records). [2025-10-27T21:23:18.795087] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-27T21:23:18.796076] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T21:23:18.820211] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-27T21:23:19.189791] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-27T21:23:19.189867] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-27T21:23:19.190968] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-27T21:23:19.191032] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-27T21:23:19.192458] [DEBUG] [LOCAL ] TAL: Trimmed 75686 records to 51657 (keeping 200 days of data) [2025-10-27T21:23:19.492903] [DEBUG] [LOCAL ] TAL: Primary data saved (51657 records). [2025-10-27T21:23:19.493049] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-27T21:23:19.493131] [INFO ] [MAIN ] Update Progress: 2044/2366 symbols completed. TAL took 35.9s. Estimated remaining: 41m 28s. Rate: 7.8 symbols/min [2025-10-27T21:23:19.620038] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-27T21:23:19.667937] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:19.668116] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-27T21:23:19.668159] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-27T21:23:19.668267] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-27T21:23:19.668309] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-27T21:23:19.668351] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-27T21:23:19.668384] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-27T21:23:20.022759] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:20.077769] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:23:20.414916] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-27T21:23:20.475974] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T21:23:20.672258] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-27T21:23:21.214963] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-27T21:23:21.945345] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-27T21:23:22.015002] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-27T21:23:22.814981] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-27T21:23:23.133598] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-27T21:23:23.614989] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-27T21:23:23.864784] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-27T21:23:23.899707] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T21:23:24.414992] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-27T21:23:25.220059] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-27T21:23:25.221737] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-27T21:23:26.014964] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-27T21:23:26.457740] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T21:23:26.790159] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T21:23:26.814926] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-27T21:23:27.601498] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T21:23:27.614919] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-27T21:23:28.414927] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-27T21:23:28.455494] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-27T21:23:28.688039] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-27T21:23:29.214952] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-27T21:23:29.556506] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-27T21:23:30.014963] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-27T21:23:30.305593] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-27T21:23:30.814919] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-27T21:23:31.614936] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-27T21:23:32.102324] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-27T21:23:32.414938] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-27T21:23:33.214987] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-27T21:23:33.406095] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-27T21:23:33.411003] [INFO ] [REMOTE ] TBB: Full fetch complete (16146 records). [2025-10-27T21:23:33.411117] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-27T21:23:33.531060] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:23:33.791218] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-27T21:23:33.791290] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-27T21:23:33.791564] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-27T21:23:33.791602] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-27T21:23:33.792090] [DEBUG] [LOCAL ] TBB: Trimmed 16146 records to 11028 (keeping 200 days of data) [2025-10-27T21:23:33.856731] [DEBUG] [LOCAL ] TBB: Primary data saved (11028 records). [2025-10-27T21:23:33.856838] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-27T21:23:33.856913] [INFO ] [MAIN ] Update Progress: 2045/2366 symbols completed. TBB took 23.7s. Estimated remaining: 41m 22s. Rate: 7.8 symbols/min [2025-10-27T21:23:34.020368] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-27T21:23:34.023065] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:34.030702] [DEBUG] [LOCAL ] TBN: Loaded 4423 existing records from primary storage. [2025-10-27T21:23:34.030864] [INFO ] [MAIN ] TBN: Loaded 4423 existing records. [2025-10-27T21:23:34.205471] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:34.205752] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-27T21:23:34.205802] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-27T21:23:34.205938] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-27T21:23:34.205975] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-27T21:23:34.375829] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T21:23:34.407763] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:23:34.587223] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:34.814904] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-27T21:23:35.366385] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T21:23:35.614923] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-27T21:23:36.208239] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T21:23:36.414942] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-27T21:23:37.214981] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-27T21:23:37.514091] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T21:23:38.014954] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-27T21:23:38.237299] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T21:23:38.340376] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T21:23:38.814982] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-27T21:23:39.540284] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T21:23:39.614931] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-27T21:23:40.414963] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-27T21:23:40.520403] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T21:23:41.027092] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-27T21:23:41.215003] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-27T21:23:41.516477] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-27T21:23:42.014926] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-27T21:23:42.676196] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T21:23:42.814930] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-27T21:23:43.615003] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-27T21:23:43.838414] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T21:23:43.957213] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-27T21:23:44.414956] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-27T21:23:45.067696] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-27T21:23:45.214982] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-27T21:23:46.014945] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-27T21:23:46.351360] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T21:23:46.413486] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T21:23:46.424221] [INFO ] [REMOTE ] TBBB: Full fetch complete (52441 records). [2025-10-27T21:23:46.424363] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-27T21:23:46.790096] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-27T21:23:46.790177] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-27T21:23:46.791114] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-27T21:23:46.791176] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-27T21:23:46.792214] [DEBUG] [LOCAL ] TBBB: Trimmed 52441 records to 35391 (keeping 200 days of data) [2025-10-27T21:23:46.838134] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-27T21:23:46.994169] [DEBUG] [LOCAL ] TBBB: Primary data saved (35391 records). [2025-10-27T21:23:46.994306] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-27T21:23:46.994384] [INFO ] [MAIN ] Update Progress: 2046/2366 symbols completed. TBBB took 35.2s. Estimated remaining: 41m 15s. Rate: 7.8 symbols/min [2025-10-27T21:23:47.157716] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:47.157878] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-27T21:23:47.157915] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-27T21:23:47.158057] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-27T21:23:47.158105] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-27T21:23:47.158145] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-27T21:23:47.158176] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-27T21:23:47.260297] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T21:23:47.264141] [INFO ] [REMOTE ] TBLU: Full fetch complete (1232 records). [2025-10-27T21:23:47.270026] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-27T21:23:47.618856] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-27T21:23:47.659458] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-27T21:23:47.699268] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:23:47.724047] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:23:47.728910] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-27T21:23:47.728793] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:47.729074] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-27T21:23:47.729389] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-27T21:23:47.729459] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-27T21:23:47.729531] [INFO ] [MAIN ] Update Progress: 2047/2366 symbols completed. TBLU took 28.2s. Estimated remaining: 41m 6s. Rate: 7.8 symbols/min [2025-10-27T21:23:47.893965] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:47.905140] [DEBUG] [LOCAL ] TCBX: Loaded 10345 existing records from primary storage. [2025-10-27T21:23:47.905346] [INFO ] [MAIN ] TCBX: Loaded 10345 existing records. [2025-10-27T21:23:48.081729] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:48.081943] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-27T21:23:48.081992] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-27T21:23:48.082147] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-27T21:23:48.082186] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-27T21:23:48.429268] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-27T21:23:48.434966] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:48.542392] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T21:23:48.547810] [INFO ] [REMOTE ] TBI: Full fetch complete (32162 records). [2025-10-27T21:23:48.547910] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-27T21:23:48.985590] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-27T21:23:48.985830] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-27T21:23:48.987450] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-27T21:23:48.988301] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-27T21:23:48.988381] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-27T21:23:48.989240] [DEBUG] [LOCAL ] TBI: Trimmed 32162 records to 22549 (keeping 200 days of data) [2025-10-27T21:23:49.113694] [DEBUG] [LOCAL ] TBI: Primary data saved (22549 records). [2025-10-27T21:23:49.113820] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-27T21:23:49.113896] [INFO ] [MAIN ] Update Progress: 2048/2366 symbols completed. TBI took 33.9s. Estimated remaining: 40m 57s. Rate: 7.8 symbols/min [2025-10-27T21:23:49.216478] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-10-27T21:23:49.290928] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:49.291146] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-27T21:23:49.291232] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-27T21:23:49.291314] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-27T21:23:49.291352] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-27T21:23:49.291392] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-27T21:23:49.291422] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-27T21:23:49.463556] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:23:49.535244] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-10-27T21:23:49.556273] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:23:49.566446] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-27T21:23:49.566544] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:23:49.566968] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-27T21:23:49.572459] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-27T21:23:49.582767] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-27T21:23:49.593115] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-27T21:23:49.593228] [INFO ] [MAIN ] Update Progress: 2049/2366 symbols completed. TCAI took 2.6s. Estimated remaining: 40m 49s. Rate: 7.8 symbols/min [2025-10-27T21:23:49.677969] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:49.817683] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:49.864732] [DEBUG] [LOCAL ] TD: Loaded 52951 existing records from primary storage. [2025-10-27T21:23:49.865024] [INFO ] [MAIN ] TD: Loaded 52951 existing records. [2025-10-27T21:23:50.020777] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2025-01. [2025-10-27T21:23:50.049191] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:50.049433] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-27T21:23:50.049501] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-27T21:23:50.049761] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-27T21:23:50.049818] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-27T21:23:50.408427] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:50.409210] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:23:50.409874] [WARN ] [REMOTE ] TCPA: No data returned for month 2025-01 [2025-10-27T21:23:50.409983] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:23:50.410051] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-27T21:23:50.410116] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:23:50.410185] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-27T21:23:50.410267] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-27T21:23:50.410304] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-27T21:23:50.410343] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-27T21:23:50.410388] [INFO ] [MAIN ] Update Progress: 2050/2366 symbols completed. TCPA took 1.3s. Estimated remaining: 40m 40s. Rate: 7.8 symbols/min [2025-10-27T21:23:50.573594] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:23:50.615637] [DEBUG] [LOCAL ] TDC: Loaded 47089 existing records from primary storage. [2025-10-27T21:23:50.615960] [INFO ] [MAIN ] TDC: Loaded 47089 existing records. [2025-10-27T21:23:50.785797] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:23:50.785993] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-27T21:23:50.786038] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-27T21:23:50.786212] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-27T21:23:50.786249] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-27T21:23:50.820174] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-27T21:23:51.138266] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:23:51.615040] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-27T21:23:52.414943] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-27T21:23:52.595047] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T21:23:52.659620] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:23:53.091319] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T21:23:53.214942] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-27T21:23:54.014961] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-27T21:23:54.657987] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T21:23:54.814919] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-27T21:23:55.133108] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-27T21:23:55.329914] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:23:55.614998] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-27T21:23:56.414939] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-27T21:23:57.160086] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T21:23:57.214908] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-27T21:23:57.388930] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-27T21:23:58.014937] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-27T21:23:58.815872] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-27T21:23:58.821298] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T21:23:59.171676] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:23:59.587971] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-27T21:23:59.614899] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-27T21:24:00.414962] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-27T21:24:00.532090] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T21:24:01.214947] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-27T21:24:01.556299] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-27T21:24:02.014958] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-27T21:24:02.091067] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T21:24:02.384780] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-27T21:24:02.815014] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-27T21:24:03.615013] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-27T21:24:04.103713] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:24:04.382406] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T21:24:04.414914] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-27T21:24:05.209036] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T21:24:05.211819] [INFO ] [REMOTE ] TBN: Full fetch complete (6387 records). [2025-10-27T21:24:05.211896] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-27T21:24:05.223357] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-27T21:24:05.565707] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-27T21:24:05.565788] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-27T21:24:05.565960] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-27T21:24:05.565998] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-27T21:24:05.566363] [DEBUG] [LOCAL ] TBN: Trimmed 6387 records to 4471 (keeping 200 days of data) [2025-10-27T21:24:05.591218] [DEBUG] [LOCAL ] TBN: Primary data saved (4471 records). [2025-10-27T21:24:05.591297] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-27T21:24:05.591380] [INFO ] [MAIN ] Update Progress: 2051/2366 symbols completed. TBN took 31.7s. Estimated remaining: 40m 33s. Rate: 7.8 symbols/min [2025-10-27T21:24:05.754850] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:05.762594] [DEBUG] [LOCAL ] TDF: Loaded 6255 existing records from primary storage. [2025-10-27T21:24:05.762806] [INFO ] [MAIN ] TDF: Loaded 6255 existing records. [2025-10-27T21:24:05.935819] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:05.936046] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-27T21:24:05.936094] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-27T21:24:05.936242] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-27T21:24:05.936280] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-27T21:24:06.023767] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-27T21:24:06.334933] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:06.665889] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T21:24:06.814956] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-27T21:24:07.433415] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T21:24:07.614974] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-27T21:24:08.332935] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T21:24:08.414906] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-27T21:24:08.870353] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T21:24:09.214943] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-27T21:24:09.543832] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T21:24:09.693874] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T21:24:10.014937] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-27T21:24:10.815001] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-27T21:24:11.496111] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T21:24:11.614930] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-27T21:24:11.710497] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T21:24:11.719853] [INFO ] [REMOTE ] TDC: Full fetch complete (67903 records). [2025-10-27T21:24:11.719979] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-27T21:24:12.097328] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-27T21:24:12.097465] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-27T21:24:12.098605] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-27T21:24:12.098709] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-27T21:24:12.107329] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-27T21:24:12.111267] [DEBUG] [LOCAL ] TDC: Trimmed 67903 records to 46307 (keeping 200 days of data) [2025-10-27T21:24:12.377116] [DEBUG] [LOCAL ] TDC: Primary data saved (46307 records). [2025-10-27T21:24:12.377227] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-27T21:24:12.377728] [INFO ] [MAIN ] Update Progress: 2052/2366 symbols completed. TDC took 22.0s. Estimated remaining: 40m 25s. Rate: 7.8 symbols/min [2025-10-27T21:24:12.420129] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-27T21:24:12.566368] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:12.590201] [DEBUG] [LOCAL ] TDG: Loaded 22248 existing records from primary storage. [2025-10-27T21:24:12.590464] [INFO ] [MAIN ] TDG: Loaded 22248 existing records. [2025-10-27T21:24:12.765235] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:12.765437] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-27T21:24:12.765484] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-27T21:24:12.765746] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-27T21:24:12.765810] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-27T21:24:13.051216] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T21:24:13.122965] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:13.214923] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-27T21:24:13.805229] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T21:24:14.014990] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-27T21:24:14.815001] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-27T21:24:15.253450] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T21:24:15.311944] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T21:24:15.614983] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-27T21:24:16.031568] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T21:24:16.414990] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-27T21:24:16.867460] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T21:24:17.214941] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-27T21:24:17.631842] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T21:24:18.014996] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-27T21:24:18.747752] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T21:24:18.814911] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-27T21:24:19.585176] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:24:19.614900] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-27T21:24:20.414953] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-27T21:24:20.488698] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T21:24:21.214940] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-27T21:24:21.752387] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:24:22.014919] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-27T21:24:22.377226] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:24:22.814991] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-27T21:24:23.302791] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-27T21:24:23.529836] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T21:24:23.614935] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-27T21:24:24.093441] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T21:24:24.414998] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-27T21:24:25.214934] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-27T21:24:25.539915] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:24:25.808212] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T21:24:26.014932] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-27T21:24:26.552482] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T21:24:26.815006] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-27T21:24:27.335884] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:24:27.338550] [INFO ] [REMOTE ] TCBX: Full fetch complete (15709 records). [2025-10-27T21:24:27.338620] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-27T21:24:27.620089] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-27T21:24:27.699398] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-27T21:24:27.699687] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-27T21:24:27.700152] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-27T21:24:27.700196] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-27T21:24:27.700707] [DEBUG] [LOCAL ] TCBX: Trimmed 15709 records to 10015 (keeping 200 days of data) [2025-10-27T21:24:27.759450] [DEBUG] [LOCAL ] TCBX: Primary data saved (10015 records). [2025-10-27T21:24:27.759597] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-27T21:24:27.759704] [INFO ] [MAIN ] Update Progress: 2053/2366 symbols completed. TCBX took 40.0s. Estimated remaining: 40m 19s. Rate: 7.8 symbols/min [2025-10-27T21:24:27.923399] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:27.970986] [DEBUG] [LOCAL ] TDOC: Loaded 54148 existing records from primary storage. [2025-10-27T21:24:27.971298] [INFO ] [MAIN ] TDOC: Loaded 54148 existing records. [2025-10-27T21:24:28.150958] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:28.151189] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-27T21:24:28.151267] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-27T21:24:28.151458] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-27T21:24:28.151498] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-27T21:24:28.420102] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-27T21:24:28.517396] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:29.196427] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T21:24:29.214952] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-27T21:24:29.247037] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T21:24:29.978445] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T21:24:30.014934] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-27T21:24:30.814957] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-27T21:24:31.066901] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T21:24:31.260790] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T21:24:31.262567] [INFO ] [REMOTE ] TDF: Full fetch complete (10264 records). [2025-10-27T21:24:31.262636] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-27T21:24:31.618447] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-27T21:24:31.618973] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-27T21:24:31.619968] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-27T21:24:31.620252] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-27T21:24:31.620293] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-27T21:24:31.620919] [DEBUG] [LOCAL ] TDF: Trimmed 10264 records to 6033 (keeping 200 days of data) [2025-10-27T21:24:31.657660] [DEBUG] [LOCAL ] TDF: Primary data saved (6033 records). [2025-10-27T21:24:31.657872] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-27T21:24:31.657967] [INFO ] [MAIN ] Update Progress: 2054/2366 symbols completed. TDF took 26.1s. Estimated remaining: 40m 10s. Rate: 7.8 symbols/min [2025-10-27T21:24:31.827506] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:31.866560] [DEBUG] [LOCAL ] TDS: Loaded 42599 existing records from primary storage. [2025-10-27T21:24:31.866912] [INFO ] [MAIN ] TDS: Loaded 42599 existing records. [2025-10-27T21:24:32.038965] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:32.039181] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-27T21:24:32.039226] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-27T21:24:32.039408] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-27T21:24:32.039445] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-27T21:24:32.383147] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:32.414904] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-27T21:24:32.922211] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T21:24:32.932397] [INFO ] [REMOTE ] TD: Full fetch complete (75805 records). [2025-10-27T21:24:32.932593] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-27T21:24:33.218816] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-27T21:24:33.313919] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-27T21:24:33.314000] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-27T21:24:33.315176] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-27T21:24:33.315258] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-27T21:24:33.316639] [DEBUG] [LOCAL ] TD: Trimmed 75805 records to 52135 (keeping 200 days of data) [2025-10-27T21:24:33.633024] [DEBUG] [LOCAL ] TD: Primary data saved (52135 records). [2025-10-27T21:24:33.633161] [INFO ] [MAIN ] TD: Full history saved. [2025-10-27T21:24:33.633239] [INFO ] [MAIN ] Update Progress: 2055/2366 symbols completed. TD took 44.0s. Estimated remaining: 40m 2s. Rate: 7.8 symbols/min [2025-10-27T21:24:33.802191] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:33.842034] [DEBUG] [LOCAL ] TDW: Loaded 45613 existing records from primary storage. [2025-10-27T21:24:33.842315] [INFO ] [MAIN ] TDW: Loaded 45613 existing records. [2025-10-27T21:24:34.019247] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-27T21:24:34.019143] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:34.020594] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-27T21:24:34.020693] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-27T21:24:34.021018] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-27T21:24:34.021173] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-27T21:24:34.147072] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T21:24:34.441692] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:34.638835] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T21:24:34.814991] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-27T21:24:35.614979] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-27T21:24:36.175740] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-27T21:24:36.287263] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T21:24:36.414896] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-27T21:24:36.480788] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-27T21:24:37.214980] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-27T21:24:38.014970] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-27T21:24:38.269049] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T21:24:38.502299] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T21:24:38.815008] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-27T21:24:38.829065] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T21:24:38.834075] [INFO ] [REMOTE ] TDG: Full fetch complete (31982 records). [2025-10-27T21:24:38.834205] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-27T21:24:39.204592] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-27T21:24:39.204715] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-27T21:24:39.205367] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-27T21:24:39.205411] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-27T21:24:39.206217] [DEBUG] [LOCAL ] TDG: Trimmed 31982 records to 21549 (keeping 200 days of data) [2025-10-27T21:24:39.343301] [DEBUG] [LOCAL ] TDG: Primary data saved (21549 records). [2025-10-27T21:24:39.343421] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-27T21:24:39.343497] [INFO ] [MAIN ] Update Progress: 2056/2366 symbols completed. TDG took 27.0s. Estimated remaining: 39m 54s. Rate: 7.8 symbols/min [2025-10-27T21:24:39.515093] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:39.535887] [DEBUG] [LOCAL ] TDY: Loaded 22473 existing records from primary storage. [2025-10-27T21:24:39.536143] [INFO ] [MAIN ] TDY: Loaded 22473 existing records. [2025-10-27T21:24:39.620044] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-27T21:24:39.722012] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:24:39.722483] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-27T21:24:39.722535] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-27T21:24:39.722743] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-27T21:24:39.722800] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-27T21:24:40.081516] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:24:40.414973] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-27T21:24:40.443708] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T21:24:41.220220] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-27T21:24:41.233463] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T21:24:41.660764] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T21:24:42.014994] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-27T21:24:42.361741] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:24:42.814978] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-27T21:24:43.231024] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T21:24:43.615014] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-27T21:24:44.414931] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-27T21:24:44.464911] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T21:24:44.667072] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T21:24:45.214983] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-27T21:24:45.467183] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T21:24:45.989674] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:24:46.014903] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-27T21:24:46.814943] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-27T21:24:47.140882] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T21:24:47.614958] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-27T21:24:48.177534] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T21:24:48.415006] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-27T21:24:49.010181] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T21:24:49.214917] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-27T21:24:49.609200] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T21:24:50.015065] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-27T21:24:50.814990] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-27T21:24:51.076733] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T21:24:51.576228] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T21:24:51.615014] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-27T21:24:52.414932] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-27T21:24:52.586519] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-27T21:24:53.117012] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T21:24:53.214918] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-27T21:24:53.291009] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-27T21:24:54.014986] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-27T21:24:54.760953] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-27T21:24:54.814920] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-27T21:24:55.214452] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-27T21:24:55.614963] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-27T21:24:56.301014] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:24:56.414949] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-27T21:24:56.764494] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T21:24:57.214988] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-27T21:24:57.545988] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T21:24:58.014965] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-27T21:24:58.061772] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T21:24:58.814950] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-27T21:24:58.946947] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T21:24:58.954287] [INFO ] [REMOTE ] TDS: Full fetch complete (61067 records). [2025-10-27T21:24:58.954413] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-27T21:24:59.329552] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-27T21:24:59.329634] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-27T21:24:59.330702] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-27T21:24:59.330763] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-27T21:24:59.331895] [DEBUG] [LOCAL ] TDS: Trimmed 61067 records to 41768 (keeping 200 days of data) [2025-10-27T21:24:59.583683] [DEBUG] [LOCAL ] TDS: Primary data saved (41768 records). [2025-10-27T21:24:59.589053] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-27T21:24:59.595767] [INFO ] [MAIN ] Update Progress: 2057/2366 symbols completed. TDS took 27.9s. Estimated remaining: 39m 48s. Rate: 7.8 symbols/min [2025-10-27T21:24:59.625914] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-27T21:24:59.625832] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T21:24:59.771229] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:24:59.771393] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-27T21:24:59.771429] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-27T21:24:59.771536] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-27T21:24:59.771576] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-27T21:24:59.771616] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-27T21:24:59.771674] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-27T21:25:00.123980] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:00.414955] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-10-27T21:25:00.661929] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:25:00.662235] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-10-27T21:25:00.662324] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:25:00.662368] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-27T21:25:00.662429] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:25:00.662498] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-27T21:25:00.662562] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-27T21:25:00.662599] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-27T21:25:00.662666] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-27T21:25:00.662739] [INFO ] [MAIN ] Update Progress: 2058/2366 symbols completed. TE took 1.1s. Estimated remaining: 39m 39s. Rate: 7.8 symbols/min [2025-10-27T21:25:00.846535] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:00.857238] [DEBUG] [LOCAL ] TEAF: Loaded 7439 existing records from primary storage. [2025-10-27T21:25:00.857483] [INFO ] [MAIN ] TEAF: Loaded 7439 existing records. [2025-10-27T21:25:01.030982] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:01.031173] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-27T21:25:01.031218] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-27T21:25:01.031377] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-27T21:25:01.031431] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-27T21:25:01.220730] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-27T21:25:01.407905] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:01.440056] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T21:25:01.982212] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T21:25:02.014951] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-27T21:25:02.814992] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-27T21:25:03.145780] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T21:25:03.150175] [INFO ] [REMOTE ] TDY: Full fetch complete (32226 records). [2025-10-27T21:25:03.150261] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-27T21:25:03.568864] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-27T21:25:03.568975] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-27T21:25:03.570287] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-27T21:25:03.570355] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-27T21:25:03.571558] [DEBUG] [LOCAL ] TDY: Trimmed 32226 records to 21896 (keeping 200 days of data) [2025-10-27T21:25:03.626240] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-27T21:25:03.723995] [DEBUG] [LOCAL ] TDY: Primary data saved (21896 records). [2025-10-27T21:25:03.724145] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-27T21:25:03.724253] [INFO ] [MAIN ] Update Progress: 2059/2366 symbols completed. TDY took 24.4s. Estimated remaining: 39m 31s. Rate: 7.8 symbols/min [2025-10-27T21:25:03.929792] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:03.978206] [DEBUG] [LOCAL ] TECK: Loaded 54209 existing records from primary storage. [2025-10-27T21:25:03.978555] [INFO ] [MAIN ] TECK: Loaded 54209 existing records. [2025-10-27T21:25:04.150557] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:04.151385] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-27T21:25:04.151477] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-27T21:25:04.151777] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-27T21:25:04.151832] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-27T21:25:04.421188] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-27T21:25:04.410970] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-27T21:25:04.526793] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:04.544551] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-27T21:25:05.214952] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-27T21:25:05.582884] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T21:25:05.865740] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T21:25:06.014955] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-27T21:25:06.814945] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-27T21:25:07.614949] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-27T21:25:07.908737] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:25:07.919394] [INFO ] [REMOTE ] TDOC: Full fetch complete (77453 records). [2025-10-27T21:25:07.919543] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-27T21:25:08.319878] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-27T21:25:08.320034] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-27T21:25:08.321212] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-27T21:25:08.321329] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-27T21:25:08.322769] [DEBUG] [LOCAL ] TDOC: Trimmed 77453 records to 53368 (keeping 200 days of data) [2025-10-27T21:25:08.415538] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-27T21:25:08.419474] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-27T21:25:08.664705] [DEBUG] [LOCAL ] TDOC: Primary data saved (53368 records). [2025-10-27T21:25:08.665280] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-27T21:25:08.666179] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T21:25:08.675411] [INFO ] [MAIN ] Update Progress: 2060/2366 symbols completed. TDOC took 40.9s. Estimated remaining: 39m 23s. Rate: 7.8 symbols/min [2025-10-27T21:25:08.846168] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:08.883867] [DEBUG] [LOCAL ] TEF: Loaded 37237 existing records from primary storage. [2025-10-27T21:25:08.884125] [INFO ] [MAIN ] TEF: Loaded 37237 existing records. [2025-10-27T21:25:09.063932] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:09.064138] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-27T21:25:09.064185] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-27T21:25:09.064397] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-27T21:25:09.064452] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-27T21:25:09.193991] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T21:25:09.223316] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-27T21:25:09.441550] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:10.014936] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-27T21:25:10.814935] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-27T21:25:11.101056] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T21:25:11.133382] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:25:11.419173] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-27T21:25:11.614932] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-27T21:25:12.414937] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-27T21:25:13.191469] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T21:25:13.214902] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-27T21:25:13.865381] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T21:25:14.014915] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-27T21:25:14.309358] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T21:25:14.317777] [INFO ] [REMOTE ] TDW: Full fetch complete (66647 records). [2025-10-27T21:25:14.317894] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-27T21:25:14.631189] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T21:25:14.725032] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-27T21:25:14.725103] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-27T21:25:14.726141] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-27T21:25:14.726202] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-27T21:25:14.727402] [DEBUG] [LOCAL ] TDW: Trimmed 66647 records to 44739 (keeping 200 days of data) [2025-10-27T21:25:14.817697] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-27T21:25:14.980319] [DEBUG] [LOCAL ] TDW: Primary data saved (44739 records). [2025-10-27T21:25:14.980439] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-27T21:25:14.980512] [INFO ] [MAIN ] Update Progress: 2061/2366 symbols completed. TDW took 41.3s. Estimated remaining: 39m 15s. Rate: 7.8 symbols/min [2025-10-27T21:25:15.144675] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:15.163507] [DEBUG] [LOCAL ] TEI: Loaded 21375 existing records from primary storage. [2025-10-27T21:25:15.163749] [INFO ] [MAIN ] TEI: Loaded 21375 existing records. [2025-10-27T21:25:15.334413] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:15.334604] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-27T21:25:15.334685] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-27T21:25:15.334886] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-27T21:25:15.334943] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-27T21:25:15.620129] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-27T21:25:15.681135] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:16.283558] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T21:25:16.414914] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-27T21:25:16.710853] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-27T21:25:17.214941] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-27T21:25:17.350139] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T21:25:17.637008] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T21:25:18.014956] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-27T21:25:18.467290] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-27T21:25:18.814945] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-27T21:25:19.546491] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T21:25:19.548801] [INFO ] [REMOTE ] TEAF: Full fetch complete (10219 records). [2025-10-27T21:25:19.548870] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-27T21:25:19.620132] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-27T21:25:19.968887] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-27T21:25:19.968965] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-27T21:25:19.969239] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-27T21:25:19.969278] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-27T21:25:19.969728] [DEBUG] [LOCAL ] TEAF: Trimmed 10219 records to 7257 (keeping 200 days of data) [2025-10-27T21:25:20.017737] [DEBUG] [LOCAL ] TEAF: Primary data saved (7257 records). [2025-10-27T21:25:20.017852] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-27T21:25:20.017931] [INFO ] [MAIN ] Update Progress: 2062/2366 symbols completed. TEAF took 19.4s. Estimated remaining: 39m 7s. Rate: 7.8 symbols/min [2025-10-27T21:25:20.211950] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:20.265447] [DEBUG] [LOCAL ] TEL: Loaded 51778 existing records from primary storage. [2025-10-27T21:25:20.265785] [INFO ] [MAIN ] TEL: Loaded 51778 existing records. [2025-10-27T21:25:20.467152] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:20.429549] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-27T21:25:20.468605] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-27T21:25:20.473945] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-27T21:25:20.481038] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-27T21:25:20.480996] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:25:20.481173] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-27T21:25:20.829163] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:21.214968] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-27T21:25:21.643147] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T21:25:21.938267] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T21:25:22.014909] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-27T21:25:22.814926] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-27T21:25:23.096690] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-27T21:25:23.614942] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-27T21:25:24.079464] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T21:25:24.414958] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-27T21:25:25.214926] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-27T21:25:25.332690] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T21:25:25.516689] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T21:25:26.014940] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-27T21:25:26.815020] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-27T21:25:27.093879] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T21:25:27.125024] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T21:25:27.598788] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-27T21:25:27.614899] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-27T21:25:28.414983] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-27T21:25:28.676274] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T21:25:29.214955] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-27T21:25:29.795558] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T21:25:29.932456] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-27T21:25:30.014990] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-27T21:25:30.815424] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-27T21:25:31.431406] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T21:25:31.614912] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-27T21:25:31.734781] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-27T21:25:32.414970] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-27T21:25:33.089618] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:25:33.110756] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T21:25:33.214929] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-27T21:25:34.014990] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-27T21:25:34.733895] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-27T21:25:34.805880] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-27T21:25:34.814900] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-27T21:25:35.614956] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-27T21:25:35.797150] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T21:25:35.802416] [INFO ] [REMOTE ] TEI: Full fetch complete (30718 records). [2025-10-27T21:25:35.802520] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-27T21:25:36.174471] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-27T21:25:36.174571] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-27T21:25:36.175430] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-27T21:25:36.175492] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-27T21:25:36.176248] [DEBUG] [LOCAL ] TEI: Trimmed 30718 records to 21032 (keeping 200 days of data) [2025-10-27T21:25:36.296503] [DEBUG] [LOCAL ] TEI: Primary data saved (21032 records). [2025-10-27T21:25:36.296639] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-27T21:25:36.296752] [INFO ] [MAIN ] Update Progress: 2063/2366 symbols completed. TEI took 21.3s. Estimated remaining: 39m 0s. Rate: 7.8 symbols/min [2025-10-27T21:25:36.420090] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-27T21:25:36.466108] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:36.495747] [DEBUG] [LOCAL ] TEN: Loaded 30706 existing records from primary storage. [2025-10-27T21:25:36.496023] [INFO ] [MAIN ] TEN: Loaded 30706 existing records. [2025-10-27T21:25:36.672013] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:36.672409] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-27T21:25:36.672576] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-27T21:25:36.672945] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-27T21:25:36.673127] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-27T21:25:36.916085] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T21:25:36.977371] [INFO ] [REMOTE ] TEF: Full fetch complete (54344 records). [2025-10-27T21:25:36.992190] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-27T21:25:37.187871] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:37.220003] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-27T21:25:37.463531] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-27T21:25:37.463610] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-27T21:25:37.464659] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-27T21:25:37.464720] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-27T21:25:37.465795] [DEBUG] [LOCAL ] TEF: Trimmed 54344 records to 36539 (keeping 200 days of data) [2025-10-27T21:25:37.669471] [DEBUG] [LOCAL ] TEF: Primary data saved (36539 records). [2025-10-27T21:25:37.669604] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-27T21:25:37.669722] [INFO ] [MAIN ] Update Progress: 2064/2366 symbols completed. TEF took 29.0s. Estimated remaining: 38m 52s. Rate: 7.8 symbols/min [2025-10-27T21:25:37.847614] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:37.869007] [DEBUG] [LOCAL ] TEO: Loaded 23331 existing records from primary storage. [2025-10-27T21:25:37.869290] [INFO ] [MAIN ] TEO: Loaded 23331 existing records. [2025-10-27T21:25:38.023568] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-27T21:25:38.054259] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:38.055315] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-27T21:25:38.055528] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-27T21:25:38.055803] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-27T21:25:38.055913] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-27T21:25:38.394447] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-27T21:25:38.465153] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:38.747771] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-27T21:25:38.814910] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-27T21:25:39.032430] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T21:25:39.614931] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-27T21:25:40.049677] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T21:25:40.414949] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-27T21:25:40.532084] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-27T21:25:41.214944] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-27T21:25:42.014975] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-27T21:25:42.051127] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:25:42.087495] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T21:25:42.666048] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T21:25:42.814925] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-27T21:25:43.614936] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-27T21:25:43.836791] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T21:25:44.415012] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-27T21:25:44.922377] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-27T21:25:45.214957] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-27T21:25:45.907315] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:25:45.961382] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-27T21:25:46.014952] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-27T21:25:46.814980] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-27T21:25:47.358365] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:25:47.614931] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-27T21:25:47.934872] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:25:48.414976] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-27T21:25:49.217671] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-27T21:25:49.223507] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T21:25:49.827103] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:25:50.014949] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-27T21:25:50.208175] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T21:25:50.815022] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-27T21:25:50.934940] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T21:25:51.614926] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-27T21:25:52.414923] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-27T21:25:52.522238] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T21:25:53.214980] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-27T21:25:53.388361] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T21:25:53.532131] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T21:25:54.014984] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-27T21:25:54.397000] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T21:25:54.814951] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-27T21:25:55.287161] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T21:25:55.512727] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-27T21:25:55.614912] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-27T21:25:56.414945] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-27T21:25:57.214953] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-27T21:25:57.400740] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-27T21:25:57.670613] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T21:25:57.680864] [INFO ] [REMOTE ] TECK: Full fetch complete (77532 records). [2025-10-27T21:25:57.681043] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-27T21:25:58.020020] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-27T21:25:58.075326] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-27T21:25:58.075441] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-27T21:25:58.076678] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-27T21:25:58.076741] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-27T21:25:58.078270] [DEBUG] [LOCAL ] TECK: Trimmed 77532 records to 53429 (keeping 200 days of data) [2025-10-27T21:25:58.216353] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:25:58.430159] [DEBUG] [LOCAL ] TECK: Primary data saved (53429 records). [2025-10-27T21:25:58.430275] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-27T21:25:58.430726] [INFO ] [MAIN ] Update Progress: 2065/2366 symbols completed. TECK took 54.7s. Estimated remaining: 38m 46s. Rate: 7.8 symbols/min [2025-10-27T21:25:58.594265] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:25:58.647185] [DEBUG] [LOCAL ] TEVA: Loaded 54396 existing records from primary storage. [2025-10-27T21:25:58.647473] [INFO ] [MAIN ] TEVA: Loaded 54396 existing records. [2025-10-27T21:25:58.817819] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-27T21:25:58.820780] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:25:58.821553] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-27T21:25:58.821601] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-27T21:25:58.821804] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-27T21:25:58.821857] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-27T21:25:59.186433] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:25:59.350600] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:25:59.614945] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-27T21:26:00.140191] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T21:26:00.149958] [INFO ] [REMOTE ] TEL: Full fetch complete (73878 records). [2025-10-27T21:26:00.150094] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-27T21:26:00.420046] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-27T21:26:00.544599] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-27T21:26:00.544923] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-27T21:26:00.546039] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-27T21:26:00.546101] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-27T21:26:00.547455] [DEBUG] [LOCAL ] TEL: Trimmed 73878 records to 51002 (keeping 200 days of data) [2025-10-27T21:26:00.777022] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:26:00.789541] [INFO ] [REMOTE ] TEO: Full fetch complete (32945 records). [2025-10-27T21:26:00.790882] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-27T21:26:01.228860] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-27T21:26:01.282902] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-27T21:26:01.285210] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-27T21:26:01.288486] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-27T21:26:01.289007] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-27T21:26:01.296405] [DEBUG] [LOCAL ] TEL: Primary data saved (51002 records). [2025-10-27T21:26:01.296834] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-27T21:26:01.297556] [INFO ] [MAIN ] Update Progress: 2066/2366 symbols completed. TEL took 41.3s. Estimated remaining: 38m 37s. Rate: 7.8 symbols/min [2025-10-27T21:26:01.297725] [DEBUG] [LOCAL ] TEO: Trimmed 32945 records to 23080 (keeping 200 days of data) [2025-10-27T21:26:01.565329] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:01.611384] [DEBUG] [LOCAL ] TEO: Primary data saved (23080 records). [2025-10-27T21:26:01.611699] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-27T21:26:01.611797] [INFO ] [MAIN ] Update Progress: 2067/2366 symbols completed. TEO took 23.9s. Estimated remaining: 38m 28s. Rate: 7.8 symbols/min [2025-10-27T21:26:01.813905] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:01.815307] [DEBUG] [LOCAL ] TEX: Loaded 44139 existing records from primary storage. [2025-10-27T21:26:01.815841] [INFO ] [MAIN ] TEX: Loaded 44139 existing records. [2025-10-27T21:26:02.002535] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:02.003484] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-27T21:26:02.003536] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-27T21:26:02.003870] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-27T21:26:02.003930] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-27T21:26:02.242260] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-27T21:26:02.272670] [INFO ] [MAIN ] TFC: Loaded 54447 existing records. [2025-10-27T21:26:02.529819] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:02.604572] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-27T21:26:02.610015] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:02.611141] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-27T21:26:02.611268] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-27T21:26:02.611526] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-27T21:26:02.611789] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-27T21:26:02.739361] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:26:02.853695] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-27T21:26:02.984461] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-27T21:26:03.084385] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:03.614941] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-27T21:26:03.734273] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T21:26:04.082299] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T21:26:04.414929] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-27T21:26:05.107811] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T21:26:05.214903] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-27T21:26:05.650898] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:26:06.014951] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-27T21:26:06.629830] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:26:06.814933] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-27T21:26:07.614907] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-27T21:26:08.069891] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-27T21:26:08.333125] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T21:26:08.414902] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-27T21:26:08.886758] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T21:26:09.215023] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-27T21:26:10.014911] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-27T21:26:10.308132] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T21:26:10.376021] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:26:10.381600] [INFO ] [REMOTE ] TEN: Full fetch complete (43958 records). [2025-10-27T21:26:10.381715] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-27T21:26:10.744844] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-27T21:26:10.744915] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-27T21:26:10.745782] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-27T21:26:10.745842] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-27T21:26:10.746728] [DEBUG] [LOCAL ] TEN: Trimmed 43958 records to 29787 (keeping 200 days of data) [2025-10-27T21:26:10.830558] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-27T21:26:10.922165] [DEBUG] [LOCAL ] TEN: Primary data saved (29787 records). [2025-10-27T21:26:10.922745] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-27T21:26:10.922859] [INFO ] [MAIN ] Update Progress: 2068/2366 symbols completed. TEN took 34.6s. Estimated remaining: 38m 21s. Rate: 7.8 symbols/min [2025-10-27T21:26:11.090073] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:11.120685] [DEBUG] [LOCAL ] TFII: Loaded 32645 existing records from primary storage. [2025-10-27T21:26:11.120972] [INFO ] [MAIN ] TFII: Loaded 32645 existing records. [2025-10-27T21:26:11.292013] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:11.292207] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-27T21:26:11.292252] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-27T21:26:11.292434] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-27T21:26:11.292472] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-27T21:26:11.617161] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-27T21:26:11.638979] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:11.885483] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-27T21:26:12.179991] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T21:26:12.414949] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-27T21:26:13.059237] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:26:13.214996] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-27T21:26:14.014971] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-27T21:26:14.335393] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:26:14.436250] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-27T21:26:14.814989] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-27T21:26:15.452873] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T21:26:15.614992] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-27T21:26:15.754542] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T21:26:16.414995] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-27T21:26:17.119922] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:26:17.214900] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-27T21:26:17.527117] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T21:26:18.014935] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-27T21:26:18.815000] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-27T21:26:19.118295] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-27T21:26:19.205204] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-27T21:26:19.614981] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-27T21:26:20.420062] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-27T21:26:20.434100] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T21:26:21.028485] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T21:26:21.215019] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-27T21:26:22.015030] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-27T21:26:22.214871] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-27T21:26:22.814908] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-27T21:26:22.924573] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T21:26:23.068071] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T21:26:23.614994] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-27T21:26:24.414926] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-27T21:26:24.497695] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-27T21:26:24.582040] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T21:26:25.214936] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-27T21:26:25.757128] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:26:26.014924] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-27T21:26:26.475781] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T21:26:26.814940] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-27T21:26:27.614907] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-27T21:26:27.668009] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T21:26:27.890901] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-27T21:26:28.414940] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-27T21:26:28.468386] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-27T21:26:29.214948] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-27T21:26:29.717961] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-27T21:26:29.728362] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-27T21:26:29.728498] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-27T21:26:30.016905] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-27T21:26:30.111894] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-27T21:26:30.111973] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-27T21:26:30.113127] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-27T21:26:30.113192] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-27T21:26:30.114672] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 53667 (keeping 200 days of data) [2025-10-27T21:26:30.435345] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-27T21:26:30.435473] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-27T21:26:30.435549] [INFO ] [MAIN ] Update Progress: 2069/2366 symbols completed. TFC took 28.8s. Estimated remaining: 38m 15s. Rate: 7.8 symbols/min [2025-10-27T21:26:30.598786] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:30.623086] [DEBUG] [LOCAL ] TFIN: Loaded 23939 existing records from primary storage. [2025-10-27T21:26:30.623366] [INFO ] [MAIN ] TFIN: Loaded 23939 existing records. [2025-10-27T21:26:30.820145] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-27T21:26:30.856309] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:30.857004] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-27T21:26:30.857088] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-27T21:26:30.857262] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-27T21:26:30.857301] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-27T21:26:31.297698] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:31.352719] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-27T21:26:31.414028] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T21:26:31.615011] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-27T21:26:32.210849] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T21:26:32.414943] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-27T21:26:33.217497] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-27T21:26:33.223092] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T21:26:33.233668] [INFO ] [REMOTE ] TEVA: Full fetch complete (77779 records). [2025-10-27T21:26:33.233809] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-27T21:26:33.431443] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T21:26:33.649687] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-27T21:26:33.649766] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-27T21:26:33.650897] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-27T21:26:33.650958] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-27T21:26:33.652270] [DEBUG] [LOCAL ] TEVA: Trimmed 77779 records to 53616 (keeping 200 days of data) [2025-10-27T21:26:33.959289] [DEBUG] [LOCAL ] TEVA: Primary data saved (53616 records). [2025-10-27T21:26:33.959408] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-27T21:26:33.960000] [INFO ] [MAIN ] Update Progress: 2070/2366 symbols completed. TEVA took 35.5s. Estimated remaining: 38m 7s. Rate: 7.8 symbols/min [2025-10-27T21:26:34.020819] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-27T21:26:34.133479] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:34.153606] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T21:26:34.196321] [DEBUG] [LOCAL ] TFPM: Loaded 40431 existing records from primary storage. [2025-10-27T21:26:34.196580] [INFO ] [MAIN ] TFPM: Loaded 40431 existing records. [2025-10-27T21:26:34.370260] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:34.370434] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-27T21:26:34.370499] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-27T21:26:34.370720] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-27T21:26:34.370787] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-27T21:26:34.721137] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:34.747206] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T21:26:34.814895] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-27T21:26:35.614914] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-27T21:26:36.014206] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T21:26:36.303367] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T21:26:36.414940] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-27T21:26:37.214944] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-27T21:26:37.892174] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T21:26:37.900457] [INFO ] [REMOTE ] TEX: Full fetch complete (64426 records). [2025-10-27T21:26:37.900575] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-27T21:26:38.020132] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-27T21:26:38.295884] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-27T21:26:38.295989] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-27T21:26:38.297227] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-27T21:26:38.297331] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-27T21:26:38.298758] [DEBUG] [LOCAL ] TEX: Trimmed 64426 records to 43349 (keeping 200 days of data) [2025-10-27T21:26:38.414224] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:26:38.584998] [DEBUG] [LOCAL ] TEX: Primary data saved (43349 records). [2025-10-27T21:26:38.585121] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-27T21:26:38.585800] [INFO ] [MAIN ] Update Progress: 2071/2366 symbols completed. TEX took 37.3s. Estimated remaining: 37m 58s. Rate: 7.8 symbols/min [2025-10-27T21:26:38.748634] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:38.790696] [DEBUG] [LOCAL ] TFX: Loaded 35998 existing records from primary storage. [2025-10-27T21:26:38.791000] [INFO ] [MAIN ] TFX: Loaded 35998 existing records. [2025-10-27T21:26:38.820004] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-27T21:26:39.017493] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:39.017757] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-27T21:26:39.017817] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-27T21:26:39.018075] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-27T21:26:39.018132] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-27T21:26:39.403914] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:39.416375] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T21:26:39.614984] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-27T21:26:39.723863] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-27T21:26:40.414911] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-27T21:26:40.463260] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-27T21:26:41.214944] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-27T21:26:41.422274] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T21:26:42.014941] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-27T21:26:42.698631] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T21:26:42.814898] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-27T21:26:43.192248] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T21:26:43.198170] [INFO ] [REMOTE ] TFII: Full fetch complete (47965 records). [2025-10-27T21:26:43.198266] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-27T21:26:43.566603] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-27T21:26:43.566726] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-27T21:26:43.567682] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-27T21:26:43.567743] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-27T21:26:43.568741] [DEBUG] [LOCAL ] TFII: Trimmed 47965 records to 31877 (keeping 200 days of data) [2025-10-27T21:26:43.620866] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-27T21:26:43.764965] [DEBUG] [LOCAL ] TFII: Primary data saved (31877 records). [2025-10-27T21:26:43.765108] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-27T21:26:43.765221] [INFO ] [MAIN ] Update Progress: 2072/2366 symbols completed. TFII took 32.8s. Estimated remaining: 37m 50s. Rate: 7.8 symbols/min [2025-10-27T21:26:43.948628] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:43.959854] [DEBUG] [LOCAL ] TG: Loaded 10776 existing records from primary storage. [2025-10-27T21:26:43.960049] [INFO ] [MAIN ] TG: Loaded 10776 existing records. [2025-10-27T21:26:44.160343] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T21:26:44.165349] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:44.173330] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-27T21:26:44.173379] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-27T21:26:44.173540] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-27T21:26:44.173588] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-27T21:26:44.418089] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-27T21:26:44.523004] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:44.536298] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T21:26:45.214948] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-27T21:26:46.020047] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-27T21:26:46.034336] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-27T21:26:46.161490] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-27T21:26:46.814976] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-27T21:26:47.624041] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-27T21:26:47.626143] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:26:47.684896] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T21:26:48.096434] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T21:26:48.414940] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-27T21:26:49.215003] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-27T21:26:49.375002] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-27T21:26:49.703434] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:26:50.014957] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-27T21:26:50.777170] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T21:26:50.814901] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-27T21:26:51.614943] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-27T21:26:51.806424] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T21:26:51.811800] [INFO ] [REMOTE ] TFIN: Full fetch complete (32755 records). [2025-10-27T21:26:51.811929] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-27T21:26:52.175056] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-27T21:26:52.175132] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-27T21:26:52.175774] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-27T21:26:52.175835] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-27T21:26:52.176534] [DEBUG] [LOCAL ] TFIN: Trimmed 32755 records to 23283 (keeping 200 days of data) [2025-10-27T21:26:52.313789] [DEBUG] [LOCAL ] TFIN: Primary data saved (23283 records). [2025-10-27T21:26:52.314016] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-27T21:26:52.314160] [INFO ] [MAIN ] Update Progress: 2073/2366 symbols completed. TFIN took 21.9s. Estimated remaining: 37m 43s. Rate: 7.8 symbols/min [2025-10-27T21:26:52.421501] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-27T21:26:52.424047] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T21:26:52.496991] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:52.497135] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-27T21:26:52.497171] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-27T21:26:52.497276] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-27T21:26:52.497317] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-27T21:26:52.497357] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-27T21:26:52.497389] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-27T21:26:52.838589] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:53.214965] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-10-27T21:26:53.452186] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:26:53.452526] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-10-27T21:26:53.452599] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:26:53.452638] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-27T21:26:53.452723] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:26:53.452763] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-27T21:26:53.452817] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-27T21:26:53.452851] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-27T21:26:53.452889] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-27T21:26:53.452934] [INFO ] [MAIN ] Update Progress: 2074/2366 symbols completed. TGE took 1.1s. Estimated remaining: 37m 34s. Rate: 7.8 symbols/min [2025-10-27T21:26:53.624525] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:26:53.649890] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T21:26:53.684598] [DEBUG] [LOCAL ] TGLS: Loaded 27881 existing records from primary storage. [2025-10-27T21:26:53.684933] [INFO ] [MAIN ] TGLS: Loaded 27881 existing records. [2025-10-27T21:26:53.857698] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:26:53.857949] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-27T21:26:53.858013] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-27T21:26:53.858261] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-27T21:26:53.858326] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-27T21:26:54.026082] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-27T21:26:54.209871] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:26:54.744618] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T21:26:54.814929] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-27T21:26:55.305301] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-27T21:26:55.615019] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-27T21:26:56.414942] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-27T21:26:57.214997] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-27T21:26:57.313528] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T21:26:57.517635] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T21:26:57.676317] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T21:26:58.014993] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-27T21:26:58.814952] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-27T21:26:58.867104] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T21:26:59.614948] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-27T21:26:59.973545] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T21:27:00.414942] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-27T21:27:01.122250] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T21:27:01.214920] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-27T21:27:01.399593] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T21:27:02.014920] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-27T21:27:02.471547] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-27T21:27:02.814955] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-27T21:27:03.350593] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T21:27:03.614909] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-27T21:27:03.687781] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T21:27:04.414938] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-27T21:27:04.551889] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-27T21:27:05.214942] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-27T21:27:05.648680] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-27T21:27:05.657349] [INFO ] [REMOTE ] TFPM: Full fetch complete (53259 records). [2025-10-27T21:27:05.657444] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-27T21:27:06.015024] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-27T21:27:06.045596] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-27T21:27:06.045706] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-27T21:27:06.046742] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-27T21:27:06.046806] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-27T21:27:06.047908] [DEBUG] [LOCAL ] TFPM: Trimmed 53259 records to 39904 (keeping 200 days of data) [2025-10-27T21:27:06.286586] [DEBUG] [LOCAL ] TFPM: Primary data saved (39904 records). [2025-10-27T21:27:06.286762] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-27T21:27:06.287299] [INFO ] [MAIN ] Update Progress: 2075/2366 symbols completed. TFPM took 32.3s. Estimated remaining: 37m 27s. Rate: 7.8 symbols/min [2025-10-27T21:27:06.461295] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:06.507518] [DEBUG] [LOCAL ] TGNA: Loaded 49132 existing records from primary storage. [2025-10-27T21:27:06.507911] [INFO ] [MAIN ] TGNA: Loaded 49132 existing records. [2025-10-27T21:27:06.654937] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:27:06.723924] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T21:27:06.728683] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:06.732450] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-27T21:27:06.732521] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-27T21:27:06.733090] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-27T21:27:06.733137] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-27T21:27:06.820052] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-27T21:27:07.083136] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:07.614932] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-27T21:27:07.828937] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T21:27:08.414994] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-27T21:27:08.853378] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T21:27:08.895247] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-27T21:27:09.214998] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-27T21:27:10.014930] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-27T21:27:10.046946] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T21:27:10.814986] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-27T21:27:11.031960] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:27:11.411049] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-27T21:27:11.614945] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-27T21:27:12.414981] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-27T21:27:12.773208] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T21:27:13.214981] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-27T21:27:13.263890] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T21:27:14.014963] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-27T21:27:14.756940] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T21:27:14.814925] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-27T21:27:14.960002] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T21:27:15.614928] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-27T21:27:15.957105] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T21:27:16.122190] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:27:16.125123] [INFO ] [REMOTE ] TG: Full fetch complete (15096 records). [2025-10-27T21:27:16.125196] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-27T21:27:16.420188] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-27T21:27:16.535828] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-27T21:27:16.535913] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-27T21:27:16.536251] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-27T21:27:16.536290] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-27T21:27:16.537013] [DEBUG] [LOCAL ] TG: Trimmed 15096 records to 10529 (keeping 200 days of data) [2025-10-27T21:27:16.597241] [DEBUG] [LOCAL ] TG: Primary data saved (10529 records). [2025-10-27T21:27:16.597396] [INFO ] [MAIN ] TG: Full history saved. [2025-10-27T21:27:16.597480] [INFO ] [MAIN ] Update Progress: 2076/2366 symbols completed. TG took 32.8s. Estimated remaining: 37m 20s. Rate: 7.8 symbols/min [2025-10-27T21:27:16.765472] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:16.795240] [DEBUG] [LOCAL ] TGS: Loaded 34390 existing records from primary storage. [2025-10-27T21:27:16.795556] [INFO ] [MAIN ] TGS: Loaded 34390 existing records. [2025-10-27T21:27:16.997943] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:16.998166] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-27T21:27:16.998233] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-27T21:27:16.998582] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-27T21:27:16.998691] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-27T21:27:17.220220] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-27T21:27:17.362009] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:17.509747] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T21:27:18.014980] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-27T21:27:18.747186] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-27T21:27:18.809398] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T21:27:18.819123] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-27T21:27:19.614943] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-27T21:27:19.756156] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T21:27:20.414928] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-27T21:27:20.600240] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T21:27:20.606870] [INFO ] [REMOTE ] TFX: Full fetch complete (54602 records). [2025-10-27T21:27:20.606971] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-27T21:27:21.015941] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-27T21:27:21.016014] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-27T21:27:21.016999] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-27T21:27:21.017059] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-27T21:27:21.018060] [DEBUG] [LOCAL ] TFX: Trimmed 54602 records to 35192 (keeping 200 days of data) [2025-10-27T21:27:21.224709] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-27T21:27:21.227247] [DEBUG] [LOCAL ] TFX: Primary data saved (35192 records). [2025-10-27T21:27:21.227521] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-27T21:27:21.228357] [INFO ] [MAIN ] Update Progress: 2077/2366 symbols completed. TFX took 42.6s. Estimated remaining: 37m 12s. Rate: 7.8 symbols/min [2025-10-27T21:27:21.760888] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T21:27:22.015029] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-27T21:27:22.298821] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T21:27:22.304514] [INFO ] [REMOTE ] TGLS: Full fetch complete (40405 records). [2025-10-27T21:27:22.304771] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-27T21:27:22.728714] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-27T21:27:22.728825] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-27T21:27:22.730104] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-27T21:27:22.730169] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-27T21:27:22.731424] [DEBUG] [LOCAL ] TGLS: Trimmed 40405 records to 27281 (keeping 200 days of data) [2025-10-27T21:27:22.829669] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-27T21:27:22.921528] [DEBUG] [LOCAL ] TGLS: Primary data saved (27281 records). [2025-10-27T21:27:22.921871] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-27T21:27:22.922014] [INFO ] [MAIN ] Update Progress: 2078/2366 symbols completed. TGLS took 29.5s. Estimated remaining: 37m 3s. Rate: 7.8 symbols/min [2025-10-27T21:27:22.976833] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-27T21:27:23.614997] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-27T21:27:23.984720] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-27T21:27:24.415044] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-27T21:27:24.624582] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T21:27:25.215018] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-27T21:27:25.710498] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T21:27:26.015003] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-27T21:27:26.400865] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:27:26.815015] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-27T21:27:27.257459] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:27:27.614920] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-27T21:27:27.674176] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-27T21:27:28.414971] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-27T21:27:28.750482] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-27T21:27:29.214933] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-27T21:27:29.697805] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T21:27:30.014997] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-27T21:27:30.210229] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T21:27:30.220276] [INFO ] [REMOTE ] TGNA: Full fetch complete (69927 records). [2025-10-27T21:27:30.220438] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-27T21:27:30.626611] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-27T21:27:30.629715] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-27T21:27:30.632260] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-27T21:27:30.632330] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-27T21:27:30.634445] [DEBUG] [LOCAL ] TGNA: Trimmed 69927 records to 48284 (keeping 200 days of data) [2025-10-27T21:27:30.953205] [DEBUG] [LOCAL ] TGNA: Primary data saved (48284 records). [2025-10-27T21:27:30.953359] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-27T21:27:30.953815] [INFO ] [MAIN ] Update Progress: 2079/2366 symbols completed. TGNA took 24.7s. Estimated remaining: 36m 55s. Rate: 7.8 symbols/min [2025-10-27T21:27:31.233761] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T21:27:31.241680] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-27T21:27:32.292477] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T21:27:32.301481] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-27T21:27:33.237194] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T21:27:33.244686] [INFO ] [REMOTE ] TGS: Full fetch complete (48788 records). [2025-10-27T21:27:33.244781] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-27T21:27:33.636880] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-27T21:27:33.636990] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-27T21:27:33.638456] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-27T21:27:33.638525] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-27T21:27:33.640060] [DEBUG] [LOCAL ] TGS: Trimmed 48788 records to 33920 (keeping 200 days of data) [2025-10-27T21:27:33.861921] [DEBUG] [LOCAL ] TGS: Primary data saved (33920 records). [2025-10-27T21:27:33.862073] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-27T21:27:33.862155] [INFO ] [MAIN ] Update Progress: 2080/2366 symbols completed. TGS took 17.3s. Estimated remaining: 36m 47s. Rate: 7.8 symbols/min [2025-10-27T21:27:34.630039] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:34.636940] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:34.661999] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:34.660085] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:34.667545] [DEBUG] [LOCAL ] THIR: Loaded 2494 existing records from primary storage. [2025-10-27T21:27:34.668184] [INFO ] [MAIN ] THIR: Loaded 2494 existing records. [2025-10-27T21:27:34.811901] [DEBUG] [LOCAL ] THG: Loaded 21799 existing records from primary storage. [2025-10-27T21:27:34.872898] [INFO ] [MAIN ] THG: Loaded 21799 existing records. [2025-10-27T21:27:34.872670] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:34.873236] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-27T21:27:34.873290] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-27T21:27:34.873410] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-27T21:27:34.873447] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-27T21:27:35.217671] [DEBUG] [LOCAL ] THC: Loaded 47339 existing records from primary storage. [2025-10-27T21:27:35.216533] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:35.223233] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-27T21:27:35.223414] [INFO ] [MAIN ] THC: Loaded 47339 existing records. [2025-10-27T21:27:35.229458] [DEBUG] [LOCAL ] TGT: Loaded 54557 existing records from primary storage. [2025-10-27T21:27:35.228598] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-27T21:27:35.286476] [INFO ] [MAIN ] TGT: Loaded 54557 existing records. [2025-10-27T21:27:35.386011] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-27T21:27:35.405632] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-27T21:27:35.841451] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:35.911948] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:35.938809] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-27T21:27:35.938976] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-27T21:27:35.944196] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-27T21:27:35.959774] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-27T21:27:36.000561] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-27T21:27:35.982287] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-27T21:27:36.000700] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-27T21:27:36.127383] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:36.136861] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-27T21:27:36.191623] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-27T21:27:36.514795] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:36.553294] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-27T21:27:36.598834] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T21:27:36.600881] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-27T21:27:37.009443] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:37.035605] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-27T21:27:37.023735] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-27T21:27:37.056222] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:37.057715] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-27T21:27:37.059259] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-27T21:27:37.325958] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-27T21:27:37.327132] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-27T21:27:37.655069] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T21:27:37.765390] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-27T21:27:38.015044] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-27T21:27:38.354411] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T21:27:38.580574] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:27:38.742413] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-27T21:27:38.815006] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-27T21:27:39.614988] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-27T21:27:40.112715] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:27:40.414971] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-27T21:27:40.703492] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-27T21:27:41.214972] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-27T21:27:41.529942] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T21:27:41.623238] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T21:27:42.014946] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-27T21:27:42.815020] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-27T21:27:43.167017] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T21:27:43.614957] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-27T21:27:43.771349] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T21:27:43.969579] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T21:27:44.414983] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-27T21:27:45.214991] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-27T21:27:45.994694] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T21:27:46.023930] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-27T21:27:46.029576] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:27:46.681507] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-27T21:27:46.682836] [INFO ] [REMOTE ] THIR: Full fetch complete (2994 records). [2025-10-27T21:27:46.682909] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-27T21:27:46.824181] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-27T21:27:47.045216] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-27T21:27:47.045298] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-27T21:27:47.045426] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-27T21:27:47.045465] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-27T21:27:47.045832] [DEBUG] [LOCAL ] THIR: Trimmed 2994 records to 2469 (keeping 200 days of data) [2025-10-27T21:27:47.059830] [DEBUG] [LOCAL ] THIR: Primary data saved (2469 records). [2025-10-27T21:27:47.059890] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-27T21:27:47.059969] [INFO ] [MAIN ] Update Progress: 2081/2366 symbols completed. THIR took 13.2s. Estimated remaining: 36m 40s. Rate: 7.8 symbols/min [2025-10-27T21:27:47.227527] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:27:47.231422] [DEBUG] [LOCAL ] THLV: Loaded 1510 existing records from primary storage. [2025-10-27T21:27:47.231556] [INFO ] [MAIN ] THLV: Loaded 1510 existing records. [2025-10-27T21:27:47.418265] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:27:47.418482] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-27T21:27:47.418532] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-27T21:27:47.418694] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-27T21:27:47.418750] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-27T21:27:47.620088] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-27T21:27:47.818976] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:27:48.414945] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-27T21:27:48.571138] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T21:27:48.717865] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-27T21:27:49.214924] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-27T21:27:49.494699] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T21:27:50.014970] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-27T21:27:50.098154] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T21:27:50.299761] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-27T21:27:50.814977] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-27T21:27:51.614946] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-27T21:27:52.414983] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-27T21:27:52.955138] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T21:27:53.001636] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-27T21:27:53.214978] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-27T21:27:53.596596] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:27:54.014956] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-27T21:27:54.288615] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T21:27:54.814934] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-27T21:27:55.336926] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:27:55.614940] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-27T21:27:55.873772] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T21:27:56.414955] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-27T21:27:57.146384] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-27T21:27:57.214901] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-27T21:27:57.679815] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T21:27:57.935804] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T21:27:58.014948] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-27T21:27:58.814926] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-27T21:27:59.040530] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-27T21:27:59.256236] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-27T21:27:59.614954] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-27T21:28:00.414987] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-27T21:28:00.895701] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-27T21:28:01.227054] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-27T21:28:01.230427] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T21:28:02.014945] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-27T21:28:02.073181] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T21:28:02.077929] [INFO ] [REMOTE ] THG: Full fetch complete (31557 records). [2025-10-27T21:28:02.078036] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-27T21:28:02.376123] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T21:28:02.460966] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-27T21:28:02.461047] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-27T21:28:02.461713] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-27T21:28:02.461779] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-27T21:28:02.462759] [DEBUG] [LOCAL ] THG: Trimmed 31557 records to 21171 (keeping 200 days of data) [2025-10-27T21:28:02.595545] [DEBUG] [LOCAL ] THG: Primary data saved (21171 records). [2025-10-27T21:28:02.595704] [INFO ] [MAIN ] THG: Full history saved. [2025-10-27T21:28:02.595806] [INFO ] [MAIN ] Update Progress: 2082/2366 symbols completed. THG took 28.7s. Estimated remaining: 36m 33s. Rate: 7.8 symbols/min [2025-10-27T21:28:02.763605] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:02.801842] [DEBUG] [LOCAL ] THO: Loaded 41472 existing records from primary storage. [2025-10-27T21:28:02.802142] [INFO ] [MAIN ] THO: Loaded 41472 existing records. [2025-10-27T21:28:02.822044] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-27T21:28:02.980291] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:02.980594] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-27T21:28:02.980669] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-27T21:28:02.980942] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-27T21:28:02.981000] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-27T21:28:03.326229] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:03.614956] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-27T21:28:04.236759] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T21:28:04.414955] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-27T21:28:05.214949] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-27T21:28:05.547688] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T21:28:05.665038] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T21:28:06.014937] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-27T21:28:06.335224] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:28:06.814946] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-27T21:28:07.060322] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T21:28:07.068486] [INFO ] [REMOTE ] THC: Full fetch complete (68655 records). [2025-10-27T21:28:07.068605] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-27T21:28:07.140327] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-27T21:28:07.455622] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-27T21:28:07.455726] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-27T21:28:07.456828] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-27T21:28:07.456895] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-27T21:28:07.458161] [DEBUG] [LOCAL ] THC: Trimmed 68655 records to 46584 (keeping 200 days of data) [2025-10-27T21:28:07.629070] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-27T21:28:07.739010] [DEBUG] [LOCAL ] THC: Primary data saved (46584 records). [2025-10-27T21:28:07.739165] [INFO ] [MAIN ] THC: Full history saved. [2025-10-27T21:28:07.739275] [INFO ] [MAIN ] Update Progress: 2083/2366 symbols completed. THC took 33.9s. Estimated remaining: 36m 25s. Rate: 7.8 symbols/min [2025-10-27T21:28:07.916375] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:07.942459] [DEBUG] [LOCAL ] THQ: Loaded 25615 existing records from primary storage. [2025-10-27T21:28:07.942753] [INFO ] [MAIN ] THQ: Loaded 25615 existing records. [2025-10-27T21:28:08.126598] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:08.126874] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-27T21:28:08.126923] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-27T21:28:08.127093] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-27T21:28:08.127133] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-27T21:28:08.420163] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-27T21:28:08.488038] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:08.807951] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T21:28:09.214975] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-27T21:28:09.489102] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-27T21:28:09.740052] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-27T21:28:10.015005] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-27T21:28:10.347587] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T21:28:10.815006] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-27T21:28:11.614921] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-27T21:28:12.415079] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-27T21:28:12.724019] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-27T21:28:12.724960] [INFO ] [REMOTE ] THLV: Full fetch complete (2496 records). [2025-10-27T21:28:12.725028] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-27T21:28:12.874113] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:28:13.114400] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-27T21:28:13.114496] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-27T21:28:13.114711] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-27T21:28:13.114771] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-27T21:28:13.115103] [DEBUG] [LOCAL ] THLV: Trimmed 2496 records to 1464 (keeping 200 days of data) [2025-10-27T21:28:13.123592] [DEBUG] [LOCAL ] THLV: Primary data saved (1464 records). [2025-10-27T21:28:13.123673] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-27T21:28:13.123756] [INFO ] [MAIN ] Update Progress: 2084/2366 symbols completed. THLV took 26.1s. Estimated remaining: 36m 17s. Rate: 7.8 symbols/min [2025-10-27T21:28:13.218320] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-27T21:28:13.319011] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:13.320969] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-27T21:28:13.349272] [DEBUG] [LOCAL ] THR: Loaded 19716 existing records from primary storage. [2025-10-27T21:28:13.349521] [INFO ] [MAIN ] THR: Loaded 19716 existing records. [2025-10-27T21:28:13.518747] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:13.518958] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-27T21:28:13.519003] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-27T21:28:13.519191] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-27T21:28:13.519228] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-27T21:28:13.859814] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:14.014959] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-27T21:28:14.727288] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T21:28:14.784479] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T21:28:14.814899] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-27T21:28:15.615001] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-27T21:28:16.326757] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:28:16.414964] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-27T21:28:17.215021] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-27T21:28:17.272316] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-27T21:28:17.669081] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-27T21:28:17.679410] [INFO ] [REMOTE ] TGT: Full fetch complete (77955 records). [2025-10-27T21:28:17.679551] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-27T21:28:18.025526] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-27T21:28:18.084321] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-27T21:28:18.084406] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-27T21:28:18.085597] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-27T21:28:18.085683] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-27T21:28:18.087162] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 53777 (keeping 200 days of data) [2025-10-27T21:28:18.419161] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T21:28:18.449943] [DEBUG] [LOCAL ] TGT: Primary data saved (53777 records). [2025-10-27T21:28:18.450091] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-27T21:28:18.450173] [INFO ] [MAIN ] Update Progress: 2085/2366 symbols completed. TGT took 44.5s. Estimated remaining: 36m 9s. Rate: 7.8 symbols/min [2025-10-27T21:28:18.617613] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:18.653579] [DEBUG] [LOCAL ] THS: Loaded 39128 existing records from primary storage. [2025-10-27T21:28:18.653906] [INFO ] [MAIN ] THS: Loaded 39128 existing records. [2025-10-27T21:28:18.822184] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-27T21:28:18.829832] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:18.831060] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-27T21:28:18.831110] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-27T21:28:18.831313] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-27T21:28:18.831370] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-27T21:28:19.201084] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:19.331070] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-27T21:28:19.614996] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-27T21:28:19.911906] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T21:28:20.414926] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-27T21:28:20.454280] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T21:28:21.024417] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T21:28:21.215051] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-27T21:28:22.015001] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-27T21:28:22.280020] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T21:28:22.815010] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-27T21:28:23.581292] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T21:28:23.617144] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-27T21:28:23.619289] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-27T21:28:24.414899] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-27T21:28:24.444860] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T21:28:25.214935] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-27T21:28:25.691709] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T21:28:26.014935] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-27T21:28:26.035252] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T21:28:26.814967] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-27T21:28:27.017847] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T21:28:27.615854] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-27T21:28:27.619334] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-27T21:28:28.414990] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-27T21:28:29.079371] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T21:28:29.215041] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-27T21:28:29.772968] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T21:28:30.014989] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-27T21:28:30.821047] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-27T21:28:30.827128] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-27T21:28:31.479799] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T21:28:31.504049] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T21:28:31.615030] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-27T21:28:32.414968] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-27T21:28:32.747952] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T21:28:33.214944] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-27T21:28:33.513914] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T21:28:34.014964] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-27T21:28:34.274706] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T21:28:34.814960] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-27T21:28:34.918403] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-27T21:28:35.615013] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-27T21:28:36.190278] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T21:28:36.374046] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T21:28:36.414997] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-27T21:28:37.153930] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-27T21:28:37.215004] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-27T21:28:38.015028] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-27T21:28:38.456226] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:28:38.814971] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-27T21:28:39.327860] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T21:28:39.335579] [INFO ] [REMOTE ] THO: Full fetch complete (60088 records). [2025-10-27T21:28:39.335789] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-27T21:28:39.615221] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-27T21:28:39.752612] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T21:28:39.773611] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-27T21:28:39.773928] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-27T21:28:39.775659] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-27T21:28:39.775775] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-27T21:28:39.778304] [DEBUG] [LOCAL ] THO: Trimmed 60088 records to 40610 (keeping 200 days of data) [2025-10-27T21:28:40.068586] [DEBUG] [LOCAL ] THO: Primary data saved (40610 records). [2025-10-27T21:28:40.068785] [INFO ] [MAIN ] THO: Full history saved. [2025-10-27T21:28:40.069344] [INFO ] [MAIN ] Update Progress: 2086/2366 symbols completed. THO took 37.5s. Estimated remaining: 36m 3s. Rate: 7.8 symbols/min [2025-10-27T21:28:40.244314] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:40.267101] [DEBUG] [LOCAL ] THW: Loaded 19817 existing records from primary storage. [2025-10-27T21:28:40.267419] [INFO ] [MAIN ] THW: Loaded 19817 existing records. [2025-10-27T21:28:40.419498] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-27T21:28:40.461443] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:40.461750] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-27T21:28:40.461811] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-27T21:28:40.462093] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-27T21:28:40.462154] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-27T21:28:40.848451] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:41.180879] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T21:28:41.214940] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-27T21:28:41.449531] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T21:28:41.453842] [INFO ] [REMOTE ] THR: Full fetch complete (28821 records). [2025-10-27T21:28:41.454014] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-27T21:28:41.867773] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-27T21:28:41.867882] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-27T21:28:41.869120] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-27T21:28:41.869187] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-27T21:28:41.870303] [DEBUG] [LOCAL ] THR: Trimmed 28821 records to 19280 (keeping 200 days of data) [2025-10-27T21:28:41.995191] [DEBUG] [LOCAL ] THR: Primary data saved (19280 records). [2025-10-27T21:28:41.995430] [INFO ] [MAIN ] THR: Full history saved. [2025-10-27T21:28:41.995559] [INFO ] [MAIN ] Update Progress: 2087/2366 symbols completed. THR took 28.9s. Estimated remaining: 35m 55s. Rate: 7.8 symbols/min [2025-10-27T21:28:42.020196] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-27T21:28:42.188379] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:42.188613] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-27T21:28:42.188694] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-27T21:28:42.188872] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-27T21:28:42.188922] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-27T21:28:42.188965] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-27T21:28:42.188999] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-27T21:28:42.572370] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:42.598630] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-27T21:28:42.814989] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-10-27T21:28:42.864011] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-27T21:28:43.023637] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:28:43.024151] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-10-27T21:28:43.024255] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:28:43.024311] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-27T21:28:43.024376] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:28:43.024453] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-27T21:28:43.024537] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-27T21:28:43.024577] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-27T21:28:43.024619] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-27T21:28:43.024722] [INFO ] [MAIN ] Update Progress: 2088/2366 symbols completed. TIC took 1.0s. Estimated remaining: 35m 46s. Rate: 7.8 symbols/min [2025-10-27T21:28:43.210359] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:43.249811] [DEBUG] [LOCAL ] TIMB: Loaded 35194 existing records from primary storage. [2025-10-27T21:28:43.250190] [INFO ] [MAIN ] TIMB: Loaded 35194 existing records. [2025-10-27T21:28:43.435474] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:43.435812] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-27T21:28:43.435869] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-27T21:28:43.436128] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-27T21:28:43.436185] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-27T21:28:43.622097] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-27T21:28:43.813087] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:44.414961] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-27T21:28:44.846974] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:28:44.985275] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T21:28:45.215004] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-27T21:28:46.014952] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-27T21:28:46.367876] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T21:28:46.375048] [INFO ] [REMOTE ] THS: Full fetch complete (54578 records). [2025-10-27T21:28:46.375152] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-27T21:28:46.748399] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-27T21:28:46.748478] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-27T21:28:46.749486] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-27T21:28:46.749547] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-27T21:28:46.750676] [DEBUG] [LOCAL ] THS: Trimmed 54578 records to 38419 (keeping 200 days of data) [2025-10-27T21:28:46.832159] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-27T21:28:46.972626] [DEBUG] [LOCAL ] THS: Primary data saved (38419 records). [2025-10-27T21:28:46.972785] [INFO ] [MAIN ] THS: Full history saved. [2025-10-27T21:28:46.973483] [INFO ] [MAIN ] Update Progress: 2089/2366 symbols completed. THS took 28.5s. Estimated remaining: 35m 38s. Rate: 7.8 symbols/min [2025-10-27T21:28:47.137979] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:47.144608] [DEBUG] [LOCAL ] TISI: Loaded 3227 existing records from primary storage. [2025-10-27T21:28:47.145042] [INFO ] [MAIN ] TISI: Loaded 3227 existing records. [2025-10-27T21:28:47.318243] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:47.318559] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-27T21:28:47.318667] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-27T21:28:47.318882] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-27T21:28:47.318938] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-27T21:28:47.506244] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T21:28:47.620087] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-27T21:28:47.706961] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:47.953356] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T21:28:48.314458] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T21:28:48.319147] [INFO ] [REMOTE ] THQ: Full fetch complete (34640 records). [2025-10-27T21:28:48.319233] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-27T21:28:48.420297] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-27T21:28:48.741671] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-27T21:28:48.741788] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-27T21:28:48.743131] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-27T21:28:48.743208] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-27T21:28:48.744132] [DEBUG] [LOCAL ] THQ: Trimmed 34640 records to 25164 (keeping 200 days of data) [2025-10-27T21:28:48.897158] [DEBUG] [LOCAL ] THQ: Primary data saved (25164 records). [2025-10-27T21:28:48.897284] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-27T21:28:48.897365] [INFO ] [MAIN ] Update Progress: 2090/2366 symbols completed. THQ took 41.2s. Estimated remaining: 35m 30s. Rate: 7.8 symbols/min [2025-10-27T21:28:49.061138] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:28:49.091341] [DEBUG] [LOCAL ] TIXT: Loaded 32965 existing records from primary storage. [2025-10-27T21:28:49.091771] [INFO ] [MAIN ] TIXT: Loaded 32965 existing records. [2025-10-27T21:28:49.216780] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-27T21:28:49.273224] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:28:49.274606] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-27T21:28:49.274731] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-27T21:28:49.280177] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-27T21:28:49.286364] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-27T21:28:49.318628] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-27T21:28:49.638165] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:28:50.014935] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-27T21:28:50.545163] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T21:28:50.814940] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-27T21:28:51.038548] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T21:28:51.614976] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-27T21:28:51.783583] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T21:28:52.414997] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-27T21:28:52.615984] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:28:52.893980] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T21:28:53.214992] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-27T21:28:54.014974] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-27T21:28:54.406364] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T21:28:54.814942] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-27T21:28:54.891494] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-27T21:28:55.254407] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T21:28:55.614937] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-27T21:28:56.401890] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T21:28:56.414905] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-27T21:28:57.057124] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T21:28:57.214939] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-27T21:28:57.663921] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T21:28:58.014944] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-27T21:28:58.803833] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T21:28:58.814886] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-27T21:28:59.257342] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T21:28:59.614938] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-27T21:29:00.191048] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T21:29:00.414951] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-27T21:29:01.214964] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-27T21:29:01.266347] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T21:29:02.014952] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-27T21:29:02.253945] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T21:29:02.323724] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-27T21:29:02.814924] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-27T21:29:03.614916] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-27T21:29:04.144423] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T21:29:04.338807] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T21:29:04.414936] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-27T21:29:05.049222] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-27T21:29:05.214988] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-27T21:29:05.604546] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T21:29:06.014964] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-27T21:29:06.488698] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T21:29:06.814938] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-27T21:29:07.369922] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-27T21:29:07.371160] [INFO ] [REMOTE ] TISI: Full fetch complete (4929 records). [2025-10-27T21:29:07.371227] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-27T21:29:07.620962] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-27T21:29:07.740789] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-27T21:29:07.740866] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-27T21:29:07.741021] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-27T21:29:07.741059] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-27T21:29:07.741409] [DEBUG] [LOCAL ] TISI: Trimmed 4929 records to 3125 (keeping 200 days of data) [2025-10-27T21:29:07.759430] [DEBUG] [LOCAL ] TISI: Primary data saved (3125 records). [2025-10-27T21:29:07.759492] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-27T21:29:07.759557] [INFO ] [MAIN ] Update Progress: 2091/2366 symbols completed. TISI took 20.8s. Estimated remaining: 35m 23s. Rate: 7.8 symbols/min [2025-10-27T21:29:07.927538] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:07.977841] [DEBUG] [LOCAL ] TJX: Loaded 54440 existing records from primary storage. [2025-10-27T21:29:07.978195] [INFO ] [MAIN ] TJX: Loaded 54440 existing records. [2025-10-27T21:29:08.151926] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:08.152092] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-27T21:29:08.152139] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-27T21:29:08.152607] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-27T21:29:08.152698] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-27T21:29:08.416742] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-27T21:29:08.497835] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:08.725257] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T21:29:09.214920] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-27T21:29:09.477516] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T21:29:09.481353] [INFO ] [REMOTE ] THW: Full fetch complete (28724 records). [2025-10-27T21:29:09.481432] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-27T21:29:09.842203] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-27T21:29:09.842286] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-27T21:29:09.842893] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-27T21:29:09.842956] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-27T21:29:09.843802] [DEBUG] [LOCAL ] THW: Trimmed 28724 records to 19443 (keeping 200 days of data) [2025-10-27T21:29:09.959228] [DEBUG] [LOCAL ] THW: Primary data saved (19443 records). [2025-10-27T21:29:09.959358] [INFO ] [MAIN ] THW: Full history saved. [2025-10-27T21:29:09.959441] [INFO ] [MAIN ] Update Progress: 2092/2366 symbols completed. THW took 29.9s. Estimated remaining: 35m 15s. Rate: 7.8 symbols/min [2025-10-27T21:29:10.020267] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-27T21:29:10.138100] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:10.161261] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T21:29:10.202273] [DEBUG] [LOCAL ] TK: Loaded 39621 existing records from primary storage. [2025-10-27T21:29:10.202549] [INFO ] [MAIN ] TK: Loaded 39621 existing records. [2025-10-27T21:29:10.393878] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:10.394064] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-27T21:29:10.394112] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-27T21:29:10.394287] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-27T21:29:10.394325] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-27T21:29:10.794674] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:10.814902] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-27T21:29:11.515540] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T21:29:11.614901] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-27T21:29:11.803341] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T21:29:12.414945] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-27T21:29:12.961005] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T21:29:13.214979] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-27T21:29:13.697526] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T21:29:14.014976] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-27T21:29:14.094221] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T21:29:14.814949] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-27T21:29:15.130381] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T21:29:15.615006] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-27T21:29:16.147783] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:29:16.414948] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-27T21:29:17.049058] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:29:17.214984] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-27T21:29:17.806372] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T21:29:18.014980] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-27T21:29:18.468533] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T21:29:18.814955] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-27T21:29:19.070608] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T21:29:19.614950] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-27T21:29:19.737743] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T21:29:20.415026] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-27T21:29:20.981167] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T21:29:21.214920] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-27T21:29:21.567949] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T21:29:21.574157] [INFO ] [REMOTE ] TIMB: Full fetch complete (52930 records). [2025-10-27T21:29:21.574321] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-27T21:29:22.024429] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-27T21:29:22.098861] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-27T21:29:22.098989] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-27T21:29:22.101056] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-27T21:29:22.101155] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-27T21:29:22.102921] [DEBUG] [LOCAL ] TIMB: Trimmed 52930 records to 34400 (keeping 200 days of data) [2025-10-27T21:29:22.404181] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:29:22.422085] [DEBUG] [LOCAL ] TIMB: Primary data saved (34400 records). [2025-10-27T21:29:22.423059] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-27T21:29:22.423206] [INFO ] [MAIN ] Update Progress: 2093/2366 symbols completed. TIMB took 39.4s. Estimated remaining: 35m 8s. Rate: 7.8 symbols/min [2025-10-27T21:29:22.598310] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:22.633882] [DEBUG] [LOCAL ] TKC: Loaded 40667 existing records from primary storage. [2025-10-27T21:29:22.634178] [INFO ] [MAIN ] TKC: Loaded 40667 existing records. [2025-10-27T21:29:22.806796] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:22.806987] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-27T21:29:22.807032] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-27T21:29:22.807217] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-27T21:29:22.807254] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-27T21:29:22.820132] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-27T21:29:23.158696] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:23.217366] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:29:23.614960] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-27T21:29:24.332121] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:29:24.415009] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-27T21:29:24.472252] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:29:25.214974] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-27T21:29:25.831554] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T21:29:26.015018] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-27T21:29:26.507547] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T21:29:26.514211] [INFO ] [REMOTE ] TIXT: Full fetch complete (45754 records). [2025-10-27T21:29:26.514354] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-27T21:29:26.820152] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-27T21:29:26.886330] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-27T21:29:26.886412] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-27T21:29:26.887310] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-27T21:29:26.887374] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-27T21:29:26.888307] [DEBUG] [LOCAL ] TIXT: Trimmed 45754 records to 32397 (keeping 200 days of data) [2025-10-27T21:29:27.061292] [DEBUG] [LOCAL ] TIXT: Primary data saved (32397 records). [2025-10-27T21:29:27.061441] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-27T21:29:27.061525] [INFO ] [MAIN ] Update Progress: 2094/2366 symbols completed. TIXT took 38.2s. Estimated remaining: 34m 60s. Rate: 7.8 symbols/min [2025-10-27T21:29:27.251601] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:27.291846] [DEBUG] [LOCAL ] TKO: Loaded 44140 existing records from primary storage. [2025-10-27T21:29:27.292159] [INFO ] [MAIN ] TKO: Loaded 44140 existing records. [2025-10-27T21:29:27.466348] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:27.466530] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-27T21:29:27.466576] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-27T21:29:27.466806] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-27T21:29:27.466862] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-27T21:29:27.639543] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-27T21:29:27.793153] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T21:29:27.866036] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:27.885220] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T21:29:28.415003] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-27T21:29:29.215021] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-27T21:29:29.434802] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T21:29:29.701524] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T21:29:30.014956] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-27T21:29:30.278393] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T21:29:30.815006] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-27T21:29:31.515589] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-27T21:29:31.614919] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-27T21:29:31.829613] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T21:29:32.414969] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-27T21:29:32.539834] [DEBUG] [REMOTE ] TKO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-27T21:29:32.540074] [WARN ] [REMOTE ] TKO: No data returned for month 2025-01 [2025-10-27T21:29:32.540174] [FATAL] [REMOTE ] TKO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:29:32.540219] [FATAL] [MAIN ] TKO: Failed to fetch primary data. [2025-10-27T21:29:32.540252] [WARN ] [MAIN ] TKO: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:29:32.540287] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-27T21:29:32.540339] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-10-27T21:29:32.540373] [INFO ] [LOCAL ] TKO: Starting deletion of derivative data. [2025-10-27T21:29:32.540534] [DEBUG] [LOCAL ] TKO: Deleted derivative data file. [2025-10-27T21:29:32.540621] [INFO ] [MAIN ] Update Progress: 2095/2366 symbols completed. TKO took 5.5s. Estimated remaining: 34m 52s. Rate: 7.8 symbols/min [2025-10-27T21:29:32.704603] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:32.742911] [DEBUG] [LOCAL ] TKR: Loaded 39746 existing records from primary storage. [2025-10-27T21:29:32.743208] [INFO ] [MAIN ] TKR: Loaded 39746 existing records. [2025-10-27T21:29:32.913176] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:32.913361] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-27T21:29:32.913406] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-27T21:29:32.913622] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-27T21:29:32.913714] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-27T21:29:33.220204] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-27T21:29:33.274489] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:33.506205] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-27T21:29:34.014931] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-27T21:29:34.270081] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-27T21:29:34.277071] [INFO ] [REMOTE ] TK: Full fetch complete (56256 records). [2025-10-27T21:29:34.277164] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-27T21:29:34.647086] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-27T21:29:34.647161] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-27T21:29:34.648129] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-27T21:29:34.648191] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-27T21:29:34.649266] [DEBUG] [LOCAL ] TK: Trimmed 56256 records to 38751 (keeping 200 days of data) [2025-10-27T21:29:34.816379] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-27T21:29:34.872352] [DEBUG] [LOCAL ] TK: Primary data saved (38751 records). [2025-10-27T21:29:34.872475] [INFO ] [MAIN ] TK: Full history saved. [2025-10-27T21:29:34.872980] [INFO ] [MAIN ] Update Progress: 2096/2366 symbols completed. TK took 24.9s. Estimated remaining: 34m 43s. Rate: 7.8 symbols/min [2025-10-27T21:29:35.038952] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:35.079385] [DEBUG] [LOCAL ] TLK: Loaded 39341 existing records from primary storage. [2025-10-27T21:29:35.079857] [INFO ] [MAIN ] TLK: Loaded 39341 existing records. [2025-10-27T21:29:35.226200] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T21:29:35.294321] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:35.294590] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-27T21:29:35.294669] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-27T21:29:35.295333] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-27T21:29:35.295390] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-27T21:29:35.615337] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-27T21:29:35.636328] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:36.415008] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-27T21:29:36.755291] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:29:36.871282] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T21:29:37.214995] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-27T21:29:37.788761] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T21:29:38.014947] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-27T21:29:38.796601] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T21:29:38.814912] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-27T21:29:39.084067] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T21:29:39.614995] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-27T21:29:40.283691] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T21:29:40.414944] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-27T21:29:41.214917] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-27T21:29:41.258424] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:29:41.354984] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T21:29:42.014986] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-27T21:29:42.814971] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-27T21:29:42.931779] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T21:29:42.965342] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T21:29:43.614998] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-27T21:29:44.145139] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T21:29:44.414979] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-27T21:29:44.913042] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:29:45.215011] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-27T21:29:46.014995] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-27T21:29:46.054199] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T21:29:46.519946] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:29:46.814974] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-27T21:29:47.471571] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:29:47.614920] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-27T21:29:47.883696] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T21:29:48.414913] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-27T21:29:49.214938] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-27T21:29:49.275998] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-27T21:29:49.285114] [INFO ] [REMOTE ] TKC: Full fetch complete (54772 records). [2025-10-27T21:29:49.285244] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-27T21:29:49.670191] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T21:29:49.695929] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-27T21:29:49.696364] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-27T21:29:49.697451] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-27T21:29:49.697514] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-27T21:29:49.698556] [DEBUG] [LOCAL ] TKC: Trimmed 54772 records to 40047 (keeping 200 days of data) [2025-10-27T21:29:49.918335] [DEBUG] [LOCAL ] TKC: Primary data saved (40047 records). [2025-10-27T21:29:49.918452] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-27T21:29:49.918524] [INFO ] [MAIN ] Update Progress: 2097/2366 symbols completed. TKC took 27.5s. Estimated remaining: 34m 36s. Rate: 7.8 symbols/min [2025-10-27T21:29:50.017530] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-27T21:29:50.090888] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:50.108520] [DEBUG] [LOCAL ] TLYS: Loaded 16665 existing records from primary storage. [2025-10-27T21:29:50.108816] [INFO ] [MAIN ] TLYS: Loaded 16665 existing records. [2025-10-27T21:29:50.284975] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:50.285186] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-27T21:29:50.285232] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-27T21:29:50.285396] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-27T21:29:50.285434] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-27T21:29:50.643499] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:50.697399] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T21:29:50.814936] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-27T21:29:51.615441] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-27T21:29:51.619035] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T21:29:51.630637] [INFO ] [REMOTE ] TJX: Full fetch complete (77830 records). [2025-10-27T21:29:51.630919] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-27T21:29:52.075976] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-27T21:29:52.076223] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-27T21:29:52.078300] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-27T21:29:52.078414] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-27T21:29:52.103155] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T21:29:52.112888] [DEBUG] [LOCAL ] TJX: Trimmed 77830 records to 53660 (keeping 200 days of data) [2025-10-27T21:29:52.421129] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-27T21:29:52.449260] [DEBUG] [LOCAL ] TJX: Primary data saved (53660 records). [2025-10-27T21:29:52.449533] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-27T21:29:52.449674] [INFO ] [MAIN ] Update Progress: 2098/2366 symbols completed. TJX took 44.7s. Estimated remaining: 34m 28s. Rate: 7.8 symbols/min [2025-10-27T21:29:52.613593] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:29:52.646571] [DEBUG] [LOCAL ] TM: Loaded 36470 existing records from primary storage. [2025-10-27T21:29:52.646902] [INFO ] [MAIN ] TM: Loaded 36470 existing records. [2025-10-27T21:29:52.824629] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:29:52.824838] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-27T21:29:52.824884] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-27T21:29:52.825172] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-27T21:29:52.825211] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-27T21:29:53.181817] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:29:53.214899] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-27T21:29:53.286861] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:29:53.617790] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:29:54.014981] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-27T21:29:54.814914] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-27T21:29:54.880234] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-27T21:29:55.309425] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:29:55.440519] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T21:29:55.614944] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-27T21:29:56.414951] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-27T21:29:56.968911] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:29:57.214925] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-27T21:29:57.494535] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T21:29:58.015005] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-27T21:29:58.126379] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-27T21:29:58.485256] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T21:29:58.814988] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-27T21:29:59.614951] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-27T21:30:00.132051] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T21:30:00.248971] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:30:00.414913] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-27T21:30:01.214950] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-27T21:30:01.796413] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T21:30:02.014973] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-27T21:30:02.624677] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-27T21:30:02.814934] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-27T21:30:02.899585] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-27T21:30:03.614926] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-27T21:30:04.335096] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-27T21:30:04.344215] [INFO ] [REMOTE ] TLK: Full fetch complete (57702 records). [2025-10-27T21:30:04.344348] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-27T21:30:04.420180] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-27T21:30:04.741433] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-27T21:30:04.741558] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-27T21:30:04.742792] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-27T21:30:04.742857] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-27T21:30:04.744107] [DEBUG] [LOCAL ] TLK: Trimmed 57702 records to 38557 (keeping 200 days of data) [2025-10-27T21:30:05.009546] [DEBUG] [LOCAL ] TLK: Primary data saved (38557 records). [2025-10-27T21:30:05.009716] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-27T21:30:05.009807] [INFO ] [MAIN ] Update Progress: 2099/2366 symbols completed. TLK took 30.1s. Estimated remaining: 34m 21s. Rate: 7.8 symbols/min [2025-10-27T21:30:05.175613] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:05.223551] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-27T21:30:05.226543] [DEBUG] [LOCAL ] TME: Loaded 53968 existing records from primary storage. [2025-10-27T21:30:05.226997] [INFO ] [MAIN ] TME: Loaded 53968 existing records. [2025-10-27T21:30:05.410072] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:05.410507] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-27T21:30:05.430633] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-27T21:30:05.431299] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-27T21:30:05.432131] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-27T21:30:05.432054] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T21:30:05.795148] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:05.817853] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T21:30:05.825425] [INFO ] [REMOTE ] TKR: Full fetch complete (57739 records). [2025-10-27T21:30:05.825591] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-27T21:30:06.021224] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-27T21:30:06.216859] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-27T21:30:06.240054] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-27T21:30:06.240129] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-27T21:30:06.241125] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-27T21:30:06.241186] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-27T21:30:06.242301] [DEBUG] [LOCAL ] TKR: Trimmed 57739 records to 38886 (keeping 200 days of data) [2025-10-27T21:30:06.474461] [DEBUG] [LOCAL ] TKR: Primary data saved (38886 records). [2025-10-27T21:30:06.474595] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-27T21:30:06.474694] [INFO ] [MAIN ] Update Progress: 2100/2366 symbols completed. TKR took 33.9s. Estimated remaining: 34m 12s. Rate: 7.8 symbols/min [2025-10-27T21:30:06.660924] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:06.705834] [DEBUG] [LOCAL ] TMHC: Loaded 46402 existing records from primary storage. [2025-10-27T21:30:06.706180] [INFO ] [MAIN ] TMHC: Loaded 46402 existing records. [2025-10-27T21:30:06.820106] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-27T21:30:06.879237] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:06.879452] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-27T21:30:06.879507] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-27T21:30:06.879744] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-27T21:30:06.879801] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-27T21:30:07.254215] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:07.494853] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T21:30:07.614933] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-27T21:30:08.099199] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T21:30:08.414938] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-27T21:30:08.626410] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T21:30:09.215027] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-27T21:30:10.015206] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-27T21:30:10.314696] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-27T21:30:10.815003] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-27T21:30:11.075188] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-27T21:30:11.138562] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:30:11.614954] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-27T21:30:12.282501] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:30:12.414976] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-27T21:30:13.215013] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-27T21:30:13.644313] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-27T21:30:14.024604] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-27T21:30:14.029758] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T21:30:14.362140] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T21:30:14.814992] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-27T21:30:15.340999] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T21:30:15.614911] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-27T21:30:15.972526] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:30:15.979025] [INFO ] [REMOTE ] TM: Full fetch complete (51725 records). [2025-10-27T21:30:15.979159] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-27T21:30:16.371775] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-27T21:30:16.371858] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-27T21:30:16.372828] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-27T21:30:16.372890] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-27T21:30:16.374000] [DEBUG] [LOCAL ] TM: Trimmed 51725 records to 35626 (keeping 200 days of data) [2025-10-27T21:30:16.422853] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-27T21:30:16.589100] [DEBUG] [LOCAL ] TM: Primary data saved (35626 records). [2025-10-27T21:30:16.589228] [INFO ] [MAIN ] TM: Full history saved. [2025-10-27T21:30:16.589905] [INFO ] [MAIN ] Update Progress: 2101/2366 symbols completed. TM took 24.1s. Estimated remaining: 34m 5s. Rate: 7.8 symbols/min [2025-10-27T21:30:16.754592] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:16.771540] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:30:16.818834] [DEBUG] [LOCAL ] TMO: Loaded 53155 existing records from primary storage. [2025-10-27T21:30:16.819151] [INFO ] [MAIN ] TMO: Loaded 53155 existing records. [2025-10-27T21:30:16.994789] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:16.995020] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-27T21:30:16.995070] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-27T21:30:16.995252] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-27T21:30:16.995289] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-27T21:30:17.222845] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-27T21:30:17.346383] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:17.541161] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:30:18.014943] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-27T21:30:18.815001] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-27T21:30:19.614981] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-27T21:30:19.702639] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T21:30:19.853585] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-27T21:30:20.420075] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-27T21:30:20.434304] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-10-27T21:30:20.764336] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:30:21.215003] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-27T21:30:21.826789] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:30:22.014978] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-27T21:30:22.225609] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:30:22.814934] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-27T21:30:23.308887] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T21:30:23.614957] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-27T21:30:24.069555] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-27T21:30:24.071884] [INFO ] [REMOTE ] TLYS: Full fetch complete (21090 records). [2025-10-27T21:30:24.071989] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-27T21:30:24.420014] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-27T21:30:24.454252] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-27T21:30:24.455113] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-27T21:30:24.455606] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-27T21:30:24.455765] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-27T21:30:24.457178] [DEBUG] [LOCAL ] TLYS: Trimmed 21090 records to 16493 (keeping 200 days of data) [2025-10-27T21:30:24.550034] [DEBUG] [LOCAL ] TLYS: Primary data saved (16493 records). [2025-10-27T21:30:24.550253] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-27T21:30:24.550400] [INFO ] [MAIN ] Update Progress: 2102/2366 symbols completed. TLYS took 34.6s. Estimated remaining: 33m 57s. Rate: 7.8 symbols/min [2025-10-27T21:30:24.680045] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-27T21:30:24.758836] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:24.773404] [DEBUG] [LOCAL ] TNC: Loaded 14258 existing records from primary storage. [2025-10-27T21:30:24.773624] [INFO ] [MAIN ] TNC: Loaded 14258 existing records. [2025-10-27T21:30:24.944439] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:24.944685] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-27T21:30:24.944741] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-27T21:30:24.944888] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-27T21:30:24.944926] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-27T21:30:25.215788] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-27T21:30:25.293102] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:25.878498] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T21:30:26.014964] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-27T21:30:26.814946] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-27T21:30:26.876182] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T21:30:27.614921] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-27T21:30:27.889982] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T21:30:28.416018] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-27T21:30:28.415921] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T21:30:29.214954] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-27T21:30:29.291954] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T21:30:30.015050] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-27T21:30:30.017054] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T21:30:30.806770] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:30:30.815846] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-27T21:30:31.000495] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-27T21:30:31.614942] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-27T21:30:32.414998] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-27T21:30:32.709928] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T21:30:32.944019] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-27T21:30:33.214936] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-27T21:30:33.922637] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T21:30:34.014897] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-27T21:30:34.367630] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T21:30:34.814937] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-27T21:30:35.627687] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-27T21:30:35.657513] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T21:30:35.897088] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T21:30:35.906350] [INFO ] [REMOTE ] TMHC: Full fetch complete (66813 records). [2025-10-27T21:30:35.906461] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-27T21:30:36.287777] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-27T21:30:36.287864] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-27T21:30:36.289211] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-27T21:30:36.289275] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-27T21:30:36.290600] [DEBUG] [LOCAL ] TMHC: Trimmed 66813 records to 45655 (keeping 200 days of data) [2025-10-27T21:30:36.456130] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-27T21:30:36.557721] [DEBUG] [LOCAL ] TMHC: Primary data saved (45655 records). [2025-10-27T21:30:36.557853] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-27T21:30:36.557930] [INFO ] [MAIN ] Update Progress: 2103/2366 symbols completed. TMHC took 30.1s. Estimated remaining: 33m 50s. Rate: 7.8 symbols/min [2025-10-27T21:30:36.723728] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:36.751016] [DEBUG] [LOCAL ] TNET: Loaded 28621 existing records from primary storage. [2025-10-27T21:30:36.751267] [INFO ] [MAIN ] TNET: Loaded 28621 existing records. [2025-10-27T21:30:36.934918] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:36.935239] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-27T21:30:36.935345] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-27T21:30:36.935664] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-27T21:30:36.935801] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-27T21:30:37.217064] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-27T21:30:37.289822] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:37.320113] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-27T21:30:37.539224] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-27T21:30:38.014991] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-27T21:30:38.814979] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-27T21:30:38.977841] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-27T21:30:38.988505] [INFO ] [REMOTE ] TME: Full fetch complete (77164 records). [2025-10-27T21:30:38.988684] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-27T21:30:39.130273] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:30:39.394166] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-27T21:30:39.394246] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-27T21:30:39.395386] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-27T21:30:39.395449] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-27T21:30:39.396930] [DEBUG] [LOCAL ] TME: Trimmed 77164 records to 53188 (keeping 200 days of data) [2025-10-27T21:30:39.619893] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-27T21:30:39.718996] [DEBUG] [LOCAL ] TME: Primary data saved (53188 records). [2025-10-27T21:30:39.719136] [INFO ] [MAIN ] TME: Full history saved. [2025-10-27T21:30:39.719625] [INFO ] [MAIN ] Update Progress: 2104/2366 symbols completed. TME took 34.7s. Estimated remaining: 33m 42s. Rate: 7.8 symbols/min [2025-10-27T21:30:39.895699] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:39.895899] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-27T21:30:39.895942] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-27T21:30:39.896049] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-27T21:30:39.896111] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-27T21:30:39.896181] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-27T21:30:39.896216] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-27T21:30:40.251153] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:40.373521] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T21:30:40.414911] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-10-27T21:30:40.635198] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:30:40.635546] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-10-27T21:30:40.635630] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:30:40.635731] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-27T21:30:40.635795] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:30:40.635864] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-27T21:30:40.635925] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-27T21:30:40.635961] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-27T21:30:40.635999] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-27T21:30:40.636043] [INFO ] [MAIN ] Update Progress: 2105/2366 symbols completed. TNGY took 0.9s. Estimated remaining: 33m 33s. Rate: 7.8 symbols/min [2025-10-27T21:30:40.801908] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:40.836892] [DEBUG] [LOCAL ] TNK: Loaded 35900 existing records from primary storage. [2025-10-27T21:30:40.837177] [INFO ] [MAIN ] TNK: Loaded 35900 existing records. [2025-10-27T21:30:41.012213] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:41.012509] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-27T21:30:41.012669] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-27T21:30:41.019226] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-27T21:30:41.029727] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-27T21:30:41.061844] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-27T21:30:41.220083] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-27T21:30:41.392184] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:42.014949] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-27T21:30:42.278974] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T21:30:42.814914] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-27T21:30:43.034397] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T21:30:43.614992] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-27T21:30:43.773915] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T21:30:44.414972] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-27T21:30:44.756555] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:30:45.214963] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-27T21:30:45.288689] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T21:30:46.014949] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-27T21:30:46.629106] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:30:46.814989] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-27T21:30:47.614944] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-27T21:30:47.633376] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T21:30:47.892413] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T21:30:48.175401] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:30:48.414944] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-27T21:30:49.053107] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T21:30:49.214954] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-27T21:30:50.014953] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-27T21:30:50.132123] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-27T21:30:50.814942] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-27T21:30:51.363789] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T21:30:51.614906] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-27T21:30:51.901481] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T21:30:52.414942] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-27T21:30:52.546228] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-27T21:30:53.214950] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-27T21:30:54.014981] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-27T21:30:54.238109] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-27T21:30:54.247972] [INFO ] [REMOTE ] TMO: Full fetch complete (75740 records). [2025-10-27T21:30:54.248134] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-27T21:30:54.642352] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-27T21:30:54.642442] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-27T21:30:54.643751] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-27T21:30:54.643871] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-27T21:30:54.645310] [DEBUG] [LOCAL ] TMO: Trimmed 75740 records to 52347 (keeping 200 days of data) [2025-10-27T21:30:54.823825] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-27T21:30:54.922851] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T21:30:55.012092] [DEBUG] [LOCAL ] TMO: Primary data saved (52347 records). [2025-10-27T21:30:55.012225] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-27T21:30:55.012963] [INFO ] [MAIN ] Update Progress: 2106/2366 symbols completed. TMO took 38.4s. Estimated remaining: 33m 26s. Rate: 7.8 symbols/min [2025-10-27T21:30:55.133064] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-27T21:30:55.208084] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:55.245758] [DEBUG] [LOCAL ] TNL: Loaded 42380 existing records from primary storage. [2025-10-27T21:30:55.246040] [INFO ] [MAIN ] TNL: Loaded 42380 existing records. [2025-10-27T21:30:55.421627] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:55.421963] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-27T21:30:55.422040] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-27T21:30:55.429161] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-27T21:30:55.429408] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T21:30:55.429577] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-27T21:30:55.462636] [INFO ] [REMOTE ] TNC: Full fetch complete (22059 records). [2025-10-27T21:30:55.493965] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-27T21:30:55.620041] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-27T21:30:56.097323] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:56.152678] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-27T21:30:56.152754] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-27T21:30:56.153233] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-27T21:30:56.153270] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-27T21:30:56.153865] [DEBUG] [LOCAL ] TNC: Trimmed 22059 records to 13730 (keeping 200 days of data) [2025-10-27T21:30:56.236840] [DEBUG] [LOCAL ] TNC: Primary data saved (13730 records). [2025-10-27T21:30:56.236967] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-27T21:30:56.237042] [INFO ] [MAIN ] Update Progress: 2107/2366 symbols completed. TNC took 31.7s. Estimated remaining: 33m 18s. Rate: 7.8 symbols/min [2025-10-27T21:30:56.404790] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:30:56.414959] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-27T21:30:56.453540] [DEBUG] [LOCAL ] TOL: Loaded 51173 existing records from primary storage. [2025-10-27T21:30:56.453868] [INFO ] [MAIN ] TOL: Loaded 51173 existing records. [2025-10-27T21:30:56.627250] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:30:56.627445] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-27T21:30:56.627512] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-27T21:30:56.627721] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-27T21:30:56.627776] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-27T21:30:56.981900] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:30:57.109076] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:30:57.214912] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-27T21:30:57.678369] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T21:30:58.014938] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-27T21:30:58.567585] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T21:30:58.814989] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-27T21:30:59.382994] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T21:30:59.611519] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T21:30:59.617205] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-27T21:31:00.414984] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-27T21:31:01.163381] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T21:31:01.187320] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:31:01.192505] [INFO ] [REMOTE ] TNET: Full fetch complete (41946 records). [2025-10-27T21:31:01.192599] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-27T21:31:01.221796] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-27T21:31:01.590393] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-27T21:31:01.590468] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-27T21:31:01.591301] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-27T21:31:01.591362] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-27T21:31:01.592222] [DEBUG] [LOCAL ] TNET: Trimmed 41946 records to 28018 (keeping 200 days of data) [2025-10-27T21:31:01.760443] [DEBUG] [LOCAL ] TNET: Primary data saved (28018 records). [2025-10-27T21:31:01.760576] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-27T21:31:01.760674] [INFO ] [MAIN ] Update Progress: 2108/2366 symbols completed. TNET took 25.2s. Estimated remaining: 33m 10s. Rate: 7.8 symbols/min [2025-10-27T21:31:01.962440] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:02.011061] [DEBUG] [LOCAL ] TOST: Loaded 54470 existing records from primary storage. [2025-10-27T21:31:02.011373] [INFO ] [MAIN ] TOST: Loaded 54470 existing records. [2025-10-27T21:31:02.022842] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-27T21:31:02.189626] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:02.189826] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-27T21:31:02.189874] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-27T21:31:02.190062] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-27T21:31:02.190100] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-27T21:31:02.545683] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:02.814945] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-27T21:31:03.058336] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T21:31:03.121680] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T21:31:03.614952] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-27T21:31:04.415001] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-27T21:31:04.817727] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-27T21:31:04.879747] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T21:31:05.214988] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-27T21:31:05.835559] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:31:06.014976] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-27T21:31:06.714711] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T21:31:06.814906] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-27T21:31:06.983232] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T21:31:07.614948] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-27T21:31:08.339575] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T21:31:08.414906] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-27T21:31:08.755738] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:31:09.214998] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-27T21:31:10.014989] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-27T21:31:10.445633] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-27T21:31:10.526275] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T21:31:10.814987] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-27T21:31:11.599557] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-27T21:31:11.614906] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-27T21:31:12.240192] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:31:12.414926] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-27T21:31:13.020688] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:31:13.214988] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-27T21:31:13.710591] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:31:14.014993] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-27T21:31:14.814934] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-27T21:31:14.954417] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:31:15.172281] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:31:15.614933] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-27T21:31:16.140092] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-27T21:31:16.415004] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-27T21:31:17.057966] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:31:17.214948] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-27T21:31:18.014936] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-27T21:31:18.180522] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T21:31:18.217702] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:31:18.814926] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-27T21:31:19.002631] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T21:31:19.009281] [INFO ] [REMOTE ] TNK: Full fetch complete (51889 records). [2025-10-27T21:31:19.009380] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-27T21:31:19.387409] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-27T21:31:19.387502] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-27T21:31:19.388591] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-27T21:31:19.388679] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-27T21:31:19.389784] [DEBUG] [LOCAL ] TNK: Trimmed 51889 records to 35154 (keeping 200 days of data) [2025-10-27T21:31:19.611885] [DEBUG] [LOCAL ] TNK: Primary data saved (35154 records). [2025-10-27T21:31:19.612056] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-27T21:31:19.612633] [INFO ] [MAIN ] Update Progress: 2109/2366 symbols completed. TNK took 39.0s. Estimated remaining: 33m 3s. Rate: 7.8 symbols/min [2025-10-27T21:31:19.620007] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-27T21:31:19.836215] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:19.866135] [DEBUG] [LOCAL ] TPB: Loaded 26581 existing records from primary storage. [2025-10-27T21:31:19.866429] [INFO ] [MAIN ] TPB: Loaded 26581 existing records. [2025-10-27T21:31:20.136031] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:20.136571] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-27T21:31:20.136775] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-27T21:31:20.137017] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-27T21:31:20.137097] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-27T21:31:20.418157] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-27T21:31:20.624669] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:20.704558] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-27T21:31:20.885624] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T21:31:21.214946] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-27T21:31:21.883983] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T21:31:22.014923] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-27T21:31:22.466634] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T21:31:22.814960] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-27T21:31:23.003377] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T21:31:23.614980] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-27T21:31:24.072587] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T21:31:24.082207] [INFO ] [REMOTE ] TOL: Full fetch complete (73619 records). [2025-10-27T21:31:24.082385] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-27T21:31:24.437316] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-27T21:31:24.487866] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-27T21:31:24.488023] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-27T21:31:24.489344] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-27T21:31:24.489428] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-27T21:31:24.504001] [DEBUG] [LOCAL ] TOL: Trimmed 73619 records to 50340 (keeping 200 days of data) [2025-10-27T21:31:24.504695] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T21:31:24.837188] [DEBUG] [LOCAL ] TOL: Primary data saved (50340 records). [2025-10-27T21:31:24.837361] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-27T21:31:24.837474] [INFO ] [MAIN ] Update Progress: 2110/2366 symbols completed. TOL took 28.6s. Estimated remaining: 32m 55s. Rate: 7.8 symbols/min [2025-10-27T21:31:25.003357] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:25.039416] [DEBUG] [LOCAL ] TPC: Loaded 39657 existing records from primary storage. [2025-10-27T21:31:25.039702] [INFO ] [MAIN ] TPC: Loaded 39657 existing records. [2025-10-27T21:31:25.221210] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-27T21:31:25.225889] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:25.227009] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-27T21:31:25.227058] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-27T21:31:25.227259] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-27T21:31:25.227315] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-27T21:31:25.587904] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:26.014928] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-27T21:31:26.358627] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:31:26.796994] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T21:31:26.822118] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-27T21:31:26.827083] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T21:31:27.614970] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-27T21:31:27.881330] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T21:31:28.414993] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-27T21:31:28.713273] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T21:31:28.721328] [INFO ] [REMOTE ] TNL: Full fetch complete (59796 records). [2025-10-27T21:31:28.721449] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-27T21:31:29.101382] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-27T21:31:29.101591] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-27T21:31:29.102607] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-27T21:31:29.102695] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-27T21:31:29.103844] [DEBUG] [LOCAL ] TNL: Trimmed 59796 records to 41603 (keeping 200 days of data) [2025-10-27T21:31:29.216877] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-27T21:31:29.329942] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T21:31:29.377046] [DEBUG] [LOCAL ] TNL: Primary data saved (41603 records). [2025-10-27T21:31:29.377169] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-27T21:31:29.377246] [INFO ] [MAIN ] Update Progress: 2111/2366 symbols completed. TNL took 34.4s. Estimated remaining: 32m 47s. Rate: 7.8 symbols/min [2025-10-27T21:31:29.546773] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:29.584255] [DEBUG] [LOCAL ] TPH: Loaded 45447 existing records from primary storage. [2025-10-27T21:31:29.584528] [INFO ] [MAIN ] TPH: Loaded 45447 existing records. [2025-10-27T21:31:29.759048] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:29.759254] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-27T21:31:29.759310] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-27T21:31:29.759803] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-27T21:31:29.759859] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-27T21:31:30.022381] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-27T21:31:30.110906] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:30.482476] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T21:31:30.814958] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-27T21:31:31.615033] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-27T21:31:31.947526] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T21:31:32.054831] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-27T21:31:32.414944] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-27T21:31:32.816520] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-27T21:31:33.214973] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-27T21:31:33.372175] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T21:31:34.014928] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-27T21:31:34.130022] [DEBUG] [REMOTE ] TOST: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-27T21:31:34.130242] [WARN ] [REMOTE ] TOST: No data returned for month 2025-10 [2025-10-27T21:31:34.130329] [FATAL] [REMOTE ] TOST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:31:34.130402] [FATAL] [MAIN ] TOST: Failed to fetch primary data. [2025-10-27T21:31:34.130436] [WARN ] [MAIN ] TOST: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:31:34.130472] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-27T21:31:34.130521] [DEBUG] [LOCAL ] TOST: No primary data file found to delete. [2025-10-27T21:31:34.130555] [INFO ] [LOCAL ] TOST: Starting deletion of derivative data. [2025-10-27T21:31:34.130692] [DEBUG] [LOCAL ] TOST: Deleted derivative data file. [2025-10-27T21:31:34.130775] [INFO ] [MAIN ] Update Progress: 2112/2366 symbols completed. TOST took 32.4s. Estimated remaining: 32m 39s. Rate: 7.8 symbols/min [2025-10-27T21:31:34.313034] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:34.326013] [DEBUG] [LOCAL ] TPL: Loaded 12363 existing records from primary storage. [2025-10-27T21:31:34.326215] [INFO ] [MAIN ] TPL: Loaded 12363 existing records. [2025-10-27T21:31:34.459956] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T21:31:34.541619] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:34.541825] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-27T21:31:34.541873] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-27T21:31:34.542043] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-27T21:31:34.542080] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-27T21:31:34.820208] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-27T21:31:34.919234] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:35.614942] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-27T21:31:36.161003] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:31:36.259965] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-27T21:31:36.414965] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-27T21:31:37.214907] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-27T21:31:37.392514] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T21:31:38.014999] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-27T21:31:38.239603] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:31:38.814964] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-27T21:31:39.084366] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-27T21:31:39.614992] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-27T21:31:39.696198] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T21:31:40.414943] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-27T21:31:41.046949] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:31:41.214919] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-27T21:31:41.239976] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T21:31:41.246178] [INFO ] [REMOTE ] TPB: Full fetch complete (36234 records). [2025-10-27T21:31:41.246262] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-27T21:31:41.640439] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-27T21:31:41.640513] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-27T21:31:41.641234] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-27T21:31:41.641293] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-27T21:31:41.642102] [DEBUG] [LOCAL ] TPB: Trimmed 36234 records to 26157 (keeping 200 days of data) [2025-10-27T21:31:41.797603] [DEBUG] [LOCAL ] TPB: Primary data saved (26157 records). [2025-10-27T21:31:41.797733] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-27T21:31:41.797814] [INFO ] [MAIN ] Update Progress: 2113/2366 symbols completed. TPB took 22.2s. Estimated remaining: 32m 32s. Rate: 7.8 symbols/min [2025-10-27T21:31:41.961891] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:31:42.010003] [DEBUG] [LOCAL ] TPR: Loaded 54128 existing records from primary storage. [2025-10-27T21:31:42.010319] [INFO ] [MAIN ] TPR: Loaded 54128 existing records. [2025-10-27T21:31:42.021259] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-27T21:31:42.189760] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:31:42.189971] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-27T21:31:42.190018] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-27T21:31:42.190273] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-27T21:31:42.190312] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-27T21:31:42.587112] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:31:42.627550] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:31:42.814932] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-27T21:31:42.827866] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-27T21:31:43.615007] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-27T21:31:43.852277] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T21:31:44.415001] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-27T21:31:44.739407] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T21:31:45.214980] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-27T21:31:45.843333] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:31:46.014937] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-27T21:31:46.513618] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T21:31:46.815015] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-27T21:31:47.370978] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T21:31:47.614995] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-27T21:31:47.804127] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T21:31:48.414995] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-27T21:31:49.214970] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-27T21:31:49.442582] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T21:31:49.595726] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T21:31:50.014900] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-27T21:31:50.180501] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T21:31:50.814950] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-27T21:31:51.131520] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:31:51.614944] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-27T21:31:52.293240] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T21:31:52.414939] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-27T21:31:53.190886] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-27T21:31:53.214912] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-27T21:31:53.606103] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T21:31:54.014929] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-27T21:31:54.274608] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T21:31:54.814980] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-27T21:31:55.494443] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T21:31:55.614922] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-27T21:31:56.002487] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:31:56.414949] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-27T21:31:57.064807] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T21:31:57.214935] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-27T21:31:57.440971] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T21:31:58.014915] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-27T21:31:58.301178] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-27T21:31:58.814957] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-27T21:31:59.500569] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T21:31:59.507745] [INFO ] [REMOTE ] TPC: Full fetch complete (55509 records). [2025-10-27T21:31:59.507840] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-27T21:31:59.620078] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-27T21:31:59.883913] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-27T21:31:59.883988] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-27T21:31:59.884944] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-27T21:31:59.885052] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-27T21:31:59.886160] [DEBUG] [LOCAL ] TPC: Trimmed 55509 records to 38966 (keeping 200 days of data) [2025-10-27T21:32:00.130337] [DEBUG] [LOCAL ] TPC: Primary data saved (38966 records). [2025-10-27T21:32:00.130527] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-27T21:32:00.130685] [INFO ] [MAIN ] Update Progress: 2114/2366 symbols completed. TPC took 35.3s. Estimated remaining: 32m 25s. Rate: 7.8 symbols/min [2025-10-27T21:32:00.310799] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:00.336810] [DEBUG] [LOCAL ] TPVG: Loaded 27576 existing records from primary storage. [2025-10-27T21:32:00.337066] [INFO ] [MAIN ] TPVG: Loaded 27576 existing records. [2025-10-27T21:32:00.419102] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-27T21:32:00.533026] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:00.534243] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T21:32:00.534517] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-27T21:32:00.537808] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-27T21:32:00.538812] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-27T21:32:00.538910] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-27T21:32:00.691104] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T21:32:00.929045] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:01.214941] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-27T21:32:01.517284] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T21:32:01.525950] [INFO ] [REMOTE ] TPH: Full fetch complete (65081 records). [2025-10-27T21:32:01.526088] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-27T21:32:01.923853] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-27T21:32:01.923939] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-27T21:32:01.924996] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-27T21:32:01.925060] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-27T21:32:01.926384] [DEBUG] [LOCAL ] TPH: Trimmed 65081 records to 44729 (keeping 200 days of data) [2025-10-27T21:32:02.022726] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-27T21:32:02.159328] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T21:32:02.223570] [DEBUG] [LOCAL ] TPH: Primary data saved (44729 records). [2025-10-27T21:32:02.223736] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-27T21:32:02.224518] [INFO ] [MAIN ] Update Progress: 2115/2366 symbols completed. TPH took 32.8s. Estimated remaining: 32m 17s. Rate: 7.8 symbols/min [2025-10-27T21:32:02.396004] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:02.406749] [DEBUG] [LOCAL ] TPYP: Loaded 7969 existing records from primary storage. [2025-10-27T21:32:02.406970] [INFO ] [MAIN ] TPYP: Loaded 7969 existing records. [2025-10-27T21:32:02.583994] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:02.584216] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-27T21:32:02.584262] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-27T21:32:02.584408] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-27T21:32:02.584445] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-27T21:32:02.820307] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-27T21:32:02.966711] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:03.614954] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-27T21:32:03.839328] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-27T21:32:03.860309] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-27T21:32:04.158056] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T21:32:04.414986] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-27T21:32:05.149339] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-27T21:32:05.214901] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-27T21:32:05.773273] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T21:32:06.014953] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-27T21:32:06.814999] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-27T21:32:07.094864] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T21:32:07.615000] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-27T21:32:08.420454] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-27T21:32:08.438927] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T21:32:08.537060] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T21:32:09.103330] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T21:32:09.214936] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-27T21:32:09.407903] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.19 seconds). [2025-10-27T21:32:10.014978] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-27T21:32:10.593336] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-27T21:32:10.595841] [INFO ] [REMOTE ] TPL: Full fetch complete (17411 records). [2025-10-27T21:32:10.595910] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-27T21:32:10.820135] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-27T21:32:10.961514] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-27T21:32:10.961586] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-27T21:32:10.961969] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-27T21:32:10.962029] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-27T21:32:10.962546] [DEBUG] [LOCAL ] TPL: Trimmed 17411 records to 11859 (keeping 200 days of data) [2025-10-27T21:32:11.035595] [DEBUG] [LOCAL ] TPL: Primary data saved (11859 records). [2025-10-27T21:32:11.035747] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-27T21:32:11.035829] [INFO ] [MAIN ] Update Progress: 2116/2366 symbols completed. TPL took 36.9s. Estimated remaining: 32m 9s. Rate: 7.8 symbols/min [2025-10-27T21:32:11.204813] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:11.211778] [DEBUG] [LOCAL ] TPZ: Loaded 4637 existing records from primary storage. [2025-10-27T21:32:11.211951] [INFO ] [MAIN ] TPZ: Loaded 4637 existing records. [2025-10-27T21:32:11.391733] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:11.391927] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-27T21:32:11.391973] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-27T21:32:11.392145] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-27T21:32:11.392228] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-27T21:32:11.625307] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-27T21:32:11.712629] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T21:32:11.755039] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:12.414926] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-27T21:32:12.661941] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T21:32:12.994029] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T21:32:13.214925] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-27T21:32:14.014947] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-27T21:32:14.753494] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T21:32:14.814925] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-27T21:32:14.930494] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-27T21:32:14.941175] [INFO ] [REMOTE ] TPR: Full fetch complete (77483 records). [2025-10-27T21:32:14.941346] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-27T21:32:15.352312] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-27T21:32:15.352404] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-27T21:32:15.353570] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-27T21:32:15.353686] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-27T21:32:15.355252] [DEBUG] [LOCAL ] TPR: Trimmed 77483 records to 53347 (keeping 200 days of data) [2025-10-27T21:32:15.575973] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T21:32:15.616983] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-27T21:32:15.698610] [DEBUG] [LOCAL ] TPR: Primary data saved (53347 records). [2025-10-27T21:32:15.698779] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-27T21:32:15.698898] [INFO ] [MAIN ] Update Progress: 2117/2366 symbols completed. TPR took 33.9s. Estimated remaining: 32m 1s. Rate: 7.8 symbols/min [2025-10-27T21:32:16.144540] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-27T21:32:16.414954] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-27T21:32:17.214914] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-27T21:32:17.553067] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:32:17.862863] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-27T21:32:18.014938] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-27T21:32:18.814961] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-27T21:32:19.152320] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T21:32:19.156962] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-27T21:32:19.614976] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-27T21:32:20.415039] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-27T21:32:20.720435] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-27T21:32:20.828708] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T21:32:21.215030] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-27T21:32:22.015027] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-27T21:32:22.106833] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-27T21:32:22.755237] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-27T21:32:22.814976] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-27T21:32:23.318426] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-27T21:32:23.614950] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-27T21:32:24.042875] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T21:32:24.414960] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-27T21:32:25.214911] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-27T21:32:25.680118] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T21:32:25.697829] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-27T21:32:26.014960] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-27T21:32:26.814954] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-27T21:32:27.195425] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-27T21:32:27.201332] [INFO ] [REMOTE ] TPVG: Full fetch complete (39164 records). [2025-10-27T21:32:27.201427] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-27T21:32:27.464226] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-27T21:32:27.592253] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-27T21:32:27.592331] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-27T21:32:27.593167] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-27T21:32:27.593229] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-27T21:32:27.594170] [DEBUG] [LOCAL ] TPVG: Trimmed 39164 records to 26721 (keeping 200 days of data) [2025-10-27T21:32:27.639921] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-27T21:32:27.747803] [DEBUG] [LOCAL ] TPVG: Primary data saved (26721 records). [2025-10-27T21:32:27.747936] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-27T21:32:27.748033] [INFO ] [MAIN ] Update Progress: 2118/2366 symbols completed. TPVG took 27.6s. Estimated remaining: 31m 54s. Rate: 7.8 symbols/min [2025-10-27T21:32:28.125799] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:32:28.415004] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-27T21:32:28.820788] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T21:32:28.822676] [INFO ] [REMOTE ] TPYP: Full fetch complete (12239 records). [2025-10-27T21:32:28.822747] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-27T21:32:29.172251] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-27T21:32:29.172326] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-27T21:32:29.172599] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-27T21:32:29.172636] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-27T21:32:29.173120] [DEBUG] [LOCAL ] TPYP: Trimmed 12239 records to 7719 (keeping 200 days of data) [2025-10-27T21:32:29.217163] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-27T21:32:29.219434] [DEBUG] [LOCAL ] TPYP: Primary data saved (7719 records). [2025-10-27T21:32:29.220150] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-27T21:32:29.220229] [INFO ] [MAIN ] Update Progress: 2119/2366 symbols completed. TPYP took 27.0s. Estimated remaining: 31m 45s. Rate: 7.8 symbols/min [2025-10-27T21:32:29.592264] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T21:32:30.014958] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-27T21:32:30.350552] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-27T21:32:30.351899] [INFO ] [REMOTE ] TPZ: Full fetch complete (8230 records). [2025-10-27T21:32:30.351992] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-27T21:32:30.706206] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-27T21:32:30.706283] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-27T21:32:30.706492] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-27T21:32:30.706530] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-27T21:32:30.707023] [DEBUG] [LOCAL ] TPZ: Trimmed 8230 records to 4527 (keeping 200 days of data) [2025-10-27T21:32:30.734110] [DEBUG] [LOCAL ] TPZ: Primary data saved (4527 records). [2025-10-27T21:32:30.734230] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-27T21:32:30.734308] [INFO ] [MAIN ] Update Progress: 2120/2366 symbols completed. TPZ took 19.7s. Estimated remaining: 31m 37s. Rate: 7.8 symbols/min [2025-10-27T21:32:31.397392] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:31.479357] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:31.471167] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:31.535990] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:31.542676] [DEBUG] [LOCAL ] TRAK: Loaded 9673 existing records from primary storage. [2025-10-27T21:32:31.542890] [INFO ] [MAIN ] TRAK: Loaded 9673 existing records. [2025-10-27T21:32:31.657408] [DEBUG] [LOCAL ] TRC: Loaded 15510 existing records from primary storage. [2025-10-27T21:32:31.675908] [INFO ] [MAIN ] TRC: Loaded 15510 existing records. [2025-10-27T21:32:31.707674] [DEBUG] [LOCAL ] TR: Loaded 19477 existing records from primary storage. [2025-10-27T21:32:31.784420] [INFO ] [MAIN ] TR: Loaded 19477 existing records. [2025-10-27T21:32:31.919850] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:31.956667] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-27T21:32:31.956887] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-27T21:32:32.008886] [DEBUG] [LOCAL ] TREX: Loaded 50512 existing records from primary storage. [2025-10-27T21:32:32.040011] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-27T21:32:32.067860] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-27T21:32:32.104977] [INFO ] [MAIN ] TREX: Loaded 50512 existing records. [2025-10-27T21:32:32.181614] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:32.339287] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:32.388574] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-27T21:32:32.393964] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-27T21:32:32.409563] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-27T21:32:32.412112] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-27T21:32:32.412687] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-27T21:32:32.412758] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-27T21:32:32.423250] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-27T21:32:32.472793] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-27T21:32:32.721388] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:32.726897] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-27T21:32:32.835877] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-27T21:32:32.896007] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-27T21:32:32.929148] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-27T21:32:33.378791] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:33.413832] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-27T21:32:33.704244] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:33.753193] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-27T21:32:33.789954] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:33.797757] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-27T21:32:33.949003] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:33.949370] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-27T21:32:34.069117] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-27T21:32:34.071787] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-27T21:32:34.542073] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-27T21:32:34.771138] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T21:32:34.785407] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T21:32:34.814979] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-27T21:32:34.976771] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-27T21:32:35.601946] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T21:32:35.614922] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-27T21:32:36.414929] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-27T21:32:36.488615] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-27T21:32:36.939792] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T21:32:37.214906] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-27T21:32:38.015005] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-27T21:32:38.392926] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T21:32:38.814921] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-27T21:32:38.981425] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T21:32:39.614916] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-27T21:32:39.837293] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-27T21:32:40.414953] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-27T21:32:41.107779] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T21:32:41.214913] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-27T21:32:41.419025] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T21:32:41.633867] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T21:32:42.014958] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-27T21:32:42.539947] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T21:32:42.814942] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-27T21:32:43.411290] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T21:32:43.614982] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-27T21:32:44.414940] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-27T21:32:44.596412] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:32:45.214963] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-27T21:32:45.871937] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T21:32:45.917359] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T21:32:46.014944] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-27T21:32:46.709270] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T21:32:46.814951] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-27T21:32:47.614954] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-27T21:32:47.901559] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T21:32:48.066035] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-27T21:32:48.414977] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-27T21:32:49.214968] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-27T21:32:49.357767] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T21:32:50.014975] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-27T21:32:50.552729] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-27T21:32:50.814950] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-27T21:32:50.893394] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-27T21:32:51.614944] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-27T21:32:51.658177] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T21:32:52.414937] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-27T21:32:52.853905] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T21:32:53.161417] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-27T21:32:53.214941] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-27T21:32:54.019990] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-27T21:32:54.021695] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-27T21:32:54.024544] [INFO ] [REMOTE ] TRAK: Full fetch complete (13624 records). [2025-10-27T21:32:54.024665] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-27T21:32:54.384955] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-27T21:32:54.385033] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-27T21:32:54.385344] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-27T21:32:54.385383] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-27T21:32:54.385956] [DEBUG] [LOCAL ] TRAK: Trimmed 13624 records to 9359 (keeping 200 days of data) [2025-10-27T21:32:54.442316] [DEBUG] [LOCAL ] TRAK: Primary data saved (9359 records). [2025-10-27T21:32:54.442450] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-27T21:32:54.442530] [INFO ] [MAIN ] Update Progress: 2121/2366 symbols completed. TRAK took 23.7s. Estimated remaining: 31m 31s. Rate: 7.8 symbols/min [2025-10-27T21:32:54.613345] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:54.662519] [DEBUG] [LOCAL ] TRGP: Loaded 51432 existing records from primary storage. [2025-10-27T21:32:54.662868] [INFO ] [MAIN ] TRGP: Loaded 51432 existing records. [2025-10-27T21:32:54.817669] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-27T21:32:54.847375] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:54.848915] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-27T21:32:54.848981] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-27T21:32:54.849448] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-27T21:32:54.849490] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-27T21:32:55.048042] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T21:32:55.233960] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:55.528939] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-27T21:32:55.614916] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-27T21:32:56.414932] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-27T21:32:56.562396] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T21:32:56.566384] [INFO ] [REMOTE ] TR: Full fetch complete (25643 records). [2025-10-27T21:32:56.566460] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-27T21:32:56.934186] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-27T21:32:56.934263] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-27T21:32:56.934859] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-27T21:32:56.934921] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-27T21:32:56.935614] [DEBUG] [LOCAL ] TR: Trimmed 25643 records to 19336 (keeping 200 days of data) [2025-10-27T21:32:57.049835] [DEBUG] [LOCAL ] TR: Primary data saved (19336 records). [2025-10-27T21:32:57.049957] [INFO ] [MAIN ] TR: Full history saved. [2025-10-27T21:32:57.050035] [INFO ] [MAIN ] Update Progress: 2122/2366 symbols completed. TR took 26.3s. Estimated remaining: 31m 23s. Rate: 7.8 symbols/min [2025-10-27T21:32:57.233410] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-27T21:32:57.237625] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T21:32:57.236987] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:32:57.275462] [DEBUG] [LOCAL ] TRN: Loaded 36624 existing records from primary storage. [2025-10-27T21:32:57.275769] [INFO ] [MAIN ] TRN: Loaded 36624 existing records. [2025-10-27T21:32:57.449766] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:32:57.449957] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-27T21:32:57.450002] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-27T21:32:57.450391] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-27T21:32:57.450429] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-27T21:32:57.814434] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:32:58.014939] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-27T21:32:58.556518] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-27T21:32:58.814928] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-27T21:32:58.855773] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T21:32:59.614970] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-27T21:32:59.808777] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-27T21:33:00.415056] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-27T21:33:01.066810] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T21:33:01.214984] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-27T21:33:01.796817] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T21:33:02.015036] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-27T21:33:02.702434] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T21:33:02.814989] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-27T21:33:03.318506] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-27T21:33:03.614964] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-27T21:33:03.816077] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T21:33:04.414944] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-27T21:33:05.035207] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:33:05.214942] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-27T21:33:05.536480] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T21:33:06.014966] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-27T21:33:06.166053] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T21:33:06.815064] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-27T21:33:07.570421] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T21:33:07.573237] [INFO ] [REMOTE ] TRC: Full fetch complete (21702 records). [2025-10-27T21:33:07.573309] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-27T21:33:07.618691] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-27T21:33:07.957177] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-27T21:33:07.957290] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-27T21:33:07.957916] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-27T21:33:07.958130] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-27T21:33:07.959074] [DEBUG] [LOCAL ] TRC: Trimmed 21702 records to 15063 (keeping 200 days of data) [2025-10-27T21:33:08.061826] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-27T21:33:08.102611] [DEBUG] [LOCAL ] TRC: Primary data saved (15063 records). [2025-10-27T21:33:08.103249] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-27T21:33:08.103358] [INFO ] [MAIN ] Update Progress: 2123/2366 symbols completed. TRC took 37.4s. Estimated remaining: 31m 15s. Rate: 7.8 symbols/min [2025-10-27T21:33:08.274457] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:08.313703] [DEBUG] [LOCAL ] TRNO: Loaded 44180 existing records from primary storage. [2025-10-27T21:33:08.314028] [INFO ] [MAIN ] TRNO: Loaded 44180 existing records. [2025-10-27T21:33:08.420080] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-27T21:33:08.487134] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:08.487306] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-27T21:33:08.487389] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-27T21:33:08.487768] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-27T21:33:08.487823] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-27T21:33:08.841013] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:09.044968] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-27T21:33:09.214981] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-27T21:33:09.853714] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T21:33:10.014982] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-27T21:33:10.374383] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T21:33:10.814948] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-27T21:33:11.041364] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T21:33:11.614958] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-27T21:33:12.105852] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T21:33:12.115671] [INFO ] [REMOTE ] TREX: Full fetch complete (71895 records). [2025-10-27T21:33:12.115803] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-27T21:33:12.418265] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-27T21:33:12.516085] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-27T21:33:12.516167] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-27T21:33:12.517396] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-27T21:33:12.517461] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-27T21:33:12.518851] [DEBUG] [LOCAL ] TREX: Trimmed 71895 records to 49725 (keeping 200 days of data) [2025-10-27T21:33:12.813189] [DEBUG] [LOCAL ] TREX: Primary data saved (49725 records). [2025-10-27T21:33:12.813331] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-27T21:33:12.813410] [INFO ] [MAIN ] Update Progress: 2124/2366 symbols completed. TREX took 42.1s. Estimated remaining: 31m 7s. Rate: 7.8 symbols/min [2025-10-27T21:33:12.985069] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:13.044101] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T21:33:13.069708] [DEBUG] [LOCAL ] TROX: Loaded 52959 existing records from primary storage. [2025-10-27T21:33:13.070032] [INFO ] [MAIN ] TROX: Loaded 52959 existing records. [2025-10-27T21:33:13.240044] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-27T21:33:13.245136] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:13.246054] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-27T21:33:13.246129] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-27T21:33:13.246350] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-27T21:33:13.246409] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-27T21:33:13.619297] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:14.014951] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-27T21:33:14.048917] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:33:14.632545] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-27T21:33:14.814939] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-27T21:33:15.085505] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T21:33:15.614946] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-27T21:33:16.414926] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-27T21:33:16.497454] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T21:33:17.117810] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T21:33:17.214911] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-27T21:33:17.625571] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T21:33:18.014954] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-27T21:33:18.400791] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:33:18.814952] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-27T21:33:19.425739] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-27T21:33:19.614926] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-27T21:33:20.419216] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-27T21:33:20.425695] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T21:33:20.620803] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:33:21.214996] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-27T21:33:21.447486] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T21:33:22.014935] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-27T21:33:22.815001] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-27T21:33:22.879696] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-27T21:33:23.559861] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-27T21:33:23.614945] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-27T21:33:24.054299] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T21:33:24.414943] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-27T21:33:24.844320] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T21:33:25.214990] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-27T21:33:25.654229] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:33:26.014949] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-27T21:33:26.600955] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T21:33:26.814916] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-27T21:33:26.854971] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T21:33:26.860876] [INFO ] [REMOTE ] TRN: Full fetch complete (52422 records). [2025-10-27T21:33:26.860968] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-27T21:33:27.231559] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-27T21:33:27.231663] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-27T21:33:27.232635] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-27T21:33:27.232741] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-27T21:33:27.233755] [DEBUG] [LOCAL ] TRN: Trimmed 52422 records to 35831 (keeping 200 days of data) [2025-10-27T21:33:27.444831] [DEBUG] [LOCAL ] TRN: Primary data saved (35831 records). [2025-10-27T21:33:27.444965] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-27T21:33:27.445401] [INFO ] [MAIN ] Update Progress: 2125/2366 symbols completed. TRN took 30.4s. Estimated remaining: 31m 0s. Rate: 7.8 symbols/min [2025-10-27T21:33:27.609524] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:27.614965] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-27T21:33:27.659351] [DEBUG] [LOCAL ] TRP: Loaded 52901 existing records from primary storage. [2025-10-27T21:33:27.659702] [INFO ] [MAIN ] TRP: Loaded 52901 existing records. [2025-10-27T21:33:27.829364] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:27.829569] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-27T21:33:27.829614] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-27T21:33:27.829847] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-27T21:33:27.829902] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-27T21:33:28.181134] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:28.271921] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:33:28.414907] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-27T21:33:29.214938] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-27T21:33:29.251991] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:33:30.012688] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-27T21:33:30.021293] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-27T21:33:30.023562] [INFO ] [REMOTE ] TRGP: Full fetch complete (73583 records). [2025-10-27T21:33:30.023764] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-27T21:33:30.407803] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-27T21:33:30.407876] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-27T21:33:30.408997] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-27T21:33:30.409057] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-27T21:33:30.410548] [DEBUG] [LOCAL ] TRGP: Trimmed 73583 records to 50616 (keeping 200 days of data) [2025-10-27T21:33:30.718143] [DEBUG] [LOCAL ] TRGP: Primary data saved (50616 records). [2025-10-27T21:33:30.718268] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-27T21:33:30.718344] [INFO ] [MAIN ] Update Progress: 2126/2366 symbols completed. TRGP took 36.3s. Estimated remaining: 30m 52s. Rate: 7.8 symbols/min [2025-10-27T21:33:30.818067] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-27T21:33:30.892267] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:30.922458] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T21:33:30.960938] [DEBUG] [LOCAL ] TRTX: Loaded 37308 existing records from primary storage. [2025-10-27T21:33:30.961264] [INFO ] [MAIN ] TRTX: Loaded 37308 existing records. [2025-10-27T21:33:31.134862] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:31.135057] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-27T21:33:31.135104] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-27T21:33:31.135354] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-27T21:33:31.135415] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-27T21:33:31.486871] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:31.557956] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-27T21:33:31.565461] [INFO ] [REMOTE ] TRNO: Full fetch complete (62627 records). [2025-10-27T21:33:31.565571] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-27T21:33:31.622473] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-27T21:33:31.950267] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-27T21:33:31.950467] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-27T21:33:31.951593] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-27T21:33:31.951683] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-27T21:33:31.953055] [DEBUG] [LOCAL ] TRNO: Trimmed 62627 records to 43285 (keeping 200 days of data) [2025-10-27T21:33:32.247678] [DEBUG] [LOCAL ] TRNO: Primary data saved (43285 records). [2025-10-27T21:33:32.247910] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-27T21:33:32.248733] [INFO ] [MAIN ] Update Progress: 2127/2366 symbols completed. TRNO took 24.1s. Estimated remaining: 30m 44s. Rate: 7.8 symbols/min [2025-10-27T21:33:32.294347] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T21:33:32.420160] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-27T21:33:32.435069] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:32.993591] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T21:33:33.215025] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-27T21:33:34.018776] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-27T21:33:34.023823] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T21:33:34.097965] [DEBUG] [LOCAL ] TRU: Loaded 52218 existing records from primary storage. [2025-10-27T21:33:34.098302] [INFO ] [MAIN ] TRU: Loaded 52218 existing records. [2025-10-27T21:33:34.284278] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:34.284684] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-27T21:33:34.284877] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-27T21:33:34.285174] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-27T21:33:34.285229] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-27T21:33:34.656073] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:34.683557] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T21:33:34.814923] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-27T21:33:35.226549] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-27T21:33:35.614950] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-27T21:33:36.414969] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-27T21:33:36.453487] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-27T21:33:37.133629] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T21:33:37.214915] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-27T21:33:37.796980] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-27T21:33:38.014962] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-27T21:33:38.572381] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-27T21:33:38.814944] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-27T21:33:39.531842] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:33:39.614950] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-27T21:33:40.414977] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-27T21:33:40.628080] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T21:33:40.940750] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T21:33:41.214942] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-27T21:33:42.024876] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-27T21:33:42.028018] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T21:33:42.479176] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T21:33:42.814950] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-27T21:33:43.354374] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T21:33:43.614952] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-27T21:33:44.135526] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T21:33:44.414931] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-27T21:33:44.923917] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:33:45.214936] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-27T21:33:45.825784] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T21:33:45.837638] [INFO ] [REMOTE ] TROX: Full fetch complete (74219 records). [2025-10-27T21:33:45.837973] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-27T21:33:46.024196] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-27T21:33:46.266116] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-27T21:33:46.266266] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-27T21:33:46.268274] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-27T21:33:46.268345] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-27T21:33:46.270526] [DEBUG] [LOCAL ] TROX: Trimmed 74219 records to 52161 (keeping 200 days of data) [2025-10-27T21:33:46.626022] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T21:33:46.652409] [DEBUG] [LOCAL ] TROX: Primary data saved (52161 records). [2025-10-27T21:33:46.653037] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-27T21:33:46.653531] [INFO ] [MAIN ] Update Progress: 2128/2366 symbols completed. TROX took 33.8s. Estimated remaining: 30m 37s. Rate: 7.8 symbols/min [2025-10-27T21:33:46.817534] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-27T21:33:46.842593] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:46.891523] [DEBUG] [LOCAL ] TRV: Loaded 48221 existing records from primary storage. [2025-10-27T21:33:46.892012] [INFO ] [MAIN ] TRV: Loaded 48221 existing records. [2025-10-27T21:33:47.080284] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:47.080556] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-27T21:33:47.080607] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-27T21:33:47.080867] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-27T21:33:47.080921] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-27T21:33:47.459505] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:47.493398] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T21:33:47.614917] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-27T21:33:47.768522] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T21:33:48.414943] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-27T21:33:49.001868] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T21:33:49.215112] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-27T21:33:49.843473] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T21:33:50.015022] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-27T21:33:50.478239] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:33:50.814995] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-27T21:33:51.404376] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T21:33:51.614966] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-27T21:33:52.110823] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-27T21:33:52.414956] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-27T21:33:53.047704] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-27T21:33:53.214975] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-27T21:33:53.857998] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:33:54.014919] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-27T21:33:54.215720] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T21:33:54.814935] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-27T21:33:55.494295] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T21:33:55.614942] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-27T21:33:55.696990] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T21:33:55.703573] [INFO ] [REMOTE ] TRTX: Full fetch complete (52956 records). [2025-10-27T21:33:55.703746] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-27T21:33:56.087486] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-27T21:33:56.087578] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-27T21:33:56.088681] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-27T21:33:56.088747] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-27T21:33:56.089953] [DEBUG] [LOCAL ] TRTX: Trimmed 52956 records to 36394 (keeping 200 days of data) [2025-10-27T21:33:56.299914] [DEBUG] [LOCAL ] TRTX: Primary data saved (36394 records). [2025-10-27T21:33:56.300055] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-27T21:33:56.300133] [INFO ] [MAIN ] Update Progress: 2129/2366 symbols completed. TRTX took 25.6s. Estimated remaining: 30m 29s. Rate: 7.8 symbols/min [2025-10-27T21:33:56.420020] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-27T21:33:56.471067] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:56.517708] [DEBUG] [LOCAL ] TS: Loaded 52416 existing records from primary storage. [2025-10-27T21:33:56.518054] [INFO ] [MAIN ] TS: Loaded 52416 existing records. [2025-10-27T21:33:56.696772] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:56.696985] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-27T21:33:56.697042] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-27T21:33:56.697225] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-27T21:33:56.697266] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-27T21:33:57.045910] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:57.214934] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-27T21:33:57.423529] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T21:33:58.014931] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-27T21:33:58.094143] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T21:33:58.106859] [INFO ] [REMOTE ] TRP: Full fetch complete (75803 records). [2025-10-27T21:33:58.107146] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-27T21:33:58.499299] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-27T21:33:58.499505] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-27T21:33:58.500733] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-27T21:33:58.500797] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-27T21:33:58.502351] [DEBUG] [LOCAL ] TRP: Trimmed 75803 records to 52114 (keeping 200 days of data) [2025-10-27T21:33:58.819603] [DEBUG] [LOCAL ] TRP: Primary data saved (52114 records). [2025-10-27T21:33:58.816432] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-27T21:33:58.819770] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-27T21:33:58.829602] [INFO ] [MAIN ] Update Progress: 2130/2366 symbols completed. TRP took 31.4s. Estimated remaining: 30m 21s. Rate: 7.8 symbols/min [2025-10-27T21:33:58.921087] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:33:59.025113] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:33:59.053114] [DEBUG] [LOCAL ] TSE: Loaded 28300 existing records from primary storage. [2025-10-27T21:33:59.053384] [INFO ] [MAIN ] TSE: Loaded 28300 existing records. [2025-10-27T21:33:59.237428] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:33:59.237610] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-27T21:33:59.237692] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-27T21:33:59.237882] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-27T21:33:59.237921] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-27T21:33:59.607618] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:33:59.614899] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-27T21:33:59.731185] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T21:33:59.999944] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T21:34:00.414942] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-27T21:34:00.624834] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T21:34:01.214951] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-27T21:34:02.014943] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-27T21:34:02.150621] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-27T21:34:02.814976] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-27T21:34:03.013359] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-27T21:34:03.614914] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-27T21:34:03.689585] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T21:34:04.230137] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T21:34:04.414907] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-27T21:34:04.845526] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T21:34:05.214907] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-27T21:34:05.949472] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-27T21:34:06.014907] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-27T21:34:06.798630] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T21:34:06.808838] [INFO ] [REMOTE ] TRU: Full fetch complete (74227 records). [2025-10-27T21:34:06.808994] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-27T21:34:06.820795] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-27T21:34:07.209263] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-27T21:34:07.209368] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-27T21:34:07.210699] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-27T21:34:07.210772] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-27T21:34:07.212374] [DEBUG] [LOCAL ] TRU: Trimmed 74227 records to 51446 (keeping 200 days of data) [2025-10-27T21:34:07.546324] [DEBUG] [LOCAL ] TRU: Primary data saved (51446 records). [2025-10-27T21:34:07.546464] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-27T21:34:07.550193] [INFO ] [MAIN ] Update Progress: 2131/2366 symbols completed. TRU took 35.3s. Estimated remaining: 30m 13s. Rate: 7.8 symbols/min [2025-10-27T21:34:07.619869] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-27T21:34:07.742194] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:07.759958] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T21:34:07.780436] [DEBUG] [LOCAL ] TSI: Loaded 8268 existing records from primary storage. [2025-10-27T21:34:07.780709] [INFO ] [MAIN ] TSI: Loaded 8268 existing records. [2025-10-27T21:34:07.976039] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:07.976476] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-27T21:34:07.976545] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-27T21:34:07.976782] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-27T21:34:07.976847] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-27T21:34:08.373441] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:08.368415] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:34:08.414899] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-27T21:34:08.904700] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:34:09.214925] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-27T21:34:09.662480] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-27T21:34:10.014943] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-27T21:34:10.375914] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:34:10.814928] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-27T21:34:10.977220] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T21:34:11.614927] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-27T21:34:12.281567] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T21:34:12.414944] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-27T21:34:13.214953] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-27T21:34:13.356021] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-27T21:34:13.757617] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T21:34:14.014943] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-27T21:34:14.116508] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T21:34:14.814911] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-27T21:34:14.835085] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T21:34:15.614937] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-27T21:34:16.380997] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T21:34:16.414902] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-27T21:34:16.445170] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-27T21:34:17.214974] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-27T21:34:17.730787] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:34:18.014988] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-27T21:34:18.215354] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-27T21:34:18.434952] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T21:34:18.814978] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-27T21:34:19.614970] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-27T21:34:20.052801] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T21:34:20.156816] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-27T21:34:20.414940] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-27T21:34:20.906878] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-27T21:34:21.214948] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-27T21:34:22.014956] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-27T21:34:22.815832] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T21:34:22.815946] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-27T21:34:23.257666] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-27T21:34:23.374839] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-27T21:34:23.614954] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-27T21:34:24.414937] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-27T21:34:24.577961] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-27T21:34:24.583511] [INFO ] [REMOTE ] TSE: Full fetch complete (40993 records). [2025-10-27T21:34:24.583597] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-27T21:34:24.955242] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-27T21:34:24.955333] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-27T21:34:24.956163] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-27T21:34:24.956227] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-27T21:34:24.957219] [DEBUG] [LOCAL ] TSE: Trimmed 40993 records to 27721 (keeping 200 days of data) [2025-10-27T21:34:25.112011] [DEBUG] [LOCAL ] TSE: Primary data saved (27721 records). [2025-10-27T21:34:25.112129] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-27T21:34:25.112206] [INFO ] [MAIN ] Update Progress: 2132/2366 symbols completed. TSE took 26.3s. Estimated remaining: 30m 7s. Rate: 7.8 symbols/min [2025-10-27T21:34:25.224158] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-27T21:34:25.295863] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:25.330394] [DEBUG] [LOCAL ] TSLX: Loaded 36286 existing records from primary storage. [2025-10-27T21:34:25.330691] [INFO ] [MAIN ] TSLX: Loaded 36286 existing records. [2025-10-27T21:34:25.501475] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:25.501706] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-27T21:34:25.501765] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-27T21:34:25.501981] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-27T21:34:25.502066] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-27T21:34:25.801834] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-27T21:34:25.870205] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:25.974179] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T21:34:26.014940] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-27T21:34:26.814975] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-27T21:34:27.146831] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:34:27.614978] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-27T21:34:28.138689] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T21:34:28.154435] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-27T21:34:28.414929] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-27T21:34:29.214978] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-27T21:34:29.728072] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:34:29.742795] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-27T21:34:29.745578] [INFO ] [REMOTE ] TSI: Full fetch complete (13893 records). [2025-10-27T21:34:29.745712] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-27T21:34:30.022121] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-27T21:34:30.105623] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-27T21:34:30.105721] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-27T21:34:30.106031] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-27T21:34:30.106069] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-27T21:34:30.106549] [DEBUG] [LOCAL ] TSI: Trimmed 13893 records to 7984 (keeping 200 days of data) [2025-10-27T21:34:30.150722] [DEBUG] [LOCAL ] TSI: Primary data saved (7984 records). [2025-10-27T21:34:30.150818] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-27T21:34:30.150889] [INFO ] [MAIN ] Update Progress: 2133/2366 symbols completed. TSI took 22.6s. Estimated remaining: 29m 59s. Rate: 7.8 symbols/min [2025-10-27T21:34:30.335013] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:30.387850] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-27T21:34:30.388145] [INFO ] [MAIN ] TSM: Loaded 54599 existing records. [2025-10-27T21:34:30.563776] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:30.563949] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-27T21:34:30.563997] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-27T21:34:30.564201] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-27T21:34:30.564264] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-27T21:34:30.823292] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-27T21:34:30.910449] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:31.390589] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T21:34:31.400560] [INFO ] [REMOTE ] TS: Full fetch complete (74923 records). [2025-10-27T21:34:31.400729] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-27T21:34:31.622585] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-27T21:34:31.789992] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-27T21:34:31.790102] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-27T21:34:31.791249] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-27T21:34:31.791313] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-27T21:34:31.792801] [DEBUG] [LOCAL ] TS: Trimmed 74923 records to 51624 (keeping 200 days of data) [2025-10-27T21:34:32.090809] [DEBUG] [LOCAL ] TS: Primary data saved (51624 records). [2025-10-27T21:34:32.090926] [INFO ] [MAIN ] TS: Full history saved. [2025-10-27T21:34:32.090999] [INFO ] [MAIN ] Update Progress: 2134/2366 symbols completed. TS took 35.8s. Estimated remaining: 29m 50s. Rate: 7.8 symbols/min [2025-10-27T21:34:32.257319] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:32.304129] [DEBUG] [LOCAL ] TSN: Loaded 53854 existing records from primary storage. [2025-10-27T21:34:32.304424] [INFO ] [MAIN ] TSN: Loaded 53854 existing records. [2025-10-27T21:34:32.419412] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-27T21:34:32.481003] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T21:34:32.507455] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:32.516192] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-27T21:34:32.516893] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-27T21:34:32.517182] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-27T21:34:32.517236] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-27T21:34:32.867810] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:33.214966] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-27T21:34:33.604262] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-27T21:34:34.014926] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-27T21:34:34.391937] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T21:34:34.481486] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-27T21:34:34.814948] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-27T21:34:35.406255] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T21:34:35.614951] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-27T21:34:36.415011] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-27T21:34:36.881858] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T21:34:37.160966] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-27T21:34:37.214919] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-27T21:34:37.784941] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T21:34:37.794227] [INFO ] [REMOTE ] TRV: Full fetch complete (70022 records). [2025-10-27T21:34:37.794359] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-27T21:34:38.020140] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-27T21:34:38.189913] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-27T21:34:38.189996] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-27T21:34:38.191127] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-27T21:34:38.191196] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-27T21:34:38.192538] [DEBUG] [LOCAL ] TRV: Trimmed 70022 records to 47439 (keeping 200 days of data) [2025-10-27T21:34:38.490067] [DEBUG] [LOCAL ] TRV: Primary data saved (47439 records). [2025-10-27T21:34:38.490272] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-27T21:34:38.490381] [INFO ] [MAIN ] Update Progress: 2135/2366 symbols completed. TRV took 51.8s. Estimated remaining: 29m 43s. Rate: 7.8 symbols/min [2025-10-27T21:34:38.689386] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:38.701539] [DEBUG] [LOCAL ] TSQ: Loaded 11871 existing records from primary storage. [2025-10-27T21:34:38.701792] [INFO ] [MAIN ] TSQ: Loaded 11871 existing records. [2025-10-27T21:34:38.816237] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-27T21:34:38.907155] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:38.907426] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-27T21:34:38.907595] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-27T21:34:38.907950] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-27T21:34:38.908163] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-27T21:34:39.052399] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T21:34:39.336303] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:39.403123] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T21:34:39.614940] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-27T21:34:40.414926] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-27T21:34:40.428993] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T21:34:41.214932] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-27T21:34:41.648938] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-27T21:34:41.758044] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-10-27T21:34:42.014948] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-27T21:34:42.091289] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T21:34:42.764546] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-27T21:34:42.814997] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-27T21:34:43.614942] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-27T21:34:44.101463] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T21:34:44.103562] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T21:34:44.414982] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-27T21:34:45.214990] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-27T21:34:45.427103] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T21:34:46.014967] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-27T21:34:46.814915] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-27T21:34:46.980759] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T21:34:47.184367] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T21:34:47.335813] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T21:34:47.614962] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-27T21:34:48.414994] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-27T21:34:49.214997] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-27T21:34:49.700829] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-27T21:34:50.014962] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-27T21:34:50.225814] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-27T21:34:50.276119] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-27T21:34:50.814905] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-27T21:34:51.284391] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T21:34:51.384133] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T21:34:51.614982] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-27T21:34:52.414946] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-27T21:34:53.214944] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-27T21:34:53.767631] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T21:34:53.798082] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T21:34:53.806928] [INFO ] [REMOTE ] TSLX: Full fetch complete (51067 records). [2025-10-27T21:34:53.807157] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-27T21:34:54.017041] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-27T21:34:54.259639] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-27T21:34:54.259860] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-27T21:34:54.261626] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-27T21:34:54.261812] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-27T21:34:54.263824] [DEBUG] [LOCAL ] TSLX: Trimmed 51067 records to 35550 (keeping 200 days of data) [2025-10-27T21:34:54.522803] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-10-27T21:34:54.555081] [DEBUG] [LOCAL ] TSLX: Primary data saved (35550 records). [2025-10-27T21:34:54.555291] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-27T21:34:54.555675] [INFO ] [MAIN ] Update Progress: 2136/2366 symbols completed. TSLX took 29.4s. Estimated remaining: 29m 36s. Rate: 7.8 symbols/min [2025-10-27T21:34:54.685478] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T21:34:54.747713] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:54.791077] [DEBUG] [LOCAL ] TT: Loaded 47694 existing records from primary storage. [2025-10-27T21:34:54.791431] [INFO ] [MAIN ] TT: Loaded 47694 existing records. [2025-10-27T21:34:54.814945] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-27T21:34:54.986762] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:34:54.987044] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-27T21:34:54.987119] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-27T21:34:54.987583] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-27T21:34:54.987672] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-27T21:34:55.328473] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:55.614939] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-27T21:34:56.414932] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-27T21:34:56.792933] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-27T21:34:57.008321] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-27T21:34:57.010905] [INFO ] [REMOTE ] TSQ: Full fetch complete (16401 records). [2025-10-27T21:34:57.010975] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-27T21:34:57.224391] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-27T21:34:57.401027] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-27T21:34:57.401133] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-27T21:34:57.401580] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-27T21:34:57.401791] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-27T21:34:57.402555] [DEBUG] [LOCAL ] TSQ: Trimmed 16401 records to 11751 (keeping 200 days of data) [2025-10-27T21:34:57.474948] [DEBUG] [LOCAL ] TSQ: Primary data saved (11751 records). [2025-10-27T21:34:57.475211] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-27T21:34:57.475333] [INFO ] [MAIN ] Update Progress: 2137/2366 symbols completed. TSQ took 19.0s. Estimated remaining: 29m 28s. Rate: 7.8 symbols/min [2025-10-27T21:34:57.609567] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-27T21:34:57.691629] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:34:57.691826] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-27T21:34:57.691866] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-27T21:34:57.691977] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-27T21:34:57.692018] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-27T21:34:57.692059] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-27T21:34:57.692091] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-27T21:34:58.020179] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-27T21:34:58.067982] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:34:58.815031] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-27T21:34:59.192522] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-27T21:34:59.614945] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-10-27T21:34:59.815485] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:34:59.815864] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-10-27T21:34:59.815952] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:34:59.815998] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-27T21:34:59.816066] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:34:59.816135] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-27T21:34:59.816196] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-27T21:34:59.816232] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-27T21:34:59.816271] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-27T21:34:59.816338] [INFO ] [MAIN ] Update Progress: 2138/2366 symbols completed. TTAM took 2.3s. Estimated remaining: 29m 19s. Rate: 7.8 symbols/min [2025-10-27T21:34:59.991399] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:00.031702] [DEBUG] [LOCAL ] TTC: Loaded 42012 existing records from primary storage. [2025-10-27T21:35:00.032118] [INFO ] [MAIN ] TTC: Loaded 42012 existing records. [2025-10-27T21:35:00.216077] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:00.216507] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-27T21:35:00.216583] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-27T21:35:00.216884] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-27T21:35:00.216957] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-27T21:35:00.350523] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-27T21:35:00.420329] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-27T21:35:00.628451] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:00.655390] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T21:35:00.907774] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:35:01.214948] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-27T21:35:02.015011] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-27T21:35:02.815053] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-27T21:35:03.165818] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T21:35:03.615060] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-27T21:35:03.810858] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-27T21:35:04.415028] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-27T21:35:04.656033] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-27T21:35:05.214912] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-27T21:35:05.315855] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T21:35:05.326263] [INFO ] [REMOTE ] TSN: Full fetch complete (76681 records). [2025-10-27T21:35:05.326408] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-27T21:35:05.709400] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-27T21:35:05.709475] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-27T21:35:05.710630] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-27T21:35:05.710711] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-27T21:35:05.712093] [DEBUG] [LOCAL ] TSN: Trimmed 76681 records to 53088 (keeping 200 days of data) [2025-10-27T21:35:06.016177] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-27T21:35:06.028153] [DEBUG] [LOCAL ] TSN: Primary data saved (53088 records). [2025-10-27T21:35:06.028277] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-27T21:35:06.028355] [INFO ] [MAIN ] Update Progress: 2139/2366 symbols completed. TSN took 33.9s. Estimated remaining: 29m 11s. Rate: 7.8 symbols/min [2025-10-27T21:35:06.197204] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:06.245215] [DEBUG] [LOCAL ] TTE: Loaded 52265 existing records from primary storage. [2025-10-27T21:35:06.245508] [INFO ] [MAIN ] TTE: Loaded 52265 existing records. [2025-10-27T21:35:06.423472] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:06.423699] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-27T21:35:06.423755] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-27T21:35:06.424005] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-27T21:35:06.424061] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-27T21:35:06.788764] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:06.814904] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-27T21:35:06.855966] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-27T21:35:06.916397] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-27T21:35:07.614929] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-27T21:35:07.643390] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T21:35:08.111698] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-27T21:35:08.414973] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-27T21:35:09.214989] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-27T21:35:09.937964] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-27T21:35:10.003663] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-27T21:35:10.016559] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-27T21:35:10.721714] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T21:35:10.814964] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-27T21:35:11.342995] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T21:35:11.614996] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-27T21:35:12.415000] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-27T21:35:12.854324] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-27T21:35:12.864716] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-27T21:35:12.864870] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-27T21:35:13.221340] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-27T21:35:13.272263] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-27T21:35:13.272477] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-27T21:35:13.273884] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-27T21:35:13.274047] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-27T21:35:13.275620] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-27T21:35:13.414322] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T21:35:13.664543] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-27T21:35:13.664701] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-27T21:35:13.665257] [INFO ] [MAIN ] Update Progress: 2140/2366 symbols completed. TSM took 43.5s. Estimated remaining: 29m 4s. Rate: 7.8 symbols/min [2025-10-27T21:35:13.835005] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:13.879194] [DEBUG] [LOCAL ] TTI: Loaded 47416 existing records from primary storage. [2025-10-27T21:35:13.879563] [INFO ] [MAIN ] TTI: Loaded 47416 existing records. [2025-10-27T21:35:14.030040] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-27T21:35:14.055748] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-27T21:35:14.086749] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:14.095544] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-27T21:35:14.095776] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-27T21:35:14.096519] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-27T21:35:14.096578] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-27T21:35:14.449663] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:14.618958] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T21:35:14.815007] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-27T21:35:15.614989] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-27T21:35:16.294688] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T21:35:16.414929] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-27T21:35:16.599917] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T21:35:16.815027] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T21:35:17.214936] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-27T21:35:17.878866] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T21:35:18.014999] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-27T21:35:18.593125] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T21:35:18.814990] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-27T21:35:19.193699] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:35:19.615063] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-27T21:35:20.414994] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-27T21:35:20.490941] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T21:35:21.220333] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-27T21:35:21.232548] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-27T21:35:21.612934] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:35:22.014971] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-27T21:35:22.820105] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-27T21:35:22.841846] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-27T21:35:23.496753] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T21:35:23.614944] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-27T21:35:23.991888] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:35:24.414956] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-27T21:35:25.214949] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-27T21:35:25.438934] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T21:35:25.529280] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-27T21:35:26.015003] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-27T21:35:26.230148] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T21:35:26.814946] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-27T21:35:27.288956] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T21:35:27.614966] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-27T21:35:28.414979] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-27T21:35:28.489583] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-27T21:35:28.498309] [INFO ] [REMOTE ] TT: Full fetch complete (69896 records). [2025-10-27T21:35:28.498430] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-27T21:35:28.890789] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-27T21:35:28.890918] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-27T21:35:28.892181] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-27T21:35:28.892276] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-27T21:35:28.893699] [DEBUG] [LOCAL ] TT: Trimmed 69896 records to 46868 (keeping 200 days of data) [2025-10-27T21:35:29.150950] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T21:35:29.216668] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-27T21:35:29.229529] [DEBUG] [LOCAL ] TT: Primary data saved (46868 records). [2025-10-27T21:35:29.229778] [INFO ] [MAIN ] TT: Full history saved. [2025-10-27T21:35:29.229883] [INFO ] [MAIN ] Update Progress: 2141/2366 symbols completed. TT took 34.7s. Estimated remaining: 28m 57s. Rate: 7.8 symbols/min [2025-10-27T21:35:29.404686] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:29.456115] [DEBUG] [LOCAL ] TU: Loaded 50476 existing records from primary storage. [2025-10-27T21:35:29.456472] [INFO ] [MAIN ] TU: Loaded 50476 existing records. [2025-10-27T21:35:29.660305] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:29.660511] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-27T21:35:29.660556] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-27T21:35:29.660792] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-27T21:35:29.660848] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-27T21:35:30.016416] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:30.016473] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-27T21:35:30.123834] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T21:35:30.791783] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:35:30.814949] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-27T21:35:30.944357] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T21:35:30.952034] [INFO ] [REMOTE ] TTC: Full fetch complete (61671 records). [2025-10-27T21:35:30.952193] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-27T21:35:31.335868] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-27T21:35:31.335946] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-27T21:35:31.337167] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-27T21:35:31.337234] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-27T21:35:31.338504] [DEBUG] [LOCAL ] TTC: Trimmed 61671 records to 41166 (keeping 200 days of data) [2025-10-27T21:35:31.589156] [DEBUG] [LOCAL ] TTC: Primary data saved (41166 records). [2025-10-27T21:35:31.589275] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-27T21:35:31.589351] [INFO ] [MAIN ] Update Progress: 2142/2366 symbols completed. TTC took 31.8s. Estimated remaining: 28m 48s. Rate: 7.8 symbols/min [2025-10-27T21:35:31.620227] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-27T21:35:31.762975] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:31.804444] [DEBUG] [LOCAL ] TUYA: Loaded 46333 existing records from primary storage. [2025-10-27T21:35:31.804758] [INFO ] [MAIN ] TUYA: Loaded 46333 existing records. [2025-10-27T21:35:31.996526] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:31.996845] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-27T21:35:31.996920] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-27T21:35:31.997176] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-27T21:35:31.997242] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-27T21:35:32.371144] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:32.419999] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-27T21:35:32.435340] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T21:35:32.856955] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T21:35:33.214951] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-27T21:35:33.729488] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T21:35:34.014953] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-27T21:35:34.769503] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T21:35:34.814918] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-27T21:35:35.032783] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T21:35:35.614952] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-27T21:35:36.415004] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-27T21:35:36.903327] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-27T21:35:37.215018] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-27T21:35:37.529963] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-27T21:35:37.644077] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T21:35:38.014965] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-27T21:35:38.814955] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-27T21:35:38.920616] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T21:35:39.263615] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T21:35:39.614988] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-27T21:35:39.948072] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T21:35:40.414971] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-27T21:35:40.930521] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T21:35:41.214938] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-27T21:35:41.827556] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T21:35:42.014994] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-27T21:35:42.813432] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-27T21:35:42.822829] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-27T21:35:43.332366] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T21:35:43.342460] [INFO ] [REMOTE ] TTE: Full fetch complete (75003 records). [2025-10-27T21:35:43.342603] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-27T21:35:43.620020] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-27T21:35:43.747371] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-27T21:35:43.747459] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-27T21:35:43.748721] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-27T21:35:43.748785] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-27T21:35:43.750170] [DEBUG] [LOCAL ] TTE: Trimmed 75003 records to 51464 (keeping 200 days of data) [2025-10-27T21:35:44.057444] [DEBUG] [LOCAL ] TTE: Primary data saved (51464 records). [2025-10-27T21:35:44.057689] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-27T21:35:44.057805] [INFO ] [MAIN ] Update Progress: 2143/2366 symbols completed. TTE took 38.0s. Estimated remaining: 28m 41s. Rate: 7.8 symbols/min [2025-10-27T21:35:44.234634] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:44.261915] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-27T21:35:44.272261] [INFO ] [REMOTE ] TTI: Full fetch complete (66639 records). [2025-10-27T21:35:44.272490] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-27T21:35:44.419532] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-27T21:35:44.620302] [DEBUG] [LOCAL ] TV: Loaded 41765 existing records from primary storage. [2025-10-27T21:35:44.620611] [INFO ] [MAIN ] TV: Loaded 41765 existing records. [2025-10-27T21:35:44.841071] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-27T21:35:44.846351] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-27T21:35:44.872513] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-27T21:35:44.902547] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-27T21:35:44.902458] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:44.902756] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-27T21:35:44.902942] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-27T21:35:44.903142] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-27T21:35:44.903344] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-27T21:35:44.993081] [DEBUG] [LOCAL ] TTI: Trimmed 66639 records to 46694 (keeping 200 days of data) [2025-10-27T21:35:45.381085] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:45.406058] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-27T21:35:45.512565] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-27T21:35:45.609250] [DEBUG] [LOCAL ] TTI: Primary data saved (46694 records). [2025-10-27T21:35:45.609436] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-27T21:35:45.610778] [INFO ] [MAIN ] Update Progress: 2144/2366 symbols completed. TTI took 31.9s. Estimated remaining: 28m 33s. Rate: 7.8 symbols/min [2025-10-27T21:35:45.884517] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:45.891976] [DEBUG] [LOCAL ] TVC: Loaded 3130 existing records from primary storage. [2025-10-27T21:35:45.892239] [INFO ] [MAIN ] TVC: Loaded 3130 existing records. [2025-10-27T21:35:46.018168] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-27T21:35:46.166961] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:46.167396] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-27T21:35:46.167581] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-27T21:35:46.167922] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-27T21:35:46.167998] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-27T21:35:46.391181] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T21:35:46.652886] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:46.680360] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-27T21:35:46.814958] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-27T21:35:47.371319] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T21:35:47.614936] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-27T21:35:48.414970] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-27T21:35:48.607557] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-27T21:35:49.027182] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T21:35:49.144196] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-27T21:35:49.214920] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-27T21:35:49.660019] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-27T21:35:50.014934] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-27T21:35:50.814947] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-27T21:35:51.189493] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T21:35:51.203990] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-27T21:35:51.614948] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-27T21:35:52.414942] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-27T21:35:53.022218] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-27T21:35:53.214935] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-27T21:35:53.583207] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:35:54.014944] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-27T21:35:54.455367] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:35:54.814949] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-27T21:35:55.417256] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T21:35:55.425520] [INFO ] [REMOTE ] TUYA: Full fetch complete (67091 records). [2025-10-27T21:35:55.425626] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-27T21:35:55.626067] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-27T21:35:55.808549] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-27T21:35:55.808620] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-27T21:35:55.809705] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-27T21:35:55.809766] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-27T21:35:55.810998] [DEBUG] [LOCAL ] TUYA: Trimmed 67091 records to 45538 (keeping 200 days of data) [2025-10-27T21:35:56.065261] [DEBUG] [LOCAL ] TUYA: Primary data saved (45538 records). [2025-10-27T21:35:56.065431] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-27T21:35:56.065636] [INFO ] [MAIN ] Update Progress: 2145/2366 symbols completed. TUYA took 24.5s. Estimated remaining: 28m 25s. Rate: 7.8 symbols/min [2025-10-27T21:35:56.206034] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:35:56.284854] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:35:56.290185] [DEBUG] [LOCAL ] TVE: Loaded 2565 existing records from primary storage. [2025-10-27T21:35:56.290342] [INFO ] [MAIN ] TVE: Loaded 2565 existing records. [2025-10-27T21:35:56.420033] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-27T21:35:56.483416] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:35:56.483599] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-27T21:35:56.483669] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-27T21:35:56.483822] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-27T21:35:56.483859] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-27T21:35:56.830018] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:35:56.991129] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T21:35:57.076349] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-27T21:35:57.215011] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-27T21:35:58.015014] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-27T21:35:58.262692] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T21:35:58.814981] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-27T21:35:59.385045] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-27T21:35:59.394961] [INFO ] [REMOTE ] TU: Full fetch complete (72823 records). [2025-10-27T21:35:59.395167] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-27T21:35:59.621959] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-27T21:35:59.806324] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-27T21:35:59.806429] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-27T21:35:59.808474] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-27T21:35:59.808559] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-27T21:35:59.810622] [DEBUG] [LOCAL ] TU: Trimmed 72823 records to 49690 (keeping 200 days of data) [2025-10-27T21:36:00.121304] [DEBUG] [LOCAL ] TU: Primary data saved (49690 records). [2025-10-27T21:36:00.121545] [INFO ] [MAIN ] TU: Full history saved. [2025-10-27T21:36:00.122228] [INFO ] [MAIN ] Update Progress: 2146/2366 symbols completed. TU took 30.9s. Estimated remaining: 28m 17s. Rate: 7.8 symbols/min [2025-10-27T21:36:00.291052] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:00.297459] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T21:36:00.328268] [DEBUG] [LOCAL ] TWI: Loaded 34221 existing records from primary storage. [2025-10-27T21:36:00.328619] [INFO ] [MAIN ] TWI: Loaded 34221 existing records. [2025-10-27T21:36:00.428617] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-27T21:36:00.483579] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T21:36:00.553300] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:00.553724] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-27T21:36:00.553788] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-27T21:36:00.554407] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-27T21:36:00.554466] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-27T21:36:00.897587] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:01.017982] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T21:36:01.214948] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-27T21:36:02.014985] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-27T21:36:02.555183] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:36:02.814963] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-27T21:36:03.172261] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-27T21:36:03.441120] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:36:03.614994] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-27T21:36:04.172635] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T21:36:04.414993] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-27T21:36:05.215001] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-27T21:36:05.415213] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-27T21:36:05.575257] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T21:36:06.014943] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-27T21:36:06.397536] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T21:36:06.814983] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-27T21:36:07.254662] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-27T21:36:07.614941] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-27T21:36:08.116000] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T21:36:08.414952] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-27T21:36:09.214955] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-27T21:36:09.867144] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T21:36:09.894533] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T21:36:10.014962] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-27T21:36:10.466397] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-27T21:36:10.814937] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-27T21:36:11.215007] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T21:36:11.614944] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-27T21:36:11.945029] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-27T21:36:12.414942] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-27T21:36:12.802193] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-27T21:36:13.214949] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-27T21:36:14.014945] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-27T21:36:14.528792] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-27T21:36:14.814945] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-27T21:36:15.388388] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T21:36:15.614969] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-27T21:36:15.804852] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-27T21:36:15.812339] [INFO ] [REMOTE ] TV: Full fetch complete (60760 records). [2025-10-27T21:36:15.812456] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-27T21:36:15.994766] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T21:36:16.019944] [INFO ] [REMOTE ] TVE: Full fetch complete (4194 records). [2025-10-27T21:36:16.060532] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-27T21:36:16.420190] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-27T21:36:16.441253] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-27T21:36:16.472242] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-27T21:36:16.486179] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-27T21:36:16.497748] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-27T21:36:16.520669] [DEBUG] [LOCAL ] TV: Trimmed 60760 records to 41039 (keeping 200 days of data) [2025-10-27T21:36:16.642681] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-27T21:36:16.652104] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-27T21:36:16.678061] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-27T21:36:16.678492] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-27T21:36:16.710831] [DEBUG] [LOCAL ] TVE: Trimmed 4194 records to 2496 (keeping 200 days of data) [2025-10-27T21:36:16.780820] [DEBUG] [LOCAL ] TVE: Primary data saved (2496 records). [2025-10-27T21:36:16.807178] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-27T21:36:16.807281] [INFO ] [MAIN ] Update Progress: 2147/2366 symbols completed. TVE took 20.7s. Estimated remaining: 28m 11s. Rate: 7.8 symbols/min [2025-10-27T21:36:16.954808] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-27T21:36:16.951557] [DEBUG] [LOCAL ] TV: Primary data saved (41039 records). [2025-10-27T21:36:16.956693] [INFO ] [MAIN ] TV: Full history saved. [2025-10-27T21:36:16.962182] [INFO ] [MAIN ] Update Progress: 2148/2366 symbols completed. TV took 32.9s. Estimated remaining: 28m 2s. Rate: 7.8 symbols/min [2025-10-27T21:36:17.140264] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:17.194617] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:17.200464] [DEBUG] [LOCAL ] TWN: Loaded 3248 existing records from primary storage. [2025-10-27T21:36:17.201566] [INFO ] [MAIN ] TWN: Loaded 3248 existing records. [2025-10-27T21:36:17.221395] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-27T21:36:17.396877] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:17.397136] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-27T21:36:17.397191] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-27T21:36:17.397321] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-27T21:36:17.397359] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-27T21:36:17.535598] [DEBUG] [LOCAL ] TWLO: Loaded 53533 existing records from primary storage. [2025-10-27T21:36:17.559517] [INFO ] [MAIN ] TWLO: Loaded 53533 existing records. [2025-10-27T21:36:17.913952] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:17.964303] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-27T21:36:17.965163] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-27T21:36:17.968269] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:17.968681] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-27T21:36:17.968758] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-27T21:36:18.021721] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-27T21:36:18.326169] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:18.349045] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-27T21:36:18.452505] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:36:18.453853] [INFO ] [REMOTE ] TVC: Full fetch complete (4991 records). [2025-10-27T21:36:18.453925] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-27T21:36:18.823515] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-27T21:36:18.831588] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-27T21:36:18.831670] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-27T21:36:18.831852] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-27T21:36:18.831894] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-27T21:36:18.832258] [DEBUG] [LOCAL ] TVC: Trimmed 4991 records to 3032 (keeping 200 days of data) [2025-10-27T21:36:18.850587] [DEBUG] [LOCAL ] TVC: Primary data saved (3032 records). [2025-10-27T21:36:18.850672] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-27T21:36:18.850757] [INFO ] [MAIN ] Update Progress: 2149/2366 symbols completed. TVC took 33.2s. Estimated remaining: 27m 54s. Rate: 7.8 symbols/min [2025-10-27T21:36:19.021425] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:19.064849] [DEBUG] [LOCAL ] TWO: Loaded 49236 existing records from primary storage. [2025-10-27T21:36:19.065133] [INFO ] [MAIN ] TWO: Loaded 49236 existing records. [2025-10-27T21:36:19.235928] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:19.236186] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-27T21:36:19.236236] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-27T21:36:19.236414] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-27T21:36:19.236451] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-27T21:36:19.575295] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:19.614905] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-27T21:36:20.420066] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-27T21:36:20.436376] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-27T21:36:21.214946] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-27T21:36:21.334374] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-27T21:36:21.464916] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T21:36:22.014992] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-27T21:36:22.373311] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-27T21:36:22.814916] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-27T21:36:22.902309] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-27T21:36:23.614982] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-27T21:36:23.912756] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T21:36:24.414968] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-27T21:36:24.520409] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-27T21:36:25.214946] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-27T21:36:26.014953] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-27T21:36:26.046471] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T21:36:26.130919] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-27T21:36:26.567269] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T21:36:26.814946] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-27T21:36:27.614950] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-27T21:36:28.067263] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T21:36:28.249405] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:36:28.414988] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-27T21:36:29.215036] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-27T21:36:29.856342] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-27T21:36:30.014962] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-27T21:36:30.139355] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T21:36:30.395977] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T21:36:30.814948] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-27T21:36:31.614980] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-27T21:36:32.154776] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T21:36:32.414991] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-27T21:36:32.935247] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T21:36:33.214949] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-27T21:36:33.755258] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-27T21:36:34.014954] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-27T21:36:34.776005] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:36:34.814931] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-27T21:36:35.255177] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-27T21:36:35.614979] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-27T21:36:35.704085] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T21:36:35.711528] [INFO ] [REMOTE ] TWI: Full fetch complete (51841 records). [2025-10-27T21:36:35.711705] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-27T21:36:36.088358] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-27T21:36:36.088432] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-27T21:36:36.089332] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-27T21:36:36.089394] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-27T21:36:36.090347] [DEBUG] [LOCAL ] TWI: Trimmed 51841 records to 33404 (keeping 200 days of data) [2025-10-27T21:36:36.273101] [DEBUG] [LOCAL ] TWI: Primary data saved (33404 records). [2025-10-27T21:36:36.273243] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-27T21:36:36.273348] [INFO ] [MAIN ] Update Progress: 2150/2366 symbols completed. TWI took 36.2s. Estimated remaining: 27m 47s. Rate: 7.8 symbols/min [2025-10-27T21:36:36.418976] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-27T21:36:36.441755] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:36.442786] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-27T21:36:36.442850] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-27T21:36:36.442979] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-27T21:36:36.443026] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-27T21:36:36.443067] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-27T21:36:36.443097] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-27T21:36:36.792754] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:36.931931] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T21:36:37.215028] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-27T21:36:37.338159] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T21:36:37.571238] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T21:36:38.014958] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-27T21:36:38.602700] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T21:36:38.814962] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-27T21:36:39.243634] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-27T21:36:39.614945] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-27T21:36:40.161455] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T21:36:40.414944] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-27T21:36:40.830341] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T21:36:40.831798] [INFO ] [REMOTE ] TWN: Full fetch complete (5163 records). [2025-10-27T21:36:40.831865] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-27T21:36:41.183601] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-27T21:36:41.183696] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-27T21:36:41.183854] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-27T21:36:41.183892] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-27T21:36:41.184236] [DEBUG] [LOCAL ] TWN: Trimmed 5163 records to 3112 (keeping 200 days of data) [2025-10-27T21:36:41.201718] [DEBUG] [LOCAL ] TWN: Primary data saved (3112 records). [2025-10-27T21:36:41.201780] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-27T21:36:41.201846] [INFO ] [MAIN ] Update Progress: 2151/2366 symbols completed. TWN took 24.2s. Estimated remaining: 27m 39s. Rate: 7.8 symbols/min [2025-10-27T21:36:41.221582] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-10-27T21:36:41.370459] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:41.390972] [DEBUG] [LOCAL ] TX: Loaded 23413 existing records from primary storage. [2025-10-27T21:36:41.391221] [INFO ] [MAIN ] TX: Loaded 23413 existing records. [2025-10-27T21:36:41.488264] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:36:41.490998] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-10-27T21:36:41.501849] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:36:41.507084] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-27T21:36:41.512265] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:36:41.517460] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-27T21:36:41.548558] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-27T21:36:41.550205] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-27T21:36:41.550943] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-27T21:36:41.565389] [INFO ] [MAIN ] Update Progress: 2152/2366 symbols completed. TWOD took 5.3s. Estimated remaining: 27m 31s. Rate: 7.8 symbols/min [2025-10-27T21:36:41.581582] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:41.603448] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-27T21:36:41.615469] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-27T21:36:41.653119] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-27T21:36:41.675012] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-27T21:36:41.892139] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:42.017875] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-27T21:36:42.140263] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:42.154015] [DEBUG] [LOCAL ] TXNM: Loaded 43369 existing records from primary storage. [2025-10-27T21:36:42.154292] [INFO ] [MAIN ] TXNM: Loaded 43369 existing records. [2025-10-27T21:36:42.327842] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:42.328049] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-27T21:36:42.328101] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-27T21:36:42.328320] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-27T21:36:42.328359] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-27T21:36:42.673068] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:42.814949] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-27T21:36:43.614938] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-27T21:36:43.665441] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T21:36:43.751080] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T21:36:44.414943] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-27T21:36:44.732959] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-27T21:36:45.214921] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-27T21:36:45.655080] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T21:36:46.014938] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-27T21:36:46.540718] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-27T21:36:46.814959] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-27T21:36:46.849936] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-27T21:36:47.614942] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-27T21:36:48.414907] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-27T21:36:48.443517] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-27T21:36:48.503491] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-27T21:36:49.214950] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-27T21:36:50.014983] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-27T21:36:50.255799] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T21:36:50.814977] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-27T21:36:51.104847] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:36:51.114179] [INFO ] [REMOTE ] TWO: Full fetch complete (69277 records). [2025-10-27T21:36:51.114315] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-27T21:36:51.536499] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-27T21:36:51.539982] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-27T21:36:51.541312] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-27T21:36:51.541585] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-27T21:36:51.544759] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T21:36:51.555356] [DEBUG] [LOCAL ] TWO: Trimmed 69277 records to 48411 (keeping 200 days of data) [2025-10-27T21:36:51.615519] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-27T21:36:51.848929] [DEBUG] [LOCAL ] TWO: Primary data saved (48411 records). [2025-10-27T21:36:51.849070] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-27T21:36:51.849796] [INFO ] [MAIN ] Update Progress: 2153/2366 symbols completed. TWO took 33.0s. Estimated remaining: 27m 23s. Rate: 7.8 symbols/min [2025-10-27T21:36:52.012517] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:36:52.035534] [DEBUG] [LOCAL ] TXO: Loaded 20250 existing records from primary storage. [2025-10-27T21:36:52.035806] [INFO ] [MAIN ] TXO: Loaded 20250 existing records. [2025-10-27T21:36:52.211112] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:36:52.211465] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-27T21:36:52.211575] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-27T21:36:52.211817] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-27T21:36:52.211888] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-27T21:36:52.422020] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-27T21:36:52.582993] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-27T21:36:52.615722] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:36:52.652763] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T21:36:53.214937] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-27T21:36:53.998568] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-27T21:36:54.014917] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-27T21:36:54.763280] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T21:36:54.814903] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-27T21:36:55.615031] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-27T21:36:55.670358] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-27T21:36:56.164335] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-27T21:36:56.414950] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-27T21:36:56.807691] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-27T21:36:57.214914] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-27T21:36:57.598232] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:36:58.014988] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-27T21:36:58.240998] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T21:36:58.814928] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-27T21:36:59.029957] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T21:36:59.614940] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-27T21:37:00.418367] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-27T21:37:00.443660] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T21:37:00.453966] [INFO ] [REMOTE ] TWLO: Full fetch complete (76589 records). [2025-10-27T21:37:00.454074] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-27T21:37:00.663959] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T21:37:00.859984] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-27T21:37:00.860078] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-27T21:37:00.861318] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-27T21:37:00.861381] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-27T21:37:00.862927] [DEBUG] [LOCAL ] TWLO: Trimmed 76589 records to 52754 (keeping 200 days of data) [2025-10-27T21:37:01.169367] [DEBUG] [LOCAL ] TWLO: Primary data saved (52754 records). [2025-10-27T21:37:01.169494] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-27T21:37:01.169571] [INFO ] [MAIN ] Update Progress: 2154/2366 symbols completed. TWLO took 44.4s. Estimated remaining: 27m 16s. Rate: 7.8 symbols/min [2025-10-27T21:37:01.223267] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-27T21:37:01.341406] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:01.395938] [DEBUG] [LOCAL ] TXT: Loaded 50277 existing records from primary storage. [2025-10-27T21:37:01.396274] [INFO ] [MAIN ] TXT: Loaded 50277 existing records. [2025-10-27T21:37:01.562979] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-27T21:37:01.600607] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:01.601086] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-27T21:37:01.601169] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-27T21:37:01.601683] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-27T21:37:01.601739] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-27T21:37:01.962216] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:02.014995] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-27T21:37:02.604787] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-27T21:37:02.814935] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-27T21:37:02.905930] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T21:37:03.575128] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T21:37:03.614910] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-27T21:37:04.414916] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-27T21:37:04.444675] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T21:37:05.214933] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-27T21:37:05.773438] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-27T21:37:06.014965] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-27T21:37:06.337028] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:37:06.814987] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-27T21:37:07.502273] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T21:37:07.537987] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T21:37:07.615050] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-27T21:37:08.255105] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T21:37:08.414978] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-27T21:37:09.214953] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-27T21:37:09.438216] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T21:37:09.857206] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T21:37:09.861783] [INFO ] [REMOTE ] TX: Full fetch complete (35431 records). [2025-10-27T21:37:09.861861] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-27T21:37:10.033904] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-27T21:37:10.230524] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-27T21:37:10.230594] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-27T21:37:10.231306] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-27T21:37:10.231367] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-27T21:37:10.232098] [DEBUG] [LOCAL ] TX: Trimmed 35431 records to 22740 (keeping 200 days of data) [2025-10-27T21:37:10.363047] [DEBUG] [LOCAL ] TX: Primary data saved (22740 records). [2025-10-27T21:37:10.363210] [INFO ] [MAIN ] TX: Full history saved. [2025-10-27T21:37:10.363320] [INFO ] [MAIN ] Update Progress: 2155/2366 symbols completed. TX took 29.2s. Estimated remaining: 27m 8s. Rate: 7.8 symbols/min [2025-10-27T21:37:10.529735] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:10.539054] [DEBUG] [LOCAL ] TY: Loaded 7594 existing records from primary storage. [2025-10-27T21:37:10.539222] [INFO ] [MAIN ] TY: Loaded 7594 existing records. [2025-10-27T21:37:10.713586] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:10.713836] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-27T21:37:10.713882] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-27T21:37:10.714032] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-27T21:37:10.714086] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-27T21:37:10.828689] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-27T21:37:11.005358] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T21:37:11.087996] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:11.615018] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-27T21:37:12.284448] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-27T21:37:12.414950] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-27T21:37:12.979793] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:37:13.214931] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-27T21:37:13.362621] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T21:37:13.729323] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T21:37:14.014953] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-27T21:37:14.456948] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-27T21:37:14.814993] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-27T21:37:15.614932] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-27T21:37:16.295321] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-27T21:37:16.336934] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-27T21:37:16.414915] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-27T21:37:17.214938] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-27T21:37:17.960380] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T21:37:18.014949] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-27T21:37:18.244813] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T21:37:18.252461] [INFO ] [REMOTE ] TXNM: Full fetch complete (62682 records). [2025-10-27T21:37:18.252564] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-27T21:37:18.588360] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T21:37:18.643975] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-27T21:37:18.644050] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-27T21:37:18.645083] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-27T21:37:18.645144] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-27T21:37:18.646303] [DEBUG] [LOCAL ] TXNM: Trimmed 62682 records to 42554 (keeping 200 days of data) [2025-10-27T21:37:18.816244] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-27T21:37:18.904820] [DEBUG] [LOCAL ] TXNM: Primary data saved (42554 records). [2025-10-27T21:37:18.904952] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-27T21:37:18.905027] [INFO ] [MAIN ] Update Progress: 2156/2366 symbols completed. TXNM took 37.3s. Estimated remaining: 27m 0s. Rate: 7.8 symbols/min [2025-10-27T21:37:19.071732] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:19.087436] [DEBUG] [LOCAL ] TYG: Loaded 14185 existing records from primary storage. [2025-10-27T21:37:19.087701] [INFO ] [MAIN ] TYG: Loaded 14185 existing records. [2025-10-27T21:37:19.263969] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:19.264196] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-27T21:37:19.264241] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-27T21:37:19.264521] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-27T21:37:19.264578] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-27T21:37:19.614947] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-27T21:37:19.618600] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:20.359281] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T21:37:20.365715] [INFO ] [REMOTE ] TXO: Full fetch complete (27365 records). [2025-10-27T21:37:20.365843] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-27T21:37:20.416998] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-27T21:37:20.757243] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-27T21:37:20.766880] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-27T21:37:20.772698] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-27T21:37:20.783500] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-27T21:37:20.785693] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-27T21:37:20.795596] [DEBUG] [LOCAL ] TXO: Trimmed 27365 records to 19924 (keeping 200 days of data) [2025-10-27T21:37:20.917066] [DEBUG] [LOCAL ] TXO: Primary data saved (19924 records). [2025-10-27T21:37:20.917211] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-27T21:37:20.917291] [INFO ] [MAIN ] Update Progress: 2157/2366 symbols completed. TXO took 29.1s. Estimated remaining: 26m 52s. Rate: 7.8 symbols/min [2025-10-27T21:37:21.186242] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-27T21:37:21.214896] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-27T21:37:21.696259] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T21:37:22.014983] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-27T21:37:22.626935] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-27T21:37:22.814940] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-27T21:37:23.614951] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-27T21:37:24.269778] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-27T21:37:24.374051] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T21:37:24.414914] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-27T21:37:25.009372] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T21:37:25.214927] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-27T21:37:26.014969] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-27T21:37:26.037002] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-27T21:37:26.815024] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-27T21:37:26.885283] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T21:37:27.262528] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:37:27.614918] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-27T21:37:28.414970] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-27T21:37:28.457873] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-27T21:37:29.214957] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-27T21:37:29.945740] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-27T21:37:30.014993] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-27T21:37:30.209152] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-27T21:37:30.730397] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T21:37:30.814911] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-27T21:37:31.441025] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T21:37:31.615019] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-27T21:37:32.415989] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-27T21:37:32.419982] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T21:37:32.830988] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T21:37:33.214979] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-27T21:37:33.649073] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:37:33.651005] [INFO ] [REMOTE ] TY: Full fetch complete (11337 records). [2025-10-27T21:37:33.651081] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-27T21:37:34.005328] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-27T21:37:34.005404] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-27T21:37:34.005828] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-27T21:37:34.005890] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-27T21:37:34.006325] [DEBUG] [LOCAL ] TY: Trimmed 11337 records to 7414 (keeping 200 days of data) [2025-10-27T21:37:34.025037] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-27T21:37:34.052154] [DEBUG] [LOCAL ] TY: Primary data saved (7414 records). [2025-10-27T21:37:34.052284] [INFO ] [MAIN ] TY: Full history saved. [2025-10-27T21:37:34.052369] [INFO ] [MAIN ] Update Progress: 2158/2366 symbols completed. TY took 23.7s. Estimated remaining: 26m 45s. Rate: 7.8 symbols/min [2025-10-27T21:37:34.395148] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T21:37:34.814966] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-27T21:37:35.375305] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T21:37:35.378288] [INFO ] [REMOTE ] TYG: Full fetch complete (21891 records). [2025-10-27T21:37:35.378377] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-27T21:37:35.621527] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-27T21:37:35.739793] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-27T21:37:35.739862] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-27T21:37:35.740318] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-27T21:37:35.740356] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-27T21:37:35.740925] [DEBUG] [LOCAL ] TYG: Trimmed 21891 records to 13708 (keeping 200 days of data) [2025-10-27T21:37:35.821396] [DEBUG] [LOCAL ] TYG: Primary data saved (13708 records). [2025-10-27T21:37:35.821522] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-27T21:37:35.821607] [INFO ] [MAIN ] Update Progress: 2159/2366 symbols completed. TYG took 16.9s. Estimated remaining: 26m 37s. Rate: 7.8 symbols/min [2025-10-27T21:37:37.401415] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-27T21:37:37.411084] [INFO ] [REMOTE ] TXT: Full fetch complete (72517 records). [2025-10-27T21:37:37.411211] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-27T21:37:37.793708] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-27T21:37:37.793796] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-27T21:37:37.794909] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-27T21:37:37.794972] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-27T21:37:37.796427] [DEBUG] [LOCAL ] TXT: Trimmed 72517 records to 49510 (keeping 200 days of data) [2025-10-27T21:37:38.093253] [DEBUG] [LOCAL ] TXT: Primary data saved (49510 records). [2025-10-27T21:37:38.093379] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-27T21:37:38.093457] [INFO ] [MAIN ] Update Progress: 2160/2366 symbols completed. TXT took 36.9s. Estimated remaining: 26m 28s. Rate: 7.8 symbols/min [2025-10-27T21:37:38.663474] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:38.687394] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:38.776498] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:38.808160] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:38.827136] [DEBUG] [LOCAL ] TYL: Loaded 22275 existing records from primary storage. [2025-10-27T21:37:38.827624] [INFO ] [MAIN ] TYL: Loaded 22275 existing records. [2025-10-27T21:37:39.051080] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:39.066183] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-27T21:37:39.066387] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-27T21:37:39.067554] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-27T21:37:39.081878] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-27T21:37:39.067293] [DEBUG] [LOCAL ] UA: Loaded 51187 existing records from primary storage. [2025-10-27T21:37:39.107725] [INFO ] [MAIN ] UA: Loaded 51187 existing records. [2025-10-27T21:37:39.118214] [DEBUG] [LOCAL ] UAA: Loaded 54277 existing records from primary storage. [2025-10-27T21:37:39.137998] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-27T21:37:39.190287] [INFO ] [MAIN ] UAA: Loaded 54277 existing records. [2025-10-27T21:37:39.195737] [INFO ] [MAIN ] U: Loaded 54579 existing records. [2025-10-27T21:37:39.855470] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:39.836745] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:39.915928] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-27T21:37:39.910691] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-27T21:37:39.921384] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-27T21:37:39.940211] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-27T21:37:39.957765] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:39.958404] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-27T21:37:39.958531] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-27T21:37:39.958852] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-27T21:37:39.959047] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-27T21:37:39.959123] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-27T21:37:39.969901] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-27T21:37:40.043602] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-27T21:37:40.099557] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-27T21:37:40.149938] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:40.251421] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-27T21:37:41.027792] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:41.046205] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-27T21:37:41.213154] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:41.208342] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:41.213618] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-27T21:37:41.213899] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-27T21:37:41.228140] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T21:37:41.232270] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-27T21:37:42.007203] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:37:42.011492] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-27T21:37:42.475951] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T21:37:42.488276] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T21:37:42.489438] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-27T21:37:42.500776] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-27T21:37:43.192544] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-27T21:37:43.203005] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-27T21:37:43.297007] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T21:37:43.614954] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-27T21:37:43.740810] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T21:37:44.135199] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T21:37:44.414972] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-27T21:37:45.009119] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:37:45.214950] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-27T21:37:45.346114] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-27T21:37:45.678715] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T21:37:46.014900] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-27T21:37:46.382135] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T21:37:46.814994] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-27T21:37:47.488728] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T21:37:47.614931] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-27T21:37:47.797139] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-27T21:37:48.414926] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-27T21:37:48.945156] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-27T21:37:49.214943] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-27T21:37:50.014959] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-27T21:37:50.178305] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T21:37:50.820066] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-27T21:37:50.835708] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-27T21:37:51.614969] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-27T21:37:51.774735] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T21:37:52.086602] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-27T21:37:52.414989] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-27T21:37:53.214929] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-27T21:37:53.460623] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T21:37:53.920920] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-27T21:37:54.014963] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-27T21:37:54.633293] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T21:37:54.814919] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-27T21:37:55.553231] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T21:37:55.557718] [INFO ] [REMOTE ] TYL: Full fetch complete (31699 records). [2025-10-27T21:37:55.557862] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-27T21:37:55.620893] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-27T21:37:55.953734] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T21:37:56.002916] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-27T21:37:56.003023] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-27T21:37:56.003720] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-27T21:37:56.004118] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-27T21:37:56.005031] [DEBUG] [LOCAL ] TYL: Trimmed 31699 records to 21800 (keeping 200 days of data) [2025-10-27T21:37:56.135682] [DEBUG] [LOCAL ] TYL: Primary data saved (21800 records). [2025-10-27T21:37:56.135815] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-27T21:37:56.135891] [INFO ] [MAIN ] Update Progress: 2161/2366 symbols completed. TYL took 18.0s. Estimated remaining: 26m 22s. Rate: 7.8 symbols/min [2025-10-27T21:37:56.305753] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:37:56.312899] [DEBUG] [LOCAL ] UAN: Loaded 5387 existing records from primary storage. [2025-10-27T21:37:56.313064] [INFO ] [MAIN ] UAN: Loaded 5387 existing records. [2025-10-27T21:37:56.420101] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-27T21:37:56.487673] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:37:56.487841] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-27T21:37:56.487887] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-27T21:37:56.488020] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-27T21:37:56.488065] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-27T21:37:56.833825] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:37:57.214930] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-27T21:37:57.482192] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T21:37:58.014915] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-27T21:37:58.177843] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-27T21:37:58.814933] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-27T21:37:59.123585] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-27T21:37:59.242961] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T21:37:59.298332] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T21:37:59.614927] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-27T21:38:00.414912] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-27T21:38:01.214939] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-27T21:38:01.493728] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T21:38:01.726439] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-27T21:38:02.015031] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-27T21:38:02.814924] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-27T21:38:02.868804] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-27T21:38:03.243200] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-27T21:38:03.614929] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-27T21:38:03.828637] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T21:38:04.415002] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-27T21:38:05.214984] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-27T21:38:05.304850] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T21:38:05.854272] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-27T21:38:06.014951] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-27T21:38:06.138087] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T21:38:06.482617] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:38:06.814991] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-27T21:38:07.615005] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-27T21:38:08.160666] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:38:08.414946] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-27T21:38:09.229209] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-27T21:38:09.257025] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T21:38:09.875686] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-27T21:38:10.014963] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-27T21:38:10.196857] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T21:38:10.417436] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:38:10.814959] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-27T21:38:11.442203] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-27T21:38:11.614953] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-27T21:38:12.415016] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-27T21:38:13.214946] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-27T21:38:14.012855] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-27T21:38:14.023227] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-27T21:38:14.055433] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T21:38:14.066131] [INFO ] [REMOTE ] UAA: Full fetch complete (77641 records). [2025-10-27T21:38:14.066261] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-27T21:38:14.470723] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-27T21:38:14.471173] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-27T21:38:14.472714] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-27T21:38:14.472817] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-27T21:38:14.479432] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-27T21:38:14.481765] [DEBUG] [LOCAL ] UAA: Trimmed 77641 records to 53496 (keeping 200 days of data) [2025-10-27T21:38:14.605084] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T21:38:14.624271] [INFO ] [REMOTE ] UA: Full fetch complete (73218 records). [2025-10-27T21:38:14.625078] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-27T21:38:14.829470] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-27T21:38:15.162792] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-27T21:38:15.167304] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-27T21:38:15.169086] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-27T21:38:15.204353] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-27T21:38:15.249126] [DEBUG] [LOCAL ] UA: Trimmed 73218 records to 50395 (keeping 200 days of data) [2025-10-27T21:38:15.248953] [DEBUG] [LOCAL ] UAA: Primary data saved (53496 records). [2025-10-27T21:38:15.249614] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-27T21:38:15.249978] [INFO ] [MAIN ] Update Progress: 2162/2366 symbols completed. UAA took 37.2s. Estimated remaining: 26m 15s. Rate: 7.8 symbols/min [2025-10-27T21:38:15.592238] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:15.628018] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-27T21:38:15.738417] [DEBUG] [LOCAL ] UA: Primary data saved (50395 records). [2025-10-27T21:38:15.739207] [INFO ] [MAIN ] UA: Full history saved. [2025-10-27T21:38:15.739352] [INFO ] [MAIN ] Update Progress: 2163/2366 symbols completed. UA took 37.6s. Estimated remaining: 26m 7s. Rate: 7.8 symbols/min [2025-10-27T21:38:15.846909] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-27T21:38:15.857365] [INFO ] [MAIN ] UBER: Loaded 54586 existing records. [2025-10-27T21:38:16.052690] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:16.111337] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:16.111598] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-27T21:38:16.111678] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-27T21:38:16.111881] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-27T21:38:16.111922] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-27T21:38:16.231931] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T21:38:16.308794] [INFO ] [REMOTE ] UAN: Full fetch complete (7836 records). [2025-10-27T21:38:16.358852] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-27T21:38:16.569838] [DEBUG] [LOCAL ] UBS: Loaded 53024 existing records from primary storage. [2025-10-27T21:38:16.603966] [INFO ] [MAIN ] UBS: Loaded 53024 existing records. [2025-10-27T21:38:16.645202] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:16.675608] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-27T21:38:17.038078] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:17.099899] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-27T21:38:17.100120] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-27T21:38:17.100046] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-27T21:38:17.100605] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-27T21:38:17.100478] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-27T21:38:17.100759] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-27T21:38:17.100868] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-27T21:38:17.101302] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-27T21:38:17.101382] [DEBUG] [LOCAL ] UAN: Trimmed 7836 records to 5101 (keeping 200 days of data) [2025-10-27T21:38:17.246022] [DEBUG] [LOCAL ] UAN: Primary data saved (5101 records). [2025-10-27T21:38:17.261686] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-27T21:38:17.291915] [INFO ] [MAIN ] Update Progress: 2164/2366 symbols completed. UAN took 21.2s. Estimated remaining: 25m 58s. Rate: 7.8 symbols/min [2025-10-27T21:38:17.527523] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-27T21:38:17.609419] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-27T21:38:17.653558] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-27T21:38:17.723751] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:17.789072] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:17.789725] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-27T21:38:18.136399] [DEBUG] [LOCAL ] UCB: Loaded 38273 existing records from primary storage. [2025-10-27T21:38:18.161168] [INFO ] [MAIN ] UCB: Loaded 38273 existing records. [2025-10-27T21:38:18.277618] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-27T21:38:18.287339] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-27T21:38:18.301733] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-27T21:38:18.306956] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-27T21:38:18.351976] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-27T21:38:18.470048] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:18.482199] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-27T21:38:18.509927] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-27T21:38:18.526548] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-27T21:38:18.526747] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-27T21:38:18.916267] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:18.963834] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-27T21:38:19.146258] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-27T21:38:19.147931] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-27T21:38:19.146923] [INFO ] [MAIN ] U: Full history saved. [2025-10-27T21:38:19.157947] [INFO ] [MAIN ] Update Progress: 2165/2366 symbols completed. U took 41.0s. Estimated remaining: 25m 50s. Rate: 7.8 symbols/min [2025-10-27T21:38:19.189756] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-27T21:38:19.332496] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:19.382346] [DEBUG] [LOCAL ] UDR: Loaded 52880 existing records from primary storage. [2025-10-27T21:38:19.395828] [INFO ] [MAIN ] UDR: Loaded 52880 existing records. [2025-10-27T21:38:19.523378] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-27T21:38:19.616363] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:19.616462] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-27T21:38:19.618087] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-27T21:38:19.618177] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-27T21:38:19.618372] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-27T21:38:19.618413] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-27T21:38:19.969776] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:20.415040] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-27T21:38:20.495554] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T21:38:20.912602] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:38:21.055504] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-27T21:38:21.214964] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-27T21:38:21.742475] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-27T21:38:22.014943] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-27T21:38:22.814911] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-27T21:38:23.177221] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T21:38:23.614972] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-27T21:38:23.729133] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-27T21:38:23.832300] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-27T21:38:24.414930] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-27T21:38:24.910312] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-27T21:38:25.214947] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-27T21:38:26.014939] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-27T21:38:26.564559] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-27T21:38:26.750255] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T21:38:26.814900] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-27T21:38:27.540569] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T21:38:27.614938] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-27T21:38:28.233182] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T21:38:28.414981] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-27T21:38:29.188848] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-27T21:38:29.214904] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-27T21:38:29.762290] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T21:38:30.014944] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-27T21:38:30.280786] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T21:38:30.814938] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-27T21:38:31.614954] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-27T21:38:32.230248] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-27T21:38:32.245823] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:38:32.414923] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-27T21:38:33.176777] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T21:38:33.214900] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-27T21:38:33.766046] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T21:38:34.014934] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-27T21:38:34.545063] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:38:34.814952] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-27T21:38:35.614951] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-27T21:38:36.377928] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T21:38:36.414897] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-27T21:38:36.695460] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-27T21:38:37.214951] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-27T21:38:37.593456] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-27T21:38:37.804277] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T21:38:38.015010] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-27T21:38:38.524849] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T21:38:38.814934] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-27T21:38:39.614990] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-27T21:38:40.216306] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T21:38:40.320440] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:38:40.414931] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-27T21:38:40.647243] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T21:38:40.654939] [INFO ] [REMOTE ] UCB: Full fetch complete (55070 records). [2025-10-27T21:38:40.655061] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-27T21:38:41.032868] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-27T21:38:41.032951] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-27T21:38:41.034076] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-27T21:38:41.034147] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-27T21:38:41.035444] [DEBUG] [LOCAL ] UCB: Trimmed 55070 records to 37432 (keeping 200 days of data) [2025-10-27T21:38:41.229733] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-27T21:38:41.266232] [DEBUG] [LOCAL ] UCB: Primary data saved (37432 records). [2025-10-27T21:38:41.266399] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-27T21:38:41.267212] [INFO ] [MAIN ] Update Progress: 2166/2366 symbols completed. UCB took 23.9s. Estimated remaining: 25m 44s. Rate: 7.8 symbols/min [2025-10-27T21:38:41.437348] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:41.479175] [DEBUG] [LOCAL ] UE: Loaded 43003 existing records from primary storage. [2025-10-27T21:38:41.479450] [INFO ] [MAIN ] UE: Loaded 43003 existing records. [2025-10-27T21:38:41.668237] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:41.668510] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-27T21:38:41.668559] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-27T21:38:41.668790] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-27T21:38:41.668848] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-27T21:38:42.020618] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-27T21:38:42.048728] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:42.079381] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T21:38:42.814941] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-27T21:38:43.546516] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:38:43.587595] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-27T21:38:43.614901] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-27T21:38:43.970628] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-27T21:38:44.414936] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-27T21:38:44.895523] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T21:38:44.905820] [INFO ] [REMOTE ] UDR: Full fetch complete (75156 records). [2025-10-27T21:38:44.905946] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-27T21:38:45.220144] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-27T21:38:45.301265] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-27T21:38:45.301366] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-27T21:38:45.302535] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-27T21:38:45.302598] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-27T21:38:45.304007] [DEBUG] [LOCAL ] UDR: Trimmed 75156 records to 52103 (keeping 200 days of data) [2025-10-27T21:38:45.614208] [DEBUG] [LOCAL ] UDR: Primary data saved (52103 records). [2025-10-27T21:38:45.614338] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-27T21:38:45.614414] [INFO ] [MAIN ] Update Progress: 2167/2366 symbols completed. UDR took 26.5s. Estimated remaining: 25m 36s. Rate: 7.8 symbols/min [2025-10-27T21:38:45.786825] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:45.796380] [DEBUG] [LOCAL ] UFI: Loaded 8278 existing records from primary storage. [2025-10-27T21:38:45.796567] [INFO ] [MAIN ] UFI: Loaded 8278 existing records. [2025-10-27T21:38:45.972674] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:45.972881] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-27T21:38:45.972929] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-27T21:38:45.973078] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-27T21:38:45.973117] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-27T21:38:46.036742] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-27T21:38:46.340256] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:46.394895] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T21:38:46.463901] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-27T21:38:46.814933] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-27T21:38:47.321488] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T21:38:47.543057] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T21:38:47.614904] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-27T21:38:48.414932] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-27T21:38:49.143234] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T21:38:49.214915] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-27T21:38:49.936684] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T21:38:50.014930] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-27T21:38:50.662529] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-27T21:38:50.673003] [INFO ] [REMOTE ] UBS: Full fetch complete (75946 records). [2025-10-27T21:38:50.673130] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-27T21:38:50.820196] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-27T21:38:51.126219] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-27T21:38:51.126447] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-27T21:38:51.127727] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-27T21:38:51.127857] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-27T21:38:51.129545] [DEBUG] [LOCAL ] UBS: Trimmed 75946 records to 52230 (keeping 200 days of data) [2025-10-27T21:38:51.243576] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-27T21:38:51.382860] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-27T21:38:51.492553] [DEBUG] [LOCAL ] UBS: Primary data saved (52230 records). [2025-10-27T21:38:51.492713] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-27T21:38:51.492801] [INFO ] [MAIN ] Update Progress: 2168/2366 symbols completed. UBS took 35.8s. Estimated remaining: 25m 28s. Rate: 7.8 symbols/min [2025-10-27T21:38:51.620100] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-27T21:38:51.671675] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:51.724490] [DEBUG] [LOCAL ] UGI: Loaded 51162 existing records from primary storage. [2025-10-27T21:38:51.724894] [INFO ] [MAIN ] UGI: Loaded 51162 existing records. [2025-10-27T21:38:51.902906] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:51.903113] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-27T21:38:51.903161] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-27T21:38:51.903683] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-27T21:38:51.903739] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-27T21:38:52.250949] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:52.411057] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T21:38:52.420510] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-27T21:38:52.422843] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-27T21:38:52.422996] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-27T21:38:52.816821] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-27T21:38:52.816914] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-27T21:38:52.818230] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-27T21:38:52.818311] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-27T21:38:52.819913] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-27T21:38:53.168832] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-27T21:38:53.168996] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-27T21:38:53.169104] [INFO ] [MAIN ] Update Progress: 2169/2366 symbols completed. UBER took 37.9s. Estimated remaining: 25m 20s. Rate: 7.8 symbols/min [2025-10-27T21:38:53.220291] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-27T21:38:53.345088] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:38:53.383009] [DEBUG] [LOCAL ] UGP: Loaded 43667 existing records from primary storage. [2025-10-27T21:38:53.383300] [INFO ] [MAIN ] UGP: Loaded 43667 existing records. [2025-10-27T21:38:53.553707] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:38:53.553899] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-27T21:38:53.553945] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-27T21:38:53.554131] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-27T21:38:53.554171] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-27T21:38:53.905773] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:38:54.006558] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-27T21:38:54.014899] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-27T21:38:54.180012] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-27T21:38:54.814908] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-27T21:38:54.859197] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T21:38:55.614981] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-27T21:38:56.049817] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T21:38:56.414945] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-27T21:38:56.841439] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-27T21:38:57.214978] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-27T21:38:58.014920] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-27T21:38:58.163323] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T21:38:58.522763] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-27T21:38:58.665783] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T21:38:58.814913] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-27T21:38:59.614938] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-27T21:39:00.319523] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-27T21:39:00.414935] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-27T21:39:00.568289] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T21:39:01.214972] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-27T21:39:01.329061] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T21:39:02.015013] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-27T21:39:02.737748] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T21:39:02.814939] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-27T21:39:03.065117] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T21:39:03.256363] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-27T21:39:03.614942] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-27T21:39:04.126348] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:39:04.128751] [INFO ] [REMOTE ] UFI: Full fetch complete (12369 records). [2025-10-27T21:39:04.128826] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-27T21:39:04.418458] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-27T21:39:04.504002] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-27T21:39:04.504075] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-27T21:39:04.504384] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-27T21:39:04.504424] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-27T21:39:04.504928] [DEBUG] [LOCAL ] UFI: Trimmed 12369 records to 8077 (keeping 200 days of data) [2025-10-27T21:39:04.548216] [DEBUG] [LOCAL ] UFI: Primary data saved (8077 records). [2025-10-27T21:39:04.548339] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-27T21:39:04.548412] [INFO ] [MAIN ] Update Progress: 2170/2366 symbols completed. UFI took 18.9s. Estimated remaining: 25m 12s. Rate: 7.8 symbols/min [2025-10-27T21:39:04.711684] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:04.727573] [DEBUG] [LOCAL ] UHAL: Loaded 17058 existing records from primary storage. [2025-10-27T21:39:04.727825] [INFO ] [MAIN ] UHAL: Loaded 17058 existing records. [2025-10-27T21:39:04.900804] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:04.901056] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-27T21:39:04.901116] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-27T21:39:04.901438] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-27T21:39:04.901495] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-27T21:39:05.220008] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-27T21:39:05.250012] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:05.963426] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-27T21:39:06.014938] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-27T21:39:06.360359] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-27T21:39:06.744332] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-27T21:39:06.814931] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-27T21:39:07.614963] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-27T21:39:07.893101] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T21:39:08.414967] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-27T21:39:09.214917] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-27T21:39:09.351540] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:39:09.571746] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:39:10.014935] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-27T21:39:10.526314] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:39:10.814930] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-27T21:39:11.228891] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T21:39:11.390489] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T21:39:11.614954] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-27T21:39:12.415005] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-27T21:39:12.672117] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T21:39:13.214963] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-27T21:39:13.510058] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T21:39:14.014971] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-27T21:39:14.198560] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T21:39:14.814936] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-27T21:39:15.079789] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T21:39:15.087323] [INFO ] [REMOTE ] UE: Full fetch complete (60979 records). [2025-10-27T21:39:15.087426] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-27T21:39:15.464817] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-27T21:39:15.464894] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-27T21:39:15.465891] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-27T21:39:15.465951] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-27T21:39:15.467158] [DEBUG] [LOCAL ] UE: Trimmed 60979 records to 42208 (keeping 200 days of data) [2025-10-27T21:39:15.652973] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-27T21:39:15.665273] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-27T21:39:15.744181] [DEBUG] [LOCAL ] UE: Primary data saved (42208 records). [2025-10-27T21:39:15.744330] [INFO ] [MAIN ] UE: Full history saved. [2025-10-27T21:39:15.744429] [INFO ] [MAIN ] Update Progress: 2171/2366 symbols completed. UE took 34.5s. Estimated remaining: 25m 5s. Rate: 7.8 symbols/min [2025-10-27T21:39:15.909271] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:15.947798] [DEBUG] [LOCAL ] UHS: Loaded 40169 existing records from primary storage. [2025-10-27T21:39:15.948118] [INFO ] [MAIN ] UHS: Loaded 40169 existing records. [2025-10-27T21:39:16.122530] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:16.122757] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-27T21:39:16.122807] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-27T21:39:16.123004] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-27T21:39:16.123042] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-27T21:39:16.420066] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-27T21:39:16.474235] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:17.003186] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:39:17.096939] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T21:39:17.214944] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-27T21:39:18.014951] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-27T21:39:18.736506] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-27T21:39:18.814907] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-27T21:39:18.890136] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T21:39:19.614934] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-27T21:39:19.781450] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T21:39:20.414988] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-27T21:39:21.216136] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-27T21:39:21.221464] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:39:21.762752] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T21:39:21.937964] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T21:39:22.014965] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-27T21:39:22.814933] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-27T21:39:23.301815] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T21:39:23.311152] [INFO ] [REMOTE ] UGI: Full fetch complete (73352 records). [2025-10-27T21:39:23.311262] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-27T21:39:23.617057] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-27T21:39:23.704244] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-27T21:39:23.704359] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-27T21:39:23.705705] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-27T21:39:23.705771] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-27T21:39:23.707276] [DEBUG] [LOCAL ] UGI: Trimmed 73352 records to 50326 (keeping 200 days of data) [2025-10-27T21:39:23.935592] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-27T21:39:23.962337] [INFO ] [REMOTE ] UHAL: Full fetch complete (23374 records). [2025-10-27T21:39:23.973339] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-27T21:39:24.156419] [DEBUG] [LOCAL ] UGI: Primary data saved (50326 records). [2025-10-27T21:39:24.161767] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-27T21:39:24.161910] [INFO ] [MAIN ] Update Progress: 2172/2366 symbols completed. UGI took 32.7s. Estimated remaining: 24m 57s. Rate: 7.8 symbols/min [2025-10-27T21:39:24.416350] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-27T21:39:24.533836] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:24.602985] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-27T21:39:24.603066] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-27T21:39:24.603681] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-27T21:39:24.603807] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-27T21:39:24.607286] [DEBUG] [LOCAL ] UHAL: Trimmed 23374 records to 16733 (keeping 200 days of data) [2025-10-27T21:39:24.612296] [DEBUG] [LOCAL ] UHT: Loaded 10342 existing records from primary storage. [2025-10-27T21:39:24.649894] [INFO ] [MAIN ] UHT: Loaded 10342 existing records. [2025-10-27T21:39:24.895808] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:24.897088] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-27T21:39:24.899237] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-27T21:39:24.900895] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-27T21:39:24.901495] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-27T21:39:24.937672] [DEBUG] [LOCAL ] UHAL: Primary data saved (16733 records). [2025-10-27T21:39:24.959565] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-27T21:39:24.993928] [INFO ] [MAIN ] Update Progress: 2173/2366 symbols completed. UHAL took 20.4s. Estimated remaining: 24m 49s. Rate: 7.8 symbols/min [2025-10-27T21:39:25.497622] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-27T21:39:25.540672] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:25.570006] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-27T21:39:25.696325] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:25.706955] [DEBUG] [LOCAL ] UI: Loaded 14418 existing records from primary storage. [2025-10-27T21:39:25.707822] [INFO ] [MAIN ] UI: Loaded 14418 existing records. [2025-10-27T21:39:25.911135] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:25.911361] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-27T21:39:25.911411] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-27T21:39:25.911607] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-27T21:39:25.911697] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-27T21:39:26.016472] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-27T21:39:26.365625] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:26.397949] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-27T21:39:26.597738] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T21:39:26.820026] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-27T21:39:26.832505] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:39:27.615014] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-27T21:39:28.414988] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-27T21:39:28.448799] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:39:29.214952] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-27T21:39:29.346816] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T21:39:29.460069] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T21:39:30.015017] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-27T21:39:30.543789] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:39:30.814953] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-27T21:39:30.968204] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-27T21:39:31.614941] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-27T21:39:31.991579] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T21:39:32.414955] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-27T21:39:33.214947] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-27T21:39:33.324944] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T21:39:33.688201] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T21:39:33.703887] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:39:34.014918] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-27T21:39:34.814933] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-27T21:39:35.383279] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-27T21:39:35.574173] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T21:39:35.583283] [INFO ] [REMOTE ] UGP: Full fetch complete (62231 records). [2025-10-27T21:39:35.583396] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-27T21:39:35.620087] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-27T21:39:35.967860] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-27T21:39:35.967944] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-27T21:39:35.969132] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-27T21:39:35.969220] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-27T21:39:35.970483] [DEBUG] [LOCAL ] UGP: Trimmed 62231 records to 43006 (keeping 200 days of data) [2025-10-27T21:39:36.209210] [DEBUG] [LOCAL ] UGP: Primary data saved (43006 records). [2025-10-27T21:39:36.209334] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-27T21:39:36.209410] [INFO ] [MAIN ] Update Progress: 2174/2366 symbols completed. UGP took 43.0s. Estimated remaining: 24m 41s. Rate: 7.8 symbols/min [2025-10-27T21:39:36.375736] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:36.410445] [DEBUG] [LOCAL ] UIS: Loaded 37070 existing records from primary storage. [2025-10-27T21:39:36.410749] [INFO ] [MAIN ] UIS: Loaded 37070 existing records. [2025-10-27T21:39:36.421730] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-27T21:39:36.592271] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:36.592463] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-27T21:39:36.592508] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-27T21:39:36.592739] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-27T21:39:36.592797] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-27T21:39:36.954516] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:37.024602] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T21:39:37.214936] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-27T21:39:37.413823] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T21:39:38.014963] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-27T21:39:38.461388] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-27T21:39:38.814958] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-27T21:39:38.929123] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-27T21:39:39.615001] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-27T21:39:39.802350] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T21:39:40.414999] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-27T21:39:40.860735] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:39:40.910863] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-27T21:39:41.214931] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-27T21:39:41.735078] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-27T21:39:42.014929] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-27T21:39:42.622520] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T21:39:42.814939] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-27T21:39:43.308369] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T21:39:43.614927] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-27T21:39:44.414923] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-27T21:39:44.536779] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T21:39:45.215003] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-27T21:39:45.903319] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T21:39:46.012084] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T21:39:46.021131] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-27T21:39:46.814930] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-27T21:39:46.951013] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T21:39:47.614940] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-27T21:39:47.967310] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T21:39:48.414943] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-27T21:39:48.634015] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-27T21:39:48.757018] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T21:39:49.214985] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-27T21:39:49.999296] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T21:39:50.014904] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-27T21:39:50.814941] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-27T21:39:51.048798] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-27T21:39:51.614946] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-27T21:39:51.914897] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T21:39:52.414981] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-27T21:39:52.655317] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T21:39:52.662254] [INFO ] [REMOTE ] UHS: Full fetch complete (58160 records). [2025-10-27T21:39:52.662384] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-27T21:39:53.048689] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-27T21:39:53.048801] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-27T21:39:53.049825] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-27T21:39:53.049888] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-27T21:39:53.051028] [DEBUG] [LOCAL ] UHS: Trimmed 58160 records to 39489 (keeping 200 days of data) [2025-10-27T21:39:53.224617] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-27T21:39:53.298085] [DEBUG] [LOCAL ] UHS: Primary data saved (39489 records). [2025-10-27T21:39:53.298227] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-27T21:39:53.299146] [INFO ] [MAIN ] Update Progress: 2175/2366 symbols completed. UHS took 37.6s. Estimated remaining: 24m 34s. Rate: 7.8 symbols/min [2025-10-27T21:39:53.476549] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:53.484856] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T21:39:53.542820] [DEBUG] [LOCAL ] UL: Loaded 53844 existing records from primary storage. [2025-10-27T21:39:53.543175] [INFO ] [MAIN ] UL: Loaded 53844 existing records. [2025-10-27T21:39:53.726476] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:53.726729] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-27T21:39:53.726784] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-27T21:39:53.727038] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-27T21:39:53.727092] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-27T21:39:54.020133] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-27T21:39:54.081991] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:54.257528] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T21:39:54.814994] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-27T21:39:54.860760] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T21:39:54.863602] [INFO ] [REMOTE ] UHT: Full fetch complete (15029 records). [2025-10-27T21:39:54.863703] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-27T21:39:55.229247] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-27T21:39:55.229330] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-27T21:39:55.229689] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-27T21:39:55.229758] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-27T21:39:55.230261] [DEBUG] [LOCAL ] UHT: Trimmed 15029 records to 10135 (keeping 200 days of data) [2025-10-27T21:39:55.291587] [DEBUG] [LOCAL ] UHT: Primary data saved (10135 records). [2025-10-27T21:39:55.291753] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-27T21:39:55.291840] [INFO ] [MAIN ] Update Progress: 2176/2366 symbols completed. UHT took 31.1s. Estimated remaining: 24m 26s. Rate: 7.8 symbols/min [2025-10-27T21:39:55.457381] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:55.614934] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-27T21:39:55.902629] [DEBUG] [LOCAL ] ULS: Loaded 38913 existing records from primary storage. [2025-10-27T21:39:55.902979] [INFO ] [MAIN ] ULS: Loaded 38913 existing records. [2025-10-27T21:39:56.096880] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:56.097082] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-27T21:39:56.097132] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-27T21:39:56.097549] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-27T21:39:56.097630] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-27T21:39:56.395188] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T21:39:56.423009] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-27T21:39:56.468273] [INFO ] [REMOTE ] UI: Full fetch complete (19945 records). [2025-10-27T21:39:56.468151] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:56.468728] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-27T21:39:56.859106] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-27T21:39:56.859382] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-27T21:39:56.859995] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-27T21:39:56.860081] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-27T21:39:56.860821] [DEBUG] [LOCAL ] UI: Trimmed 19945 records to 14183 (keeping 200 days of data) [2025-10-27T21:39:56.950059] [DEBUG] [LOCAL ] UI: Primary data saved (14183 records). [2025-10-27T21:39:56.950556] [INFO ] [MAIN ] UI: Full history saved. [2025-10-27T21:39:56.950686] [INFO ] [MAIN ] Update Progress: 2177/2366 symbols completed. UI took 31.9s. Estimated remaining: 24m 18s. Rate: 7.8 symbols/min [2025-10-27T21:39:57.057716] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-27T21:39:57.154884] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:39:57.202782] [DEBUG] [LOCAL ] UMC: Loaded 53439 existing records from primary storage. [2025-10-27T21:39:57.203105] [INFO ] [MAIN ] UMC: Loaded 53439 existing records. [2025-10-27T21:39:57.223085] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-27T21:39:57.378534] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:39:57.378755] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-27T21:39:57.378829] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-27T21:39:57.379031] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-27T21:39:57.379089] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-27T21:39:57.728861] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:39:58.014970] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-27T21:39:58.311204] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-27T21:39:58.702628] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T21:39:58.825495] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-27T21:39:58.826843] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-27T21:39:59.614955] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-27T21:40:00.414928] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-27T21:40:00.655266] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-27T21:40:01.022843] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:40:01.214930] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-27T21:40:02.015001] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-27T21:40:02.183383] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-27T21:40:02.496830] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T21:40:02.814943] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-27T21:40:03.183772] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T21:40:03.614959] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-27T21:40:04.414926] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-27T21:40:04.869845] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-27T21:40:05.214905] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-27T21:40:05.429539] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T21:40:05.518809] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-27T21:40:06.015043] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-27T21:40:06.574846] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-27T21:40:06.814957] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-27T21:40:07.622304] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-27T21:40:07.643707] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-27T21:40:07.994138] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T21:40:08.414944] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-27T21:40:09.017236] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T21:40:09.214963] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-27T21:40:10.009749] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T21:40:10.020076] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-27T21:40:10.814957] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-27T21:40:11.027245] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:40:11.614918] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-27T21:40:12.415000] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-27T21:40:12.738458] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T21:40:13.080680] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T21:40:13.087510] [INFO ] [REMOTE ] UIS: Full fetch complete (52019 records). [2025-10-27T21:40:13.087664] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-27T21:40:13.229160] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-27T21:40:13.478849] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-27T21:40:13.478937] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-27T21:40:13.480160] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-27T21:40:13.480225] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-27T21:40:13.481416] [DEBUG] [LOCAL ] UIS: Trimmed 52019 records to 36276 (keeping 200 days of data) [2025-10-27T21:40:13.624180] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (4.41 seconds). [2025-10-27T21:40:13.723945] [DEBUG] [LOCAL ] UIS: Primary data saved (36276 records). [2025-10-27T21:40:13.724139] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-27T21:40:13.724233] [INFO ] [MAIN ] Update Progress: 2178/2366 symbols completed. UIS took 37.5s. Estimated remaining: 24m 11s. Rate: 7.8 symbols/min [2025-10-27T21:40:13.891322] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:13.924092] [DEBUG] [LOCAL ] UMH: Loaded 34721 existing records from primary storage. [2025-10-27T21:40:13.924366] [INFO ] [MAIN ] UMH: Loaded 34721 existing records. [2025-10-27T21:40:14.019793] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-27T21:40:14.110140] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:14.110402] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-27T21:40:14.110475] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-27T21:40:14.110717] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-27T21:40:14.110789] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-27T21:40:14.526997] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:14.814948] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-27T21:40:15.063343] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-27T21:40:15.100185] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-27T21:40:15.572924] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-27T21:40:15.614910] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-27T21:40:15.679419] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:40:16.414931] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-27T21:40:17.214971] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-27T21:40:17.429762] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T21:40:17.834489] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T21:40:18.015002] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-27T21:40:18.815040] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-27T21:40:18.902977] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-27T21:40:19.145858] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-27T21:40:19.614937] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-27T21:40:20.414945] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-27T21:40:20.814695] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T21:40:21.139879] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T21:40:21.214904] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-27T21:40:21.780417] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T21:40:22.014944] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-27T21:40:22.700836] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T21:40:22.814913] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-27T21:40:23.122425] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T21:40:23.614961] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-27T21:40:24.414935] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-27T21:40:24.589304] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-27T21:40:24.599338] [INFO ] [REMOTE ] UMC: Full fetch complete (76655 records). [2025-10-27T21:40:24.599485] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-27T21:40:24.988410] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-27T21:40:24.988521] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-27T21:40:24.989694] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-27T21:40:24.989768] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-27T21:40:24.991266] [DEBUG] [LOCAL ] UMC: Trimmed 76655 records to 52657 (keeping 200 days of data) [2025-10-27T21:40:25.130568] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T21:40:25.215774] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-27T21:40:25.323114] [DEBUG] [LOCAL ] UMC: Primary data saved (52657 records). [2025-10-27T21:40:25.323253] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-27T21:40:25.323334] [INFO ] [MAIN ] Update Progress: 2179/2366 symbols completed. UMC took 28.4s. Estimated remaining: 24m 4s. Rate: 7.8 symbols/min [2025-10-27T21:40:25.489735] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:25.502919] [DEBUG] [LOCAL ] UNF: Loaded 12082 existing records from primary storage. [2025-10-27T21:40:25.503111] [INFO ] [MAIN ] UNF: Loaded 12082 existing records. [2025-10-27T21:40:25.694270] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T21:40:25.698320] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:25.705603] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-27T21:40:25.705710] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-27T21:40:25.706220] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-27T21:40:25.706279] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-27T21:40:26.022071] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-27T21:40:26.053004] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:26.814948] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-27T21:40:27.066986] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-27T21:40:27.077290] [INFO ] [REMOTE ] UL: Full fetch complete (77075 records). [2025-10-27T21:40:27.077416] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-27T21:40:27.495045] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-27T21:40:27.495127] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-27T21:40:27.496457] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-27T21:40:27.496570] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-27T21:40:27.498102] [DEBUG] [LOCAL ] UL: Trimmed 77075 records to 53061 (keeping 200 days of data) [2025-10-27T21:40:27.619029] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-27T21:40:27.622152] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T21:40:27.794988] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T21:40:27.886368] [DEBUG] [LOCAL ] UL: Primary data saved (53061 records). [2025-10-27T21:40:27.886495] [INFO ] [MAIN ] UL: Full history saved. [2025-10-27T21:40:27.887361] [INFO ] [MAIN ] Update Progress: 2180/2366 symbols completed. UL took 34.6s. Estimated remaining: 23m 56s. Rate: 7.8 symbols/min [2025-10-27T21:40:28.056839] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:28.098681] [DEBUG] [LOCAL ] UNFI: Loaded 43201 existing records from primary storage. [2025-10-27T21:40:28.098970] [INFO ] [MAIN ] UNFI: Loaded 43201 existing records. [2025-10-27T21:40:28.278066] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:28.278317] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-27T21:40:28.278404] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-27T21:40:28.278596] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-27T21:40:28.278634] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-27T21:40:28.420045] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-27T21:40:28.657166] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:28.672246] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T21:40:29.214948] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-27T21:40:29.521412] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T21:40:30.005752] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-27T21:40:30.014888] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-27T21:40:30.597211] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T21:40:30.814934] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-27T21:40:31.614964] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-27T21:40:32.184541] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-27T21:40:32.414941] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-27T21:40:33.049160] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:40:33.214912] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-27T21:40:33.512843] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T21:40:34.014942] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-27T21:40:34.255915] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T21:40:34.814997] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-27T21:40:35.424072] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T21:40:35.614943] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-27T21:40:35.997073] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T21:40:36.414942] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-27T21:40:36.616385] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T21:40:36.624197] [INFO ] [REMOTE ] UMH: Full fetch complete (47455 records). [2025-10-27T21:40:36.624354] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-27T21:40:37.050086] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-27T21:40:37.050162] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-27T21:40:37.051232] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-27T21:40:37.051300] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-27T21:40:37.052347] [DEBUG] [LOCAL ] UMH: Trimmed 47455 records to 33938 (keeping 200 days of data) [2025-10-27T21:40:37.219714] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-27T21:40:37.262035] [DEBUG] [LOCAL ] UMH: Primary data saved (33938 records). [2025-10-27T21:40:37.262134] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-27T21:40:37.262206] [INFO ] [MAIN ] Update Progress: 2181/2366 symbols completed. UMH took 23.5s. Estimated remaining: 23m 48s. Rate: 7.8 symbols/min [2025-10-27T21:40:37.428860] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:37.478687] [DEBUG] [LOCAL ] UNH: Loaded 54599 existing records from primary storage. [2025-10-27T21:40:37.479140] [INFO ] [MAIN ] UNH: Loaded 54599 existing records. [2025-10-27T21:40:37.656524] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:37.656803] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-27T21:40:37.656921] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-27T21:40:37.663683] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-27T21:40:37.674998] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-27T21:40:37.707345] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T21:40:37.772231] [INFO ] [REMOTE ] ULS: Full fetch complete (53752 records). [2025-10-27T21:40:37.782529] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-27T21:40:38.043523] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-27T21:40:38.351628] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:38.384394] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:40:38.455224] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-27T21:40:38.455289] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-27T21:40:38.456279] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-27T21:40:38.456339] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-27T21:40:38.457518] [DEBUG] [LOCAL ] ULS: Trimmed 53752 records to 38114 (keeping 200 days of data) [2025-10-27T21:40:38.680048] [DEBUG] [LOCAL ] ULS: Primary data saved (38114 records). [2025-10-27T21:40:38.680176] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-27T21:40:38.680570] [INFO ] [MAIN ] Update Progress: 2182/2366 symbols completed. ULS took 43.4s. Estimated remaining: 23m 40s. Rate: 7.8 symbols/min [2025-10-27T21:40:38.816874] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-27T21:40:38.845996] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:38.889079] [DEBUG] [LOCAL ] UNM: Loaded 48593 existing records from primary storage. [2025-10-27T21:40:38.889361] [INFO ] [MAIN ] UNM: Loaded 48593 existing records. [2025-10-27T21:40:39.061000] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:39.061177] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-27T21:40:39.061221] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-27T21:40:39.061425] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-27T21:40:39.061463] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-27T21:40:39.413694] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:39.465926] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:40:39.614901] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-27T21:40:40.415223] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-27T21:40:41.037307] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-27T21:40:41.214961] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-27T21:40:41.479510] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T21:40:41.856441] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-27T21:40:42.014925] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-27T21:40:42.814984] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-27T21:40:42.832562] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T21:40:43.190147] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T21:40:43.614922] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-27T21:40:44.156446] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T21:40:44.414977] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-27T21:40:44.941984] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T21:40:45.214953] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-27T21:40:45.768550] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-27T21:40:46.014951] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-27T21:40:46.707019] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T21:40:46.814913] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-27T21:40:46.876287] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T21:40:47.575937] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T21:40:47.614902] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-27T21:40:48.191478] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-27T21:40:48.414965] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-27T21:40:49.215001] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-27T21:40:50.014928] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-27T21:40:50.814976] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-27T21:40:50.914670] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-27T21:40:50.954830] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T21:40:51.358243] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T21:40:51.443124] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T21:40:51.446564] [INFO ] [REMOTE ] UNF: Full fetch complete (17780 records). [2025-10-27T21:40:51.446675] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-27T21:40:51.615005] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-27T21:40:51.824998] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-27T21:40:51.825069] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-27T21:40:51.825445] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-27T21:40:51.825517] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-27T21:40:51.826062] [DEBUG] [LOCAL ] UNF: Trimmed 17780 records to 11817 (keeping 200 days of data) [2025-10-27T21:40:51.897160] [DEBUG] [LOCAL ] UNF: Primary data saved (11817 records). [2025-10-27T21:40:51.897287] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-27T21:40:51.897365] [INFO ] [MAIN ] Update Progress: 2183/2366 symbols completed. UNF took 26.6s. Estimated remaining: 23m 32s. Rate: 7.8 symbols/min [2025-10-27T21:40:52.062816] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:40:52.068510] [DEBUG] [LOCAL ] UNMA: Loaded 3442 existing records from primary storage. [2025-10-27T21:40:52.068697] [INFO ] [MAIN ] UNMA: Loaded 3442 existing records. [2025-10-27T21:40:52.239789] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:40:52.239997] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-27T21:40:52.240042] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-27T21:40:52.240168] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-27T21:40:52.240211] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-27T21:40:52.425239] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-27T21:40:52.606239] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:40:53.214969] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-27T21:40:53.320140] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-27T21:40:53.672681] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T21:40:54.014981] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-27T21:40:54.332244] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-27T21:40:54.362870] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-27T21:40:54.815000] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-27T21:40:55.614931] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-27T21:40:56.414946] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-27T21:40:56.794996] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-27T21:40:57.198738] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-27T21:40:57.214899] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-27T21:40:57.588592] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T21:40:58.014941] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-27T21:40:58.815044] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-27T21:40:59.248776] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-27T21:40:59.346355] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:40:59.373615] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T21:40:59.614927] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-27T21:41:00.415024] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-27T21:41:00.873765] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-27T21:41:00.886422] [INFO ] [REMOTE ] UNFI: Full fetch complete (59934 records). [2025-10-27T21:41:00.886586] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-27T21:41:01.225481] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-27T21:41:01.270442] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-27T21:41:01.270547] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-27T21:41:01.271686] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-27T21:41:01.271750] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-27T21:41:01.272991] [DEBUG] [LOCAL ] UNFI: Trimmed 59934 records to 42417 (keeping 200 days of data) [2025-10-27T21:41:01.517545] [DEBUG] [LOCAL ] UNFI: Primary data saved (42417 records). [2025-10-27T21:41:01.517749] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-27T21:41:01.518509] [INFO ] [MAIN ] Update Progress: 2184/2366 symbols completed. UNFI took 33.6s. Estimated remaining: 23m 25s. Rate: 7.8 symbols/min [2025-10-27T21:41:01.708693] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:01.790505] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-27T21:41:01.791730] [DEBUG] [LOCAL ] UNP: Loaded 54142 existing records from primary storage. [2025-10-27T21:41:01.801999] [INFO ] [MAIN ] UNP: Loaded 54142 existing records. [2025-10-27T21:41:01.975275] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:01.975493] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-27T21:41:01.975541] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-27T21:41:01.975772] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-27T21:41:01.975828] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-27T21:41:02.020292] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-27T21:41:02.318534] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:02.814944] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-27T21:41:03.189485] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-27T21:41:03.614994] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-27T21:41:03.780676] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T21:41:03.976234] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T21:41:04.246487] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-10-27T21:41:04.414940] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-27T21:41:05.214964] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-27T21:41:05.808937] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-27T21:41:06.015001] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-27T21:41:06.816092] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-27T21:41:06.822728] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-27T21:41:07.168726] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-27T21:41:07.500241] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-27T21:41:07.614964] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-27T21:41:07.968878] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-27T21:41:08.414947] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-27T21:41:09.215041] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-27T21:41:09.721744] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T21:41:10.014968] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-27T21:41:10.814991] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-27T21:41:11.277038] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-27T21:41:11.278409] [INFO ] [REMOTE ] UNMA: Full fetch complete (5395 records). [2025-10-27T21:41:11.278478] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-27T21:41:11.621950] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-27T21:41:11.669811] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-27T21:41:11.670160] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-27T21:41:11.670417] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-27T21:41:11.670687] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-27T21:41:11.671315] [DEBUG] [LOCAL ] UNMA: Trimmed 5395 records to 3362 (keeping 200 days of data) [2025-10-27T21:41:11.721817] [DEBUG] [LOCAL ] UNMA: Primary data saved (3362 records). [2025-10-27T21:41:11.724243] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:41:11.724390] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-27T21:41:11.735731] [INFO ] [MAIN ] Update Progress: 2185/2366 symbols completed. UNMA took 19.8s. Estimated remaining: 23m 17s. Rate: 7.8 symbols/min [2025-10-27T21:41:11.905423] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:11.938864] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-27T21:41:11.987667] [DEBUG] [LOCAL ] UP: Loaded 45147 existing records from primary storage. [2025-10-27T21:41:11.987963] [INFO ] [MAIN ] UP: Loaded 45147 existing records. [2025-10-27T21:41:12.159934] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:12.160187] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-27T21:41:12.160233] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-27T21:41:12.160666] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-27T21:41:12.160724] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-27T21:41:12.425016] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-27T21:41:12.504379] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:12.884927] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-27T21:41:12.895948] [INFO ] [REMOTE ] UNH: Full fetch complete (77962 records). [2025-10-27T21:41:12.896094] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-27T21:41:13.221081] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-27T21:41:13.299046] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-27T21:41:13.299229] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-27T21:41:13.300517] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-27T21:41:13.300592] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-27T21:41:13.330039] [DEBUG] [LOCAL ] UNH: Trimmed 77962 records to 53819 (keeping 200 days of data) [2025-10-27T21:41:13.332071] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T21:41:13.671394] [DEBUG] [LOCAL ] UNH: Primary data saved (53819 records). [2025-10-27T21:41:13.671497] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-27T21:41:13.671583] [INFO ] [MAIN ] Update Progress: 2186/2366 symbols completed. UNH took 36.4s. Estimated remaining: 23m 9s. Rate: 7.8 symbols/min [2025-10-27T21:41:13.835350] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:13.883666] [DEBUG] [LOCAL ] UPS: Loaded 54501 existing records from primary storage. [2025-10-27T21:41:13.883991] [INFO ] [MAIN ] UPS: Loaded 54501 existing records. [2025-10-27T21:41:14.020042] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-27T21:41:14.058732] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:14.058900] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-27T21:41:14.058944] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-27T21:41:14.059113] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-27T21:41:14.059154] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-27T21:41:14.410565] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:14.814973] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-27T21:41:15.132737] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T21:41:15.143273] [INFO ] [REMOTE ] UNM: Full fetch complete (69895 records). [2025-10-27T21:41:15.143410] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-27T21:41:15.560742] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-27T21:41:15.561257] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-27T21:41:15.562446] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-27T21:41:15.564020] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-27T21:41:15.564170] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-27T21:41:15.576285] [DEBUG] [LOCAL ] UNM: Trimmed 69895 records to 47761 (keeping 200 days of data) [2025-10-27T21:41:15.631737] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-27T21:41:15.878438] [DEBUG] [LOCAL ] UNM: Primary data saved (47761 records). [2025-10-27T21:41:15.878800] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-27T21:41:15.879463] [INFO ] [MAIN ] Update Progress: 2187/2366 symbols completed. UNM took 37.2s. Estimated remaining: 23m 1s. Rate: 7.8 symbols/min [2025-10-27T21:41:16.055319] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-27T21:41:16.072420] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:16.115725] [DEBUG] [LOCAL ] URI: Loaded 34924 existing records from primary storage. [2025-10-27T21:41:16.115986] [INFO ] [MAIN ] URI: Loaded 34924 existing records. [2025-10-27T21:41:16.292043] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:16.292298] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-27T21:41:16.292344] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-27T21:41:16.292844] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-27T21:41:16.292902] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-27T21:41:16.420032] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-27T21:41:16.647875] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:17.214910] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-27T21:41:17.638127] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T21:41:18.015005] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-27T21:41:18.192585] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T21:41:18.293536] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T21:41:18.814949] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-27T21:41:19.338116] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T21:41:19.614939] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-27T21:41:20.414970] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-27T21:41:20.891002] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-27T21:41:21.214932] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-27T21:41:21.558219] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-27T21:41:21.593883] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-27T21:41:22.014973] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-27T21:41:22.814916] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-27T21:41:23.020562] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-27T21:41:23.049520] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T21:41:23.614946] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-27T21:41:24.415005] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-27T21:41:24.480681] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T21:41:24.985876] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T21:41:25.214978] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-27T21:41:25.575607] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T21:41:26.014946] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-27T21:41:26.814983] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-27T21:41:27.164207] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:41:27.556602] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-27T21:41:27.614971] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-27T21:41:28.414917] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-27T21:41:28.417620] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-27T21:41:29.178239] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T21:41:29.214913] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-27T21:41:30.015086] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-27T21:41:30.101630] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-27T21:41:30.549235] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T21:41:30.814965] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-27T21:41:31.614991] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-27T21:41:31.864611] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-27T21:41:32.414922] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-27T21:41:32.482460] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-27T21:41:33.215005] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-27T21:41:33.799337] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-27T21:41:33.885868] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-27T21:41:34.014909] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-27T21:41:34.660830] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T21:41:34.814930] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-27T21:41:35.614899] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-27T21:41:35.663755] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T21:41:35.673329] [INFO ] [REMOTE ] UP: Full fetch complete (63075 records). [2025-10-27T21:41:35.673445] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-27T21:41:36.058001] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-27T21:41:36.058083] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-27T21:41:36.059173] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-27T21:41:36.059233] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-27T21:41:36.060404] [DEBUG] [LOCAL ] UP: Trimmed 63075 records to 44705 (keeping 200 days of data) [2025-10-27T21:41:36.192385] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T21:41:36.332701] [DEBUG] [LOCAL ] UP: Primary data saved (44705 records). [2025-10-27T21:41:36.332816] [INFO ] [MAIN ] UP: Full history saved. [2025-10-27T21:41:36.332891] [INFO ] [MAIN ] Update Progress: 2188/2366 symbols completed. UP took 24.6s. Estimated remaining: 22m 54s. Rate: 7.8 symbols/min [2025-10-27T21:41:36.420894] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-27T21:41:36.499257] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:36.533348] [DEBUG] [LOCAL ] USA: Loaded 36914 existing records from primary storage. [2025-10-27T21:41:36.533599] [INFO ] [MAIN ] USA: Loaded 36914 existing records. [2025-10-27T21:41:36.706879] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:36.707046] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-27T21:41:36.707091] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-27T21:41:36.707276] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-27T21:41:36.707314] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-27T21:41:37.067751] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:37.094541] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-27T21:41:37.104556] [INFO ] [REMOTE ] UNP: Full fetch complete (77155 records). [2025-10-27T21:41:37.104694] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-27T21:41:37.220117] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-27T21:41:37.500814] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-27T21:41:37.500942] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-27T21:41:37.502221] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-27T21:41:37.502389] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-27T21:41:37.503781] [DEBUG] [LOCAL ] UNP: Trimmed 77155 records to 53359 (keeping 200 days of data) [2025-10-27T21:41:37.829832] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-27T21:41:37.885592] [DEBUG] [LOCAL ] UNP: Primary data saved (53359 records). [2025-10-27T21:41:37.885727] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-27T21:41:37.886429] [INFO ] [MAIN ] Update Progress: 2189/2366 symbols completed. UNP took 36.4s. Estimated remaining: 22m 46s. Rate: 7.8 symbols/min [2025-10-27T21:41:38.026046] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-27T21:41:38.059925] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:38.081535] [DEBUG] [LOCAL ] USAC: Loaded 22044 existing records from primary storage. [2025-10-27T21:41:38.081797] [INFO ] [MAIN ] USAC: Loaded 22044 existing records. [2025-10-27T21:41:38.262398] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:38.262603] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-27T21:41:38.262688] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-27T21:41:38.262943] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-27T21:41:38.263002] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-27T21:41:38.583747] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T21:41:38.644940] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:38.814900] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-27T21:41:39.069852] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:41:39.614950] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-27T21:41:39.973298] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T21:41:40.414966] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-27T21:41:40.784369] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:41:41.214997] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-27T21:41:42.014955] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-27T21:41:42.383771] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T21:41:42.440049] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-27T21:41:42.810297] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T21:41:42.816413] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-27T21:41:43.614994] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-27T21:41:44.414977] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-27T21:41:44.588613] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-27T21:41:44.662301] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-27T21:41:45.214959] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-27T21:41:45.789498] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T21:41:46.014944] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-27T21:41:46.213671] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T21:41:46.814934] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-27T21:41:47.089628] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-27T21:41:47.095631] [INFO ] [REMOTE ] URI: Full fetch complete (52711 records). [2025-10-27T21:41:47.095745] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-27T21:41:47.466255] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-27T21:41:47.466410] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-27T21:41:47.467420] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-27T21:41:47.467494] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-27T21:41:47.468677] [DEBUG] [LOCAL ] URI: Trimmed 52711 records to 34205 (keeping 200 days of data) [2025-10-27T21:41:47.631670] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-27T21:41:47.692608] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T21:41:47.715565] [DEBUG] [LOCAL ] URI: Primary data saved (34205 records). [2025-10-27T21:41:47.715681] [INFO ] [MAIN ] URI: Full history saved. [2025-10-27T21:41:47.716035] [INFO ] [MAIN ] Update Progress: 2190/2366 symbols completed. URI took 31.8s. Estimated remaining: 22m 39s. Rate: 7.8 symbols/min [2025-10-27T21:41:47.879920] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:47.927945] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-27T21:41:47.928345] [INFO ] [MAIN ] USB: Loaded 54468 existing records. [2025-10-27T21:41:48.099505] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:48.099722] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-27T21:41:48.099778] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-27T21:41:48.100046] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-27T21:41:48.100083] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-27T21:41:48.424330] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-27T21:41:48.449618] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:48.770768] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T21:41:49.214946] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-27T21:41:49.574226] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T21:41:50.014921] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-27T21:41:50.814947] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-27T21:41:51.016274] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T21:41:51.390204] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T21:41:51.614954] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-27T21:41:52.415018] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-27T21:41:52.550368] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T21:41:53.214974] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-27T21:41:53.256817] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-27T21:41:54.014965] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-27T21:41:54.122281] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-27T21:41:54.383890] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T21:41:54.471051] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-27T21:41:54.481128] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-27T21:41:54.481245] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-27T21:41:54.820191] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-27T21:41:54.866978] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-27T21:41:54.867066] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-27T21:41:54.868228] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-27T21:41:54.868292] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-27T21:41:54.869734] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53721 (keeping 200 days of data) [2025-10-27T21:41:55.196917] [DEBUG] [LOCAL ] UPS: Primary data saved (53721 records). [2025-10-27T21:41:55.197043] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-27T21:41:55.197116] [INFO ] [MAIN ] Update Progress: 2191/2366 symbols completed. UPS took 41.5s. Estimated remaining: 22m 31s. Rate: 7.8 symbols/min [2025-10-27T21:41:55.361255] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:41:55.407827] [DEBUG] [LOCAL ] USFD: Loaded 51851 existing records from primary storage. [2025-10-27T21:41:55.408123] [INFO ] [MAIN ] USFD: Loaded 51851 existing records. [2025-10-27T21:41:55.579449] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:41:55.579715] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-27T21:41:55.579771] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-27T21:41:55.579946] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-27T21:41:55.579983] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-27T21:41:55.621149] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-27T21:41:55.938975] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:41:55.955147] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T21:41:56.414910] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-27T21:41:57.214968] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-27T21:41:57.252215] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T21:41:57.544759] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T21:41:58.014951] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-27T21:41:58.158748] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T21:41:58.814928] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-27T21:41:59.195568] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T21:41:59.615007] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-27T21:42:00.368478] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-27T21:42:00.414906] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-27T21:42:00.890079] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-27T21:42:01.215187] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T21:42:01.215354] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-27T21:42:02.014926] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-27T21:42:02.550100] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:42:02.814980] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-27T21:42:03.614918] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-27T21:42:03.659614] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T21:42:04.003951] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T21:42:04.414909] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-27T21:42:04.473358] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T21:42:05.214956] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-27T21:42:05.732811] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T21:42:06.014953] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-27T21:42:06.564585] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T21:42:06.814982] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-27T21:42:07.615157] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-27T21:42:07.767526] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-27T21:42:08.280446] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T21:42:08.383029] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:42:08.388748] [INFO ] [REMOTE ] USAC: Full fetch complete (35387 records). [2025-10-27T21:42:08.388851] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-27T21:42:08.420023] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-27T21:42:08.760867] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-27T21:42:08.760941] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-27T21:42:08.761637] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-27T21:42:08.761718] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-27T21:42:08.762433] [DEBUG] [LOCAL ] USAC: Trimmed 35387 records to 21460 (keeping 200 days of data) [2025-10-27T21:42:08.895327] [DEBUG] [LOCAL ] USAC: Primary data saved (21460 records). [2025-10-27T21:42:08.895463] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-27T21:42:08.895571] [INFO ] [MAIN ] Update Progress: 2192/2366 symbols completed. USAC took 31.0s. Estimated remaining: 22m 24s. Rate: 7.8 symbols/min [2025-10-27T21:42:09.087957] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:09.105549] [DEBUG] [LOCAL ] USNA: Loaded 18372 existing records from primary storage. [2025-10-27T21:42:09.105792] [INFO ] [MAIN ] USNA: Loaded 18372 existing records. [2025-10-27T21:42:09.220031] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-27T21:42:09.280538] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:09.280900] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-27T21:42:09.280953] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-27T21:42:09.281106] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-27T21:42:09.281142] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-27T21:42:09.629011] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:42:10.014979] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-27T21:42:10.357991] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-27T21:42:10.715081] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T21:42:10.723012] [INFO ] [REMOTE ] USA: Full fetch complete (52575 records). [2025-10-27T21:42:10.723114] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-27T21:42:10.820070] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-27T21:42:11.103720] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-27T21:42:11.103804] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-27T21:42:11.104812] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-27T21:42:11.104874] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-27T21:42:11.105896] [DEBUG] [LOCAL ] USA: Trimmed 52575 records to 36172 (keeping 200 days of data) [2025-10-27T21:42:11.312371] [DEBUG] [LOCAL ] USA: Primary data saved (36172 records). [2025-10-27T21:42:11.312569] [INFO ] [MAIN ] USA: Full history saved. [2025-10-27T21:42:11.312692] [INFO ] [MAIN ] Update Progress: 2193/2366 symbols completed. USA took 35.0s. Estimated remaining: 22m 15s. Rate: 7.8 symbols/min [2025-10-27T21:42:11.487265] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:11.525987] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T21:42:11.553316] [DEBUG] [LOCAL ] USPH: Loaded 17161 existing records from primary storage. [2025-10-27T21:42:11.553558] [INFO ] [MAIN ] USPH: Loaded 17161 existing records. [2025-10-27T21:42:11.620088] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-27T21:42:11.734310] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:11.734524] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-27T21:42:11.734616] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-27T21:42:11.734857] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-27T21:42:11.734912] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-27T21:42:11.921154] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-27T21:42:12.099570] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:42:12.414943] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-27T21:42:13.070457] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T21:42:13.214937] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-27T21:42:13.607617] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-27T21:42:13.618255] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-27T21:42:13.618379] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-27T21:42:14.024622] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-27T21:42:14.028467] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-27T21:42:14.028585] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-27T21:42:14.030017] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-27T21:42:14.030177] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-27T21:42:14.032313] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-27T21:42:14.147823] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T21:42:14.390453] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-27T21:42:14.390578] [INFO ] [MAIN ] USB: Full history saved. [2025-10-27T21:42:14.391019] [INFO ] [MAIN ] Update Progress: 2194/2366 symbols completed. USB took 26.7s. Estimated remaining: 22m 7s. Rate: 7.8 symbols/min [2025-10-27T21:42:14.566894] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:14.598625] [DEBUG] [LOCAL ] UTF: Loaded 31575 existing records from primary storage. [2025-10-27T21:42:14.598906] [INFO ] [MAIN ] UTF: Loaded 31575 existing records. [2025-10-27T21:42:14.786539] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:14.786800] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-27T21:42:14.786869] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-27T21:42:14.787189] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-27T21:42:14.787265] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-27T21:42:14.820050] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-27T21:42:14.961115] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T21:42:15.184506] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:42:15.615000] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-27T21:42:16.394175] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-27T21:42:16.420531] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-27T21:42:16.454214] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T21:42:17.215902] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-27T21:42:17.221158] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-27T21:42:17.798301] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-27T21:42:18.014967] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-27T21:42:18.814981] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-27T21:42:18.933569] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-27T21:42:19.614948] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-27T21:42:20.414975] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-27T21:42:20.922976] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T21:42:21.055611] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-27T21:42:21.214925] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-27T21:42:21.675217] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-27T21:42:21.712697] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-27T21:42:22.014958] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-27T21:42:22.668796] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T21:42:22.814942] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-27T21:42:23.546016] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-27T21:42:23.614908] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-27T21:42:24.329781] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-27T21:42:24.414932] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-27T21:42:25.061340] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-27T21:42:25.214960] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-27T21:42:26.014960] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-27T21:42:26.638941] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-27T21:42:26.749850] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-27T21:42:26.814911] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-27T21:42:27.614978] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-27T21:42:28.415002] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-27T21:42:28.456237] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T21:42:28.465876] [INFO ] [REMOTE ] USFD: Full fetch complete (74272 records). [2025-10-27T21:42:28.466040] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-27T21:42:28.840042] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T21:42:28.884729] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-27T21:42:28.884814] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-27T21:42:28.885949] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-27T21:42:28.886012] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-27T21:42:28.887385] [DEBUG] [LOCAL ] USFD: Trimmed 74272 records to 51030 (keeping 200 days of data) [2025-10-27T21:42:29.177918] [DEBUG] [LOCAL ] USFD: Primary data saved (51030 records). [2025-10-27T21:42:29.178017] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-27T21:42:29.178093] [INFO ] [MAIN ] Update Progress: 2195/2366 symbols completed. USFD took 34.0s. Estimated remaining: 22m 0s. Rate: 7.8 symbols/min [2025-10-27T21:42:29.220288] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-27T21:42:29.350010] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:29.386490] [DEBUG] [LOCAL ] UTI: Loaded 40977 existing records from primary storage. [2025-10-27T21:42:29.386813] [INFO ] [MAIN ] UTI: Loaded 40977 existing records. [2025-10-27T21:42:29.541252] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-27T21:42:29.602896] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:29.603202] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-27T21:42:29.603259] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-27T21:42:29.603532] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-27T21:42:29.603588] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-27T21:42:29.943515] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:42:30.014901] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-27T21:42:30.208870] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T21:42:30.814945] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-27T21:42:30.948996] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T21:42:31.614946] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-27T21:42:32.137995] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T21:42:32.414993] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-27T21:42:32.496152] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T21:42:33.214952] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-27T21:42:33.921020] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-27T21:42:33.938615] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T21:42:34.014907] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-27T21:42:34.814952] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-27T21:42:35.460431] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T21:42:35.614940] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-27T21:42:36.016336] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T21:42:36.414980] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-27T21:42:36.793594] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T21:42:37.214960] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-27T21:42:37.559186] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:42:37.563748] [INFO ] [REMOTE ] USNA: Full fetch complete (27308 records). [2025-10-27T21:42:37.563830] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-27T21:42:37.934879] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-27T21:42:37.934964] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-27T21:42:37.935596] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-27T21:42:37.935637] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-27T21:42:37.936387] [DEBUG] [LOCAL ] USNA: Trimmed 27308 records to 17931 (keeping 200 days of data) [2025-10-27T21:42:38.017579] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-27T21:42:38.041185] [DEBUG] [LOCAL ] USNA: Primary data saved (17931 records). [2025-10-27T21:42:38.041334] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-27T21:42:38.041418] [INFO ] [MAIN ] Update Progress: 2196/2366 symbols completed. USNA took 29.1s. Estimated remaining: 21m 53s. Rate: 7.8 symbols/min [2025-10-27T21:42:38.220219] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:38.233802] [DEBUG] [LOCAL ] UTL: Loaded 11946 existing records from primary storage. [2025-10-27T21:42:38.234181] [INFO ] [MAIN ] UTL: Loaded 11946 existing records. [2025-10-27T21:42:38.351697] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-27T21:42:38.435935] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:38.436216] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-27T21:42:38.436266] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-27T21:42:38.436426] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-27T21:42:38.436465] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-27T21:42:38.789544] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:42:38.814899] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-27T21:42:39.324067] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-27T21:42:39.608938] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T21:42:39.618708] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-27T21:42:40.165503] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-27T21:42:40.414949] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-27T21:42:41.214920] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-27T21:42:41.347250] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-27T21:42:42.014943] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-27T21:42:42.242679] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T21:42:42.606931] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-27T21:42:42.814928] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-27T21:42:43.440498] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T21:42:43.443968] [INFO ] [REMOTE ] USPH: Full fetch complete (23002 records). [2025-10-27T21:42:43.444040] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-27T21:42:43.615676] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-27T21:42:43.837218] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-27T21:42:43.837289] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-27T21:42:43.837778] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-27T21:42:43.837838] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-27T21:42:43.838393] [DEBUG] [LOCAL ] USPH: Trimmed 23002 records to 16747 (keeping 200 days of data) [2025-10-27T21:42:43.936504] [DEBUG] [LOCAL ] USPH: Primary data saved (16747 records). [2025-10-27T21:42:43.936667] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-27T21:42:43.936763] [INFO ] [MAIN ] Update Progress: 2197/2366 symbols completed. USPH took 32.6s. Estimated remaining: 21m 45s. Rate: 7.8 symbols/min [2025-10-27T21:42:44.414939] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-27T21:42:44.493359] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T21:42:45.171563] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-27T21:42:45.214979] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-27T21:42:46.014941] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-27T21:42:46.294453] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T21:42:46.603743] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-27T21:42:46.814955] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-27T21:42:47.598724] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-27T21:42:47.614912] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-27T21:42:48.379496] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T21:42:48.414896] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-27T21:42:49.214942] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-27T21:42:49.843692] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T21:42:49.856689] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-27T21:42:50.014945] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-27T21:42:50.814926] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-27T21:42:51.228571] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T21:42:51.237104] [INFO ] [REMOTE ] UTF: Full fetch complete (44217 records). [2025-10-27T21:42:51.237198] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-27T21:42:51.622935] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-27T21:42:51.627394] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T21:42:51.641681] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-27T21:42:51.645956] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-27T21:42:51.647619] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-27T21:42:51.647810] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-27T21:42:51.648947] [DEBUG] [LOCAL ] UTF: Trimmed 44217 records to 31007 (keeping 200 days of data) [2025-10-27T21:42:51.856987] [DEBUG] [LOCAL ] UTF: Primary data saved (31007 records). [2025-10-27T21:42:51.857154] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-27T21:42:51.857247] [INFO ] [MAIN ] Update Progress: 2198/2366 symbols completed. UTF took 37.5s. Estimated remaining: 21m 37s. Rate: 7.8 symbols/min [2025-10-27T21:42:52.414961] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-27T21:42:52.830789] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T21:42:53.034223] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-27T21:42:53.214963] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-27T21:42:54.014974] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-27T21:42:54.589484] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-27T21:42:54.636219] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T21:42:54.814949] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-27T21:42:55.615011] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-27T21:42:55.954835] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:42:55.963341] [INFO ] [REMOTE ] UTI: Full fetch complete (59046 records). [2025-10-27T21:42:55.963517] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-27T21:42:56.375504] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-27T21:42:56.375657] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-27T21:42:56.377468] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-27T21:42:56.377533] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-27T21:42:56.379315] [DEBUG] [LOCAL ] UTI: Trimmed 59046 records to 40222 (keeping 200 days of data) [2025-10-27T21:42:56.627011] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-27T21:42:56.651697] [INFO ] [REMOTE ] UTL: Full fetch complete (15874 records). [2025-10-27T21:42:56.651814] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-27T21:42:56.651502] [DEBUG] [LOCAL ] UTI: Primary data saved (40222 records). [2025-10-27T21:42:56.652193] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-27T21:42:56.683059] [INFO ] [MAIN ] Update Progress: 2199/2366 symbols completed. UTI took 27.5s. Estimated remaining: 21m 29s. Rate: 7.8 symbols/min [2025-10-27T21:42:57.020319] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-27T21:42:57.020399] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-27T21:42:57.020868] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-27T21:42:57.020929] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-27T21:42:57.021444] [DEBUG] [LOCAL ] UTL: Trimmed 15874 records to 11797 (keeping 200 days of data) [2025-10-27T21:42:57.090554] [DEBUG] [LOCAL ] UTL: Primary data saved (11797 records). [2025-10-27T21:42:57.090717] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-27T21:42:57.090808] [INFO ] [MAIN ] Update Progress: 2200/2366 symbols completed. UTL took 19.0s. Estimated remaining: 21m 21s. Rate: 7.8 symbols/min [2025-10-27T21:42:57.689772] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:57.742707] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:57.806285] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:57.808229] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:42:57.840996] [DEBUG] [LOCAL ] UVV: Loaded 22966 existing records from primary storage. [2025-10-27T21:42:57.849190] [INFO ] [MAIN ] UVV: Loaded 22966 existing records. [2025-10-27T21:42:57.849672] [DEBUG] [LOCAL ] UVE: Loaded 22288 existing records from primary storage. [2025-10-27T21:42:57.866791] [INFO ] [MAIN ] UVE: Loaded 22288 existing records. [2025-10-27T21:42:58.135252] [DEBUG] [LOCAL ] UTZ: Loaded 44785 existing records from primary storage. [2025-10-27T21:42:58.137057] [DEBUG] [LOCAL ] UWMC: Loaded 53737 existing records from primary storage. [2025-10-27T21:42:58.137888] [INFO ] [MAIN ] UTZ: Loaded 44785 existing records. [2025-10-27T21:42:58.160029] [INFO ] [MAIN ] UWMC: Loaded 53737 existing records. [2025-10-27T21:42:58.346253] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:58.377947] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-27T21:42:58.437451] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-27T21:42:58.522629] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-27T21:42:58.522811] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-27T21:42:58.522466] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:58.558741] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-27T21:42:58.579691] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-27T21:42:58.765109] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-27T21:42:58.812616] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-27T21:42:58.795583] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:58.846177] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-27T21:42:58.865290] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-27T21:42:58.884686] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-27T21:42:58.921908] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-27T21:42:58.921754] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:42:58.943922] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-27T21:42:58.999512] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-27T21:42:59.096341] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-27T21:42:59.157487] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-27T21:42:59.945808] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:00.044227] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-27T21:43:00.121916] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:00.201268] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-27T21:43:00.237519] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:00.242271] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-27T21:43:00.324486] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:00.324827] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-27T21:43:01.260738] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T21:43:01.265137] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-27T21:43:01.340856] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:43:01.346221] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-27T21:43:01.459309] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T21:43:01.468365] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-27T21:43:01.723763] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T21:43:01.894472] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T21:43:02.014970] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-27T21:43:02.113050] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:43:02.489580] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-27T21:43:02.814984] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-27T21:43:03.514047] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T21:43:03.615008] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-27T21:43:04.058991] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T21:43:04.318991] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T21:43:04.415041] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-27T21:43:05.214951] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-27T21:43:05.882883] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T21:43:06.014982] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-27T21:43:06.553396] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T21:43:06.685635] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-27T21:43:06.814935] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-27T21:43:07.614961] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-27T21:43:07.652666] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T21:43:08.414941] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-27T21:43:08.746906] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-27T21:43:09.173272] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-27T21:43:09.214917] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-27T21:43:10.014967] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-27T21:43:10.808186] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:43:10.819761] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-27T21:43:11.460713] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-27T21:43:11.521893] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-27T21:43:11.614902] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-27T21:43:12.414918] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-27T21:43:12.715912] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T21:43:13.169027] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T21:43:13.214971] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-27T21:43:14.014937] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-27T21:43:14.819407] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-27T21:43:14.838183] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T21:43:14.851250] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-27T21:43:15.619997] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-27T21:43:15.623764] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-27T21:43:16.420006] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-27T21:43:16.429004] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-27T21:43:17.214936] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-27T21:43:17.906910] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:43:17.930957] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-27T21:43:18.014915] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-27T21:43:18.732446] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T21:43:18.736423] [INFO ] [REMOTE ] UVV: Full fetch complete (30223 records). [2025-10-27T21:43:18.736496] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-27T21:43:18.820130] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-27T21:43:19.150849] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-27T21:43:19.150948] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-27T21:43:19.151689] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-27T21:43:19.151777] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-27T21:43:19.152855] [DEBUG] [LOCAL ] UVV: Trimmed 30223 records to 22553 (keeping 200 days of data) [2025-10-27T21:43:19.299541] [DEBUG] [LOCAL ] UVV: Primary data saved (22553 records). [2025-10-27T21:43:19.299691] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-27T21:43:19.299787] [INFO ] [MAIN ] Update Progress: 2201/2366 symbols completed. UVV took 22.2s. Estimated remaining: 21m 14s. Rate: 7.8 symbols/min [2025-10-27T21:43:19.468768] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:19.476404] [DEBUG] [LOCAL ] UZD: Loaded 5808 existing records from primary storage. [2025-10-27T21:43:19.476574] [INFO ] [MAIN ] UZD: Loaded 5808 existing records. [2025-10-27T21:43:19.621740] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-27T21:43:19.651208] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:19.651493] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-27T21:43:19.651538] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-27T21:43:19.651739] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-27T21:43:19.651794] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-27T21:43:20.001186] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:20.057331] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-27T21:43:20.414952] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-27T21:43:21.034196] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:43:21.214956] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-27T21:43:21.589319] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:43:21.649232] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-27T21:43:22.014983] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-27T21:43:22.814931] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-27T21:43:23.224918] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-27T21:43:23.614944] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-27T21:43:23.902992] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T21:43:24.235153] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T21:43:24.414935] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-27T21:43:25.214964] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-27T21:43:25.697689] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T21:43:25.905486] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T21:43:26.014968] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-27T21:43:26.814957] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-27T21:43:27.042804] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T21:43:27.050501] [INFO ] [REMOTE ] UTZ: Full fetch complete (64368 records). [2025-10-27T21:43:27.050619] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-27T21:43:27.439914] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-27T21:43:27.440503] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-27T21:43:27.441698] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-27T21:43:27.442021] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-27T21:43:27.441923] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T21:43:27.445433] [DEBUG] [LOCAL ] UTZ: Trimmed 64368 records to 44017 (keeping 200 days of data) [2025-10-27T21:43:27.617677] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-27T21:43:27.718444] [DEBUG] [LOCAL ] UTZ: Primary data saved (44017 records). [2025-10-27T21:43:27.718587] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-27T21:43:27.718692] [INFO ] [MAIN ] Update Progress: 2202/2366 symbols completed. UTZ took 30.6s. Estimated remaining: 21m 6s. Rate: 7.8 symbols/min [2025-10-27T21:43:27.890046] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:27.899674] [DEBUG] [LOCAL ] UZE: Loaded 6962 existing records from primary storage. [2025-10-27T21:43:27.899866] [INFO ] [MAIN ] UZE: Loaded 6962 existing records. [2025-10-27T21:43:28.103015] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:28.103260] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-27T21:43:28.103309] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-27T21:43:28.103516] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-27T21:43:28.103574] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-27T21:43:28.421182] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-27T21:43:28.516156] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:29.214930] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-27T21:43:29.469802] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T21:43:29.494248] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T21:43:29.811998] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T21:43:30.014986] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-27T21:43:30.683490] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T21:43:30.814927] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-27T21:43:31.579180] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-27T21:43:31.583727] [INFO ] [REMOTE ] UVE: Full fetch complete (30482 records). [2025-10-27T21:43:31.583804] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-27T21:43:31.620216] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-27T21:43:31.961458] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-27T21:43:31.961536] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-27T21:43:31.962256] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-27T21:43:31.962317] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-27T21:43:31.963095] [DEBUG] [LOCAL ] UVE: Trimmed 30482 records to 21970 (keeping 200 days of data) [2025-10-27T21:43:32.097870] [DEBUG] [LOCAL ] UVE: Primary data saved (21970 records). [2025-10-27T21:43:32.098006] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-27T21:43:32.098085] [INFO ] [MAIN ] Update Progress: 2203/2366 symbols completed. UVE took 35.0s. Estimated remaining: 20m 59s. Rate: 7.8 symbols/min [2025-10-27T21:43:32.268327] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T21:43:32.271508] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:32.273526] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-27T21:43:32.274020] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-27T21:43:32.274153] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-27T21:43:32.274195] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-27T21:43:32.274237] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-27T21:43:32.274272] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-27T21:43:32.420084] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-27T21:43:32.621481] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:33.025709] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-27T21:43:33.214990] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-27T21:43:33.616263] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-27T21:43:34.014937] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-27T21:43:34.814967] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-27T21:43:35.341748] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T21:43:35.614976] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-27T21:43:35.824574] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-27T21:43:36.255874] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-27T21:43:36.414916] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-27T21:43:36.856445] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-27T21:43:36.857451] [INFO ] [REMOTE ] UZD: Full fetch complete (8750 records). [2025-10-27T21:43:36.857519] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-27T21:43:37.204151] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-27T21:43:37.204225] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-27T21:43:37.204473] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-27T21:43:37.204512] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-27T21:43:37.204970] [DEBUG] [LOCAL ] UZD: Trimmed 8750 records to 5613 (keeping 200 days of data) [2025-10-27T21:43:37.218971] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-27T21:43:37.239508] [DEBUG] [LOCAL ] UZD: Primary data saved (5613 records). [2025-10-27T21:43:37.239588] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-27T21:43:37.239682] [INFO ] [MAIN ] Update Progress: 2204/2366 symbols completed. UZD took 17.9s. Estimated remaining: 20m 51s. Rate: 7.8 symbols/min [2025-10-27T21:43:37.409117] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:37.457875] [DEBUG] [LOCAL ] V: Loaded 54526 existing records from primary storage. [2025-10-27T21:43:37.458182] [INFO ] [MAIN ] V: Loaded 54526 existing records. [2025-10-27T21:43:37.628555] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:37.628778] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-27T21:43:37.628827] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-27T21:43:37.629074] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-27T21:43:37.629129] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-27T21:43:37.738265] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T21:43:37.986054] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:38.014909] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-27T21:43:38.814938] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-27T21:43:39.177017] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-27T21:43:39.614909] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-27T21:43:40.096344] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-27T21:43:40.193326] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-27T21:43:40.414947] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-27T21:43:40.872814] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T21:43:41.214948] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-27T21:43:41.830680] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T21:43:42.014979] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-27T21:43:42.433293] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T21:43:42.814979] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-27T21:43:43.280666] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T21:43:43.614981] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-27T21:43:44.034714] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-27T21:43:44.414951] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-27T21:43:44.806398] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-27T21:43:45.214959] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-27T21:43:46.014959] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-27T21:43:46.462762] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:43:46.523846] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T21:43:46.536476] [INFO ] [REMOTE ] UWMC: Full fetch complete (75939 records). [2025-10-27T21:43:46.536677] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-27T21:43:46.820146] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-27T21:43:46.946320] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-27T21:43:46.946406] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-27T21:43:46.947606] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-27T21:43:46.947692] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-27T21:43:46.949124] [DEBUG] [LOCAL ] UWMC: Trimmed 75939 records to 52956 (keeping 200 days of data) [2025-10-27T21:43:47.251839] [DEBUG] [LOCAL ] UWMC: Primary data saved (52956 records). [2025-10-27T21:43:47.251981] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-27T21:43:47.252766] [INFO ] [MAIN ] Update Progress: 2205/2366 symbols completed. UWMC took 50.1s. Estimated remaining: 20m 43s. Rate: 7.8 symbols/min [2025-10-27T21:43:47.362711] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-27T21:43:47.437137] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:47.473038] [DEBUG] [LOCAL ] VAC: Loaded 34142 existing records from primary storage. [2025-10-27T21:43:47.473424] [INFO ] [MAIN ] VAC: Loaded 34142 existing records. [2025-10-27T21:43:47.626354] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-27T21:43:47.673414] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:47.673629] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-27T21:43:47.673712] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-27T21:43:47.673988] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-27T21:43:47.674056] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-27T21:43:48.027505] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:48.414951] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-27T21:43:49.214955] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-27T21:43:49.256300] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-27T21:43:49.480515] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-27T21:43:49.603127] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-27T21:43:50.015057] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-27T21:43:50.814909] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-27T21:43:51.006746] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-27T21:43:51.614976] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-27T21:43:52.022293] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-27T21:43:52.415006] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-27T21:43:52.790724] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-27T21:43:53.215010] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-27T21:43:53.769888] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T21:43:54.014981] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-27T21:43:54.814911] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-27T21:43:55.047630] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-27T21:43:55.188039] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-27T21:43:55.568476] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-27T21:43:55.614898] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-27T21:43:56.415009] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-27T21:43:56.785504] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:43:56.787879] [INFO ] [REMOTE ] UZE: Full fetch complete (9665 records). [2025-10-27T21:43:56.788018] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-27T21:43:57.237824] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-27T21:43:57.298078] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-27T21:43:57.298246] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-27T21:43:57.298556] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-27T21:43:57.298602] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-27T21:43:57.299271] [DEBUG] [LOCAL ] UZE: Trimmed 9665 records to 6778 (keeping 200 days of data) [2025-10-27T21:43:57.344603] [DEBUG] [LOCAL ] UZE: Primary data saved (6778 records). [2025-10-27T21:43:57.344785] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-27T21:43:57.344876] [INFO ] [MAIN ] Update Progress: 2206/2366 symbols completed. UZE took 29.6s. Estimated remaining: 20m 35s. Rate: 7.8 symbols/min [2025-10-27T21:43:57.548073] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:57.596785] [DEBUG] [LOCAL ] VAL: Loaded 50604 existing records from primary storage. [2025-10-27T21:43:57.597099] [INFO ] [MAIN ] VAL: Loaded 50604 existing records. [2025-10-27T21:43:57.782606] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:57.783023] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-27T21:43:57.783162] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-27T21:43:57.783909] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-27T21:43:57.783967] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-27T21:43:57.836680] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T21:43:57.872190] [INFO ] [REMOTE ] UZF: Full fetch complete (8268 records). [2025-10-27T21:43:57.877562] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-27T21:43:58.048389] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-27T21:43:58.288318] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-27T21:43:58.343350] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T21:43:58.365534] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:43:58.365980] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:43:58.384422] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-27T21:43:58.405250] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-27T21:43:58.426527] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-27T21:43:58.426459] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:58.426743] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-27T21:43:58.426861] [INFO ] [MAIN ] Update Progress: 2207/2366 symbols completed. UZF took 26.3s. Estimated remaining: 20m 27s. Rate: 7.8 symbols/min [2025-10-27T21:43:58.590880] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:43:58.641034] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-27T21:43:58.641328] [INFO ] [MAIN ] VALE: Loaded 54473 existing records. [2025-10-27T21:43:58.812634] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:43:58.812857] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-27T21:43:58.812901] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-27T21:43:58.813080] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-27T21:43:58.813126] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-27T21:43:58.824377] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-27T21:43:59.169467] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:43:59.582884] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-27T21:43:59.614903] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-27T21:44:00.319528] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T21:44:00.414977] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-27T21:44:01.215010] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-27T21:44:01.336297] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T21:44:02.014961] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-27T21:44:02.409355] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-27T21:44:02.814997] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-27T21:44:02.959163] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-27T21:44:03.193491] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T21:44:03.614997] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-27T21:44:04.415081] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-27T21:44:04.866623] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-27T21:44:05.222308] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-27T21:44:05.228730] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-27T21:44:05.403947] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-27T21:44:06.014945] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-27T21:44:06.814948] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-27T21:44:07.567488] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-27T21:44:07.614919] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-27T21:44:08.070174] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-27T21:44:08.415492] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-27T21:44:08.417923] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-27T21:44:09.214942] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-27T21:44:09.616354] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-27T21:44:10.015001] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-27T21:44:10.180096] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T21:44:10.243419] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-27T21:44:10.753513] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T21:44:10.763787] [INFO ] [REMOTE ] V: Full fetch complete (77921 records). [2025-10-27T21:44:10.763922] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-27T21:44:10.820456] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-27T21:44:11.176478] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-27T21:44:11.176562] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-27T21:44:11.177902] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-27T21:44:11.177970] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-27T21:44:11.179460] [DEBUG] [LOCAL ] V: Trimmed 77921 records to 53745 (keeping 200 days of data) [2025-10-27T21:44:11.529813] [DEBUG] [LOCAL ] V: Primary data saved (53745 records). [2025-10-27T21:44:11.529969] [INFO ] [MAIN ] V: Full history saved. [2025-10-27T21:44:11.530079] [INFO ] [MAIN ] Update Progress: 2208/2366 symbols completed. V took 34.3s. Estimated remaining: 20m 20s. Rate: 7.8 symbols/min [2025-10-27T21:44:11.620103] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-27T21:44:11.701437] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:11.708294] [DEBUG] [LOCAL ] VATE: Loaded 5125 existing records from primary storage. [2025-10-27T21:44:11.708513] [INFO ] [MAIN ] VATE: Loaded 5125 existing records. [2025-10-27T21:44:11.882030] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:11.882194] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-27T21:44:11.882239] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-27T21:44:11.882372] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-27T21:44:11.882409] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-27T21:44:12.227241] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:12.333738] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T21:44:12.414923] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-27T21:44:12.558603] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-27T21:44:13.214960] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-27T21:44:13.484201] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:44:14.014973] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-27T21:44:14.188236] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T21:44:14.669984] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T21:44:14.814961] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-27T21:44:15.297905] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-27T21:44:15.614948] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-27T21:44:16.414997] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-27T21:44:17.214915] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-27T21:44:17.253014] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-27T21:44:17.689471] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T21:44:17.919219] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-27T21:44:18.014918] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-27T21:44:18.479308] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T21:44:18.814925] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-27T21:44:19.614945] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-27T21:44:19.742596] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-27T21:44:19.748822] [INFO ] [REMOTE ] VAC: Full fetch complete (48828 records). [2025-10-27T21:44:19.748945] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-27T21:44:20.132305] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-27T21:44:20.132396] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-27T21:44:20.133456] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-27T21:44:20.133536] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-27T21:44:20.134716] [DEBUG] [LOCAL ] VAC: Trimmed 48828 records to 33412 (keeping 200 days of data) [2025-10-27T21:44:20.340330] [DEBUG] [LOCAL ] VAC: Primary data saved (33412 records). [2025-10-27T21:44:20.340464] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-27T21:44:20.340540] [INFO ] [MAIN ] Update Progress: 2209/2366 symbols completed. VAC took 33.1s. Estimated remaining: 20m 12s. Rate: 7.8 symbols/min [2025-10-27T21:44:20.420145] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-27T21:44:20.508350] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:20.517713] [DEBUG] [LOCAL ] VBF: Loaded 7259 existing records from primary storage. [2025-10-27T21:44:20.517937] [INFO ] [MAIN ] VBF: Loaded 7259 existing records. [2025-10-27T21:44:20.687459] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:20.687626] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-27T21:44:20.687707] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-27T21:44:20.687871] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-27T21:44:20.687926] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-27T21:44:21.032666] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:21.139867] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T21:44:21.214904] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-27T21:44:22.015022] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-27T21:44:22.240904] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T21:44:22.433536] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-27T21:44:22.815021] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-27T21:44:23.050864] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T21:44:23.614981] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-27T21:44:24.272940] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T21:44:24.304217] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-27T21:44:24.414937] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-27T21:44:24.925776] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-27T21:44:25.214992] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-27T21:44:26.014968] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-27T21:44:26.412557] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T21:44:26.690267] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T21:44:26.814915] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-27T21:44:27.614955] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-27T21:44:28.305378] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T21:44:28.415023] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-27T21:44:28.839349] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-27T21:44:29.041477] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-27T21:44:29.214904] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-27T21:44:30.014943] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-27T21:44:30.520989] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T21:44:30.814995] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-27T21:44:31.444016] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-27T21:44:31.614925] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-27T21:44:31.643458] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-27T21:44:31.654110] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-27T21:44:31.654235] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-27T21:44:32.065739] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-27T21:44:32.065874] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-27T21:44:32.067083] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-27T21:44:32.067145] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-27T21:44:32.068722] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-27T21:44:32.309167] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-27T21:44:32.389595] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-27T21:44:32.389756] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-27T21:44:32.390525] [INFO ] [MAIN ] Update Progress: 2210/2366 symbols completed. VALE took 34.0s. Estimated remaining: 20m 5s. Rate: 7.8 symbols/min [2025-10-27T21:44:32.420225] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-27T21:44:32.559108] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:32.574378] [DEBUG] [LOCAL ] VCV: Loaded 13331 existing records from primary storage. [2025-10-27T21:44:32.574604] [INFO ] [MAIN ] VCV: Loaded 13331 existing records. [2025-10-27T21:44:32.752973] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:32.753206] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-27T21:44:32.753255] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-27T21:44:32.753430] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-27T21:44:32.753488] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-27T21:44:33.089043] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T21:44:33.120997] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:33.214920] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-27T21:44:33.702657] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-27T21:44:34.014941] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-27T21:44:34.477574] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-27T21:44:34.814946] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-27T21:44:35.337371] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-27T21:44:35.614940] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-27T21:44:36.414942] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-27T21:44:36.539190] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-27T21:44:37.214952] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-27T21:44:37.684678] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T21:44:37.969007] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T21:44:38.014948] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-27T21:44:38.619335] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-27T21:44:38.814977] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-27T21:44:39.433939] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-27T21:44:39.614947] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-27T21:44:40.414953] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-27T21:44:40.856350] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T21:44:40.865700] [INFO ] [REMOTE ] VAL: Full fetch complete (72895 records). [2025-10-27T21:44:40.865857] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-27T21:44:41.220980] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-27T21:44:41.244734] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-27T21:44:41.265874] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-27T21:44:41.266264] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-27T21:44:41.267570] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-27T21:44:41.267669] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-27T21:44:41.269454] [DEBUG] [LOCAL ] VAL: Trimmed 72895 records to 49768 (keeping 200 days of data) [2025-10-27T21:44:41.556050] [DEBUG] [LOCAL ] VAL: Primary data saved (49768 records). [2025-10-27T21:44:41.556179] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-27T21:44:41.556255] [INFO ] [MAIN ] Update Progress: 2211/2366 symbols completed. VAL took 44.2s. Estimated remaining: 19m 57s. Rate: 7.8 symbols/min [2025-10-27T21:44:41.738385] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:41.745515] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T21:44:41.789626] [DEBUG] [LOCAL ] VEEV: Loaded 47767 existing records from primary storage. [2025-10-27T21:44:41.789968] [INFO ] [MAIN ] VEEV: Loaded 47767 existing records. [2025-10-27T21:44:41.977775] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:41.977984] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-27T21:44:41.978031] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-27T21:44:41.978288] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-27T21:44:41.978355] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-27T21:44:42.020070] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-27T21:44:42.206417] [DEBUG] [REMOTE ] VCV: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-27T21:44:42.242778] [WARN ] [REMOTE ] VCV: No data returned for month 2025-07 [2025-10-27T21:44:42.260724] [FATAL] [REMOTE ] VCV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:44:42.262952] [FATAL] [MAIN ] VCV: Failed to fetch primary data. [2025-10-27T21:44:42.268734] [WARN ] [MAIN ] VCV: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:44:42.268840] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-27T21:44:42.268910] [DEBUG] [LOCAL ] VCV: No primary data file found to delete. [2025-10-27T21:44:42.268967] [INFO ] [LOCAL ] VCV: Starting deletion of derivative data. [2025-10-27T21:44:42.269136] [DEBUG] [LOCAL ] VCV: Deleted derivative data file. [2025-10-27T21:44:42.269245] [INFO ] [MAIN ] Update Progress: 2212/2366 symbols completed. VCV took 9.9s. Estimated remaining: 19m 49s. Rate: 7.8 symbols/min [2025-10-27T21:44:42.469182] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:42.524292] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:42.537300] [DEBUG] [LOCAL ] VEL: Loaded 12041 existing records from primary storage. [2025-10-27T21:44:42.537518] [INFO ] [MAIN ] VEL: Loaded 12041 existing records. [2025-10-27T21:44:42.714689] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:42.714932] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-27T21:44:42.714978] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-27T21:44:42.715136] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-27T21:44:42.715174] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-27T21:44:42.820102] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-27T21:44:43.064698] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:43.614949] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-27T21:44:43.615846] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T21:44:44.017826] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-27T21:44:44.019436] [INFO ] [REMOTE ] VATE: Full fetch complete (10698 records). [2025-10-27T21:44:44.019505] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-27T21:44:44.393307] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-27T21:44:44.393403] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-27T21:44:44.393766] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-27T21:44:44.393841] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-27T21:44:44.394524] [DEBUG] [LOCAL ] VATE: Trimmed 10698 records to 4965 (keeping 200 days of data) [2025-10-27T21:44:44.425500] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-27T21:44:44.442192] [DEBUG] [LOCAL ] VATE: Primary data saved (4965 records). [2025-10-27T21:44:44.442322] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-27T21:44:44.442433] [INFO ] [MAIN ] Update Progress: 2213/2366 symbols completed. VATE took 32.9s. Estimated remaining: 19m 41s. Rate: 7.8 symbols/min [2025-10-27T21:44:44.693339] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:44.748307] [DEBUG] [LOCAL ] VET: Loaded 44676 existing records from primary storage. [2025-10-27T21:44:44.748788] [INFO ] [MAIN ] VET: Loaded 44676 existing records. [2025-10-27T21:44:44.993815] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:44.994069] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-27T21:44:44.994130] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-27T21:44:44.994427] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-27T21:44:44.994496] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-27T21:44:45.216573] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-27T21:44:45.251418] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T21:44:45.500100] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:46.014989] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-27T21:44:46.074318] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:44:46.554672] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-27T21:44:46.557118] [INFO ] [REMOTE ] VBF: Full fetch complete (10922 records). [2025-10-27T21:44:46.557188] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-27T21:44:46.820166] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-27T21:44:46.913345] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-27T21:44:46.913426] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-27T21:44:46.913777] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-27T21:44:46.913839] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-27T21:44:46.914274] [DEBUG] [LOCAL ] VBF: Trimmed 10922 records to 7091 (keeping 200 days of data) [2025-10-27T21:44:46.960609] [DEBUG] [LOCAL ] VBF: Primary data saved (7091 records). [2025-10-27T21:44:46.960826] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-27T21:44:46.960916] [INFO ] [MAIN ] Update Progress: 2214/2366 symbols completed. VBF took 26.6s. Estimated remaining: 19m 33s. Rate: 7.8 symbols/min [2025-10-27T21:44:47.131660] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:44:47.182527] [DEBUG] [LOCAL ] VFC: Loaded 54386 existing records from primary storage. [2025-10-27T21:44:47.182893] [INFO ] [MAIN ] VFC: Loaded 54386 existing records. [2025-10-27T21:44:47.344929] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T21:44:47.378815] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:44:47.379052] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-27T21:44:47.379110] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-27T21:44:47.379296] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-27T21:44:47.379335] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-27T21:44:47.620217] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-27T21:44:47.738445] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:44:48.414971] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-27T21:44:48.990488] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T21:44:49.214946] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-27T21:44:49.840429] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:44:50.014956] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-27T21:44:50.815771] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-27T21:44:50.815703] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T21:44:50.887675] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-27T21:44:51.614945] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-27T21:44:52.415051] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-27T21:44:52.571358] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T21:44:52.719563] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T21:44:52.962183] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-27T21:44:53.214938] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-27T21:44:54.014972] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-27T21:44:54.720162] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-27T21:44:54.814959] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-27T21:44:55.174764] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T21:44:55.614939] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-27T21:44:56.414959] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-27T21:44:56.525482] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T21:44:56.964431] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T21:44:57.203622] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T21:44:57.214892] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-27T21:44:58.014936] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-27T21:44:58.815015] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-27T21:44:58.863708] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T21:44:59.447748] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T21:44:59.604375] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T21:44:59.614995] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-27T21:45:00.171782] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T21:45:00.414916] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-27T21:45:00.931007] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-27T21:45:01.214968] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-27T21:45:01.972937] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-27T21:45:02.014985] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-27T21:45:02.527683] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-27T21:45:02.530161] [INFO ] [REMOTE ] VEL: Full fetch complete (17165 records). [2025-10-27T21:45:02.530228] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-27T21:45:02.820064] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-27T21:45:02.885295] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-27T21:45:02.885369] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-27T21:45:02.885764] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-27T21:45:02.885824] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-27T21:45:02.886357] [DEBUG] [LOCAL ] VEL: Trimmed 17165 records to 11745 (keeping 200 days of data) [2025-10-27T21:45:02.953892] [DEBUG] [LOCAL ] VEL: Primary data saved (11745 records). [2025-10-27T21:45:02.954017] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-27T21:45:02.954098] [INFO ] [MAIN ] Update Progress: 2215/2366 symbols completed. VEL took 20.7s. Estimated remaining: 19m 26s. Rate: 7.8 symbols/min [2025-10-27T21:45:03.118527] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:03.118698] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-27T21:45:03.118747] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-27T21:45:03.118852] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-27T21:45:03.118893] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-27T21:45:03.118933] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-27T21:45:03.118964] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-27T21:45:03.476487] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:03.614939] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-10-27T21:45:04.310794] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:45:04.311600] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-27T21:45:04.414950] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-10-27T21:45:05.214945] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-27T21:45:06.014980] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-27T21:45:06.232410] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-27T21:45:06.797094] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:45:06.814908] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-10-27T21:45:07.614959] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-27T21:45:07.745542] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-27T21:45:08.414949] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-27T21:45:09.057466] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-27T21:45:09.134062] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T21:45:09.214952] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-27T21:45:09.694025] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-27T21:45:10.014941] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-27T21:45:10.660358] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:45:10.814971] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-27T21:45:11.525219] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:45:11.614937] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-27T21:45:12.402505] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-27T21:45:12.414916] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-27T21:45:13.165459] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-27T21:45:13.214908] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-10-27T21:45:14.015005] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-27T21:45:14.137382] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-27T21:45:14.814943] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-27T21:45:15.268113] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-27T21:45:15.573281] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-27T21:45:15.614902] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-27T21:45:16.151989] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T21:45:16.414934] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-27T21:45:16.779560] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:45:16.788198] [INFO ] [REMOTE ] VET: Full fetch complete (64455 records). [2025-10-27T21:45:16.788296] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-27T21:45:17.184784] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-27T21:45:17.184884] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-27T21:45:17.185957] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-27T21:45:17.186017] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-27T21:45:17.187226] [DEBUG] [LOCAL ] VET: Trimmed 64455 records to 43843 (keeping 200 days of data) [2025-10-27T21:45:17.233622] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-10-27T21:45:17.435200] [DEBUG] [LOCAL ] VET: Primary data saved (43843 records). [2025-10-27T21:45:17.435316] [INFO ] [MAIN ] VET: Full history saved. [2025-10-27T21:45:17.435400] [INFO ] [MAIN ] Update Progress: 2216/2366 symbols completed. VET took 33.0s. Estimated remaining: 19m 18s. Rate: 7.8 symbols/min [2025-10-27T21:45:17.597631] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:17.603621] [DEBUG] [LOCAL ] VGI: Loaded 5258 existing records from primary storage. [2025-10-27T21:45:17.603809] [INFO ] [MAIN ] VGI: Loaded 5258 existing records. [2025-10-27T21:45:17.782667] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:17.783564] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-27T21:45:17.783635] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-27T21:45:17.784351] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-27T21:45:17.784407] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-27T21:45:18.021437] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-27T21:45:18.161154] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T21:45:18.166587] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:18.814901] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-27T21:45:19.223785] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-27T21:45:19.561285] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T21:45:19.614901] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-27T21:45:20.262513] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:45:20.414941] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-27T21:45:21.001202] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T21:45:21.011322] [INFO ] [REMOTE ] VFC: Full fetch complete (77753 records). [2025-10-27T21:45:21.011434] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-27T21:45:21.223616] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-10-27T21:45:21.443899] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-27T21:45:21.443985] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-27T21:45:21.445168] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-27T21:45:21.445238] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-27T21:45:21.446758] [DEBUG] [LOCAL ] VFC: Trimmed 77753 records to 53610 (keeping 200 days of data) [2025-10-27T21:45:21.775325] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-10-27T21:45:21.775537] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-27T21:45:21.776490] [INFO ] [MAIN ] Update Progress: 2217/2366 symbols completed. VFC took 34.8s. Estimated remaining: 19m 11s. Rate: 7.8 symbols/min [2025-10-27T21:45:21.923069] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T21:45:21.982244] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:22.001151] [DEBUG] [LOCAL ] VGM: Loaded 18809 existing records from primary storage. [2025-10-27T21:45:22.001387] [INFO ] [MAIN ] VGM: Loaded 18809 existing records. [2025-10-27T21:45:22.021204] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-27T21:45:22.176413] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:22.176592] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-27T21:45:22.176692] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-27T21:45:22.176868] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-27T21:45:22.176906] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-27T21:45:22.518455] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:22.814989] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-27T21:45:22.974536] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-27T21:45:23.488524] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T21:45:23.497428] [INFO ] [REMOTE ] VEEV: Full fetch complete (68212 records). [2025-10-27T21:45:23.497545] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-27T21:45:23.618202] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-27T21:45:23.662713] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-27T21:45:23.905768] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-27T21:45:23.905844] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-27T21:45:23.906940] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-27T21:45:23.906999] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-27T21:45:23.908248] [DEBUG] [LOCAL ] VEEV: Trimmed 68212 records to 46907 (keeping 200 days of data) [2025-10-27T21:45:24.184512] [DEBUG] [LOCAL ] VEEV: Primary data saved (46907 records). [2025-10-27T21:45:24.189397] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-27T21:45:24.190176] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-27T21:45:24.189994] [INFO ] [MAIN ] Update Progress: 2218/2366 symbols completed. VEEV took 42.6s. Estimated remaining: 19m 2s. Rate: 7.8 symbols/min [2025-10-27T21:45:24.365004] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:24.370190] [DEBUG] [LOCAL ] VHI: Loaded 2692 existing records from primary storage. [2025-10-27T21:45:24.370348] [INFO ] [MAIN ] VHI: Loaded 2692 existing records. [2025-10-27T21:45:24.423492] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-27T21:45:24.550990] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:24.551195] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-27T21:45:24.551246] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-27T21:45:24.551380] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-27T21:45:24.551419] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-27T21:45:24.900121] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:24.947991] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-27T21:45:25.214949] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-27T21:45:25.687033] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T21:45:26.014952] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-27T21:45:26.666741] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-27T21:45:26.814942] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-10-27T21:45:27.614963] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-27T21:45:28.082358] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-27T21:45:28.414924] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-27T21:45:28.507950] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T21:45:28.903831] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:45:29.214945] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-27T21:45:29.986910] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-27T21:45:30.014934] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-27T21:45:30.814928] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-10-27T21:45:30.986397] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-27T21:45:31.614951] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-27T21:45:32.010778] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T21:45:32.414923] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-27T21:45:32.774226] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-27T21:45:32.822701] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-27T21:45:33.214935] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-27T21:45:33.564232] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-27T21:45:34.014925] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-10-27T21:45:34.814942] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-27T21:45:35.368317] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T21:45:35.484263] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T21:45:35.614943] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-27T21:45:36.270498] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-27T21:45:36.414942] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-27T21:45:36.775978] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-27T21:45:37.214951] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-27T21:45:37.616887] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:45:38.014936] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-27T21:45:38.396853] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-27T21:45:38.814933] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-27T21:45:39.180108] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-27T21:45:39.614943] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-27T21:45:40.105418] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:45:40.414956] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-27T21:45:40.774447] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T21:45:40.775678] [INFO ] [REMOTE ] VHI: Full fetch complete (4292 records). [2025-10-27T21:45:40.775777] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-27T21:45:41.144768] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-27T21:45:41.144907] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-27T21:45:41.145068] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-27T21:45:41.145110] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-27T21:45:41.145476] [DEBUG] [LOCAL ] VHI: Trimmed 4292 records to 2587 (keeping 200 days of data) [2025-10-27T21:45:41.160944] [DEBUG] [LOCAL ] VHI: Primary data saved (2587 records). [2025-10-27T21:45:41.161022] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-27T21:45:41.161095] [INFO ] [MAIN ] Update Progress: 2219/2366 symbols completed. VHI took 17.0s. Estimated remaining: 18m 55s. Rate: 7.8 symbols/min [2025-10-27T21:45:41.224689] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-27T21:45:41.338009] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:41.338166] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-27T21:45:41.338204] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-27T21:45:41.338318] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-27T21:45:41.338361] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-27T21:45:41.338404] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-27T21:45:41.338437] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-27T21:45:41.695988] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:41.944275] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T21:45:42.014930] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-27T21:45:42.814911] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-10-27T21:45:42.957575] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T21:45:43.036311] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:45:43.036564] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-10-27T21:45:43.036732] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:45:43.036829] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-27T21:45:43.036910] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:45:43.036997] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-27T21:45:43.037073] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-27T21:45:43.037113] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-27T21:45:43.037156] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-27T21:45:43.037202] [INFO ] [MAIN ] Update Progress: 2220/2366 symbols completed. VIA took 1.9s. Estimated remaining: 18m 47s. Rate: 7.8 symbols/min [2025-10-27T21:45:43.221952] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:43.269805] [DEBUG] [LOCAL ] VICI: Loaded 54432 existing records from primary storage. [2025-10-27T21:45:43.270113] [INFO ] [MAIN ] VICI: Loaded 54432 existing records. [2025-10-27T21:45:43.460254] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:43.460552] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-27T21:45:43.460615] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-27T21:45:43.460841] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-27T21:45:43.460903] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-27T21:45:43.621267] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-27T21:45:43.840097] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:44.278024] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-27T21:45:44.414936] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-27T21:45:45.154930] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:45:45.214950] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-27T21:45:46.014933] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-27T21:45:46.364361] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:45:46.814983] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-10. [2025-10-27T21:45:47.587061] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T21:45:47.614904] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-27T21:45:48.282870] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-27T21:45:48.293572] [INFO ] [REMOTE ] VG: Full fetch complete (73858 records). [2025-10-27T21:45:48.293760] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-10-27T21:45:48.420033] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-27T21:45:48.498914] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-27T21:45:48.499824] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:45:48.499900] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:45:48.499973] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-27T21:45:48.500040] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-27T21:45:48.500075] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-27T21:45:48.500113] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-27T21:45:48.500177] [INFO ] [MAIN ] Update Progress: 2221/2366 symbols completed. VG took 45.5s. Estimated remaining: 18m 39s. Rate: 7.8 symbols/min [2025-10-27T21:45:48.672318] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:48.720464] [DEBUG] [LOCAL ] VIK: Loaded 53049 existing records from primary storage. [2025-10-27T21:45:48.720801] [INFO ] [MAIN ] VIK: Loaded 53049 existing records. [2025-10-27T21:45:48.894455] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:48.894682] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-27T21:45:48.894738] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-27T21:45:48.895231] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-27T21:45:48.895287] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-27T21:45:49.253863] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:49.221117] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-27T21:45:49.281953] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T21:45:49.315055] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T21:45:49.642542] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T21:45:49.643939] [INFO ] [REMOTE ] VGI: Full fetch complete (7474 records). [2025-10-27T21:45:49.644009] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-27T21:45:50.002976] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-27T21:45:50.003057] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-27T21:45:50.003241] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-27T21:45:50.003279] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-27T21:45:50.003748] [DEBUG] [LOCAL ] VGI: Trimmed 7474 records to 5101 (keeping 200 days of data) [2025-10-27T21:45:50.015617] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-27T21:45:50.034323] [DEBUG] [LOCAL ] VGI: Primary data saved (5101 records). [2025-10-27T21:45:50.034414] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-27T21:45:50.034487] [INFO ] [MAIN ] Update Progress: 2222/2366 symbols completed. VGI took 32.6s. Estimated remaining: 18m 31s. Rate: 7.8 symbols/min [2025-10-27T21:45:50.206273] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:50.254186] [DEBUG] [LOCAL ] VIPS: Loaded 51979 existing records from primary storage. [2025-10-27T21:45:50.254498] [INFO ] [MAIN ] VIPS: Loaded 51979 existing records. [2025-10-27T21:45:50.435204] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:50.435427] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-27T21:45:50.435474] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-27T21:45:50.435703] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-27T21:45:50.435760] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-27T21:45:50.805762] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T21:45:50.804956] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:50.814900] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-27T21:45:51.473142] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-27T21:45:51.614957] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-27T21:45:52.414966] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-27T21:45:53.214970] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-27T21:45:53.393161] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-27T21:45:53.396800] [INFO ] [REMOTE ] VGM: Full fetch complete (25651 records). [2025-10-27T21:45:53.396876] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-27T21:45:53.765427] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-27T21:45:53.765610] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-27T21:45:53.766228] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-27T21:45:53.776512] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-27T21:45:53.800522] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-27T21:45:53.800778] [DEBUG] [LOCAL ] VGM: Trimmed 25651 records to 18374 (keeping 200 days of data) [2025-10-27T21:45:53.923347] [DEBUG] [LOCAL ] VGM: Primary data saved (18374 records). [2025-10-27T21:45:53.923527] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-27T21:45:53.923665] [INFO ] [MAIN ] Update Progress: 2223/2366 symbols completed. VGM took 32.1s. Estimated remaining: 18m 23s. Rate: 7.8 symbols/min [2025-10-27T21:45:54.020085] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-27T21:45:54.097517] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:45:54.140282] [DEBUG] [LOCAL ] VIRT: Loaded 47117 existing records from primary storage. [2025-10-27T21:45:54.140699] [INFO ] [MAIN ] VIRT: Loaded 47117 existing records. [2025-10-27T21:45:54.317911] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:45:54.318147] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-27T21:45:54.318217] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-27T21:45:54.318429] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-27T21:45:54.318469] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-27T21:45:54.818419] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-27T21:45:54.865932] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:45:54.918090] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T21:45:55.614948] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-27T21:45:55.748483] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T21:45:56.410931] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T21:45:56.420669] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-27T21:45:56.690387] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T21:45:57.214929] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-27T21:45:58.014924] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-27T21:45:58.287703] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-27T21:45:58.386162] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-27T21:45:58.814941] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-27T21:45:59.428778] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:45:59.614970] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-27T21:46:00.162498] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T21:46:00.414963] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-27T21:46:01.049840] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:46:01.214978] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-27T21:46:01.924696] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-27T21:46:02.014977] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-27T21:46:02.814919] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-27T21:46:02.950410] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T21:46:03.299546] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T21:46:03.614954] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-27T21:46:04.423115] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-27T21:46:04.442559] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:46:05.082123] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-27T21:46:05.214935] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-27T21:46:05.697615] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T21:46:06.014932] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-27T21:46:06.814935] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-27T21:46:07.208600] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T21:46:07.279819] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:46:07.614959] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-27T21:46:08.352299] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T21:46:08.414914] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-27T21:46:09.214923] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-27T21:46:09.274998] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T21:46:09.806878] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T21:46:10.014931] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-27T21:46:10.738574] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-27T21:46:10.814945] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-27T21:46:11.434038] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T21:46:11.614932] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-27T21:46:12.228005] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T21:46:12.414971] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-27T21:46:13.214922] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-27T21:46:13.381405] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-27T21:46:13.931545] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T21:46:13.942243] [INFO ] [REMOTE ] VICI: Full fetch complete (77800 records). [2025-10-27T21:46:13.957180] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-27T21:46:13.971572] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-27T21:46:14.015930] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-27T21:46:14.372051] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-27T21:46:14.372149] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-27T21:46:14.373317] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-27T21:46:14.373381] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-27T21:46:14.374842] [DEBUG] [LOCAL ] VICI: Trimmed 77800 records to 53650 (keeping 200 days of data) [2025-10-27T21:46:14.694701] [DEBUG] [LOCAL ] VICI: Primary data saved (53650 records). [2025-10-27T21:46:14.694839] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-27T21:46:14.694916] [INFO ] [MAIN ] Update Progress: 2224/2366 symbols completed. VICI took 31.7s. Estimated remaining: 18m 16s. Rate: 7.8 symbols/min [2025-10-27T21:46:14.820029] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-27T21:46:14.861381] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:14.901982] [DEBUG] [LOCAL ] VIST: Loaded 47407 existing records from primary storage. [2025-10-27T21:46:14.902266] [INFO ] [MAIN ] VIST: Loaded 47407 existing records. [2025-10-27T21:46:15.080750] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:15.080951] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-27T21:46:15.080998] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-27T21:46:15.081212] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-27T21:46:15.081275] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-27T21:46:15.427571] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:15.614946] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-27T21:46:15.949027] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T21:46:16.151230] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-27T21:46:16.414980] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-27T21:46:17.215013] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-27T21:46:17.246425] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T21:46:18.020057] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-27T21:46:18.022835] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T21:46:18.032700] [INFO ] [REMOTE ] VIPS: Full fetch complete (74852 records). [2025-10-27T21:46:18.032818] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-27T21:46:18.434812] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-27T21:46:18.434921] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-27T21:46:18.436262] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-27T21:46:18.436332] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-27T21:46:18.438011] [DEBUG] [LOCAL ] VIPS: Trimmed 74852 records to 51198 (keeping 200 days of data) [2025-10-27T21:46:18.732850] [DEBUG] [LOCAL ] VIPS: Primary data saved (51198 records). [2025-10-27T21:46:18.732967] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-27T21:46:18.733042] [INFO ] [MAIN ] Update Progress: 2225/2366 symbols completed. VIPS took 28.7s. Estimated remaining: 18m 8s. Rate: 7.8 symbols/min [2025-10-27T21:46:18.832254] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-27T21:46:18.905155] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:18.974174] [DEBUG] [LOCAL ] VIV: Loaded 45137 existing records from primary storage. [2025-10-27T21:46:18.975090] [INFO ] [MAIN ] VIV: Loaded 45137 existing records. [2025-10-27T21:46:18.976553] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T21:46:19.165103] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:19.165295] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-27T21:46:19.165342] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-27T21:46:19.165535] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-27T21:46:19.165592] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-27T21:46:19.345313] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T21:46:19.416135] [INFO ] [REMOTE ] VIRT: Full fetch complete (67511 records). [2025-10-27T21:46:19.442082] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-27T21:46:19.622574] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-27T21:46:19.723479] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:19.983828] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-27T21:46:19.983903] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-27T21:46:19.984966] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-27T21:46:19.985027] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-27T21:46:19.986259] [DEBUG] [LOCAL ] VIRT: Trimmed 67511 records to 46273 (keeping 200 days of data) [2025-10-27T21:46:20.260296] [DEBUG] [LOCAL ] VIRT: Primary data saved (46273 records). [2025-10-27T21:46:20.260414] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-27T21:46:20.260497] [INFO ] [MAIN ] Update Progress: 2226/2366 symbols completed. VIRT took 26.3s. Estimated remaining: 18m 0s. Rate: 7.8 symbols/min [2025-10-27T21:46:20.415696] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-27T21:46:20.441871] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:20.459878] [DEBUG] [LOCAL ] VKQ: Loaded 18013 existing records from primary storage. [2025-10-27T21:46:20.460147] [INFO ] [MAIN ] VKQ: Loaded 18013 existing records. [2025-10-27T21:46:20.670469] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-27T21:46:20.675790] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:20.684367] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-27T21:46:20.684435] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-27T21:46:20.684920] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-27T21:46:20.684980] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-27T21:46:21.057997] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:21.119360] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:46:21.214905] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-27T21:46:21.674853] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T21:46:22.014937] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-27T21:46:22.538773] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T21:46:22.557816] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-27T21:46:22.814938] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-27T21:46:23.614951] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-27T21:46:24.334055] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-27T21:46:24.414902] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-27T21:46:24.692341] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T21:46:25.214979] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-27T21:46:26.014960] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-27T21:46:26.084079] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:46:26.621894] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T21:46:26.814949] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-27T21:46:27.352484] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T21:46:27.615143] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-27T21:46:28.424839] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-27T21:46:28.429108] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T21:46:28.473378] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-27T21:46:29.214931] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-27T21:46:29.569095] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:46:30.014963] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-27T21:46:30.271890] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T21:46:30.814959] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-27T21:46:31.211683] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:46:31.614923] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-27T21:46:31.799930] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:46:32.414972] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-27T21:46:32.879613] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T21:46:33.214940] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-27T21:46:33.463761] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T21:46:34.014933] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-27T21:46:34.814990] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-27T21:46:34.915437] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-27T21:46:35.222221] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-27T21:46:35.614930] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-27T21:46:35.895356] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-27T21:46:36.414968] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-27T21:46:36.996466] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-27T21:46:37.214940] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-27T21:46:38.014948] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-27T21:46:38.075030] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-27T21:46:38.814958] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-27T21:46:38.871515] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-27T21:46:39.231200] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T21:46:39.614979] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-27T21:46:40.393894] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-27T21:46:40.414966] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-27T21:46:40.497493] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T21:46:40.507617] [INFO ] [REMOTE ] VIK: Full fetch complete (75852 records). [2025-10-27T21:46:40.507779] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-27T21:46:40.901451] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-27T21:46:40.901558] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-27T21:46:40.902772] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-27T21:46:40.902835] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-27T21:46:40.904308] [DEBUG] [LOCAL ] VIK: Trimmed 75852 records to 52242 (keeping 200 days of data) [2025-10-27T21:46:41.206703] [DEBUG] [LOCAL ] VIK: Primary data saved (52242 records). [2025-10-27T21:46:41.206843] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-27T21:46:41.207329] [INFO ] [MAIN ] Update Progress: 2227/2366 symbols completed. VIK took 52.7s. Estimated remaining: 17m 53s. Rate: 7.8 symbols/min [2025-10-27T21:46:41.220151] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-27T21:46:41.375986] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:41.406497] [DEBUG] [LOCAL ] VLN: Loaded 31504 existing records from primary storage. [2025-10-27T21:46:41.406834] [INFO ] [MAIN ] VLN: Loaded 31504 existing records. [2025-10-27T21:46:41.582236] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:41.582460] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-27T21:46:41.582525] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-27T21:46:41.582731] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-27T21:46:41.582787] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-27T21:46:41.945460] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:41.959180] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-27T21:46:42.014945] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-27T21:46:42.126503] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-27T21:46:42.708920] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-27T21:46:42.716026] [INFO ] [REMOTE ] VKQ: Full fetch complete (24389 records). [2025-10-27T21:46:42.716264] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-27T21:46:42.820207] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-27T21:46:43.214079] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-27T21:46:43.214167] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-27T21:46:43.214761] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-27T21:46:43.214831] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-27T21:46:43.215711] [DEBUG] [LOCAL ] VKQ: Trimmed 24389 records to 17638 (keeping 200 days of data) [2025-10-27T21:46:43.340413] [DEBUG] [LOCAL ] VKQ: Primary data saved (17638 records). [2025-10-27T21:46:43.340609] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-27T21:46:43.340746] [INFO ] [MAIN ] Update Progress: 2228/2366 symbols completed. VKQ took 23.1s. Estimated remaining: 17m 45s. Rate: 7.8 symbols/min [2025-10-27T21:46:43.537070] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:43.588005] [DEBUG] [LOCAL ] VLO: Loaded 53730 existing records from primary storage. [2025-10-27T21:46:43.588346] [INFO ] [MAIN ] VLO: Loaded 53730 existing records. [2025-10-27T21:46:43.624591] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-27T21:46:43.790535] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:43.790775] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-27T21:46:43.790829] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-27T21:46:43.791414] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-27T21:46:43.791455] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-27T21:46:44.197957] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T21:46:44.222180] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:44.414915] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-27T21:46:44.986970] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-27T21:46:44.996290] [INFO ] [REMOTE ] VIST: Full fetch complete (67595 records). [2025-10-27T21:46:44.996412] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-27T21:46:45.220180] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-27T21:46:45.419431] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-27T21:46:45.419548] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-27T21:46:45.420930] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-27T21:46:45.421098] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-27T21:46:45.422513] [DEBUG] [LOCAL ] VIST: Trimmed 67595 records to 46664 (keeping 200 days of data) [2025-10-27T21:46:45.678027] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:46:45.723305] [DEBUG] [LOCAL ] VIST: Primary data saved (46664 records). [2025-10-27T21:46:45.723441] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-27T21:46:45.723524] [INFO ] [MAIN ] Update Progress: 2229/2366 symbols completed. VIST took 31.0s. Estimated remaining: 17m 37s. Rate: 7.8 symbols/min [2025-10-27T21:46:45.892170] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:46:45.929511] [DEBUG] [LOCAL ] VLRS: Loaded 39917 existing records from primary storage. [2025-10-27T21:46:45.929875] [INFO ] [MAIN ] VLRS: Loaded 39917 existing records. [2025-10-27T21:46:46.020154] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-27T21:46:46.122359] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:46:46.122579] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-27T21:46:46.122628] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-27T21:46:46.122884] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-27T21:46:46.122929] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-27T21:46:46.489452] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:46:46.543446] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:46:46.711055] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-27T21:46:46.814945] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-27T21:46:47.586210] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-27T21:46:47.614897] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-27T21:46:48.414934] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-27T21:46:48.720003] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-27T21:46:49.214936] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-27T21:46:49.482472] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:46:50.014939] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-27T21:46:50.814915] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-27T21:46:50.982981] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T21:46:51.114136] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-27T21:46:51.614949] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-27T21:46:51.854010] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T21:46:52.414947] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-27T21:46:52.848518] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-27T21:46:53.214955] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-27T21:46:53.371174] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-27T21:46:54.014959] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-27T21:46:54.766010] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:46:54.814910] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-27T21:46:55.210363] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T21:46:55.614933] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-27T21:46:56.414913] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-27T21:46:56.526942] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-27T21:46:56.887897] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-27T21:46:57.214975] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-27T21:46:57.863149] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T21:46:58.015007] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-27T21:46:58.571374] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T21:46:58.814948] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-27T21:46:59.374050] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T21:46:59.614988] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-27T21:46:59.850816] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T21:46:59.860501] [INFO ] [REMOTE ] VLN: Full fetch complete (43141 records). [2025-10-27T21:46:59.860779] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-27T21:47:00.270283] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-27T21:47:00.270390] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-27T21:47:00.271415] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-27T21:47:00.271490] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-27T21:47:00.272861] [DEBUG] [LOCAL ] VLN: Trimmed 43141 records to 31215 (keeping 200 days of data) [2025-10-27T21:47:00.425299] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-27T21:47:00.444612] [DEBUG] [LOCAL ] VLN: Primary data saved (31215 records). [2025-10-27T21:47:00.445556] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-27T21:47:00.445669] [INFO ] [MAIN ] Update Progress: 2230/2366 symbols completed. VLN took 19.2s. Estimated remaining: 17m 30s. Rate: 7.8 symbols/min [2025-10-27T21:47:00.619473] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:00.629570] [DEBUG] [LOCAL ] VLT: Loaded 4325 existing records from primary storage. [2025-10-27T21:47:00.629797] [INFO ] [MAIN ] VLT: Loaded 4325 existing records. [2025-10-27T21:47:00.805707] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:00.805919] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-27T21:47:00.805964] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-27T21:47:00.806145] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-27T21:47:00.806201] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-27T21:47:01.162622] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:01.214897] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-27T21:47:01.267137] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T21:47:01.275402] [INFO ] [REMOTE ] VIV: Full fetch complete (64315 records). [2025-10-27T21:47:01.275522] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-27T21:47:01.665923] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-27T21:47:01.665996] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-27T21:47:01.667138] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-27T21:47:01.667216] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-27T21:47:01.668430] [DEBUG] [LOCAL ] VIV: Trimmed 64315 records to 44440 (keeping 200 days of data) [2025-10-27T21:47:01.774757] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-27T21:47:01.952728] [DEBUG] [LOCAL ] VIV: Primary data saved (44440 records). [2025-10-27T21:47:01.953031] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-27T21:47:01.953220] [INFO ] [MAIN ] Update Progress: 2231/2366 symbols completed. VIV took 43.2s. Estimated remaining: 17m 22s. Rate: 7.8 symbols/min [2025-10-27T21:47:02.025414] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-27T21:47:02.173620] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:02.217363] [DEBUG] [LOCAL ] VLTO: Loaded 46678 existing records from primary storage. [2025-10-27T21:47:02.217796] [INFO ] [MAIN ] VLTO: Loaded 46678 existing records. [2025-10-27T21:47:02.433763] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:02.428714] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T21:47:02.444467] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-27T21:47:02.444946] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-27T21:47:02.445440] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-27T21:47:02.445490] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-27T21:47:02.796220] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:02.814911] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-27T21:47:03.434510] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-27T21:47:03.615000] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-27T21:47:04.184562] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T21:47:04.233163] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-27T21:47:04.414917] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-27T21:47:05.214952] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-27T21:47:05.619854] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-27T21:47:05.948294] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T21:47:06.014942] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-27T21:47:06.814943] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-27T21:47:07.284920] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-27T21:47:07.614924] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-27T21:47:08.031318] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-27T21:47:08.414930] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-27T21:47:09.214928] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-27T21:47:09.425580] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T21:47:09.456384] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T21:47:09.936506] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T21:47:10.014939] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-27T21:47:10.357515] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T21:47:10.814932] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-27T21:47:11.614970] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-27T21:47:12.247313] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T21:47:12.415004] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-27T21:47:12.558333] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-27T21:47:12.973831] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:47:13.214932] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-27T21:47:14.014944] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-27T21:47:14.245844] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-27T21:47:14.252961] [INFO ] [REMOTE ] VLRS: Full fetch complete (58341 records). [2025-10-27T21:47:14.253060] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-27T21:47:14.613807] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-27T21:47:14.659986] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-27T21:47:14.660054] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-27T21:47:14.661060] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-27T21:47:14.661122] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-27T21:47:14.662239] [DEBUG] [LOCAL ] VLRS: Trimmed 58341 records to 39139 (keeping 200 days of data) [2025-10-27T21:47:14.820151] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-27T21:47:14.879219] [DEBUG] [LOCAL ] VLRS: Primary data saved (39139 records). [2025-10-27T21:47:14.879349] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-27T21:47:14.879437] [INFO ] [MAIN ] Update Progress: 2232/2366 symbols completed. VLRS took 29.2s. Estimated remaining: 17m 15s. Rate: 7.8 symbols/min [2025-10-27T21:47:15.053728] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:15.092141] [DEBUG] [LOCAL ] VMC: Loaded 42689 existing records from primary storage. [2025-10-27T21:47:15.092427] [INFO ] [MAIN ] VMC: Loaded 42689 existing records. [2025-10-27T21:47:15.272293] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:15.272533] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-27T21:47:15.272587] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-27T21:47:15.272848] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-27T21:47:15.272908] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-27T21:47:15.621758] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-27T21:47:15.643337] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:16.284624] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-27T21:47:16.414938] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-27T21:47:16.788773] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-27T21:47:17.001037] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T21:47:17.214934] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-27T21:47:18.014950] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-27T21:47:18.411897] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T21:47:18.814918] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-27T21:47:19.016016] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-27T21:47:19.614943] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-27T21:47:20.368558] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-27T21:47:20.414909] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-27T21:47:20.969597] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-27T21:47:21.214987] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-27T21:47:21.724992] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:47:21.812983] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-27T21:47:21.814700] [INFO ] [REMOTE ] VLT: Full fetch complete (7362 records). [2025-10-27T21:47:21.814800] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-27T21:47:22.025142] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-27T21:47:22.199841] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-27T21:47:22.199926] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-27T21:47:22.200181] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-27T21:47:22.200221] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-27T21:47:22.200598] [DEBUG] [LOCAL ] VLT: Trimmed 7362 records to 4125 (keeping 200 days of data) [2025-10-27T21:47:22.225489] [DEBUG] [LOCAL ] VLT: Primary data saved (4125 records). [2025-10-27T21:47:22.225608] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-27T21:47:22.225715] [INFO ] [MAIN ] Update Progress: 2233/2366 symbols completed. VLT took 21.8s. Estimated remaining: 17m 7s. Rate: 7.8 symbols/min [2025-10-27T21:47:22.390904] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:22.407498] [DEBUG] [LOCAL ] VMI: Loaded 15127 existing records from primary storage. [2025-10-27T21:47:22.407772] [INFO ] [MAIN ] VMI: Loaded 15127 existing records. [2025-10-27T21:47:22.580030] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:22.580229] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-27T21:47:22.580275] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-27T21:47:22.580561] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-27T21:47:22.580618] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-27T21:47:22.824418] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-27T21:47:22.929289] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:23.614921] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-27T21:47:23.949155] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:47:24.414930] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-27T21:47:24.494473] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T21:47:24.512608] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-27T21:47:25.214949] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-27T21:47:25.882552] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T21:47:26.014916] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-27T21:47:26.033077] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-27T21:47:26.402490] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-27T21:47:26.412459] [INFO ] [REMOTE ] VLO: Full fetch complete (76893 records). [2025-10-27T21:47:26.412579] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-27T21:47:26.814114] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-27T21:47:26.814214] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-27T21:47:26.815394] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-27T21:47:26.815509] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-27T21:47:26.816568] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-27T21:47:26.818298] [DEBUG] [LOCAL ] VLO: Trimmed 76893 records to 52932 (keeping 200 days of data) [2025-10-27T21:47:27.137809] [DEBUG] [LOCAL ] VLO: Primary data saved (52932 records). [2025-10-27T21:47:27.137942] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-27T21:47:27.138019] [INFO ] [MAIN ] Update Progress: 2234/2366 symbols completed. VLO took 43.8s. Estimated remaining: 16m 59s. Rate: 7.8 symbols/min [2025-10-27T21:47:27.301195] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:27.320460] [DEBUG] [LOCAL ] VMO: Loaded 20898 existing records from primary storage. [2025-10-27T21:47:27.320726] [INFO ] [MAIN ] VMO: Loaded 20898 existing records. [2025-10-27T21:47:27.491051] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:27.491269] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-27T21:47:27.491316] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-27T21:47:27.491501] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-27T21:47:27.491556] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-27T21:47:27.629504] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-27T21:47:27.855302] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:28.324968] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T21:47:28.399895] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:47:28.414905] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-27T21:47:29.214919] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-27T21:47:29.418610] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T21:47:30.014993] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-27T21:47:30.820168] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-27T21:47:30.841524] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T21:47:31.614962] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-27T21:47:31.718159] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T21:47:32.079521] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:47:32.414936] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-27T21:47:32.461501] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T21:47:33.214961] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-27T21:47:33.541047] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-27T21:47:34.014988] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-27T21:47:34.602569] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T21:47:34.814974] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-27T21:47:35.186369] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T21:47:35.614937] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-27T21:47:36.080377] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T21:47:36.414935] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-27T21:47:36.502397] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-27T21:47:36.808995] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-27T21:47:37.214967] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-27T21:47:37.976361] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-27T21:47:38.014901] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-27T21:47:38.623223] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T21:47:38.814950] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-27T21:47:39.614944] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-27T21:47:40.367584] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-27T21:47:40.377461] [INFO ] [REMOTE ] VLTO: Full fetch complete (67340 records). [2025-10-27T21:47:40.377734] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-27T21:47:40.424436] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-27T21:47:40.806670] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-27T21:47:40.806778] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-27T21:47:40.807890] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-27T21:47:40.807970] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-27T21:47:40.823036] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T21:47:40.829236] [DEBUG] [LOCAL ] VLTO: Trimmed 67340 records to 45922 (keeping 200 days of data) [2025-10-27T21:47:41.106351] [DEBUG] [LOCAL ] VLTO: Primary data saved (45922 records). [2025-10-27T21:47:41.106480] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-27T21:47:41.106559] [INFO ] [MAIN ] Update Progress: 2235/2366 symbols completed. VLTO took 39.2s. Estimated remaining: 16m 52s. Rate: 7.8 symbols/min [2025-10-27T21:47:41.220025] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-27T21:47:41.282741] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:41.299017] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T21:47:41.342700] [DEBUG] [LOCAL ] VNO: Loaded 49435 existing records from primary storage. [2025-10-27T21:47:41.343043] [INFO ] [MAIN ] VNO: Loaded 49435 existing records. [2025-10-27T21:47:41.519228] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:41.519453] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-27T21:47:41.519513] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-27T21:47:41.519741] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-27T21:47:41.519796] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-27T21:47:41.864836] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:42.014907] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-27T21:47:42.270503] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T21:47:42.814933] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-27T21:47:43.486407] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T21:47:43.602991] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-27T21:47:43.614899] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-27T21:47:44.414941] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-27T21:47:44.756176] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:47:45.108277] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T21:47:45.214897] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-27T21:47:46.014954] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-27T21:47:46.063742] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T21:47:46.066891] [INFO ] [REMOTE ] VMI: Full fetch complete (21393 records). [2025-10-27T21:47:46.066971] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-27T21:47:46.436532] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-27T21:47:46.436607] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-27T21:47:46.437180] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-27T21:47:46.437231] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-27T21:47:46.437872] [DEBUG] [LOCAL ] VMI: Trimmed 21393 records to 14745 (keeping 200 days of data) [2025-10-27T21:47:46.546062] [DEBUG] [LOCAL ] VMI: Primary data saved (14745 records). [2025-10-27T21:47:46.546219] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-27T21:47:46.546321] [INFO ] [MAIN ] Update Progress: 2236/2366 symbols completed. VMI took 24.3s. Estimated remaining: 16m 44s. Rate: 7.8 symbols/min [2025-10-27T21:47:46.717821] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:47:46.757464] [DEBUG] [LOCAL ] VNT: Loaded 44559 existing records from primary storage. [2025-10-27T21:47:46.757776] [INFO ] [MAIN ] VNT: Loaded 44559 existing records. [2025-10-27T21:47:46.824224] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-27T21:47:46.945888] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:47:46.946717] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-27T21:47:46.946777] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-27T21:47:46.946980] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-27T21:47:46.947038] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-27T21:47:47.308859] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:47:47.373521] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:47:47.489521] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T21:47:47.614958] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-27T21:47:48.414981] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-27T21:47:49.136826] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-27T21:47:49.215006] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-27T21:47:49.752094] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-27T21:47:50.014949] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-27T21:47:50.337244] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T21:47:50.815011] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-27T21:47:51.614941] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-27T21:47:51.879140] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T21:47:52.414979] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-27T21:47:52.444759] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-27T21:47:53.224963] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-27T21:47:53.227856] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T21:47:54.004499] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:47:54.014895] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-27T21:47:54.495786] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-27T21:47:54.814960] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-27T21:47:55.347999] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:47:55.614933] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-27T21:47:55.789346] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T21:47:56.414961] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-27T21:47:56.807164] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:47:57.215033] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-27T21:47:58.014964] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-27T21:47:58.107877] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-27T21:47:58.483568] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-27T21:47:58.814942] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-27T21:47:58.899632] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-27T21:47:59.614953] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-27T21:48:00.037848] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:48:00.264211] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T21:48:00.268329] [INFO ] [REMOTE ] VMO: Full fetch complete (30704 records). [2025-10-27T21:48:00.268473] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-27T21:48:00.426322] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-27T21:48:00.636305] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-27T21:48:00.636386] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-27T21:48:00.637050] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-27T21:48:00.637111] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-27T21:48:00.637860] [DEBUG] [LOCAL ] VMO: Trimmed 30704 records to 20312 (keeping 200 days of data) [2025-10-27T21:48:00.755993] [DEBUG] [LOCAL ] VMO: Primary data saved (20312 records). [2025-10-27T21:48:00.756108] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-27T21:48:00.756181] [INFO ] [MAIN ] Update Progress: 2237/2366 symbols completed. VMO took 33.6s. Estimated remaining: 16m 36s. Rate: 7.8 symbols/min [2025-10-27T21:48:01.214968] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-27T21:48:01.737041] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:48:01.744479] [INFO ] [REMOTE ] VMC: Full fetch complete (62275 records). [2025-10-27T21:48:01.744623] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-27T21:48:02.016184] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-27T21:48:02.168469] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-27T21:48:02.168594] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-27T21:48:02.170014] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-27T21:48:02.170095] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-27T21:48:02.171612] [DEBUG] [LOCAL ] VMC: Trimmed 62275 records to 41857 (keeping 200 days of data) [2025-10-27T21:48:02.306141] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T21:48:02.477662] [DEBUG] [LOCAL ] VMC: Primary data saved (41857 records). [2025-10-27T21:48:02.477795] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-27T21:48:02.477874] [INFO ] [MAIN ] Update Progress: 2238/2366 symbols completed. VMC took 47.6s. Estimated remaining: 16m 28s. Rate: 7.8 symbols/min [2025-10-27T21:48:02.814951] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-27T21:48:03.097013] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T21:48:03.615006] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-27T21:48:04.421692] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T21:48:04.431874] [INFO ] [REMOTE ] VNO: Full fetch complete (70430 records). [2025-10-27T21:48:04.432040] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-27T21:48:04.827812] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-27T21:48:04.827893] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-27T21:48:04.829047] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-27T21:48:04.829108] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-27T21:48:04.830409] [DEBUG] [LOCAL ] VNO: Trimmed 70430 records to 48642 (keeping 200 days of data) [2025-10-27T21:48:05.128973] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T21:48:05.140053] [DEBUG] [LOCAL ] VNO: Primary data saved (48642 records). [2025-10-27T21:48:05.150593] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-27T21:48:05.151004] [INFO ] [MAIN ] Update Progress: 2239/2366 symbols completed. VNO took 24.0s. Estimated remaining: 16m 20s. Rate: 7.8 symbols/min [2025-10-27T21:48:05.151746] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-27T21:48:06.364395] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-27T21:48:06.374748] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-27T21:48:07.429236] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-27T21:48:07.438796] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-27T21:48:08.593375] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-27T21:48:08.602306] [INFO ] [REMOTE ] VNT: Full fetch complete (64244 records). [2025-10-27T21:48:08.602407] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-27T21:48:08.977751] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-27T21:48:08.977837] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-27T21:48:08.978949] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-27T21:48:08.979010] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-27T21:48:08.980220] [DEBUG] [LOCAL ] VNT: Trimmed 64244 records to 43756 (keeping 200 days of data) [2025-10-27T21:48:09.242024] [DEBUG] [LOCAL ] VNT: Primary data saved (43756 records). [2025-10-27T21:48:09.242153] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-27T21:48:09.242678] [INFO ] [MAIN ] Update Progress: 2240/2366 symbols completed. VNT took 22.7s. Estimated remaining: 16m 12s. Rate: 7.8 symbols/min [2025-10-27T21:48:09.889463] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:09.840287] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:09.934454] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:09.963997] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-27T21:48:09.964111] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-27T21:48:09.966445] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-27T21:48:09.966548] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-27T21:48:09.966027] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:09.966979] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-27T21:48:09.967031] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-27T21:48:10.074848] [DEBUG] [LOCAL ] VOC: Loaded 9214 existing records from primary storage. [2025-10-27T21:48:10.091992] [INFO ] [MAIN ] VOC: Loaded 9214 existing records. [2025-10-27T21:48:10.242324] [DEBUG] [LOCAL ] VPG: Loaded 17113 existing records from primary storage. [2025-10-27T21:48:10.339828] [INFO ] [MAIN ] VPG: Loaded 17113 existing records. [2025-10-27T21:48:10.458442] [DEBUG] [LOCAL ] VOYA: Loaded 42281 existing records from primary storage. [2025-10-27T21:48:10.514718] [INFO ] [MAIN ] VOYA: Loaded 42281 existing records. [2025-10-27T21:48:10.546272] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:10.611191] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-27T21:48:10.671431] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-27T21:48:10.735328] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-27T21:48:10.742429] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:10.753195] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-27T21:48:10.764042] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-10-27T21:48:10.895836] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:10.912016] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-27T21:48:10.953715] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-27T21:48:11.006467] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:11.017632] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-27T21:48:11.011681] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-27T21:48:11.025124] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-27T21:48:11.025200] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-27T21:48:11.048445] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-27T21:48:11.054078] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-27T21:48:11.133498] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:48:11.204162] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-10-27T21:48:11.381249] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:48:11.423260] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-27T21:48:11.474791] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:48:11.528381] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-27T21:48:11.534211] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-27T21:48:11.560892] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-27T21:48:11.643695] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-27T21:48:11.665113] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:11.686959] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-27T21:48:11.687111] [INFO ] [MAIN ] Update Progress: 2241/2366 symbols completed. VOYG took 2.4s. Estimated remaining: 16m 4s. Rate: 7.8 symbols/min [2025-10-27T21:48:12.113844] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:12.158007] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-27T21:48:12.207615] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:12.213538] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-27T21:48:12.290484] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:12.299631] [DEBUG] [LOCAL ] VPV: Loaded 5255 existing records from primary storage. [2025-10-27T21:48:12.299958] [INFO ] [MAIN ] VPV: Loaded 5255 existing records. [2025-10-27T21:48:12.494561] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:12.495059] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-27T21:48:12.495155] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-27T21:48:12.495450] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-27T21:48:12.495517] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-27T21:48:12.634735] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-27T21:48:12.648614] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-27T21:48:12.903016] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:12.903470] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-27T21:48:13.071685] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:48:13.074780] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-27T21:48:13.609374] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-27T21:48:13.612228] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-27T21:48:13.655594] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-27T21:48:13.658996] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-27T21:48:13.689446] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T21:48:13.709077] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T21:48:14.014942] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-27T21:48:14.238813] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-27T21:48:14.376287] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-27T21:48:14.814958] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-27T21:48:14.969244] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T21:48:15.615001] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-27T21:48:15.639837] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-27T21:48:16.273380] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-27T21:48:16.414939] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-27T21:48:17.161483] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-27T21:48:17.214907] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-27T21:48:17.744935] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T21:48:18.014948] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-27T21:48:18.814935] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-27T21:48:19.174236] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-27T21:48:19.614940] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-27T21:48:19.898296] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T21:48:20.162067] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T21:48:20.414959] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-27T21:48:20.943623] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-27T21:48:21.214954] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-27T21:48:22.014930] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-27T21:48:22.234753] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T21:48:22.814988] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-27T21:48:23.305003] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:48:23.615038] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-27T21:48:23.682987] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T21:48:24.414965] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-27T21:48:24.436568] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-27T21:48:24.439394] [INFO ] [REMOTE ] VOC: Full fetch complete (13368 records). [2025-10-27T21:48:24.439531] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-27T21:48:24.803346] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-27T21:48:24.803421] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-27T21:48:24.803746] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-27T21:48:24.803806] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-27T21:48:24.804247] [DEBUG] [LOCAL ] VOC: Trimmed 13368 records to 8990 (keeping 200 days of data) [2025-10-27T21:48:24.854481] [DEBUG] [LOCAL ] VOC: Primary data saved (8990 records). [2025-10-27T21:48:24.854609] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-27T21:48:24.854709] [INFO ] [MAIN ] Update Progress: 2242/2366 symbols completed. VOC took 15.6s. Estimated remaining: 15m 57s. Rate: 7.8 symbols/min [2025-10-27T21:48:25.019627] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:25.053784] [DEBUG] [LOCAL ] VRE: Loaded 35725 existing records from primary storage. [2025-10-27T21:48:25.054072] [INFO ] [MAIN ] VRE: Loaded 35725 existing records. [2025-10-27T21:48:25.226708] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-27T21:48:25.235864] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:25.241295] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-27T21:48:25.241371] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-27T21:48:25.247881] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-27T21:48:25.248318] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-27T21:48:25.248761] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T21:48:25.601918] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:25.795125] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-27T21:48:26.014944] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-27T21:48:26.814969] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-27T21:48:26.876769] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-27T21:48:27.614952] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-27T21:48:28.163872] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T21:48:28.398835] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T21:48:28.414902] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-27T21:48:29.214942] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-27T21:48:29.781123] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T21:48:29.855149] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-27T21:48:30.014986] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-27T21:48:30.814998] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-27T21:48:31.500263] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-27T21:48:31.533523] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-27T21:48:31.614963] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-27T21:48:32.414999] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-27T21:48:32.792760] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-27T21:48:33.008490] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T21:48:33.214983] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-27T21:48:33.856998] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-27T21:48:34.014939] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-27T21:48:34.814920] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-27T21:48:34.955398] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-27T21:48:35.614993] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-27T21:48:36.038109] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-27T21:48:36.189151] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-27T21:48:36.414937] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-27T21:48:36.791434] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-27T21:48:37.214996] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-27T21:48:37.901142] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-27T21:48:38.014993] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-27T21:48:38.815004] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-27T21:48:39.075596] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-27T21:48:39.360409] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-27T21:48:39.614929] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-27T21:48:40.220588] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-27T21:48:40.222542] [INFO ] [REMOTE ] VPV: Full fetch complete (8774 records). [2025-10-27T21:48:40.222623] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-27T21:48:40.423600] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-27T21:48:40.582957] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-27T21:48:40.583033] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-27T21:48:40.583252] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-27T21:48:40.583289] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-27T21:48:40.583701] [DEBUG] [LOCAL ] VPV: Trimmed 8774 records to 5024 (keeping 200 days of data) [2025-10-27T21:48:40.612598] [DEBUG] [LOCAL ] VPV: Primary data saved (5024 records). [2025-10-27T21:48:40.612729] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-27T21:48:40.612804] [INFO ] [MAIN ] Update Progress: 2243/2366 symbols completed. VPV took 28.9s. Estimated remaining: 15m 50s. Rate: 7.8 symbols/min [2025-10-27T21:48:40.777106] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:40.827042] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-27T21:48:40.827366] [INFO ] [MAIN ] VRT: Loaded 54533 existing records. [2025-10-27T21:48:40.997736] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:40.997954] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-27T21:48:40.997999] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-27T21:48:40.998199] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-27T21:48:40.998236] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-27T21:48:41.220576] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-27T21:48:41.347429] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:41.448409] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T21:48:41.453368] [INFO ] [REMOTE ] VPG: Full fetch complete (23251 records). [2025-10-27T21:48:41.453481] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-27T21:48:41.893852] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-27T21:48:41.893940] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-27T21:48:41.894586] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-27T21:48:41.894633] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-27T21:48:41.895426] [DEBUG] [LOCAL ] VPG: Trimmed 23251 records to 16571 (keeping 200 days of data) [2025-10-27T21:48:42.000127] [DEBUG] [LOCAL ] VPG: Primary data saved (16571 records). [2025-10-27T21:48:42.000265] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-27T21:48:42.000342] [INFO ] [MAIN ] Update Progress: 2244/2366 symbols completed. VPG took 32.7s. Estimated remaining: 15m 42s. Rate: 7.8 symbols/min [2025-10-27T21:48:42.025777] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-27T21:48:42.174809] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:42.186273] [DEBUG] [LOCAL ] VRTS: Loaded 9517 existing records from primary storage. [2025-10-27T21:48:42.186482] [INFO ] [MAIN ] VRTS: Loaded 9517 existing records. [2025-10-27T21:48:42.362211] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:42.362571] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-27T21:48:42.362707] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-27T21:48:42.362961] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-27T21:48:42.363019] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-27T21:48:42.545209] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-27T21:48:42.752132] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:42.814904] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-27T21:48:43.271703] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T21:48:43.614946] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-27T21:48:44.265958] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-27T21:48:44.414951] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-27T21:48:44.881865] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-27T21:48:45.041717] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-27T21:48:45.214956] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-27T21:48:46.014948] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-27T21:48:46.561409] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-27T21:48:46.815013] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-27T21:48:47.137978] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-27T21:48:47.493726] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-27T21:48:47.615010] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-27T21:48:48.415041] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-27T21:48:48.909837] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-27T21:48:49.214943] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-27T21:48:49.626333] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-27T21:48:50.020041] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-27T21:48:50.038545] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-27T21:48:50.699069] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T21:48:50.814939] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-27T21:48:51.614973] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-27T21:48:52.168459] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-27T21:48:52.414959] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-27T21:48:53.214967] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-27T21:48:53.248876] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-27T21:48:53.587481] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:48:54.014938] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-27T21:48:54.720557] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T21:48:54.814948] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-27T21:48:55.105082] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T21:48:55.113238] [INFO ] [REMOTE ] VOYA: Full fetch complete (61344 records). [2025-10-27T21:48:55.113407] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-27T21:48:55.517458] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-27T21:48:55.517539] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-27T21:48:55.518600] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-27T21:48:55.518682] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-27T21:48:55.519995] [DEBUG] [LOCAL ] VOYA: Trimmed 61344 records to 41334 (keeping 200 days of data) [2025-10-27T21:48:55.616340] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-27T21:48:55.776747] [DEBUG] [LOCAL ] VOYA: Primary data saved (41334 records). [2025-10-27T21:48:55.777048] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-27T21:48:55.777161] [INFO ] [MAIN ] Update Progress: 2245/2366 symbols completed. VOYA took 46.5s. Estimated remaining: 15m 34s. Rate: 7.8 symbols/min [2025-10-27T21:48:55.890194] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-27T21:48:55.917999] [INFO ] [REMOTE ] VRE: Full fetch complete (48818 records). [2025-10-27T21:48:55.923863] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-27T21:48:56.087569] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:56.383315] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-27T21:48:56.383431] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-27T21:48:56.384429] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-27T21:48:56.384509] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-27T21:48:56.399688] [DEBUG] [LOCAL ] VSCO: Loaded 53444 existing records from primary storage. [2025-10-27T21:48:56.400125] [INFO ] [MAIN ] VSCO: Loaded 53444 existing records. [2025-10-27T21:48:56.400017] [DEBUG] [LOCAL ] VRE: Trimmed 48818 records to 35022 (keeping 200 days of data) [2025-10-27T21:48:56.430596] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-27T21:48:56.739521] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:56.746839] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-27T21:48:56.746937] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-27T21:48:56.766475] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-27T21:48:56.767339] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-27T21:48:56.911515] [DEBUG] [LOCAL ] VRE: Primary data saved (35022 records). [2025-10-27T21:48:56.921889] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-27T21:48:56.922478] [INFO ] [MAIN ] Update Progress: 2246/2366 symbols completed. VRE took 32.1s. Estimated remaining: 15m 26s. Rate: 7.8 symbols/min [2025-10-27T21:48:57.252101] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:48:57.339194] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-27T21:48:57.344525] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:57.347257] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-27T21:48:57.388379] [DEBUG] [LOCAL ] VSH: Loaded 49004 existing records from primary storage. [2025-10-27T21:48:57.388703] [INFO ] [MAIN ] VSH: Loaded 49004 existing records. [2025-10-27T21:48:57.561967] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:48:57.562149] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-27T21:48:57.562195] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-27T21:48:57.562396] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-27T21:48:57.562433] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-27T21:48:57.917488] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:48:58.009799] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-27T21:48:58.020263] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-27T21:48:58.720514] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-27T21:48:58.814914] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-27T21:48:59.561036] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:48:59.614905] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-27T21:49:00.124341] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:49:00.414967] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-27T21:49:01.197664] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-27T21:49:01.214889] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-27T21:49:01.297950] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T21:49:01.619740] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-27T21:49:01.622037] [INFO ] [REMOTE ] VRTS: Full fetch complete (11945 records). [2025-10-27T21:49:01.622125] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-27T21:49:01.985212] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-27T21:49:01.985285] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-27T21:49:01.985585] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-27T21:49:01.985623] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-27T21:49:01.986103] [DEBUG] [LOCAL ] VRTS: Trimmed 11945 records to 9395 (keeping 200 days of data) [2025-10-27T21:49:02.016455] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-27T21:49:02.045368] [DEBUG] [LOCAL ] VRTS: Primary data saved (9395 records). [2025-10-27T21:49:02.045449] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-27T21:49:02.045519] [INFO ] [MAIN ] Update Progress: 2247/2366 symbols completed. VRTS took 20.0s. Estimated remaining: 15m 18s. Rate: 7.8 symbols/min [2025-10-27T21:49:02.212688] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:02.263901] [DEBUG] [LOCAL ] VST: Loaded 54489 existing records from primary storage. [2025-10-27T21:49:02.264191] [INFO ] [MAIN ] VST: Loaded 54489 existing records. [2025-10-27T21:49:02.444451] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:02.444688] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-27T21:49:02.444746] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-27T21:49:02.444934] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-27T21:49:02.444973] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-27T21:49:02.794719] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:02.814898] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-27T21:49:03.355231] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-27T21:49:03.615042] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-27T21:49:04.415004] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-27T21:49:05.086826] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-27T21:49:05.161350] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:49:05.214910] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-27T21:49:06.014936] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-27T21:49:06.222123] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T21:49:06.814933] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-27T21:49:07.099326] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-27T21:49:07.614977] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-27T21:49:08.176929] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T21:49:08.220323] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-27T21:49:08.414921] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-27T21:49:09.214983] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-27T21:49:09.958807] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-27T21:49:10.014929] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-27T21:49:10.586720] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-27T21:49:10.814935] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-27T21:49:11.039778] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-27T21:49:11.615005] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-27T21:49:12.283875] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-27T21:49:12.414978] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-27T21:49:12.922402] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T21:49:13.215001] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-27T21:49:13.280332] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-27T21:49:14.014929] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-27T21:49:14.067734] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-27T21:49:14.814997] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-27T21:49:15.547572] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:49:15.614901] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-27T21:49:15.750076] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-27T21:49:16.414973] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-27T21:49:16.517780] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T21:49:16.998694] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T21:49:17.214953] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-27T21:49:18.014958] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-27T21:49:18.670092] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T21:49:18.725972] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-27T21:49:18.814902] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-27T21:49:19.461418] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T21:49:19.614918] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-27T21:49:20.414986] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-27T21:49:20.886365] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-27T21:49:20.987682] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-27T21:49:21.214905] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-27T21:49:21.769084] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-27T21:49:21.779092] [INFO ] [REMOTE ] VSCO: Full fetch complete (76437 records). [2025-10-27T21:49:21.779206] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-27T21:49:22.020543] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-27T21:49:22.163550] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-27T21:49:22.163624] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-27T21:49:22.164830] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-27T21:49:22.164894] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-27T21:49:22.166332] [DEBUG] [LOCAL ] VSCO: Trimmed 76437 records to 52649 (keeping 200 days of data) [2025-10-27T21:49:22.460351] [DEBUG] [LOCAL ] VSCO: Primary data saved (52649 records). [2025-10-27T21:49:22.460474] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-27T21:49:22.460551] [INFO ] [MAIN ] Update Progress: 2248/2366 symbols completed. VSCO took 26.7s. Estimated remaining: 15m 11s. Rate: 7.8 symbols/min [2025-10-27T21:49:22.626735] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:22.668426] [DEBUG] [LOCAL ] VSTS: Loaded 49534 existing records from primary storage. [2025-10-27T21:49:22.668755] [INFO ] [MAIN ] VSTS: Loaded 49534 existing records. [2025-10-27T21:49:22.852744] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:22.852874] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-27T21:49:22.853329] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-27T21:49:22.854435] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-27T21:49:22.854747] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-27T21:49:22.854805] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-27T21:49:23.090535] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-27T21:49:23.165996] [INFO ] [REMOTE ] VSH: Full fetch complete (71018 records). [2025-10-27T21:49:23.168251] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-27T21:49:23.355477] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:23.625351] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-27T21:49:23.628864] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-27T21:49:23.628938] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-27T21:49:23.630917] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-27T21:49:23.631082] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-27T21:49:23.632422] [DEBUG] [LOCAL ] VSH: Trimmed 71018 records to 48222 (keeping 200 days of data) [2025-10-27T21:49:23.917628] [DEBUG] [LOCAL ] VSH: Primary data saved (48222 records). [2025-10-27T21:49:23.917776] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-27T21:49:23.917859] [INFO ] [MAIN ] Update Progress: 2249/2366 symbols completed. VSH took 27.0s. Estimated remaining: 15m 3s. Rate: 7.8 symbols/min [2025-10-27T21:49:24.087210] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:24.124272] [DEBUG] [LOCAL ] VTEX: Loaded 43417 existing records from primary storage. [2025-10-27T21:49:24.124567] [INFO ] [MAIN ] VTEX: Loaded 43417 existing records. [2025-10-27T21:49:24.298500] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:24.298816] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-27T21:49:24.298932] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-27T21:49:24.299119] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-27T21:49:24.299157] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-27T21:49:24.669356] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:24.669774] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-27T21:49:24.705811] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-27T21:49:24.772429] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:49:24.843053] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-27T21:49:25.214979] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-27T21:49:25.988126] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T21:49:26.014904] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-27T21:49:26.815001] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-27T21:49:27.287847] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-27T21:49:27.321724] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:49:27.614979] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-27T21:49:27.805424] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-27T21:49:28.015976] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-27T21:49:28.026277] [INFO ] [REMOTE ] VST: Full fetch complete (77887 records). [2025-10-27T21:49:28.026397] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-27T21:49:28.409354] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-27T21:49:28.409428] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-27T21:49:28.410580] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-27T21:49:28.410661] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-27T21:49:28.412024] [DEBUG] [LOCAL ] VST: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-27T21:49:28.466088] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-27T21:49:28.742537] [DEBUG] [LOCAL ] VST: Primary data saved (53708 records). [2025-10-27T21:49:28.742682] [INFO ] [MAIN ] VST: Full history saved. [2025-10-27T21:49:28.743066] [INFO ] [MAIN ] Update Progress: 2250/2366 symbols completed. VST took 26.7s. Estimated remaining: 14m 55s. Rate: 7.8 symbols/min [2025-10-27T21:49:28.908022] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:28.952515] [DEBUG] [LOCAL ] VTLE: Loaded 48151 existing records from primary storage. [2025-10-27T21:49:28.952839] [INFO ] [MAIN ] VTLE: Loaded 48151 existing records. [2025-10-27T21:49:29.131303] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:29.131508] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-27T21:49:29.131568] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-27T21:49:29.131833] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-27T21:49:29.131892] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-27T21:49:29.220051] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-27T21:49:29.480813] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:29.711745] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-27T21:49:30.014907] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-27T21:49:30.814981] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-27T21:49:31.135761] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-27T21:49:31.397630] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T21:49:31.614937] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-27T21:49:32.414919] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-27T21:49:32.450072] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T21:49:33.188814] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T21:49:33.214951] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-27T21:49:34.015023] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-27T21:49:34.600421] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-27T21:49:34.814953] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-27T21:49:34.874868] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T21:49:35.373886] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:49:35.614950] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-27T21:49:35.818046] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-27T21:49:36.414963] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-27T21:49:36.903429] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T21:49:37.215010] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-27T21:49:37.835612] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-27T21:49:38.014981] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-27T21:49:38.180209] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-27T21:49:38.814968] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-27T21:49:39.614962] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-27T21:49:40.076874] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T21:49:40.265682] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-27T21:49:40.277189] [INFO ] [REMOTE ] VRT: Full fetch complete (77933 records). [2025-10-27T21:49:40.277414] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-27T21:49:40.427826] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-27T21:49:40.698305] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-27T21:49:40.698425] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-27T21:49:40.700308] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-27T21:49:40.700380] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-27T21:49:40.702509] [DEBUG] [LOCAL ] VRT: Trimmed 77933 records to 53754 (keeping 200 days of data) [2025-10-27T21:49:40.997138] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-27T21:49:41.109725] [DEBUG] [LOCAL ] VRT: Primary data saved (53754 records). [2025-10-27T21:49:41.109903] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-27T21:49:41.110003] [INFO ] [MAIN ] Update Progress: 2251/2366 symbols completed. VRT took 1m 0s. Estimated remaining: 14m 48s. Rate: 7.8 symbols/min [2025-10-27T21:49:41.220073] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-27T21:49:41.281347] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:41.298246] [DEBUG] [LOCAL ] VTMX: Loaded 17960 existing records from primary storage. [2025-10-27T21:49:41.298495] [INFO ] [MAIN ] VTMX: Loaded 17960 existing records. [2025-10-27T21:49:41.479898] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:41.480104] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-27T21:49:41.480152] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-27T21:49:41.480424] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-27T21:49:41.480482] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-27T21:49:41.853945] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:41.890715] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T21:49:42.014924] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-27T21:49:42.421036] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-27T21:49:42.814933] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-27T21:49:43.211913] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T21:49:43.614921] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-27T21:49:43.772061] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-27T21:49:44.414930] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-27T21:49:45.021735] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T21:49:45.215024] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-27T21:49:45.504006] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T21:49:46.015015] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-27T21:49:46.453137] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T21:49:46.463006] [INFO ] [REMOTE ] VSTS: Full fetch complete (69691 records). [2025-10-27T21:49:46.463163] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-27T21:49:46.815087] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-27T21:49:46.891083] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-27T21:49:46.895017] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-27T21:49:46.896866] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-27T21:49:46.897264] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-27T21:49:46.897476] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-27T21:49:46.902827] [DEBUG] [LOCAL ] VSTS: Trimmed 69691 records to 48712 (keeping 200 days of data) [2025-10-27T21:49:47.174395] [DEBUG] [LOCAL ] VSTS: Primary data saved (48712 records). [2025-10-27T21:49:47.174540] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-27T21:49:47.174623] [INFO ] [MAIN ] Update Progress: 2252/2366 symbols completed. VSTS took 24.7s. Estimated remaining: 14m 40s. Rate: 7.8 symbols/min [2025-10-27T21:49:47.338487] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:47.347729] [DEBUG] [LOCAL ] VTN: Loaded 7382 existing records from primary storage. [2025-10-27T21:49:47.347940] [INFO ] [MAIN ] VTN: Loaded 7382 existing records. [2025-10-27T21:49:47.524042] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:47.524288] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-27T21:49:47.524337] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-27T21:49:47.524488] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-27T21:49:47.524527] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-27T21:49:47.623854] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-27T21:49:47.890761] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:48.116227] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T21:49:48.340576] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-27T21:49:48.414904] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-27T21:49:49.214927] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-27T21:49:49.420493] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-27T21:49:50.015067] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-27T21:49:50.382746] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T21:49:50.483004] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-27T21:49:50.814984] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-27T21:49:51.614970] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-27T21:49:52.367852] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T21:49:52.414907] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-27T21:49:53.201513] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:49:53.214906] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-27T21:49:53.336364] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-27T21:49:53.344401] [INFO ] [REMOTE ] VTEX: Full fetch complete (61070 records). [2025-10-27T21:49:53.344543] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-27T21:49:53.718980] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-27T21:49:53.719060] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-27T21:49:53.720089] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-27T21:49:53.720152] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-27T21:49:53.721378] [DEBUG] [LOCAL ] VTEX: Trimmed 61070 records to 42713 (keeping 200 days of data) [2025-10-27T21:49:53.952035] [DEBUG] [LOCAL ] VTEX: Primary data saved (42713 records). [2025-10-27T21:49:53.952155] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-27T21:49:53.952998] [INFO ] [MAIN ] Update Progress: 2253/2366 symbols completed. VTEX took 30.0s. Estimated remaining: 14m 32s. Rate: 7.8 symbols/min [2025-10-27T21:49:54.024357] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-27T21:49:54.117614] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:49:54.138222] [DEBUG] [LOCAL ] VTOL: Loaded 19635 existing records from primary storage. [2025-10-27T21:49:54.138469] [INFO ] [MAIN ] VTOL: Loaded 19635 existing records. [2025-10-27T21:49:54.313597] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:49:54.313915] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-27T21:49:54.313969] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-27T21:49:54.314190] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-27T21:49:54.314246] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-27T21:49:54.662883] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:49:54.696043] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T21:49:54.814911] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-27T21:49:55.096288] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-27T21:49:55.563388] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-27T21:49:55.614950] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-27T21:49:56.414969] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-27T21:49:56.939875] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T21:49:57.033378] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T21:49:57.214956] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-27T21:49:58.014993] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-27T21:49:58.435756] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:49:58.754938] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-27T21:49:58.814908] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-27T21:49:59.313215] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T21:49:59.614933] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-27T21:50:00.201093] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T21:50:00.414944] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-27T21:50:01.214978] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-27T21:50:01.544807] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T21:50:01.553427] [INFO ] [REMOTE ] VTLE: Full fetch complete (68224 records). [2025-10-27T21:50:01.553585] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-27T21:50:01.676192] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-27T21:50:01.989577] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-27T21:50:01.989677] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-27T21:50:01.990938] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-27T21:50:01.990999] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-27T21:50:01.992243] [DEBUG] [LOCAL ] VTLE: Trimmed 68224 records to 47226 (keeping 200 days of data) [2025-10-27T21:50:02.039306] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-27T21:50:02.271251] [DEBUG] [LOCAL ] VTLE: Primary data saved (47226 records). [2025-10-27T21:50:02.271384] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-27T21:50:02.271894] [INFO ] [MAIN ] Update Progress: 2254/2366 symbols completed. VTLE took 33.5s. Estimated remaining: 14m 25s. Rate: 7.8 symbols/min [2025-10-27T21:50:02.439561] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:02.496859] [DEBUG] [LOCAL ] VTR: Loaded 53420 existing records from primary storage. [2025-10-27T21:50:02.497206] [INFO ] [MAIN ] VTR: Loaded 53420 existing records. [2025-10-27T21:50:02.680309] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:02.680513] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-27T21:50:02.680560] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-27T21:50:02.680784] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-27T21:50:02.680840] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-27T21:50:02.817816] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-27T21:50:02.967878] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-27T21:50:03.048048] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:03.614947] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-27T21:50:03.675094] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-27T21:50:04.414940] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-27T21:50:04.992627] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-27T21:50:05.214956] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-27T21:50:05.264139] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-27T21:50:06.014942] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-27T21:50:06.642469] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-27T21:50:06.814934] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-27T21:50:06.849817] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-27T21:50:07.330722] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-27T21:50:07.614946] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-27T21:50:08.414957] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-27T21:50:09.045668] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-27T21:50:09.214962] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-27T21:50:09.480785] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-27T21:50:10.004325] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-27T21:50:10.014887] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-27T21:50:10.814951] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-27T21:50:10.978965] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-27T21:50:11.614941] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-27T21:50:12.044520] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-27T21:50:12.414982] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-27T21:50:13.124711] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T21:50:13.214917] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-27T21:50:13.260400] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T21:50:13.645432] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-27T21:50:14.014933] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-27T21:50:14.681909] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-27T21:50:14.814930] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-27T21:50:15.537512] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-27T21:50:15.614945] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-27T21:50:16.414943] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-27T21:50:17.025362] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-27T21:50:17.214924] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-27T21:50:17.427152] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:50:17.996149] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T21:50:17.998451] [INFO ] [REMOTE ] VTN: Full fetch complete (11001 records). [2025-10-27T21:50:17.998533] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-27T21:50:18.020083] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-27T21:50:18.362270] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-27T21:50:18.362344] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-27T21:50:18.362591] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-27T21:50:18.362629] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-27T21:50:18.363101] [DEBUG] [LOCAL ] VTN: Trimmed 11001 records to 7126 (keeping 200 days of data) [2025-10-27T21:50:18.405217] [DEBUG] [LOCAL ] VTN: Primary data saved (7126 records). [2025-10-27T21:50:18.405348] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-27T21:50:18.405426] [INFO ] [MAIN ] Update Progress: 2255/2366 symbols completed. VTN took 31.2s. Estimated remaining: 14m 17s. Rate: 7.8 symbols/min [2025-10-27T21:50:18.569722] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:18.599409] [DEBUG] [LOCAL ] VTS: Loaded 30241 existing records from primary storage. [2025-10-27T21:50:18.599689] [INFO ] [MAIN ] VTS: Loaded 30241 existing records. [2025-10-27T21:50:18.775989] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:18.776343] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-27T21:50:18.782058] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-27T21:50:18.786269] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-27T21:50:18.786706] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-27T21:50:18.786602] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:50:18.821186] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-27T21:50:18.826529] [INFO ] [REMOTE ] VTMX: Full fetch complete (26104 records). [2025-10-27T21:50:18.833395] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-27T21:50:19.463771] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:19.534027] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-27T21:50:19.534094] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-27T21:50:19.534615] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-27T21:50:19.534681] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-27T21:50:19.535289] [DEBUG] [LOCAL ] VTMX: Trimmed 26104 records to 17601 (keeping 200 days of data) [2025-10-27T21:50:19.615970] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-27T21:50:19.640560] [DEBUG] [LOCAL ] VTMX: Primary data saved (17601 records). [2025-10-27T21:50:19.640678] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-27T21:50:19.640768] [INFO ] [MAIN ] Update Progress: 2256/2366 symbols completed. VTMX took 38.5s. Estimated remaining: 14m 9s. Rate: 7.8 symbols/min [2025-10-27T21:50:19.806179] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:19.834449] [DEBUG] [LOCAL ] VVR: Loaded 31590 existing records from primary storage. [2025-10-27T21:50:19.834724] [INFO ] [MAIN ] VVR: Loaded 31590 existing records. [2025-10-27T21:50:20.013476] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:20.013737] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-27T21:50:20.013790] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-27T21:50:20.013973] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-27T21:50:20.014010] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-27T21:50:20.364398] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:20.424560] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-27T21:50:20.427212] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-27T21:50:20.761854] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T21:50:21.214965] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-27T21:50:21.396759] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-27T21:50:21.402637] [INFO ] [REMOTE ] VTOL: Full fetch complete (26550 records). [2025-10-27T21:50:21.402829] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-27T21:50:21.950960] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-27T21:50:21.951082] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-27T21:50:21.952479] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-27T21:50:21.952566] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-27T21:50:21.953908] [DEBUG] [LOCAL ] VTOL: Trimmed 26550 records to 19174 (keeping 200 days of data) [2025-10-27T21:50:22.022445] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-27T21:50:22.121446] [DEBUG] [LOCAL ] VTOL: Primary data saved (19174 records). [2025-10-27T21:50:22.121693] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-27T21:50:22.121819] [INFO ] [MAIN ] Update Progress: 2257/2366 symbols completed. VTOL took 28.2s. Estimated remaining: 14m 1s. Rate: 7.8 symbols/min [2025-10-27T21:50:22.316001] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:22.317798] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-27T21:50:22.379765] [DEBUG] [LOCAL ] VVV: Loaded 50855 existing records from primary storage. [2025-10-27T21:50:22.380233] [INFO ] [MAIN ] VVV: Loaded 50855 existing records. [2025-10-27T21:50:22.553017] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:22.553199] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-27T21:50:22.553244] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-27T21:50:22.553474] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-27T21:50:22.553533] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-27T21:50:22.821192] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-27T21:50:22.897415] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:23.325674] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-27T21:50:23.614940] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-27T21:50:23.889975] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:50:24.414942] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-27T21:50:24.929667] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T21:50:25.214943] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-27T21:50:25.471002] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-27T21:50:26.014955] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-27T21:50:26.674959] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-27T21:50:26.814980] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-27T21:50:26.880883] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T21:50:27.615001] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-27T21:50:28.415001] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-27T21:50:28.503364] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-27T21:50:28.598329] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T21:50:29.215015] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-27T21:50:29.702066] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T21:50:30.014944] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-27T21:50:30.263520] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-27T21:50:30.814987] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-27T21:50:31.157263] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T21:50:31.614955] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-27T21:50:32.423729] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-27T21:50:32.429971] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-27T21:50:32.670103] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-27T21:50:33.157410] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-27T21:50:33.167237] [INFO ] [REMOTE ] VTR: Full fetch complete (76431 records). [2025-10-27T21:50:33.167349] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-27T21:50:33.220171] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-27T21:50:33.549065] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-27T21:50:33.549161] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-27T21:50:33.550317] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-27T21:50:33.550377] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-27T21:50:33.551759] [DEBUG] [LOCAL ] VTR: Trimmed 76431 records to 52638 (keeping 200 days of data) [2025-10-27T21:50:33.863301] [DEBUG] [LOCAL ] VTR: Primary data saved (52638 records). [2025-10-27T21:50:33.863463] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-27T21:50:33.864124] [INFO ] [MAIN ] Update Progress: 2258/2366 symbols completed. VTR took 31.6s. Estimated remaining: 13m 54s. Rate: 7.8 symbols/min [2025-10-27T21:50:34.026696] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-27T21:50:34.030153] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:34.053174] [DEBUG] [LOCAL ] VVX: Loaded 23327 existing records from primary storage. [2025-10-27T21:50:34.053628] [INFO ] [MAIN ] VVX: Loaded 23327 existing records. [2025-10-27T21:50:34.245692] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-27T21:50:34.248932] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:34.255511] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-27T21:50:34.255567] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-27T21:50:34.255777] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-27T21:50:34.255833] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-27T21:50:34.600755] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:34.814915] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-27T21:50:34.948408] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-27T21:50:35.444988] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T21:50:35.614977] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-27T21:50:36.414957] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-27T21:50:36.492242] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T21:50:37.214982] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-27T21:50:37.702731] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T21:50:38.015004] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-27T21:50:38.164020] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-27T21:50:38.814929] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-27T21:50:39.103435] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-27T21:50:39.614974] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-27T21:50:39.834714] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-27T21:50:40.414916] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-27T21:50:40.569374] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-27T21:50:41.214915] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-27T21:50:41.573475] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:50:41.579575] [INFO ] [REMOTE ] VTS: Full fetch complete (41650 records). [2025-10-27T21:50:41.579742] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-27T21:50:41.946785] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-27T21:50:41.947029] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-27T21:50:41.947954] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-27T21:50:41.948105] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-27T21:50:41.949287] [DEBUG] [LOCAL ] VTS: Trimmed 41650 records to 29492 (keeping 200 days of data) [2025-10-27T21:50:42.019157] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-27T21:50:42.054784] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-27T21:50:42.145867] [DEBUG] [LOCAL ] VTS: Primary data saved (29492 records). [2025-10-27T21:50:42.146001] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-27T21:50:42.146078] [INFO ] [MAIN ] Update Progress: 2259/2366 symbols completed. VTS took 23.7s. Estimated remaining: 13m 46s. Rate: 7.8 symbols/min [2025-10-27T21:50:42.311443] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:42.354771] [DEBUG] [LOCAL ] VYX: Loaded 48961 existing records from primary storage. [2025-10-27T21:50:42.355101] [INFO ] [MAIN ] VYX: Loaded 48961 existing records. [2025-10-27T21:50:42.530776] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:42.530974] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-27T21:50:42.531020] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-27T21:50:42.531206] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-27T21:50:42.531243] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-27T21:50:42.820098] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-27T21:50:42.881159] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:43.301581] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T21:50:43.594810] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-27T21:50:43.614896] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-27T21:50:44.414919] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-27T21:50:44.702243] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-27T21:50:45.215001] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-27T21:50:45.740430] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-27T21:50:46.014969] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-27T21:50:46.787384] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-27T21:50:46.814902] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-27T21:50:47.261444] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:50:47.614977] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-27T21:50:48.109958] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:50:48.414925] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-27T21:50:48.778042] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:50:49.215000] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-27T21:50:49.269818] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-27T21:50:50.014993] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-27T21:50:50.766121] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:50:50.814914] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-27T21:50:51.016807] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-27T21:50:51.615013] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-27T21:50:52.237020] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:50:52.414978] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-27T21:50:52.487543] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T21:50:53.215001] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-27T21:50:53.697413] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-27T21:50:54.014927] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-27T21:50:54.387041] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T21:50:54.814981] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-27T21:50:55.022698] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T21:50:55.598448] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-27T21:50:55.602791] [INFO ] [REMOTE ] VVX: Full fetch complete (33087 records). [2025-10-27T21:50:55.602869] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-27T21:50:55.623374] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-27T21:50:55.967971] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-27T21:50:55.968044] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-27T21:50:55.968697] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-27T21:50:55.968757] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-27T21:50:55.969616] [DEBUG] [LOCAL ] VVX: Trimmed 33087 records to 22918 (keeping 200 days of data) [2025-10-27T21:50:56.101018] [DEBUG] [LOCAL ] VVX: Primary data saved (22918 records). [2025-10-27T21:50:56.101151] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-27T21:50:56.101250] [INFO ] [MAIN ] Update Progress: 2260/2366 symbols completed. VVX took 22.2s. Estimated remaining: 13m 39s. Rate: 7.8 symbols/min [2025-10-27T21:50:56.265470] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:56.315406] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-27T21:50:56.315730] [INFO ] [MAIN ] VZ: Loaded 54571 existing records. [2025-10-27T21:50:56.420078] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-27T21:50:56.493353] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:56.493529] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-27T21:50:56.493575] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-27T21:50:56.493895] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-27T21:50:56.493952] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-27T21:50:56.840622] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:57.214673] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-27T21:50:57.223491] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-27T21:50:57.475681] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T21:50:57.486303] [INFO ] [REMOTE ] VVR: Full fetch complete (46579 records). [2025-10-27T21:50:57.486478] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-27T21:50:57.865226] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-27T21:50:57.865319] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-27T21:50:57.866298] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-27T21:50:57.866358] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-27T21:50:57.867434] [DEBUG] [LOCAL ] VVR: Trimmed 46579 records to 30814 (keeping 200 days of data) [2025-10-27T21:50:58.015620] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-27T21:50:58.058904] [DEBUG] [LOCAL ] VVR: Primary data saved (30814 records). [2025-10-27T21:50:58.059067] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-27T21:50:58.059161] [INFO ] [MAIN ] Update Progress: 2261/2366 symbols completed. VVR took 38.4s. Estimated remaining: 13m 31s. Rate: 7.8 symbols/min [2025-10-27T21:50:58.238684] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:50:58.285167] [DEBUG] [LOCAL ] W: Loaded 54179 existing records from primary storage. [2025-10-27T21:50:58.285482] [INFO ] [MAIN ] W: Loaded 54179 existing records. [2025-10-27T21:50:58.462682] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:50:58.462917] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-27T21:50:58.462964] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-27T21:50:58.463429] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-27T21:50:58.463468] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-27T21:50:58.817927] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-27T21:50:58.817781] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:50:58.848802] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-27T21:50:59.171566] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-27T21:50:59.614931] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-27T21:51:00.414999] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-27T21:51:00.827700] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-27T21:51:00.910208] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-27T21:51:01.214953] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-27T21:51:01.739128] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-27T21:51:02.014949] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-27T21:51:02.809518] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:51:02.820064] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-27T21:51:03.204452] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T21:51:03.614955] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-27T21:51:04.414961] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-27T21:51:05.054478] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-27T21:51:05.092726] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T21:51:05.214952] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-27T21:51:05.865365] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-27T21:51:06.014941] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-27T21:51:06.814942] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-27T21:51:07.157893] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-27T21:51:07.616053] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-27T21:51:07.619169] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-27T21:51:08.417457] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-27T21:51:08.422511] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T21:51:08.432205] [INFO ] [REMOTE ] VVV: Full fetch complete (72476 records). [2025-10-27T21:51:08.432321] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-27T21:51:08.830102] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-27T21:51:08.830261] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-27T21:51:08.831564] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-27T21:51:08.831683] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-27T21:51:08.858415] [DEBUG] [LOCAL ] VVV: Trimmed 72476 records to 50075 (keeping 200 days of data) [2025-10-27T21:51:08.860216] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-27T21:51:08.924800] [INFO ] [REMOTE ] VYX: Full fetch complete (70155 records). [2025-10-27T21:51:08.951262] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-27T21:51:09.226012] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-27T21:51:09.462083] [DEBUG] [LOCAL ] VVV: Primary data saved (50075 records). [2025-10-27T21:51:09.484467] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-27T21:51:09.485623] [INFO ] [MAIN ] Update Progress: 2262/2366 symbols completed. VVV took 47.4s. Estimated remaining: 13m 23s. Rate: 7.8 symbols/min [2025-10-27T21:51:09.705735] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-27T21:51:09.710964] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-27T21:51:09.727763] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-27T21:51:09.727850] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-27T21:51:09.757968] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:09.759021] [DEBUG] [LOCAL ] VYX: Trimmed 70155 records to 48119 (keeping 200 days of data) [2025-10-27T21:51:10.017924] [DEBUG] [LOCAL ] WAB: Loaded 44422 existing records from primary storage. [2025-10-27T21:51:10.018271] [INFO ] [MAIN ] WAB: Loaded 44422 existing records. [2025-10-27T21:51:10.172982] [DEBUG] [LOCAL ] VYX: Primary data saved (48119 records). [2025-10-27T21:51:10.188715] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-27T21:51:10.189448] [INFO ] [MAIN ] Update Progress: 2263/2366 symbols completed. VYX took 28.0s. Estimated remaining: 13m 15s. Rate: 7.8 symbols/min [2025-10-27T21:51:10.277525] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:10.327911] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-27T21:51:10.349081] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-27T21:51:10.349471] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-27T21:51:10.355006] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-27T21:51:10.455962] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:10.799621] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:10.800222] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-27T21:51:10.847027] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-27T21:51:10.847148] [DEBUG] [LOCAL ] WAL: Loaded 46382 existing records from primary storage. [2025-10-27T21:51:10.858624] [INFO ] [MAIN ] WAL: Loaded 46382 existing records. [2025-10-27T21:51:10.903233] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-27T21:51:11.044243] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:11.044477] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-27T21:51:11.044550] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-27T21:51:11.044870] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-27T21:51:11.044930] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-27T21:51:11.397829] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:11.489249] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-27T21:51:11.614912] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-27T21:51:11.967346] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-27T21:51:12.414967] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-27T21:51:12.606448] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-27T21:51:13.214942] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-27T21:51:13.953210] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:51:14.020629] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-27T21:51:14.058856] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-27T21:51:14.591352] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-27T21:51:14.815034] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-27T21:51:15.590971] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T21:51:15.614914] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-27T21:51:16.356265] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-27T21:51:16.414912] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-27T21:51:17.131074] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T21:51:17.214917] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-27T21:51:17.854505] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T21:51:18.014928] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-27T21:51:18.788862] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T21:51:18.814939] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-27T21:51:19.614996] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-27T21:51:19.890353] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T21:51:20.414922] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-27T21:51:20.739125] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-27T21:51:20.965976] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-27T21:51:21.214979] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-27T21:51:21.962314] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:51:22.014933] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-27T21:51:22.408013] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-27T21:51:22.814980] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-27T21:51:23.345075] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-27T21:51:23.614935] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-27T21:51:24.414963] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-27T21:51:24.656397] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-27T21:51:25.115929] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-27T21:51:25.214918] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-27T21:51:25.684133] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T21:51:26.014946] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-27T21:51:26.474888] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-27T21:51:26.814943] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-27T21:51:27.615178] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-27T21:51:27.942435] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-27T21:51:28.362328] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T21:51:28.414994] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-27T21:51:28.906567] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T21:51:29.214980] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-27T21:51:29.965861] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T21:51:30.014900] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-27T21:51:30.604758] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-27T21:51:30.814939] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-27T21:51:31.614964] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-27T21:51:31.728364] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T21:51:31.744013] [INFO ] [REMOTE ] WAL: Full fetch complete (67343 records). [2025-10-27T21:51:31.744260] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-27T21:51:32.144230] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-27T21:51:32.144389] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-27T21:51:32.145715] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-27T21:51:32.145817] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-27T21:51:32.147412] [DEBUG] [LOCAL ] WAL: Trimmed 67343 records to 45573 (keeping 200 days of data) [2025-10-27T21:51:32.286872] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:51:32.415116] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-27T21:51:32.456587] [DEBUG] [LOCAL ] WAL: Primary data saved (45573 records). [2025-10-27T21:51:32.456811] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-27T21:51:32.456897] [INFO ] [MAIN ] Update Progress: 2264/2366 symbols completed. WAL took 22.2s. Estimated remaining: 13m 8s. Rate: 7.8 symbols/min [2025-10-27T21:51:32.622914] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:32.654378] [DEBUG] [LOCAL ] WAT: Loaded 36177 existing records from primary storage. [2025-10-27T21:51:32.654635] [INFO ] [MAIN ] WAT: Loaded 36177 existing records. [2025-10-27T21:51:32.828253] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:32.828457] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-27T21:51:32.828502] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-27T21:51:32.828839] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-27T21:51:32.828897] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-27T21:51:33.223761] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:33.217733] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-27T21:51:33.320470] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-27T21:51:33.330693] [INFO ] [REMOTE ] W: Full fetch complete (77506 records). [2025-10-27T21:51:33.330852] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-27T21:51:33.731458] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-27T21:51:33.731562] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-27T21:51:33.732842] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-27T21:51:33.733027] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-27T21:51:33.734446] [DEBUG] [LOCAL ] W: Trimmed 77506 records to 53407 (keeping 200 days of data) [2025-10-27T21:51:33.955754] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T21:51:34.030874] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-27T21:51:34.079077] [DEBUG] [LOCAL ] W: Primary data saved (53407 records). [2025-10-27T21:51:34.079210] [INFO ] [MAIN ] W: Full history saved. [2025-10-27T21:51:34.079334] [INFO ] [MAIN ] Update Progress: 2265/2366 symbols completed. W took 36.0s. Estimated remaining: 12m 60s. Rate: 7.8 symbols/min [2025-10-27T21:51:34.244073] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:34.244243] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-27T21:51:34.244278] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-27T21:51:34.244382] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-27T21:51:34.244422] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-27T21:51:34.244462] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-27T21:51:34.244493] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-27T21:51:34.590531] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:34.814942] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-10-27T21:51:35.018921] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:51:35.019392] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-10-27T21:51:35.019494] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:51:35.019546] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-27T21:51:35.019608] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:51:35.019710] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-27T21:51:35.019786] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-27T21:51:35.019828] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-27T21:51:35.019870] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-27T21:51:35.019924] [INFO ] [MAIN ] Update Progress: 2266/2366 symbols completed. WBI took 0.9s. Estimated remaining: 12m 52s. Rate: 7.8 symbols/min [2025-10-27T21:51:35.198731] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:35.245270] [DEBUG] [LOCAL ] WBS: Loaded 49577 existing records from primary storage. [2025-10-27T21:51:35.245902] [INFO ] [MAIN ] WBS: Loaded 49577 existing records. [2025-10-27T21:51:35.414170] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-27T21:51:35.481408] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:35.481761] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-27T21:51:35.481898] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-27T21:51:35.482129] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-27T21:51:35.482190] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-27T21:51:35.589691] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T21:51:35.620041] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-27T21:51:35.866723] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:36.414915] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-27T21:51:36.463744] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T21:51:36.473892] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-27T21:51:36.474010] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-27T21:51:36.857325] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-27T21:51:36.857400] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-27T21:51:36.858536] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-27T21:51:36.858598] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-27T21:51:36.859976] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-27T21:51:37.177400] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-27T21:51:37.177521] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-27T21:51:37.178024] [INFO ] [MAIN ] Update Progress: 2267/2366 symbols completed. VZ took 41.1s. Estimated remaining: 12m 44s. Rate: 7.8 symbols/min [2025-10-27T21:51:37.220118] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-27T21:51:37.347921] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:37.359973] [DEBUG] [LOCAL ] WBX: Loaded 10022 existing records from primary storage. [2025-10-27T21:51:37.360178] [INFO ] [MAIN ] WBX: Loaded 10022 existing records. [2025-10-27T21:51:37.533021] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:37.533219] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-27T21:51:37.533274] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-27T21:51:37.533417] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-27T21:51:37.533454] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-27T21:51:37.885716] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:38.014895] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-27T21:51:38.123069] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T21:51:38.347417] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-27T21:51:38.353083] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:51:38.365284] [INFO ] [REMOTE ] WAB: Full fetch complete (64358 records). [2025-10-27T21:51:38.365378] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-27T21:51:38.743940] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-27T21:51:38.744015] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-27T21:51:38.744950] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-27T21:51:38.745011] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-27T21:51:38.746181] [DEBUG] [LOCAL ] WAB: Trimmed 64358 records to 43665 (keeping 200 days of data) [2025-10-27T21:51:38.835928] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-27T21:51:39.009809] [DEBUG] [LOCAL ] WAB: Primary data saved (43665 records). [2025-10-27T21:51:39.009923] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-27T21:51:39.010009] [INFO ] [MAIN ] Update Progress: 2268/2366 symbols completed. WAB took 29.5s. Estimated remaining: 12m 36s. Rate: 7.8 symbols/min [2025-10-27T21:51:39.177343] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:51:39.214119] [DEBUG] [LOCAL ] WCC: Loaded 38902 existing records from primary storage. [2025-10-27T21:51:39.214367] [INFO ] [MAIN ] WCC: Loaded 38902 existing records. [2025-10-27T21:51:39.384883] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:51:39.385026] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-27T21:51:39.385072] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-27T21:51:39.385245] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-27T21:51:39.385282] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-27T21:51:39.620236] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-27T21:51:39.728834] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:51:39.932718] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T21:51:40.414989] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-27T21:51:40.814822] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-27T21:51:41.214925] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-27T21:51:41.556099] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-27T21:51:42.014968] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-27T21:51:42.157314] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T21:51:42.814929] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-27T21:51:43.461524] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T21:51:43.614938] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-27T21:51:43.943356] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:51:44.414916] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-27T21:51:44.762473] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T21:51:45.214930] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-27T21:51:45.589936] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T21:51:46.014934] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-27T21:51:46.147110] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T21:51:46.814935] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-27T21:51:47.301876] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T21:51:47.614990] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-27T21:51:48.293436] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-27T21:51:48.414904] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-27T21:51:48.829979] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-27T21:51:49.214986] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-27T21:51:50.015958] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-27T21:51:50.016092] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-27T21:51:50.193442] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-27T21:51:50.814953] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-27T21:51:51.218623] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:51:51.614981] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-27T21:51:52.414923] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-27T21:51:52.465930] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T21:51:52.657272] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-27T21:51:53.214960] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-27T21:51:53.587723] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T21:51:53.880703] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T21:51:54.014947] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-27T21:51:54.814989] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-27T21:51:55.131894] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-27T21:51:55.164929] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:51:55.614938] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-27T21:51:56.282298] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-27T21:51:56.414929] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-27T21:51:57.063915] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-27T21:51:57.214941] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-27T21:51:58.014941] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-27T21:51:58.470816] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T21:51:58.545362] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-27T21:51:58.814962] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-27T21:51:59.145493] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-27T21:51:59.614988] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-27T21:52:00.414999] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-27T21:52:01.214925] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-27T21:52:01.356391] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-27T21:52:01.358431] [INFO ] [REMOTE ] WBX: Full fetch complete (20859 records). [2025-10-27T21:52:01.358513] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-27T21:52:01.770346] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-27T21:52:01.781586] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-27T21:52:01.781939] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-27T21:52:01.782769] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-27T21:52:01.783305] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-27T21:52:01.784374] [DEBUG] [LOCAL ] WBX: Trimmed 20859 records to 9485 (keeping 200 days of data) [2025-10-27T21:52:01.853664] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-27T21:52:01.873313] [INFO ] [REMOTE ] WAT: Full fetch complete (50969 records). [2025-10-27T21:52:01.876901] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-27T21:52:01.882140] [DEBUG] [LOCAL ] WBX: Primary data saved (9485 records). [2025-10-27T21:52:01.882326] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-27T21:52:01.882442] [INFO ] [MAIN ] Update Progress: 2269/2366 symbols completed. WBX took 24.7s. Estimated remaining: 12m 29s. Rate: 7.8 symbols/min [2025-10-27T21:52:02.020099] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-27T21:52:02.332461] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:02.645324] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-27T21:52:02.645607] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-27T21:52:02.647892] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-27T21:52:02.648107] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-27T21:52:02.649981] [DEBUG] [LOCAL ] WAT: Trimmed 50969 records to 35383 (keeping 200 days of data) [2025-10-27T21:52:02.815542] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-27T21:52:02.815400] [DEBUG] [LOCAL ] WCN: Loaded 48561 existing records from primary storage. [2025-10-27T21:52:02.823334] [INFO ] [MAIN ] WCN: Loaded 48561 existing records. [2025-10-27T21:52:03.224183] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:03.230994] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-27T21:52:03.236007] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-27T21:52:03.242210] [DEBUG] [LOCAL ] WAT: Primary data saved (35383 records). [2025-10-27T21:52:03.242399] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-27T21:52:03.242512] [INFO ] [MAIN ] Update Progress: 2270/2366 symbols completed. WAT took 30.8s. Estimated remaining: 12m 21s. Rate: 7.8 symbols/min [2025-10-27T21:52:03.247822] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-27T21:52:03.269760] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-27T21:52:03.582591] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:03.803404] [DEBUG] [LOCAL ] WD: Loaded 22725 existing records from primary storage. [2025-10-27T21:52:03.843976] [INFO ] [MAIN ] WD: Loaded 22725 existing records. [2025-10-27T21:52:03.843715] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:03.874404] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-27T21:52:04.048910] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-27T21:52:04.053032] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:04.062064] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-27T21:52:04.062140] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-27T21:52:04.062688] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-27T21:52:04.062745] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-27T21:52:04.423322] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-27T21:52:04.431308] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:04.469002] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-27T21:52:05.214925] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-27T21:52:05.358532] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T21:52:05.535148] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T21:52:05.927063] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-27T21:52:06.015051] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-27T21:52:06.814921] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-27T21:52:07.136967] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T21:52:07.615001] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-27T21:52:08.034367] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T21:52:08.414957] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-27T21:52:09.176003] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T21:52:09.214906] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-27T21:52:09.230056] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T21:52:10.014957] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-27T21:52:10.669599] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:52:10.814963] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-27T21:52:11.112674] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-27T21:52:11.614954] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-27T21:52:12.229153] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-27T21:52:12.414914] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-27T21:52:13.214986] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-27T21:52:13.296203] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-27T21:52:13.306105] [INFO ] [REMOTE ] WBS: Full fetch complete (70443 records). [2025-10-27T21:52:13.306224] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-27T21:52:13.740430] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-27T21:52:13.740566] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-27T21:52:13.741732] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-27T21:52:13.741811] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-27T21:52:13.743247] [DEBUG] [LOCAL ] WBS: Trimmed 70443 records to 48813 (keeping 200 days of data) [2025-10-27T21:52:13.880030] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T21:52:14.027387] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-27T21:52:14.056707] [DEBUG] [LOCAL ] WBS: Primary data saved (48813 records). [2025-10-27T21:52:14.056864] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-27T21:52:14.056943] [INFO ] [MAIN ] Update Progress: 2271/2366 symbols completed. WBS took 39.0s. Estimated remaining: 12m 13s. Rate: 7.8 symbols/min [2025-10-27T21:52:14.224488] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:14.242721] [DEBUG] [LOCAL ] WDH: Loaded 18224 existing records from primary storage. [2025-10-27T21:52:14.242973] [INFO ] [MAIN ] WDH: Loaded 18224 existing records. [2025-10-27T21:52:14.412979] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:14.413148] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-27T21:52:14.413192] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-27T21:52:14.413389] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-27T21:52:14.413444] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-27T21:52:14.757713] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:14.814898] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-27T21:52:14.849326] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-27T21:52:15.118206] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T21:52:15.124587] [INFO ] [REMOTE ] WCC: Full fetch complete (56967 records). [2025-10-27T21:52:15.124717] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-27T21:52:15.402547] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-27T21:52:15.515626] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-27T21:52:15.515762] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-27T21:52:15.517034] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-27T21:52:15.517097] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-27T21:52:15.518299] [DEBUG] [LOCAL ] WCC: Trimmed 56967 records to 38119 (keeping 200 days of data) [2025-10-27T21:52:15.616503] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-27T21:52:15.759110] [DEBUG] [LOCAL ] WCC: Primary data saved (38119 records). [2025-10-27T21:52:15.759454] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-27T21:52:15.760216] [INFO ] [MAIN ] Update Progress: 2272/2366 symbols completed. WCC took 36.8s. Estimated remaining: 12m 5s. Rate: 7.8 symbols/min [2025-10-27T21:52:15.924624] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:15.946907] [DEBUG] [LOCAL ] WDI: Loaded 21532 existing records from primary storage. [2025-10-27T21:52:15.947149] [INFO ] [MAIN ] WDI: Loaded 21532 existing records. [2025-10-27T21:52:16.121512] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:16.121750] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-27T21:52:16.121803] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-27T21:52:16.121988] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-27T21:52:16.122027] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-27T21:52:16.417728] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-27T21:52:16.417041] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-27T21:52:16.495817] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:17.215002] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-27T21:52:17.666382] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T21:52:17.886533] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-27T21:52:18.014943] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-27T21:52:18.639754] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-27T21:52:18.814963] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-27T21:52:19.614960] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-27T21:52:20.270500] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-27T21:52:20.414974] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-27T21:52:20.626782] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T21:52:21.214908] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-27T21:52:21.374555] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T21:52:22.014909] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-27T21:52:22.258097] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T21:52:22.464986] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-27T21:52:22.814958] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-27T21:52:23.373781] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-27T21:52:23.614984] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-27T21:52:24.414919] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-27T21:52:24.436838] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-27T21:52:25.214953] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-27T21:52:25.701737] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-27T21:52:26.014975] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-27T21:52:26.327997] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T21:52:26.814978] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-27T21:52:27.030312] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-27T21:52:27.614949] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-27T21:52:27.796189] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T21:52:28.414991] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-27T21:52:29.188722] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-27T21:52:29.214938] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-27T21:52:29.369348] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-27T21:52:29.963628] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-27T21:52:30.014959] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-27T21:52:30.814936] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-27T21:52:31.302762] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-27T21:52:31.614962] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-27T21:52:31.911193] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-27T21:52:32.414947] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-27T21:52:32.479988] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-27T21:52:32.973502] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-27T21:52:32.977005] [INFO ] [REMOTE ] WD: Full fetch complete (32922 records). [2025-10-27T21:52:32.977084] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-27T21:52:33.220181] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-27T21:52:33.339772] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-27T21:52:33.339850] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-27T21:52:33.340567] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-27T21:52:33.341023] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-27T21:52:33.341968] [DEBUG] [LOCAL ] WD: Trimmed 32922 records to 22168 (keeping 200 days of data) [2025-10-27T21:52:33.477480] [DEBUG] [LOCAL ] WD: Primary data saved (22168 records). [2025-10-27T21:52:33.477634] [INFO ] [MAIN ] WD: Full history saved. [2025-10-27T21:52:33.477749] [INFO ] [MAIN ] Update Progress: 2273/2366 symbols completed. WD took 30.2s. Estimated remaining: 11m 58s. Rate: 7.8 symbols/min [2025-10-27T21:52:33.641190] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:33.681100] [DEBUG] [LOCAL ] WDS: Loaded 43633 existing records from primary storage. [2025-10-27T21:52:33.681389] [INFO ] [MAIN ] WDS: Loaded 43633 existing records. [2025-10-27T21:52:33.852620] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:33.852872] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-27T21:52:33.852918] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-27T21:52:33.853104] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-27T21:52:33.853160] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-27T21:52:34.022693] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-27T21:52:34.190365] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:52:34.223715] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:34.814970] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-27T21:52:35.156455] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T21:52:35.161340] [INFO ] [REMOTE ] WDH: Full fetch complete (24003 records). [2025-10-27T21:52:35.161460] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-27T21:52:35.537774] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-27T21:52:35.537850] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-27T21:52:35.538354] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-27T21:52:35.538396] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-27T21:52:35.539074] [DEBUG] [LOCAL ] WDH: Trimmed 24003 records to 17911 (keeping 200 days of data) [2025-10-27T21:52:35.621690] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-27T21:52:35.645251] [DEBUG] [LOCAL ] WDH: Primary data saved (17911 records). [2025-10-27T21:52:35.645409] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-27T21:52:35.645498] [INFO ] [MAIN ] Update Progress: 2274/2366 symbols completed. WDH took 21.6s. Estimated remaining: 11m 50s. Rate: 7.8 symbols/min [2025-10-27T21:52:35.814347] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:35.829175] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-27T21:52:35.840808] [DEBUG] [LOCAL ] WEA: Loaded 7926 existing records from primary storage. [2025-10-27T21:52:35.840988] [INFO ] [MAIN ] WEA: Loaded 7926 existing records. [2025-10-27T21:52:36.011580] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:36.011822] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-27T21:52:36.011867] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-27T21:52:36.012008] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-27T21:52:36.012044] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-27T21:52:36.353499] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:36.414895] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-27T21:52:36.826430] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T21:52:36.936056] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-27T21:52:37.214949] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-27T21:52:37.794603] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-27T21:52:38.014948] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-27T21:52:38.611808] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T21:52:38.814946] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-27T21:52:39.614921] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-27T21:52:40.420683] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-27T21:52:40.425985] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T21:52:40.770688] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T21:52:41.111242] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-27T21:52:41.214923] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-27T21:52:42.014948] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-27T21:52:42.480290] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-27T21:52:42.710407] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-27T21:52:42.719685] [INFO ] [REMOTE ] WCN: Full fetch complete (69469 records). [2025-10-27T21:52:42.719807] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-27T21:52:42.816368] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-27T21:52:43.094760] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-27T21:52:43.094836] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-27T21:52:43.095921] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-27T21:52:43.095981] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-27T21:52:43.097315] [DEBUG] [LOCAL ] WCN: Trimmed 69469 records to 47789 (keeping 200 days of data) [2025-10-27T21:52:43.382827] [DEBUG] [LOCAL ] WCN: Primary data saved (47789 records). [2025-10-27T21:52:43.382971] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-27T21:52:43.383404] [INFO ] [MAIN ] Update Progress: 2275/2366 symbols completed. WCN took 41.5s. Estimated remaining: 11m 42s. Rate: 7.8 symbols/min [2025-10-27T21:52:43.548557] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:43.587582] [DEBUG] [LOCAL ] WEAV: Loaded 42950 existing records from primary storage. [2025-10-27T21:52:43.587882] [INFO ] [MAIN ] WEAV: Loaded 42950 existing records. [2025-10-27T21:52:43.620066] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-27T21:52:43.692965] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-27T21:52:43.776074] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:43.776284] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-27T21:52:43.776332] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-27T21:52:43.776523] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-27T21:52:43.776564] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-27T21:52:44.133083] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:44.414935] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-27T21:52:44.747259] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-27T21:52:45.214954] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-27T21:52:45.450280] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-27T21:52:46.014946] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-27T21:52:46.571295] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T21:52:46.814979] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-27T21:52:47.234303] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-27T21:52:47.614967] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-27T21:52:48.015891] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T21:52:48.342676] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-10-27T21:52:48.414964] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-27T21:52:49.215001] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-27T21:52:49.644553] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:52:49.646611] [INFO ] [REMOTE ] WEA: Full fetch complete (10046 records). [2025-10-27T21:52:49.646734] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-27T21:52:50.025671] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-27T21:52:50.028427] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-27T21:52:50.028926] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-27T21:52:50.019576] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-27T21:52:50.029180] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-27T21:52:50.030888] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-27T21:52:50.040797] [DEBUG] [LOCAL ] WEA: Trimmed 10046 records to 7817 (keeping 200 days of data) [2025-10-27T21:52:50.091370] [DEBUG] [LOCAL ] WEA: Primary data saved (7817 records). [2025-10-27T21:52:50.091489] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-27T21:52:50.091567] [INFO ] [MAIN ] Update Progress: 2276/2366 symbols completed. WEA took 14.4s. Estimated remaining: 11m 35s. Rate: 7.8 symbols/min [2025-10-27T21:52:50.256825] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:52:50.306582] [DEBUG] [LOCAL ] WEC: Loaded 52886 existing records from primary storage. [2025-10-27T21:52:50.306931] [INFO ] [MAIN ] WEC: Loaded 52886 existing records. [2025-10-27T21:52:50.484559] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:52:50.484786] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-27T21:52:50.484833] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-27T21:52:50.485033] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-27T21:52:50.485087] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-27T21:52:50.833288] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-27T21:52:50.839497] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:52:51.254593] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-27T21:52:51.614912] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-27T21:52:51.996557] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-27T21:52:52.001281] [INFO ] [REMOTE ] WDI: Full fetch complete (30353 records). [2025-10-27T21:52:52.001402] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-27T21:52:52.361287] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-27T21:52:52.361365] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-27T21:52:52.361994] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-27T21:52:52.362055] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-27T21:52:52.362808] [DEBUG] [LOCAL ] WDI: Trimmed 30353 records to 20832 (keeping 200 days of data) [2025-10-27T21:52:52.421728] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-27T21:52:52.488337] [DEBUG] [LOCAL ] WDI: Primary data saved (20832 records). [2025-10-27T21:52:52.488466] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-27T21:52:52.488543] [INFO ] [MAIN ] Update Progress: 2277/2366 symbols completed. WDI took 36.7s. Estimated remaining: 11m 27s. Rate: 7.8 symbols/min [2025-10-27T21:52:53.199661] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T21:52:53.214899] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-27T21:52:53.607136] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T21:52:54.014991] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-27T21:52:54.716568] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-27T21:52:54.814911] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-27T21:52:55.278836] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T21:52:55.615001] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-27T21:52:56.414985] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-27T21:52:56.672138] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-27T21:52:57.110929] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:52:57.214920] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-27T21:52:57.481411] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-27T21:52:58.014942] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-27T21:52:58.322939] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T21:52:58.815006] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-27T21:52:59.563383] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-27T21:52:59.614905] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-27T21:52:59.786522] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-27T21:53:00.415075] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-27T21:53:01.118767] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T21:53:01.214959] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-27T21:53:01.970881] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-27T21:53:02.014949] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-27T21:53:02.815005] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-27T21:53:03.006863] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T21:53:03.461291] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:53:03.615006] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-27T21:53:04.065827] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T21:53:04.415005] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-27T21:53:05.215040] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-27T21:53:05.500134] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-27T21:53:05.535504] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-27T21:53:06.015036] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-27T21:53:06.367819] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-27T21:53:06.814984] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-27T21:53:07.614995] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-27T21:53:07.883275] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T21:53:08.332823] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-27T21:53:08.414916] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-27T21:53:08.702180] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-27T21:53:08.710539] [INFO ] [REMOTE ] WDS: Full fetch complete (64047 records). [2025-10-27T21:53:08.710699] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-27T21:53:09.102981] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-27T21:53:09.103060] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-27T21:53:09.104151] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-27T21:53:09.104264] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-27T21:53:09.105533] [DEBUG] [LOCAL ] WDS: Trimmed 64047 records to 42786 (keeping 200 days of data) [2025-10-27T21:53:09.225142] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-27T21:53:09.358681] [DEBUG] [LOCAL ] WDS: Primary data saved (42786 records). [2025-10-27T21:53:09.358798] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-27T21:53:09.358875] [INFO ] [MAIN ] Update Progress: 2278/2366 symbols completed. WDS took 35.9s. Estimated remaining: 11m 19s. Rate: 7.8 symbols/min [2025-10-27T21:53:09.623556] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T21:53:10.014925] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-27T21:53:10.336361] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-27T21:53:10.805308] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-27T21:53:10.814896] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-27T21:53:10.815779] [INFO ] [REMOTE ] WEC: Full fetch complete (75874 records). [2025-10-27T21:53:10.815854] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-27T21:53:11.196428] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-27T21:53:11.196504] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-27T21:53:11.197706] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-27T21:53:11.197769] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-27T21:53:11.199142] [DEBUG] [LOCAL ] WEC: Trimmed 75874 records to 52101 (keeping 200 days of data) [2025-10-27T21:53:11.514822] [DEBUG] [LOCAL ] WEC: Primary data saved (52101 records). [2025-10-27T21:53:11.514949] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-27T21:53:11.515026] [INFO ] [MAIN ] Update Progress: 2279/2366 symbols completed. WEC took 21.4s. Estimated remaining: 11m 11s. Rate: 7.8 symbols/min [2025-10-27T21:53:11.857854] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-27T21:53:11.867329] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-27T21:53:13.447161] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T21:53:13.456388] [INFO ] [REMOTE ] WEAV: Full fetch complete (61732 records). [2025-10-27T21:53:13.456544] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-27T21:53:13.826678] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-27T21:53:13.826764] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-27T21:53:13.827812] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-27T21:53:13.827873] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-27T21:53:13.829041] [DEBUG] [LOCAL ] WEAV: Trimmed 61732 records to 42190 (keeping 200 days of data) [2025-10-27T21:53:14.057562] [DEBUG] [LOCAL ] WEAV: Primary data saved (42190 records). [2025-10-27T21:53:14.057706] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-27T21:53:14.058145] [INFO ] [MAIN ] Update Progress: 2280/2366 symbols completed. WEAV took 30.7s. Estimated remaining: 11m 4s. Rate: 7.8 symbols/min [2025-10-27T21:53:14.687497] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:14.743205] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:14.710409] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:14.746345] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:14.761851] [DEBUG] [LOCAL ] WF: Loaded 10840 existing records from primary storage. [2025-10-27T21:53:14.762837] [INFO ] [MAIN ] WF: Loaded 10840 existing records. [2025-10-27T21:53:14.893805] [DEBUG] [LOCAL ] WEX: Loaded 32739 existing records from primary storage. [2025-10-27T21:53:14.934541] [INFO ] [MAIN ] WEX: Loaded 32739 existing records. [2025-10-27T21:53:15.006294] [DEBUG] [LOCAL ] WES: Loaded 49454 existing records from primary storage. [2025-10-27T21:53:15.035167] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:15.054013] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-27T21:53:15.053944] [INFO ] [MAIN ] WES: Loaded 49454 existing records. [2025-10-27T21:53:15.067886] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-27T21:53:15.155545] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-27T21:53:15.198095] [DEBUG] [LOCAL ] WELL: Loaded 53053 existing records from primary storage. [2025-10-27T21:53:15.186192] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-27T21:53:15.232178] [INFO ] [MAIN ] WELL: Loaded 53053 existing records. [2025-10-27T21:53:15.563569] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:15.585962] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:15.597115] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-27T21:53:15.655875] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-27T21:53:15.655785] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-27T21:53:15.717779] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-27T21:53:15.704541] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-27T21:53:15.759457] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-27T21:53:15.762547] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:15.801304] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-27T21:53:15.801421] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-27T21:53:15.801242] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-27T21:53:15.883157] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-27T21:53:15.918127] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-27T21:53:16.003026] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-27T21:53:16.437320] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:16.558972] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-27T21:53:16.866209] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:16.900391] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-27T21:53:16.945258] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:16.992747] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-27T21:53:16.997524] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:16.997900] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-27T21:53:17.572464] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-27T21:53:17.575613] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-27T21:53:17.961461] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T21:53:17.967836] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-27T21:53:18.063466] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-27T21:53:18.066380] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-27T21:53:18.303251] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T21:53:18.312815] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-27T21:53:18.690125] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-27T21:53:18.814901] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-27T21:53:18.877100] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T21:53:18.977787] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-27T21:53:19.509560] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-27T21:53:19.614905] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-27T21:53:20.414964] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-27T21:53:20.577896] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T21:53:20.856118] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T21:53:21.214970] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-27T21:53:21.611039] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-27T21:53:21.796159] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-27T21:53:22.014944] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-27T21:53:22.491296] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-27T21:53:22.814995] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-27T21:53:23.615012] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-27T21:53:24.420450] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-27T21:53:24.425458] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T21:53:25.111353] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-27T21:53:25.203234] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-27T21:53:25.214941] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-27T21:53:26.014946] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-27T21:53:26.621048] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-27T21:53:26.814966] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-27T21:53:27.091291] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T21:53:27.470165] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-27T21:53:27.614938] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-27T21:53:28.058289] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T21:53:28.414944] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-27T21:53:29.214996] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-27T21:53:29.261577] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-27T21:53:30.014975] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-27T21:53:30.814999] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-27T21:53:31.127259] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-27T21:53:31.331467] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T21:53:31.614981] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-27T21:53:31.780021] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:53:32.414992] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-27T21:53:33.032505] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T21:53:33.214955] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-27T21:53:33.717552] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-27T21:53:33.744201] [INFO ] [REMOTE ] WF: Full fetch complete (15907 records). [2025-10-27T21:53:33.744475] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-27T21:53:33.752178] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-27T21:53:34.020188] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-27T21:53:34.111555] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-27T21:53:34.111629] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-27T21:53:34.112088] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-27T21:53:34.112137] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-27T21:53:34.112625] [DEBUG] [LOCAL ] WF: Trimmed 15907 records to 10521 (keeping 200 days of data) [2025-10-27T21:53:34.176230] [DEBUG] [LOCAL ] WF: Primary data saved (10521 records). [2025-10-27T21:53:34.176336] [INFO ] [MAIN ] WF: Full history saved. [2025-10-27T21:53:34.176415] [INFO ] [MAIN ] Update Progress: 2281/2366 symbols completed. WF took 20.1s. Estimated remaining: 10m 56s. Rate: 7.8 symbols/min [2025-10-27T21:53:34.338736] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:34.388195] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-10-27T21:53:34.388534] [INFO ] [MAIN ] WFC: Loaded 54528 existing records. [2025-10-27T21:53:34.563583] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:34.564832] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-27T21:53:34.564891] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-27T21:53:34.565619] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-27T21:53:34.565754] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-27T21:53:34.820763] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-27T21:53:34.907788] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:35.614982] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-27T21:53:35.736191] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T21:53:35.774592] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T21:53:36.414935] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-27T21:53:37.077060] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T21:53:37.214929] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-27T21:53:37.652482] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:53:38.014931] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-27T21:53:38.504080] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T21:53:38.814955] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-27T21:53:38.896779] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-27T21:53:38.903015] [INFO ] [REMOTE ] WEX: Full fetch complete (50288 records). [2025-10-27T21:53:38.903128] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-27T21:53:39.325516] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-27T21:53:39.325614] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-27T21:53:39.326812] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-27T21:53:39.326896] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-27T21:53:39.327980] [DEBUG] [LOCAL ] WEX: Trimmed 50288 records to 31810 (keeping 200 days of data) [2025-10-27T21:53:39.535955] [DEBUG] [LOCAL ] WEX: Primary data saved (31810 records). [2025-10-27T21:53:39.536081] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-27T21:53:39.536911] [INFO ] [MAIN ] Update Progress: 2282/2366 symbols completed. WEX took 25.5s. Estimated remaining: 10m 48s. Rate: 7.8 symbols/min [2025-10-27T21:53:39.623028] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-27T21:53:39.731985] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:39.756526] [DEBUG] [LOCAL ] WFG: Loaded 24893 existing records from primary storage. [2025-10-27T21:53:39.756909] [INFO ] [MAIN ] WFG: Loaded 24893 existing records. [2025-10-27T21:53:39.953973] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:39.954173] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-27T21:53:39.954248] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-27T21:53:39.954487] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-27T21:53:39.954545] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-27T21:53:40.359940] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:40.388104] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T21:53:40.414907] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-27T21:53:41.214906] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-27T21:53:41.276276] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-27T21:53:41.790560] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T21:53:42.014935] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-27T21:53:42.814961] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-27T21:53:42.950085] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T21:53:43.548293] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T21:53:43.614925] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-27T21:53:44.423045] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-27T21:53:44.426000] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T21:53:45.215028] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-27T21:53:45.371160] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T21:53:45.873144] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T21:53:46.014999] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-27T21:53:46.738516] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-27T21:53:46.748624] [INFO ] [REMOTE ] WELL: Full fetch complete (76013 records). [2025-10-27T21:53:46.748872] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-27T21:53:46.856289] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-27T21:53:46.840701] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-27T21:53:46.894219] [INFO ] [REMOTE ] WES: Full fetch complete (70697 records). [2025-10-27T21:53:46.904907] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-27T21:53:47.486012] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-27T21:53:47.486319] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-27T21:53:47.487689] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-27T21:53:47.493131] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-27T21:53:47.559799] [DEBUG] [LOCAL ] WELL: Trimmed 76013 records to 52274 (keeping 200 days of data) [2025-10-27T21:53:47.581927] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-27T21:53:47.581995] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-27T21:53:47.582773] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-27T21:53:47.582847] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-27T21:53:47.638135] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-27T21:53:47.638409] [DEBUG] [LOCAL ] WES: Trimmed 70697 records to 48645 (keeping 200 days of data) [2025-10-27T21:53:47.928149] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-27T21:53:48.127918] [DEBUG] [LOCAL ] WES: Primary data saved (48645 records). [2025-10-27T21:53:48.137004] [INFO ] [MAIN ] WES: Full history saved. [2025-10-27T21:53:48.143223] [INFO ] [MAIN ] Update Progress: 2283/2366 symbols completed. WES took 34.1s. Estimated remaining: 10m 41s. Rate: 7.8 symbols/min [2025-10-27T21:53:48.417121] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:48.417498] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-27T21:53:48.428042] [DEBUG] [LOCAL ] WELL: Primary data saved (52274 records). [2025-10-27T21:53:48.429501] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-27T21:53:48.430283] [INFO ] [MAIN ] Update Progress: 2284/2366 symbols completed. WELL took 34.4s. Estimated remaining: 10m 33s. Rate: 7.8 symbols/min [2025-10-27T21:53:48.618410] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:53:48.635596] [DEBUG] [LOCAL ] WGO: Loaded 38650 existing records from primary storage. [2025-10-27T21:53:48.636020] [INFO ] [MAIN ] WGO: Loaded 38650 existing records. [2025-10-27T21:53:48.873618] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:48.874676] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-27T21:53:48.874779] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-27T21:53:48.874569] [DEBUG] [LOCAL ] WH: Loaded 46021 existing records from primary storage. [2025-10-27T21:53:48.875122] [INFO ] [MAIN ] WH: Loaded 46021 existing records. [2025-10-27T21:53:48.905950] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-27T21:53:48.930319] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-27T21:53:49.265404] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:53:49.309448] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-27T21:53:49.323191] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-27T21:53:49.334031] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-27T21:53:49.339383] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-27T21:53:49.538403] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:49.539052] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-27T21:53:49.816269] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-27T21:53:49.815318] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:53:49.853730] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-27T21:53:50.014914] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-27T21:53:50.676385] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T21:53:50.814978] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-27T21:53:51.614914] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-27T21:53:51.740219] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-27T21:53:52.054590] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-27T21:53:52.414941] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-27T21:53:52.695987] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T21:53:53.214947] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-27T21:53:53.602719] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-27T21:53:54.014997] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-27T21:53:54.814919] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-27T21:53:54.926169] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T21:53:55.410617] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-27T21:53:55.614980] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-27T21:53:56.414937] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-27T21:53:56.741782] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-27T21:53:56.860002] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T21:53:57.214966] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-27T21:53:57.235311] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T21:53:58.014941] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-27T21:53:58.271757] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T21:53:58.814959] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-27T21:53:59.614977] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-27T21:53:59.741781] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-27T21:53:59.898015] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T21:54:00.414989] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-27T21:54:00.443135] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-27T21:54:01.214930] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-27T21:54:01.738179] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-27T21:54:02.014967] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-27T21:54:02.389965] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:54:02.815029] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-27T21:54:03.221276] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-27T21:54:03.614985] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-27T21:54:04.006446] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-27T21:54:04.414920] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-27T21:54:04.876434] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T21:54:05.214168] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-27T21:54:05.219342] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-27T21:54:06.014980] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-27T21:54:06.670604] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:54:06.814897] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-27T21:54:06.849790] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-27T21:54:07.614994] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-27T21:54:08.129932] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-27T21:54:08.415001] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-27T21:54:08.994602] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-27T21:54:09.214964] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-27T21:54:09.477776] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-27T21:54:09.485080] [INFO ] [REMOTE ] WFG: Full fetch complete (36490 records). [2025-10-27T21:54:09.485278] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-27T21:54:09.857866] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-27T21:54:09.857942] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-27T21:54:09.858690] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-27T21:54:09.858751] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-27T21:54:09.859593] [DEBUG] [LOCAL ] WFG: Trimmed 36490 records to 24243 (keeping 200 days of data) [2025-10-27T21:54:10.008844] [DEBUG] [LOCAL ] WFG: Primary data saved (24243 records). [2025-10-27T21:54:10.008963] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-27T21:54:10.009059] [INFO ] [MAIN ] Update Progress: 2285/2366 symbols completed. WFG took 30.5s. Estimated remaining: 10m 26s. Rate: 7.8 symbols/min [2025-10-27T21:54:10.014927] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-27T21:54:10.186212] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:10.224495] [DEBUG] [LOCAL ] WHD: Loaded 40534 existing records from primary storage. [2025-10-27T21:54:10.224797] [INFO ] [MAIN ] WHD: Loaded 40534 existing records. [2025-10-27T21:54:10.403698] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T21:54:10.431992] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:10.432417] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-27T21:54:10.432577] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-27T21:54:10.433017] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-27T21:54:10.433077] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-27T21:54:10.779475] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:10.814903] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-27T21:54:11.262823] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:54:11.614924] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-27T21:54:11.862111] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-27T21:54:12.414964] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-27T21:54:13.152907] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-27T21:54:13.214957] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-27T21:54:13.822457] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-27T21:54:13.829896] [INFO ] [REMOTE ] WGO: Full fetch complete (57238 records). [2025-10-27T21:54:13.829984] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-27T21:54:14.018003] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-27T21:54:14.209831] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-27T21:54:14.210025] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-27T21:54:14.211056] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-27T21:54:14.211139] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-27T21:54:14.212282] [DEBUG] [LOCAL ] WGO: Trimmed 57238 records to 37932 (keeping 200 days of data) [2025-10-27T21:54:14.340371] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:54:14.466071] [DEBUG] [LOCAL ] WGO: Primary data saved (37932 records). [2025-10-27T21:54:14.466324] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-27T21:54:14.466540] [INFO ] [MAIN ] Update Progress: 2286/2366 symbols completed. WGO took 26.3s. Estimated remaining: 10m 18s. Rate: 7.8 symbols/min [2025-10-27T21:54:14.633060] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:14.638253] [DEBUG] [LOCAL ] WHG: Loaded 3058 existing records from primary storage. [2025-10-27T21:54:14.638413] [INFO ] [MAIN ] WHG: Loaded 3058 existing records. [2025-10-27T21:54:14.815777] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-27T21:54:14.819057] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:14.845813] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-27T21:54:14.846025] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-27T21:54:14.846305] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-27T21:54:14.848088] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-27T21:54:14.848248] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-27T21:54:14.933059] [INFO ] [REMOTE ] WFC: Full fetch complete (77927 records). [2025-10-27T21:54:14.944322] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-27T21:54:15.547369] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:15.616175] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-27T21:54:15.660434] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-27T21:54:15.660543] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-27T21:54:15.662267] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-27T21:54:15.662542] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-27T21:54:15.664442] [DEBUG] [LOCAL ] WFC: Trimmed 77927 records to 53748 (keeping 200 days of data) [2025-10-27T21:54:16.006468] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-27T21:54:16.006725] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-27T21:54:16.007235] [INFO ] [MAIN ] Update Progress: 2287/2366 symbols completed. WFC took 41.8s. Estimated remaining: 10m 10s. Rate: 7.8 symbols/min [2025-10-27T21:54:16.177946] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:16.222685] [DEBUG] [LOCAL ] WHR: Loaded 49586 existing records from primary storage. [2025-10-27T21:54:16.222977] [INFO ] [MAIN ] WHR: Loaded 49586 existing records. [2025-10-27T21:54:16.416058] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-27T21:54:16.419920] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:16.424534] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-27T21:54:16.424623] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-27T21:54:16.424923] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-27T21:54:16.425099] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-27T21:54:16.470926] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T21:54:16.787451] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:16.826699] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-27T21:54:17.214930] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-27T21:54:17.499564] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T21:54:17.581452] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-27T21:54:18.014916] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-27T21:54:18.516455] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-27T21:54:18.814998] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-27T21:54:19.614997] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-27T21:54:20.012948] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T21:54:20.414944] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-27T21:54:20.793052] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-27T21:54:21.214936] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-27T21:54:21.652891] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:54:22.014992] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-27T21:54:22.373044] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T21:54:22.814962] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-27T21:54:23.431934] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-27T21:54:23.489607] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-27T21:54:23.614931] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-27T21:54:24.414958] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-27T21:54:25.214927] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-27T21:54:25.301477] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-27T21:54:25.310365] [INFO ] [REMOTE ] WH: Full fetch complete (65920 records). [2025-10-27T21:54:25.310507] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-27T21:54:25.702050] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-27T21:54:25.702127] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-27T21:54:25.703281] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-27T21:54:25.703343] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-27T21:54:25.704576] [DEBUG] [LOCAL ] WH: Trimmed 65920 records to 45314 (keeping 200 days of data) [2025-10-27T21:54:25.953496] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-27T21:54:26.009105] [DEBUG] [LOCAL ] WH: Primary data saved (45314 records). [2025-10-27T21:54:26.009238] [INFO ] [MAIN ] WH: Full history saved. [2025-10-27T21:54:26.009913] [INFO ] [MAIN ] Update Progress: 2288/2366 symbols completed. WH took 37.6s. Estimated remaining: 10m 2s. Rate: 7.8 symbols/min [2025-10-27T21:54:26.020721] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-27T21:54:26.180016] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:26.188676] [DEBUG] [LOCAL ] WIA: Loaded 5133 existing records from primary storage. [2025-10-27T21:54:26.188897] [INFO ] [MAIN ] WIA: Loaded 5133 existing records. [2025-10-27T21:54:26.359585] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:26.359824] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-27T21:54:26.359872] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-27T21:54:26.360012] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-27T21:54:26.360048] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-27T21:54:26.710932] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:26.814921] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-27T21:54:26.962481] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T21:54:27.197679] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T21:54:27.546254] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-27T21:54:27.614919] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-27T21:54:28.414944] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-27T21:54:28.829428] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T21:54:29.161352] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T21:54:29.214941] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-27T21:54:30.015014] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-27T21:54:30.328674] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-27T21:54:30.638566] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T21:54:30.814973] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-27T21:54:31.420821] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-27T21:54:31.614943] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-27T21:54:32.215043] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-27T21:54:32.414936] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-27T21:54:32.867126] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T21:54:33.214957] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-27T21:54:34.014955] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-27T21:54:34.609328] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-27T21:54:34.814940] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-27T21:54:35.140368] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T21:54:35.148202] [INFO ] [REMOTE ] WHD: Full fetch complete (58004 records). [2025-10-27T21:54:35.148318] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-27T21:54:35.524664] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-27T21:54:35.524752] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-27T21:54:35.525781] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-27T21:54:35.525842] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-27T21:54:35.526968] [DEBUG] [LOCAL ] WHD: Trimmed 58004 records to 39696 (keeping 200 days of data) [2025-10-27T21:54:35.620816] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-27T21:54:35.766058] [DEBUG] [LOCAL ] WHD: Primary data saved (39696 records). [2025-10-27T21:54:35.766194] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-27T21:54:35.766268] [INFO ] [MAIN ] Update Progress: 2289/2366 symbols completed. WHD took 25.8s. Estimated remaining: 9m 54s. Rate: 7.8 symbols/min [2025-10-27T21:54:35.936511] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:35.948845] [DEBUG] [LOCAL ] WINN: Loaded 11353 existing records from primary storage. [2025-10-27T21:54:35.949100] [INFO ] [MAIN ] WINN: Loaded 11353 existing records. [2025-10-27T21:54:36.112404] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T21:54:36.131444] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:36.132925] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-27T21:54:36.132975] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-27T21:54:36.133196] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-27T21:54:36.133265] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-27T21:54:36.430612] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-27T21:54:36.516407] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:36.637012] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-27T21:54:36.930582] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-27T21:54:37.214934] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-27T21:54:37.740242] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-27T21:54:38.014913] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-27T21:54:38.814941] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-27T21:54:39.192239] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-27T21:54:39.465478] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-27T21:54:39.614917] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-27T21:54:40.414974] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-27T21:54:40.963524] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-27T21:54:40.992712] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-27T21:54:41.214933] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-27T21:54:41.524761] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-27T21:54:42.014940] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-27T21:54:42.814977] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-27T21:54:43.176236] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T21:54:43.177120] [INFO ] [REMOTE ] WHG: Full fetch complete (4322 records). [2025-10-27T21:54:43.177188] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-27T21:54:43.536844] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-27T21:54:43.536976] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-27T21:54:43.537217] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-27T21:54:43.537323] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-27T21:54:43.537900] [DEBUG] [LOCAL ] WHG: Trimmed 4322 records to 2977 (keeping 200 days of data) [2025-10-27T21:54:43.556173] [DEBUG] [LOCAL ] WHG: Primary data saved (2977 records). [2025-10-27T21:54:43.556290] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-27T21:54:43.556428] [INFO ] [MAIN ] Update Progress: 2290/2366 symbols completed. WHG took 29.1s. Estimated remaining: 9m 47s. Rate: 7.8 symbols/min [2025-10-27T21:54:43.618741] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-27T21:54:43.731674] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:43.779986] [DEBUG] [LOCAL ] WIT: Loaded 53309 existing records from primary storage. [2025-10-27T21:54:43.807892] [INFO ] [MAIN ] WIT: Loaded 53309 existing records. [2025-10-27T21:54:43.878750] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-27T21:54:43.996443] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:43.996692] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-27T21:54:43.996750] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-27T21:54:43.996938] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-27T21:54:43.996975] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-27T21:54:44.345059] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:44.414899] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-27T21:54:44.503466] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T21:54:45.214952] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-27T21:54:46.014994] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-27T21:54:46.123112] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-27T21:54:46.654168] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T21:54:46.814981] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-27T21:54:46.834061] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-27T21:54:47.614954] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-27T21:54:48.414925] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-27T21:54:48.671883] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-27T21:54:48.676856] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T21:54:49.214963] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-27T21:54:49.633666] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T21:54:50.014960] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-27T21:54:50.074888] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-27T21:54:50.414021] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-27T21:54:50.814985] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-27T21:54:51.615001] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-27T21:54:52.113461] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T21:54:52.300108] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-27T21:54:52.309820] [INFO ] [REMOTE ] WHR: Full fetch complete (69881 records). [2025-10-27T21:54:52.309949] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-27T21:54:52.420121] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-27T21:54:52.741749] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-27T21:54:52.741867] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-27T21:54:52.743442] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-27T21:54:52.743514] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-27T21:54:52.745418] [DEBUG] [LOCAL ] WHR: Trimmed 69881 records to 48831 (keeping 200 days of data) [2025-10-27T21:54:53.219063] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-27T21:54:53.228532] [DEBUG] [LOCAL ] WHR: Primary data saved (48831 records). [2025-10-27T21:54:53.228811] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-27T21:54:53.229457] [INFO ] [MAIN ] Update Progress: 2291/2366 symbols completed. WHR took 37.2s. Estimated remaining: 9m 39s. Rate: 7.8 symbols/min [2025-10-27T21:54:53.524779] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:53.549487] [DEBUG] [LOCAL ] WIW: Loaded 20503 existing records from primary storage. [2025-10-27T21:54:53.549797] [INFO ] [MAIN ] WIW: Loaded 20503 existing records. [2025-10-27T21:54:53.781564] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:53.781805] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-27T21:54:53.781856] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-27T21:54:53.782035] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-27T21:54:53.782076] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-27T21:54:53.985671] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-27T21:54:54.021415] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-27T21:54:54.214431] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:54.225894] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T21:54:54.585623] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-27T21:54:54.814967] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-27T21:54:55.278988] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-27T21:54:55.614926] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-27T21:54:56.239624] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-27T21:54:56.414941] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-27T21:54:57.215006] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-27T21:54:57.702629] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-27T21:54:58.014914] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-27T21:54:58.115313] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-27T21:54:58.448827] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T21:54:58.451415] [INFO ] [REMOTE ] WINN: Full fetch complete (17320 records). [2025-10-27T21:54:58.451487] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-27T21:54:58.823723] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-27T21:54:58.836053] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-27T21:54:58.836145] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-27T21:54:58.836597] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-27T21:54:58.836811] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-27T21:54:58.837548] [DEBUG] [LOCAL ] WINN: Trimmed 17320 records to 10950 (keeping 200 days of data) [2025-10-27T21:54:58.901836] [DEBUG] [LOCAL ] WINN: Primary data saved (10950 records). [2025-10-27T21:54:58.901969] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-27T21:54:58.902045] [INFO ] [MAIN ] Update Progress: 2292/2366 symbols completed. WINN took 23.1s. Estimated remaining: 9m 31s. Rate: 7.8 symbols/min [2025-10-27T21:54:59.069295] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:54:59.104059] [DEBUG] [LOCAL ] WK: Loaded 37475 existing records from primary storage. [2025-10-27T21:54:59.104334] [INFO ] [MAIN ] WK: Loaded 37475 existing records. [2025-10-27T21:54:59.277889] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:54:59.278084] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-27T21:54:59.278177] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-27T21:54:59.278368] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-27T21:54:59.278407] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-27T21:54:59.622516] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-27T21:54:59.627186] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:54:59.791434] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-27T21:55:00.043199] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-27T21:55:00.414982] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-27T21:55:01.214969] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-27T21:55:01.577108] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T21:55:01.929637] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-27T21:55:01.931506] [INFO ] [REMOTE ] WIA: Full fetch complete (7300 records). [2025-10-27T21:55:01.931609] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-27T21:55:02.020233] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-27T21:55:02.361775] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-27T21:55:02.361847] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-27T21:55:02.362027] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-27T21:55:02.362065] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-27T21:55:02.362434] [DEBUG] [LOCAL ] WIA: Trimmed 7300 records to 4998 (keeping 200 days of data) [2025-10-27T21:55:02.391262] [DEBUG] [LOCAL ] WIA: Primary data saved (4998 records). [2025-10-27T21:55:02.391355] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-27T21:55:02.391436] [INFO ] [MAIN ] Update Progress: 2293/2366 symbols completed. WIA took 36.4s. Estimated remaining: 9m 23s. Rate: 7.8 symbols/min [2025-10-27T21:55:02.555269] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:02.587854] [DEBUG] [LOCAL ] WKC: Loaded 35058 existing records from primary storage. [2025-10-27T21:55:02.588120] [INFO ] [MAIN ] WKC: Loaded 35058 existing records. [2025-10-27T21:55:02.759556] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:02.759793] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-27T21:55:02.759840] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-27T21:55:02.760018] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-27T21:55:02.760054] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-27T21:55:02.820618] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-27T21:55:03.155125] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:03.419611] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-27T21:55:03.614941] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-27T21:55:03.961430] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-27T21:55:04.414952] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-27T21:55:04.935950] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T21:55:05.214914] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-27T21:55:05.586794] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-27T21:55:06.014922] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-27T21:55:06.150270] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T21:55:06.814969] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-27T21:55:07.508061] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-27T21:55:07.614925] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-27T21:55:08.277747] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T21:55:08.414949] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-27T21:55:08.648846] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-27T21:55:09.214957] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-27T21:55:10.014969] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-27T21:55:10.257397] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-27T21:55:10.671056] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-27T21:55:10.814943] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-27T21:55:11.099829] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T21:55:11.614954] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-27T21:55:11.973527] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T21:55:12.414961] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-27T21:55:12.586450] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-27T21:55:13.215009] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-27T21:55:14.014918] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-27T21:55:14.282947] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-27T21:55:14.381844] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-27T21:55:14.814987] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-27T21:55:15.247883] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-27T21:55:15.615003] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-27T21:55:15.756177] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-27T21:55:16.414940] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-27T21:55:17.030435] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-27T21:55:17.040435] [INFO ] [REMOTE ] WIT: Full fetch complete (76020 records). [2025-10-27T21:55:17.040542] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-27T21:55:17.230140] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-27T21:55:17.432353] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-27T21:55:17.432473] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-27T21:55:17.433800] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-27T21:55:17.433863] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-27T21:55:17.435386] [DEBUG] [LOCAL ] WIT: Trimmed 76020 records to 52538 (keeping 200 days of data) [2025-10-27T21:55:17.730929] [DEBUG] [LOCAL ] WIT: Primary data saved (52538 records). [2025-10-27T21:55:17.731037] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-27T21:55:17.731120] [INFO ] [MAIN ] Update Progress: 2294/2366 symbols completed. WIT took 34.2s. Estimated remaining: 9m 16s. Rate: 7.8 symbols/min [2025-10-27T21:55:17.899429] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:17.939176] [DEBUG] [LOCAL ] WLK: Loaded 46493 existing records from primary storage. [2025-10-27T21:55:17.939473] [INFO ] [MAIN ] WLK: Loaded 46493 existing records. [2025-10-27T21:55:18.020689] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-27T21:55:18.143420] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:18.151119] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-27T21:55:18.150949] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-27T21:55:18.151246] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-27T21:55:18.167033] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T21:55:18.166547] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-27T21:55:18.171131] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-27T21:55:18.530087] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:18.814956] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-27T21:55:19.512601] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-27T21:55:19.614920] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-27T21:55:19.838780] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T21:55:20.414950] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-27T21:55:20.935395] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-27T21:55:21.215037] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-27T21:55:21.636505] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-27T21:55:22.014961] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-27T21:55:22.211516] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-27T21:55:22.814958] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-27T21:55:23.089576] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T21:55:23.096878] [INFO ] [REMOTE ] WK: Full fetch complete (53386 records). [2025-10-27T21:55:23.096989] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-27T21:55:23.468662] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-27T21:55:23.468785] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-27T21:55:23.469954] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-27T21:55:23.470020] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-27T21:55:23.471227] [DEBUG] [LOCAL ] WK: Trimmed 53386 records to 36650 (keeping 200 days of data) [2025-10-27T21:55:23.647417] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-27T21:55:23.691423] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-27T21:55:23.733253] [DEBUG] [LOCAL ] WK: Primary data saved (36650 records). [2025-10-27T21:55:23.733405] [INFO ] [MAIN ] WK: Full history saved. [2025-10-27T21:55:23.733531] [INFO ] [MAIN ] Update Progress: 2295/2366 symbols completed. WK took 24.8s. Estimated remaining: 9m 8s. Rate: 7.8 symbols/min [2025-10-27T21:55:23.964328] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:23.975324] [DEBUG] [LOCAL ] WLKP: Loaded 7386 existing records from primary storage. [2025-10-27T21:55:23.975529] [INFO ] [MAIN ] WLKP: Loaded 7386 existing records. [2025-10-27T21:55:24.172802] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:24.173040] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-27T21:55:24.173088] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-27T21:55:24.173381] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-27T21:55:24.173455] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-27T21:55:24.424675] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-27T21:55:24.528635] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:24.970756] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T21:55:25.214937] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-27T21:55:25.484372] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-27T21:55:25.934281] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-27T21:55:26.014934] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-27T21:55:26.721849] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T21:55:26.814951] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-27T21:55:27.614963] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-27T21:55:28.259788] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T21:55:28.414942] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-27T21:55:28.595139] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T21:55:29.214969] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-27T21:55:29.521737] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T21:55:30.014934] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-27T21:55:30.532281] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-27T21:55:30.814926] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-27T21:55:31.085034] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-27T21:55:31.614995] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-27T21:55:32.414997] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-27T21:55:32.466271] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-27T21:55:32.498811] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-27T21:55:33.036799] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-27T21:55:33.040742] [INFO ] [REMOTE ] WIW: Full fetch complete (29257 records). [2025-10-27T21:55:33.040825] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-27T21:55:33.217548] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-27T21:55:33.418710] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-27T21:55:33.418799] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-27T21:55:33.419425] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-27T21:55:33.419466] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-27T21:55:33.420307] [DEBUG] [LOCAL ] WIW: Trimmed 29257 records to 20070 (keeping 200 days of data) [2025-10-27T21:55:33.536765] [DEBUG] [LOCAL ] WIW: Primary data saved (20070 records). [2025-10-27T21:55:33.536885] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-27T21:55:33.536961] [INFO ] [MAIN ] Update Progress: 2296/2366 symbols completed. WIW took 40.3s. Estimated remaining: 9m 1s. Rate: 7.8 symbols/min [2025-10-27T21:55:33.702242] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:33.702425] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-27T21:55:33.702462] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-27T21:55:33.702571] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-27T21:55:33.702633] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-27T21:55:33.702718] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-27T21:55:33.702756] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-27T21:55:33.815881] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-27T21:55:34.020085] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-27T21:55:34.075541] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:34.814936] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-27T21:55:35.184615] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-27T21:55:35.285480] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T21:55:35.614939] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-27T21:55:36.219246] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-27T21:55:36.414928] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-27T21:55:37.214936] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-27T21:55:37.521007] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-27T21:55:37.652009] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T21:55:38.014913] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-27T21:55:38.372848] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-27T21:55:38.814950] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-27T21:55:39.614950] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-27T21:55:39.994720] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-27T21:55:40.415117] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-27T21:55:40.542805] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-27T21:55:40.759994] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-27T21:55:41.214896] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-27T21:55:42.014973] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-27T21:55:42.423205] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T21:55:42.533154] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-27T21:55:42.814981] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-27T21:55:43.614943] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-27T21:55:44.197872] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-27T21:55:44.204342] [INFO ] [REMOTE ] WKC: Full fetch complete (50244 records). [2025-10-27T21:55:44.204470] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-27T21:55:44.420511] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-27T21:55:44.593083] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-27T21:55:44.593155] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-27T21:55:44.594101] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-27T21:55:44.594160] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-27T21:55:44.595161] [DEBUG] [LOCAL ] WKC: Trimmed 50244 records to 34239 (keeping 200 days of data) [2025-10-27T21:55:44.804607] [DEBUG] [LOCAL ] WKC: Primary data saved (34239 records). [2025-10-27T21:55:44.804771] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-27T21:55:44.805511] [INFO ] [MAIN ] Update Progress: 2297/2366 symbols completed. WKC took 42.4s. Estimated remaining: 8m 53s. Rate: 7.8 symbols/min [2025-10-27T21:55:44.878232] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-27T21:55:45.009825] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T21:55:45.012332] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:45.022010] [INFO ] [REMOTE ] WLK: Full fetch complete (64131 records). [2025-10-27T21:55:45.022182] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-27T21:55:45.216782] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-27T21:55:45.305821] [DEBUG] [LOCAL ] WLY: Loaded 30101 existing records from primary storage. [2025-10-27T21:55:45.333749] [INFO ] [MAIN ] WLY: Loaded 30101 existing records. [2025-10-27T21:55:45.595959] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-27T21:55:45.603542] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-27T21:55:45.616841] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-27T21:55:45.615636] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:45.617034] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-27T21:55:45.617178] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-27T21:55:45.617116] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-27T21:55:45.617590] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-27T21:55:45.617846] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-27T21:55:45.689067] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-27T21:55:45.722048] [DEBUG] [LOCAL ] WLK: Trimmed 64131 records to 45684 (keeping 200 days of data) [2025-10-27T21:55:46.016666] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-27T21:55:46.184481] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:46.275457] [DEBUG] [LOCAL ] WLK: Primary data saved (45684 records). [2025-10-27T21:55:46.275583] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-27T21:55:46.275690] [INFO ] [MAIN ] Update Progress: 2298/2366 symbols completed. WLK took 28.5s. Estimated remaining: 8m 45s. Rate: 7.8 symbols/min [2025-10-27T21:55:46.447333] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:46.495108] [DEBUG] [LOCAL ] WM: Loaded 51589 existing records from primary storage. [2025-10-27T21:55:46.495408] [INFO ] [MAIN ] WM: Loaded 51589 existing records. [2025-10-27T21:55:46.631414] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T21:55:46.687116] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:46.687308] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-27T21:55:46.687356] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-27T21:55:46.687588] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-27T21:55:46.687668] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-27T21:55:46.829369] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-27T21:55:47.049071] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:47.447318] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T21:55:47.614990] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-27T21:55:48.415003] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-27T21:55:49.066086] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-27T21:55:49.096919] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-27T21:55:49.214962] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-27T21:55:49.691942] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T21:55:50.014952] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-27T21:55:50.765245] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-27T21:55:50.767759] [INFO ] [REMOTE ] WLKP: Full fetch complete (10044 records). [2025-10-27T21:55:50.767849] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-27T21:55:50.822197] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-27T21:55:51.130104] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-27T21:55:51.130197] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-27T21:55:51.130445] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-27T21:55:51.130484] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-27T21:55:51.130919] [DEBUG] [LOCAL ] WLKP: Trimmed 10044 records to 7160 (keeping 200 days of data) [2025-10-27T21:55:51.173047] [DEBUG] [LOCAL ] WLKP: Primary data saved (7160 records). [2025-10-27T21:55:51.173162] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-27T21:55:51.173239] [INFO ] [MAIN ] Update Progress: 2299/2366 symbols completed. WLKP took 27.4s. Estimated remaining: 8m 37s. Rate: 7.8 symbols/min [2025-10-27T21:55:51.338444] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:51.385967] [DEBUG] [LOCAL ] WMB: Loaded 54452 existing records from primary storage. [2025-10-27T21:55:51.386270] [INFO ] [MAIN ] WMB: Loaded 54452 existing records. [2025-10-27T21:55:51.562046] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:51.562265] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-27T21:55:51.562311] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-27T21:55:51.562854] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-27T21:55:51.562909] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-27T21:55:51.624560] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-27T21:55:51.941732] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:52.216378] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-27T21:55:52.414984] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-27T21:55:52.626258] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T21:55:53.215011] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-27T21:55:54.014984] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-27T21:55:54.311730] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-27T21:55:54.378517] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-27T21:55:54.376716] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T21:55:54.814984] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-27T21:55:55.614953] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-27T21:55:56.011591] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-27T21:55:56.414949] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-27T21:55:56.548451] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T21:55:57.214992] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-27T21:55:57.356132] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-27T21:55:58.014979] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-27T21:55:58.361058] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-27T21:55:58.362019] [INFO ] [REMOTE ] WLTG: Full fetch complete (1656 records). [2025-10-27T21:55:58.362090] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-27T21:55:58.547707] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T21:55:58.547893] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:55:58.547960] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:55:58.548030] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-27T21:55:58.548094] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-27T21:55:58.548129] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-27T21:55:58.548168] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-27T21:55:58.548222] [INFO ] [MAIN ] Update Progress: 2300/2366 symbols completed. WLTG took 25.0s. Estimated remaining: 8m 30s. Rate: 7.8 symbols/min [2025-10-27T21:55:58.724590] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:55:58.740220] [DEBUG] [LOCAL ] WMK: Loaded 14808 existing records from primary storage. [2025-10-27T21:55:58.740556] [INFO ] [MAIN ] WMK: Loaded 14808 existing records. [2025-10-27T21:55:58.819592] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-27T21:55:58.929221] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:55:58.929411] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-27T21:55:58.929458] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-27T21:55:58.929606] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-27T21:55:58.929679] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-27T21:55:59.077187] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-27T21:55:59.338393] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:55:59.614957] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-27T21:56:00.415292] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T21:56:00.415428] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-27T21:56:00.813360] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:56:01.047369] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-27T21:56:01.214932] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-27T21:56:02.014923] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-27T21:56:02.814994] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-27T21:56:02.967689] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-27T21:56:03.461296] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-27T21:56:03.582010] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-27T21:56:03.614910] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-27T21:56:04.254174] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-27T21:56:04.414985] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-27T21:56:05.214918] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-27T21:56:06.014978] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-27T21:56:06.128112] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-27T21:56:06.407467] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-27T21:56:06.814931] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-27T21:56:06.963298] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T21:56:07.614939] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-27T21:56:08.286949] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-27T21:56:08.414903] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-27T21:56:08.748171] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-27T21:56:09.214976] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-27T21:56:09.369860] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T21:56:10.015000] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-27T21:56:10.190350] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T21:56:10.636994] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-27T21:56:10.814967] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-27T21:56:11.614996] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-27T21:56:11.915696] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-27T21:56:12.414938] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-27T21:56:12.589338] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-27T21:56:13.215003] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-27T21:56:14.016114] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-27T21:56:14.018936] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T21:56:14.133315] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T21:56:14.814994] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-27T21:56:15.614977] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-27T21:56:15.871763] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-27T21:56:15.942066] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T21:56:16.133210] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-27T21:56:16.136041] [INFO ] [REMOTE ] WMK: Full fetch complete (20045 records). [2025-10-27T21:56:16.136109] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-27T21:56:16.416006] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-27T21:56:16.499889] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-27T21:56:16.499954] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-27T21:56:16.500367] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-27T21:56:16.500405] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-27T21:56:16.500951] [DEBUG] [LOCAL ] WMK: Trimmed 20045 records to 14444 (keeping 200 days of data) [2025-10-27T21:56:16.588889] [DEBUG] [LOCAL ] WMK: Primary data saved (14444 records). [2025-10-27T21:56:16.589022] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-27T21:56:16.589137] [INFO ] [MAIN ] Update Progress: 2301/2366 symbols completed. WMK took 18.0s. Estimated remaining: 8m 22s. Rate: 7.8 symbols/min [2025-10-27T21:56:16.756379] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:16.795068] [DEBUG] [LOCAL ] WMS: Loaded 39959 existing records from primary storage. [2025-10-27T21:56:16.795396] [INFO ] [MAIN ] WMS: Loaded 39959 existing records. [2025-10-27T21:56:16.971973] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:16.972155] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-27T21:56:16.972202] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-27T21:56:16.972389] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-27T21:56:16.972428] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-27T21:56:17.224736] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-27T21:56:17.332323] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:18.014955] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-27T21:56:18.191176] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T21:56:18.192333] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-27T21:56:18.815027] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-27T21:56:19.561724] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-27T21:56:19.614924] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-27T21:56:19.703105] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T21:56:19.709053] [INFO ] [REMOTE ] WLY: Full fetch complete (42830 records). [2025-10-27T21:56:19.709212] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-27T21:56:20.075922] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-27T21:56:20.075994] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-27T21:56:20.076851] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-27T21:56:20.076911] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-27T21:56:20.077817] [DEBUG] [LOCAL ] WLY: Trimmed 42830 records to 29484 (keeping 200 days of data) [2025-10-27T21:56:20.258481] [DEBUG] [LOCAL ] WLY: Primary data saved (29484 records). [2025-10-27T21:56:20.258621] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-27T21:56:20.259405] [INFO ] [MAIN ] Update Progress: 2302/2366 symbols completed. WLY took 35.5s. Estimated remaining: 8m 14s. Rate: 7.8 symbols/min [2025-10-27T21:56:20.429382] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-27T21:56:20.432089] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:20.460157] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T21:56:20.470333] [INFO ] [REMOTE ] WM: Full fetch complete (73831 records). [2025-10-27T21:56:20.470487] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-27T21:56:20.812157] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-27T21:56:20.827882] [INFO ] [MAIN ] WMT: Loaded 54580 existing records. [2025-10-27T21:56:21.006311] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-27T21:56:21.012308] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-27T21:56:21.023751] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-27T21:56:21.028955] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-27T21:56:21.086350] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:21.086444] [DEBUG] [LOCAL ] WM: Trimmed 73831 records to 50815 (keeping 200 days of data) [2025-10-27T21:56:21.086965] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-27T21:56:21.087024] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-27T21:56:21.087245] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-27T21:56:21.087332] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-27T21:56:21.245933] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-27T21:56:21.758206] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:21.775189] [DEBUG] [LOCAL ] WM: Primary data saved (50815 records). [2025-10-27T21:56:21.775348] [INFO ] [MAIN ] WM: Full history saved. [2025-10-27T21:56:21.775436] [INFO ] [MAIN ] Update Progress: 2303/2366 symbols completed. WM took 35.5s. Estimated remaining: 8m 6s. Rate: 7.8 symbols/min [2025-10-27T21:56:21.957466] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:21.993255] [DEBUG] [LOCAL ] WNC: Loaded 38504 existing records from primary storage. [2025-10-27T21:56:21.993625] [INFO ] [MAIN ] WNC: Loaded 38504 existing records. [2025-10-27T21:56:22.024803] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-27T21:56:22.204938] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-27T21:56:22.210470] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:22.210804] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-27T21:56:22.210888] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-27T21:56:22.221117] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-27T21:56:22.221208] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-27T21:56:22.592741] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:22.644852] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T21:56:22.814960] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-27T21:56:23.615018] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-27T21:56:24.255335] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T21:56:24.314368] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-27T21:56:24.414942] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-27T21:56:24.684036] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T21:56:25.214947] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-27T21:56:26.014961] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-27T21:56:26.606257] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-27T21:56:26.814974] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-27T21:56:26.864362] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-27T21:56:27.380061] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T21:56:27.614935] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-27T21:56:28.415181] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-27T21:56:29.162835] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:56:29.214908] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-27T21:56:29.282367] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-27T21:56:29.542865] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-27T21:56:30.014954] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-27T21:56:30.493144] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T21:56:30.814962] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-27T21:56:31.614945] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-27T21:56:32.012494] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-27T21:56:32.414916] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-27T21:56:32.547182] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-27T21:56:33.204793] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-27T21:56:33.215204] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-27T21:56:33.728870] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-27T21:56:34.014930] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-27T21:56:34.319602] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T21:56:34.387892] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:56:34.398397] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-27T21:56:34.398568] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-27T21:56:34.795832] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-27T21:56:34.795910] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-27T21:56:34.797193] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-27T21:56:34.797256] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-27T21:56:34.798890] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-27T21:56:34.852130] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-27T21:56:35.126322] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-27T21:56:35.126451] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-27T21:56:35.126525] [INFO ] [MAIN ] Update Progress: 2304/2366 symbols completed. WMB took 44.0s. Estimated remaining: 7m 59s. Rate: 7.8 symbols/min [2025-10-27T21:56:35.292718] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:35.341480] [DEBUG] [LOCAL ] WOLF: Loaded 53675 existing records from primary storage. [2025-10-27T21:56:35.341809] [INFO ] [MAIN ] WOLF: Loaded 53675 existing records. [2025-10-27T21:56:35.514001] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:35.514255] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-27T21:56:35.514302] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-27T21:56:35.514799] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-27T21:56:35.514856] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-27T21:56:35.620090] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-27T21:56:35.867594] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:36.414947] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-27T21:56:36.520454] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-27T21:56:37.175331] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T21:56:37.214905] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-27T21:56:38.014948] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-27T21:56:38.340461] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-27T21:56:38.377537] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-27T21:56:38.814958] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-27T21:56:39.462287] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-27T21:56:39.614915] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-27T21:56:39.980580] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-27T21:56:40.414985] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-27T21:56:40.569016] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T21:56:41.214987] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-27T21:56:42.014996] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-27T21:56:42.172791] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-27T21:56:42.631432] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T21:56:42.814943] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-27T21:56:43.614960] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-27T21:56:44.417043] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-27T21:56:44.419351] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-27T21:56:44.603405] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-27T21:56:44.634353] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-27T21:56:44.641286] [INFO ] [REMOTE ] WNC: Full fetch complete (57778 records). [2025-10-27T21:56:44.641442] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-27T21:56:45.031920] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-27T21:56:45.031994] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-27T21:56:45.033030] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-27T21:56:45.033090] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-27T21:56:45.034170] [DEBUG] [LOCAL ] WNC: Trimmed 57778 records to 37717 (keeping 200 days of data) [2025-10-27T21:56:45.224282] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-27T21:56:45.256159] [DEBUG] [LOCAL ] WNC: Primary data saved (37717 records). [2025-10-27T21:56:45.256337] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-27T21:56:45.256425] [INFO ] [MAIN ] Update Progress: 2305/2366 symbols completed. WNC took 23.5s. Estimated remaining: 7m 51s. Rate: 7.8 symbols/min [2025-10-27T21:56:45.424558] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:45.446410] [DEBUG] [LOCAL ] WOR: Loaded 23757 existing records from primary storage. [2025-10-27T21:56:45.446682] [INFO ] [MAIN ] WOR: Loaded 23757 existing records. [2025-10-27T21:56:45.620923] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:45.621112] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-27T21:56:45.621158] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-27T21:56:45.621350] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-27T21:56:45.621405] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-27T21:56:45.967737] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:46.014913] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-27T21:56:46.815034] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-27T21:56:46.864189] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-27T21:56:46.905889] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-27T21:56:46.940710] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-27T21:56:47.614982] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-27T21:56:48.414959] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-27T21:56:48.787845] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-27T21:56:48.794941] [INFO ] [REMOTE ] WMS: Full fetch complete (57074 records). [2025-10-27T21:56:48.795031] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-27T21:56:49.181601] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-27T21:56:49.181777] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-27T21:56:49.182980] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-27T21:56:49.183055] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-27T21:56:49.184379] [DEBUG] [LOCAL ] WMS: Trimmed 57074 records to 39264 (keeping 200 days of data) [2025-10-27T21:56:49.238596] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-27T21:56:49.331374] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-27T21:56:49.352719] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T21:56:49.490289] [DEBUG] [LOCAL ] WMS: Primary data saved (39264 records). [2025-10-27T21:56:49.490443] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-27T21:56:49.490948] [INFO ] [MAIN ] Update Progress: 2306/2366 symbols completed. WMS took 32.9s. Estimated remaining: 7m 43s. Rate: 7.8 symbols/min [2025-10-27T21:56:49.655437] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:49.684542] [DEBUG] [LOCAL ] WOW: Loaded 31544 existing records from primary storage. [2025-10-27T21:56:49.684822] [INFO ] [MAIN ] WOW: Loaded 31544 existing records. [2025-10-27T21:56:49.856799] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:49.856997] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-27T21:56:49.857044] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-27T21:56:49.857241] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-27T21:56:49.857297] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-27T21:56:50.027115] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-27T21:56:50.208281] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:56:50.814956] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-27T21:56:51.221752] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-27T21:56:51.484236] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T21:56:51.614924] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-27T21:56:52.415026] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-27T21:56:52.601756] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-27T21:56:53.064279] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-27T21:56:53.214984] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-27T21:56:53.496023] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-27T21:56:54.015006] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-27T21:56:54.681215] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-27T21:56:54.814956] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-27T21:56:55.313520] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-27T21:56:55.614960] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-27T21:56:55.912958] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-27T21:56:56.414944] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-27T21:56:57.215018] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-27T21:56:57.731735] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T21:56:57.977259] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-27T21:56:58.014916] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-27T21:56:58.381434] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T21:56:58.391584] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-27T21:56:58.391750] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-27T21:56:58.772422] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-27T21:56:58.772507] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-27T21:56:58.773697] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-27T21:56:58.773759] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-27T21:56:58.775198] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-27T21:56:58.829285] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-27T21:56:59.112484] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-27T21:56:59.112634] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-27T21:56:59.113396] [INFO ] [MAIN ] Update Progress: 2307/2366 symbols completed. WMT took 38.9s. Estimated remaining: 7m 36s. Rate: 7.8 symbols/min [2025-10-27T21:56:59.279931] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:56:59.328242] [DEBUG] [LOCAL ] WPC: Loaded 48759 existing records from primary storage. [2025-10-27T21:56:59.328601] [INFO ] [MAIN ] WPC: Loaded 48759 existing records. [2025-10-27T21:56:59.555048] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:56:59.555330] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-27T21:56:59.555699] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-27T21:56:59.558190] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-27T21:56:59.569098] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-27T21:56:59.569196] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-27T21:56:59.623396] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-27T21:56:59.950329] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:56:59.949208] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:00.414918] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-27T21:57:00.789298] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T21:57:01.214966] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-27T21:57:02.015014] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-27T21:57:02.294390] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-27T21:57:02.814991] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-27T21:57:02.856112] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-27T21:57:03.614938] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-27T21:57:03.715166] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-27T21:57:04.015388] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:57:04.414985] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-27T21:57:05.214918] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-27T21:57:05.591234] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-27T21:57:06.014918] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-27T21:57:06.119039] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-27T21:57:06.588818] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-27T21:57:06.814948] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-27T21:57:07.437706] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-27T21:57:07.614951] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-27T21:57:08.039545] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-27T21:57:08.372048] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-27T21:57:08.414957] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-27T21:57:09.214973] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-27T21:57:09.573700] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-27T21:57:10.015021] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-27T21:57:10.765663] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-27T21:57:10.814936] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-27T21:57:11.614916] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-27T21:57:12.164540] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-27T21:57:12.243431] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-27T21:57:12.414937] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-27T21:57:12.741428] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T21:57:13.214995] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-27T21:57:13.772809] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-27T21:57:14.014955] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-27T21:57:14.069398] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-27T21:57:14.075928] [INFO ] [REMOTE ] WOW: Full fetch complete (43169 records). [2025-10-27T21:57:14.076012] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-27T21:57:14.448103] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-27T21:57:14.448180] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-27T21:57:14.449128] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-27T21:57:14.449189] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-27T21:57:14.450150] [DEBUG] [LOCAL ] WOW: Trimmed 43169 records to 30895 (keeping 200 days of data) [2025-10-27T21:57:14.624969] [DEBUG] [LOCAL ] WOW: Primary data saved (30895 records). [2025-10-27T21:57:14.625119] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-27T21:57:14.625231] [INFO ] [MAIN ] Update Progress: 2308/2366 symbols completed. WOW took 25.1s. Estimated remaining: 7m 28s. Rate: 7.8 symbols/min [2025-10-27T21:57:14.803145] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:14.814960] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-27T21:57:14.855570] [DEBUG] [LOCAL ] WPM: Loaded 53563 existing records from primary storage. [2025-10-27T21:57:14.855940] [INFO ] [MAIN ] WPM: Loaded 53563 existing records. [2025-10-27T21:57:15.041105] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:15.041374] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-27T21:57:15.041443] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-27T21:57:15.041717] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-27T21:57:15.041790] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-27T21:57:15.400398] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:15.459814] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-27T21:57:15.614930] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-27T21:57:16.414980] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-27T21:57:16.839679] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-27T21:57:17.086438] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-27T21:57:17.189248] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T21:57:17.193858] [INFO ] [REMOTE ] WOR: Full fetch complete (36145 records). [2025-10-27T21:57:17.193983] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-27T21:57:17.222818] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-27T21:57:17.563235] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-27T21:57:17.563307] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-27T21:57:17.564017] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-27T21:57:17.564078] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-27T21:57:17.564905] [DEBUG] [LOCAL ] WOR: Trimmed 36145 records to 23081 (keeping 200 days of data) [2025-10-27T21:57:17.706139] [DEBUG] [LOCAL ] WOR: Primary data saved (23081 records). [2025-10-27T21:57:17.706251] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-27T21:57:17.706327] [INFO ] [MAIN ] Update Progress: 2309/2366 symbols completed. WOR took 32.4s. Estimated remaining: 7m 20s. Rate: 7.8 symbols/min [2025-10-27T21:57:17.876779] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:17.909133] [DEBUG] [LOCAL ] WPP: Loaded 34788 existing records from primary storage. [2025-10-27T21:57:17.909390] [INFO ] [MAIN ] WPP: Loaded 34788 existing records. [2025-10-27T21:57:18.020230] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-27T21:57:18.089265] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:18.089476] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-27T21:57:18.089551] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-27T21:57:18.089867] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-27T21:57:18.089926] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-27T21:57:18.457403] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:18.654403] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T21:57:18.814952] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-27T21:57:19.614952] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-27T21:57:20.184418] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T21:57:20.266878] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-27T21:57:20.276848] [INFO ] [REMOTE ] WOLF: Full fetch complete (77066 records). [2025-10-27T21:57:20.276976] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-27T21:57:20.420036] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-27T21:57:20.674910] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-27T21:57:20.674995] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-27T21:57:20.676303] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-27T21:57:20.676368] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-27T21:57:20.677902] [DEBUG] [LOCAL ] WOLF: Trimmed 77066 records to 52894 (keeping 200 days of data) [2025-10-27T21:57:20.984063] [DEBUG] [LOCAL ] WOLF: Primary data saved (52894 records). [2025-10-27T21:57:20.984367] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-27T21:57:20.984571] [INFO ] [MAIN ] Update Progress: 2310/2366 symbols completed. WOLF took 45.9s. Estimated remaining: 7m 12s. Rate: 7.8 symbols/min [2025-10-27T21:57:21.164131] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:21.209885] [DEBUG] [LOCAL ] WRB: Loaded 51561 existing records from primary storage. [2025-10-27T21:57:21.210216] [INFO ] [MAIN ] WRB: Loaded 51561 existing records. [2025-10-27T21:57:21.221263] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-27T21:57:21.424870] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:21.428310] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-27T21:57:21.428597] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-27T21:57:21.428750] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-27T21:57:21.436173] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-27T21:57:21.440002] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-27T21:57:21.812963] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T21:57:21.850132] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:22.014910] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-27T21:57:22.611160] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-27T21:57:22.814947] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-27T21:57:23.595037] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T21:57:23.621120] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-27T21:57:23.639157] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-27T21:57:24.414961] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-27T21:57:25.048396] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-27T21:57:25.214932] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-27T21:57:25.451445] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-27T21:57:26.014949] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-27T21:57:26.573527] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T21:57:26.814924] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-27T21:57:27.160194] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-27T21:57:27.614990] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-27T21:57:28.414989] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-27T21:57:28.511510] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-27T21:57:29.214910] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-27T21:57:29.336197] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-27T21:57:29.395538] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-27T21:57:30.014928] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-27T21:57:30.772488] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:57:30.814902] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-27T21:57:31.332101] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T21:57:31.341332] [INFO ] [REMOTE ] WPC: Full fetch complete (70384 records). [2025-10-27T21:57:31.341467] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-27T21:57:31.623626] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-27T21:57:31.725677] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-27T21:57:31.725760] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-27T21:57:31.726972] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-27T21:57:31.727035] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-27T21:57:31.728385] [DEBUG] [LOCAL ] WPC: Trimmed 70384 records to 47998 (keeping 200 days of data) [2025-10-27T21:57:32.039955] [DEBUG] [LOCAL ] WPC: Primary data saved (47998 records). [2025-10-27T21:57:32.040093] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-27T21:57:32.040191] [INFO ] [MAIN ] Update Progress: 2311/2366 symbols completed. WPC took 32.9s. Estimated remaining: 7m 5s. Rate: 7.8 symbols/min [2025-10-27T21:57:32.206003] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:32.252238] [DEBUG] [LOCAL ] WRBY: Loaded 51415 existing records from primary storage. [2025-10-27T21:57:32.252531] [INFO ] [MAIN ] WRBY: Loaded 51415 existing records. [2025-10-27T21:57:32.427729] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:32.427833] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-27T21:57:32.429026] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-27T21:57:32.429091] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-27T21:57:32.429348] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-27T21:57:32.429405] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-27T21:57:32.823207] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:32.851050] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-27T21:57:32.894570] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-27T21:57:33.214949] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-27T21:57:33.968729] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-27T21:57:34.014911] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-27T21:57:34.413383] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-27T21:57:34.814938] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-27T21:57:35.614935] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-27T21:57:35.662570] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T21:57:36.421572] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-27T21:57:36.433591] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-27T21:57:36.886429] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-27T21:57:37.214968] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-27T21:57:37.990968] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-27T21:57:38.014943] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-27T21:57:38.814926] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-27T21:57:38.845757] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:57:39.566468] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-27T21:57:39.614958] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-27T21:57:40.284002] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-27T21:57:40.415008] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-27T21:57:40.774226] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-27T21:57:41.214963] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-27T21:57:42.014927] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-27T21:57:42.711121] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-27T21:57:42.814927] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-27T21:57:43.454391] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-27T21:57:43.614929] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-27T21:57:43.902607] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-27T21:57:43.912831] [INFO ] [REMOTE ] WPM: Full fetch complete (76449 records). [2025-10-27T21:57:43.912971] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-27T21:57:44.308564] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-27T21:57:44.308718] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-27T21:57:44.309951] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-27T21:57:44.310070] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-27T21:57:44.311742] [DEBUG] [LOCAL ] WPM: Trimmed 76449 records to 52788 (keeping 200 days of data) [2025-10-27T21:57:44.425682] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-27T21:57:44.450793] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-27T21:57:44.676093] [DEBUG] [LOCAL ] WPM: Primary data saved (52788 records). [2025-10-27T21:57:44.676235] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-27T21:57:44.676921] [INFO ] [MAIN ] Update Progress: 2312/2366 symbols completed. WPM took 30.1s. Estimated remaining: 6m 57s. Rate: 7.8 symbols/min [2025-10-27T21:57:44.801345] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-27T21:57:44.878545] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:44.876043] [INFO ] [REMOTE ] WPP: Full fetch complete (47678 records). [2025-10-27T21:57:44.879106] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-27T21:57:45.085302] [DEBUG] [LOCAL ] WS: Loaded 23771 existing records from primary storage. [2025-10-27T21:57:45.153342] [INFO ] [MAIN ] WS: Loaded 23771 existing records. [2025-10-27T21:57:45.224071] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-27T21:57:45.403460] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-27T21:57:45.403909] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-27T21:57:45.415795] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-27T21:57:45.415951] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-27T21:57:45.490726] [DEBUG] [LOCAL ] WPP: Trimmed 47678 records to 34034 (keeping 200 days of data) [2025-10-27T21:57:45.490469] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:45.491353] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-27T21:57:45.491683] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-27T21:57:45.491957] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-27T21:57:45.492012] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-27T21:57:46.047843] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:46.048898] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-27T21:57:46.073931] [DEBUG] [LOCAL ] WPP: Primary data saved (34034 records). [2025-10-27T21:57:46.074037] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-27T21:57:46.074111] [INFO ] [MAIN ] Update Progress: 2313/2366 symbols completed. WPP took 28.4s. Estimated remaining: 6m 49s. Rate: 7.8 symbols/min [2025-10-27T21:57:46.255462] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:46.275954] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-27T21:57:46.328600] [DEBUG] [LOCAL ] WSM: Loaded 49331 existing records from primary storage. [2025-10-27T21:57:46.328913] [INFO ] [MAIN ] WSM: Loaded 49331 existing records. [2025-10-27T21:57:46.503028] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:46.503221] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-27T21:57:46.503267] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-27T21:57:46.503443] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-27T21:57:46.503482] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-27T21:57:46.826561] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-27T21:57:46.868661] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:46.954141] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-27T21:57:46.954866] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-27T21:57:47.614928] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-27T21:57:48.290584] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-27T21:57:48.398947] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T21:57:48.414909] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-27T21:57:48.826354] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-27T21:57:48.837761] [INFO ] [REMOTE ] WRB: Full fetch complete (73914 records). [2025-10-27T21:57:48.838023] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-27T21:57:49.223608] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-27T21:57:49.248227] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-27T21:57:49.249402] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-27T21:57:49.250722] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-27T21:57:49.250927] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-27T21:57:49.252407] [DEBUG] [LOCAL ] WRB: Trimmed 73914 records to 50774 (keeping 200 days of data) [2025-10-27T21:57:49.571293] [DEBUG] [LOCAL ] WRB: Primary data saved (50774 records). [2025-10-27T21:57:49.571420] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-27T21:57:49.571517] [INFO ] [MAIN ] Update Progress: 2314/2366 symbols completed. WRB took 28.6s. Estimated remaining: 6m 41s. Rate: 7.8 symbols/min [2025-10-27T21:57:49.739849] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:57:49.765989] [DEBUG] [LOCAL ] WSO: Loaded 26305 existing records from primary storage. [2025-10-27T21:57:49.766312] [INFO ] [MAIN ] WSO: Loaded 26305 existing records. [2025-10-27T21:57:49.947116] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:57:49.947331] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-27T21:57:49.947380] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-27T21:57:49.947559] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-27T21:57:49.947598] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-27T21:57:50.021775] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-27T21:57:50.318617] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:57:50.814908] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-27T21:57:50.865566] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-27T21:57:50.918354] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-27T21:57:51.614972] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-27T21:57:51.949116] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T21:57:52.414988] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-27T21:57:53.214977] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-27T21:57:53.319807] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-27T21:57:53.376860] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T21:57:54.014934] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-27T21:57:54.375925] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-27T21:57:54.692721] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-27T21:57:54.814954] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-27T21:57:55.614958] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-27T21:57:56.414916] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-27T21:57:56.474207] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T21:57:56.982677] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-27T21:57:57.214959] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-27T21:57:57.997044] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-27T21:57:58.014902] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-27T21:57:58.815015] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-27T21:57:58.883089] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-27T21:57:59.104969] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-27T21:57:59.614976] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-27T21:57:59.971019] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-27T21:58:00.327427] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-27T21:58:00.414988] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-27T21:58:01.214953] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-27T21:58:01.832451] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-27T21:58:02.014987] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-27T21:58:02.495722] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T21:58:02.814978] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-27T21:58:03.112402] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-27T21:58:03.615060] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-27T21:58:04.421192] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-27T21:58:04.431219] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T21:58:04.487879] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-27T21:58:05.214949] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-27T21:58:05.903807] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-27T21:58:06.013184] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T21:58:06.015273] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-27T21:58:06.814962] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-27T21:58:07.187588] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-27T21:58:07.615002] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-27T21:58:08.236358] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-27T21:58:08.411211] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-27T21:58:08.416422] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-27T21:58:09.214932] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-27T21:58:09.558638] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:58:09.563509] [INFO ] [REMOTE ] WS: Full fetch complete (35381 records). [2025-10-27T21:58:09.563680] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-27T21:58:09.939716] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-27T21:58:09.939801] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-27T21:58:09.940577] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-27T21:58:09.940639] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-27T21:58:09.941544] [DEBUG] [LOCAL ] WS: Trimmed 35381 records to 23168 (keeping 200 days of data) [2025-10-27T21:58:10.030556] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-27T21:58:10.086693] [DEBUG] [LOCAL ] WS: Primary data saved (23168 records). [2025-10-27T21:58:10.086824] [INFO ] [MAIN ] WS: Full history saved. [2025-10-27T21:58:10.086902] [INFO ] [MAIN ] Update Progress: 2315/2366 symbols completed. WS took 25.4s. Estimated remaining: 6m 34s. Rate: 7.8 symbols/min [2025-10-27T21:58:10.260593] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:10.281817] [DEBUG] [LOCAL ] WSR: Loaded 22794 existing records from primary storage. [2025-10-27T21:58:10.282050] [INFO ] [MAIN ] WSR: Loaded 22794 existing records. [2025-10-27T21:58:10.463948] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:10.464145] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-27T21:58:10.464193] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-27T21:58:10.464501] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-27T21:58:10.464556] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-27T21:58:10.840328] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-27T21:58:10.840275] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:10.903021] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-27T21:58:11.099276] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T21:58:11.614951] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-27T21:58:12.417937] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-27T21:58:12.425216] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-27T21:58:13.120702] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-27T21:58:13.214921] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-27T21:58:13.557372] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-27T21:58:13.644494] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-27T21:58:14.014944] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-27T21:58:14.815033] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-27T21:58:15.070807] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-27T21:58:15.172631] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T21:58:15.181298] [INFO ] [REMOTE ] WSM: Full fetch complete (71159 records). [2025-10-27T21:58:15.181408] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-27T21:58:15.568638] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-27T21:58:15.568747] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-27T21:58:15.569880] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-27T21:58:15.569943] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-27T21:58:15.571484] [DEBUG] [LOCAL ] WSM: Trimmed 71159 records to 48464 (keeping 200 days of data) [2025-10-27T21:58:15.626244] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-27T21:58:15.870483] [DEBUG] [LOCAL ] WSM: Primary data saved (48464 records). [2025-10-27T21:58:15.870608] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-27T21:58:15.870707] [INFO ] [MAIN ] Update Progress: 2316/2366 symbols completed. WSM took 29.8s. Estimated remaining: 6m 26s. Rate: 7.8 symbols/min [2025-10-27T21:58:16.041601] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:16.076767] [DEBUG] [LOCAL ] WST: Loaded 37339 existing records from primary storage. [2025-10-27T21:58:16.077035] [INFO ] [MAIN ] WST: Loaded 37339 existing records. [2025-10-27T21:58:16.251952] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:16.252145] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-27T21:58:16.252189] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-27T21:58:16.252423] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-27T21:58:16.252479] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-27T21:58:16.429160] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-27T21:58:16.614030] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:16.932458] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-27T21:58:16.942199] [INFO ] [REMOTE ] WRBY: Full fetch complete (73623 records). [2025-10-27T21:58:16.942323] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-27T21:58:17.220173] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-27T21:58:17.335258] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-27T21:58:17.335438] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-27T21:58:17.336851] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-27T21:58:17.336935] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-27T21:58:17.338796] [DEBUG] [LOCAL ] WRBY: Trimmed 73623 records to 50611 (keeping 200 days of data) [2025-10-27T21:58:17.571121] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T21:58:17.600852] [INFO ] [REMOTE ] WSO: Full fetch complete (36165 records). [2025-10-27T21:58:17.600968] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-27T21:58:17.764075] [DEBUG] [LOCAL ] WRBY: Primary data saved (50611 records). [2025-10-27T21:58:17.764279] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-27T21:58:17.765264] [INFO ] [MAIN ] Update Progress: 2317/2366 symbols completed. WRBY took 45.7s. Estimated remaining: 6m 18s. Rate: 7.8 symbols/min [2025-10-27T21:58:18.014973] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-27T21:58:18.051358] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-27T21:58:18.051442] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-27T21:58:18.052207] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-27T21:58:18.052267] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-27T21:58:18.053192] [DEBUG] [LOCAL ] WSO: Trimmed 36165 records to 25997 (keeping 200 days of data) [2025-10-27T21:58:18.230453] [DEBUG] [LOCAL ] WSO: Primary data saved (25997 records). [2025-10-27T21:58:18.230602] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-27T21:58:18.230710] [INFO ] [MAIN ] Update Progress: 2318/2366 symbols completed. WSO took 28.7s. Estimated remaining: 6m 11s. Rate: 7.8 symbols/min [2025-10-27T21:58:18.327510] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-27T21:58:18.717039] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-27T21:58:18.814959] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-27T21:58:19.614966] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-27T21:58:19.950803] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-27T21:58:20.414947] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-27T21:58:20.933538] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T21:58:21.214949] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-27T21:58:21.295112] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-27T21:58:22.014932] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-27T21:58:22.926916] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-27T21:58:22.936490] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-27T21:58:23.446442] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-27T21:58:23.614938] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-27T21:58:25.225219] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-27T21:58:25.234504] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-27T21:58:26.416990] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T21:58:26.424690] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-27T21:58:27.178349] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-10-27T21:58:27.183475] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-27T21:58:27.964823] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-27T21:58:27.970883] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-27T21:58:28.142202] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-27T21:58:28.150245] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-27T21:58:28.639131] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-27T21:58:28.643632] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-27T21:58:29.311621] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-27T21:58:29.316469] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-27T21:58:29.692062] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-27T21:58:30.014899] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-27T21:58:30.357941] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-27T21:58:30.361979] [INFO ] [REMOTE ] WSR: Full fetch complete (32564 records). [2025-10-27T21:58:30.362081] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-27T21:58:30.718521] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-27T21:58:30.718591] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-27T21:58:30.719156] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-27T21:58:30.719216] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-27T21:58:30.719936] [DEBUG] [LOCAL ] WSR: Trimmed 32564 records to 22100 (keeping 200 days of data) [2025-10-27T21:58:30.850941] [DEBUG] [LOCAL ] WSR: Primary data saved (22100 records). [2025-10-27T21:58:30.851081] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-27T21:58:30.851174] [INFO ] [MAIN ] Update Progress: 2319/2366 symbols completed. WSR took 20.8s. Estimated remaining: 6m 3s. Rate: 7.8 symbols/min [2025-10-27T21:58:31.432980] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-27T21:58:31.440196] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-27T21:58:31.824134] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-27T21:58:31.833134] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-27T21:58:32.146690] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-27T21:58:32.154390] [INFO ] [REMOTE ] WST: Full fetch complete (54729 records). [2025-10-27T21:58:32.154508] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-27T21:58:32.559748] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-27T21:58:32.559846] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-27T21:58:32.560935] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-27T21:58:32.561001] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-27T21:58:32.562218] [DEBUG] [LOCAL ] WST: Trimmed 54729 records to 36589 (keeping 200 days of data) [2025-10-27T21:58:32.824508] [DEBUG] [LOCAL ] WST: Primary data saved (36589 records). [2025-10-27T21:58:32.824750] [INFO ] [MAIN ] WST: Full history saved. [2025-10-27T21:58:32.824913] [INFO ] [MAIN ] Update Progress: 2320/2366 symbols completed. WST took 17.0s. Estimated remaining: 5m 55s. Rate: 7.8 symbols/min [2025-10-27T21:58:33.702674] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:33.732462] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:33.740806] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-27T21:58:33.767885] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:33.768124] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-27T21:58:33.790887] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-27T21:58:33.791171] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-27T21:58:33.796855] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-27T21:58:33.800865] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:33.801330] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-27T21:58:34.169463] [DEBUG] [LOCAL ] WTI: Loaded 45451 existing records from primary storage. [2025-10-27T21:58:34.195809] [DEBUG] [LOCAL ] WT: Loaded 48917 existing records from primary storage. [2025-10-27T21:58:34.224821] [INFO ] [MAIN ] WTI: Loaded 45451 existing records. [2025-10-27T21:58:34.245960] [DEBUG] [LOCAL ] WTRG: Loaded 51645 existing records from primary storage. [2025-10-27T21:58:34.266528] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:34.235479] [INFO ] [MAIN ] WT: Loaded 48917 existing records. [2025-10-27T21:58:34.272420] [INFO ] [MAIN ] WTRG: Loaded 51645 existing records. [2025-10-27T21:58:34.267182] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-27T21:58:34.774723] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:34.800284] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:34.800420] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-27T21:58:34.826409] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-27T21:58:34.851920] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-27T21:58:34.835324] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-27T21:58:34.859234] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-27T21:58:34.858569] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:34.859316] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-27T21:58:34.873961] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-27T21:58:34.873618] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-27T21:58:34.874372] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-27T21:58:34.885561] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-27T21:58:34.894372] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-27T21:58:34.894269] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-27T21:58:34.951581] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-27T21:58:34.957573] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-27T21:58:35.456277] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-27T21:58:35.589967] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-27T21:58:35.934238] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:36.016367] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-27T21:58:36.026234] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:36.026484] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-27T21:58:36.004971] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:36.151497] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-27T21:58:36.414932] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-27T21:58:36.836185] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T21:58:37.214918] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-27T21:58:37.553794] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-27T21:58:37.653983] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-27T21:58:38.014953] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-27T21:58:38.398929] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T21:58:38.814945] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-27T21:58:39.131551] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-27T21:58:39.614955] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-27T21:58:40.016856] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-27T21:58:40.286336] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T21:58:40.414930] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-27T21:58:41.214950] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-27T21:58:41.715896] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-27T21:58:42.014952] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-27T21:58:42.361500] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-27T21:58:42.814938] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-27T21:58:43.305379] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T21:58:43.614940] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-27T21:58:44.028532] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-27T21:58:44.055043] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-27T21:58:44.414949] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-27T21:58:45.214963] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-27T21:58:45.978499] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-27T21:58:46.014962] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-27T21:58:46.250545] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-27T21:58:46.814976] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-27T21:58:47.275061] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T21:58:47.614970] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-27T21:58:47.955602] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T21:58:48.414973] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-27T21:58:48.864999] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-27T21:58:49.214918] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-27T21:58:49.314677] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-27T21:58:49.651406] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-27T21:58:50.014970] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-27T21:58:50.814943] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-27T21:58:51.623434] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-27T21:58:51.641489] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-27T21:58:52.186941] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T21:58:52.240495] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-27T21:58:52.414984] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-27T21:58:53.214996] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-27T21:58:53.636439] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-27T21:58:53.637822] [INFO ] [REMOTE ] WTM: Full fetch complete (2824 records). [2025-10-27T21:58:53.637907] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-27T21:58:53.825872] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-27T21:58:53.826074] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-27T21:58:53.826204] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-27T21:58:53.826284] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-27T21:58:53.826438] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-27T21:58:53.826559] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-27T21:58:53.826687] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-27T21:58:53.826780] [INFO ] [MAIN ] Update Progress: 2321/2366 symbols completed. WTM took 21.0s. Estimated remaining: 5m 48s. Rate: 7.8 symbols/min [2025-10-27T21:58:54.027828] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-27T21:58:54.030893] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:58:54.036700] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-27T21:58:54.066608] [DEBUG] [LOCAL ] WTS: Loaded 17427 existing records from primary storage. [2025-10-27T21:58:54.066887] [INFO ] [MAIN ] WTS: Loaded 17427 existing records. [2025-10-27T21:58:54.245773] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:58:54.245963] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-27T21:58:54.246009] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-27T21:58:54.246196] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-27T21:58:54.246251] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-27T21:58:54.595612] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:58:54.814930] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-27T21:58:55.614989] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-27T21:58:55.888468] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-27T21:58:56.062332] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-27T21:58:56.259754] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-27T21:58:56.414962] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-27T21:58:57.215019] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-27T21:58:58.021090] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-27T21:58:58.033528] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-27T21:58:58.814917] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-27T21:58:59.059041] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T21:58:59.614968] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-27T21:58:59.836748] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-27T21:59:00.421921] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-27T21:59:00.425186] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-27T21:59:01.214920] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-27T21:59:01.498855] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (4.28 seconds). [2025-10-27T21:59:02.014860] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-27T21:59:02.212946] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-27T21:59:02.454721] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T21:59:02.814992] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-27T21:59:03.291704] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-27T21:59:03.302062] [INFO ] [REMOTE ] WT: Full fetch complete (69821 records). [2025-10-27T21:59:03.302255] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-27T21:59:03.620073] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-27T21:59:03.699219] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-27T21:59:03.699295] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-27T21:59:03.700394] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-27T21:59:03.700457] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-27T21:59:03.701896] [DEBUG] [LOCAL ] WT: Trimmed 69821 records to 48144 (keeping 200 days of data) [2025-10-27T21:59:03.978576] [DEBUG] [LOCAL ] WT: Primary data saved (48144 records). [2025-10-27T21:59:03.978718] [INFO ] [MAIN ] WT: Full history saved. [2025-10-27T21:59:03.979480] [INFO ] [MAIN ] Update Progress: 2322/2366 symbols completed. WT took 31.2s. Estimated remaining: 5m 40s. Rate: 7.8 symbols/min [2025-10-27T21:59:04.146674] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:04.187952] [DEBUG] [LOCAL ] WTTR: Loaded 45178 existing records from primary storage. [2025-10-27T21:59:04.188348] [INFO ] [MAIN ] WTTR: Loaded 45178 existing records. [2025-10-27T21:59:04.322446] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-27T21:59:04.377701] [INFO ] [REMOTE ] WTI: Full fetch complete (63888 records). [2025-10-27T21:59:04.401893] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-27T21:59:04.401749] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:04.402071] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-27T21:59:04.402141] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-27T21:59:04.402522] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-27T21:59:04.402580] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-27T21:59:04.458029] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-27T21:59:05.151513] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-27T21:59:05.148045] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:05.151943] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-27T21:59:05.153156] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-27T21:59:05.153283] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-27T21:59:05.154809] [DEBUG] [LOCAL ] WTI: Trimmed 63888 records to 44692 (keeping 200 days of data) [2025-10-27T21:59:05.235417] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-27T21:59:05.432143] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T21:59:05.451494] [DEBUG] [LOCAL ] WTI: Primary data saved (44692 records). [2025-10-27T21:59:05.451600] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-27T21:59:05.451703] [INFO ] [MAIN ] Update Progress: 2323/2366 symbols completed. WTI took 32.6s. Estimated remaining: 5m 32s. Rate: 7.8 symbols/min [2025-10-27T21:59:05.618201] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:05.665265] [DEBUG] [LOCAL ] WU: Loaded 54267 existing records from primary storage. [2025-10-27T21:59:05.665622] [INFO ] [MAIN ] WU: Loaded 54267 existing records. [2025-10-27T21:59:05.776950] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-27T21:59:05.856418] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:05.856600] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-27T21:59:05.856717] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-27T21:59:05.856933] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-27T21:59:05.856988] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-27T21:59:06.027180] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-27T21:59:06.207137] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:06.498697] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-27T21:59:06.814993] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-27T21:59:07.497462] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-27T21:59:07.614942] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-27T21:59:08.414980] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-27T21:59:08.628389] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-27T21:59:08.698766] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-27T21:59:09.214976] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-27T21:59:09.566931] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-27T21:59:09.898867] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-27T21:59:10.014981] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-27T21:59:10.823523] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-27T21:59:10.824681] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-27T21:59:11.614994] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-27T21:59:12.113243] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-27T21:59:12.414914] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-27T21:59:13.097280] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T21:59:13.214934] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-27T21:59:13.776767] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-27T21:59:14.014927] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-27T21:59:14.614781] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-27T21:59:14.624401] [INFO ] [REMOTE ] WTRG: Full fetch complete (73901 records). [2025-10-27T21:59:14.624524] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-27T21:59:14.827844] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-27T21:59:15.043381] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-27T21:59:15.043495] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-27T21:59:15.046029] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-27T21:59:15.046102] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-27T21:59:15.048132] [DEBUG] [LOCAL ] WTRG: Trimmed 73901 records to 50865 (keeping 200 days of data) [2025-10-27T21:59:15.199146] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T21:59:15.399587] [DEBUG] [LOCAL ] WTRG: Primary data saved (50865 records). [2025-10-27T21:59:15.399825] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-27T21:59:15.399955] [INFO ] [MAIN ] Update Progress: 2324/2366 symbols completed. WTRG took 42.6s. Estimated remaining: 5m 24s. Rate: 7.8 symbols/min [2025-10-27T21:59:15.583587] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:15.614954] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-27T21:59:15.634488] [DEBUG] [LOCAL ] WWW: Loaded 49939 existing records from primary storage. [2025-10-27T21:59:15.634962] [INFO ] [MAIN ] WWW: Loaded 49939 existing records. [2025-10-27T21:59:15.827730] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:15.828019] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-27T21:59:15.828080] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-27T21:59:15.828322] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-27T21:59:15.828366] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-27T21:59:16.210059] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:16.383594] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-27T21:59:16.414916] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-27T21:59:16.437570] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T21:59:17.214996] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-27T21:59:17.619281] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-27T21:59:18.015002] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-27T21:59:18.814985] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-27T21:59:18.873789] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T21:59:19.327536] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-27T21:59:19.614939] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-27T21:59:20.053802] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-27T21:59:20.415228] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-27T21:59:20.871407] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-27T21:59:21.214967] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-27T21:59:22.014953] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-27T21:59:22.196947] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-27T21:59:22.362799] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-27T21:59:22.814958] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-27T21:59:23.417816] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T21:59:23.614942] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-27T21:59:23.991738] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-27T21:59:24.414955] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-27T21:59:24.952882] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T21:59:25.214918] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-27T21:59:25.278120] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-27T21:59:25.280944] [INFO ] [REMOTE ] WTS: Full fetch complete (25644 records). [2025-10-27T21:59:25.281018] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-27T21:59:25.635638] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-27T21:59:25.635740] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-27T21:59:25.636254] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-27T21:59:25.636313] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-27T21:59:25.636973] [DEBUG] [LOCAL ] WTS: Trimmed 25644 records to 16949 (keeping 200 days of data) [2025-10-27T21:59:25.739978] [DEBUG] [LOCAL ] WTS: Primary data saved (16949 records). [2025-10-27T21:59:25.740110] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-27T21:59:25.740186] [INFO ] [MAIN ] Update Progress: 2325/2366 symbols completed. WTS took 31.9s. Estimated remaining: 5m 17s. Rate: 7.8 symbols/min [2025-10-27T21:59:25.909488] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:25.958851] [DEBUG] [LOCAL ] WY: Loaded 53986 existing records from primary storage. [2025-10-27T21:59:25.959182] [INFO ] [MAIN ] WY: Loaded 53986 existing records. [2025-10-27T21:59:26.014912] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-27T21:59:26.137455] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:26.137636] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-27T21:59:26.137718] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-27T21:59:26.138026] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-27T21:59:26.138084] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-27T21:59:26.505137] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:26.608524] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T21:59:26.814934] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-27T21:59:27.199259] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T21:59:27.614983] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-27T21:59:28.062669] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-27T21:59:28.414941] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-27T21:59:29.214932] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-27T21:59:29.434973] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-27T21:59:29.664585] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-27T21:59:30.014944] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-27T21:59:30.412602] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-27T21:59:30.814948] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-27T21:59:31.615003] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-27T21:59:31.899784] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-27T21:59:32.414925] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-27T21:59:32.961056] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-27T21:59:33.214962] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-27T21:59:33.920678] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-10-27T21:59:34.014953] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-27T21:59:34.770469] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-27T21:59:34.779052] [INFO ] [REMOTE ] WTTR: Full fetch complete (65493 records). [2025-10-27T21:59:34.779216] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-27T21:59:34.822580] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-27T21:59:35.174887] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-27T21:59:35.174966] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-27T21:59:35.176097] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-27T21:59:35.176166] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-27T21:59:35.177472] [DEBUG] [LOCAL ] WTTR: Trimmed 65493 records to 44314 (keeping 200 days of data) [2025-10-27T21:59:35.411571] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-10-27T21:59:35.479431] [DEBUG] [LOCAL ] WTTR: Primary data saved (44314 records). [2025-10-27T21:59:35.479569] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-27T21:59:35.480357] [INFO ] [MAIN ] Update Progress: 2326/2366 symbols completed. WTTR took 31.5s. Estimated remaining: 5m 9s. Rate: 7.8 symbols/min [2025-10-27T21:59:35.618382] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-27T21:59:35.650872] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:35.690703] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-27T21:59:35.720784] [DEBUG] [LOCAL ] XFLT: Loaded 30309 existing records from primary storage. [2025-10-27T21:59:35.721046] [INFO ] [MAIN ] XFLT: Loaded 30309 existing records. [2025-10-27T21:59:35.896260] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:35.896461] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-27T21:59:35.896508] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-27T21:59:35.896776] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-27T21:59:35.896838] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-27T21:59:36.254185] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:36.337399] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-27T21:59:36.414928] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-27T21:59:37.215004] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-27T21:59:37.403051] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-27T21:59:37.414976] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-27T21:59:38.014963] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-27T21:59:38.661977] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-27T21:59:38.814913] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-27T21:59:39.399979] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T21:59:39.409353] [INFO ] [REMOTE ] WWW: Full fetch complete (70707 records). [2025-10-27T21:59:39.409474] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-27T21:59:39.620014] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-27T21:59:39.791117] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-27T21:59:39.791189] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-27T21:59:39.792326] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-27T21:59:39.792388] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-27T21:59:39.793633] [DEBUG] [LOCAL ] WWW: Trimmed 70707 records to 49169 (keeping 200 days of data) [2025-10-27T21:59:40.082299] [DEBUG] [LOCAL ] WWW: Primary data saved (49169 records). [2025-10-27T21:59:40.082424] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-27T21:59:40.082498] [INFO ] [MAIN ] Update Progress: 2327/2366 symbols completed. WWW took 24.7s. Estimated remaining: 5m 1s. Rate: 7.8 symbols/min [2025-10-27T21:59:40.254415] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:40.293767] [DEBUG] [LOCAL ] XHR: Loaded 43866 existing records from primary storage. [2025-10-27T21:59:40.294152] [INFO ] [MAIN ] XHR: Loaded 43866 existing records. [2025-10-27T21:59:40.418010] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-27T21:59:40.487717] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:40.488143] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-27T21:59:40.488215] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-27T21:59:40.488464] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-27T21:59:40.488519] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-27T21:59:40.643948] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-27T21:59:40.959673] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:41.214989] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-27T21:59:41.281103] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-27T21:59:41.997169] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-27T21:59:42.007460] [INFO ] [REMOTE ] WU: Full fetch complete (77524 records). [2025-10-27T21:59:42.007604] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-27T21:59:42.020982] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-27T21:59:42.425347] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-27T21:59:42.490540] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-27T21:59:42.490619] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-27T21:59:42.491861] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-27T21:59:42.491924] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-27T21:59:42.493369] [DEBUG] [LOCAL ] WU: Trimmed 77524 records to 53487 (keeping 200 days of data) [2025-10-27T21:59:42.816873] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-27T21:59:42.823741] [DEBUG] [LOCAL ] WU: Primary data saved (53487 records). [2025-10-27T21:59:42.823816] [INFO ] [MAIN ] WU: Full history saved. [2025-10-27T21:59:42.823885] [INFO ] [MAIN ] Update Progress: 2328/2366 symbols completed. WU took 37.4s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-10-27T21:59:42.994119] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:42.994288] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-27T21:59:42.994325] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-27T21:59:42.994441] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-27T21:59:42.994483] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-27T21:59:42.994524] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-27T21:59:42.994556] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-27T21:59:43.375178] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:43.614914] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-27T21:59:43.788883] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-27T21:59:44.123683] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-27T21:59:44.414966] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-10-27T21:59:44.615518] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-27T21:59:44.615906] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-10-27T21:59:44.615987] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-27T21:59:44.616031] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-27T21:59:44.616063] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-27T21:59:44.616100] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-27T21:59:44.616153] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-27T21:59:44.616186] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-27T21:59:44.616226] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-27T21:59:44.616270] [INFO ] [MAIN ] Update Progress: 2329/2366 symbols completed. XIFR took 1.8s. Estimated remaining: 4m 46s. Rate: 7.8 symbols/min [2025-10-27T21:59:44.804156] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T21:59:44.801986] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-27T21:59:44.858673] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-27T21:59:44.858986] [INFO ] [MAIN ] XOM: Loaded 54573 existing records. [2025-10-27T21:59:45.031018] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T21:59:45.031208] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-27T21:59:45.031268] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-27T21:59:45.031446] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-27T21:59:45.031486] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-27T21:59:45.221341] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-27T21:59:45.374534] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T21:59:46.014940] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-27T21:59:46.509116] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T21:59:46.814918] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-27T21:59:47.273723] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-27T21:59:47.614958] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-27T21:59:48.415023] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-27T21:59:48.611189] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-27T21:59:48.902285] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-27T21:59:49.214959] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-27T21:59:49.477259] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-27T21:59:50.014960] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-27T21:59:50.814923] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-27T21:59:50.927897] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-27T21:59:50.959495] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-27T21:59:51.614943] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-27T21:59:52.414910] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-27T21:59:53.133858] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-27T21:59:53.214928] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-27T21:59:53.268733] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-27T21:59:53.632036] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-27T21:59:54.014951] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-27T21:59:54.331732] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-27T21:59:54.814984] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-27T21:59:55.288192] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-27T21:59:55.614953] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-27T21:59:55.764696] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-27T21:59:56.414943] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-27T21:59:57.069730] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-27T21:59:57.214931] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-27T21:59:57.320739] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-27T21:59:58.014929] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-27T21:59:58.814957] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-27T21:59:58.893595] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-27T21:59:59.021677] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-27T21:59:59.172302] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T21:59:59.182357] [INFO ] [REMOTE ] WY: Full fetch complete (77045 records). [2025-10-27T21:59:59.182471] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-27T21:59:59.573349] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-27T21:59:59.573435] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-27T21:59:59.574609] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-27T21:59:59.574693] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-27T21:59:59.576118] [DEBUG] [LOCAL ] WY: Trimmed 77045 records to 53202 (keeping 200 days of data) [2025-10-27T21:59:59.630140] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-27T21:59:59.897015] [DEBUG] [LOCAL ] WY: Primary data saved (53202 records). [2025-10-27T21:59:59.897165] [INFO ] [MAIN ] WY: Full history saved. [2025-10-27T21:59:59.897670] [INFO ] [MAIN ] Update Progress: 2330/2366 symbols completed. WY took 34.2s. Estimated remaining: 4m 38s. Rate: 7.8 symbols/min [2025-10-27T22:00:00.064167] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:00.095197] [DEBUG] [LOCAL ] XPER: Loaded 31005 existing records from primary storage. [2025-10-27T22:00:00.095478] [INFO ] [MAIN ] XPER: Loaded 31005 existing records. [2025-10-27T22:00:00.273871] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:00.274070] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-27T22:00:00.274116] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-27T22:00:00.274284] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-27T22:00:00.274321] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-27T22:00:00.421704] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-27T22:00:00.645635] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:01.215008] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-27T22:00:01.647517] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-27T22:00:01.808618] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-27T22:00:02.014954] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-27T22:00:02.450523] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-27T22:00:02.814975] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-27T22:00:02.921214] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-27T22:00:02.927317] [INFO ] [REMOTE ] XFLT: Full fetch complete (43903 records). [2025-10-27T22:00:02.927414] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-27T22:00:03.309005] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-27T22:00:03.309084] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-27T22:00:03.309958] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-27T22:00:03.310020] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-27T22:00:03.311021] [DEBUG] [LOCAL ] XFLT: Trimmed 43903 records to 29571 (keeping 200 days of data) [2025-10-27T22:00:03.482929] [DEBUG] [LOCAL ] XFLT: Primary data saved (29571 records). [2025-10-27T22:00:03.483094] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-27T22:00:03.483774] [INFO ] [MAIN ] Update Progress: 2331/2366 symbols completed. XFLT took 28.0s. Estimated remaining: 4m 30s. Rate: 7.8 symbols/min [2025-10-27T22:00:03.620037] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-27T22:00:03.649439] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:03.703058] [DEBUG] [LOCAL ] XPEV: Loaded 54394 existing records from primary storage. [2025-10-27T22:00:03.703377] [INFO ] [MAIN ] XPEV: Loaded 54394 existing records. [2025-10-27T22:00:03.875257] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:03.875454] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-27T22:00:03.875500] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-27T22:00:03.875731] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-27T22:00:03.875787] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-27T22:00:04.222034] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:04.415005] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-27T22:00:04.555608] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-27T22:00:05.214989] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-27T22:00:05.447815] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-27T22:00:06.014984] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-27T22:00:06.697677] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-27T22:00:06.796726] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-27T22:00:06.814915] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-27T22:00:07.615068] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-27T22:00:08.220097] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-27T22:00:08.394705] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-27T22:00:08.414908] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-27T22:00:08.820473] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-27T22:00:09.214948] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-27T22:00:09.411687] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-27T22:00:10.014944] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-27T22:00:10.814979] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-27T22:00:10.963099] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-27T22:00:11.166158] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-27T22:00:11.614938] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-27T22:00:12.414915] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-27T22:00:12.443058] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-27T22:00:12.866807] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-27T22:00:13.214953] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-27T22:00:14.014918] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-27T22:00:14.240802] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-27T22:00:14.423485] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-27T22:00:14.814991] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-27T22:00:15.581528] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-27T22:00:15.614898] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-27T22:00:16.414953] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-27T22:00:16.878131] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-27T22:00:17.091288] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-27T22:00:17.099051] [INFO ] [REMOTE ] XHR: Full fetch complete (61936 records). [2025-10-27T22:00:17.099163] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-27T22:00:17.219418] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-27T22:00:17.466414] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T22:00:17.515731] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-27T22:00:17.515819] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-27T22:00:17.517266] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-27T22:00:17.517365] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-27T22:00:17.518612] [DEBUG] [LOCAL ] XHR: Trimmed 61936 records to 43013 (keeping 200 days of data) [2025-10-27T22:00:17.774719] [DEBUG] [LOCAL ] XHR: Primary data saved (43013 records). [2025-10-27T22:00:17.774843] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-27T22:00:17.774921] [INFO ] [MAIN ] Update Progress: 2332/2366 symbols completed. XHR took 37.7s. Estimated remaining: 4m 23s. Rate: 7.8 symbols/min [2025-10-27T22:00:17.951137] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:17.997726] [DEBUG] [LOCAL ] XPO: Loaded 48155 existing records from primary storage. [2025-10-27T22:00:17.998027] [INFO ] [MAIN ] XPO: Loaded 48155 existing records. [2025-10-27T22:00:18.020861] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-27T22:00:18.209193] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:18.209423] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-27T22:00:18.209471] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-27T22:00:18.209695] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-27T22:00:18.209751] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-27T22:00:18.555022] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:18.814921] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-27T22:00:19.063034] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-27T22:00:19.614994] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-27T22:00:19.730185] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-27T22:00:20.414921] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-27T22:00:20.478579] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-27T22:00:21.214954] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-27T22:00:21.777374] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-27T22:00:21.810910] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-27T22:00:22.014947] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-27T22:00:22.344591] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-27T22:00:22.814974] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-27T22:00:22.960500] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-27T22:00:22.966917] [INFO ] [REMOTE ] XPER: Full fetch complete (43555 records). [2025-10-27T22:00:22.967041] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-27T22:00:23.329511] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-27T22:00:23.329581] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-27T22:00:23.330390] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-27T22:00:23.330451] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-27T22:00:23.331321] [DEBUG] [LOCAL ] XPER: Trimmed 43555 records to 30387 (keeping 200 days of data) [2025-10-27T22:00:23.491532] [DEBUG] [LOCAL ] XPER: Primary data saved (30387 records). [2025-10-27T22:00:23.491675] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-27T22:00:23.491770] [INFO ] [MAIN ] Update Progress: 2333/2366 symbols completed. XPER took 23.6s. Estimated remaining: 4m 15s. Rate: 7.8 symbols/min [2025-10-27T22:00:23.629791] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-27T22:00:23.660378] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:23.694169] [DEBUG] [LOCAL ] XPOF: Loaded 37285 existing records from primary storage. [2025-10-27T22:00:23.694497] [INFO ] [MAIN ] XPOF: Loaded 37285 existing records. [2025-10-27T22:00:23.880591] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:23.880823] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-27T22:00:23.880874] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-27T22:00:23.881099] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-27T22:00:23.881158] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-27T22:00:24.263369] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:24.288494] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T22:00:24.414909] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-27T22:00:25.214967] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-27T22:00:25.501596] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-27T22:00:26.014913] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-27T22:00:26.263509] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-27T22:00:26.363045] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-27T22:00:26.814940] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-27T22:00:27.614920] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-27T22:00:27.688884] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-27T22:00:27.989226] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-27T22:00:27.999416] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-27T22:00:27.999539] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-27T22:00:28.393686] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-27T22:00:28.393782] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-27T22:00:28.395129] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-27T22:00:28.395195] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-27T22:00:28.396848] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-27T22:00:28.453521] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-27T22:00:28.752075] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-27T22:00:28.785885] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-27T22:00:28.786028] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-27T22:00:28.786106] [INFO ] [MAIN ] Update Progress: 2334/2366 symbols completed. XOM took 44.2s. Estimated remaining: 4m 7s. Rate: 7.8 symbols/min [2025-10-27T22:00:28.954745] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:28.994606] [DEBUG] [LOCAL ] XPRO: Loaded 46493 existing records from primary storage. [2025-10-27T22:00:28.994927] [INFO ] [MAIN ] XPRO: Loaded 46493 existing records. [2025-10-27T22:00:29.175039] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:29.175314] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-27T22:00:29.175364] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-27T22:00:29.175548] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-27T22:00:29.175626] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-27T22:00:29.220050] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-27T22:00:29.525420] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:29.925977] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T22:00:30.014950] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-27T22:00:30.814972] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-27T22:00:31.342085] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-27T22:00:31.354114] [INFO ] [REMOTE ] XPEV: Full fetch complete (77770 records). [2025-10-27T22:00:31.354311] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-27T22:00:31.621553] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-27T22:00:31.837400] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-27T22:00:31.837556] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-27T22:00:31.839018] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-27T22:00:31.839362] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-27T22:00:31.841939] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-27T22:00:31.853020] [DEBUG] [LOCAL ] XPEV: Trimmed 77770 records to 53614 (keeping 200 days of data) [2025-10-27T22:00:32.215863] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-27T22:00:32.228297] [DEBUG] [LOCAL ] XPEV: Primary data saved (53614 records). [2025-10-27T22:00:32.229062] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-27T22:00:32.229772] [INFO ] [MAIN ] Update Progress: 2335/2366 symbols completed. XPEV took 28.7s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-10-27T22:00:32.392435] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:32.421025] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-27T22:00:32.423212] [DEBUG] [LOCAL ] XYF: Loaded 27566 existing records from primary storage. [2025-10-27T22:00:32.423410] [INFO ] [MAIN ] XYF: Loaded 27566 existing records. [2025-10-27T22:00:32.596050] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:32.596237] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-27T22:00:32.596282] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-27T22:00:32.596457] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-27T22:00:32.596494] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-27T22:00:32.937194] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:33.214923] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-27T22:00:33.521690] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-27T22:00:33.596462] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T22:00:34.014930] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-27T22:00:34.426354] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-27T22:00:34.470376] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-27T22:00:34.814928] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-27T22:00:35.614983] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-27T22:00:36.140015] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-27T22:00:36.158583] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T22:00:36.414970] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-27T22:00:37.214928] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-27T22:00:37.506423] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T22:00:38.014934] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-27T22:00:38.253457] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-27T22:00:38.809899] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-27T22:00:38.815134] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-27T22:00:39.614948] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-27T22:00:39.775722] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-27T22:00:40.414983] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-27T22:00:41.214915] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-27T22:00:41.259234] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-27T22:00:41.292481] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-27T22:00:42.014931] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-27T22:00:42.681835] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T22:00:42.814964] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-27T22:00:42.961730] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-27T22:00:43.614992] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-27T22:00:44.408218] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T22:00:44.418016] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-27T22:00:45.116216] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-27T22:00:45.214925] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-27T22:00:45.492773] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-27T22:00:46.014932] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-27T22:00:46.266219] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-27T22:00:46.814957] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-27T22:00:46.990201] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-27T22:00:47.614997] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-27T22:00:48.321780] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-27T22:00:48.414923] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-27T22:00:48.532595] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-27T22:00:49.214988] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-27T22:00:50.014943] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-27T22:00:50.152940] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-27T22:00:50.499147] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-27T22:00:50.814984] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-27T22:00:51.217526] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-27T22:00:51.224483] [INFO ] [REMOTE ] XPOF: Full fetch complete (52884 records). [2025-10-27T22:00:51.224634] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-27T22:00:51.600500] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-27T22:00:51.600592] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-27T22:00:51.601699] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-27T22:00:51.601780] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-27T22:00:51.615069] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-27T22:00:51.614866] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-27T22:00:51.615436] [DEBUG] [LOCAL ] XPOF: Trimmed 52884 records to 36549 (keeping 200 days of data) [2025-10-27T22:00:51.825685] [DEBUG] [LOCAL ] XPOF: Primary data saved (36549 records). [2025-10-27T22:00:51.825832] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-27T22:00:51.825909] [INFO ] [MAIN ] Update Progress: 2336/2366 symbols completed. XPOF took 28.3s. Estimated remaining: 3m 52s. Rate: 7.8 symbols/min [2025-10-27T22:00:51.990274] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:52.035170] [DEBUG] [LOCAL ] XYL: Loaded 48223 existing records from primary storage. [2025-10-27T22:00:52.035459] [INFO ] [MAIN ] XYL: Loaded 48223 existing records. [2025-10-27T22:00:52.210011] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:52.210224] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-27T22:00:52.210270] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-27T22:00:52.210457] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-27T22:00:52.210512] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-27T22:00:52.422638] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-27T22:00:52.559335] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:52.956942] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-27T22:00:53.188887] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-27T22:00:53.193282] [INFO ] [REMOTE ] XYF: Full fetch complete (33971 records). [2025-10-27T22:00:53.193385] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-27T22:00:53.221996] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-27T22:00:53.558235] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-27T22:00:53.558306] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-27T22:00:53.558910] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-27T22:00:53.558977] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-27T22:00:53.559749] [DEBUG] [LOCAL ] XYF: Trimmed 33971 records to 27009 (keeping 200 days of data) [2025-10-27T22:00:53.721298] [DEBUG] [LOCAL ] XYF: Primary data saved (27009 records). [2025-10-27T22:00:53.721442] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-27T22:00:53.721529] [INFO ] [MAIN ] Update Progress: 2337/2366 symbols completed. XYF took 21.5s. Estimated remaining: 3m 44s. Rate: 7.8 symbols/min [2025-10-27T22:00:53.888785] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:53.888946] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-27T22:00:53.888982] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-27T22:00:53.889087] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-27T22:00:53.889128] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-27T22:00:53.889167] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-27T22:00:53.889198] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-27T22:00:54.025181] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-27T22:00:54.239624] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:54.392537] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-27T22:00:54.814939] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-10-27T22:00:55.605375] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-27T22:00:55.614969] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-27T22:00:55.796927] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-27T22:00:56.414995] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-10-27T22:00:56.908797] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-27T22:00:56.917608] [INFO ] [REMOTE ] XPO: Full fetch complete (69548 records). [2025-10-27T22:00:56.917743] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-27T22:00:57.220211] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-27T22:00:57.300312] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-27T22:00:57.300384] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-27T22:00:57.301509] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-27T22:00:57.301569] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-27T22:00:57.302839] [DEBUG] [LOCAL ] XPO: Trimmed 69548 records to 47324 (keeping 200 days of data) [2025-10-27T22:00:57.580032] [DEBUG] [LOCAL ] XPO: Primary data saved (47324 records). [2025-10-27T22:00:57.580150] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-27T22:00:57.580224] [INFO ] [MAIN ] Update Progress: 2338/2366 symbols completed. XPO took 39.8s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-10-27T22:00:57.750412] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:00:57.782803] [DEBUG] [LOCAL ] YALA: Loaded 36621 existing records from primary storage. [2025-10-27T22:00:57.783062] [INFO ] [MAIN ] YALA: Loaded 36621 existing records. [2025-10-27T22:00:57.953115] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:00:57.953282] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-27T22:00:57.953327] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-27T22:00:57.953524] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-27T22:00:57.953579] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-27T22:00:58.020052] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-27T22:00:58.301946] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:00:58.391345] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-27T22:00:58.814958] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-10-27T22:00:59.068518] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-27T22:00:59.272974] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-27T22:00:59.614961] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-27T22:01:00.414963] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-27T22:01:00.593014] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-27T22:01:00.634959] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-27T22:01:01.214947] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-27T22:01:01.847878] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-27T22:01:01.856544] [INFO ] [REMOTE ] XPRO: Full fetch complete (66450 records). [2025-10-27T22:01:01.856712] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-27T22:01:02.018084] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-10-27T22:01:02.157113] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-27T22:01:02.329381] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-27T22:01:02.329476] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-27T22:01:02.330738] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-27T22:01:02.330804] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-27T22:01:02.332141] [DEBUG] [LOCAL ] XPRO: Trimmed 66450 records to 45635 (keeping 200 days of data) [2025-10-27T22:01:02.605703] [DEBUG] [LOCAL ] XPRO: Primary data saved (45635 records). [2025-10-27T22:01:02.605852] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-27T22:01:02.605949] [INFO ] [MAIN ] Update Progress: 2339/2366 symbols completed. XPRO took 33.8s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-10-27T22:01:02.791695] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:02.814947] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-27T22:01:02.833421] [DEBUG] [LOCAL ] YELP: Loaded 45756 existing records from primary storage. [2025-10-27T22:01:02.833747] [INFO ] [MAIN ] YELP: Loaded 45756 existing records. [2025-10-27T22:01:03.016408] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:03.016606] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-27T22:01:03.016724] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-27T22:01:03.016924] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-27T22:01:03.016964] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-27T22:01:03.398308] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:03.614941] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-27T22:01:04.031625] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-27T22:01:04.124507] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-27T22:01:04.414973] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-27T22:01:05.215321] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-27T22:01:05.217779] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-27T22:01:05.763716] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T22:01:06.014932] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-10-27T22:01:06.814975] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-27T22:01:06.974256] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-27T22:01:07.614952] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-27T22:01:08.069972] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-27T22:01:08.110382] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-27T22:01:08.414958] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-10-27T22:01:09.148068] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-27T22:01:09.214960] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-27T22:01:10.014976] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-27T22:01:10.576485] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-27T22:01:10.780115] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-27T22:01:10.814903] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-27T22:01:11.572114] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T22:01:11.614932] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-10-27T22:01:12.414996] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-27T22:01:12.552708] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-27T22:01:13.214958] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-27T22:01:13.704622] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-27T22:01:13.913630] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-27T22:01:14.014938] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-10-27T22:01:14.387270] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-27T22:01:14.814949] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-27T22:01:15.614962] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-27T22:01:16.287673] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T22:01:16.359867] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-27T22:01:16.414911] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-10-27T22:01:16.753101] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T22:01:17.214941] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-27T22:01:18.020605] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-27T22:01:18.026169] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-27T22:01:18.766998] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-27T22:01:18.814996] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-27T22:01:19.305380] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-27T22:01:19.614975] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-10. [2025-10-27T22:01:20.046851] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-27T22:01:20.056958] [INFO ] [REMOTE ] XYZ: Full fetch complete (75583 records). [2025-10-27T22:01:20.057096] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-27T22:01:20.277015] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-27T22:01:20.278568] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-27T22:01:20.287031] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-27T22:01:20.287639] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-27T22:01:20.287742] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-27T22:01:20.288148] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-27T22:01:20.288205] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-27T22:01:20.288288] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-27T22:01:20.288370] [INFO ] [MAIN ] Update Progress: 2340/2366 symbols completed. XYZ took 26.6s. Estimated remaining: 3m 21s. Rate: 7.8 symbols/min [2025-10-27T22:01:20.425679] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-27T22:01:20.457701] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:20.508225] [DEBUG] [LOCAL ] YETI: Loaded 53260 existing records from primary storage. [2025-10-27T22:01:20.508526] [INFO ] [MAIN ] YETI: Loaded 53260 existing records. [2025-10-27T22:01:20.686227] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:20.686462] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-27T22:01:20.686512] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-27T22:01:20.686759] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-27T22:01:20.686817] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-27T22:01:21.039136] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:21.214995] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-27T22:01:21.528457] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-27T22:01:22.014944] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-27T22:01:22.797188] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-27T22:01:22.814901] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-27T22:01:23.616768] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-27T22:01:23.628114] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-27T22:01:24.167311] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-27T22:01:24.414955] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-27T22:01:25.214950] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-27T22:01:25.427873] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-27T22:01:25.769270] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-27T22:01:26.014938] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-27T22:01:26.658362] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T22:01:26.814949] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-27T22:01:27.190134] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-27T22:01:27.614944] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-27T22:01:27.823856] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-27T22:01:28.414928] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-27T22:01:29.082793] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-27T22:01:29.214950] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-27T22:01:29.524342] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-27T22:01:29.533207] [INFO ] [REMOTE ] YELP: Full fetch complete (64712 records). [2025-10-27T22:01:29.533376] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-27T22:01:29.915203] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-27T22:01:29.915281] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-27T22:01:29.916380] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-27T22:01:29.916442] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-27T22:01:29.917722] [DEBUG] [LOCAL ] YELP: Trimmed 64712 records to 44920 (keeping 200 days of data) [2025-10-27T22:01:30.014978] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-27T22:01:30.180101] [DEBUG] [LOCAL ] YELP: Primary data saved (44920 records). [2025-10-27T22:01:30.180230] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-27T22:01:30.180306] [INFO ] [MAIN ] Update Progress: 2341/2366 symbols completed. YELP took 27.6s. Estimated remaining: 3m 13s. Rate: 7.8 symbols/min [2025-10-27T22:01:30.346559] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:30.383661] [DEBUG] [LOCAL ] YEXT: Loaded 43601 existing records from primary storage. [2025-10-27T22:01:30.383965] [INFO ] [MAIN ] YEXT: Loaded 43601 existing records. [2025-10-27T22:01:30.566959] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:30.567176] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-27T22:01:30.567224] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-27T22:01:30.567459] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-27T22:01:30.567516] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-27T22:01:30.820242] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-27T22:01:30.928263] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:30.961072] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T22:01:31.095955] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-27T22:01:31.614953] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-27T22:01:32.166797] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-27T22:01:32.414943] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-27T22:01:32.791144] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-27T22:01:33.214906] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-27T22:01:33.257466] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-27T22:01:33.262857] [INFO ] [REMOTE ] YALA: Full fetch complete (47115 records). [2025-10-27T22:01:33.263007] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-27T22:01:33.636526] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-27T22:01:33.636599] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-27T22:01:33.637513] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-27T22:01:33.637571] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-27T22:01:33.638607] [DEBUG] [LOCAL ] YALA: Trimmed 47115 records to 35827 (keeping 200 days of data) [2025-10-27T22:01:33.834227] [DEBUG] [LOCAL ] YALA: Primary data saved (35827 records). [2025-10-27T22:01:33.834364] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-27T22:01:33.834443] [INFO ] [MAIN ] Update Progress: 2342/2366 symbols completed. YALA took 36.3s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-10-27T22:01:34.004108] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:34.014936] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-27T22:01:34.054006] [DEBUG] [LOCAL ] YMM: Loaded 53355 existing records from primary storage. [2025-10-27T22:01:34.054352] [INFO ] [MAIN ] YMM: Loaded 53355 existing records. [2025-10-27T22:01:34.234008] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:34.234281] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-27T22:01:34.234331] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-27T22:01:34.234533] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-27T22:01:34.234590] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-27T22:01:34.603891] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:34.627456] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T22:01:34.661351] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-27T22:01:34.671176] [INFO ] [REMOTE ] XYL: Full fetch complete (70070 records). [2025-10-27T22:01:34.671334] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-27T22:01:34.824894] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-27T22:01:35.072814] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-27T22:01:35.072886] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-27T22:01:35.074029] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-27T22:01:35.074092] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-27T22:01:35.075357] [DEBUG] [LOCAL ] XYL: Trimmed 70070 records to 47440 (keeping 200 days of data) [2025-10-27T22:01:35.359685] [DEBUG] [LOCAL ] XYL: Primary data saved (47440 records). [2025-10-27T22:01:35.359808] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-27T22:01:35.360292] [INFO ] [MAIN ] Update Progress: 2343/2366 symbols completed. XYL took 43.5s. Estimated remaining: 2m 58s. Rate: 7.8 symbols/min [2025-10-27T22:01:35.533157] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:35.578232] [DEBUG] [LOCAL ] YOU: Loaded 50176 existing records from primary storage. [2025-10-27T22:01:35.578516] [INFO ] [MAIN ] YOU: Loaded 50176 existing records. [2025-10-27T22:01:35.620121] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-27T22:01:35.760810] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:35.761079] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-27T22:01:35.761145] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-27T22:01:35.761318] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-27T22:01:35.761354] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-27T22:01:36.110847] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:36.210312] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-27T22:01:36.414936] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-27T22:01:37.214945] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-27T22:01:37.292672] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-27T22:01:38.015009] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-27T22:01:38.316363] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-27T22:01:38.694961] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T22:01:38.814977] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-27T22:01:39.575291] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-27T22:01:39.614940] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-27T22:01:40.329550] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-27T22:01:40.414978] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-27T22:01:40.635546] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-27T22:01:41.214955] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-27T22:01:41.850817] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-27T22:01:42.014928] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-27T22:01:42.654676] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T22:01:42.814971] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-27T22:01:43.371150] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-27T22:01:43.614961] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-27T22:01:44.215717] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T22:01:44.414948] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-27T22:01:44.753724] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-27T22:01:45.214985] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-27T22:01:45.648237] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-27T22:01:46.014942] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-27T22:01:46.490636] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-27T22:01:46.814928] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-27T22:01:47.161180] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-27T22:01:47.614993] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-27T22:01:48.252428] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-27T22:01:48.414939] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-27T22:01:49.214947] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-27T22:01:49.377459] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-27T22:01:49.800341] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-27T22:01:50.014929] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-27T22:01:50.429492] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-27T22:01:50.814986] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-27T22:01:51.274713] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-27T22:01:51.614984] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-27T22:01:52.414939] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-27T22:01:52.518521] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-27T22:01:52.529118] [INFO ] [REMOTE ] YETI: Full fetch complete (75499 records). [2025-10-27T22:01:52.529256] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-27T22:01:52.931911] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-27T22:01:52.931986] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-27T22:01:52.933153] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-27T22:01:52.933213] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-27T22:01:52.934673] [DEBUG] [LOCAL ] YETI: Trimmed 75499 records to 52451 (keeping 200 days of data) [2025-10-27T22:01:53.219391] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-27T22:01:53.241714] [DEBUG] [LOCAL ] YETI: Primary data saved (52451 records). [2025-10-27T22:01:53.241824] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-27T22:01:53.242526] [INFO ] [MAIN ] Update Progress: 2344/2366 symbols completed. YETI took 33.0s. Estimated remaining: 2m 50s. Rate: 7.8 symbols/min [2025-10-27T22:01:53.413001] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:53.443622] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-27T22:01:53.495890] [DEBUG] [LOCAL ] YPF: Loaded 51528 existing records from primary storage. [2025-10-27T22:01:53.496209] [INFO ] [MAIN ] YPF: Loaded 51528 existing records. [2025-10-27T22:01:53.670501] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:53.670908] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-27T22:01:53.670954] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-27T22:01:53.671133] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-27T22:01:53.671171] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-27T22:01:54.038239] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:54.038328] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-27T22:01:54.064681] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-27T22:01:54.073763] [INFO ] [REMOTE ] YEXT: Full fetch complete (62859 records). [2025-10-27T22:01:54.073918] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-27T22:01:54.465105] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-27T22:01:54.465187] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-27T22:01:54.466289] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-27T22:01:54.466350] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-27T22:01:54.468450] [DEBUG] [LOCAL ] YEXT: Trimmed 62859 records to 42731 (keeping 200 days of data) [2025-10-27T22:01:54.729022] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T22:01:54.748007] [DEBUG] [LOCAL ] YEXT: Primary data saved (42731 records). [2025-10-27T22:01:54.748555] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-27T22:01:54.748802] [INFO ] [MAIN ] Update Progress: 2345/2366 symbols completed. YEXT took 24.6s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-10-27T22:01:54.821725] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-27T22:01:54.916894] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:01:54.929754] [DEBUG] [LOCAL ] YRD: Loaded 11228 existing records from primary storage. [2025-10-27T22:01:54.929964] [INFO ] [MAIN ] YRD: Loaded 11228 existing records. [2025-10-27T22:01:55.109558] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:01:55.109806] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-27T22:01:55.109855] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-27T22:01:55.110040] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-27T22:01:55.110096] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-27T22:01:55.488850] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:01:55.614926] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-27T22:01:55.762710] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-27T22:01:56.194338] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-27T22:01:56.414942] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-27T22:01:56.585175] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-27T22:01:57.214964] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-27T22:01:58.014930] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-27T22:01:58.228232] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-27T22:01:58.584670] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-27T22:01:58.814946] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-27T22:01:59.450837] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-27T22:01:59.614937] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-27T22:02:00.145683] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T22:02:00.414949] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-27T22:02:00.595819] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-27T22:02:01.214994] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-27T22:02:01.771020] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-27T22:02:01.918124] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-27T22:02:02.014915] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-27T22:02:02.814939] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-27T22:02:03.255619] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-27T22:02:03.614944] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-27T22:02:04.414935] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-27T22:02:04.618101] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-27T22:02:05.214929] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-27T22:02:05.363359] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-27T22:02:05.373447] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-27T22:02:05.389198] [INFO ] [REMOTE ] YOU: Full fetch complete (72332 records). [2025-10-27T22:02:05.389369] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-27T22:02:05.786565] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-27T22:02:05.786705] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-27T22:02:05.788043] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-27T22:02:05.788112] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-27T22:02:05.789725] [DEBUG] [LOCAL ] YOU: Trimmed 72332 records to 49363 (keeping 200 days of data) [2025-10-27T22:02:06.016952] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-27T22:02:06.120302] [DEBUG] [LOCAL ] YOU: Primary data saved (49363 records). [2025-10-27T22:02:06.120481] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-27T22:02:06.121108] [INFO ] [MAIN ] Update Progress: 2346/2366 symbols completed. YOU took 30.8s. Estimated remaining: 2m 35s. Rate: 7.8 symbols/min [2025-10-27T22:02:06.298262] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:06.325284] [DEBUG] [LOCAL ] YSG: Loaded 25944 existing records from primary storage. [2025-10-27T22:02:06.325562] [INFO ] [MAIN ] YSG: Loaded 25944 existing records. [2025-10-27T22:02:06.503133] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:06.503371] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-27T22:02:06.503417] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-27T22:02:06.503587] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-27T22:02:06.503624] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-27T22:02:06.839802] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-27T22:02:06.860909] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:07.144120] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-27T22:02:07.614936] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-27T22:02:07.641760] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-27T22:02:07.898594] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-27T22:02:08.414952] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-27T22:02:08.934001] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-27T22:02:09.214937] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-27T22:02:09.530176] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T22:02:09.822510] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-27T22:02:10.014943] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-27T22:02:10.504489] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-27T22:02:10.814942] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-27T22:02:11.362715] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-27T22:02:11.615000] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-27T22:02:12.131752] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-27T22:02:12.415021] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-27T22:02:13.214994] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-27T22:02:14.014938] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-27T22:02:14.186725] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-27T22:02:14.212046] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-27T22:02:14.214469] [INFO ] [REMOTE ] YRD: Full fetch complete (18674 records). [2025-10-27T22:02:14.214560] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-27T22:02:14.559307] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-27T22:02:14.592128] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-27T22:02:14.592193] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-27T22:02:14.592624] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-27T22:02:14.592704] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-27T22:02:14.593212] [DEBUG] [LOCAL ] YRD: Trimmed 18674 records to 10814 (keeping 200 days of data) [2025-10-27T22:02:14.654387] [DEBUG] [LOCAL ] YRD: Primary data saved (10814 records). [2025-10-27T22:02:14.654522] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-27T22:02:14.654600] [INFO ] [MAIN ] Update Progress: 2347/2366 symbols completed. YRD took 19.9s. Estimated remaining: 2m 27s. Rate: 7.8 symbols/min [2025-10-27T22:02:14.822169] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:14.820264] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-27T22:02:14.869887] [DEBUG] [LOCAL ] YUM: Loaded 51829 existing records from primary storage. [2025-10-27T22:02:14.870180] [INFO ] [MAIN ] YUM: Loaded 51829 existing records. [2025-10-27T22:02:15.047508] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:15.047750] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-27T22:02:15.047803] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-27T22:02:15.048404] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-27T22:02:15.048462] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-27T22:02:15.389981] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:15.614938] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-27T22:02:16.414938] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-27T22:02:16.468099] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-27T22:02:17.175671] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-27T22:02:17.214903] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-27T22:02:17.503950] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-27T22:02:18.014942] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-27T22:02:18.814945] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-27T22:02:19.014729] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-27T22:02:19.345340] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-27T22:02:19.355529] [INFO ] [REMOTE ] YMM: Full fetch complete (76481 records). [2025-10-27T22:02:19.355679] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-27T22:02:19.620055] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-27T22:02:19.760179] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-27T22:02:19.760266] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-27T22:02:19.761472] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-27T22:02:19.761845] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-27T22:02:19.763337] [DEBUG] [LOCAL ] YMM: Trimmed 76481 records to 52573 (keeping 200 days of data) [2025-10-27T22:02:20.081169] [DEBUG] [LOCAL ] YMM: Primary data saved (52573 records). [2025-10-27T22:02:20.081297] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-27T22:02:20.081374] [INFO ] [MAIN ] Update Progress: 2348/2366 symbols completed. YMM took 46.2s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-10-27T22:02:20.253505] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:20.300480] [DEBUG] [LOCAL ] YUMC: Loaded 53347 existing records from primary storage. [2025-10-27T22:02:20.300938] [INFO ] [MAIN ] YUMC: Loaded 53347 existing records. [2025-10-27T22:02:20.419986] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-27T22:02:20.489479] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:20.490317] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-27T22:02:20.490755] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-27T22:02:20.491134] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-27T22:02:20.491297] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-27T22:02:20.696142] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-27T22:02:20.909149] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:21.214907] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-27T22:02:21.275827] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-27T22:02:21.533503] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-27T22:02:22.014930] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-27T22:02:22.698578] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-27T22:02:22.814927] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-27T22:02:23.609118] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-27T22:02:23.619447] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-27T22:02:23.632291] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-27T22:02:24.414936] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-27T22:02:25.214956] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-27T22:02:25.390984] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-27T22:02:25.457401] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-27T22:02:26.014932] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-27T22:02:26.820635] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-27T22:02:26.840070] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-27T22:02:27.186842] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-27T22:02:27.614950] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-27T22:02:28.137804] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-27T22:02:28.414942] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-27T22:02:29.099855] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-27T22:02:29.214913] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-27T22:02:29.838914] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-27T22:02:30.014924] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-27T22:02:30.814912] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-27T22:02:30.884564] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-27T22:02:30.977798] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-27T22:02:31.614940] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-27T22:02:32.414907] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-27T22:02:32.474905] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-27T22:02:33.008635] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-27T22:02:33.018788] [INFO ] [REMOTE ] YPF: Full fetch complete (73879 records). [2025-10-27T22:02:33.018925] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-27T22:02:33.224545] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-27T22:02:33.408462] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-27T22:02:33.408558] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-27T22:02:33.409800] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-27T22:02:33.409864] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-27T22:02:33.411253] [DEBUG] [LOCAL ] YPF: Trimmed 73879 records to 50749 (keeping 200 days of data) [2025-10-27T22:02:33.706940] [DEBUG] [LOCAL ] YPF: Primary data saved (50749 records). [2025-10-27T22:02:33.707119] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-27T22:02:33.707930] [INFO ] [MAIN ] Update Progress: 2349/2366 symbols completed. YPF took 40.5s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-10-27T22:02:33.893513] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:33.953898] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-27T22:02:33.979979] [DEBUG] [LOCAL ] ZBH: Loaded 51412 existing records from primary storage. [2025-10-27T22:02:33.980688] [INFO ] [MAIN ] ZBH: Loaded 51412 existing records. [2025-10-27T22:02:34.022258] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-27T22:02:34.155139] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:34.155362] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-27T22:02:34.155412] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-27T22:02:34.155683] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-27T22:02:34.155742] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-27T22:02:34.498161] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:34.814910] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-27T22:02:34.915385] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-27T22:02:35.427874] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-27T22:02:35.614992] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-27T22:02:36.296111] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-27T22:02:36.414917] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-27T22:02:36.952434] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-27T22:02:37.215006] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-27T22:02:37.821925] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-27T22:02:38.014912] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-27T22:02:38.072364] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-27T22:02:38.373539] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-27T22:02:38.383131] [INFO ] [REMOTE ] YUM: Full fetch complete (74604 records). [2025-10-27T22:02:38.383241] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-27T22:02:38.763301] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-27T22:02:38.763385] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-27T22:02:38.764550] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-27T22:02:38.764659] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-27T22:02:38.766105] [DEBUG] [LOCAL ] YUM: Trimmed 74604 records to 51032 (keeping 200 days of data) [2025-10-27T22:02:38.820194] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-27T22:02:39.078921] [DEBUG] [LOCAL ] YUM: Primary data saved (51032 records). [2025-10-27T22:02:39.079049] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-27T22:02:39.079158] [INFO ] [MAIN ] Update Progress: 2350/2366 symbols completed. YUM took 24.4s. Estimated remaining: 2m 4s. Rate: 7.8 symbols/min [2025-10-27T22:02:39.243520] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:39.262465] [DEBUG] [LOCAL ] ZEPP: Loaded 20001 existing records from primary storage. [2025-10-27T22:02:39.262718] [INFO ] [MAIN ] ZEPP: Loaded 20001 existing records. [2025-10-27T22:02:39.434249] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:39.434426] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-27T22:02:39.434471] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-27T22:02:39.434681] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-27T22:02:39.434738] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-27T22:02:39.620120] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-27T22:02:39.783749] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:40.284825] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-27T22:02:40.414914] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-27T22:02:40.512970] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-27T22:02:40.518242] [INFO ] [REMOTE ] YSG: Full fetch complete (32716 records). [2025-10-27T22:02:40.518321] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-27T22:02:40.892009] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-27T22:02:40.892588] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-27T22:02:40.892469] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-27T22:02:40.894564] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-27T22:02:40.894615] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-27T22:02:40.895320] [DEBUG] [LOCAL ] YSG: Trimmed 32716 records to 25638 (keeping 200 days of data) [2025-10-27T22:02:41.039065] [DEBUG] [LOCAL ] YSG: Primary data saved (25638 records). [2025-10-27T22:02:41.039193] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-27T22:02:41.039269] [INFO ] [MAIN ] Update Progress: 2351/2366 symbols completed. YSG took 34.9s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-10-27T22:02:41.215451] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-27T22:02:41.215370] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:41.267273] [DEBUG] [LOCAL ] ZETA: Loaded 54397 existing records from primary storage. [2025-10-27T22:02:41.267578] [INFO ] [MAIN ] ZETA: Loaded 54397 existing records. [2025-10-27T22:02:41.441271] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:41.441448] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-27T22:02:41.441493] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-27T22:02:41.441722] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-27T22:02:41.441777] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-27T22:02:41.794088] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:42.014927] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-27T22:02:42.698922] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-27T22:02:42.814923] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-27T22:02:43.614997] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-27T22:02:44.168544] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-27T22:02:44.414916] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-27T22:02:44.714236] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T22:02:45.214984] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-27T22:02:45.456073] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-27T22:02:46.014972] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-27T22:02:46.409175] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-27T22:02:46.704311] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-27T22:02:46.814896] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-27T22:02:47.615214] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-27T22:02:47.952302] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-27T22:02:47.982271] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-27T22:02:48.414963] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-27T22:02:48.534287] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-27T22:02:49.214991] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-27T22:02:49.978850] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-27T22:02:50.014915] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-27T22:02:50.467709] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-27T22:02:50.814974] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-27T22:02:51.190317] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-27T22:02:51.200248] [INFO ] [REMOTE ] YUMC: Full fetch complete (76437 records). [2025-10-27T22:02:51.200401] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-27T22:02:51.580484] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-27T22:02:51.580558] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-27T22:02:51.581733] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-27T22:02:51.581799] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-27T22:02:51.583140] [DEBUG] [LOCAL ] YUMC: Trimmed 76437 records to 52547 (keeping 200 days of data) [2025-10-27T22:02:51.634577] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-27T22:02:51.897713] [DEBUG] [LOCAL ] YUMC: Primary data saved (52547 records). [2025-10-27T22:02:51.897842] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-27T22:02:51.897916] [INFO ] [MAIN ] Update Progress: 2352/2366 symbols completed. YUMC took 31.8s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-10-27T22:02:52.052001] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-27T22:02:52.070286] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:52.107902] [DEBUG] [LOCAL ] ZGN: Loaded 41489 existing records from primary storage. [2025-10-27T22:02:52.108199] [INFO ] [MAIN ] ZGN: Loaded 41489 existing records. [2025-10-27T22:02:52.278538] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:52.278739] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-27T22:02:52.278828] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-27T22:02:52.279000] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-27T22:02:52.279038] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-27T22:02:52.425466] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-27T22:02:52.670950] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:52.732585] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-27T22:02:53.214993] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-27T22:02:53.993302] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-27T22:02:54.014901] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-27T22:02:54.714773] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-27T22:02:54.814949] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-27T22:02:55.418473] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-27T22:02:55.614949] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-27T22:02:56.415018] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-27T22:02:56.569576] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-27T22:02:57.101162] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-27T22:02:57.214945] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-27T22:02:57.548185] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-27T22:02:57.557459] [INFO ] [REMOTE ] ZBH: Full fetch complete (73831 records). [2025-10-27T22:02:57.557568] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-27T22:02:57.847459] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-27T22:02:57.965335] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-27T22:02:57.965405] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-27T22:02:57.966551] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-27T22:02:57.966612] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-27T22:02:57.967953] [DEBUG] [LOCAL ] ZBH: Trimmed 73831 records to 50575 (keeping 200 days of data) [2025-10-27T22:02:58.023907] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-27T22:02:58.275125] [DEBUG] [LOCAL ] ZBH: Primary data saved (50575 records). [2025-10-27T22:02:58.275244] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-27T22:02:58.275951] [INFO ] [MAIN ] Update Progress: 2353/2366 symbols completed. ZBH took 24.6s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-10-27T22:02:58.439865] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:02:58.461911] [DEBUG] [LOCAL ] ZH: Loaded 24876 existing records from primary storage. [2025-10-27T22:02:58.462170] [INFO ] [MAIN ] ZH: Loaded 24876 existing records. [2025-10-27T22:02:58.636458] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:02:58.636707] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-27T22:02:58.636765] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-27T22:02:58.636956] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-27T22:02:58.636993] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-27T22:02:58.748694] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-27T22:02:58.826439] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-27T22:02:59.075047] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:02:59.356292] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-27T22:02:59.615001] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-27T22:03:00.414960] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-27T22:03:01.195715] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-27T22:03:01.214904] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-27T22:03:02.014937] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-27T22:03:02.492686] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-27T22:03:02.822971] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-27T22:03:02.825571] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-27T22:03:03.458770] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-27T22:03:03.614977] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-27T22:03:04.414949] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-27T22:03:04.736897] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-27T22:03:04.803557] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-27T22:03:05.214946] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-27T22:03:05.558852] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T22:03:06.015011] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-27T22:03:06.168173] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T22:03:06.696608] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-27T22:03:06.814963] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-27T22:03:07.614933] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-27T22:03:08.282341] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-27T22:03:08.414912] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-27T22:03:09.214984] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-27T22:03:09.569919] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-27T22:03:09.622508] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-27T22:03:09.627247] [INFO ] [REMOTE ] ZEPP: Full fetch complete (21777 records). [2025-10-27T22:03:09.627326] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-27T22:03:10.000765] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-27T22:03:10.000845] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-27T22:03:10.001284] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-27T22:03:10.001323] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-27T22:03:10.001979] [DEBUG] [LOCAL ] ZEPP: Trimmed 21777 records to 20120 (keeping 200 days of data) [2025-10-27T22:03:10.047172] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-27T22:03:10.117140] [DEBUG] [LOCAL ] ZEPP: Primary data saved (20120 records). [2025-10-27T22:03:10.117263] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-27T22:03:10.117411] [INFO ] [MAIN ] Update Progress: 2354/2366 symbols completed. ZEPP took 31.0s. Estimated remaining: 1m 33s. Rate: 7.8 symbols/min [2025-10-27T22:03:10.281543] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:10.332963] [DEBUG] [LOCAL ] ZIM: Loaded 54216 existing records from primary storage. [2025-10-27T22:03:10.333264] [INFO ] [MAIN ] ZIM: Loaded 54216 existing records. [2025-10-27T22:03:10.508249] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:10.508456] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-27T22:03:10.508501] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-27T22:03:10.508740] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-27T22:03:10.508796] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-27T22:03:10.819595] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-27T22:03:10.858863] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:10.899817] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-27T22:03:11.614927] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-27T22:03:12.147999] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-27T22:03:12.394176] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-27T22:03:12.414897] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-27T22:03:13.214948] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-27T22:03:13.538313] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-27T22:03:13.587947] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-27T22:03:14.014928] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-27T22:03:14.814944] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-27T22:03:15.298280] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-27T22:03:15.308319] [INFO ] [REMOTE ] ZETA: Full fetch complete (77737 records). [2025-10-27T22:03:15.308426] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-27T22:03:15.620040] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-27T22:03:15.698998] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-27T22:03:15.699073] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-27T22:03:15.700623] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-27T22:03:15.700720] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-27T22:03:15.702208] [DEBUG] [LOCAL ] ZETA: Trimmed 77737 records to 53618 (keeping 200 days of data) [2025-10-27T22:03:15.826275] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-27T22:03:16.070378] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-27T22:03:16.090009] [DEBUG] [LOCAL ] ZETA: Primary data saved (53618 records). [2025-10-27T22:03:16.090417] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-27T22:03:16.090785] [INFO ] [MAIN ] Update Progress: 2355/2366 symbols completed. ZETA took 35.1s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-10-27T22:03:16.258273] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:16.295894] [DEBUG] [LOCAL ] ZIP: Loaded 44045 existing records from primary storage. [2025-10-27T22:03:16.296165] [INFO ] [MAIN ] ZIP: Loaded 44045 existing records. [2025-10-27T22:03:16.420095] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-27T22:03:16.474866] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:16.475177] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-27T22:03:16.475258] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-27T22:03:16.475562] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-27T22:03:16.475620] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-27T22:03:16.836848] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:17.078579] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-27T22:03:17.214920] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-27T22:03:18.014961] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-27T22:03:18.042467] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T22:03:18.354244] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-27T22:03:18.815019] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-27T22:03:19.243555] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T22:03:19.614939] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-27T22:03:20.414956] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-27T22:03:20.749535] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-27T22:03:20.758166] [INFO ] [REMOTE ] ZGN: Full fetch complete (58877 records). [2025-10-27T22:03:20.758302] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-27T22:03:21.188452] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-27T22:03:21.188551] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-27T22:03:21.189617] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-27T22:03:21.189772] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-27T22:03:21.191204] [DEBUG] [LOCAL ] ZGN: Trimmed 58877 records to 40668 (keeping 200 days of data) [2025-10-27T22:03:21.241596] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-27T22:03:21.428990] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-27T22:03:21.489072] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-27T22:03:21.504735] [DEBUG] [LOCAL ] ZGN: Primary data saved (40668 records). [2025-10-27T22:03:21.504848] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-27T22:03:21.504939] [INFO ] [MAIN ] Update Progress: 2356/2366 symbols completed. ZGN took 29.6s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-10-27T22:03:21.693251] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:21.731126] [DEBUG] [LOCAL ] ZK: Loaded 39505 existing records from primary storage. [2025-10-27T22:03:21.731403] [INFO ] [MAIN ] ZK: Loaded 39505 existing records. [2025-10-27T22:03:21.911475] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:21.912414] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-27T22:03:21.912472] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-27T22:03:21.913150] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-27T22:03:21.913208] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-27T22:03:22.020177] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-27T22:03:22.277137] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:22.292353] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-27T22:03:22.814948] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-27T22:03:23.306615] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-27T22:03:23.614936] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-27T22:03:24.414958] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-27T22:03:25.214978] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-27T22:03:25.223738] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-27T22:03:25.299185] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-27T22:03:25.482239] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-27T22:03:26.014960] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-27T22:03:26.507704] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-27T22:03:26.814970] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-27T22:03:27.614957] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-27T22:03:27.930530] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-27T22:03:28.135330] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T22:03:28.414947] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-27T22:03:28.796230] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-27T22:03:29.220240] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-27T22:03:29.232500] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-27T22:03:30.014939] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-27T22:03:30.332479] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T22:03:30.641289] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-27T22:03:30.645238] [INFO ] [REMOTE ] ZH: Full fetch complete (39562 records). [2025-10-27T22:03:30.645313] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-27T22:03:30.820205] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-27T22:03:31.017332] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-27T22:03:31.017400] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-27T22:03:31.018190] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-27T22:03:31.018250] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-27T22:03:31.019073] [DEBUG] [LOCAL ] ZH: Trimmed 39562 records to 24122 (keeping 200 days of data) [2025-10-27T22:03:31.145797] [DEBUG] [LOCAL ] ZH: Primary data saved (24122 records). [2025-10-27T22:03:31.145918] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-27T22:03:31.145991] [INFO ] [MAIN ] Update Progress: 2357/2366 symbols completed. ZH took 32.9s. Estimated remaining: 1m 10s. Rate: 7.8 symbols/min [2025-10-27T22:03:31.614955] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-27T22:03:32.001899] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-27T22:03:32.414896] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-27T22:03:33.086544] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-27T22:03:33.214913] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-27T22:03:33.810871] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T22:03:34.014964] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-27T22:03:34.531279] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-27T22:03:34.814984] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-27T22:03:35.614980] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-27T22:03:35.940686] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-27T22:03:36.403027] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-27T22:03:36.414905] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-27T22:03:37.214998] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-27T22:03:37.268573] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-27T22:03:38.015011] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-27T22:03:38.192563] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-27T22:03:38.315844] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-27T22:03:38.324104] [INFO ] [REMOTE ] ZIP: Full fetch complete (60934 records). [2025-10-27T22:03:38.324238] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-27T22:03:38.715491] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-27T22:03:38.715575] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-27T22:03:38.716804] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-27T22:03:38.716871] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-27T22:03:38.718186] [DEBUG] [LOCAL ] ZIP: Trimmed 60934 records to 43222 (keeping 200 days of data) [2025-10-27T22:03:38.823697] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-27T22:03:38.969585] [DEBUG] [LOCAL ] ZIP: Primary data saved (43222 records). [2025-10-27T22:03:38.969761] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-27T22:03:38.970312] [INFO ] [MAIN ] Update Progress: 2358/2366 symbols completed. ZIP took 22.9s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-10-27T22:03:39.527693] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T22:03:39.614968] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-27T22:03:40.595925] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-27T22:03:40.603595] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-27T22:03:40.822005] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-27T22:03:41.214994] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-27T22:03:41.596449] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-27T22:03:42.014993] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-27T22:03:43.278738] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-27T22:03:43.290044] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-27T22:03:43.346699] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-27T22:03:43.614993] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-27T22:03:44.898698] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-27T22:03:44.908581] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-27T22:03:45.160549] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-27T22:03:45.170957] [INFO ] [REMOTE ] ZIM: Full fetch complete (77556 records). [2025-10-27T22:03:45.171091] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-27T22:03:45.559449] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-27T22:03:45.559528] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-27T22:03:45.561166] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-27T22:03:45.561229] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-27T22:03:45.562633] [DEBUG] [LOCAL ] ZIM: Trimmed 77556 records to 53434 (keeping 200 days of data) [2025-10-27T22:03:45.886265] [DEBUG] [LOCAL ] ZIM: Primary data saved (53434 records). [2025-10-27T22:03:45.886400] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-27T22:03:45.886499] [INFO ] [MAIN ] Update Progress: 2359/2366 symbols completed. ZIM took 35.8s. Estimated remaining: 54.1s. Rate: 7.8 symbols/min [2025-10-27T22:03:45.979355] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-27T22:03:45.986923] [INFO ] [REMOTE ] ZK: Full fetch complete (57154 records). [2025-10-27T22:03:45.987022] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-27T22:03:46.359767] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-27T22:03:46.359839] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-27T22:03:46.360855] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-27T22:03:46.360915] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-27T22:03:46.361950] [DEBUG] [LOCAL ] ZK: Trimmed 57154 records to 38664 (keeping 200 days of data) [2025-10-27T22:03:46.575597] [DEBUG] [LOCAL ] ZK: Primary data saved (38664 records). [2025-10-27T22:03:46.575764] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-27T22:03:46.575848] [INFO ] [MAIN ] Update Progress: 2360/2366 symbols completed. ZK took 25.1s. Estimated remaining: 46.3s. Rate: 7.8 symbols/min [2025-10-27T22:03:47.193919] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:47.248366] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:47.292479] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:47.294288] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:03:47.307760] [DEBUG] [LOCAL ] ZKH: Loaded 7395 existing records from primary storage. [2025-10-27T22:03:47.308349] [INFO ] [MAIN ] ZKH: Loaded 7395 existing records. [2025-10-27T22:03:47.358426] [DEBUG] [LOCAL ] ZTR: Loaded 16790 existing records from primary storage. [2025-10-27T22:03:47.381452] [INFO ] [MAIN ] ZTR: Loaded 16790 existing records. [2025-10-27T22:03:47.750180] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:47.746906] [DEBUG] [LOCAL ] ZTS: Loaded 53866 existing records from primary storage. [2025-10-27T22:03:47.755243] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-27T22:03:47.753443] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:47.755619] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-27T22:03:47.756586] [DEBUG] [LOCAL ] ZTO: Loaded 49886 existing records from primary storage. [2025-10-27T22:03:47.755761] [INFO ] [MAIN ] ZTS: Loaded 53866 existing records. [2025-10-27T22:03:47.756694] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-27T22:03:47.785230] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-27T22:03:47.785171] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-27T22:03:47.796155] [INFO ] [MAIN ] ZTO: Loaded 49886 existing records. [2025-10-27T22:03:47.796295] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-27T22:03:47.790597] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-27T22:03:47.806807] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-27T22:03:48.312963] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:48.496954] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-27T22:03:48.516961] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-27T22:03:48.491279] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:03:48.559510] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-27T22:03:48.648488] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-27T22:03:48.677935] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-27T22:03:48.639322] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-27T22:03:48.728541] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-27T22:03:48.834015] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-27T22:03:49.078093] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:49.116689] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-27T22:03:49.180344] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:49.221629] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-27T22:03:49.582244] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:49.592871] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-27T22:03:49.651188] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:03:49.651480] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-27T22:03:50.010407] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-27T22:03:50.015979] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-27T22:03:50.047580] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-27T22:03:50.049842] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-27T22:03:50.635075] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-27T22:03:50.637989] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-27T22:03:50.751057] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-27T22:03:50.814903] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-27T22:03:50.878254] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-27T22:03:51.100980] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-27T22:03:51.458542] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-27T22:03:51.614967] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-27T22:03:51.801492] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-27T22:03:52.415012] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-27T22:03:52.868984] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-27T22:03:53.039534] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-27T22:03:53.214957] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-27T22:03:53.613295] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-27T22:03:54.014951] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-27T22:03:54.814951] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-27T22:03:55.381747] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-27T22:03:55.614956] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-27T22:03:56.286994] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-27T22:03:56.414946] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-27T22:03:56.968341] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-27T22:03:57.215005] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-27T22:03:57.331890] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-27T22:03:57.749374] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-27T22:03:58.014957] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-27T22:03:58.616127] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-27T22:03:58.814949] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-27T22:03:59.528264] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-27T22:03:59.614929] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-27T22:04:00.414953] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-27T22:04:01.214983] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-27T22:04:01.617297] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-27T22:04:01.618489] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-27T22:04:01.719524] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-27T22:04:02.014950] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-27T22:04:02.815012] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-27T22:04:03.395226] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-27T22:04:03.519984] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-27T22:04:03.614922] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-27T22:04:04.414988] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-27T22:04:04.871553] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-27T22:04:05.214919] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-27T22:04:05.361799] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-27T22:04:06.014950] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-27T22:04:06.757499] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-27T22:04:06.761112] [INFO ] [REMOTE ] ZTR: Full fetch complete (26954 records). [2025-10-27T22:04:06.761200] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-27T22:04:06.822855] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-27T22:04:07.125911] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-27T22:04:07.125990] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-27T22:04:07.126538] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-27T22:04:07.126581] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-27T22:04:07.127208] [DEBUG] [LOCAL ] ZTR: Trimmed 26954 records to 16304 (keeping 200 days of data) [2025-10-27T22:04:07.220852] [DEBUG] [LOCAL ] ZTR: Primary data saved (16304 records). [2025-10-27T22:04:07.220979] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-27T22:04:07.221054] [INFO ] [MAIN ] Update Progress: 2361/2366 symbols completed. ZTR took 20.6s. Estimated remaining: 38.6s. Rate: 7.8 symbols/min [2025-10-27T22:04:07.389758] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:04:07.420343] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-27T22:04:07.459996] [DEBUG] [LOCAL ] ZVIA: Loaded 36374 existing records from primary storage. [2025-10-27T22:04:07.460287] [INFO ] [MAIN ] ZVIA: Loaded 36374 existing records. [2025-10-27T22:04:07.614908] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-27T22:04:07.633623] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:04:07.634485] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-27T22:04:07.634547] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-27T22:04:07.634746] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-27T22:04:07.634801] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-27T22:04:07.980107] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:04:08.414969] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-27T22:04:08.624914] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-27T22:04:08.903214] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-27T22:04:09.215052] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-27T22:04:09.427940] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-27T22:04:09.697226] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-27T22:04:10.015003] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-27T22:04:10.349054] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-27T22:04:10.350414] [INFO ] [REMOTE ] ZKH: Full fetch complete (11732 records). [2025-10-27T22:04:10.350486] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-27T22:04:10.723255] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-27T22:04:10.723334] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-27T22:04:10.723605] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-27T22:04:10.723663] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-27T22:04:10.724129] [DEBUG] [LOCAL ] ZKH: Trimmed 11732 records to 7200 (keeping 200 days of data) [2025-10-27T22:04:10.761263] [DEBUG] [LOCAL ] ZKH: Primary data saved (7200 records). [2025-10-27T22:04:10.761365] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-27T22:04:10.761449] [INFO ] [MAIN ] Update Progress: 2362/2366 symbols completed. ZKH took 24.2s. Estimated remaining: 30.9s. Rate: 7.8 symbols/min [2025-10-27T22:04:10.821043] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-27T22:04:10.929097] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-17 to 2025-10-27. [2025-10-27T22:04:10.967022] [DEBUG] [LOCAL ] ZWS: Loaded 42708 existing records from primary storage. [2025-10-27T22:04:10.967294] [INFO ] [MAIN ] ZWS: Loaded 42708 existing records. [2025-10-27T22:04:11.140012] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-07, but need from 2025-01-10 for 200 day retention. Performing full refresh. [2025-10-27T22:04:11.140223] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-27T22:04:11.140269] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-27T22:04:11.140534] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-27T22:04:11.140577] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-27T22:04:11.490173] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2025-01-10 to 2025-10-27 (requires 10 months of data pull). [2025-10-27T22:04:11.614914] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-27T22:04:12.414907] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-27T22:04:12.716471] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-27T22:04:13.144929] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-27T22:04:13.214929] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-27T22:04:13.578400] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-27T22:04:14.014933] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-27T22:04:14.611614] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-27T22:04:14.814911] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-27T22:04:15.094426] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-27T22:04:15.615014] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-27T22:04:16.422165] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-27T22:04:16.427727] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-27T22:04:16.436868] [INFO ] [REMOTE ] ZTO: Full fetch complete (72468 records). [2025-10-27T22:04:16.437033] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-27T22:04:16.816410] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-27T22:04:16.816482] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-27T22:04:16.817660] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-27T22:04:16.817722] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-27T22:04:16.818990] [DEBUG] [LOCAL ] ZTO: Trimmed 72468 records to 48934 (keeping 200 days of data) [2025-10-27T22:04:17.104911] [DEBUG] [LOCAL ] ZTO: Primary data saved (48934 records). [2025-10-27T22:04:17.105031] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-27T22:04:17.105104] [INFO ] [MAIN ] Update Progress: 2363/2366 symbols completed. ZTO took 30.5s. Estimated remaining: 23.2s. Rate: 7.8 symbols/min [2025-10-27T22:04:17.214961] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-27T22:04:17.462963] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-27T22:04:17.497356] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-27T22:04:18.014988] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-27T22:04:18.805713] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-27T22:04:18.814894] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-27T22:04:19.509561] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-27T22:04:19.614914] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-27T22:04:20.097466] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-27T22:04:20.414951] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-27T22:04:21.160739] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-27T22:04:21.214972] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-27T22:04:21.811901] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-27T22:04:22.014944] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-27T22:04:22.826290] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-27T22:04:22.835049] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-27T22:04:22.876023] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-27T22:04:23.614963] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-27T22:04:23.992074] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-27T22:04:24.002497] [INFO ] [REMOTE ] ZTS: Full fetch complete (76854 records). [2025-10-27T22:04:24.002699] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-27T22:04:24.394538] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-27T22:04:24.394778] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-27T22:04:24.395972] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-27T22:04:24.396168] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-27T22:04:24.417817] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-27T22:04:24.420669] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-27T22:04:24.429587] [DEBUG] [LOCAL ] ZTS: Trimmed 76854 records to 53087 (keeping 200 days of data) [2025-10-27T22:04:24.753288] [DEBUG] [LOCAL ] ZTS: Primary data saved (53087 records). [2025-10-27T22:04:24.753426] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-27T22:04:24.754253] [INFO ] [MAIN ] Update Progress: 2364/2366 symbols completed. ZTS took 38.2s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-10-27T22:04:25.214941] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-27T22:04:25.808545] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-27T22:04:26.014993] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-27T22:04:26.147081] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-27T22:04:26.814976] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-27T22:04:27.124491] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-27T22:04:27.614994] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-27T22:04:28.065219] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-27T22:04:28.414994] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-27T22:04:28.665476] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-27T22:04:29.214935] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-27T22:04:29.697223] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-27T22:04:30.014940] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-27T22:04:30.304172] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-27T22:04:30.814956] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-27T22:04:30.999050] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-27T22:04:31.614982] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-27T22:04:32.260408] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-27T22:04:32.414963] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-27T22:04:32.933779] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-27T22:04:32.941993] [INFO ] [REMOTE ] ZWS: Full fetch complete (61991 records). [2025-10-27T22:04:32.942102] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-27T22:04:33.313287] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-27T22:04:33.313363] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-27T22:04:33.314453] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-27T22:04:33.314514] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-27T22:04:33.315638] [DEBUG] [LOCAL ] ZWS: Trimmed 61991 records to 41904 (keeping 200 days of data) [2025-10-27T22:04:33.554621] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-27T22:04:33.564823] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52456 records). [2025-10-27T22:04:33.565531] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-27T22:04:33.752802] [DEBUG] [LOCAL ] ZWS: Primary data saved (41904 records). [2025-10-27T22:04:33.769730] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-27T22:04:33.775320] [INFO ] [MAIN ] Update Progress: 2365/2366 symbols completed. ZWS took 23.0s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-10-27T22:04:33.971486] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-27T22:04:33.971558] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-27T22:04:33.972480] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-27T22:04:33.972560] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-27T22:04:33.973540] [DEBUG] [LOCAL ] ZVIA: Trimmed 52456 records to 35788 (keeping 200 days of data) [2025-10-27T22:04:34.168432] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35788 records). [2025-10-27T22:04:34.168577] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-27T22:04:34.168689] [INFO ] [MAIN ] Update Progress: 2366/2366 symbols completed. ZVIA took 26.9s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-10-27T22:04:34.170027] [INFO ] [MAIN ] Parallel update completed in 5h 4m 31s [2025-10-27T22:04:34.170109] [WARN ] [MAIN ] Failed symbols (485): AAM, AAUC, AAP, ABR, ABT, ACM, ACR, ACP, AD, ADNT... [2025-10-27T22:04:34.170187] [INFO ] [MAIN ] Update success rate: 79.5% (1881/2366 symbols) [2025-10-27T22:04:37.212061] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1881/2366 @ 79.50%)' [2025-10-27T22:04:37.212503] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-27T22:04:37.212549] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-27T22:04:37.212581] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-27T22:04:37.212702] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-27T22:04:37.212756] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-27T22:04:38.118048] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-27T22:04:38.118189] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-27T22:04:38.118406] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-27T22:04:38.118924] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-27T22:04:38.118981] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-27T22:04:38.119012] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-27T22:04:38.119068] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-27T22:04:38.119099] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-27T22:04:38.119128] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-27T22:04:38.119518] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-27T22:04:38.119557] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-27T22:04:38.119736] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-27T22:04:38.119792] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-27T22:04:38.119826] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-27T22:04:38.119857] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-27T22:04:38.143359] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-27T22:04:38.167199] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-27T22:04:38.167324] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-27T22:04:38.167359] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-27T22:04:38.167390] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-27T22:04:38.167445] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-27T22:04:38.167489] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-27T22:04:38.167551] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-27T22:04:38.168729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-27T22:04:38.168860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-27T22:04:38.169440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-27T22:04:38.169560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-10-27T22:04:38.169692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-27T22:04:38.169789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-27T22:04:38.169859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-27T22:04:38.169941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-27T22:04:38.170038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-27T22:04:38.170132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-27T22:04:38.170225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-27T22:04:38.170309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-27T22:04:38.170421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-27T22:04:38.170530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-27T22:04:38.170621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-27T22:04:38.170729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-27T22:04:38.170809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-27T22:04:38.170877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-27T22:04:38.170972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-27T22:04:38.171064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-27T22:04:38.171150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-27T22:04:38.171241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-27T22:04:38.171325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-27T22:04:38.171449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-27T22:04:38.171539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-27T22:04:38.171682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-27T22:04:38.171772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-27T22:04:38.171855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-27T22:04:38.171954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-27T22:04:38.172044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-27T22:04:38.172110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-27T22:04:38.172175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-27T22:04:38.172241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-27T22:04:38.172311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-27T22:04:38.172372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-27T22:04:38.172434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-27T22:04:38.172496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-27T22:04:38.172561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-27T22:04:38.172624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-27T22:04:38.172728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-27T22:04:38.172807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-27T22:04:38.172886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-27T22:04:38.173007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-27T22:04:38.173097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-27T22:04:38.173163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-27T22:04:38.173225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-27T22:04:38.173289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-27T22:04:38.173354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-27T22:04:38.173432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-27T22:04:38.173521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-27T22:04:38.173593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-27T22:04:38.173684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-27T22:04:38.173773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-27T22:04:38.173839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-27T22:04:38.173901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-27T22:04:38.174006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-27T22:04:38.174068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-27T22:04:38.174129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-27T22:04:38.174192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-27T22:04:38.174255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-27T22:04:38.174317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-27T22:04:38.174390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-27T22:04:38.174498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-27T22:04:38.174585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-27T22:04:38.174671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-27T22:04:38.174778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-27T22:04:38.174870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-27T22:04:38.174938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-27T22:04:38.174998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-27T22:04:38.175073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-27T22:04:38.175164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-27T22:04:38.175251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-27T22:04:38.175355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-27T22:04:38.175444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-27T22:04:38.175511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-27T22:04:38.175575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-27T22:04:38.175635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-27T22:04:38.175754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-27T22:04:38.175843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-27T22:04:38.175921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-27T22:04:38.175988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-27T22:04:38.176057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-27T22:04:38.176118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-27T22:04:38.176180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-27T22:04:38.176242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-27T22:04:38.176302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-27T22:04:38.176361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-27T22:04:38.176423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-27T22:04:38.176483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-27T22:04:38.176544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-27T22:04:38.176604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-27T22:04:38.176753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-27T22:04:38.176842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-27T22:04:38.176907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-27T22:04:38.177016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-27T22:04:38.177088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-27T22:04:38.177168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-27T22:04:38.177256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-27T22:04:38.177326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-27T22:04:38.177389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-27T22:04:38.177449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-27T22:04:38.177508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-27T22:04:38.177569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-27T22:04:38.177630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-27T22:04:38.177747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-27T22:04:38.177819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-27T22:04:38.177882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-27T22:04:38.177973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-27T22:04:38.178039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-27T22:04:38.178101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-27T22:04:38.178164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-27T22:04:38.178228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-27T22:04:38.178292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-27T22:04:38.178373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-27T22:04:38.178463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-27T22:04:38.178530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-27T22:04:38.178609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-27T22:04:38.178728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-27T22:04:38.178806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-27T22:04:38.178879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-27T22:04:38.178946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-27T22:04:38.179009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-27T22:04:38.179089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-27T22:04:38.179179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-27T22:04:38.179246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-27T22:04:38.179310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-27T22:04:38.179376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-27T22:04:38.179437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-27T22:04:38.179500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-27T22:04:38.179562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-27T22:04:38.179623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-27T22:04:38.179725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-27T22:04:38.179804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-27T22:04:38.179870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-27T22:04:38.179934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-27T22:04:38.179998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-27T22:04:38.180076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-27T22:04:38.180167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-27T22:04:38.180234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-27T22:04:38.180297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-27T22:04:38.180360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-27T22:04:38.180423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-27T22:04:38.180485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-27T22:04:38.180556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-27T22:04:38.180618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-27T22:04:38.180719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-27T22:04:38.180800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-27T22:04:38.180866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-27T22:04:38.180930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-27T22:04:38.180990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-27T22:04:38.181051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-27T22:04:38.181169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-27T22:04:38.181231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-27T22:04:38.181295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-27T22:04:38.181357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-27T22:04:38.181417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-27T22:04:38.181477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-27T22:04:38.181545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-27T22:04:38.181609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-27T22:04:38.181709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-27T22:04:38.181796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-27T22:04:38.181863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-27T22:04:38.181926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-27T22:04:38.181994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-27T22:04:38.182057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-27T22:04:38.182168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-27T22:04:38.182239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-27T22:04:38.182301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-27T22:04:38.182362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-27T22:04:38.182427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-27T22:04:38.182488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-27T22:04:38.182549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-27T22:04:38.182611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-27T22:04:38.182707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-27T22:04:38.182789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-27T22:04:38.182854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-27T22:04:38.182916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-27T22:04:38.182978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-27T22:04:38.183039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-27T22:04:38.183110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-27T22:04:38.183173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-27T22:04:38.183250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-27T22:04:38.183342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-27T22:04:38.183405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-27T22:04:38.183468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-27T22:04:38.183693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-27T22:04:38.183781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-27T22:04:38.183845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-27T22:04:38.183908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-27T22:04:38.183969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-27T22:04:38.184039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-27T22:04:38.184103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-27T22:04:38.184166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-27T22:04:38.184226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-27T22:04:38.184286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-27T22:04:38.184353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-27T22:04:38.184414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-27T22:04:38.184475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-27T22:04:38.184533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-27T22:04:38.184592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-10-27T22:04:38.184674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-27T22:04:38.184762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-27T22:04:38.184866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-27T22:04:38.184952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-27T22:04:38.185016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-27T22:04:38.185078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-27T22:04:38.185152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-27T22:04:38.185236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-27T22:04:38.185309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-27T22:04:38.185378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-27T22:04:38.185458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-27T22:04:38.185547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-27T22:04:38.185620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-27T22:04:38.185737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-27T22:04:38.185838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-27T22:04:38.185906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-27T22:04:38.185970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-27T22:04:38.186034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-27T22:04:38.186095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-27T22:04:38.186180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-27T22:04:38.186270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-27T22:04:38.186339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-27T22:04:38.186407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-27T22:04:38.186705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-27T22:04:38.186798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-27T22:04:38.186866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-27T22:04:38.186936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-27T22:04:38.186998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-27T22:04:38.187061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-27T22:04:38.187122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-27T22:04:38.187191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-27T22:04:38.187256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-27T22:04:38.187326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-27T22:04:38.187389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-27T22:04:38.187486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-27T22:04:38.187556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-27T22:04:38.187685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-27T22:04:38.187779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-27T22:04:38.187851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-27T22:04:38.187915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-27T22:04:38.187978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-27T22:04:38.188049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-27T22:04:38.188114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-27T22:04:38.188176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-27T22:04:38.188244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-27T22:04:38.188316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-27T22:04:38.188384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-27T22:04:38.188461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-27T22:04:38.188528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-27T22:04:38.188588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-27T22:04:38.188679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-27T22:04:38.188768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-27T22:04:38.188832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-27T22:04:38.188895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-27T22:04:38.188977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-27T22:04:38.189067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-27T22:04:38.189135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-27T22:04:38.189206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-27T22:04:38.189272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-27T22:04:38.189342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-27T22:04:38.189592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-27T22:04:38.189690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-27T22:04:38.189783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-27T22:04:38.189855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-27T22:04:38.189925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-27T22:04:38.189993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-27T22:04:38.190058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-27T22:04:38.190124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-27T22:04:38.190247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-27T22:04:38.190310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-27T22:04:38.190377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-27T22:04:38.190444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-27T22:04:38.190541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-27T22:04:38.190625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-27T22:04:38.190940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-27T22:04:38.191019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-27T22:04:38.191089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-27T22:04:38.191153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-27T22:04:38.191217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-27T22:04:38.191284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-27T22:04:38.191349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-27T22:04:38.191793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-27T22:04:38.191892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-27T22:04:38.192001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-27T22:04:38.192076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-27T22:04:38.192141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-27T22:04:38.192208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-27T22:04:38.192273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-27T22:04:38.192335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-27T22:04:38.192398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-27T22:04:38.192463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-27T22:04:38.192526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-27T22:04:38.192593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-27T22:04:38.192704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-27T22:04:38.192795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-27T22:04:38.192863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-27T22:04:38.192929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-27T22:04:38.193001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-27T22:04:38.193065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-27T22:04:38.193132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-27T22:04:38.193197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-27T22:04:38.193259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-27T22:04:38.193320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-27T22:04:38.193388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-27T22:04:38.193602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-27T22:04:38.193694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-27T22:04:38.193783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-27T22:04:38.193891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-27T22:04:38.193983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-27T22:04:38.194072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-27T22:04:38.194163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-27T22:04:38.194255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-27T22:04:38.194322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-27T22:04:38.194387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-27T22:04:38.194452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-27T22:04:38.194513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-27T22:04:38.194577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-27T22:04:38.194839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-27T22:04:38.194936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-27T22:04:38.195018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-27T22:04:38.195085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-27T22:04:38.195158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-27T22:04:38.195221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-27T22:04:38.195284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-27T22:04:38.195349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-27T22:04:38.195411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-27T22:04:38.195475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-27T22:04:38.195538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-27T22:04:38.195618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-27T22:04:38.195747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-27T22:04:38.195836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-27T22:04:38.195904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-27T22:04:38.195978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-27T22:04:38.196045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-27T22:04:38.196112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-27T22:04:38.196202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-27T22:04:38.196264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-27T22:04:38.196328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-27T22:04:38.196390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-27T22:04:38.196452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-27T22:04:38.196515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-27T22:04:38.196581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-27T22:04:38.196686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-27T22:04:38.196776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-27T22:04:38.196843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-27T22:04:38.196906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-27T22:04:38.196967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-27T22:04:38.197027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-27T22:04:38.197097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-27T22:04:38.197159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-27T22:04:38.197222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-27T22:04:38.197290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-27T22:04:38.197352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-27T22:04:38.197413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-27T22:04:38.197476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-10-27T22:04:38.197538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-27T22:04:38.197598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-27T22:04:38.197687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-27T22:04:38.197777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-27T22:04:38.197843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-27T22:04:38.197906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-27T22:04:38.197970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-27T22:04:38.198033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-27T22:04:38.198113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-27T22:04:38.198200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-27T22:04:38.198264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-27T22:04:38.198328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-27T22:04:38.198388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-27T22:04:38.198450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-27T22:04:38.198510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-27T22:04:38.198570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-27T22:04:38.198736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-27T22:04:38.198826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-27T22:04:38.198891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-27T22:04:38.198953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-27T22:04:38.199014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-27T22:04:38.199078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-27T22:04:38.199138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-27T22:04:38.199248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-27T22:04:38.199321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-27T22:04:38.199384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-27T22:04:38.199447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-27T22:04:38.199511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-27T22:04:38.199573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-27T22:04:38.199635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-27T22:04:38.199747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-27T22:04:38.199825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-27T22:04:38.199889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-27T22:04:38.199952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-27T22:04:38.200014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-27T22:04:38.200077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-27T22:04:38.200138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-27T22:04:38.200198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-27T22:04:38.200257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-27T22:04:38.200316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-27T22:04:38.200377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-27T22:04:38.200437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-27T22:04:38.200499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-27T22:04:38.200559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-27T22:04:38.200623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-27T22:04:38.200725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-27T22:04:38.200800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-27T22:04:38.200862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-27T22:04:38.200923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-27T22:04:38.200985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-27T22:04:38.201045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-27T22:04:38.201107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-27T22:04:38.201168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-27T22:04:38.201247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-27T22:04:38.201335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-27T22:04:38.201397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-27T22:04:38.201459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-27T22:04:38.201520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-27T22:04:38.201580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-27T22:04:38.201671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-27T22:04:38.201762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-27T22:04:38.201828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-27T22:04:38.201891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-27T22:04:38.201952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-27T22:04:38.202016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-27T22:04:38.202077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-27T22:04:38.202185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-27T22:04:38.202248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-27T22:04:38.202310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-10-27T22:04:38.202381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-27T22:04:38.202448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-27T22:04:38.202512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-27T22:04:38.202575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-27T22:04:38.202664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-27T22:04:38.202759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-27T22:04:38.202823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-27T22:04:38.202888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-27T22:04:38.202954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-27T22:04:38.203017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-27T22:04:38.203082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-27T22:04:38.203143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-27T22:04:38.203218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-27T22:04:38.203280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-27T22:04:38.203342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-27T22:04:38.203404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-27T22:04:38.203471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-27T22:04:38.203538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-27T22:04:38.203604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-27T22:04:38.203692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-27T22:04:38.203779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-27T22:04:38.203847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-27T22:04:38.203911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-27T22:04:38.203982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-27T22:04:38.204046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-27T22:04:38.204156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-27T22:04:38.204228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-27T22:04:38.204300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-27T22:04:38.204363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-27T22:04:38.204427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-27T22:04:38.204486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-27T22:04:38.204548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-27T22:04:38.204611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-27T22:04:38.204706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-27T22:04:38.204800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-27T22:04:38.204866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-27T22:04:38.204943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-27T22:04:38.205008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-27T22:04:38.205071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-27T22:04:38.205141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-27T22:04:38.205206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-27T22:04:38.205282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-27T22:04:38.205359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-27T22:04:38.205427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-27T22:04:38.205490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-27T22:04:38.205558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-27T22:04:38.205622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-27T22:04:38.205724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-27T22:04:38.205805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-27T22:04:38.205869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-27T22:04:38.205933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-27T22:04:38.205996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-27T22:04:38.206057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-27T22:04:38.206120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-27T22:04:38.206207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-27T22:04:38.206281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-27T22:04:38.206341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-27T22:04:38.206404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-27T22:04:38.206465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-27T22:04:38.206529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-27T22:04:38.206590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-27T22:04:38.206773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-27T22:04:38.206866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-27T22:04:38.206933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-27T22:04:38.206998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-27T22:04:38.207062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-27T22:04:38.207124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-27T22:04:38.207185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-27T22:04:38.207260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-27T22:04:38.207338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-27T22:04:38.207416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-27T22:04:38.207478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-27T22:04:38.207538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-27T22:04:38.207605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-27T22:04:38.207692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-27T22:04:38.207780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-27T22:04:38.207844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-27T22:04:38.207912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-27T22:04:38.207975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-27T22:04:38.208036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-27T22:04:38.208096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-27T22:04:38.208155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-27T22:04:38.208217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-27T22:04:38.208277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-27T22:04:38.208339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-27T22:04:38.208400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-27T22:04:38.208462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-27T22:04:38.208548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-27T22:04:38.208610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-27T22:04:38.208703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-27T22:04:38.208786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-27T22:04:38.208848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-27T22:04:38.208911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-27T22:04:38.208972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-27T22:04:38.209032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-27T22:04:38.209094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-27T22:04:38.209196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-27T22:04:38.209268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-27T22:04:38.209331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-27T22:04:38.209393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-27T22:04:38.209454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-27T22:04:38.209514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-27T22:04:38.209575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-27T22:04:38.209637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-27T22:04:38.209745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-27T22:04:38.209814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-27T22:04:38.209876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-27T22:04:38.209938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-27T22:04:38.210000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-27T22:04:38.210060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-27T22:04:38.210121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-27T22:04:38.210185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-27T22:04:38.210248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-27T22:04:38.210313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-27T22:04:38.210373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-27T22:04:38.210441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-27T22:04:38.210516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-27T22:04:38.210605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-27T22:04:38.210695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-27T22:04:38.210780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-27T22:04:38.210842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-27T22:04:38.210906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-27T22:04:38.210967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-27T22:04:38.211029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-27T22:04:38.211086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-27T22:04:38.211146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-27T22:04:38.211211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-27T22:04:38.211274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-27T22:04:38.211335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-27T22:04:38.211395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-27T22:04:38.211460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-27T22:04:38.211524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-27T22:04:38.211613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-27T22:04:38.211823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-27T22:04:38.211905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-27T22:04:38.211972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-27T22:04:38.212034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-27T22:04:38.212097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-27T22:04:38.212160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-27T22:04:38.212224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-27T22:04:38.212287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-27T22:04:38.212353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-27T22:04:38.212425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-27T22:04:38.212488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-27T22:04:38.212554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-27T22:04:38.212620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-27T22:04:38.212722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-27T22:04:38.212802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-27T22:04:38.212869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-27T22:04:38.212936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-27T22:04:38.213008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-27T22:04:38.213074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-27T22:04:38.213138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-27T22:04:38.213235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-27T22:04:38.213318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-27T22:04:38.213389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-27T22:04:38.213467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-27T22:04:38.213558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-27T22:04:38.213624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-27T22:04:38.213728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-27T22:04:38.213805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-27T22:04:38.213877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-27T22:04:38.213943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-27T22:04:38.214005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-27T22:04:38.214068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-27T22:04:38.214129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-27T22:04:38.214193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-27T22:04:38.214315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-27T22:04:38.214387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-27T22:04:38.214453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-27T22:04:38.214517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-27T22:04:38.214583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-27T22:04:38.214673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-27T22:04:38.214764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-27T22:04:38.214830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-27T22:04:38.214894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-27T22:04:38.214960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-27T22:04:38.215022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-27T22:04:38.215084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-27T22:04:38.215148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-27T22:04:38.215210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-27T22:04:38.215271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-27T22:04:38.215335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-27T22:04:38.215398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-27T22:04:38.215461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-27T22:04:38.215521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-27T22:04:38.215582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-27T22:04:38.215666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-27T22:04:38.215758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-27T22:04:38.215887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-27T22:04:38.215979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-27T22:04:38.216059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-27T22:04:38.216123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-27T22:04:38.216185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-27T22:04:38.216248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-27T22:04:38.216311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-27T22:04:38.216376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-27T22:04:38.216438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-27T22:04:38.216498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-27T22:04:38.216561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-27T22:04:38.216622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-27T22:04:38.216752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-27T22:04:38.216825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-27T22:04:38.216888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-27T22:04:38.216949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-27T22:04:38.217012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-27T22:04:38.217075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-27T22:04:38.217135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-27T22:04:38.217196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-27T22:04:38.217257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-27T22:04:38.217318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-27T22:04:38.217378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-27T22:04:38.217439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-27T22:04:38.217501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-27T22:04:38.217563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-27T22:04:38.217623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-27T22:04:38.217725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-27T22:04:38.217801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-27T22:04:38.217865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-27T22:04:38.217928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-27T22:04:38.217989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-27T22:04:38.218050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-27T22:04:38.218111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-27T22:04:38.218172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-27T22:04:38.218233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-27T22:04:38.218295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-27T22:04:38.218356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-27T22:04:38.218420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-27T22:04:38.218481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-27T22:04:38.218542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-27T22:04:38.218612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-27T22:04:38.218742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-27T22:04:38.218830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-27T22:04:38.218892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-27T22:04:38.218955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-27T22:04:38.219018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-10-27T22:04:38.219079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-27T22:04:38.219141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-27T22:04:38.219251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-27T22:04:38.219322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-27T22:04:38.219385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-27T22:04:38.219446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-27T22:04:38.219510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-27T22:04:38.219571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-27T22:04:38.219632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-27T22:04:38.219885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-27T22:04:38.219958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-27T22:04:38.220020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-27T22:04:38.220080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-27T22:04:38.220139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-27T22:04:38.220198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-27T22:04:38.220261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-27T22:04:38.220322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-27T22:04:38.220387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-27T22:04:38.220451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-27T22:04:38.220516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-27T22:04:38.220580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-27T22:04:38.220663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-27T22:04:38.220757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-27T22:04:38.220825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-27T22:04:38.220890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-27T22:04:38.220953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-27T22:04:38.221013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-27T22:04:38.221087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-27T22:04:38.221200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-27T22:04:38.221273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-27T22:04:38.221338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-27T22:04:38.221407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-27T22:04:38.221475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAMI.csv [2025-10-27T22:04:38.221542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-27T22:04:38.221607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-27T22:04:38.221702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-27T22:04:38.221791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-27T22:04:38.221855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-27T22:04:38.221921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-27T22:04:38.221987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-27T22:04:38.222051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-27T22:04:38.222114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-27T22:04:38.222177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-27T22:04:38.222242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-27T22:04:38.222306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-27T22:04:38.222369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-27T22:04:38.222430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-27T22:04:38.222493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-27T22:04:38.222557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-27T22:04:38.222620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-27T22:04:38.222727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-27T22:04:38.222808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-27T22:04:38.222872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-27T22:04:38.222942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-27T22:04:38.223005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-27T22:04:38.223067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-27T22:04:38.223129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-27T22:04:38.223192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-27T22:04:38.223276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-27T22:04:38.223366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-27T22:04:38.223432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-27T22:04:38.223495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-27T22:04:38.223557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-27T22:04:38.223618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-27T22:04:38.223827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-27T22:04:38.223908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-27T22:04:38.223971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-27T22:04:38.224042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-27T22:04:38.224105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-27T22:04:38.224168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-27T22:04:38.224240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-27T22:04:38.224302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-27T22:04:38.224364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-27T22:04:38.224487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-27T22:04:38.224558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-27T22:04:38.224623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-27T22:04:38.224733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-27T22:04:38.224810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-27T22:04:38.224872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-27T22:04:38.224936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-27T22:04:38.224999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-27T22:04:38.225061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-27T22:04:38.225122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-27T22:04:38.225183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-27T22:04:38.225244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-27T22:04:38.225306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-27T22:04:38.225367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-27T22:04:38.225427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-27T22:04:38.225494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-27T22:04:38.225556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-27T22:04:38.225617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-27T22:04:38.225715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-27T22:04:38.225796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-27T22:04:38.225891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-27T22:04:38.225955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-27T22:04:38.226017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-27T22:04:38.226080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-27T22:04:38.226141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-27T22:04:38.226215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-27T22:04:38.226276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-27T22:04:38.226349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-27T22:04:38.226410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-27T22:04:38.226470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-27T22:04:38.226531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-27T22:04:38.226591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-27T22:04:38.226698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-27T22:04:38.226785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-27T22:04:38.226850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-27T22:04:38.226919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-27T22:04:38.226981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-27T22:04:38.227043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-27T22:04:38.227106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-27T22:04:38.227167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-27T22:04:38.227227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-27T22:04:38.227288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-27T22:04:38.227350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-27T22:04:38.227414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-27T22:04:38.227474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-27T22:04:38.227543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-27T22:04:38.227617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-27T22:04:38.227721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-27T22:04:38.227802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-27T22:04:38.227867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-27T22:04:38.227928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-27T22:04:38.227989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-27T22:04:38.228048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-27T22:04:38.228108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-27T22:04:38.228169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-27T22:04:38.228229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-27T22:04:38.228290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-27T22:04:38.228351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-27T22:04:38.228412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-27T22:04:38.228473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-27T22:04:38.228588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-27T22:04:38.228673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-27T22:04:38.228763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-27T22:04:38.228826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-27T22:04:38.228889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-27T22:04:38.228951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-27T22:04:38.229019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-27T22:04:38.229085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-27T22:04:38.229148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-27T22:04:38.229211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-27T22:04:38.229273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-27T22:04:38.229384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-27T22:04:38.229455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-27T22:04:38.229531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-27T22:04:38.229595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-27T22:04:38.229685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-27T22:04:38.229788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-27T22:04:38.229853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-27T22:04:38.229916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-27T22:04:38.229980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-27T22:04:38.230043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-27T22:04:38.230106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-27T22:04:38.230167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-27T22:04:38.230233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-27T22:04:38.230293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-27T22:04:38.230354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-10-27T22:04:38.230418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-27T22:04:38.230482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-27T22:04:38.230544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-27T22:04:38.230608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-27T22:04:38.230858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-27T22:04:38.230961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-27T22:04:38.231027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-27T22:04:38.231090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-27T22:04:38.231154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-27T22:04:38.231218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-27T22:04:38.231279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-27T22:04:38.231342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-27T22:04:38.231403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-27T22:04:38.231467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-27T22:04:38.231532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-27T22:04:38.231594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-27T22:04:38.231689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-27T22:04:38.231782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-27T22:04:38.231847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-27T22:04:38.231908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-27T22:04:38.231972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-27T22:04:38.232035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-27T22:04:38.232097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-27T22:04:38.232209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-27T22:04:38.232270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-27T22:04:38.232332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-27T22:04:38.232402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-27T22:04:38.232465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-27T22:04:38.232527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-27T22:04:38.232589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-27T22:04:38.232676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-27T22:04:38.232765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-27T22:04:38.232832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-27T22:04:38.232894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-27T22:04:38.232958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-27T22:04:38.233020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-27T22:04:38.233083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-27T22:04:38.233145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-27T22:04:38.233209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-27T22:04:38.233272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-27T22:04:38.233333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-27T22:04:38.233395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-27T22:04:38.233468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-27T22:04:38.233530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-27T22:04:38.233591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-27T22:04:38.233690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-27T22:04:38.233782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-27T22:04:38.233848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-27T22:04:38.233912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-27T22:04:38.233975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-27T22:04:38.234036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-27T22:04:38.234097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-27T22:04:38.234159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-27T22:04:38.234222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-27T22:04:38.234286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-27T22:04:38.234349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-27T22:04:38.234460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-27T22:04:38.234534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-27T22:04:38.234598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-27T22:04:38.234689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-27T22:04:38.234778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-27T22:04:38.234843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-27T22:04:38.234905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-27T22:04:38.234966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-27T22:04:38.235037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-27T22:04:38.235100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-27T22:04:38.235161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-27T22:04:38.235222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-27T22:04:38.235284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-27T22:04:38.235344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-27T22:04:38.235405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-27T22:04:38.235467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-27T22:04:38.235549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-27T22:04:38.235610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-27T22:04:38.235704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-27T22:04:38.235788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-27T22:04:38.235850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-27T22:04:38.235911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-27T22:04:38.235973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-27T22:04:38.236037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-27T22:04:38.236097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-27T22:04:38.236156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-27T22:04:38.236217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-27T22:04:38.236285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-27T22:04:38.236347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-27T22:04:38.236407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-27T22:04:38.236467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-27T22:04:38.236528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-27T22:04:38.236588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-27T22:04:38.236702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-27T22:04:38.236791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-27T22:04:38.236855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-27T22:04:38.236917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-27T22:04:38.236979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-27T22:04:38.237040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-27T22:04:38.237100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-27T22:04:38.237161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-27T22:04:38.237222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-27T22:04:38.237284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-27T22:04:38.237344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-27T22:04:38.237601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-27T22:04:38.237687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-27T22:04:38.237780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-27T22:04:38.237845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-27T22:04:38.237906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-27T22:04:38.237965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-27T22:04:38.238026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-27T22:04:38.238086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-27T22:04:38.238149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-27T22:04:38.238215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-27T22:04:38.238282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-27T22:04:38.238346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-27T22:04:38.238411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-27T22:04:38.238472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-27T22:04:38.238537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-27T22:04:38.238602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-27T22:04:38.238766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-27T22:04:38.238858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-27T22:04:38.238925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-27T22:04:38.238989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-27T22:04:38.239055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-27T22:04:38.239119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-27T22:04:38.239184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-27T22:04:38.239247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-27T22:04:38.239309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-27T22:04:38.239376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-27T22:04:38.239437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-27T22:04:38.239545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-27T22:04:38.239616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-27T22:04:38.239718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-27T22:04:38.239799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-27T22:04:38.239866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-27T22:04:38.239930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-27T22:04:38.239998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-27T22:04:38.240060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-27T22:04:38.240123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-27T22:04:38.240189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-27T22:04:38.240251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-27T22:04:38.240312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-27T22:04:38.240375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-27T22:04:38.240444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-27T22:04:38.240509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-27T22:04:38.240573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-27T22:04:38.240637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-27T22:04:38.240751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-27T22:04:38.240820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-27T22:04:38.240886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-27T22:04:38.240949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-27T22:04:38.241014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-27T22:04:38.241078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-27T22:04:38.241140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-27T22:04:38.241203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-27T22:04:38.241274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-27T22:04:38.241344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-27T22:04:38.241406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-27T22:04:38.241497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-27T22:04:38.241602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-27T22:04:38.241723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-27T22:04:38.241803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-27T22:04:38.241888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-27T22:04:38.241961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-27T22:04:38.242029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-27T22:04:38.242091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-27T22:04:38.242153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-27T22:04:38.242223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-27T22:04:38.242284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-27T22:04:38.242346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-27T22:04:38.242407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-27T22:04:38.242467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-27T22:04:38.242526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-27T22:04:38.242587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-27T22:04:38.242803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-27T22:04:38.242893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-27T22:04:38.242958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-27T22:04:38.243019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-27T22:04:38.243082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-27T22:04:38.243144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-27T22:04:38.243205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-27T22:04:38.243266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-27T22:04:38.243335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-27T22:04:38.243397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-27T22:04:38.243476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-27T22:04:38.243538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-27T22:04:38.243599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-27T22:04:38.243686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-27T22:04:38.243775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-27T22:04:38.243840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-27T22:04:38.243902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-27T22:04:38.243976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-27T22:04:38.244036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-27T22:04:38.244098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-27T22:04:38.244160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-27T22:04:38.244221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-27T22:04:38.244282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-27T22:04:38.244351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-27T22:04:38.244410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-27T22:04:38.244470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-27T22:04:38.244530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-27T22:04:38.244634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-27T22:04:38.244750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-27T22:04:38.244818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-27T22:04:38.244882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-27T22:04:38.244943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-27T22:04:38.245025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-27T22:04:38.245085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-27T22:04:38.245144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-27T22:04:38.245205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-27T22:04:38.245279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-27T22:04:38.245340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-27T22:04:38.245400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-27T22:04:38.245461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-27T22:04:38.245520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-27T22:04:38.245580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-27T22:04:38.245663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-27T22:04:38.245767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-27T22:04:38.245831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-27T22:04:38.245904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-27T22:04:38.245970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-27T22:04:38.246036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-27T22:04:38.246097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-27T22:04:38.246159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-27T22:04:38.246220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-27T22:04:38.246282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-27T22:04:38.246343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-27T22:04:38.246403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-27T22:04:38.246467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-27T22:04:38.246529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-27T22:04:38.246617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-27T22:04:38.246869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-27T22:04:38.246945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-27T22:04:38.247010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-27T22:04:38.247073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-27T22:04:38.247134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-27T22:04:38.247197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-27T22:04:38.247261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-27T22:04:38.247325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-27T22:04:38.247390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-27T22:04:38.247453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-27T22:04:38.247518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-27T22:04:38.247582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-27T22:04:38.247685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-27T22:04:38.247775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-27T22:04:38.247842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-27T22:04:38.247907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-27T22:04:38.247977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-27T22:04:38.248055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-27T22:04:38.248120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-27T22:04:38.248188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-27T22:04:38.248252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-27T22:04:38.248322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-27T22:04:38.248382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-27T22:04:38.248448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-27T22:04:38.248512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-27T22:04:38.248575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-27T22:04:38.248639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-27T22:04:38.248764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-27T22:04:38.248834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-27T22:04:38.248900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-27T22:04:38.248964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-27T22:04:38.249053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-27T22:04:38.249124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-27T22:04:38.249186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-27T22:04:38.249250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-27T22:04:38.249312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-27T22:04:38.249375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-27T22:04:38.249439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-27T22:04:38.249503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-27T22:04:38.249567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-27T22:04:38.249630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-27T22:04:38.249762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-27T22:04:38.249833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-27T22:04:38.249899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-27T22:04:38.249962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-27T22:04:38.250025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-27T22:04:38.250088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-27T22:04:38.250151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-27T22:04:38.250213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-27T22:04:38.250275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-27T22:04:38.250337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-27T22:04:38.250400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-27T22:04:38.250461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-27T22:04:38.250524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-27T22:04:38.250586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-27T22:04:38.250676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-27T22:04:38.250769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-27T22:04:38.250835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-27T22:04:38.250898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-27T22:04:38.250962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-27T22:04:38.251034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-27T22:04:38.251097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-27T22:04:38.251159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-27T22:04:38.251222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-27T22:04:38.251285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-27T22:04:38.251355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-27T22:04:38.251416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-27T22:04:38.251478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-27T22:04:38.251540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-27T22:04:38.251623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-27T22:04:38.251732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-27T22:04:38.251809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-27T22:04:38.251875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-27T22:04:38.251938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-27T22:04:38.252000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-27T22:04:38.252060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-27T22:04:38.252125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-27T22:04:38.252186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-27T22:04:38.252247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-27T22:04:38.252307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-27T22:04:38.252369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-27T22:04:38.252431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-27T22:04:38.252492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-27T22:04:38.252549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-27T22:04:38.252608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-27T22:04:38.252697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-27T22:04:38.252782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-27T22:04:38.252848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-27T22:04:38.252912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-27T22:04:38.252973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-27T22:04:38.253034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-27T22:04:38.253106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-27T22:04:38.253167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-27T22:04:38.253225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-27T22:04:38.253286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-27T22:04:38.253392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-27T22:04:38.253453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-27T22:04:38.253515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-27T22:04:38.253576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-27T22:04:38.253638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-27T22:04:38.253759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-27T22:04:38.253826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-27T22:04:38.253890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-27T22:04:38.253960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-27T22:04:38.254023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-27T22:04:38.254085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-27T22:04:38.254145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-27T22:04:38.254205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-27T22:04:38.254264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-27T22:04:38.254325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-27T22:04:38.254385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-27T22:04:38.254447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-27T22:04:38.254548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-27T22:04:38.254620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-27T22:04:38.254808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-27T22:04:38.254886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-27T22:04:38.254954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-27T22:04:38.255020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-27T22:04:38.255087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-27T22:04:38.255151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-27T22:04:38.255214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-27T22:04:38.255276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-27T22:04:38.255338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-27T22:04:38.255405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-27T22:04:38.255472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-27T22:04:38.255534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-27T22:04:38.255599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-27T22:04:38.255697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-27T22:04:38.255787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-27T22:04:38.255855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-27T22:04:38.255920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-27T22:04:38.255983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-27T22:04:38.256050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-27T22:04:38.256115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-27T22:04:38.256180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-27T22:04:38.256246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-27T22:04:38.256307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-27T22:04:38.256371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-27T22:04:38.256434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-27T22:04:38.256497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-27T22:04:38.256561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-27T22:04:38.256623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-27T22:04:38.256776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-27T22:04:38.256849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-27T22:04:38.256911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-27T22:04:38.256977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-27T22:04:38.257047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-27T22:04:38.257110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-27T22:04:38.257172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-27T22:04:38.257235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-27T22:04:38.257301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-27T22:04:38.257368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-27T22:04:38.257432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-27T22:04:38.257494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-27T22:04:38.257558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-27T22:04:38.257618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-27T22:04:38.257718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-27T22:04:38.257798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-27T22:04:38.257873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-27T22:04:38.257950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-27T22:04:38.258013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-27T22:04:38.258074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-27T22:04:38.258138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-27T22:04:38.258204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-27T22:04:38.258268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-27T22:04:38.258330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-27T22:04:38.258396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-27T22:04:38.258458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-27T22:04:38.258519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-27T22:04:38.258579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-27T22:04:38.258935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-27T22:04:38.259026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-27T22:04:38.259092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-27T22:04:38.259158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-27T22:04:38.259221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-27T22:04:38.259282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-27T22:04:38.259353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-27T22:04:38.259415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-27T22:04:38.259476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-27T22:04:38.259539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-27T22:04:38.259608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-27T22:04:38.259704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-27T22:04:38.259789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-27T22:04:38.259894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-27T22:04:38.259967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-27T22:04:38.260031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-27T22:04:38.260095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-27T22:04:38.260158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-27T22:04:38.260220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-27T22:04:38.260282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-27T22:04:38.260349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-27T22:04:38.260412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-27T22:04:38.260474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-27T22:04:38.260535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-27T22:04:38.260597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-27T22:04:38.260689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-27T22:04:38.260777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-27T22:04:38.260850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-27T22:04:38.260912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-27T22:04:38.260974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-27T22:04:38.261038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-27T22:04:38.261101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-27T22:04:38.261161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-27T22:04:38.261223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-27T22:04:38.261294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-27T22:04:38.261356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-27T22:04:38.261417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-27T22:04:38.261477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-27T22:04:38.261538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-27T22:04:38.261599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-27T22:04:38.261692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-27T22:04:38.261785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-27T22:04:38.261850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-27T22:04:38.261912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-27T22:04:38.261974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-27T22:04:38.262036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-27T22:04:38.262096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-27T22:04:38.262156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-27T22:04:38.262225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-27T22:04:38.262290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-27T22:04:38.262352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-27T22:04:38.262413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-27T22:04:38.262502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-27T22:04:38.262567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-27T22:04:38.262628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-27T22:04:38.262866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-27T22:04:38.262951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-27T22:04:38.263013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-27T22:04:38.263084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-27T22:04:38.263147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-27T22:04:38.263208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-27T22:04:38.263269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-27T22:04:38.263335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-27T22:04:38.263399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-27T22:04:38.263458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-27T22:04:38.263517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-27T22:04:38.263580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-27T22:04:38.263667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-27T22:04:38.263757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-27T22:04:38.263821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-27T22:04:38.263884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-27T22:04:38.263945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-27T22:04:38.264005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-27T22:04:38.264064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-27T22:04:38.264134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-27T22:04:38.264194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-27T22:04:38.264256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-27T22:04:38.264319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-27T22:04:38.264380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-27T22:04:38.264440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-27T22:04:38.264500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-27T22:04:38.264718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-27T22:04:38.264840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-27T22:04:38.264916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-27T22:04:38.265048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-27T22:04:38.265122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-27T22:04:38.265204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-27T22:04:38.265274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-27T22:04:38.265340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-27T22:04:38.265403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-27T22:04:38.265467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-27T22:04:38.265529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-27T22:04:38.265596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-27T22:04:38.265691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-27T22:04:38.265782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-27T22:04:38.265849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-27T22:04:38.265919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-27T22:04:38.265984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-27T22:04:38.266047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-27T22:04:38.266112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-27T22:04:38.266178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-27T22:04:38.266244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-27T22:04:38.266306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-27T22:04:38.266371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-27T22:04:38.266459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-27T22:04:38.266522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-27T22:04:38.266585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-27T22:04:38.266686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-27T22:04:38.266778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-27T22:04:38.266849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-27T22:04:38.266915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-27T22:04:38.266981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-27T22:04:38.267044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-27T22:04:38.267106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-27T22:04:38.267166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-27T22:04:38.267226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-27T22:04:38.267290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-27T22:04:38.267353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-27T22:04:38.267417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-27T22:04:38.267479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-27T22:04:38.267542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-27T22:04:38.267605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-27T22:04:38.267704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-27T22:04:38.267790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-27T22:04:38.267865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-27T22:04:38.267928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-27T22:04:38.268023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-27T22:04:38.268086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-27T22:04:38.268147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-27T22:04:38.268208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-27T22:04:38.268269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-27T22:04:38.268333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-27T22:04:38.268395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-27T22:04:38.268455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-27T22:04:38.268516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-27T22:04:38.268577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-27T22:04:38.268660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-27T22:04:38.268755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-27T22:04:38.268823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-27T22:04:38.268885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-27T22:04:38.268949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-27T22:04:38.269011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-27T22:04:38.269071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-27T22:04:38.269133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-27T22:04:38.269194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-27T22:04:38.269254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-27T22:04:38.269316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-27T22:04:38.269378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-27T22:04:38.269439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-27T22:04:38.269545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-27T22:04:38.269607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-27T22:04:38.269706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-27T22:04:38.269793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-27T22:04:38.269862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-10-27T22:04:38.269925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-27T22:04:38.270029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-27T22:04:38.270100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-27T22:04:38.270162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-27T22:04:38.270225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-27T22:04:38.270288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-27T22:04:38.270350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-27T22:04:38.270414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-27T22:04:38.270477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-27T22:04:38.270548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-27T22:04:38.270610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-27T22:04:38.270795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-27T22:04:38.270880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-27T22:04:38.270945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-27T22:04:38.271009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-27T22:04:38.271071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-27T22:04:38.271134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-27T22:04:38.271198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-27T22:04:38.271258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-27T22:04:38.271318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-27T22:04:38.271378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-27T22:04:38.271439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-27T22:04:38.271499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-27T22:04:38.271560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-27T22:04:38.271622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-27T22:04:38.271731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-27T22:04:38.271806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-27T22:04:38.271870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-27T22:04:38.271934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-27T22:04:38.271996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-27T22:04:38.272057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-27T22:04:38.272117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-27T22:04:38.272176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-27T22:04:38.272237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-27T22:04:38.272297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-27T22:04:38.272367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-27T22:04:38.272428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-27T22:04:38.272490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-27T22:04:38.272563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-27T22:04:38.272624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-27T22:04:38.272796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-27T22:04:38.272883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-27T22:04:38.272947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-27T22:04:38.273009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-27T22:04:38.273071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-27T22:04:38.273133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-27T22:04:38.273238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-27T22:04:38.273306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-27T22:04:38.273369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-27T22:04:38.273430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-27T22:04:38.273489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-27T22:04:38.273549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-27T22:04:38.273610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-27T22:04:38.273704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-27T22:04:38.273785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-27T22:04:38.273851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-27T22:04:38.273914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-27T22:04:38.273976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-27T22:04:38.274038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-27T22:04:38.274099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-27T22:04:38.274160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-27T22:04:38.274228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-27T22:04:38.274290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-27T22:04:38.274353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-27T22:04:38.274423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-27T22:04:38.274487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-27T22:04:38.274551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-27T22:04:38.274624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-27T22:04:38.274807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-27T22:04:38.274887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-27T22:04:38.274954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-27T22:04:38.275018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-27T22:04:38.275123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-27T22:04:38.275196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-27T22:04:38.275259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-27T22:04:38.275321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-27T22:04:38.275383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-27T22:04:38.275445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-27T22:04:38.275508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-27T22:04:38.275569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-27T22:04:38.275629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-27T22:04:38.275735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-27T22:04:38.275808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-27T22:04:38.275872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-27T22:04:38.275937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-27T22:04:38.276006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-27T22:04:38.276070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-27T22:04:38.276133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-27T22:04:38.276197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-27T22:04:38.276268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-27T22:04:38.276331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-27T22:04:38.276392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-27T22:04:38.276454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-27T22:04:38.276517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-27T22:04:38.276578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-27T22:04:38.276679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-27T22:04:38.276773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-27T22:04:38.276873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-27T22:04:38.276935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-27T22:04:38.276998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-27T22:04:38.277057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-27T22:04:38.277119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-27T22:04:38.277181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-27T22:04:38.277243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-27T22:04:38.277306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-27T22:04:38.277367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-27T22:04:38.277429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-27T22:04:38.277489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-27T22:04:38.277552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-27T22:04:38.277614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-27T22:04:38.277716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-27T22:04:38.277796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-27T22:04:38.277861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-27T22:04:38.277923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-27T22:04:38.277985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-27T22:04:38.278046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-27T22:04:38.278105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-27T22:04:38.278165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-27T22:04:38.278227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-27T22:04:38.278288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-27T22:04:38.278354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-27T22:04:38.278417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-27T22:04:38.278479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-27T22:04:38.278555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-27T22:04:38.278618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-27T22:04:38.278863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-27T22:04:38.278942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-27T22:04:38.279011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-27T22:04:38.279081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-27T22:04:38.279144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-27T22:04:38.279204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-27T22:04:38.279265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-27T22:04:38.279367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-27T22:04:38.279433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-27T22:04:38.279494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-27T22:04:38.279555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-27T22:04:38.279617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-27T22:04:38.279713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-27T22:04:38.279793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-27T22:04:38.279857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-27T22:04:38.279919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-27T22:04:38.279983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-27T22:04:38.280043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-27T22:04:38.280148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-27T22:04:38.280229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-27T22:04:38.280292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-27T22:04:38.280354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-27T22:04:38.280417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-27T22:04:38.280561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-27T22:04:38.280623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-27T22:04:38.280763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-27T22:04:38.280853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-27T22:04:38.280918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-27T22:04:38.280983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-27T22:04:38.281044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-27T22:04:38.281105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-27T22:04:38.281167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-27T22:04:38.281227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-27T22:04:38.281287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-27T22:04:38.281348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-27T22:04:38.281409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-27T22:04:38.281470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-27T22:04:38.281545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-27T22:04:38.281607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-27T22:04:38.281695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-27T22:04:38.281781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-27T22:04:38.281843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-27T22:04:38.281904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-27T22:04:38.281965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-27T22:04:38.282026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-27T22:04:38.282087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-27T22:04:38.282155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-27T22:04:38.282220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-27T22:04:38.282280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-27T22:04:38.282372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-27T22:04:38.282434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-27T22:04:38.282495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-27T22:04:38.282556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-27T22:04:38.282618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-27T22:04:38.282797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-27T22:04:38.282880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-27T22:04:38.282947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-27T22:04:38.283010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-27T22:04:38.283075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-27T22:04:38.283137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-27T22:04:38.283201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-27T22:04:38.283266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-27T22:04:38.283327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-27T22:04:38.283390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-27T22:04:38.283452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-27T22:04:38.283512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-27T22:04:38.283574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-27T22:04:38.283634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-27T22:04:38.283752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-27T22:04:38.283825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-27T22:04:38.283887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-27T22:04:38.283955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-27T22:04:38.284018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-27T22:04:38.284081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-27T22:04:38.284144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-27T22:04:38.284213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-27T22:04:38.284276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-27T22:04:38.284338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-27T22:04:38.284401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-27T22:04:38.284463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-27T22:04:38.284524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-27T22:04:38.284587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-27T22:04:38.284672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-27T22:04:38.284761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-27T22:04:38.284856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-27T22:04:38.284920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-27T22:04:38.284983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-27T22:04:38.285045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-27T22:04:38.285108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-27T22:04:38.285214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-27T22:04:38.285285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-27T22:04:38.285347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-27T22:04:38.285410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-27T22:04:38.285473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-27T22:04:38.285535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-27T22:04:38.285597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-27T22:04:38.285702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-27T22:04:38.285803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-27T22:04:38.285870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-27T22:04:38.285934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-27T22:04:38.285997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-27T22:04:38.286057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-27T22:04:38.286119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-27T22:04:38.286181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-27T22:04:38.286242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-27T22:04:38.286304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-27T22:04:38.286370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-27T22:04:38.286431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-27T22:04:38.286491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-27T22:04:38.286554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-27T22:04:38.286616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-27T22:04:38.286733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-27T22:04:38.286807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-27T22:04:38.286877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-27T22:04:38.286940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-27T22:04:38.287001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-27T22:04:38.287061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-27T22:04:38.287121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-27T22:04:38.287181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-27T22:04:38.287241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-27T22:04:38.287299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-27T22:04:38.287360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-27T22:04:38.287420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-27T22:04:38.287493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-27T22:04:38.287554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-27T22:04:38.287734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-27T22:04:38.287829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-27T22:04:38.287895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-27T22:04:38.287956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-27T22:04:38.288018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-27T22:04:38.288078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-27T22:04:38.288138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-27T22:04:38.288198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-27T22:04:38.288257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-27T22:04:38.288319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-27T22:04:38.288380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-27T22:04:38.288441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-27T22:04:38.288501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-27T22:04:38.288562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-27T22:04:38.288621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-27T22:04:38.288721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-27T22:04:38.288797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-27T22:04:38.288858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-27T22:04:38.288921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-27T22:04:38.288981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-27T22:04:38.289053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-27T22:04:38.289114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-27T22:04:38.289175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-27T22:04:38.289237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-27T22:04:38.289299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-27T22:04:38.289363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-27T22:04:38.289436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-27T22:04:38.289498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-27T22:04:38.289561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-27T22:04:38.289621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-27T22:04:38.289720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-27T22:04:38.289823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-27T22:04:38.289885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-27T22:04:38.289946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-27T22:04:38.290007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-27T22:04:38.290110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-27T22:04:38.290179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-27T22:04:38.290242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-27T22:04:38.290310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-27T22:04:38.290379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-10-27T22:04:38.290445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-27T22:04:38.290509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-27T22:04:38.290573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-27T22:04:38.290634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-27T22:04:38.290746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-27T22:04:38.290819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-27T22:04:38.290881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-27T22:04:38.290944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-27T22:04:38.291005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-27T22:04:38.291069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-27T22:04:38.291133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-27T22:04:38.291197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-27T22:04:38.291260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-27T22:04:38.291323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-27T22:04:38.291385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-27T22:04:38.291449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-27T22:04:38.291513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-27T22:04:38.291576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-27T22:04:38.291639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-27T22:04:38.291752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-27T22:04:38.291820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-27T22:04:38.291887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-27T22:04:38.291952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-27T22:04:38.292013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-27T22:04:38.292083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-27T22:04:38.292168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-27T22:04:38.292228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-27T22:04:38.292291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-27T22:04:38.292353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-27T22:04:38.292415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-27T22:04:38.292476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-27T22:04:38.292539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-27T22:04:38.292602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-27T22:04:38.292698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-27T22:04:38.292784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-27T22:04:38.292851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-27T22:04:38.292914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-27T22:04:38.292985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-27T22:04:38.293047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-27T22:04:38.293109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-27T22:04:38.293172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-27T22:04:38.293236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-27T22:04:38.293296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-27T22:04:38.293358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-27T22:04:38.293421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-27T22:04:38.293481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-27T22:04:38.293543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-27T22:04:38.293672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-27T22:04:38.293763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-27T22:04:38.293828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-27T22:04:38.293891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-27T22:04:38.293952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-27T22:04:38.294020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-27T22:04:38.294083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-27T22:04:38.294145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-27T22:04:38.294206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-27T22:04:38.294265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-27T22:04:38.294326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-27T22:04:38.294388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-27T22:04:38.294451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-27T22:04:38.294511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-27T22:04:38.294572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-27T22:04:38.294636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-27T22:04:38.294762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-27T22:04:38.294832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-27T22:04:38.294895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-27T22:04:38.295000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-27T22:04:38.295070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-27T22:04:38.295145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-27T22:04:38.295216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-27T22:04:38.295278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-27T22:04:38.295351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-27T22:04:38.295414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-27T22:04:38.295475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-27T22:04:38.295537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-27T22:04:38.295598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-27T22:04:38.295748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-27T22:04:38.295837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-27T22:04:38.295900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-27T22:04:38.295963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-27T22:04:38.296025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-27T22:04:38.296089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-27T22:04:38.296150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-27T22:04:38.296211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-27T22:04:38.296272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-27T22:04:38.296332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-27T22:04:38.296392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-27T22:04:38.296451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-27T22:04:38.296512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-27T22:04:38.296572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-27T22:04:38.296666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-27T22:04:38.296759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-27T22:04:38.296825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-27T22:04:38.296928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-27T22:04:38.296990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-27T22:04:38.297050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-27T22:04:38.297108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-27T22:04:38.297167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-27T22:04:38.297228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-27T22:04:38.297287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-27T22:04:38.297351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-27T22:04:38.297445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-27T22:04:38.297524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-27T22:04:38.297587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-27T22:04:38.297696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-27T22:04:38.297784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-27T22:04:38.297848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-27T22:04:38.297909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-27T22:04:38.297970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-27T22:04:38.298032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-27T22:04:38.298091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-27T22:04:38.298152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-27T22:04:38.298213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-27T22:04:38.298279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-27T22:04:38.298343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-27T22:04:38.298405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-27T22:04:38.298471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-27T22:04:38.298534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-27T22:04:38.298594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-27T22:04:38.298685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-27T22:04:38.298775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-27T22:04:38.298842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-27T22:04:38.298907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-27T22:04:38.298968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-27T22:04:38.299031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-27T22:04:38.299092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-27T22:04:38.299155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-27T22:04:38.299218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-27T22:04:38.299286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-27T22:04:38.299347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-27T22:04:38.299410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-27T22:04:38.299471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-27T22:04:38.299533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-27T22:04:38.299596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-27T22:04:38.299762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-27T22:04:38.299852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-27T22:04:38.299916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-27T22:04:38.300022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-27T22:04:38.300095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-27T22:04:38.300165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-27T22:04:38.300229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-27T22:04:38.300292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-27T22:04:38.300373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-27T22:04:38.300436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-27T22:04:38.300510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-27T22:04:38.300574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-27T22:04:38.300635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-27T22:04:38.300747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-27T22:04:38.300815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-27T22:04:38.300879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-10-27T22:04:38.300942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-27T22:04:38.301004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-27T22:04:38.301069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-27T22:04:38.301131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-27T22:04:38.301198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-27T22:04:38.301272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-27T22:04:38.301335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-27T22:04:38.301397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-27T22:04:38.301458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-27T22:04:38.301519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-27T22:04:38.301580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-27T22:04:38.301659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-27T22:04:38.301753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-27T22:04:38.301819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-27T22:04:38.301921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-27T22:04:38.301984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-27T22:04:38.302047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-27T22:04:38.302109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-27T22:04:38.302169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-27T22:04:38.302231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-27T22:04:38.302294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-27T22:04:38.302354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-27T22:04:38.302414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-27T22:04:38.302476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-27T22:04:38.302536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-27T22:04:38.302611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-27T22:04:38.302715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-27T22:04:38.302805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-27T22:04:38.302877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-27T22:04:38.302938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-27T22:04:38.303000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-27T22:04:38.303061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-27T22:04:38.303127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-27T22:04:38.303189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-27T22:04:38.303249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-27T22:04:38.303308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-27T22:04:38.303368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-27T22:04:38.303429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-27T22:04:38.303489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-27T22:04:38.303549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-27T22:04:38.303608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-27T22:04:38.303698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-27T22:04:38.303781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-27T22:04:38.303845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-27T22:04:38.303920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-27T22:04:38.303984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-27T22:04:38.304045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-27T22:04:38.304105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-27T22:04:38.304165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-27T22:04:38.304225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-27T22:04:38.304285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-27T22:04:38.304346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-27T22:04:38.304407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-27T22:04:38.304468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-27T22:04:38.304526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-27T22:04:38.304584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-27T22:04:38.304673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-27T22:04:38.304758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-27T22:04:38.304862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-27T22:04:38.304933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-27T22:04:38.304997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-27T22:04:38.305058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-27T22:04:38.305149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-27T22:04:38.305212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-27T22:04:38.305271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-27T22:04:38.305339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-27T22:04:38.305401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-27T22:04:38.305461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-27T22:04:38.305521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-27T22:04:38.305583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-27T22:04:38.305682] [INFO ] [LOCAL ] Deleted 1881 derivative data files. [2025-10-27T22:04:38.305738] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-27T22:04:38.307634] [INFO ] [LOCAL ] Found 1881 symbols with primary data. [2025-10-27T22:04:38.308104] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1881 symbols [2025-10-27T22:04:38.308809] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:38.309017] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:38.309471] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:38.348503] [DEBUG] [LOCAL ] AAMI: Loaded 23916 existing records from primary storage. [2025-10-27T22:04:38.348724] [INFO ] [MAIN ] AAMI: Loaded 23916 primary data records. [2025-10-27T22:04:38.487691] [DEBUG] [LOCAL ] A: Loaded 50510 existing records from primary storage. [2025-10-27T22:04:38.498429] [INFO ] [MAIN ] A: Loaded 50510 primary data records. [2025-10-27T22:04:38.777685] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-27T22:04:38.777872] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-27T22:04:39.398485] [DEBUG] [MAIN ] AAMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:39.433493] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:39.480343] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:39.523881] [INFO ] [MAIN ] AAMI: Generated 138 derivative records from 23916 primary records. [2025-10-27T22:04:39.524156] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-27T22:04:39.544418] [DEBUG] [LOCAL ] AAMI: Derivative data saved (138 records). [2025-10-27T22:04:39.544580] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-10-27T22:04:39.546433] [INFO ] [MAIN ] Derivative Progress: 1/1881 symbols completed. AAMI took 1.2s. Estimated remaining: 38m 49s. Rate: 48.4 symbols/min [2025-10-27T22:04:39.546926] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:39.553044] [INFO ] [MAIN ] A: Generated 138 derivative records from 50510 primary records. [2025-10-27T22:04:39.554330] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-27T22:04:39.570760] [DEBUG] [LOCAL ] A: Derivative data saved (138 records). [2025-10-27T22:04:39.571044] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-27T22:04:39.574982] [INFO ] [MAIN ] Derivative Progress: 2/1881 symbols completed. A took 1.3s. Estimated remaining: 19m 50s. Rate: 94.7 symbols/min [2025-10-27T22:04:39.575355] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:39.588760] [INFO ] [MAIN ] AA: Generated 138 derivative records from 53622 primary records. [2025-10-27T22:04:39.588989] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-27T22:04:39.612419] [DEBUG] [LOCAL ] AA: Derivative data saved (138 records). [2025-10-27T22:04:39.612756] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-27T22:04:39.613197] [DEBUG] [LOCAL ] AAT: Loaded 29917 existing records from primary storage. [2025-10-27T22:04:39.619164] [INFO ] [MAIN ] AAT: Loaded 29917 primary data records. [2025-10-27T22:04:39.621898] [INFO ] [MAIN ] Derivative Progress: 3/1881 symbols completed. AA took 1.3s. Estimated remaining: 13m 43s. Rate: 137.0 symbols/min [2025-10-27T22:04:39.622177] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:39.711087] [DEBUG] [LOCAL ] AB: Loaded 24063 existing records from primary storage. [2025-10-27T22:04:39.721801] [INFO ] [MAIN ] AB: Loaded 24063 primary data records. [2025-10-27T22:04:40.274558] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-27T22:04:40.275142] [INFO ] [MAIN ] ABBV: Loaded 53674 primary data records. [2025-10-27T22:04:40.595834] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:40.636869] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:40.683137] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:40.711688] [INFO ] [MAIN ] AAT: Generated 138 derivative records from 29917 primary records. [2025-10-27T22:04:40.713181] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-27T22:04:40.734487] [DEBUG] [LOCAL ] AAT: Derivative data saved (138 records). [2025-10-27T22:04:40.736248] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-27T22:04:40.738500] [INFO ] [MAIN ] Derivative Progress: 4/1881 symbols completed. AAT took 1.2s. Estimated remaining: 19m 1s. Rate: 98.7 symbols/min [2025-10-27T22:04:40.741714] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:40.744619] [INFO ] [MAIN ] AB: Generated 138 derivative records from 24063 primary records. [2025-10-27T22:04:40.745926] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-27T22:04:40.761919] [DEBUG] [LOCAL ] AB: Derivative data saved (138 records). [2025-10-27T22:04:40.762019] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-27T22:04:40.764137] [INFO ] [MAIN ] Derivative Progress: 5/1881 symbols completed. AB took 1.2s. Estimated remaining: 15m 22s. Rate: 122.1 symbols/min [2025-10-27T22:04:40.765835] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:40.781950] [INFO ] [MAIN ] ABBV: Generated 138 derivative records from 53674 primary records. [2025-10-27T22:04:40.782209] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-27T22:04:40.804053] [DEBUG] [LOCAL ] ABBV: Derivative data saved (138 records). [2025-10-27T22:04:40.804280] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-27T22:04:40.807117] [DEBUG] [LOCAL ] ABCB: Loaded 30102 existing records from primary storage. [2025-10-27T22:04:40.806585] [INFO ] [MAIN ] Derivative Progress: 6/1881 symbols completed. ABBV took 1.2s. Estimated remaining: 13m 1s. Rate: 144.1 symbols/min [2025-10-27T22:04:40.807358] [INFO ] [MAIN ] ABCB: Loaded 30102 primary data records. [2025-10-27T22:04:40.807712] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:41.016249] [DEBUG] [LOCAL ] ABG: Loaded 17425 existing records from primary storage. [2025-10-27T22:04:41.016490] [INFO ] [MAIN ] ABG: Loaded 17425 primary data records. [2025-10-27T22:04:41.266826] [DEBUG] [LOCAL ] ABEV: Loaded 53283 existing records from primary storage. [2025-10-27T22:04:41.270596] [INFO ] [MAIN ] ABEV: Loaded 53283 primary data records. [2025-10-27T22:04:41.791401] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:41.831210] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:41.859238] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:41.904249] [INFO ] [MAIN ] ABCB: Generated 138 derivative records from 30102 primary records. [2025-10-27T22:04:41.906120] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-27T22:04:41.926613] [DEBUG] [LOCAL ] ABCB: Derivative data saved (138 records). [2025-10-27T22:04:41.927513] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-27T22:04:41.929350] [INFO ] [MAIN ] Derivative Progress: 7/1881 symbols completed. ABCB took 1.2s. Estimated remaining: 16m 10s. Rate: 116.0 symbols/min [2025-10-27T22:04:41.929570] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:41.950023] [INFO ] [MAIN ] ABG: Generated 138 derivative records from 17425 primary records. [2025-10-27T22:04:41.950358] [INFO ] [MAIN ] ABEV: Generated 138 derivative records from 53283 primary records. [2025-10-27T22:04:41.958966] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-27T22:04:41.959055] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-27T22:04:41.982297] [DEBUG] [LOCAL ] ABG: Derivative data saved (138 records). [2025-10-27T22:04:41.994617] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-27T22:04:41.993617] [DEBUG] [LOCAL ] ABEV: Derivative data saved (138 records). [2025-10-27T22:04:41.994931] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-27T22:04:41.997829] [INFO ] [MAIN ] Derivative Progress: 8/1881 symbols completed. ABEV took 1.2s. Estimated remaining: 14m 24s. Rate: 130.1 symbols/min [2025-10-27T22:04:41.998753] [DEBUG] [LOCAL ] ABM: Loaded 31780 existing records from primary storage. [2025-10-27T22:04:41.999003] [INFO ] [MAIN ] ABM: Loaded 31780 primary data records. [2025-10-27T22:04:41.998916] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:42.002016] [INFO ] [MAIN ] Derivative Progress: 9/1881 symbols completed. ABG took 1.2s. Estimated remaining: 12m 48s. Rate: 146.2 symbols/min [2025-10-27T22:04:42.023326] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:42.332348] [DEBUG] [LOCAL ] ACA: Loaded 22078 existing records from primary storage. [2025-10-27T22:04:42.333849] [INFO ] [MAIN ] ACA: Loaded 22078 primary data records. [2025-10-27T22:04:42.366973] [DEBUG] [LOCAL ] ACCO: Loaded 36287 existing records from primary storage. [2025-10-27T22:04:42.400366] [INFO ] [MAIN ] ACCO: Loaded 36287 primary data records. [2025-10-27T22:04:43.053809] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:43.111762] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:43.149178] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:43.169128] [INFO ] [MAIN ] ABM: Generated 138 derivative records from 31780 primary records. [2025-10-27T22:04:43.174423] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-27T22:04:43.189526] [DEBUG] [LOCAL ] ABM: Derivative data saved (138 records). [2025-10-27T22:04:43.192978] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-27T22:04:43.195387] [INFO ] [MAIN ] Derivative Progress: 10/1881 symbols completed. ABM took 1.3s. Estimated remaining: 15m 14s. Rate: 122.8 symbols/min [2025-10-27T22:04:43.200146] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:43.250338] [INFO ] [MAIN ] ACA: Generated 138 derivative records from 22078 primary records. [2025-10-27T22:04:43.252817] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-27T22:04:43.249856] [DEBUG] [LOCAL ] ACEL: Loaded 25768 existing records from primary storage. [2025-10-27T22:04:43.253347] [INFO ] [MAIN ] ACEL: Loaded 25768 primary data records. [2025-10-27T22:04:43.253119] [INFO ] [MAIN ] ACCO: Generated 138 derivative records from 36287 primary records. [2025-10-27T22:04:43.272856] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-27T22:04:43.310320] [DEBUG] [LOCAL ] ACA: Derivative data saved (138 records). [2025-10-27T22:04:43.345382] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-27T22:04:43.361840] [INFO ] [MAIN ] Derivative Progress: 11/1881 symbols completed. ACA took 1.4s. Estimated remaining: 14m 19s. Rate: 130.6 symbols/min [2025-10-27T22:04:43.367202] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:43.359804] [DEBUG] [LOCAL ] ACCO: Derivative data saved (138 records). [2025-10-27T22:04:43.383846] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-27T22:04:43.397420] [INFO ] [MAIN ] Derivative Progress: 12/1881 symbols completed. ACCO took 1.4s. Estimated remaining: 13m 13s. Rate: 141.5 symbols/min [2025-10-27T22:04:43.403141] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:43.635954] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-27T22:04:43.649013] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-27T22:04:43.649488] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:43.762109] [DEBUG] [LOCAL ] ACI: Loaded 53285 existing records from primary storage. [2025-10-27T22:04:43.774121] [INFO ] [MAIN ] ACI: Loaded 53285 primary data records. [2025-10-27T22:04:44.317299] [INFO ] [MAIN ] ACEL: Generated 138 derivative records from 25768 primary records. [2025-10-27T22:04:44.320251] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-27T22:04:44.334739] [DEBUG] [LOCAL ] ACEL: Derivative data saved (138 records). [2025-10-27T22:04:44.347505] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-27T22:04:44.349870] [INFO ] [MAIN ] Derivative Progress: 13/1881 symbols completed. ACEL took 1.1s. Estimated remaining: 14m 28s. Rate: 129.1 symbols/min [2025-10-27T22:04:44.350353] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:44.383727] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:44.422810] [INFO ] [MAIN ] ACHR: Generated 138 derivative records from 53818 primary records. [2025-10-27T22:04:44.424084] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-27T22:04:44.439899] [INFO ] [MAIN ] ACI: Generated 138 derivative records from 53285 primary records. [2025-10-27T22:04:44.441481] [DEBUG] [LOCAL ] ACHR: Derivative data saved (138 records). [2025-10-27T22:04:44.441548] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-27T22:04:44.442055] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-27T22:04:44.444532] [INFO ] [MAIN ] Derivative Progress: 14/1881 symbols completed. ACHR took 1.1s. Estimated remaining: 13m 38s. Rate: 136.9 symbols/min [2025-10-27T22:04:44.456116] [DEBUG] [LOCAL ] ACI: Derivative data saved (138 records). [2025-10-27T22:04:44.456175] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-27T22:04:44.462358] [INFO ] [MAIN ] Derivative Progress: 15/1881 symbols completed. ACI took 1.1s. Estimated remaining: 12m 46s. Rate: 146.2 symbols/min [2025-10-27T22:04:44.463197] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:44.463413] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:44.463524] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:44.475890] [DEBUG] [LOCAL ] ACV: Loaded 7257 existing records from primary storage. [2025-10-27T22:04:44.476274] [INFO ] [MAIN ] ACV: Loaded 7257 primary data records. [2025-10-27T22:04:44.605688] [DEBUG] [LOCAL ] ACRE: Loaded 32703 existing records from primary storage. [2025-10-27T22:04:44.628523] [INFO ] [MAIN ] ACRE: Loaded 32703 primary data records. [2025-10-27T22:04:44.808458] [DEBUG] [LOCAL ] ACN: Loaded 53433 existing records from primary storage. [2025-10-27T22:04:44.938215] [INFO ] [MAIN ] ACN: Loaded 53433 primary data records. [2025-10-27T22:04:45.510699] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:45.565910] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:45.566531] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:45.626099] [INFO ] [MAIN ] ACV: Generated 138 derivative records from 7257 primary records. [2025-10-27T22:04:45.628929] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-27T22:04:45.647774] [DEBUG] [LOCAL ] ACV: Derivative data saved (138 records). [2025-10-27T22:04:45.648391] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-27T22:04:45.653350] [INFO ] [MAIN ] Derivative Progress: 16/1881 symbols completed. ACV took 1.2s. Estimated remaining: 14m 16s. Rate: 130.7 symbols/min [2025-10-27T22:04:45.655366] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:45.662272] [INFO ] [MAIN ] ACN: Generated 138 derivative records from 53433 primary records. [2025-10-27T22:04:45.663439] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-27T22:04:45.675343] [INFO ] [MAIN ] ACRE: Generated 138 derivative records from 32703 primary records. [2025-10-27T22:04:45.678309] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-27T22:04:45.678141] [DEBUG] [LOCAL ] ACN: Derivative data saved (138 records). [2025-10-27T22:04:45.678976] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-27T22:04:45.682002] [INFO ] [MAIN ] Derivative Progress: 17/1881 symbols completed. ACN took 1.2s. Estimated remaining: 13m 29s. Rate: 138.3 symbols/min [2025-10-27T22:04:45.690627] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:45.693995] [DEBUG] [LOCAL ] ACRE: Derivative data saved (138 records). [2025-10-27T22:04:45.694078] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-27T22:04:45.697156] [INFO ] [MAIN ] Derivative Progress: 18/1881 symbols completed. ACRE took 1.2s. Estimated remaining: 12m 45s. Rate: 146.2 symbols/min [2025-10-27T22:04:45.697623] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:45.766158] [DEBUG] [LOCAL ] ACVA: Loaded 49125 existing records from primary storage. [2025-10-27T22:04:45.779809] [DEBUG] [LOCAL ] ADCT: Loaded 35566 existing records from primary storage. [2025-10-27T22:04:45.779190] [INFO ] [MAIN ] ACVA: Loaded 49125 primary data records. [2025-10-27T22:04:45.780370] [INFO ] [MAIN ] ADCT: Loaded 35566 primary data records. [2025-10-27T22:04:45.813393] [DEBUG] [LOCAL ] ADC: Loaded 46272 existing records from primary storage. [2025-10-27T22:04:45.830348] [INFO ] [MAIN ] ADC: Loaded 46272 primary data records. [2025-10-27T22:04:46.744204] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:04:46.776586] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:46.805272] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:46.877033] [INFO ] [MAIN ] ACVA: Generated 138 derivative records from 49125 primary records. [2025-10-27T22:04:46.879140] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-27T22:04:46.897520] [DEBUG] [LOCAL ] ACVA: Derivative data saved (138 records). [2025-10-27T22:04:46.899677] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-27T22:04:46.902694] [INFO ] [MAIN ] Derivative Progress: 19/1881 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 2s. Rate: 132.6 symbols/min [2025-10-27T22:04:46.907488] [INFO ] [MAIN ] ADCT: Generated 138 derivative records from 35566 primary records. [2025-10-27T22:04:46.907313] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:46.905677] [INFO ] [MAIN ] ADC: Generated 138 derivative records from 46272 primary records. [2025-10-27T22:04:46.908278] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-27T22:04:46.908204] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-27T22:04:46.931515] [DEBUG] [LOCAL ] ADCT: Derivative data saved (138 records). [2025-10-27T22:04:46.933033] [DEBUG] [LOCAL ] ADC: Derivative data saved (138 records). [2025-10-27T22:04:46.931697] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-27T22:04:46.933149] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-27T22:04:46.935049] [INFO ] [MAIN ] Derivative Progress: 20/1881 symbols completed. ADCT took 1.2s. Estimated remaining: 13m 23s. Rate: 139.1 symbols/min [2025-10-27T22:04:46.937693] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:46.937883] [INFO ] [MAIN ] Derivative Progress: 21/1881 symbols completed. ADC took 1.2s. Estimated remaining: 12m 44s. Rate: 146.0 symbols/min [2025-10-27T22:04:46.938278] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:46.991027] [DEBUG] [LOCAL ] ADX: Loaded 27465 existing records from primary storage. [2025-10-27T22:04:46.991270] [INFO ] [MAIN ] ADX: Loaded 27465 primary data records. [2025-10-27T22:04:47.060243] [DEBUG] [LOCAL ] ADM: Loaded 53387 existing records from primary storage. [2025-10-27T22:04:47.095799] [INFO ] [MAIN ] ADM: Loaded 53387 primary data records. [2025-10-27T22:04:47.242291] [DEBUG] [LOCAL ] ADT: Loaded 53432 existing records from primary storage. [2025-10-27T22:04:47.256161] [INFO ] [MAIN ] ADT: Loaded 53432 primary data records. [2025-10-27T22:04:47.976571] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:48.017718] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:48.053086] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:48.086049] [INFO ] [MAIN ] ADX: Generated 138 derivative records from 27465 primary records. [2025-10-27T22:04:48.091269] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-27T22:04:48.107152] [DEBUG] [LOCAL ] ADX: Derivative data saved (138 records). [2025-10-27T22:04:48.107670] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-27T22:04:48.111579] [INFO ] [MAIN ] Derivative Progress: 22/1881 symbols completed. ADX took 1.2s. Estimated remaining: 13m 48s. Rate: 134.6 symbols/min [2025-10-27T22:04:48.114694] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:48.118367] [INFO ] [MAIN ] ADM: Generated 138 derivative records from 53387 primary records. [2025-10-27T22:04:48.119040] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-27T22:04:48.136268] [DEBUG] [LOCAL ] ADM: Derivative data saved (138 records). [2025-10-27T22:04:48.136581] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-27T22:04:48.139510] [INFO ] [MAIN ] Derivative Progress: 23/1881 symbols completed. ADM took 1.2s. Estimated remaining: 13m 14s. Rate: 140.4 symbols/min [2025-10-27T22:04:48.139975] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:48.146222] [INFO ] [MAIN ] ADT: Generated 138 derivative records from 53432 primary records. [2025-10-27T22:04:48.146377] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-27T22:04:48.158633] [DEBUG] [LOCAL ] ADT: Derivative data saved (138 records). [2025-10-27T22:04:48.158768] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-27T22:04:48.161588] [INFO ] [MAIN ] Derivative Progress: 24/1881 symbols completed. ADT took 1.2s. Estimated remaining: 12m 42s. Rate: 146.1 symbols/min [2025-10-27T22:04:48.172419] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:48.201796] [DEBUG] [LOCAL ] AEE: Loaded 49892 existing records from primary storage. [2025-10-27T22:04:48.201995] [INFO ] [MAIN ] AEE: Loaded 49892 primary data records. [2025-10-27T22:04:48.311276] [DEBUG] [LOCAL ] AEG: Loaded 49423 existing records from primary storage. [2025-10-27T22:04:48.333019] [INFO ] [MAIN ] AEG: Loaded 49423 primary data records. [2025-10-27T22:04:48.670413] [DEBUG] [LOCAL ] AEM: Loaded 53473 existing records from primary storage. [2025-10-27T22:04:48.683215] [INFO ] [MAIN ] AEM: Loaded 53473 primary data records. [2025-10-27T22:04:49.251325] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:49.299204] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:49.358837] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:49.396231] [INFO ] [MAIN ] AEE: Generated 138 derivative records from 49892 primary records. [2025-10-27T22:04:49.397113] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-27T22:04:49.419257] [DEBUG] [LOCAL ] AEE: Derivative data saved (138 records). [2025-10-27T22:04:49.416001] [INFO ] [MAIN ] AEG: Generated 138 derivative records from 49423 primary records. [2025-10-27T22:04:49.420837] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-27T22:04:49.420984] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-27T22:04:49.423450] [INFO ] [MAIN ] Derivative Progress: 25/1881 symbols completed. AEE took 1.3s. Estimated remaining: 13m 45s. Rate: 134.9 symbols/min [2025-10-27T22:04:49.424610] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:49.441538] [DEBUG] [LOCAL ] AEG: Derivative data saved (138 records). [2025-10-27T22:04:49.443325] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-27T22:04:49.448264] [INFO ] [MAIN ] Derivative Progress: 26/1881 symbols completed. AEG took 1.3s. Estimated remaining: 13m 15s. Rate: 140.0 symbols/min [2025-10-27T22:04:49.448488] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:49.459316] [INFO ] [MAIN ] AEM: Generated 138 derivative records from 53473 primary records. [2025-10-27T22:04:49.459438] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-27T22:04:49.472868] [DEBUG] [LOCAL ] AEM: Derivative data saved (138 records). [2025-10-27T22:04:49.473030] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-27T22:04:49.476389] [INFO ] [MAIN ] Derivative Progress: 27/1881 symbols completed. AEM took 1.3s. Estimated remaining: 12m 47s. Rate: 145.1 symbols/min [2025-10-27T22:04:49.476688] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:49.527800] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-27T22:04:49.528203] [INFO ] [MAIN ] AEO: Loaded 53563 primary data records. [2025-10-27T22:04:49.641697] [DEBUG] [LOCAL ] AER: Loaded 47685 existing records from primary storage. [2025-10-27T22:04:49.654193] [INFO ] [MAIN ] AER: Loaded 47685 primary data records. [2025-10-27T22:04:49.880355] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-27T22:04:49.998916] [INFO ] [MAIN ] AES: Loaded 53663 primary data records. [2025-10-27T22:04:50.557439] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:50.583663] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:50.627544] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:50.707096] [INFO ] [MAIN ] AEO: Generated 138 derivative records from 53563 primary records. [2025-10-27T22:04:50.711067] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-27T22:04:50.711305] [INFO ] [MAIN ] AES: Generated 138 derivative records from 53663 primary records. [2025-10-27T22:04:50.720462] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-27T22:04:50.723929] [INFO ] [MAIN ] AER: Generated 138 derivative records from 47685 primary records. [2025-10-27T22:04:50.737224] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-27T22:04:50.737456] [DEBUG] [LOCAL ] AEO: Derivative data saved (138 records). [2025-10-27T22:04:50.742229] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-27T22:04:50.743393] [DEBUG] [LOCAL ] AES: Derivative data saved (138 records). [2025-10-27T22:04:50.743909] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-27T22:04:50.754573] [INFO ] [MAIN ] Derivative Progress: 28/1881 symbols completed. AES took 1.3s. Estimated remaining: 13m 44s. Rate: 135.0 symbols/min [2025-10-27T22:04:50.761579] [INFO ] [MAIN ] Derivative Progress: 29/1881 symbols completed. AEO took 1.3s. Estimated remaining: 13m 15s. Rate: 139.7 symbols/min [2025-10-27T22:04:50.763539] [DEBUG] [LOCAL ] AER: Derivative data saved (138 records). [2025-10-27T22:04:50.763889] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-27T22:04:50.766218] [INFO ] [MAIN ] Derivative Progress: 30/1881 symbols completed. AER took 1.3s. Estimated remaining: 12m 49s. Rate: 144.5 symbols/min [2025-10-27T22:04:50.766831] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:50.767138] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:50.766937] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:50.787218] [DEBUG] [LOCAL ] AFB: Loaded 10957 existing records from primary storage. [2025-10-27T22:04:50.787438] [INFO ] [MAIN ] AFB: Loaded 10957 primary data records. [2025-10-27T22:04:51.035149] [DEBUG] [LOCAL ] AESI: Loaded 49777 existing records from primary storage. [2025-10-27T22:04:51.027189] [DEBUG] [LOCAL ] AFG: Loaded 31571 existing records from primary storage. [2025-10-27T22:04:51.035788] [INFO ] [MAIN ] AESI: Loaded 49777 primary data records. [2025-10-27T22:04:51.035955] [INFO ] [MAIN ] AFG: Loaded 31571 primary data records. [2025-10-27T22:04:51.839857] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:51.876246] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:51.913956] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:51.985209] [INFO ] [MAIN ] AFB: Generated 138 derivative records from 10957 primary records. [2025-10-27T22:04:51.989419] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-27T22:04:52.008291] [DEBUG] [LOCAL ] AFB: Derivative data saved (138 records). [2025-10-27T22:04:52.008495] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-27T22:04:52.013090] [INFO ] [MAIN ] Derivative Progress: 31/1881 symbols completed. AFB took 1.2s. Estimated remaining: 13m 38s. Rate: 135.7 symbols/min [2025-10-27T22:04:52.013508] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:52.021578] [INFO ] [MAIN ] AESI: Generated 138 derivative records from 49777 primary records. [2025-10-27T22:04:52.024333] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-27T22:04:52.039129] [DEBUG] [LOCAL ] AFGC: Loaded 2550 existing records from primary storage. [2025-10-27T22:04:52.039745] [INFO ] [MAIN ] AFGC: Loaded 2550 primary data records. [2025-10-27T22:04:52.050687] [DEBUG] [LOCAL ] AESI: Derivative data saved (138 records). [2025-10-27T22:04:52.042047] [INFO ] [MAIN ] AFG: Generated 138 derivative records from 31571 primary records. [2025-10-27T22:04:52.111104] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-27T22:04:52.089944] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-27T22:04:52.150474] [INFO ] [MAIN ] Derivative Progress: 32/1881 symbols completed. AESI took 1.4s. Estimated remaining: 13m 20s. Rate: 138.7 symbols/min [2025-10-27T22:04:52.161927] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:52.167292] [DEBUG] [LOCAL ] AFG: Derivative data saved (138 records). [2025-10-27T22:04:52.167477] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-27T22:04:52.170470] [INFO ] [MAIN ] Derivative Progress: 33/1881 symbols completed. AFG took 1.4s. Estimated remaining: 12m 56s. Rate: 142.8 symbols/min [2025-10-27T22:04:52.192208] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:52.222437] [DEBUG] [LOCAL ] AFGE: Loaded 2214 existing records from primary storage. [2025-10-27T22:04:52.253800] [INFO ] [MAIN ] AFGE: Loaded 2214 primary data records. [2025-10-27T22:04:52.734097] [DEBUG] [LOCAL ] AFL: Loaded 53160 existing records from primary storage. [2025-10-27T22:04:52.734451] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:04:52.734952] [INFO ] [MAIN ] AFL: Loaded 53160 primary data records. [2025-10-27T22:04:53.072920] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:53.133146] [INFO ] [MAIN ] AFGC: Generated 138 derivative records from 2550 primary records. [2025-10-27T22:04:53.140387] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-27T22:04:53.168565] [DEBUG] [LOCAL ] AFGC: Derivative data saved (138 records). [2025-10-27T22:04:53.173229] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-27T22:04:53.175883] [INFO ] [MAIN ] Derivative Progress: 34/1881 symbols completed. AFGC took 1.2s. Estimated remaining: 13m 28s. Rate: 137.2 symbols/min [2025-10-27T22:04:53.177218] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:53.176275] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:53.203942] [INFO ] [MAIN ] AFGE: Generated 138 derivative records from 2214 primary records. [2025-10-27T22:04:53.205561] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-27T22:04:53.220498] [DEBUG] [LOCAL ] AFGE: Derivative data saved (138 records). [2025-10-27T22:04:53.220620] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-27T22:04:53.224816] [INFO ] [MAIN ] Derivative Progress: 35/1881 symbols completed. AFGE took 1.1s. Estimated remaining: 13m 7s. Rate: 140.8 symbols/min [2025-10-27T22:04:53.225044] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:53.249327] [INFO ] [MAIN ] AFL: Generated 138 derivative records from 53160 primary records. [2025-10-27T22:04:53.249436] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-27T22:04:53.262589] [DEBUG] [LOCAL ] AFL: Derivative data saved (138 records). [2025-10-27T22:04:53.276373] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-27T22:04:53.279479] [INFO ] [MAIN ] Derivative Progress: 36/1881 symbols completed. AFL took 1.1s. Estimated remaining: 12m 47s. Rate: 144.3 symbols/min [2025-10-27T22:04:53.279850] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:53.280976] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-27T22:04:53.281476] [INFO ] [MAIN ] AG: Loaded 53643 primary data records. [2025-10-27T22:04:53.467969] [DEBUG] [LOCAL ] AGD: Loaded 19100 existing records from primary storage. [2025-10-27T22:04:53.501202] [INFO ] [MAIN ] AGD: Loaded 19100 primary data records. [2025-10-27T22:04:53.624174] [DEBUG] [LOCAL ] AGCO: Loaded 41854 existing records from primary storage. [2025-10-27T22:04:53.651490] [INFO ] [MAIN ] AGCO: Loaded 41854 primary data records. [2025-10-27T22:04:54.318948] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:54.374195] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:54.393423] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:54.449076] [INFO ] [MAIN ] AG: Generated 138 derivative records from 53643 primary records. [2025-10-27T22:04:54.449629] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-27T22:04:54.469178] [DEBUG] [LOCAL ] AG: Derivative data saved (138 records). [2025-10-27T22:04:54.469899] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-27T22:04:54.472035] [INFO ] [MAIN ] Derivative Progress: 37/1881 symbols completed. AG took 1.3s. Estimated remaining: 13m 26s. Rate: 137.3 symbols/min [2025-10-27T22:04:54.472245] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:54.489621] [INFO ] [MAIN ] AGD: Generated 138 derivative records from 19100 primary records. [2025-10-27T22:04:54.490104] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-27T22:04:54.499242] [DEBUG] [LOCAL ] AGM: Loaded 10480 existing records from primary storage. [2025-10-27T22:04:54.510533] [INFO ] [MAIN ] AGM: Loaded 10480 primary data records. [2025-10-27T22:04:54.513700] [INFO ] [MAIN ] AGCO: Generated 138 derivative records from 41854 primary records. [2025-10-27T22:04:54.511502] [DEBUG] [LOCAL ] AGD: Derivative data saved (138 records). [2025-10-27T22:04:54.535831] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-27T22:04:54.535932] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-27T22:04:54.576400] [INFO ] [MAIN ] Derivative Progress: 38/1881 symbols completed. AGD took 1.3s. Estimated remaining: 13m 9s. Rate: 140.1 symbols/min [2025-10-27T22:04:54.598607] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:54.652535] [DEBUG] [LOCAL ] AGCO: Derivative data saved (138 records). [2025-10-27T22:04:54.683102] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-27T22:04:54.706721] [INFO ] [MAIN ] Derivative Progress: 39/1881 symbols completed. AGCO took 1.5s. Estimated remaining: 12m 55s. Rate: 142.7 symbols/min [2025-10-27T22:04:54.728036] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:54.872820] [DEBUG] [LOCAL ] AGO: Loaded 27300 existing records from primary storage. [2025-10-27T22:04:54.873273] [INFO ] [MAIN ] AGO: Loaded 27300 primary data records. [2025-10-27T22:04:55.016458] [DEBUG] [LOCAL ] AGRO: Loaded 32070 existing records from primary storage. [2025-10-27T22:04:55.027363] [INFO ] [MAIN ] AGRO: Loaded 32070 primary data records. [2025-10-27T22:04:55.506975] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:55.552468] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:55.584793] [INFO ] [MAIN ] AGM: Generated 138 derivative records from 10480 primary records. [2025-10-27T22:04:55.599933] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:55.599676] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-27T22:04:55.630073] [DEBUG] [LOCAL ] AGM: Derivative data saved (138 records). [2025-10-27T22:04:55.630206] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-27T22:04:55.632510] [INFO ] [MAIN ] Derivative Progress: 40/1881 symbols completed. AGM took 1.2s. Estimated remaining: 13m 17s. Rate: 138.5 symbols/min [2025-10-27T22:04:55.634040] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:55.647798] [INFO ] [MAIN ] AGO: Generated 138 derivative records from 27300 primary records. [2025-10-27T22:04:55.648017] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-27T22:04:55.674833] [DEBUG] [LOCAL ] AGO: Derivative data saved (138 records). [2025-10-27T22:04:55.677908] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-27T22:04:55.679938] [INFO ] [MAIN ] Derivative Progress: 41/1881 symbols completed. AGO took 1.1s. Estimated remaining: 12m 60s. Rate: 141.6 symbols/min [2025-10-27T22:04:55.680112] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:55.684701] [INFO ] [MAIN ] AGRO: Generated 138 derivative records from 32070 primary records. [2025-10-27T22:04:55.687116] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-27T22:04:55.712080] [DEBUG] [LOCAL ] AHT: Loaded 6347 existing records from primary storage. [2025-10-27T22:04:55.714351] [DEBUG] [LOCAL ] AHH: Loaded 39774 existing records from primary storage. [2025-10-27T22:04:55.714452] [DEBUG] [LOCAL ] AGRO: Derivative data saved (138 records). [2025-10-27T22:04:55.714551] [INFO ] [MAIN ] AHH: Loaded 39774 primary data records. [2025-10-27T22:04:55.714668] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-27T22:04:55.716884] [INFO ] [MAIN ] Derivative Progress: 42/1881 symbols completed. AGRO took 1.0s. Estimated remaining: 12m 42s. Rate: 144.8 symbols/min [2025-10-27T22:04:55.714740] [INFO ] [MAIN ] AHT: Loaded 6347 primary data records. [2025-10-27T22:04:55.728294] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:56.366522] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-27T22:04:56.367067] [INFO ] [MAIN ] AI: Loaded 53764 primary data records. [2025-10-27T22:04:56.523169] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:56.540470] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:56.803007] [INFO ] [MAIN ] AHT: Generated 138 derivative records from 6347 primary records. [2025-10-27T22:04:56.802462] [INFO ] [MAIN ] AHH: Generated 138 derivative records from 39774 primary records. [2025-10-27T22:04:56.806423] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-27T22:04:56.805370] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-27T22:04:56.857179] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:56.857634] [DEBUG] [LOCAL ] AHH: Derivative data saved (138 records). [2025-10-27T22:04:56.875061] [DEBUG] [LOCAL ] AHT: Derivative data saved (138 records). [2025-10-27T22:04:56.876816] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-27T22:04:56.873784] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-27T22:04:56.879587] [INFO ] [MAIN ] Derivative Progress: 43/1881 symbols completed. AHT took 1.2s. Estimated remaining: 13m 14s. Rate: 138.9 symbols/min [2025-10-27T22:04:56.883129] [INFO ] [MAIN ] Derivative Progress: 44/1881 symbols completed. AHH took 1.2s. Estimated remaining: 12m 56s. Rate: 142.1 symbols/min [2025-10-27T22:04:56.903731] [INFO ] [MAIN ] AI: Generated 138 derivative records from 53764 primary records. [2025-10-27T22:04:56.903907] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-27T22:04:56.921047] [DEBUG] [LOCAL ] AI: Derivative data saved (138 records). [2025-10-27T22:04:56.921213] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-27T22:04:56.924088] [INFO ] [MAIN ] Derivative Progress: 45/1881 symbols completed. AI took 1.2s. Estimated remaining: 12m 40s. Rate: 145.0 symbols/min [2025-10-27T22:04:56.924736] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:56.924802] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:56.924635] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:56.951174] [DEBUG] [LOCAL ] AIO: Loaded 12787 existing records from primary storage. [2025-10-27T22:04:56.951349] [INFO ] [MAIN ] AIO: Loaded 12787 primary data records. [2025-10-27T22:04:57.013607] [DEBUG] [LOCAL ] AIN: Loaded 24135 existing records from primary storage. [2025-10-27T22:04:57.048212] [INFO ] [MAIN ] AIN: Loaded 24135 primary data records. [2025-10-27T22:04:57.290469] [DEBUG] [LOCAL ] AIG: Loaded 53450 existing records from primary storage. [2025-10-27T22:04:57.362476] [INFO ] [MAIN ] AIG: Loaded 53450 primary data records. [2025-10-27T22:04:58.128917] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:58.158851] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:58.188579] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:58.259369] [INFO ] [MAIN ] AIN: Generated 138 derivative records from 24135 primary records. [2025-10-27T22:04:58.259588] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-27T22:04:58.262000] [INFO ] [MAIN ] AIO: Generated 138 derivative records from 12787 primary records. [2025-10-27T22:04:58.263325] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-27T22:04:58.287950] [DEBUG] [LOCAL ] AIO: Derivative data saved (138 records). [2025-10-27T22:04:58.285190] [DEBUG] [LOCAL ] AIN: Derivative data saved (138 records). [2025-10-27T22:04:58.290010] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-27T22:04:58.289817] [INFO ] [MAIN ] AIG: Generated 138 derivative records from 53450 primary records. [2025-10-27T22:04:58.292216] [INFO ] [MAIN ] Derivative Progress: 46/1881 symbols completed. AIN took 1.4s. Estimated remaining: 13m 17s. Rate: 138.1 symbols/min [2025-10-27T22:04:58.290110] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-27T22:04:58.294378] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-27T22:04:58.294523] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:58.294693] [INFO ] [MAIN ] Derivative Progress: 47/1881 symbols completed. AIO took 1.4s. Estimated remaining: 12m 60s. Rate: 141.1 symbols/min [2025-10-27T22:04:58.294882] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:58.308396] [DEBUG] [LOCAL ] AIG: Derivative data saved (138 records). [2025-10-27T22:04:58.308555] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-27T22:04:58.310793] [INFO ] [MAIN ] Derivative Progress: 48/1881 symbols completed. AIG took 1.4s. Estimated remaining: 12m 44s. Rate: 144.0 symbols/min [2025-10-27T22:04:58.311021] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:58.348293] [DEBUG] [LOCAL ] AIR: Loaded 28344 existing records from primary storage. [2025-10-27T22:04:58.348890] [DEBUG] [LOCAL ] AIT: Loaded 26203 existing records from primary storage. [2025-10-27T22:04:58.349297] [INFO ] [MAIN ] AIT: Loaded 26203 primary data records. [2025-10-27T22:04:58.349220] [INFO ] [MAIN ] AIR: Loaded 28344 primary data records. [2025-10-27T22:04:58.645214] [DEBUG] [LOCAL ] AIV: Loaded 41782 existing records from primary storage. [2025-10-27T22:04:58.805757] [INFO ] [MAIN ] AIV: Loaded 41782 primary data records. [2025-10-27T22:04:59.305437] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:59.338589] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:59.394620] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:04:59.431905] [INFO ] [MAIN ] AIT: Generated 138 derivative records from 26203 primary records. [2025-10-27T22:04:59.443438] [INFO ] [MAIN ] AIR: Generated 138 derivative records from 28344 primary records. [2025-10-27T22:04:59.446254] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-27T22:04:59.448427] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-27T22:04:59.472990] [DEBUG] [LOCAL ] AIR: Derivative data saved (138 records). [2025-10-27T22:04:59.476081] [DEBUG] [LOCAL ] AIT: Derivative data saved (138 records). [2025-10-27T22:04:59.476248] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-27T22:04:59.476369] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-27T22:04:59.478674] [INFO ] [MAIN ] Derivative Progress: 49/1881 symbols completed. AIR took 1.2s. Estimated remaining: 13m 12s. Rate: 138.9 symbols/min [2025-10-27T22:04:59.480967] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:59.482428] [INFO ] [MAIN ] Derivative Progress: 50/1881 symbols completed. AIT took 1.2s. Estimated remaining: 12m 55s. Rate: 141.7 symbols/min [2025-10-27T22:04:59.482910] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:59.486003] [INFO ] [MAIN ] AIV: Generated 138 derivative records from 41782 primary records. [2025-10-27T22:04:59.486212] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-27T22:04:59.499792] [DEBUG] [LOCAL ] AIZN: Loaded 3678 existing records from primary storage. [2025-10-27T22:04:59.499987] [INFO ] [MAIN ] AIZN: Loaded 3678 primary data records. [2025-10-27T22:04:59.522765] [DEBUG] [LOCAL ] AIV: Derivative data saved (138 records). [2025-10-27T22:04:59.544400] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-27T22:04:59.571967] [INFO ] [MAIN ] Derivative Progress: 51/1881 symbols completed. AIV took 1.3s. Estimated remaining: 12m 43s. Rate: 143.9 symbols/min [2025-10-27T22:04:59.578379] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:04:59.798230] [DEBUG] [LOCAL ] AIZ: Loaded 28903 existing records from primary storage. [2025-10-27T22:04:59.798622] [INFO ] [MAIN ] AIZ: Loaded 28903 primary data records. [2025-10-27T22:05:00.188879] [DEBUG] [LOCAL ] AJG: Loaded 46202 existing records from primary storage. [2025-10-27T22:05:00.189766] [INFO ] [MAIN ] AJG: Loaded 46202 primary data records. [2025-10-27T22:05:00.504634] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:00.550592] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:00.606214] [INFO ] [MAIN ] AIZN: Generated 138 derivative records from 3678 primary records. [2025-10-27T22:05:00.611720] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:00.614329] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-27T22:05:00.640981] [DEBUG] [LOCAL ] AIZN: Derivative data saved (138 records). [2025-10-27T22:05:00.645198] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-27T22:05:00.647830] [INFO ] [MAIN ] Derivative Progress: 52/1881 symbols completed. AIZN took 1.2s. Estimated remaining: 13m 6s. Rate: 139.7 symbols/min [2025-10-27T22:05:00.651537] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:00.659460] [INFO ] [MAIN ] AIZ: Generated 138 derivative records from 28903 primary records. [2025-10-27T22:05:00.659693] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-27T22:05:00.675997] [DEBUG] [LOCAL ] AIZ: Derivative data saved (138 records). [2025-10-27T22:05:00.677398] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-27T22:05:00.682630] [INFO ] [MAIN ] Derivative Progress: 53/1881 symbols completed. AIZ took 1.2s. Estimated remaining: 12m 52s. Rate: 142.1 symbols/min [2025-10-27T22:05:00.684757] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:00.687245] [INFO ] [MAIN ] AJG: Generated 138 derivative records from 46202 primary records. [2025-10-27T22:05:00.687397] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-27T22:05:00.709747] [DEBUG] [LOCAL ] AJG: Derivative data saved (138 records). [2025-10-27T22:05:00.710036] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-27T22:05:00.712125] [INFO ] [MAIN ] Derivative Progress: 54/1881 symbols completed. AJG took 1.1s. Estimated remaining: 12m 38s. Rate: 144.6 symbols/min [2025-10-27T22:05:00.712479] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:00.741488] [DEBUG] [LOCAL ] AKR: Loaded 45897 existing records from primary storage. [2025-10-27T22:05:00.741828] [INFO ] [MAIN ] AKR: Loaded 45897 primary data records. [2025-10-27T22:05:00.877066] [DEBUG] [LOCAL ] AL: Loaded 44745 existing records from primary storage. [2025-10-27T22:05:00.883095] [INFO ] [MAIN ] AL: Loaded 44745 primary data records. [2025-10-27T22:05:01.034222] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-27T22:05:01.146679] [INFO ] [MAIN ] ALB: Loaded 53362 primary data records. [2025-10-27T22:05:01.763786] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:01.803252] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:01.843594] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:01.890346] [INFO ] [MAIN ] AKR: Generated 138 derivative records from 45897 primary records. [2025-10-27T22:05:01.893043] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-27T22:05:01.916220] [DEBUG] [LOCAL ] AKR: Derivative data saved (138 records). [2025-10-27T22:05:01.921276] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-27T22:05:01.924070] [INFO ] [MAIN ] Derivative Progress: 55/1881 symbols completed. AKR took 1.3s. Estimated remaining: 13m 4s. Rate: 139.7 symbols/min [2025-10-27T22:05:01.927108] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:01.942211] [INFO ] [MAIN ] AL: Generated 138 derivative records from 44745 primary records. [2025-10-27T22:05:01.945199] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-27T22:05:01.967967] [DEBUG] [LOCAL ] AL: Derivative data saved (138 records). [2025-10-27T22:05:01.968954] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-27T22:05:01.983225] [INFO ] [MAIN ] Derivative Progress: 56/1881 symbols completed. AL took 1.3s. Estimated remaining: 12m 52s. Rate: 141.9 symbols/min [2025-10-27T22:05:01.980849] [INFO ] [MAIN ] ALB: Generated 138 derivative records from 53362 primary records. [2025-10-27T22:05:01.983526] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:01.984277] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-27T22:05:02.012731] [DEBUG] [LOCAL ] ALB: Derivative data saved (138 records). [2025-10-27T22:05:02.013044] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-27T22:05:02.015921] [INFO ] [MAIN ] Derivative Progress: 57/1881 symbols completed. ALB took 1.3s. Estimated remaining: 12m 39s. Rate: 144.3 symbols/min [2025-10-27T22:05:02.016123] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:02.017884] [DEBUG] [LOCAL ] ALE: Loaded 31792 existing records from primary storage. [2025-10-27T22:05:02.018878] [INFO ] [MAIN ] ALE: Loaded 31792 primary data records. [2025-10-27T22:05:02.124262] [DEBUG] [LOCAL ] ALG: Loaded 9543 existing records from primary storage. [2025-10-27T22:05:02.164597] [INFO ] [MAIN ] ALG: Loaded 9543 primary data records. [2025-10-27T22:05:02.177509] [DEBUG] [LOCAL ] ALEX: Loaded 30369 existing records from primary storage. [2025-10-27T22:05:02.243407] [INFO ] [MAIN ] ALEX: Loaded 30369 primary data records. [2025-10-27T22:05:03.033475] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:03.078839] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:03.115169] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:03.145999] [INFO ] [MAIN ] ALE: Generated 138 derivative records from 31792 primary records. [2025-10-27T22:05:03.151603] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-27T22:05:03.173264] [DEBUG] [LOCAL ] ALE: Derivative data saved (138 records). [2025-10-27T22:05:03.175235] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-27T22:05:03.178266] [INFO ] [MAIN ] Derivative Progress: 58/1881 symbols completed. ALE took 1.3s. Estimated remaining: 13m 2s. Rate: 139.9 symbols/min [2025-10-27T22:05:03.184598] [INFO ] [MAIN ] ALG: Generated 138 derivative records from 9543 primary records. [2025-10-27T22:05:03.185811] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-27T22:05:03.201617] [DEBUG] [LOCAL ] ALG: Derivative data saved (138 records). [2025-10-27T22:05:03.203347] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-27T22:05:03.205909] [INFO ] [MAIN ] Derivative Progress: 59/1881 symbols completed. ALG took 1.2s. Estimated remaining: 12m 49s. Rate: 142.2 symbols/min [2025-10-27T22:05:03.208115] [INFO ] [MAIN ] ALEX: Generated 138 derivative records from 30369 primary records. [2025-10-27T22:05:03.208189] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-27T22:05:03.219885] [DEBUG] [LOCAL ] ALEX: Derivative data saved (138 records). [2025-10-27T22:05:03.219959] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-27T22:05:03.222130] [INFO ] [MAIN ] Derivative Progress: 60/1881 symbols completed. ALEX took 1.2s. Estimated remaining: 12m 36s. Rate: 144.5 symbols/min [2025-10-27T22:05:03.222684] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:03.222861] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:03.222804] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:03.262298] [DEBUG] [LOCAL ] ALSN: Loaded 43052 existing records from primary storage. [2025-10-27T22:05:03.262457] [INFO ] [MAIN ] ALSN: Loaded 43052 primary data records. [2025-10-27T22:05:03.506383] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-10-27T22:05:03.506729] [INFO ] [MAIN ] ALIT: Loaded 52760 primary data records. [2025-10-27T22:05:03.520064] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-27T22:05:03.520224] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-27T22:05:04.311888] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:04.344084] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:04.395445] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:04.418887] [INFO ] [MAIN ] ALSN: Generated 138 derivative records from 43052 primary records. [2025-10-27T22:05:04.419159] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-27T22:05:04.438053] [DEBUG] [LOCAL ] ALSN: Derivative data saved (138 records). [2025-10-27T22:05:04.438626] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-27T22:05:04.440924] [INFO ] [MAIN ] Derivative Progress: 61/1881 symbols completed. ALSN took 1.2s. Estimated remaining: 12m 60s. Rate: 140.1 symbols/min [2025-10-27T22:05:04.442163] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:04.457031] [INFO ] [MAIN ] ALIT: Generated 138 derivative records from 52760 primary records. [2025-10-27T22:05:04.462550] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-27T22:05:04.486216] [DEBUG] [LOCAL ] ALIT: Derivative data saved (138 records). [2025-10-27T22:05:04.486362] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-27T22:05:04.486142] [DEBUG] [LOCAL ] ALTG: Loaded 22760 existing records from primary storage. [2025-10-27T22:05:04.487532] [INFO ] [MAIN ] ALTG: Loaded 22760 primary data records. [2025-10-27T22:05:04.490578] [INFO ] [MAIN ] Derivative Progress: 62/1881 symbols completed. ALIT took 1.3s. Estimated remaining: 12m 48s. Rate: 142.1 symbols/min [2025-10-27T22:05:04.490847] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:04.524465] [INFO ] [MAIN ] ALK: Generated 138 derivative records from 53087 primary records. [2025-10-27T22:05:04.548140] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-27T22:05:04.608319] [DEBUG] [LOCAL ] ALK: Derivative data saved (138 records). [2025-10-27T22:05:04.608461] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-27T22:05:04.619951] [INFO ] [MAIN ] Derivative Progress: 63/1881 symbols completed. ALK took 1.4s. Estimated remaining: 12m 39s. Rate: 143.7 symbols/min [2025-10-27T22:05:04.617591] [DEBUG] [LOCAL ] ALUR: Loaded 9135 existing records from primary storage. [2025-10-27T22:05:04.630455] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:04.630994] [INFO ] [MAIN ] ALUR: Loaded 9135 primary data records. [2025-10-27T22:05:05.145398] [DEBUG] [LOCAL ] ALV: Loaded 42134 existing records from primary storage. [2025-10-27T22:05:05.146951] [INFO ] [MAIN ] ALV: Loaded 42134 primary data records. [2025-10-27T22:05:05.263520] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:05.508538] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:05.558574] [INFO ] [MAIN ] ALTG: Generated 138 derivative records from 22760 primary records. [2025-10-27T22:05:05.559534] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-27T22:05:05.586678] [DEBUG] [LOCAL ] ALTG: Derivative data saved (138 records). [2025-10-27T22:05:05.586566] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:05.589434] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-27T22:05:05.606031] [INFO ] [MAIN ] Derivative Progress: 64/1881 symbols completed. ALTG took 1.2s. Estimated remaining: 12m 55s. Rate: 140.7 symbols/min [2025-10-27T22:05:05.606338] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:05.621548] [INFO ] [MAIN ] ALUR: Generated 138 derivative records from 9135 primary records. [2025-10-27T22:05:05.624960] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-27T22:05:05.638036] [DEBUG] [LOCAL ] ALUR: Derivative data saved (138 records). [2025-10-27T22:05:05.638265] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-27T22:05:05.640793] [INFO ] [MAIN ] Derivative Progress: 65/1881 symbols completed. ALUR took 1.1s. Estimated remaining: 12m 44s. Rate: 142.7 symbols/min [2025-10-27T22:05:05.641016] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:05.666243] [INFO ] [MAIN ] ALV: Generated 138 derivative records from 42134 primary records. [2025-10-27T22:05:05.666561] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-27T22:05:05.679043] [DEBUG] [LOCAL ] ALV: Derivative data saved (138 records). [2025-10-27T22:05:05.686290] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-27T22:05:05.688464] [INFO ] [MAIN ] Derivative Progress: 66/1881 symbols completed. ALV took 1.1s. Estimated remaining: 12m 33s. Rate: 144.6 symbols/min [2025-10-27T22:05:05.688788] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:05.715498] [DEBUG] [LOCAL ] AM: Loaded 51802 existing records from primary storage. [2025-10-27T22:05:05.716304] [INFO ] [MAIN ] AM: Loaded 51802 primary data records. [2025-10-27T22:05:05.716054] [DEBUG] [LOCAL ] AMBC: Loaded 35502 existing records from primary storage. [2025-10-27T22:05:05.738097] [INFO ] [MAIN ] AMBC: Loaded 35502 primary data records. [2025-10-27T22:05:06.160432] [DEBUG] [LOCAL ] AMBP: Loaded 44283 existing records from primary storage. [2025-10-27T22:05:06.165905] [INFO ] [MAIN ] AMBP: Loaded 44283 primary data records. [2025-10-27T22:05:06.696674] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:06.729888] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:06.781060] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:06.801069] [INFO ] [MAIN ] AM: Generated 138 derivative records from 51802 primary records. [2025-10-27T22:05:06.810424] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-27T22:05:06.826469] [DEBUG] [LOCAL ] AM: Derivative data saved (138 records). [2025-10-27T22:05:06.826759] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-27T22:05:06.833318] [INFO ] [MAIN ] Derivative Progress: 67/1881 symbols completed. AM took 1.2s. Estimated remaining: 12m 52s. Rate: 140.9 symbols/min [2025-10-27T22:05:06.834742] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:06.843806] [INFO ] [MAIN ] AMBC: Generated 138 derivative records from 35502 primary records. [2025-10-27T22:05:06.844069] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-27T22:05:06.856976] [DEBUG] [LOCAL ] AMBC: Derivative data saved (138 records). [2025-10-27T22:05:06.857250] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-27T22:05:06.859671] [INFO ] [MAIN ] Derivative Progress: 68/1881 symbols completed. AMBC took 1.2s. Estimated remaining: 12m 41s. Rate: 142.9 symbols/min [2025-10-27T22:05:06.860480] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:06.868794] [INFO ] [MAIN ] AMBP: Generated 138 derivative records from 44283 primary records. [2025-10-27T22:05:06.869048] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-27T22:05:06.882848] [DEBUG] [LOCAL ] AMBP: Derivative data saved (138 records). [2025-10-27T22:05:06.896365] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-27T22:05:06.899404] [INFO ] [MAIN ] Derivative Progress: 69/1881 symbols completed. AMBP took 1.2s. Estimated remaining: 12m 31s. Rate: 144.8 symbols/min [2025-10-27T22:05:06.899864] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:06.933749] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-27T22:05:06.933969] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-27T22:05:07.050159] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-27T22:05:07.071285] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-27T22:05:07.369365] [DEBUG] [LOCAL ] AME: Loaded 48327 existing records from primary storage. [2025-10-27T22:05:07.395834] [INFO ] [MAIN ] AME: Loaded 48327 primary data records. [2025-10-27T22:05:07.892166] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:07.927079] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:07.969083] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:08.007683] [INFO ] [MAIN ] AMC: Generated 138 derivative records from 53766 primary records. [2025-10-27T22:05:08.009976] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-27T22:05:08.028441] [INFO ] [MAIN ] AMCR: Generated 138 derivative records from 53670 primary records. [2025-10-27T22:05:08.029558] [DEBUG] [LOCAL ] AMC: Derivative data saved (138 records). [2025-10-27T22:05:08.029804] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-27T22:05:08.032534] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-27T22:05:08.035149] [INFO ] [MAIN ] Derivative Progress: 70/1881 symbols completed. AMC took 1.2s. Estimated remaining: 12m 49s. Rate: 141.3 symbols/min [2025-10-27T22:05:08.035331] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:08.048979] [DEBUG] [LOCAL ] AMCR: Derivative data saved (138 records). [2025-10-27T22:05:08.049776] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-27T22:05:08.055128] [INFO ] [MAIN ] Derivative Progress: 71/1881 symbols completed. AMCR took 1.2s. Estimated remaining: 12m 38s. Rate: 143.2 symbols/min [2025-10-27T22:05:08.055333] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:08.064346] [INFO ] [MAIN ] AME: Generated 138 derivative records from 48327 primary records. [2025-10-27T22:05:08.064608] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-27T22:05:08.082737] [DEBUG] [LOCAL ] AME: Derivative data saved (138 records). [2025-10-27T22:05:08.084059] [DEBUG] [LOCAL ] AMG: Loaded 19768 existing records from primary storage. [2025-10-27T22:05:08.083735] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-27T22:05:08.086296] [INFO ] [MAIN ] Derivative Progress: 72/1881 symbols completed. AME took 1.2s. Estimated remaining: 12m 28s. Rate: 145.1 symbols/min [2025-10-27T22:05:08.086464] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:08.087042] [INFO ] [MAIN ] AMG: Loaded 19768 primary data records. [2025-10-27T22:05:08.416566] [DEBUG] [LOCAL ] AMH: Loaded 51793 existing records from primary storage. [2025-10-27T22:05:08.416868] [INFO ] [MAIN ] AMH: Loaded 51793 primary data records. [2025-10-27T22:05:08.531278] [DEBUG] [LOCAL ] AMN: Loaded 41409 existing records from primary storage. [2025-10-27T22:05:08.534865] [INFO ] [MAIN ] AMN: Loaded 41409 primary data records. [2025-10-27T22:05:09.104858] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:09.153144] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:09.187276] [INFO ] [MAIN ] AMG: Generated 138 derivative records from 19768 primary records. [2025-10-27T22:05:09.187512] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-27T22:05:09.203824] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:09.228604] [DEBUG] [LOCAL ] AMG: Derivative data saved (138 records). [2025-10-27T22:05:09.229071] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-27T22:05:09.233736] [INFO ] [MAIN ] Derivative Progress: 73/1881 symbols completed. AMG took 1.2s. Estimated remaining: 12m 46s. Rate: 141.6 symbols/min [2025-10-27T22:05:09.251803] [INFO ] [MAIN ] AMH: Generated 138 derivative records from 51793 primary records. [2025-10-27T22:05:09.253486] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-27T22:05:09.269299] [DEBUG] [LOCAL ] AMH: Derivative data saved (138 records). [2025-10-27T22:05:09.270931] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-27T22:05:09.275817] [INFO ] [MAIN ] Derivative Progress: 74/1881 symbols completed. AMH took 1.2s. Estimated remaining: 12m 36s. Rate: 143.4 symbols/min [2025-10-27T22:05:09.278892] [INFO ] [MAIN ] AMN: Generated 138 derivative records from 41409 primary records. [2025-10-27T22:05:09.278973] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-27T22:05:09.290310] [DEBUG] [LOCAL ] AMN: Derivative data saved (138 records). [2025-10-27T22:05:09.290364] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-27T22:05:09.292561] [INFO ] [MAIN ] Derivative Progress: 75/1881 symbols completed. AMN took 1.2s. Estimated remaining: 12m 26s. Rate: 145.2 symbols/min [2025-10-27T22:05:09.292922] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:09.293025] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:09.293399] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:09.329883] [DEBUG] [LOCAL ] AMP: Loaded 31375 existing records from primary storage. [2025-10-27T22:05:09.330119] [INFO ] [MAIN ] AMP: Loaded 31375 primary data records. [2025-10-27T22:05:09.411414] [DEBUG] [LOCAL ] AMR: Loaded 28408 existing records from primary storage. [2025-10-27T22:05:09.423278] [INFO ] [MAIN ] AMR: Loaded 28408 primary data records. [2025-10-27T22:05:09.591783] [DEBUG] [LOCAL ] AMPY: Loaded 39370 existing records from primary storage. [2025-10-27T22:05:09.759270] [INFO ] [MAIN ] AMPY: Loaded 39370 primary data records. [2025-10-27T22:05:10.286016] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:10.318009] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:10.372831] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:10.400711] [INFO ] [MAIN ] AMP: Generated 138 derivative records from 31375 primary records. [2025-10-27T22:05:10.405129] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-27T22:05:10.426060] [DEBUG] [LOCAL ] AMP: Derivative data saved (138 records). [2025-10-27T22:05:10.426324] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-27T22:05:10.429387] [INFO ] [MAIN ] AMR: Generated 138 derivative records from 28408 primary records. [2025-10-27T22:05:10.431382] [INFO ] [MAIN ] Derivative Progress: 76/1881 symbols completed. AMP took 1.1s. Estimated remaining: 12m 43s. Rate: 142.0 symbols/min [2025-10-27T22:05:10.432256] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-27T22:05:10.432140] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:10.450794] [DEBUG] [LOCAL ] AMR: Derivative data saved (138 records). [2025-10-27T22:05:10.451004] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-27T22:05:10.454468] [INFO ] [MAIN ] Derivative Progress: 77/1881 symbols completed. AMR took 1.2s. Estimated remaining: 12m 33s. Rate: 143.7 symbols/min [2025-10-27T22:05:10.454805] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:10.472742] [INFO ] [MAIN ] AMPY: Generated 138 derivative records from 39370 primary records. [2025-10-27T22:05:10.473000] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-27T22:05:10.487671] [DEBUG] [LOCAL ] AMPY: Derivative data saved (138 records). [2025-10-27T22:05:10.498422] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-27T22:05:10.502344] [DEBUG] [LOCAL ] AMRC: Loaded 38274 existing records from primary storage. [2025-10-27T22:05:10.501289] [INFO ] [MAIN ] Derivative Progress: 78/1881 symbols completed. AMPY took 1.2s. Estimated remaining: 12m 24s. Rate: 145.4 symbols/min [2025-10-27T22:05:10.502523] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:10.502670] [INFO ] [MAIN ] AMRC: Loaded 38274 primary data records. [2025-10-27T22:05:10.685183] [DEBUG] [LOCAL ] AMTB: Loaded 20491 existing records from primary storage. [2025-10-27T22:05:10.722997] [INFO ] [MAIN ] AMTB: Loaded 20491 primary data records. [2025-10-27T22:05:10.900483] [DEBUG] [LOCAL ] AMT: Loaded 52406 existing records from primary storage. [2025-10-27T22:05:10.927021] [INFO ] [MAIN ] AMT: Loaded 52406 primary data records. [2025-10-27T22:05:11.468929] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:11.526426] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:11.548999] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:11.576125] [INFO ] [MAIN ] AMRC: Generated 138 derivative records from 38274 primary records. [2025-10-27T22:05:11.577833] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-27T22:05:11.602062] [DEBUG] [LOCAL ] AMRC: Derivative data saved (138 records). [2025-10-27T22:05:11.605341] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-27T22:05:11.610733] [INFO ] [MAIN ] Derivative Progress: 79/1881 symbols completed. AMRC took 1.2s. Estimated remaining: 12m 40s. Rate: 142.3 symbols/min [2025-10-27T22:05:11.616392] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:11.631472] [INFO ] [MAIN ] AMT: Generated 138 derivative records from 52406 primary records. [2025-10-27T22:05:11.631259] [DEBUG] [LOCAL ] AMTD: Loaded 3794 existing records from primary storage. [2025-10-27T22:05:11.631769] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-27T22:05:11.631700] [INFO ] [MAIN ] AMTB: Generated 138 derivative records from 20491 primary records. [2025-10-27T22:05:11.632444] [INFO ] [MAIN ] AMTD: Loaded 3794 primary data records. [2025-10-27T22:05:11.632386] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-27T22:05:11.697740] [DEBUG] [LOCAL ] AMT: Derivative data saved (138 records). [2025-10-27T22:05:11.720387] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-27T22:05:11.729461] [DEBUG] [LOCAL ] AMTB: Derivative data saved (138 records). [2025-10-27T22:05:11.729337] [INFO ] [MAIN ] Derivative Progress: 80/1881 symbols completed. AMT took 1.3s. Estimated remaining: 12m 32s. Rate: 143.6 symbols/min [2025-10-27T22:05:11.738085] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:11.737984] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-27T22:05:11.757730] [INFO ] [MAIN ] Derivative Progress: 81/1881 symbols completed. AMTB took 1.3s. Estimated remaining: 12m 23s. Rate: 145.3 symbols/min [2025-10-27T22:05:11.769587] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:12.030921] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:12.043442] [DEBUG] [LOCAL ] AMTM: Loaded 50131 existing records from primary storage. [2025-10-27T22:05:12.045758] [INFO ] [MAIN ] AMTM: Loaded 50131 primary data records. [2025-10-27T22:05:12.104762] [DEBUG] [LOCAL ] AMX: Loaded 49065 existing records from primary storage. [2025-10-27T22:05:12.143284] [INFO ] [MAIN ] AMX: Loaded 49065 primary data records. [2025-10-27T22:05:12.734358] [INFO ] [MAIN ] AMTD: Generated 138 derivative records from 3794 primary records. [2025-10-27T22:05:12.735554] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-27T22:05:12.747432] [DEBUG] [LOCAL ] AMTD: Derivative data saved (138 records). [2025-10-27T22:05:12.747818] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-27T22:05:12.750321] [INFO ] [MAIN ] Derivative Progress: 82/1881 symbols completed. AMTD took 1.1s. Estimated remaining: 12m 36s. Rate: 142.8 symbols/min [2025-10-27T22:05:12.751000] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:12.771225] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:12.813336] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:12.849622] [DEBUG] [LOCAL ] AN: Loaded 30923 existing records from primary storage. [2025-10-27T22:05:12.851082] [INFO ] [MAIN ] AN: Loaded 30923 primary data records. [2025-10-27T22:05:12.989692] [INFO ] [MAIN ] AMTM: Generated 138 derivative records from 50131 primary records. [2025-10-27T22:05:13.018919] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-27T22:05:13.167250] [DEBUG] [LOCAL ] AMTM: Derivative data saved (138 records). [2025-10-27T22:05:13.169396] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-27T22:05:13.174616] [INFO ] [MAIN ] AMX: Generated 138 derivative records from 49065 primary records. [2025-10-27T22:05:13.171627] [INFO ] [MAIN ] Derivative Progress: 83/1881 symbols completed. AMTM took 1.4s. Estimated remaining: 12m 35s. Rate: 142.8 symbols/min [2025-10-27T22:05:13.175139] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-27T22:05:13.176178] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:13.189162] [DEBUG] [LOCAL ] AMX: Derivative data saved (138 records). [2025-10-27T22:05:13.189297] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-27T22:05:13.191252] [INFO ] [MAIN ] Derivative Progress: 84/1881 symbols completed. AMX took 1.4s. Estimated remaining: 12m 26s. Rate: 144.5 symbols/min [2025-10-27T22:05:13.192614] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:13.212492] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:13.300436] [DEBUG] [LOCAL ] ANF: Loaded 51990 existing records from primary storage. [2025-10-27T22:05:13.300629] [INFO ] [MAIN ] AN: Generated 138 derivative records from 30923 primary records. [2025-10-27T22:05:13.300910] [INFO ] [MAIN ] ANF: Loaded 51990 primary data records. [2025-10-27T22:05:13.301034] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-27T22:05:13.300346] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-27T22:05:13.322195] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-27T22:05:13.448201] [DEBUG] [LOCAL ] AN: Derivative data saved (138 records). [2025-10-27T22:05:13.485999] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-27T22:05:13.516023] [INFO ] [MAIN ] Derivative Progress: 85/1881 symbols completed. AN took 0.8s. Estimated remaining: 12m 24s. Rate: 144.9 symbols/min [2025-10-27T22:05:13.546018] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:13.948923] [DEBUG] [LOCAL ] ANVS: Loaded 23987 existing records from primary storage. [2025-10-27T22:05:13.949811] [INFO ] [MAIN ] ANVS: Loaded 23987 primary data records. [2025-10-27T22:05:14.147315] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:14.295530] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:14.335875] [INFO ] [MAIN ] ANF: Generated 138 derivative records from 51990 primary records. [2025-10-27T22:05:14.336830] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-27T22:05:14.353199] [DEBUG] [LOCAL ] ANF: Derivative data saved (138 records). [2025-10-27T22:05:14.355070] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-27T22:05:14.357559] [INFO ] [MAIN ] Derivative Progress: 86/1881 symbols completed. ANF took 1.2s. Estimated remaining: 12m 32s. Rate: 143.1 symbols/min [2025-10-27T22:05:14.357917] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:14.373381] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:14.392094] [INFO ] [MAIN ] ANET: Generated 138 derivative records from 53766 primary records. [2025-10-27T22:05:14.394838] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-27T22:05:14.418851] [DEBUG] [LOCAL ] ANET: Derivative data saved (138 records). [2025-10-27T22:05:14.420706] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-27T22:05:14.422600] [INFO ] [MAIN ] Derivative Progress: 87/1881 symbols completed. ANET took 1.2s. Estimated remaining: 12m 25s. Rate: 144.5 symbols/min [2025-10-27T22:05:14.422923] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:14.440101] [DEBUG] [LOCAL ] AOD: Loaded 30589 existing records from primary storage. [2025-10-27T22:05:14.443717] [INFO ] [MAIN ] AOD: Loaded 30589 primary data records. [2025-10-27T22:05:14.514335] [DEBUG] [LOCAL ] AOMR: Loaded 16054 existing records from primary storage. [2025-10-27T22:05:14.526261] [INFO ] [MAIN ] ANVS: Generated 138 derivative records from 23987 primary records. [2025-10-27T22:05:14.531555] [INFO ] [MAIN ] AOMR: Loaded 16054 primary data records. [2025-10-27T22:05:14.531484] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-27T22:05:14.744210] [DEBUG] [LOCAL ] ANVS: Derivative data saved (138 records). [2025-10-27T22:05:14.744782] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-27T22:05:14.908928] [INFO ] [MAIN ] Derivative Progress: 88/1881 symbols completed. ANVS took 1.4s. Estimated remaining: 12m 26s. Rate: 144.3 symbols/min [2025-10-27T22:05:15.116465] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:15.151424] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:15.181952] [INFO ] [MAIN ] AOD: Generated 138 derivative records from 30589 primary records. [2025-10-27T22:05:15.182309] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-27T22:05:15.198213] [DEBUG] [LOCAL ] AOD: Derivative data saved (138 records). [2025-10-27T22:05:15.199807] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-27T22:05:15.202462] [INFO ] [MAIN ] Derivative Progress: 89/1881 symbols completed. AOD took 0.8s. Estimated remaining: 12m 23s. Rate: 144.7 symbols/min [2025-10-27T22:05:15.207105] [INFO ] [MAIN ] AOMR: Generated 138 derivative records from 16054 primary records. [2025-10-27T22:05:15.207188] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-27T22:05:15.218323] [DEBUG] [LOCAL ] AOMR: Derivative data saved (138 records). [2025-10-27T22:05:15.218378] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-27T22:05:15.220497] [INFO ] [MAIN ] Derivative Progress: 90/1881 symbols completed. AOMR took 0.8s. Estimated remaining: 12m 15s. Rate: 146.3 symbols/min [2025-10-27T22:05:15.221028] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:15.221156] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:15.220955] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:15.249186] [DEBUG] [LOCAL ] AORT: Loaded 28591 existing records from primary storage. [2025-10-27T22:05:15.268635] [INFO ] [MAIN ] AORT: Loaded 28591 primary data records. [2025-10-27T22:05:15.396021] [DEBUG] [LOCAL ] AON: Loaded 44854 existing records from primary storage. [2025-10-27T22:05:15.406910] [INFO ] [MAIN ] AON: Loaded 44854 primary data records. [2025-10-27T22:05:15.417807] [DEBUG] [LOCAL ] AOS: Loaded 48566 existing records from primary storage. [2025-10-27T22:05:15.477237] [INFO ] [MAIN ] AOS: Loaded 48566 primary data records. [2025-10-27T22:05:16.220217] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:16.246809] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:16.281374] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:16.340815] [INFO ] [MAIN ] AORT: Generated 138 derivative records from 28591 primary records. [2025-10-27T22:05:16.343529] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-27T22:05:16.360154] [DEBUG] [LOCAL ] AORT: Derivative data saved (138 records). [2025-10-27T22:05:16.361261] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-27T22:05:16.363254] [INFO ] [MAIN ] Derivative Progress: 91/1881 symbols completed. AORT took 1.1s. Estimated remaining: 12m 29s. Rate: 143.5 symbols/min [2025-10-27T22:05:16.364035] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:16.368254] [INFO ] [MAIN ] AON: Generated 138 derivative records from 44854 primary records. [2025-10-27T22:05:16.367614] [INFO ] [MAIN ] AOS: Generated 138 derivative records from 48566 primary records. [2025-10-27T22:05:16.368758] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-27T22:05:16.368928] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-27T22:05:16.389151] [DEBUG] [LOCAL ] AOS: Derivative data saved (138 records). [2025-10-27T22:05:16.390906] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-27T22:05:16.392910] [INFO ] [MAIN ] Derivative Progress: 92/1881 symbols completed. AOS took 1.2s. Estimated remaining: 12m 21s. Rate: 144.9 symbols/min [2025-10-27T22:05:16.394806] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:16.397848] [DEBUG] [LOCAL ] AON: Derivative data saved (138 records). [2025-10-27T22:05:16.398177] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-27T22:05:16.400635] [INFO ] [MAIN ] Derivative Progress: 93/1881 symbols completed. AON took 1.2s. Estimated remaining: 12m 12s. Rate: 146.5 symbols/min [2025-10-27T22:05:16.401076] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:16.404997] [DEBUG] [LOCAL ] AP: Loaded 7468 existing records from primary storage. [2025-10-27T22:05:16.405219] [INFO ] [MAIN ] AP: Loaded 7468 primary data records. [2025-10-27T22:05:16.753611] [DEBUG] [LOCAL ] APAM: Loaded 35313 existing records from primary storage. [2025-10-27T22:05:16.753775] [INFO ] [MAIN ] APAM: Loaded 35313 primary data records. [2025-10-27T22:05:16.844122] [DEBUG] [LOCAL ] APD: Loaded 45282 existing records from primary storage. [2025-10-27T22:05:16.866052] [INFO ] [MAIN ] APD: Loaded 45282 primary data records. [2025-10-27T22:05:17.379394] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:17.422486] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:17.464283] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:17.493414] [INFO ] [MAIN ] AP: Generated 138 derivative records from 7468 primary records. [2025-10-27T22:05:17.493875] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-27T22:05:17.511894] [DEBUG] [LOCAL ] AP: Derivative data saved (138 records). [2025-10-27T22:05:17.513383] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-27T22:05:17.516608] [INFO ] [MAIN ] Derivative Progress: 94/1881 symbols completed. AP took 1.2s. Estimated remaining: 12m 25s. Rate: 143.8 symbols/min [2025-10-27T22:05:17.519430] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:17.529183] [INFO ] [MAIN ] APAM: Generated 138 derivative records from 35313 primary records. [2025-10-27T22:05:17.531919] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-27T22:05:17.535962] [INFO ] [MAIN ] APD: Generated 138 derivative records from 45282 primary records. [2025-10-27T22:05:17.547595] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-27T22:05:17.548694] [DEBUG] [LOCAL ] APAM: Derivative data saved (138 records). [2025-10-27T22:05:17.549067] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-27T22:05:17.557990] [INFO ] [MAIN ] Derivative Progress: 95/1881 symbols completed. APAM took 1.2s. Estimated remaining: 12m 18s. Rate: 145.2 symbols/min [2025-10-27T22:05:17.562553] [DEBUG] [LOCAL ] APD: Derivative data saved (138 records). [2025-10-27T22:05:17.562702] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-27T22:05:17.562823] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:17.565623] [INFO ] [MAIN ] Derivative Progress: 96/1881 symbols completed. APD took 1.2s. Estimated remaining: 12m 10s. Rate: 146.7 symbols/min [2025-10-27T22:05:17.565828] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:17.603597] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-27T22:05:17.603958] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-27T22:05:17.953256] [DEBUG] [LOCAL ] APO: Loaded 53373 existing records from primary storage. [2025-10-27T22:05:17.953579] [INFO ] [MAIN ] APO: Loaded 53373 primary data records. [2025-10-27T22:05:17.955375] [DEBUG] [LOCAL ] APLE: Loaded 51909 existing records from primary storage. [2025-10-27T22:05:17.966856] [INFO ] [MAIN ] APLE: Loaded 51909 primary data records. [2025-10-27T22:05:18.648028] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:18.709075] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:18.722695] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:18.760091] [INFO ] [MAIN ] APH: Generated 138 derivative records from 53691 primary records. [2025-10-27T22:05:18.763376] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-27T22:05:18.785283] [DEBUG] [LOCAL ] APH: Derivative data saved (138 records). [2025-10-27T22:05:18.785627] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-27T22:05:18.792351] [INFO ] [MAIN ] Derivative Progress: 97/1881 symbols completed. APH took 1.3s. Estimated remaining: 12m 25s. Rate: 143.8 symbols/min [2025-10-27T22:05:18.793437] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:18.810725] [INFO ] [MAIN ] APO: Generated 138 derivative records from 53373 primary records. [2025-10-27T22:05:18.816242] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-27T22:05:18.816400] [INFO ] [MAIN ] APLE: Generated 138 derivative records from 51909 primary records. [2025-10-27T22:05:18.816753] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-27T22:05:18.814241] [DEBUG] [LOCAL ] APOS: Loaded 6830 existing records from primary storage. [2025-10-27T22:05:18.826235] [INFO ] [MAIN ] APOS: Loaded 6830 primary data records. [2025-10-27T22:05:18.839820] [DEBUG] [LOCAL ] APLE: Derivative data saved (138 records). [2025-10-27T22:05:18.839948] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-27T22:05:18.844834] [INFO ] [MAIN ] Derivative Progress: 98/1881 symbols completed. APLE took 1.3s. Estimated remaining: 12m 18s. Rate: 145.1 symbols/min [2025-10-27T22:05:18.844909] [DEBUG] [LOCAL ] APO: Derivative data saved (138 records). [2025-10-27T22:05:18.865624] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-27T22:05:18.878638] [INFO ] [MAIN ] Derivative Progress: 99/1881 symbols completed. APO took 1.3s. Estimated remaining: 12m 10s. Rate: 146.4 symbols/min [2025-10-27T22:05:18.865480] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:18.911276] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:18.977411] [DEBUG] [LOCAL ] AQNB: Loaded 3764 existing records from primary storage. [2025-10-27T22:05:19.010575] [INFO ] [MAIN ] AQNB: Loaded 3764 primary data records. [2025-10-27T22:05:19.390670] [DEBUG] [LOCAL ] APTV: Loaded 51758 existing records from primary storage. [2025-10-27T22:05:19.461964] [INFO ] [MAIN ] APTV: Loaded 51758 primary data records. [2025-10-27T22:05:19.807158] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:19.850188] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:19.905388] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:19.922065] [INFO ] [MAIN ] APOS: Generated 138 derivative records from 6830 primary records. [2025-10-27T22:05:19.924267] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-27T22:05:19.946856] [DEBUG] [LOCAL ] APOS: Derivative data saved (138 records). [2025-10-27T22:05:19.954066] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-27T22:05:19.957295] [INFO ] [MAIN ] Derivative Progress: 100/1881 symbols completed. APOS took 1.2s. Estimated remaining: 12m 22s. Rate: 144.1 symbols/min [2025-10-27T22:05:19.957828] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:19.963252] [INFO ] [MAIN ] AQNB: Generated 138 derivative records from 3764 primary records. [2025-10-27T22:05:19.964920] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-27T22:05:19.986110] [DEBUG] [LOCAL ] AQNB: Derivative data saved (138 records). [2025-10-27T22:05:19.988113] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-27T22:05:19.990169] [INFO ] [MAIN ] Derivative Progress: 101/1881 symbols completed. AQNB took 1.1s. Estimated remaining: 12m 15s. Rate: 145.4 symbols/min [2025-10-27T22:05:19.990869] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:20.013367] [INFO ] [MAIN ] APTV: Generated 138 derivative records from 51758 primary records. [2025-10-27T22:05:20.013708] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-27T22:05:20.030617] [DEBUG] [LOCAL ] APTV: Derivative data saved (138 records). [2025-10-27T22:05:20.042916] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-27T22:05:20.045759] [INFO ] [MAIN ] Derivative Progress: 102/1881 symbols completed. APTV took 1.2s. Estimated remaining: 12m 8s. Rate: 146.6 symbols/min [2025-10-27T22:05:20.052086] [DEBUG] [LOCAL ] ARCO: Loaded 44014 existing records from primary storage. [2025-10-27T22:05:20.052512] [INFO ] [MAIN ] ARCO: Loaded 44014 primary data records. [2025-10-27T22:05:20.052235] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:20.073507] [DEBUG] [LOCAL ] ARDC: Loaded 14965 existing records from primary storage. [2025-10-27T22:05:20.073682] [INFO ] [MAIN ] ARDC: Loaded 14965 primary data records. [2025-10-27T22:05:20.439243] [DEBUG] [LOCAL ] ARDT: Loaded 27328 existing records from primary storage. [2025-10-27T22:05:20.482785] [INFO ] [MAIN ] ARDT: Loaded 27328 primary data records. [2025-10-27T22:05:21.108265] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:21.142842] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:21.195043] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:21.232446] [INFO ] [MAIN ] ARCO: Generated 138 derivative records from 44014 primary records. [2025-10-27T22:05:21.235729] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-27T22:05:21.254899] [DEBUG] [LOCAL ] ARCO: Derivative data saved (138 records). [2025-10-27T22:05:21.257593] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-27T22:05:21.262015] [INFO ] [MAIN ] Derivative Progress: 103/1881 symbols completed. ARCO took 1.3s. Estimated remaining: 12m 21s. Rate: 143.9 symbols/min [2025-10-27T22:05:21.265676] [INFO ] [MAIN ] ARDC: Generated 138 derivative records from 14965 primary records. [2025-10-27T22:05:21.268228] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-27T22:05:21.279372] [INFO ] [MAIN ] ARDT: Generated 138 derivative records from 27328 primary records. [2025-10-27T22:05:21.283687] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-27T22:05:21.284133] [DEBUG] [LOCAL ] ARDC: Derivative data saved (138 records). [2025-10-27T22:05:21.284240] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-27T22:05:21.286797] [INFO ] [MAIN ] Derivative Progress: 104/1881 symbols completed. ARDC took 1.3s. Estimated remaining: 12m 14s. Rate: 145.2 symbols/min [2025-10-27T22:05:21.298209] [DEBUG] [LOCAL ] ARDT: Derivative data saved (138 records). [2025-10-27T22:05:21.298275] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-27T22:05:21.300410] [INFO ] [MAIN ] Derivative Progress: 105/1881 symbols completed. ARDT took 1.2s. Estimated remaining: 12m 7s. Rate: 146.5 symbols/min [2025-10-27T22:05:21.301146] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:21.301243] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:21.301067] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:21.359865] [DEBUG] [LOCAL ] ARI: Loaded 43209 existing records from primary storage. [2025-10-27T22:05:21.360482] [INFO ] [MAIN ] ARI: Loaded 43209 primary data records. [2025-10-27T22:05:21.486460] [DEBUG] [LOCAL ] ARMK: Loaded 50218 existing records from primary storage. [2025-10-27T22:05:21.487855] [INFO ] [MAIN ] ARMK: Loaded 50218 primary data records. [2025-10-27T22:05:21.488543] [DEBUG] [LOCAL ] ARES: Loaded 49601 existing records from primary storage. [2025-10-27T22:05:21.505391] [INFO ] [MAIN ] ARES: Loaded 49601 primary data records. [2025-10-27T22:05:22.334479] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:22.366024] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:05:22.392180] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:22.470602] [INFO ] [MAIN ] ARI: Generated 138 derivative records from 43209 primary records. [2025-10-27T22:05:22.472787] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-27T22:05:22.467790] [INFO ] [MAIN ] ARES: Generated 138 derivative records from 49601 primary records. [2025-10-27T22:05:22.473752] [INFO ] [MAIN ] ARMK: Generated 138 derivative records from 50218 primary records. [2025-10-27T22:05:22.474049] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-27T22:05:22.481131] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-27T22:05:22.485712] [DEBUG] [LOCAL ] ARI: Derivative data saved (138 records). [2025-10-27T22:05:22.485902] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-27T22:05:22.495390] [INFO ] [MAIN ] Derivative Progress: 106/1881 symbols completed. ARI took 1.2s. Estimated remaining: 12m 20s. Rate: 143.9 symbols/min [2025-10-27T22:05:22.498055] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:22.508562] [DEBUG] [LOCAL ] ARMK: Derivative data saved (138 records). [2025-10-27T22:05:22.510232] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-27T22:05:22.512753] [INFO ] [MAIN ] Derivative Progress: 107/1881 symbols completed. ARMK took 1.2s. Estimated remaining: 12m 13s. Rate: 145.2 symbols/min [2025-10-27T22:05:22.513005] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:22.517492] [DEBUG] [LOCAL ] ARES: Derivative data saved (138 records). [2025-10-27T22:05:22.517685] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-27T22:05:22.520048] [INFO ] [MAIN ] Derivative Progress: 108/1881 symbols completed. ARES took 1.2s. Estimated remaining: 12m 6s. Rate: 146.6 symbols/min [2025-10-27T22:05:22.520365] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:22.527069] [DEBUG] [LOCAL ] ASBA: Loaded 3407 existing records from primary storage. [2025-10-27T22:05:22.527385] [INFO ] [MAIN ] ASBA: Loaded 3407 primary data records. [2025-10-27T22:05:22.881368] [DEBUG] [LOCAL ] AROC: Loaded 49007 existing records from primary storage. [2025-10-27T22:05:22.882985] [INFO ] [MAIN ] AROC: Loaded 49007 primary data records. [2025-10-27T22:05:22.882689] [DEBUG] [LOCAL ] AS: Loaded 53194 existing records from primary storage. [2025-10-27T22:05:22.888555] [INFO ] [MAIN ] AS: Loaded 53194 primary data records. [2025-10-27T22:05:23.607028] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:23.648490] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:23.691378] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:23.715243] [INFO ] [MAIN ] ASBA: Generated 138 derivative records from 3407 primary records. [2025-10-27T22:05:23.718487] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-27T22:05:23.735764] [DEBUG] [LOCAL ] ASBA: Derivative data saved (138 records). [2025-10-27T22:05:23.736121] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-27T22:05:23.738538] [INFO ] [MAIN ] Derivative Progress: 109/1881 symbols completed. ASBA took 1.2s. Estimated remaining: 12m 19s. Rate: 144.0 symbols/min [2025-10-27T22:05:23.738827] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:23.763795] [INFO ] [MAIN ] AROC: Generated 138 derivative records from 49007 primary records. [2025-10-27T22:05:23.765360] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-27T22:05:23.774440] [DEBUG] [LOCAL ] ASG: Loaded 19127 existing records from primary storage. [2025-10-27T22:05:23.774804] [INFO ] [MAIN ] ASG: Loaded 19127 primary data records. [2025-10-27T22:05:23.774036] [INFO ] [MAIN ] AS: Generated 138 derivative records from 53194 primary records. [2025-10-27T22:05:23.794697] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-27T22:05:23.797516] [DEBUG] [LOCAL ] AROC: Derivative data saved (138 records). [2025-10-27T22:05:23.822322] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-27T22:05:23.842873] [INFO ] [MAIN ] Derivative Progress: 110/1881 symbols completed. AROC took 1.3s. Estimated remaining: 12m 13s. Rate: 144.9 symbols/min [2025-10-27T22:05:23.857075] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:23.880982] [DEBUG] [LOCAL ] AS: Derivative data saved (138 records). [2025-10-27T22:05:23.893866] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-27T22:05:23.907298] [INFO ] [MAIN ] Derivative Progress: 111/1881 symbols completed. AS took 1.4s. Estimated remaining: 12m 7s. Rate: 146.1 symbols/min [2025-10-27T22:05:23.907979] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:24.138140] [DEBUG] [LOCAL ] ASGN: Loaded 36722 existing records from primary storage. [2025-10-27T22:05:24.138690] [INFO ] [MAIN ] ASGN: Loaded 36722 primary data records. [2025-10-27T22:05:24.231584] [DEBUG] [LOCAL ] ASH: Loaded 37142 existing records from primary storage. [2025-10-27T22:05:24.253044] [INFO ] [MAIN ] ASH: Loaded 37142 primary data records. [2025-10-27T22:05:24.584547] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:24.827249] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:24.844759] [INFO ] [MAIN ] ASG: Generated 138 derivative records from 19127 primary records. [2025-10-27T22:05:24.845867] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-27T22:05:24.860881] [DEBUG] [LOCAL ] ASG: Derivative data saved (138 records). [2025-10-27T22:05:24.861116] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-27T22:05:24.864239] [INFO ] [MAIN ] Derivative Progress: 112/1881 symbols completed. ASG took 1.1s. Estimated remaining: 12m 15s. Rate: 144.3 symbols/min [2025-10-27T22:05:24.866113] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:24.883035] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:24.931583] [INFO ] [MAIN ] ASGN: Generated 138 derivative records from 36722 primary records. [2025-10-27T22:05:24.929291] [DEBUG] [LOCAL ] ASIX: Loaded 22673 existing records from primary storage. [2025-10-27T22:05:24.931977] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-27T22:05:24.933688] [INFO ] [MAIN ] ASIX: Loaded 22673 primary data records. [2025-10-27T22:05:24.987442] [DEBUG] [LOCAL ] ASGN: Derivative data saved (138 records). [2025-10-27T22:05:25.001430] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-27T22:05:25.038059] [INFO ] [MAIN ] Derivative Progress: 113/1881 symbols completed. ASGN took 1.2s. Estimated remaining: 12m 11s. Rate: 145.1 symbols/min [2025-10-27T22:05:25.046535] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:25.080801] [INFO ] [MAIN ] ASH: Generated 138 derivative records from 37142 primary records. [2025-10-27T22:05:25.091252] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-27T22:05:25.296238] [DEBUG] [LOCAL ] ASH: Derivative data saved (138 records). [2025-10-27T22:05:25.320612] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-27T22:05:25.323200] [INFO ] [MAIN ] Derivative Progress: 114/1881 symbols completed. ASH took 1.4s. Estimated remaining: 12m 9s. Rate: 145.5 symbols/min [2025-10-27T22:05:25.323563] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:25.348692] [DEBUG] [LOCAL ] ASR: Loaded 9374 existing records from primary storage. [2025-10-27T22:05:25.348892] [INFO ] [MAIN ] ASR: Loaded 9374 primary data records. [2025-10-27T22:05:25.371384] [DEBUG] [LOCAL ] ASPN: Loaded 49804 existing records from primary storage. [2025-10-27T22:05:25.425823] [INFO ] [MAIN ] ASPN: Loaded 49804 primary data records. [2025-10-27T22:05:25.960261] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:26.005588] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:26.049507] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:26.069512] [INFO ] [MAIN ] ASIX: Generated 138 derivative records from 22673 primary records. [2025-10-27T22:05:26.075934] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-27T22:05:26.091101] [DEBUG] [LOCAL ] ASIX: Derivative data saved (138 records). [2025-10-27T22:05:26.092339] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-27T22:05:26.094768] [INFO ] [MAIN ] Derivative Progress: 115/1881 symbols completed. ASIX took 1.2s. Estimated remaining: 12m 14s. Rate: 144.4 symbols/min [2025-10-27T22:05:26.101450] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:26.117535] [INFO ] [MAIN ] ASR: Generated 138 derivative records from 9374 primary records. [2025-10-27T22:05:26.117749] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-27T22:05:26.120118] [INFO ] [MAIN ] ASPN: Generated 138 derivative records from 49804 primary records. [2025-10-27T22:05:26.120394] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-27T22:05:26.132251] [DEBUG] [LOCAL ] ASR: Derivative data saved (138 records). [2025-10-27T22:05:26.139048] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-27T22:05:26.142268] [INFO ] [MAIN ] Derivative Progress: 116/1881 symbols completed. ASR took 0.8s. Estimated remaining: 12m 8s. Rate: 145.5 symbols/min [2025-10-27T22:05:26.142699] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:26.145468] [DEBUG] [LOCAL ] ASPN: Derivative data saved (138 records). [2025-10-27T22:05:26.145706] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-27T22:05:26.148350] [INFO ] [MAIN ] Derivative Progress: 117/1881 symbols completed. ASPN took 1.1s. Estimated remaining: 12m 1s. Rate: 146.7 symbols/min [2025-10-27T22:05:26.148588] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:26.201386] [DEBUG] [LOCAL ] ASX: Loaded 52859 existing records from primary storage. [2025-10-27T22:05:26.201670] [INFO ] [MAIN ] ASX: Loaded 52859 primary data records. [2025-10-27T22:05:26.302784] [DEBUG] [LOCAL ] ATGE: Loaded 29886 existing records from primary storage. [2025-10-27T22:05:26.322026] [INFO ] [MAIN ] ATGE: Loaded 29886 primary data records. [2025-10-27T22:05:26.325686] [DEBUG] [LOCAL ] ATEN: Loaded 37301 existing records from primary storage. [2025-10-27T22:05:26.337678] [INFO ] [MAIN ] ATEN: Loaded 37301 primary data records. [2025-10-27T22:05:27.178677] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:27.211264] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:27.246094] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:27.289886] [INFO ] [MAIN ] ASX: Generated 138 derivative records from 52859 primary records. [2025-10-27T22:05:27.291065] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-27T22:05:27.307907] [DEBUG] [LOCAL ] ASX: Derivative data saved (138 records). [2025-10-27T22:05:27.308401] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-27T22:05:27.313929] [INFO ] [MAIN ] Derivative Progress: 118/1881 symbols completed. ASX took 1.2s. Estimated remaining: 12m 12s. Rate: 144.5 symbols/min [2025-10-27T22:05:27.317491] [INFO ] [MAIN ] ATGE: Generated 138 derivative records from 29886 primary records. [2025-10-27T22:05:27.317743] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-27T22:05:27.333300] [INFO ] [MAIN ] ATEN: Generated 138 derivative records from 37301 primary records. [2025-10-27T22:05:27.333749] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-27T22:05:27.335242] [DEBUG] [LOCAL ] ATGE: Derivative data saved (138 records). [2025-10-27T22:05:27.335433] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-27T22:05:27.345490] [INFO ] [MAIN ] Derivative Progress: 119/1881 symbols completed. ATGE took 1.2s. Estimated remaining: 12m 6s. Rate: 145.6 symbols/min [2025-10-27T22:05:27.348352] [DEBUG] [LOCAL ] ATEN: Derivative data saved (138 records). [2025-10-27T22:05:27.348432] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-27T22:05:27.350769] [INFO ] [MAIN ] Derivative Progress: 120/1881 symbols completed. ATEN took 1.2s. Estimated remaining: 11m 60s. Rate: 146.8 symbols/min [2025-10-27T22:05:27.351385] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:27.351331] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:27.351488] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:27.418273] [DEBUG] [LOCAL ] ATMU: Loaded 38247 existing records from primary storage. [2025-10-27T22:05:27.417451] [DEBUG] [LOCAL ] ATKR: Loaded 34497 existing records from primary storage. [2025-10-27T22:05:27.418488] [INFO ] [MAIN ] ATMU: Loaded 38247 primary data records. [2025-10-27T22:05:27.418545] [INFO ] [MAIN ] ATKR: Loaded 34497 primary data records. [2025-10-27T22:05:27.628415] [DEBUG] [LOCAL ] ATI: Loaded 51272 existing records from primary storage. [2025-10-27T22:05:27.631772] [INFO ] [MAIN ] ATI: Loaded 51272 primary data records. [2025-10-27T22:05:28.341413] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:28.371690] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:28.402405] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:28.456118] [INFO ] [MAIN ] ATKR: Generated 138 derivative records from 34497 primary records. [2025-10-27T22:05:28.458255] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-27T22:05:28.475220] [DEBUG] [LOCAL ] ATKR: Derivative data saved (138 records). [2025-10-27T22:05:28.479382] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-27T22:05:28.483977] [INFO ] [MAIN ] Derivative Progress: 121/1881 symbols completed. ATKR took 1.1s. Estimated remaining: 12m 10s. Rate: 144.7 symbols/min [2025-10-27T22:05:28.486806] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:28.486694] [INFO ] [MAIN ] ATMU: Generated 138 derivative records from 38247 primary records. [2025-10-27T22:05:28.490105] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-27T22:05:28.489869] [INFO ] [MAIN ] ATI: Generated 138 derivative records from 51272 primary records. [2025-10-27T22:05:28.490608] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-27T22:05:28.515586] [DEBUG] [LOCAL ] ATMU: Derivative data saved (138 records). [2025-10-27T22:05:28.513756] [DEBUG] [LOCAL ] ATI: Derivative data saved (138 records). [2025-10-27T22:05:28.515838] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-27T22:05:28.518777] [INFO ] [MAIN ] Derivative Progress: 122/1881 symbols completed. ATI took 1.2s. Estimated remaining: 12m 4s. Rate: 145.8 symbols/min [2025-10-27T22:05:28.515885] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-27T22:05:28.520974] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:28.521604] [INFO ] [MAIN ] Derivative Progress: 123/1881 symbols completed. ATMU took 1.2s. Estimated remaining: 11m 58s. Rate: 147.0 symbols/min [2025-10-27T22:05:28.521916] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:28.552352] [DEBUG] [LOCAL ] ATS: Loaded 16610 existing records from primary storage. [2025-10-27T22:05:28.559138] [INFO ] [MAIN ] ATS: Loaded 16610 primary data records. [2025-10-27T22:05:28.636170] [DEBUG] [LOCAL ] ATO: Loaded 41245 existing records from primary storage. [2025-10-27T22:05:28.647870] [INFO ] [MAIN ] ATO: Loaded 41245 primary data records. [2025-10-27T22:05:28.762402] [DEBUG] [LOCAL ] ATR: Loaded 30289 existing records from primary storage. [2025-10-27T22:05:28.779325] [INFO ] [MAIN ] ATR: Loaded 30289 primary data records. [2025-10-27T22:05:29.562865] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:29.568436] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:29.620311] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:29.697131] [INFO ] [MAIN ] ATS: Generated 138 derivative records from 16610 primary records. [2025-10-27T22:05:29.696972] [INFO ] [MAIN ] ATO: Generated 138 derivative records from 41245 primary records. [2025-10-27T22:05:29.697708] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-27T22:05:29.697886] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-27T22:05:29.712072] [DEBUG] [LOCAL ] ATO: Derivative data saved (138 records). [2025-10-27T22:05:29.712354] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-27T22:05:29.721456] [INFO ] [MAIN ] Derivative Progress: 124/1881 symbols completed. ATO took 1.2s. Estimated remaining: 12m 8s. Rate: 144.7 symbols/min [2025-10-27T22:05:29.724845] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:29.726413] [DEBUG] [LOCAL ] ATS: Derivative data saved (138 records). [2025-10-27T22:05:29.726578] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-27T22:05:29.728768] [INFO ] [MAIN ] Derivative Progress: 125/1881 symbols completed. ATS took 1.2s. Estimated remaining: 12m 2s. Rate: 145.9 symbols/min [2025-10-27T22:05:29.729030] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:29.731779] [INFO ] [MAIN ] ATR: Generated 138 derivative records from 30289 primary records. [2025-10-27T22:05:29.732010] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-27T22:05:29.745109] [DEBUG] [LOCAL ] ATR: Derivative data saved (138 records). [2025-10-27T22:05:29.745284] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-27T22:05:29.747604] [INFO ] [MAIN ] Derivative Progress: 126/1881 symbols completed. ATR took 1.2s. Estimated remaining: 11m 56s. Rate: 147.0 symbols/min [2025-10-27T22:05:29.747955] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:29.808563] [DEBUG] [LOCAL ] ATUS: Loaded 49931 existing records from primary storage. [2025-10-27T22:05:29.823060] [INFO ] [MAIN ] ATUS: Loaded 49931 primary data records. [2025-10-27T22:05:29.846570] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-27T22:05:29.889432] [DEBUG] [LOCAL ] AUB: Loaded 45688 existing records from primary storage. [2025-10-27T22:05:29.889617] [INFO ] [MAIN ] AU: Loaded 53079 primary data records. [2025-10-27T22:05:29.889548] [INFO ] [MAIN ] AUB: Loaded 45688 primary data records. [2025-10-27T22:05:30.747570] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:30.778454] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:30.806852] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:30.855302] [INFO ] [MAIN ] ATUS: Generated 138 derivative records from 49931 primary records. [2025-10-27T22:05:30.855878] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-27T22:05:30.871152] [DEBUG] [LOCAL ] ATUS: Derivative data saved (138 records). [2025-10-27T22:05:30.872370] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-27T22:05:30.874113] [INFO ] [MAIN ] Derivative Progress: 127/1881 symbols completed. ATUS took 1.1s. Estimated remaining: 12m 6s. Rate: 145.0 symbols/min [2025-10-27T22:05:30.877154] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:30.880479] [INFO ] [MAIN ] AU: Generated 138 derivative records from 53079 primary records. [2025-10-27T22:05:30.880736] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-27T22:05:30.896971] [DEBUG] [LOCAL ] AU: Derivative data saved (138 records). [2025-10-27T22:05:30.897121] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-27T22:05:30.901100] [INFO ] [MAIN ] AUB: Generated 138 derivative records from 45688 primary records. [2025-10-27T22:05:30.900736] [INFO ] [MAIN ] Derivative Progress: 128/1881 symbols completed. AU took 1.2s. Estimated remaining: 12m 0s. Rate: 146.0 symbols/min [2025-10-27T22:05:30.901235] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-27T22:05:30.901916] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:30.914280] [DEBUG] [LOCAL ] AUB: Derivative data saved (138 records). [2025-10-27T22:05:30.914587] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-27T22:05:30.917612] [INFO ] [MAIN ] Derivative Progress: 129/1881 symbols completed. AUB took 1.2s. Estimated remaining: 11m 55s. Rate: 147.1 symbols/min [2025-10-27T22:05:30.919820] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:30.933118] [DEBUG] [LOCAL ] AVAL: Loaded 8321 existing records from primary storage. [2025-10-27T22:05:30.933338] [INFO ] [MAIN ] AVAL: Loaded 8321 primary data records. [2025-10-27T22:05:31.046938] [DEBUG] [LOCAL ] AVA: Loaded 37994 existing records from primary storage. [2025-10-27T22:05:31.063473] [INFO ] [MAIN ] AVA: Loaded 37994 primary data records. [2025-10-27T22:05:31.380106] [DEBUG] [LOCAL ] AVB: Loaded 41943 existing records from primary storage. [2025-10-27T22:05:31.380311] [INFO ] [MAIN ] AVB: Loaded 41943 primary data records. [2025-10-27T22:05:31.890893] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:31.927971] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:31.972852] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:32.010793] [INFO ] [MAIN ] AVAL: Generated 138 derivative records from 8321 primary records. [2025-10-27T22:05:32.012008] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-27T22:05:32.027396] [DEBUG] [LOCAL ] AVAL: Derivative data saved (138 records). [2025-10-27T22:05:32.028097] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-27T22:05:32.032503] [INFO ] [MAIN ] Derivative Progress: 130/1881 symbols completed. AVAL took 1.1s. Estimated remaining: 12m 4s. Rate: 145.2 symbols/min [2025-10-27T22:05:32.032846] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:32.045060] [INFO ] [MAIN ] AVA: Generated 138 derivative records from 37994 primary records. [2025-10-27T22:05:32.045292] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-27T22:05:32.067939] [DEBUG] [LOCAL ] AVA: Derivative data saved (138 records). [2025-10-27T22:05:32.070101] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-27T22:05:32.069963] [INFO ] [MAIN ] AVB: Generated 138 derivative records from 41943 primary records. [2025-10-27T22:05:32.072601] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-27T22:05:32.072512] [INFO ] [MAIN ] Derivative Progress: 131/1881 symbols completed. AVA took 1.2s. Estimated remaining: 11m 58s. Rate: 146.2 symbols/min [2025-10-27T22:05:32.073320] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:32.092444] [DEBUG] [LOCAL ] AVB: Derivative data saved (138 records). [2025-10-27T22:05:32.092707] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-27T22:05:32.095439] [INFO ] [MAIN ] Derivative Progress: 132/1881 symbols completed. AVB took 1.2s. Estimated remaining: 11m 53s. Rate: 147.2 symbols/min [2025-10-27T22:05:32.096338] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:32.096219] [DEBUG] [LOCAL ] AVD: Loaded 20940 existing records from primary storage. [2025-10-27T22:05:32.097166] [INFO ] [MAIN ] AVD: Loaded 20940 primary data records. [2025-10-27T22:05:32.281229] [DEBUG] [LOCAL ] AVK: Loaded 18417 existing records from primary storage. [2025-10-27T22:05:32.415434] [DEBUG] [LOCAL ] AVNS: Loaded 33316 existing records from primary storage. [2025-10-27T22:05:32.423291] [INFO ] [MAIN ] AVNS: Loaded 33316 primary data records. [2025-10-27T22:05:32.424010] [INFO ] [MAIN ] AVK: Loaded 18417 primary data records. [2025-10-27T22:05:33.094291] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:33.136875] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:33.172370] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:33.201684] [INFO ] [MAIN ] AVD: Generated 138 derivative records from 20940 primary records. [2025-10-27T22:05:33.205835] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-27T22:05:33.228472] [DEBUG] [LOCAL ] AVD: Derivative data saved (138 records). [2025-10-27T22:05:33.230922] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-27T22:05:33.234708] [INFO ] [MAIN ] Derivative Progress: 133/1881 symbols completed. AVD took 1.2s. Estimated remaining: 12m 2s. Rate: 145.3 symbols/min [2025-10-27T22:05:33.244939] [INFO ] [MAIN ] AVNS: Generated 138 derivative records from 33316 primary records. [2025-10-27T22:05:33.247814] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-27T22:05:33.247984] [INFO ] [MAIN ] AVK: Generated 138 derivative records from 18417 primary records. [2025-10-27T22:05:33.248666] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-27T22:05:33.272348] [DEBUG] [LOCAL ] AVNS: Derivative data saved (138 records). [2025-10-27T22:05:33.272440] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-27T22:05:33.271077] [DEBUG] [LOCAL ] AVK: Derivative data saved (138 records). [2025-10-27T22:05:33.274680] [INFO ] [MAIN ] Derivative Progress: 134/1881 symbols completed. AVNS took 1.2s. Estimated remaining: 11m 57s. Rate: 146.3 symbols/min [2025-10-27T22:05:33.272567] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-27T22:05:33.277094] [INFO ] [MAIN ] Derivative Progress: 135/1881 symbols completed. AVK took 1.2s. Estimated remaining: 11m 51s. Rate: 147.4 symbols/min [2025-10-27T22:05:33.277425] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:33.277568] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:33.277478] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:33.342626] [DEBUG] [LOCAL ] AVNT: Loaded 38236 existing records from primary storage. [2025-10-27T22:05:33.342805] [INFO ] [MAIN ] AVNT: Loaded 38236 primary data records. [2025-10-27T22:05:33.388162] [DEBUG] [LOCAL ] AVY: Loaded 37987 existing records from primary storage. [2025-10-27T22:05:33.393427] [INFO ] [MAIN ] AVY: Loaded 37987 primary data records. [2025-10-27T22:05:33.433346] [DEBUG] [LOCAL ] AVTR: Loaded 53570 existing records from primary storage. [2025-10-27T22:05:33.438807] [INFO ] [MAIN ] AVTR: Loaded 53570 primary data records. [2025-10-27T22:05:34.286838] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:34.288963] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:34.335869] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:34.419867] [INFO ] [MAIN ] AVNT: Generated 138 derivative records from 38236 primary records. [2025-10-27T22:05:34.420785] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-27T22:05:34.423264] [INFO ] [MAIN ] AVTR: Generated 138 derivative records from 53570 primary records. [2025-10-27T22:05:34.424635] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-27T22:05:34.449636] [DEBUG] [LOCAL ] AVNT: Derivative data saved (138 records). [2025-10-27T22:05:34.449825] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-27T22:05:34.454867] [INFO ] [MAIN ] Derivative Progress: 136/1881 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 0s. Rate: 145.3 symbols/min [2025-10-27T22:05:34.455152] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:34.457543] [DEBUG] [LOCAL ] AVTR: Derivative data saved (138 records). [2025-10-27T22:05:34.458259] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-27T22:05:34.464106] [INFO ] [MAIN ] Derivative Progress: 137/1881 symbols completed. AVTR took 1.2s. Estimated remaining: 11m 55s. Rate: 146.4 symbols/min [2025-10-27T22:05:34.461037] [INFO ] [MAIN ] AVY: Generated 138 derivative records from 37987 primary records. [2025-10-27T22:05:34.464557] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-27T22:05:34.464365] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:34.478830] [DEBUG] [LOCAL ] AVY: Derivative data saved (138 records). [2025-10-27T22:05:34.478988] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-27T22:05:34.481279] [INFO ] [MAIN ] Derivative Progress: 138/1881 symbols completed. AVY took 1.2s. Estimated remaining: 11m 49s. Rate: 147.4 symbols/min [2025-10-27T22:05:34.481603] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:34.506388] [DEBUG] [LOCAL ] AWF: Loaded 23920 existing records from primary storage. [2025-10-27T22:05:34.506680] [INFO ] [MAIN ] AWF: Loaded 23920 primary data records. [2025-10-27T22:05:34.558879] [DEBUG] [LOCAL ] AWI: Loaded 24899 existing records from primary storage. [2025-10-27T22:05:34.575746] [INFO ] [MAIN ] AWI: Loaded 24899 primary data records. [2025-10-27T22:05:35.167184] [DEBUG] [LOCAL ] AWK: Loaded 48248 existing records from primary storage. [2025-10-27T22:05:35.189905] [INFO ] [MAIN ] AWK: Loaded 48248 primary data records. [2025-10-27T22:05:35.563613] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:35.563132] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:35.622122] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:35.681021] [INFO ] [MAIN ] AWI: Generated 138 derivative records from 24899 primary records. [2025-10-27T22:05:35.684329] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-27T22:05:35.701791] [INFO ] [MAIN ] AWF: Generated 138 derivative records from 23920 primary records. [2025-10-27T22:05:35.701924] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-27T22:05:35.705800] [DEBUG] [LOCAL ] AWI: Derivative data saved (138 records). [2025-10-27T22:05:35.706207] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-27T22:05:35.722660] [INFO ] [MAIN ] Derivative Progress: 139/1881 symbols completed. AWI took 1.3s. Estimated remaining: 11m 60s. Rate: 145.3 symbols/min [2025-10-27T22:05:35.722868] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:35.720553] [DEBUG] [LOCAL ] AWF: Derivative data saved (138 records). [2025-10-27T22:05:35.723096] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-27T22:05:35.727025] [INFO ] [MAIN ] Derivative Progress: 140/1881 symbols completed. AWF took 1.3s. Estimated remaining: 11m 54s. Rate: 146.3 symbols/min [2025-10-27T22:05:35.727196] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:35.730006] [INFO ] [MAIN ] AWK: Generated 138 derivative records from 48248 primary records. [2025-10-27T22:05:35.730150] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-27T22:05:35.743215] [DEBUG] [LOCAL ] AWK: Derivative data saved (138 records). [2025-10-27T22:05:35.743485] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-27T22:05:35.745968] [INFO ] [MAIN ] Derivative Progress: 141/1881 symbols completed. AWK took 1.3s. Estimated remaining: 11m 49s. Rate: 147.3 symbols/min [2025-10-27T22:05:35.746226] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:35.780482] [DEBUG] [LOCAL ] AX: Loaded 27347 existing records from primary storage. [2025-10-27T22:05:35.780003] [DEBUG] [LOCAL ] AWR: Loaded 22460 existing records from primary storage. [2025-10-27T22:05:35.780686] [INFO ] [MAIN ] AWR: Loaded 22460 primary data records. [2025-10-27T22:05:35.780875] [INFO ] [MAIN ] AX: Loaded 27347 primary data records. [2025-10-27T22:05:36.108125] [DEBUG] [LOCAL ] AXL: Loaded 50492 existing records from primary storage. [2025-10-27T22:05:36.124428] [INFO ] [MAIN ] AXL: Loaded 50492 primary data records. [2025-10-27T22:05:36.759856] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:36.784249] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:36.828730] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:36.873757] [INFO ] [MAIN ] AWR: Generated 138 derivative records from 22460 primary records. [2025-10-27T22:05:36.877157] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-27T22:05:36.891911] [DEBUG] [LOCAL ] AWR: Derivative data saved (138 records). [2025-10-27T22:05:36.892055] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-27T22:05:36.893950] [INFO ] [MAIN ] Derivative Progress: 142/1881 symbols completed. AWR took 1.2s. Estimated remaining: 11m 57s. Rate: 145.4 symbols/min [2025-10-27T22:05:36.894147] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:36.899450] [INFO ] [MAIN ] AX: Generated 138 derivative records from 27347 primary records. [2025-10-27T22:05:36.899833] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-27T22:05:36.916118] [DEBUG] [LOCAL ] AX: Derivative data saved (138 records). [2025-10-27T22:05:36.917153] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-27T22:05:36.919675] [INFO ] [MAIN ] Derivative Progress: 143/1881 symbols completed. AX took 1.2s. Estimated remaining: 11m 52s. Rate: 146.4 symbols/min [2025-10-27T22:05:36.919850] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:36.922598] [INFO ] [MAIN ] AXL: Generated 138 derivative records from 50492 primary records. [2025-10-27T22:05:36.922916] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-27T22:05:36.935746] [DEBUG] [LOCAL ] AXL: Derivative data saved (138 records). [2025-10-27T22:05:36.938067] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-27T22:05:36.938232] [DEBUG] [LOCAL ] AXR: Loaded 2799 existing records from primary storage. [2025-10-27T22:05:36.941202] [INFO ] [MAIN ] Derivative Progress: 144/1881 symbols completed. AXL took 1.2s. Estimated remaining: 11m 47s. Rate: 147.4 symbols/min [2025-10-27T22:05:36.941530] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:36.941732] [INFO ] [MAIN ] AXR: Loaded 2799 primary data records. [2025-10-27T22:05:37.297121] [DEBUG] [LOCAL ] AXP: Loaded 53134 existing records from primary storage. [2025-10-27T22:05:37.303430] [INFO ] [MAIN ] AXP: Loaded 53134 primary data records. [2025-10-27T22:05:37.312021] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-27T22:05:37.332524] [INFO ] [MAIN ] AXS: Loaded 38703 primary data records. [2025-10-27T22:05:37.920493] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:05:37.986853] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:37.988013] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:38.028275] [INFO ] [MAIN ] AXR: Generated 138 derivative records from 2799 primary records. [2025-10-27T22:05:38.028464] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-27T22:05:38.041364] [DEBUG] [LOCAL ] AXR: Derivative data saved (138 records). [2025-10-27T22:05:38.041868] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-27T22:05:38.043897] [INFO ] [MAIN ] Derivative Progress: 145/1881 symbols completed. AXR took 1.1s. Estimated remaining: 11m 55s. Rate: 145.6 symbols/min [2025-10-27T22:05:38.046814] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:38.074729] [INFO ] [MAIN ] AXS: Generated 138 derivative records from 38703 primary records. [2025-10-27T22:05:38.074934] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-27T22:05:38.091877] [INFO ] [MAIN ] AXP: Generated 138 derivative records from 53134 primary records. [2025-10-27T22:05:38.103837] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-27T22:05:38.103639] [DEBUG] [LOCAL ] AXS: Derivative data saved (138 records). [2025-10-27T22:05:38.104305] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-27T22:05:38.106572] [INFO ] [MAIN ] Derivative Progress: 146/1881 symbols completed. AXS took 1.2s. Estimated remaining: 11m 51s. Rate: 146.5 symbols/min [2025-10-27T22:05:38.106777] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:38.119688] [DEBUG] [LOCAL ] AXP: Derivative data saved (138 records). [2025-10-27T22:05:38.132362] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-27T22:05:38.135596] [INFO ] [MAIN ] Derivative Progress: 147/1881 symbols completed. AXP took 1.2s. Estimated remaining: 11m 46s. Rate: 147.4 symbols/min [2025-10-27T22:05:38.135851] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:38.137389] [DEBUG] [LOCAL ] AXTA: Loaded 52292 existing records from primary storage. [2025-10-27T22:05:38.137637] [INFO ] [MAIN ] AXTA: Loaded 52292 primary data records. [2025-10-27T22:05:38.263139] [DEBUG] [LOCAL ] AYI: Loaded 23636 existing records from primary storage. [2025-10-27T22:05:38.268554] [DEBUG] [LOCAL ] AZO: Loaded 10621 existing records from primary storage. [2025-10-27T22:05:38.268811] [INFO ] [MAIN ] AZO: Loaded 10621 primary data records. [2025-10-27T22:05:38.274016] [INFO ] [MAIN ] AYI: Loaded 23636 primary data records. [2025-10-27T22:05:39.079325] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:39.145362] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:05:39.145007] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:39.200112] [INFO ] [MAIN ] AXTA: Generated 138 derivative records from 52292 primary records. [2025-10-27T22:05:39.202059] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-27T22:05:39.217019] [DEBUG] [LOCAL ] AXTA: Derivative data saved (138 records). [2025-10-27T22:05:39.217309] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-27T22:05:39.222580] [INFO ] [MAIN ] Derivative Progress: 148/1881 symbols completed. AXTA took 1.2s. Estimated remaining: 11m 53s. Rate: 145.8 symbols/min [2025-10-27T22:05:39.236986] [INFO ] [MAIN ] AYI: Generated 138 derivative records from 23636 primary records. [2025-10-27T22:05:39.237285] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-27T22:05:39.248374] [INFO ] [MAIN ] AZO: Generated 138 derivative records from 10621 primary records. [2025-10-27T22:05:39.250787] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-27T22:05:39.253344] [DEBUG] [LOCAL ] AYI: Derivative data saved (138 records). [2025-10-27T22:05:39.253430] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-27T22:05:39.255999] [INFO ] [MAIN ] Derivative Progress: 149/1881 symbols completed. AYI took 1.1s. Estimated remaining: 11m 48s. Rate: 146.7 symbols/min [2025-10-27T22:05:39.267210] [DEBUG] [LOCAL ] AZO: Derivative data saved (138 records). [2025-10-27T22:05:39.267295] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-27T22:05:39.269562] [INFO ] [MAIN ] Derivative Progress: 150/1881 symbols completed. AZO took 1.1s. Estimated remaining: 11m 43s. Rate: 147.6 symbols/min [2025-10-27T22:05:39.270105] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:39.270611] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:39.270217] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:39.293135] [DEBUG] [LOCAL ] AZZ: Loaded 22861 existing records from primary storage. [2025-10-27T22:05:39.293264] [INFO ] [MAIN ] AZZ: Loaded 22861 primary data records. [2025-10-27T22:05:39.631980] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-27T22:05:39.645092] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-27T22:05:39.706717] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-27T22:05:39.740091] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-27T22:05:40.278994] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:40.324083] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:40.358405] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:40.383543] [INFO ] [MAIN ] AZZ: Generated 138 derivative records from 22861 primary records. [2025-10-27T22:05:40.384056] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-27T22:05:40.403489] [DEBUG] [LOCAL ] AZZ: Derivative data saved (138 records). [2025-10-27T22:05:40.403928] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-27T22:05:40.405975] [INFO ] [MAIN ] Derivative Progress: 151/1881 symbols completed. AZZ took 1.1s. Estimated remaining: 11m 51s. Rate: 145.9 symbols/min [2025-10-27T22:05:40.407576] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:40.429752] [INFO ] [MAIN ] BA: Generated 138 derivative records from 53790 primary records. [2025-10-27T22:05:40.430059] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-27T22:05:40.447331] [DEBUG] [LOCAL ] BA: Derivative data saved (138 records). [2025-10-27T22:05:40.449455] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-27T22:05:40.449302] [INFO ] [MAIN ] BAC: Generated 138 derivative records from 53808 primary records. [2025-10-27T22:05:40.449671] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-27T22:05:40.451527] [INFO ] [MAIN ] Derivative Progress: 152/1881 symbols completed. BA took 1.2s. Estimated remaining: 11m 47s. Rate: 146.8 symbols/min [2025-10-27T22:05:40.451843] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:40.465194] [DEBUG] [LOCAL ] BAC: Derivative data saved (138 records). [2025-10-27T22:05:40.478502] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-27T22:05:40.481098] [INFO ] [MAIN ] Derivative Progress: 153/1881 symbols completed. BAC took 1.2s. Estimated remaining: 11m 42s. Rate: 147.7 symbols/min [2025-10-27T22:05:40.481329] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:40.511146] [DEBUG] [LOCAL ] BAH: Loaded 51639 existing records from primary storage. [2025-10-27T22:05:40.511468] [INFO ] [MAIN ] BAH: Loaded 51639 primary data records. [2025-10-27T22:05:40.622876] [DEBUG] [LOCAL ] BAK: Loaded 39231 existing records from primary storage. [2025-10-27T22:05:40.636878] [INFO ] [MAIN ] BAK: Loaded 39231 primary data records. [2025-10-27T22:05:40.942671] [DEBUG] [LOCAL ] BALL: Loaded 51906 existing records from primary storage. [2025-10-27T22:05:40.946931] [INFO ] [MAIN ] BALL: Loaded 51906 primary data records. [2025-10-27T22:05:41.514343] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:41.552372] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:41.599226] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:41.625098] [INFO ] [MAIN ] BAH: Generated 138 derivative records from 51639 primary records. [2025-10-27T22:05:41.627557] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-27T22:05:41.648905] [DEBUG] [LOCAL ] BAH: Derivative data saved (138 records). [2025-10-27T22:05:41.649671] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-27T22:05:41.653901] [INFO ] [MAIN ] Derivative Progress: 154/1881 symbols completed. BAH took 1.2s. Estimated remaining: 11m 50s. Rate: 145.9 symbols/min [2025-10-27T22:05:41.656533] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:41.670317] [INFO ] [MAIN ] BAK: Generated 138 derivative records from 39231 primary records. [2025-10-27T22:05:41.670588] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-27T22:05:41.687289] [DEBUG] [LOCAL ] BAK: Derivative data saved (138 records). [2025-10-27T22:05:41.687887] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-27T22:05:41.690272] [INFO ] [MAIN ] Derivative Progress: 155/1881 symbols completed. BAK took 1.2s. Estimated remaining: 11m 46s. Rate: 146.7 symbols/min [2025-10-27T22:05:41.692412] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:41.692578] [INFO ] [MAIN ] BALL: Generated 138 derivative records from 51906 primary records. [2025-10-27T22:05:41.693380] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-27T22:05:41.718525] [DEBUG] [LOCAL ] BALL: Derivative data saved (138 records). [2025-10-27T22:05:41.718762] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-27T22:05:41.721817] [INFO ] [MAIN ] Derivative Progress: 156/1881 symbols completed. BALL took 1.2s. Estimated remaining: 11m 41s. Rate: 147.6 symbols/min [2025-10-27T22:05:41.722179] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:41.741771] [DEBUG] [LOCAL ] BAM: Loaded 52063 existing records from primary storage. [2025-10-27T22:05:41.742043] [INFO ] [MAIN ] BAM: Loaded 52063 primary data records. [2025-10-27T22:05:41.915332] [DEBUG] [LOCAL ] BAP: Loaded 24970 existing records from primary storage. [2025-10-27T22:05:41.963238] [INFO ] [MAIN ] BAP: Loaded 24970 primary data records. [2025-10-27T22:05:42.149908] [DEBUG] [LOCAL ] BANC: Loaded 51382 existing records from primary storage. [2025-10-27T22:05:42.157425] [INFO ] [MAIN ] BANC: Loaded 51382 primary data records. [2025-10-27T22:05:42.738354] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:42.775249] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:42.810973] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:42.855666] [INFO ] [MAIN ] BAM: Generated 138 derivative records from 52063 primary records. [2025-10-27T22:05:42.858852] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-27T22:05:42.876077] [DEBUG] [LOCAL ] BAM: Derivative data saved (138 records). [2025-10-27T22:05:42.876488] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-27T22:05:42.881250] [INFO ] [MAIN ] Derivative Progress: 157/1881 symbols completed. BAM took 1.2s. Estimated remaining: 11m 49s. Rate: 145.9 symbols/min [2025-10-27T22:05:42.881608] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:42.886006] [INFO ] [MAIN ] BAP: Generated 138 derivative records from 24970 primary records. [2025-10-27T22:05:42.888121] [INFO ] [MAIN ] BANC: Generated 138 derivative records from 51382 primary records. [2025-10-27T22:05:42.888308] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-27T22:05:42.888391] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-27T22:05:42.911522] [DEBUG] [LOCAL ] BAP: Derivative data saved (138 records). [2025-10-27T22:05:42.912984] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-27T22:05:42.915070] [INFO ] [MAIN ] Derivative Progress: 158/1881 symbols completed. BAP took 1.2s. Estimated remaining: 11m 45s. Rate: 146.7 symbols/min [2025-10-27T22:05:42.912917] [DEBUG] [LOCAL ] BANC: Derivative data saved (138 records). [2025-10-27T22:05:42.915261] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:42.915747] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-27T22:05:42.918266] [INFO ] [MAIN ] Derivative Progress: 159/1881 symbols completed. BANC took 1.2s. Estimated remaining: 11m 40s. Rate: 147.7 symbols/min [2025-10-27T22:05:42.918486] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:42.946546] [DEBUG] [LOCAL ] BARK: Loaded 37982 existing records from primary storage. [2025-10-27T22:05:42.946732] [INFO ] [MAIN ] BARK: Loaded 37982 primary data records. [2025-10-27T22:05:43.296765] [DEBUG] [LOCAL ] BB: Loaded 52860 existing records from primary storage. [2025-10-27T22:05:43.297025] [INFO ] [MAIN ] BB: Loaded 52860 primary data records. [2025-10-27T22:05:43.309166] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-27T22:05:43.328872] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-27T22:05:43.982576] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:44.024500] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:44.069486] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:44.107045] [INFO ] [MAIN ] BARK: Generated 138 derivative records from 37982 primary records. [2025-10-27T22:05:44.110181] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-27T22:05:44.125640] [DEBUG] [LOCAL ] BARK: Derivative data saved (138 records). [2025-10-27T22:05:44.125827] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-27T22:05:44.129034] [INFO ] [MAIN ] Derivative Progress: 160/1881 symbols completed. BARK took 1.2s. Estimated remaining: 11m 48s. Rate: 145.8 symbols/min [2025-10-27T22:05:44.129251] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:44.135926] [INFO ] [MAIN ] BB: Generated 138 derivative records from 52860 primary records. [2025-10-27T22:05:44.136343] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-27T22:05:44.152978] [DEBUG] [LOCAL ] BB: Derivative data saved (138 records). [2025-10-27T22:05:44.153954] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-27T22:05:44.157169] [INFO ] [MAIN ] Derivative Progress: 161/1881 symbols completed. BB took 1.2s. Estimated remaining: 11m 43s. Rate: 146.7 symbols/min [2025-10-27T22:05:44.157316] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:44.166067] [INFO ] [MAIN ] BBAI: Generated 138 derivative records from 53820 primary records. [2025-10-27T22:05:44.166296] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-27T22:05:44.189934] [DEBUG] [LOCAL ] BBAI: Derivative data saved (138 records). [2025-10-27T22:05:44.190165] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-27T22:05:44.193106] [INFO ] [MAIN ] Derivative Progress: 162/1881 symbols completed. BBAI took 1.3s. Estimated remaining: 11m 39s. Rate: 147.5 symbols/min [2025-10-27T22:05:44.193440] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:44.223877] [DEBUG] [LOCAL ] BBAR: Loaded 42596 existing records from primary storage. [2025-10-27T22:05:44.224069] [INFO ] [MAIN ] BBAR: Loaded 42596 primary data records. [2025-10-27T22:05:44.332304] [DEBUG] [LOCAL ] BBD: Loaded 53275 existing records from primary storage. [2025-10-27T22:05:44.345048] [INFO ] [MAIN ] BBD: Loaded 53275 primary data records. [2025-10-27T22:05:44.541269] [DEBUG] [LOCAL ] BBDC: Loaded 32408 existing records from primary storage. [2025-10-27T22:05:44.664790] [INFO ] [MAIN ] BBDC: Loaded 32408 primary data records. [2025-10-27T22:05:45.190434] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:45.240505] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:45.268878] [INFO ] [MAIN ] BBAR: Generated 138 derivative records from 42596 primary records. [2025-10-27T22:05:45.284088] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-27T22:05:45.284867] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:45.309279] [DEBUG] [LOCAL ] BBAR: Derivative data saved (138 records). [2025-10-27T22:05:45.309806] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-27T22:05:45.311720] [INFO ] [MAIN ] Derivative Progress: 163/1881 symbols completed. BBAR took 1.2s. Estimated remaining: 11m 46s. Rate: 146.0 symbols/min [2025-10-27T22:05:45.340547] [INFO ] [MAIN ] BBD: Generated 138 derivative records from 53275 primary records. [2025-10-27T22:05:45.342040] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-27T22:05:45.359419] [DEBUG] [LOCAL ] BBD: Derivative data saved (138 records). [2025-10-27T22:05:45.359710] [INFO ] [MAIN ] BBDC: Generated 138 derivative records from 32408 primary records. [2025-10-27T22:05:45.359800] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-27T22:05:45.359975] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-27T22:05:45.362668] [INFO ] [MAIN ] Derivative Progress: 164/1881 symbols completed. BBD took 1.2s. Estimated remaining: 11m 42s. Rate: 146.7 symbols/min [2025-10-27T22:05:45.374450] [DEBUG] [LOCAL ] BBDC: Derivative data saved (138 records). [2025-10-27T22:05:45.374514] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-27T22:05:45.377074] [INFO ] [MAIN ] Derivative Progress: 165/1881 symbols completed. BBDC took 1.2s. Estimated remaining: 11m 38s. Rate: 147.6 symbols/min [2025-10-27T22:05:45.377450] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:45.377603] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:45.377514] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:45.384980] [DEBUG] [LOCAL ] BBU: Loaded 5811 existing records from primary storage. [2025-10-27T22:05:45.385147] [INFO ] [MAIN ] BBU: Loaded 5811 primary data records. [2025-10-27T22:05:45.495747] [DEBUG] [LOCAL ] BBUC: Loaded 13766 existing records from primary storage. [2025-10-27T22:05:45.506811] [INFO ] [MAIN ] BBUC: Loaded 13766 primary data records. [2025-10-27T22:05:45.900804] [DEBUG] [LOCAL ] BBVA: Loaded 48999 existing records from primary storage. [2025-10-27T22:05:45.940814] [INFO ] [MAIN ] BBVA: Loaded 48999 primary data records. [2025-10-27T22:05:46.371889] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:46.412252] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:46.457442] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:46.478092] [INFO ] [MAIN ] BBU: Generated 138 derivative records from 5811 primary records. [2025-10-27T22:05:46.479121] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-27T22:05:46.497547] [DEBUG] [LOCAL ] BBU: Derivative data saved (138 records). [2025-10-27T22:05:46.498036] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-27T22:05:46.500959] [INFO ] [MAIN ] Derivative Progress: 166/1881 symbols completed. BBU took 1.1s. Estimated remaining: 11m 45s. Rate: 146.1 symbols/min [2025-10-27T22:05:46.503859] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:46.511777] [INFO ] [MAIN ] BBUC: Generated 138 derivative records from 13766 primary records. [2025-10-27T22:05:46.514478] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-27T22:05:46.534718] [DEBUG] [LOCAL ] BBUC: Derivative data saved (138 records). [2025-10-27T22:05:46.536909] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-27T22:05:46.539259] [INFO ] [MAIN ] Derivative Progress: 167/1881 symbols completed. BBUC took 1.2s. Estimated remaining: 11m 40s. Rate: 146.9 symbols/min [2025-10-27T22:05:46.539526] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:46.543374] [INFO ] [MAIN ] BBVA: Generated 138 derivative records from 48999 primary records. [2025-10-27T22:05:46.543474] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-27T22:05:46.552823] [DEBUG] [LOCAL ] BBW: Loaded 26942 existing records from primary storage. [2025-10-27T22:05:46.561719] [INFO ] [MAIN ] BBW: Loaded 26942 primary data records. [2025-10-27T22:05:46.584931] [DEBUG] [LOCAL ] BBVA: Derivative data saved (138 records). [2025-10-27T22:05:46.585116] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-27T22:05:46.603012] [INFO ] [MAIN ] Derivative Progress: 168/1881 symbols completed. BBVA took 1.2s. Estimated remaining: 11m 36s. Rate: 147.6 symbols/min [2025-10-27T22:05:46.603215] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:46.885624] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-27T22:05:46.885981] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-27T22:05:47.079669] [DEBUG] [LOCAL ] BBY: Loaded 53430 existing records from primary storage. [2025-10-27T22:05:47.209000] [INFO ] [MAIN ] BBY: Loaded 53430 primary data records. [2025-10-27T22:05:47.346995] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:47.621168] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:47.644321] [INFO ] [MAIN ] BBW: Generated 138 derivative records from 26942 primary records. [2025-10-27T22:05:47.646021] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-27T22:05:47.668850] [DEBUG] [LOCAL ] BBW: Derivative data saved (138 records). [2025-10-27T22:05:47.673814] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-27T22:05:47.674357] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:47.679048] [INFO ] [MAIN ] Derivative Progress: 169/1881 symbols completed. BBW took 1.2s. Estimated remaining: 11m 43s. Rate: 146.2 symbols/min [2025-10-27T22:05:47.679595] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:47.739548] [INFO ] [MAIN ] BBWI: Generated 138 derivative records from 53591 primary records. [2025-10-27T22:05:47.743012] [INFO ] [MAIN ] BBY: Generated 138 derivative records from 53430 primary records. [2025-10-27T22:05:47.743151] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-27T22:05:47.743876] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-27T22:05:47.781864] [DEBUG] [LOCAL ] BBY: Derivative data saved (138 records). [2025-10-27T22:05:47.779403] [DEBUG] [LOCAL ] BBWI: Derivative data saved (138 records). [2025-10-27T22:05:47.782121] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-27T22:05:47.782210] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-27T22:05:47.785161] [INFO ] [MAIN ] Derivative Progress: 170/1881 symbols completed. BBWI took 1.2s. Estimated remaining: 11m 39s. Rate: 146.8 symbols/min [2025-10-27T22:05:47.785374] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:47.787964] [INFO ] [MAIN ] Derivative Progress: 171/1881 symbols completed. BBY took 1.2s. Estimated remaining: 11m 35s. Rate: 147.7 symbols/min [2025-10-27T22:05:47.789807] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:47.789542] [DEBUG] [LOCAL ] BC: Loaded 43867 existing records from primary storage. [2025-10-27T22:05:47.790343] [INFO ] [MAIN ] BC: Loaded 43867 primary data records. [2025-10-27T22:05:48.001910] [DEBUG] [LOCAL ] BCC: Loaded 28474 existing records from primary storage. [2025-10-27T22:05:48.002177] [INFO ] [MAIN ] BCC: Loaded 28474 primary data records. [2025-10-27T22:05:48.196364] [DEBUG] [LOCAL ] BCAT: Loaded 34005 existing records from primary storage. [2025-10-27T22:05:48.207199] [INFO ] [MAIN ] BCAT: Loaded 34005 primary data records. [2025-10-27T22:05:48.755365] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:48.794488] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:48.845397] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:48.859884] [INFO ] [MAIN ] BC: Generated 138 derivative records from 43867 primary records. [2025-10-27T22:05:48.862556] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-27T22:05:48.878626] [DEBUG] [LOCAL ] BC: Derivative data saved (138 records). [2025-10-27T22:05:48.879393] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-27T22:05:48.884942] [INFO ] [MAIN ] Derivative Progress: 172/1881 symbols completed. BC took 1.2s. Estimated remaining: 11m 41s. Rate: 146.2 symbols/min [2025-10-27T22:05:48.885096] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:48.898503] [INFO ] [MAIN ] BCC: Generated 138 derivative records from 28474 primary records. [2025-10-27T22:05:48.900153] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-27T22:05:48.915222] [DEBUG] [LOCAL ] BCC: Derivative data saved (138 records). [2025-10-27T22:05:48.915546] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-27T22:05:48.918490] [INFO ] [MAIN ] Derivative Progress: 173/1881 symbols completed. BCC took 1.1s. Estimated remaining: 11m 37s. Rate: 147.0 symbols/min [2025-10-27T22:05:48.919036] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:48.939512] [INFO ] [MAIN ] BCAT: Generated 138 derivative records from 34005 primary records. [2025-10-27T22:05:48.939807] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-27T22:05:48.951960] [DEBUG] [LOCAL ] BCAT: Derivative data saved (138 records). [2025-10-27T22:05:48.952130] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-27T22:05:48.954385] [INFO ] [MAIN ] Derivative Progress: 174/1881 symbols completed. BCAT took 1.2s. Estimated remaining: 11m 33s. Rate: 147.8 symbols/min [2025-10-27T22:05:48.960940] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:48.977755] [DEBUG] [LOCAL ] BCE: Loaded 52235 existing records from primary storage. [2025-10-27T22:05:48.978027] [INFO ] [MAIN ] BCE: Loaded 52235 primary data records. [2025-10-27T22:05:49.098338] [DEBUG] [LOCAL ] BCH: Loaded 29646 existing records from primary storage. [2025-10-27T22:05:49.104155] [INFO ] [MAIN ] BCH: Loaded 29646 primary data records. [2025-10-27T22:05:49.270197] [DEBUG] [LOCAL ] BCO: Loaded 24419 existing records from primary storage. [2025-10-27T22:05:49.384573] [INFO ] [MAIN ] BCO: Loaded 24419 primary data records. [2025-10-27T22:05:49.947932] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:49.993231] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:50.019725] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:50.054980] [INFO ] [MAIN ] BCE: Generated 138 derivative records from 52235 primary records. [2025-10-27T22:05:50.056342] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-27T22:05:50.075867] [DEBUG] [LOCAL ] BCE: Derivative data saved (138 records). [2025-10-27T22:05:50.077271] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-27T22:05:50.080412] [INFO ] [MAIN ] Derivative Progress: 175/1881 symbols completed. BCE took 1.2s. Estimated remaining: 11m 40s. Rate: 146.3 symbols/min [2025-10-27T22:05:50.080934] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:50.095176] [INFO ] [MAIN ] BCH: Generated 138 derivative records from 29646 primary records. [2025-10-27T22:05:50.095513] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-27T22:05:50.108822] [INFO ] [MAIN ] BCO: Generated 138 derivative records from 24419 primary records. [2025-10-27T22:05:50.109318] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-27T22:05:50.120566] [DEBUG] [LOCAL ] BCH: Derivative data saved (138 records). [2025-10-27T22:05:50.123265] [DEBUG] [LOCAL ] BCO: Derivative data saved (138 records). [2025-10-27T22:05:50.123362] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-27T22:05:50.125628] [INFO ] [MAIN ] Derivative Progress: 176/1881 symbols completed. BCH took 1.2s. Estimated remaining: 11m 36s. Rate: 147.0 symbols/min [2025-10-27T22:05:50.123483] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-27T22:05:50.125794] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:50.128463] [INFO ] [MAIN ] Derivative Progress: 177/1881 symbols completed. BCO took 1.2s. Estimated remaining: 11m 31s. Rate: 147.9 symbols/min [2025-10-27T22:05:50.128741] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:50.181062] [DEBUG] [LOCAL ] BCX: Loaded 21778 existing records from primary storage. [2025-10-27T22:05:50.190619] [INFO ] [MAIN ] BCX: Loaded 21778 primary data records. [2025-10-27T22:05:50.191823] [DEBUG] [LOCAL ] BCS: Loaded 53437 existing records from primary storage. [2025-10-27T22:05:50.192080] [INFO ] [MAIN ] BCS: Loaded 53437 primary data records. [2025-10-27T22:05:50.192698] [DEBUG] [LOCAL ] BCSF: Loaded 27770 existing records from primary storage. [2025-10-27T22:05:50.224519] [INFO ] [MAIN ] BCSF: Loaded 27770 primary data records. [2025-10-27T22:05:51.119758] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:51.145000] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:51.177880] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:51.243962] [INFO ] [MAIN ] BCSF: Generated 138 derivative records from 27770 primary records. [2025-10-27T22:05:51.245013] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-27T22:05:51.248061] [INFO ] [MAIN ] BCS: Generated 138 derivative records from 53437 primary records. [2025-10-27T22:05:51.248953] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-27T22:05:51.251119] [INFO ] [MAIN ] BCX: Generated 138 derivative records from 21778 primary records. [2025-10-27T22:05:51.251389] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-27T22:05:51.286963] [DEBUG] [LOCAL ] BCSF: Derivative data saved (138 records). [2025-10-27T22:05:51.287908] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-27T22:05:51.291129] [DEBUG] [LOCAL ] BCS: Derivative data saved (138 records). [2025-10-27T22:05:51.290739] [INFO ] [MAIN ] Derivative Progress: 178/1881 symbols completed. BCSF took 1.2s. Estimated remaining: 11m 38s. Rate: 146.3 symbols/min [2025-10-27T22:05:51.291799] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-27T22:05:51.294759] [INFO ] [MAIN ] Derivative Progress: 179/1881 symbols completed. BCS took 1.2s. Estimated remaining: 11m 34s. Rate: 147.1 symbols/min [2025-10-27T22:05:51.296598] [DEBUG] [LOCAL ] BCX: Derivative data saved (138 records). [2025-10-27T22:05:51.296728] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-27T22:05:51.299163] [INFO ] [MAIN ] Derivative Progress: 180/1881 symbols completed. BCX took 1.2s. Estimated remaining: 11m 30s. Rate: 148.0 symbols/min [2025-10-27T22:05:51.299611] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:51.299753] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:51.299518] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:51.328435] [DEBUG] [LOCAL ] BDC: Loaded 23527 existing records from primary storage. [2025-10-27T22:05:51.328560] [INFO ] [MAIN ] BDC: Loaded 23527 primary data records. [2025-10-27T22:05:51.448558] [DEBUG] [LOCAL ] BDJ: Loaded 28843 existing records from primary storage. [2025-10-27T22:05:51.461224] [INFO ] [MAIN ] BDJ: Loaded 28843 primary data records. [2025-10-27T22:05:51.482833] [DEBUG] [LOCAL ] BDN: Loaded 47524 existing records from primary storage. [2025-10-27T22:05:51.488127] [INFO ] [MAIN ] BDN: Loaded 47524 primary data records. [2025-10-27T22:05:52.497733] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:52.566151] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:52.611937] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:52.637954] [INFO ] [MAIN ] BDC: Generated 138 derivative records from 23527 primary records. [2025-10-27T22:05:52.643869] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-27T22:05:52.672504] [DEBUG] [LOCAL ] BDC: Derivative data saved (138 records). [2025-10-27T22:05:52.674835] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-27T22:05:52.678474] [INFO ] [MAIN ] Derivative Progress: 181/1881 symbols completed. BDC took 1.4s. Estimated remaining: 11m 39s. Rate: 146.0 symbols/min [2025-10-27T22:05:52.679762] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:52.710219] [INFO ] [MAIN ] BDN: Generated 138 derivative records from 47524 primary records. [2025-10-27T22:05:52.711051] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-27T22:05:52.716428] [INFO ] [MAIN ] BDJ: Generated 138 derivative records from 28843 primary records. [2025-10-27T22:05:52.717438] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-27T22:05:52.736769] [DEBUG] [LOCAL ] BDN: Derivative data saved (138 records). [2025-10-27T22:05:52.761611] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-27T22:05:52.766402] [INFO ] [MAIN ] Derivative Progress: 182/1881 symbols completed. BDN took 1.5s. Estimated remaining: 11m 35s. Rate: 146.7 symbols/min [2025-10-27T22:05:52.768041] [DEBUG] [LOCAL ] BDJ: Derivative data saved (138 records). [2025-10-27T22:05:52.767010] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:52.768276] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-27T22:05:52.772017] [INFO ] [MAIN ] Derivative Progress: 183/1881 symbols completed. BDJ took 1.5s. Estimated remaining: 11m 31s. Rate: 147.5 symbols/min [2025-10-27T22:05:52.772537] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:52.793368] [DEBUG] [LOCAL ] BDX: Loaded 52047 existing records from primary storage. [2025-10-27T22:05:52.793808] [INFO ] [MAIN ] BDX: Loaded 52047 primary data records. [2025-10-27T22:05:53.223283] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-27T22:05:53.224749] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-27T22:05:53.224497] [DEBUG] [LOCAL ] BEKE: Loaded 53182 existing records from primary storage. [2025-10-27T22:05:53.245711] [INFO ] [MAIN ] BEKE: Loaded 53182 primary data records. [2025-10-27T22:05:53.840157] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:53.904184] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:53.904450] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:53.949453] [INFO ] [MAIN ] BDX: Generated 138 derivative records from 52047 primary records. [2025-10-27T22:05:53.950556] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-27T22:05:53.970513] [DEBUG] [LOCAL ] BDX: Derivative data saved (138 records). [2025-10-27T22:05:53.971007] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-27T22:05:53.974883] [INFO ] [MAIN ] Derivative Progress: 184/1881 symbols completed. BDX took 1.3s. Estimated remaining: 11m 38s. Rate: 145.9 symbols/min [2025-10-27T22:05:53.975280] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:53.997686] [INFO ] [MAIN ] BE: Generated 138 derivative records from 53661 primary records. [2025-10-27T22:05:53.997904] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-27T22:05:53.994160] [INFO ] [MAIN ] BEKE: Generated 138 derivative records from 53182 primary records. [2025-10-27T22:05:53.998456] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-27T22:05:54.019461] [DEBUG] [LOCAL ] BE: Derivative data saved (138 records). [2025-10-27T22:05:54.022359] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-27T22:05:54.024871] [INFO ] [MAIN ] Derivative Progress: 185/1881 symbols completed. BE took 1.3s. Estimated remaining: 11m 34s. Rate: 146.6 symbols/min [2025-10-27T22:05:54.022220] [DEBUG] [LOCAL ] BEKE: Derivative data saved (138 records). [2025-10-27T22:05:54.025038] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:54.025489] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-27T22:05:54.028044] [INFO ] [MAIN ] Derivative Progress: 186/1881 symbols completed. BEKE took 1.3s. Estimated remaining: 11m 30s. Rate: 147.4 symbols/min [2025-10-27T22:05:54.028275] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:54.068895] [DEBUG] [LOCAL ] BEN: Loaded 53102 existing records from primary storage. [2025-10-27T22:05:54.069285] [INFO ] [MAIN ] BEN: Loaded 53102 primary data records. [2025-10-27T22:05:54.230503] [DEBUG] [LOCAL ] BEPC: Loaded 46201 existing records from primary storage. [2025-10-27T22:05:54.231265] [DEBUG] [LOCAL ] BEP: Loaded 38684 existing records from primary storage. [2025-10-27T22:05:54.241996] [INFO ] [MAIN ] BEP: Loaded 38684 primary data records. [2025-10-27T22:05:54.241871] [INFO ] [MAIN ] BEPC: Loaded 46201 primary data records. [2025-10-27T22:05:55.053317] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:55.100114] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:55.132271] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:55.185564] [INFO ] [MAIN ] BEN: Generated 138 derivative records from 53102 primary records. [2025-10-27T22:05:55.186559] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-27T22:05:55.202252] [DEBUG] [LOCAL ] BEN: Derivative data saved (138 records). [2025-10-27T22:05:55.206878] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-27T22:05:55.209808] [INFO ] [MAIN ] Derivative Progress: 187/1881 symbols completed. BEN took 1.2s. Estimated remaining: 11m 37s. Rate: 145.9 symbols/min [2025-10-27T22:05:55.210301] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:55.219681] [INFO ] [MAIN ] BEP: Generated 138 derivative records from 38684 primary records. [2025-10-27T22:05:55.221320] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-27T22:05:55.226950] [DEBUG] [LOCAL ] BEPH: Loaded 4804 existing records from primary storage. [2025-10-27T22:05:55.227407] [INFO ] [MAIN ] BEPC: Generated 138 derivative records from 46201 primary records. [2025-10-27T22:05:55.234547] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-27T22:05:55.236396] [INFO ] [MAIN ] BEPH: Loaded 4804 primary data records. [2025-10-27T22:05:55.239555] [DEBUG] [LOCAL ] BEP: Derivative data saved (138 records). [2025-10-27T22:05:55.239890] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-27T22:05:55.308609] [DEBUG] [LOCAL ] BEPC: Derivative data saved (138 records). [2025-10-27T22:05:55.291814] [INFO ] [MAIN ] Derivative Progress: 188/1881 symbols completed. BEP took 1.3s. Estimated remaining: 11m 33s. Rate: 146.5 symbols/min [2025-10-27T22:05:55.328547] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-27T22:05:55.341893] [INFO ] [MAIN ] Derivative Progress: 189/1881 symbols completed. BEPC took 1.3s. Estimated remaining: 11m 30s. Rate: 147.2 symbols/min [2025-10-27T22:05:55.347518] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:55.328677] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:55.386512] [DEBUG] [LOCAL ] BEPJ: Loaded 3063 existing records from primary storage. [2025-10-27T22:05:55.404190] [INFO ] [MAIN ] BEPJ: Loaded 3063 primary data records. [2025-10-27T22:05:55.454019] [DEBUG] [LOCAL ] BEPI: Loaded 3495 existing records from primary storage. [2025-10-27T22:05:55.600767] [INFO ] [MAIN ] BEPI: Loaded 3495 primary data records. [2025-10-27T22:05:56.242168] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:56.288859] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:05:56.320342] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:56.364073] [INFO ] [MAIN ] BEPH: Generated 138 derivative records from 4804 primary records. [2025-10-27T22:05:56.369103] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-27T22:05:56.389965] [DEBUG] [LOCAL ] BEPH: Derivative data saved (138 records). [2025-10-27T22:05:56.391327] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-27T22:05:56.395466] [INFO ] [MAIN ] Derivative Progress: 190/1881 symbols completed. BEPH took 1.2s. Estimated remaining: 11m 35s. Rate: 146.0 symbols/min [2025-10-27T22:05:56.395773] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:56.406575] [INFO ] [MAIN ] BEPJ: Generated 138 derivative records from 3063 primary records. [2025-10-27T22:05:56.408889] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-27T22:05:56.421296] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (138 records). [2025-10-27T22:05:56.423276] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-27T22:05:56.423515] [INFO ] [MAIN ] BEPI: Generated 138 derivative records from 3495 primary records. [2025-10-27T22:05:56.423620] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-27T22:05:56.434471] [INFO ] [MAIN ] Derivative Progress: 191/1881 symbols completed. BEPJ took 1.1s. Estimated remaining: 11m 31s. Rate: 146.7 symbols/min [2025-10-27T22:05:56.435270] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:56.446062] [DEBUG] [LOCAL ] BEPI: Derivative data saved (138 records). [2025-10-27T22:05:56.456312] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-27T22:05:56.458949] [INFO ] [MAIN ] Derivative Progress: 192/1881 symbols completed. BEPI took 1.1s. Estimated remaining: 11m 27s. Rate: 147.4 symbols/min [2025-10-27T22:05:56.459180] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:56.459842] [DEBUG] [LOCAL ] BFAM: Loaded 33693 existing records from primary storage. [2025-10-27T22:05:56.460583] [INFO ] [MAIN ] BFAM: Loaded 33693 primary data records. [2025-10-27T22:05:56.772227] [DEBUG] [LOCAL ] BFH: Loaded 41171 existing records from primary storage. [2025-10-27T22:05:56.786188] [INFO ] [MAIN ] BFH: Loaded 41171 primary data records. [2025-10-27T22:05:56.844485] [DEBUG] [LOCAL ] BFLY: Loaded 51867 existing records from primary storage. [2025-10-27T22:05:56.865435] [INFO ] [MAIN ] BFLY: Loaded 51867 primary data records. [2025-10-27T22:05:57.447431] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:57.507302] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:57.509427] [INFO ] [MAIN ] BFAM: Generated 138 derivative records from 33693 primary records. [2025-10-27T22:05:57.524061] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-27T22:05:57.539577] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:57.581735] [DEBUG] [LOCAL ] BFAM: Derivative data saved (138 records). [2025-10-27T22:05:57.582229] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-27T22:05:57.584808] [INFO ] [MAIN ] Derivative Progress: 193/1881 symbols completed. BFAM took 1.2s. Estimated remaining: 11m 33s. Rate: 146.1 symbols/min [2025-10-27T22:05:57.618796] [INFO ] [MAIN ] BFH: Generated 138 derivative records from 41171 primary records. [2025-10-27T22:05:57.619114] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-27T22:05:57.630333] [INFO ] [MAIN ] BFLY: Generated 138 derivative records from 51867 primary records. [2025-10-27T22:05:57.632561] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-27T22:05:57.635563] [DEBUG] [LOCAL ] BFH: Derivative data saved (138 records). [2025-10-27T22:05:57.636250] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-27T22:05:57.638330] [INFO ] [MAIN ] Derivative Progress: 194/1881 symbols completed. BFH took 1.2s. Estimated remaining: 11m 30s. Rate: 146.7 symbols/min [2025-10-27T22:05:57.649872] [DEBUG] [LOCAL ] BFLY: Derivative data saved (138 records). [2025-10-27T22:05:57.649939] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-27T22:05:57.652610] [INFO ] [MAIN ] Derivative Progress: 195/1881 symbols completed. BFLY took 1.2s. Estimated remaining: 11m 26s. Rate: 147.5 symbols/min [2025-10-27T22:05:57.653209] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:57.653127] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:57.653051] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:57.672348] [DEBUG] [LOCAL ] BFS: Loaded 9503 existing records from primary storage. [2025-10-27T22:05:57.672552] [INFO ] [MAIN ] BFS: Loaded 9503 primary data records. [2025-10-27T22:05:57.758945] [DEBUG] [LOCAL ] BFZ: Loaded 11944 existing records from primary storage. [2025-10-27T22:05:57.788545] [DEBUG] [LOCAL ] BGB: Loaded 17226 existing records from primary storage. [2025-10-27T22:05:57.788397] [INFO ] [MAIN ] BFZ: Loaded 11944 primary data records. [2025-10-27T22:05:57.799327] [INFO ] [MAIN ] BGB: Loaded 17226 primary data records. [2025-10-27T22:05:58.684927] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:58.726622] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:58.755398] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:58.820942] [INFO ] [MAIN ] BFS: Generated 138 derivative records from 9503 primary records. [2025-10-27T22:05:58.825584] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-27T22:05:58.826305] [INFO ] [MAIN ] BGB: Generated 138 derivative records from 17226 primary records. [2025-10-27T22:05:58.828386] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-27T22:05:58.856730] [DEBUG] [LOCAL ] BFS: Derivative data saved (138 records). [2025-10-27T22:05:58.856908] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-27T22:05:58.857696] [DEBUG] [LOCAL ] BGB: Derivative data saved (138 records). [2025-10-27T22:05:58.860762] [INFO ] [MAIN ] Derivative Progress: 196/1881 symbols completed. BFS took 1.2s. Estimated remaining: 11m 33s. Rate: 146.0 symbols/min [2025-10-27T22:05:58.861260] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-27T22:05:58.865120] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:58.865211] [INFO ] [MAIN ] Derivative Progress: 197/1881 symbols completed. BGB took 1.2s. Estimated remaining: 11m 29s. Rate: 146.7 symbols/min [2025-10-27T22:05:58.865608] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:58.869443] [INFO ] [MAIN ] BFZ: Generated 138 derivative records from 11944 primary records. [2025-10-27T22:05:58.869602] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-27T22:05:58.881788] [DEBUG] [LOCAL ] BFZ: Derivative data saved (138 records). [2025-10-27T22:05:58.886766] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-27T22:05:58.889389] [INFO ] [MAIN ] Derivative Progress: 198/1881 symbols completed. BFZ took 1.2s. Estimated remaining: 11m 25s. Rate: 147.4 symbols/min [2025-10-27T22:05:58.889580] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:05:58.901809] [DEBUG] [LOCAL ] BGR: Loaded 13127 existing records from primary storage. [2025-10-27T22:05:58.902214] [INFO ] [MAIN ] BGR: Loaded 13127 primary data records. [2025-10-27T22:05:58.956447] [DEBUG] [LOCAL ] BGSF: Loaded 8297 existing records from primary storage. [2025-10-27T22:05:58.978584] [INFO ] [MAIN ] BGSF: Loaded 8297 primary data records. [2025-10-27T22:05:59.266054] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-27T22:05:59.306676] [INFO ] [MAIN ] BGS: Loaded 50455 primary data records. [2025-10-27T22:05:59.883240] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:59.916448] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:05:59.962841] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:00.011928] [INFO ] [MAIN ] BGSF: Generated 138 derivative records from 8297 primary records. [2025-10-27T22:06:00.016076] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-27T22:06:00.031876] [DEBUG] [LOCAL ] BGSF: Derivative data saved (138 records). [2025-10-27T22:06:00.032103] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-27T22:06:00.040851] [INFO ] [MAIN ] Derivative Progress: 199/1881 symbols completed. BGSF took 1.2s. Estimated remaining: 11m 31s. Rate: 146.1 symbols/min [2025-10-27T22:06:00.042398] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:00.041910] [INFO ] [MAIN ] BGR: Generated 138 derivative records from 13127 primary records. [2025-10-27T22:06:00.043202] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-27T22:06:00.066590] [DEBUG] [LOCAL ] BGR: Derivative data saved (138 records). [2025-10-27T22:06:00.071105] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-27T22:06:00.074687] [INFO ] [MAIN ] Derivative Progress: 200/1881 symbols completed. BGR took 1.2s. Estimated remaining: 11m 27s. Rate: 146.8 symbols/min [2025-10-27T22:06:00.077632] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:00.078256] [INFO ] [MAIN ] BGS: Generated 138 derivative records from 50455 primary records. [2025-10-27T22:06:00.079116] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-27T22:06:00.099314] [DEBUG] [LOCAL ] BGT: Loaded 15819 existing records from primary storage. [2025-10-27T22:06:00.099823] [INFO ] [MAIN ] BGT: Loaded 15819 primary data records. [2025-10-27T22:06:00.107835] [DEBUG] [LOCAL ] BGS: Derivative data saved (138 records). [2025-10-27T22:06:00.111639] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-27T22:06:00.121143] [INFO ] [MAIN ] Derivative Progress: 201/1881 symbols completed. BGS took 1.3s. Estimated remaining: 11m 24s. Rate: 147.4 symbols/min [2025-10-27T22:06:00.121394] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:00.215827] [DEBUG] [LOCAL ] BGX: Loaded 10924 existing records from primary storage. [2025-10-27T22:06:00.219133] [INFO ] [MAIN ] BGX: Loaded 10924 primary data records. [2025-10-27T22:06:00.598502] [DEBUG] [LOCAL ] BGY: Loaded 21175 existing records from primary storage. [2025-10-27T22:06:00.610728] [INFO ] [MAIN ] BGY: Loaded 21175 primary data records. [2025-10-27T22:06:01.119416] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:01.160097] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:01.201875] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:01.228335] [INFO ] [MAIN ] BGT: Generated 138 derivative records from 15819 primary records. [2025-10-27T22:06:01.231375] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-27T22:06:01.248745] [DEBUG] [LOCAL ] BGT: Derivative data saved (138 records). [2025-10-27T22:06:01.251339] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-27T22:06:01.254280] [INFO ] [MAIN ] Derivative Progress: 202/1881 symbols completed. BGT took 1.2s. Estimated remaining: 11m 29s. Rate: 146.1 symbols/min [2025-10-27T22:06:01.256307] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:01.272594] [INFO ] [MAIN ] BGX: Generated 138 derivative records from 10924 primary records. [2025-10-27T22:06:01.274013] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-27T22:06:01.288052] [INFO ] [MAIN ] BGY: Generated 138 derivative records from 21175 primary records. [2025-10-27T22:06:01.291077] [DEBUG] [LOCAL ] BGX: Derivative data saved (138 records). [2025-10-27T22:06:01.291210] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-27T22:06:01.292135] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-27T22:06:01.294566] [INFO ] [MAIN ] Derivative Progress: 203/1881 symbols completed. BGX took 1.2s. Estimated remaining: 11m 26s. Rate: 146.8 symbols/min [2025-10-27T22:06:01.295146] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:01.306178] [DEBUG] [LOCAL ] BGY: Derivative data saved (138 records). [2025-10-27T22:06:01.316115] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-27T22:06:01.319015] [INFO ] [MAIN ] Derivative Progress: 204/1881 symbols completed. BGY took 1.2s. Estimated remaining: 11m 22s. Rate: 147.5 symbols/min [2025-10-27T22:06:01.319381] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:01.338251] [DEBUG] [LOCAL ] BHC: Loaded 46452 existing records from primary storage. [2025-10-27T22:06:01.338385] [INFO ] [MAIN ] BHC: Loaded 46452 primary data records. [2025-10-27T22:06:01.437604] [DEBUG] [LOCAL ] BHK: Loaded 23928 existing records from primary storage. [2025-10-27T22:06:01.453931] [INFO ] [MAIN ] BHK: Loaded 23928 primary data records. [2025-10-27T22:06:01.829456] [DEBUG] [LOCAL ] BHP: Loaded 53359 existing records from primary storage. [2025-10-27T22:06:01.862794] [INFO ] [MAIN ] BHP: Loaded 53359 primary data records. [2025-10-27T22:06:02.347175] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:02.382049] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:02.429615] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:02.448999] [INFO ] [MAIN ] BHC: Generated 138 derivative records from 46452 primary records. [2025-10-27T22:06:02.449133] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-27T22:06:02.465706] [DEBUG] [LOCAL ] BHC: Derivative data saved (138 records). [2025-10-27T22:06:02.465952] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-27T22:06:02.471108] [INFO ] [MAIN ] Derivative Progress: 205/1881 symbols completed. BHC took 1.2s. Estimated remaining: 11m 28s. Rate: 146.1 symbols/min [2025-10-27T22:06:02.472984] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:02.491199] [INFO ] [MAIN ] BHK: Generated 138 derivative records from 23928 primary records. [2025-10-27T22:06:02.492496] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-27T22:06:02.513691] [DEBUG] [LOCAL ] BHK: Derivative data saved (138 records). [2025-10-27T22:06:02.514157] [DEBUG] [LOCAL ] BHR: Loaded 21977 existing records from primary storage. [2025-10-27T22:06:02.514224] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-27T22:06:02.516433] [INFO ] [MAIN ] Derivative Progress: 206/1881 symbols completed. BHK took 1.2s. Estimated remaining: 11m 25s. Rate: 146.8 symbols/min [2025-10-27T22:06:02.516883] [INFO ] [MAIN ] BHR: Loaded 21977 primary data records. [2025-10-27T22:06:02.516828] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:02.564306] [INFO ] [MAIN ] BHP: Generated 138 derivative records from 53359 primary records. [2025-10-27T22:06:02.608850] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-27T22:06:02.679545] [DEBUG] [LOCAL ] BHP: Derivative data saved (138 records). [2025-10-27T22:06:02.695920] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-27T22:06:02.721333] [INFO ] [MAIN ] Derivative Progress: 207/1881 symbols completed. BHP took 1.4s. Estimated remaining: 11m 23s. Rate: 147.1 symbols/min [2025-10-27T22:06:02.829291] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:02.873672] [DEBUG] [LOCAL ] BHVN: Loaded 50598 existing records from primary storage. [2025-10-27T22:06:02.874134] [INFO ] [MAIN ] BHVN: Loaded 50598 primary data records. [2025-10-27T22:06:03.200427] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:03.214722] [DEBUG] [LOCAL ] BILL: Loaded 52486 existing records from primary storage. [2025-10-27T22:06:03.226971] [INFO ] [MAIN ] BILL: Loaded 52486 primary data records. [2025-10-27T22:06:03.549237] [INFO ] [MAIN ] BHR: Generated 138 derivative records from 21977 primary records. [2025-10-27T22:06:03.549607] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-27T22:06:03.574771] [DEBUG] [LOCAL ] BHR: Derivative data saved (138 records). [2025-10-27T22:06:03.575220] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-27T22:06:03.575676] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:03.577823] [INFO ] [MAIN ] Derivative Progress: 208/1881 symbols completed. BHR took 1.1s. Estimated remaining: 11m 26s. Rate: 146.4 symbols/min [2025-10-27T22:06:03.617217] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:03.639045] [INFO ] [MAIN ] BHVN: Generated 138 derivative records from 50598 primary records. [2025-10-27T22:06:03.639315] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-27T22:06:03.656842] [DEBUG] [LOCAL ] BHVN: Derivative data saved (138 records). [2025-10-27T22:06:03.657224] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-27T22:06:03.660831] [INFO ] [MAIN ] Derivative Progress: 209/1881 symbols completed. BHVN took 1.1s. Estimated remaining: 11m 23s. Rate: 146.9 symbols/min [2025-10-27T22:06:03.668168] [INFO ] [MAIN ] BILL: Generated 138 derivative records from 52486 primary records. [2025-10-27T22:06:03.668263] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-27T22:06:03.679496] [DEBUG] [LOCAL ] BILL: Derivative data saved (138 records). [2025-10-27T22:06:03.679550] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-27T22:06:03.682160] [INFO ] [MAIN ] Derivative Progress: 210/1881 symbols completed. BILL took 0.9s. Estimated remaining: 11m 19s. Rate: 147.6 symbols/min [2025-10-27T22:06:03.682632] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:03.682578] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:03.682733] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:03.705169] [DEBUG] [LOCAL ] BIO: Loaded 23423 existing records from primary storage. [2025-10-27T22:06:03.713441] [INFO ] [MAIN ] BIO: Loaded 23423 primary data records. [2025-10-27T22:06:03.859687] [DEBUG] [LOCAL ] BIP: Loaded 38519 existing records from primary storage. [2025-10-27T22:06:03.865457] [DEBUG] [LOCAL ] BIPC: Loaded 40781 existing records from primary storage. [2025-10-27T22:06:03.875977] [INFO ] [MAIN ] BIP: Loaded 38519 primary data records. [2025-10-27T22:06:03.925368] [INFO ] [MAIN ] BIPC: Loaded 40781 primary data records. [2025-10-27T22:06:04.699296] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:04.746126] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:04.789690] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:04.813275] [INFO ] [MAIN ] BIO: Generated 138 derivative records from 23423 primary records. [2025-10-27T22:06:04.815720] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-27T22:06:04.837571] [DEBUG] [LOCAL ] BIO: Derivative data saved (138 records). [2025-10-27T22:06:04.841786] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-27T22:06:04.844059] [INFO ] [MAIN ] Derivative Progress: 211/1881 symbols completed. BIO took 1.2s. Estimated remaining: 11m 25s. Rate: 146.3 symbols/min [2025-10-27T22:06:04.844516] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:04.861099] [DEBUG] [LOCAL ] BIPH: Loaded 2251 existing records from primary storage. [2025-10-27T22:06:04.861485] [INFO ] [MAIN ] BIPH: Loaded 2251 primary data records. [2025-10-27T22:06:05.001837] [INFO ] [MAIN ] BIP: Generated 138 derivative records from 38519 primary records. [2025-10-27T22:06:05.052073] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-27T22:06:05.181689] [INFO ] [MAIN ] BIPC: Generated 138 derivative records from 40781 primary records. [2025-10-27T22:06:05.185143] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-27T22:06:05.185436] [DEBUG] [LOCAL ] BIP: Derivative data saved (138 records). [2025-10-27T22:06:05.186542] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-27T22:06:05.189291] [INFO ] [MAIN ] Derivative Progress: 212/1881 symbols completed. BIP took 1.5s. Estimated remaining: 11m 24s. Rate: 146.4 symbols/min [2025-10-27T22:06:05.189474] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:05.202767] [DEBUG] [LOCAL ] BIPC: Derivative data saved (138 records). [2025-10-27T22:06:05.203915] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-27T22:06:05.206684] [INFO ] [MAIN ] Derivative Progress: 213/1881 symbols completed. BIPC took 1.5s. Estimated remaining: 11m 21s. Rate: 147.1 symbols/min [2025-10-27T22:06:05.206967] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:05.209557] [DEBUG] [LOCAL ] BIPI: Loaded 2727 existing records from primary storage. [2025-10-27T22:06:05.210240] [INFO ] [MAIN ] BIPI: Loaded 2727 primary data records. [2025-10-27T22:06:05.513952] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:05.557408] [DEBUG] [LOCAL ] BIRK: Loaded 51082 existing records from primary storage. [2025-10-27T22:06:05.560560] [INFO ] [MAIN ] BIRK: Loaded 51082 primary data records. [2025-10-27T22:06:05.883885] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:05.902276] [INFO ] [MAIN ] BIPH: Generated 138 derivative records from 2251 primary records. [2025-10-27T22:06:05.903264] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-27T22:06:05.916918] [DEBUG] [LOCAL ] BIPH: Derivative data saved (138 records). [2025-10-27T22:06:05.917213] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-27T22:06:05.922463] [INFO ] [MAIN ] Derivative Progress: 214/1881 symbols completed. BIPH took 1.1s. Estimated remaining: 11m 22s. Rate: 146.6 symbols/min [2025-10-27T22:06:05.923591] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:05.961206] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:05.978877] [INFO ] [MAIN ] BIPI: Generated 138 derivative records from 2727 primary records. [2025-10-27T22:06:05.979391] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-27T22:06:05.992058] [DEBUG] [LOCAL ] BIT: Loaded 23558 existing records from primary storage. [2025-10-27T22:06:05.998046] [INFO ] [MAIN ] BIT: Loaded 23558 primary data records. [2025-10-27T22:06:06.003575] [DEBUG] [LOCAL ] BIPI: Derivative data saved (138 records). [2025-10-27T22:06:06.014953] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-27T22:06:06.075439] [INFO ] [MAIN ] Derivative Progress: 215/1881 symbols completed. BIPI took 0.9s. Estimated remaining: 11m 20s. Rate: 147.0 symbols/min [2025-10-27T22:06:06.087538] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:06.336708] [INFO ] [MAIN ] BIRK: Generated 138 derivative records from 51082 primary records. [2025-10-27T22:06:06.338162] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-27T22:06:06.355808] [DEBUG] [LOCAL ] BIRK: Derivative data saved (138 records). [2025-10-27T22:06:06.356333] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-27T22:06:06.361058] [INFO ] [MAIN ] Derivative Progress: 216/1881 symbols completed. BIRK took 1.2s. Estimated remaining: 11m 19s. Rate: 147.2 symbols/min [2025-10-27T22:06:06.361277] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:06.389067] [DEBUG] [LOCAL ] BJ: Loaded 51411 existing records from primary storage. [2025-10-27T22:06:06.389756] [INFO ] [MAIN ] BJ: Loaded 51411 primary data records. [2025-10-27T22:06:06.581789] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:06.793488] [DEBUG] [LOCAL ] BK: Loaded 53535 existing records from primary storage. [2025-10-27T22:06:06.796473] [INFO ] [MAIN ] BK: Loaded 53535 primary data records. [2025-10-27T22:06:07.156459] [INFO ] [MAIN ] BIT: Generated 138 derivative records from 23558 primary records. [2025-10-27T22:06:07.161868] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:07.161665] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-27T22:06:07.192136] [DEBUG] [LOCAL ] BIT: Derivative data saved (138 records). [2025-10-27T22:06:07.192629] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-27T22:06:07.195454] [INFO ] [MAIN ] Derivative Progress: 217/1881 symbols completed. BIT took 1.3s. Estimated remaining: 11m 22s. Rate: 146.5 symbols/min [2025-10-27T22:06:07.196160] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:07.222383] [INFO ] [MAIN ] BJ: Generated 138 derivative records from 51411 primary records. [2025-10-27T22:06:07.233242] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-27T22:06:07.250987] [DEBUG] [LOCAL ] BJ: Derivative data saved (138 records). [2025-10-27T22:06:07.251523] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-27T22:06:07.254041] [INFO ] [MAIN ] Derivative Progress: 218/1881 symbols completed. BJ took 1.2s. Estimated remaining: 11m 19s. Rate: 147.1 symbols/min [2025-10-27T22:06:07.254195] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:07.284239] [DEBUG] [LOCAL ] BKD: Loaded 50297 existing records from primary storage. [2025-10-27T22:06:07.284750] [INFO ] [MAIN ] BKD: Loaded 50297 primary data records. [2025-10-27T22:06:07.284997] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:07.517960] [DEBUG] [LOCAL ] BKE: Loaded 33221 existing records from primary storage. [2025-10-27T22:06:07.620384] [INFO ] [MAIN ] BKE: Loaded 33221 primary data records. [2025-10-27T22:06:07.958434] [INFO ] [MAIN ] BK: Generated 138 derivative records from 53535 primary records. [2025-10-27T22:06:07.972293] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-27T22:06:07.975788] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:08.001754] [DEBUG] [LOCAL ] BK: Derivative data saved (138 records). [2025-10-27T22:06:08.001978] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-27T22:06:08.008433] [INFO ] [MAIN ] Derivative Progress: 219/1881 symbols completed. BK took 1.6s. Estimated remaining: 11m 21s. Rate: 146.5 symbols/min [2025-10-27T22:06:08.008873] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:08.060231] [INFO ] [MAIN ] BKD: Generated 138 derivative records from 50297 primary records. [2025-10-27T22:06:08.061007] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-27T22:06:08.060940] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:08.086015] [DEBUG] [LOCAL ] BKD: Derivative data saved (138 records). [2025-10-27T22:06:08.086470] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-27T22:06:08.089701] [INFO ] [MAIN ] Derivative Progress: 220/1881 symbols completed. BKD took 0.9s. Estimated remaining: 11m 18s. Rate: 147.0 symbols/min [2025-10-27T22:06:08.101753] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:08.104325] [DEBUG] [LOCAL ] BKKT: Loaded 37775 existing records from primary storage. [2025-10-27T22:06:08.108388] [INFO ] [MAIN ] BKKT: Loaded 37775 primary data records. [2025-10-27T22:06:08.195880] [DEBUG] [LOCAL ] BKN: Loaded 7164 existing records from primary storage. [2025-10-27T22:06:08.216222] [INFO ] [MAIN ] BKN: Loaded 7164 primary data records. [2025-10-27T22:06:08.618828] [INFO ] [MAIN ] BKE: Generated 138 derivative records from 33221 primary records. [2025-10-27T22:06:08.768168] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-27T22:06:08.792022] [DEBUG] [LOCAL ] BKE: Derivative data saved (138 records). [2025-10-27T22:06:08.793063] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-27T22:06:08.795515] [INFO ] [MAIN ] Derivative Progress: 221/1881 symbols completed. BKE took 1.5s. Estimated remaining: 11m 20s. Rate: 146.5 symbols/min [2025-10-27T22:06:08.795905] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:08.823265] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:08.860512] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:08.904214] [DEBUG] [LOCAL ] BKSY: Loaded 48907 existing records from primary storage. [2025-10-27T22:06:08.910914] [INFO ] [MAIN ] BKSY: Loaded 48907 primary data records. [2025-10-27T22:06:09.119854] [INFO ] [MAIN ] BKKT: Generated 138 derivative records from 37775 primary records. [2025-10-27T22:06:09.220657] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-27T22:06:09.220570] [INFO ] [MAIN ] BKN: Generated 138 derivative records from 7164 primary records. [2025-10-27T22:06:09.221081] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-27T22:06:09.245467] [DEBUG] [LOCAL ] BKN: Derivative data saved (138 records). [2025-10-27T22:06:09.245587] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-27T22:06:09.248269] [INFO ] [MAIN ] Derivative Progress: 222/1881 symbols completed. BKN took 1.1s. Estimated remaining: 11m 20s. Rate: 146.5 symbols/min [2025-10-27T22:06:09.248722] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:09.242455] [DEBUG] [LOCAL ] BKKT: Derivative data saved (138 records). [2025-10-27T22:06:09.249746] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-27T22:06:09.252008] [INFO ] [MAIN ] Derivative Progress: 223/1881 symbols completed. BKKT took 1.2s. Estimated remaining: 11m 16s. Rate: 147.1 symbols/min [2025-10-27T22:06:09.264241] [DEBUG] [LOCAL ] BKT: Loaded 12719 existing records from primary storage. [2025-10-27T22:06:09.264460] [INFO ] [MAIN ] BKT: Loaded 12719 primary data records. [2025-10-27T22:06:09.442391] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:09.613141] [INFO ] [MAIN ] BKSY: Generated 138 derivative records from 48907 primary records. [2025-10-27T22:06:09.613290] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-27T22:06:09.625568] [DEBUG] [LOCAL ] BKSY: Derivative data saved (138 records). [2025-10-27T22:06:09.625788] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-27T22:06:09.628028] [INFO ] [MAIN ] Derivative Progress: 224/1881 symbols completed. BKSY took 0.8s. Estimated remaining: 11m 16s. Rate: 147.2 symbols/min [2025-10-27T22:06:09.643479] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:09.668586] [INFO ] [MAIN ] BKT: Generated 138 derivative records from 12719 primary records. [2025-10-27T22:06:09.668684] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-27T22:06:09.679797] [DEBUG] [LOCAL ] BKT: Derivative data saved (138 records). [2025-10-27T22:06:09.679854] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-27T22:06:09.682216] [INFO ] [MAIN ] Derivative Progress: 225/1881 symbols completed. BKT took 0.4s. Estimated remaining: 11m 13s. Rate: 147.7 symbols/min [2025-10-27T22:06:09.682668] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:09.682772] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:09.682896] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:09.734298] [DEBUG] [LOCAL ] BKV: Loaded 29033 existing records from primary storage. [2025-10-27T22:06:09.735377] [INFO ] [MAIN ] BKV: Loaded 29033 primary data records. [2025-10-27T22:06:09.756271] [DEBUG] [LOCAL ] BLCO: Loaded 34457 existing records from primary storage. [2025-10-27T22:06:09.789998] [INFO ] [MAIN ] BLCO: Loaded 34457 primary data records. [2025-10-27T22:06:09.895330] [DEBUG] [LOCAL ] BKU: Loaded 42038 existing records from primary storage. [2025-10-27T22:06:09.917834] [INFO ] [MAIN ] BKU: Loaded 42038 primary data records. [2025-10-27T22:06:10.718628] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:10.772407] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:10.769613] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:10.837395] [INFO ] [MAIN ] BKV: Generated 138 derivative records from 29033 primary records. [2025-10-27T22:06:10.838162] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-27T22:06:10.861533] [DEBUG] [LOCAL ] BKV: Derivative data saved (138 records). [2025-10-27T22:06:10.864866] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-27T22:06:10.868954] [INFO ] [MAIN ] Derivative Progress: 226/1881 symbols completed. BKV took 1.2s. Estimated remaining: 11m 18s. Rate: 146.5 symbols/min [2025-10-27T22:06:10.869156] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:10.872480] [INFO ] [MAIN ] BLCO: Generated 138 derivative records from 34457 primary records. [2025-10-27T22:06:10.872890] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-27T22:06:10.874621] [INFO ] [MAIN ] BKU: Generated 138 derivative records from 42038 primary records. [2025-10-27T22:06:10.875265] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-27T22:06:10.898218] [DEBUG] [LOCAL ] BLCO: Derivative data saved (138 records). [2025-10-27T22:06:10.898634] [DEBUG] [LOCAL ] BKU: Derivative data saved (138 records). [2025-10-27T22:06:10.898728] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-27T22:06:10.898929] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-27T22:06:10.901600] [INFO ] [MAIN ] Derivative Progress: 227/1881 symbols completed. BLCO took 1.2s. Estimated remaining: 11m 15s. Rate: 147.1 symbols/min [2025-10-27T22:06:10.908488] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:10.910983] [INFO ] [MAIN ] Derivative Progress: 228/1881 symbols completed. BKU took 1.2s. Estimated remaining: 11m 11s. Rate: 147.7 symbols/min [2025-10-27T22:06:10.911553] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:10.925891] [DEBUG] [LOCAL ] BLD: Loaded 26648 existing records from primary storage. [2025-10-27T22:06:10.926074] [INFO ] [MAIN ] BLD: Loaded 26648 primary data records. [2025-10-27T22:06:10.977865] [DEBUG] [LOCAL ] BLE: Loaded 13448 existing records from primary storage. [2025-10-27T22:06:10.993424] [INFO ] [MAIN ] BLE: Loaded 13448 primary data records. [2025-10-27T22:06:11.543752] [DEBUG] [LOCAL ] BLDR: Loaded 51805 existing records from primary storage. [2025-10-27T22:06:11.544443] [INFO ] [MAIN ] BLDR: Loaded 51805 primary data records. [2025-10-27T22:06:11.867870] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:06:11.896465] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:11.948838] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:11.974978] [INFO ] [MAIN ] BLD: Generated 138 derivative records from 26648 primary records. [2025-10-27T22:06:11.980381] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-27T22:06:12.001359] [DEBUG] [LOCAL ] BLD: Derivative data saved (138 records). [2025-10-27T22:06:12.003233] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-27T22:06:12.005692] [INFO ] [MAIN ] Derivative Progress: 229/1881 symbols completed. BLD took 1.1s. Estimated remaining: 11m 16s. Rate: 146.6 symbols/min [2025-10-27T22:06:12.006055] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:12.016285] [INFO ] [MAIN ] BLE: Generated 138 derivative records from 13448 primary records. [2025-10-27T22:06:12.017687] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-27T22:06:12.019878] [INFO ] [MAIN ] BLDR: Generated 138 derivative records from 51805 primary records. [2025-10-27T22:06:12.020110] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-27T22:06:12.031412] [DEBUG] [LOCAL ] BLE: Derivative data saved (138 records). [2025-10-27T22:06:12.038571] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-27T22:06:12.044140] [INFO ] [MAIN ] Derivative Progress: 230/1881 symbols completed. BLE took 1.1s. Estimated remaining: 11m 13s. Rate: 147.2 symbols/min [2025-10-27T22:06:12.044461] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:12.045579] [DEBUG] [LOCAL ] BLDR: Derivative data saved (138 records). [2025-10-27T22:06:12.054625] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-27T22:06:12.057105] [INFO ] [MAIN ] Derivative Progress: 231/1881 symbols completed. BLDR took 1.1s. Estimated remaining: 11m 10s. Rate: 147.8 symbols/min [2025-10-27T22:06:12.057438] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:12.074163] [DEBUG] [LOCAL ] BLK: Loaded 33685 existing records from primary storage. [2025-10-27T22:06:12.074356] [INFO ] [MAIN ] BLK: Loaded 33685 primary data records. [2025-10-27T22:06:12.134180] [DEBUG] [LOCAL ] BLW: Loaded 12668 existing records from primary storage. [2025-10-27T22:06:12.142905] [INFO ] [MAIN ] BLW: Loaded 12668 primary data records. [2025-10-27T22:06:12.621821] [DEBUG] [LOCAL ] BLND: Loaded 49191 existing records from primary storage. [2025-10-27T22:06:12.705541] [INFO ] [MAIN ] BLND: Loaded 49191 primary data records. [2025-10-27T22:06:13.073939] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:13.101826] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:13.156029] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:13.190072] [INFO ] [MAIN ] BLK: Generated 138 derivative records from 33685 primary records. [2025-10-27T22:06:13.190801] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-27T22:06:13.206522] [DEBUG] [LOCAL ] BLK: Derivative data saved (138 records). [2025-10-27T22:06:13.208766] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-27T22:06:13.209082] [INFO ] [MAIN ] BLW: Generated 138 derivative records from 12668 primary records. [2025-10-27T22:06:13.211248] [INFO ] [MAIN ] Derivative Progress: 232/1881 symbols completed. BLK took 1.2s. Estimated remaining: 11m 15s. Rate: 146.7 symbols/min [2025-10-27T22:06:13.211722] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:13.215097] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-27T22:06:13.229464] [DEBUG] [LOCAL ] BLW: Derivative data saved (138 records). [2025-10-27T22:06:13.229973] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-27T22:06:13.232274] [INFO ] [MAIN ] Derivative Progress: 233/1881 symbols completed. BLW took 1.2s. Estimated remaining: 11m 11s. Rate: 147.3 symbols/min [2025-10-27T22:06:13.239304] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:13.251745] [DEBUG] [LOCAL ] BLX: Loaded 14966 existing records from primary storage. [2025-10-27T22:06:13.252314] [INFO ] [MAIN ] BLX: Loaded 14966 primary data records. [2025-10-27T22:06:13.254738] [INFO ] [MAIN ] BLND: Generated 138 derivative records from 49191 primary records. [2025-10-27T22:06:13.285785] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-27T22:06:13.380600] [DEBUG] [LOCAL ] BLND: Derivative data saved (138 records). [2025-10-27T22:06:13.386238] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-27T22:06:13.399129] [INFO ] [MAIN ] Derivative Progress: 234/1881 symbols completed. BLND took 1.4s. Estimated remaining: 11m 9s. Rate: 147.6 symbols/min [2025-10-27T22:06:13.432321] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:13.475385] [DEBUG] [LOCAL ] BMA: Loaded 36661 existing records from primary storage. [2025-10-27T22:06:13.588120] [INFO ] [MAIN ] BMA: Loaded 36661 primary data records. [2025-10-27T22:06:13.688418] [DEBUG] [LOCAL ] BME: Loaded 11046 existing records from primary storage. [2025-10-27T22:06:13.702425] [INFO ] [MAIN ] BME: Loaded 11046 primary data records. [2025-10-27T22:06:14.237469] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:14.294432] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:14.336364] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:14.334944] [INFO ] [MAIN ] BLX: Generated 138 derivative records from 14966 primary records. [2025-10-27T22:06:14.349697] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-27T22:06:14.369888] [DEBUG] [LOCAL ] BLX: Derivative data saved (138 records). [2025-10-27T22:06:14.371711] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-27T22:06:14.378722] [INFO ] [MAIN ] Derivative Progress: 235/1881 symbols completed. BLX took 1.2s. Estimated remaining: 11m 13s. Rate: 146.8 symbols/min [2025-10-27T22:06:14.379408] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:14.392592] [INFO ] [MAIN ] BMA: Generated 138 derivative records from 36661 primary records. [2025-10-27T22:06:14.400829] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-27T22:06:14.424530] [DEBUG] [LOCAL ] BMEZ: Loaded 24659 existing records from primary storage. [2025-10-27T22:06:14.423971] [DEBUG] [LOCAL ] BMA: Derivative data saved (138 records). [2025-10-27T22:06:14.424634] [INFO ] [MAIN ] BMEZ: Loaded 24659 primary data records. [2025-10-27T22:06:14.425131] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-27T22:06:14.428996] [INFO ] [MAIN ] Derivative Progress: 236/1881 symbols completed. BMA took 1.2s. Estimated remaining: 11m 10s. Rate: 147.3 symbols/min [2025-10-27T22:06:14.465027] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:14.470555] [INFO ] [MAIN ] BME: Generated 138 derivative records from 11046 primary records. [2025-10-27T22:06:14.494283] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-27T22:06:14.554841] [DEBUG] [LOCAL ] BME: Derivative data saved (138 records). [2025-10-27T22:06:14.558766] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-27T22:06:14.561486] [INFO ] [MAIN ] Derivative Progress: 237/1881 symbols completed. BME took 1.1s. Estimated remaining: 11m 8s. Rate: 147.7 symbols/min [2025-10-27T22:06:14.572693] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:14.790569] [DEBUG] [LOCAL ] BMI: Loaded 24626 existing records from primary storage. [2025-10-27T22:06:14.799165] [INFO ] [MAIN ] BMI: Loaded 24626 primary data records. [2025-10-27T22:06:14.821755] [DEBUG] [LOCAL ] BMN: Loaded 2612 existing records from primary storage. [2025-10-27T22:06:14.821995] [INFO ] [MAIN ] BMN: Loaded 2612 primary data records. [2025-10-27T22:06:15.446509] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:15.497770] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:15.528031] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:15.553120] [INFO ] [MAIN ] BMEZ: Generated 138 derivative records from 24659 primary records. [2025-10-27T22:06:15.554611] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-27T22:06:15.573618] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (138 records). [2025-10-27T22:06:15.573746] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-27T22:06:15.575914] [INFO ] [MAIN ] Derivative Progress: 238/1881 symbols completed. BMEZ took 1.2s. Estimated remaining: 11m 11s. Rate: 146.8 symbols/min [2025-10-27T22:06:15.594418] [INFO ] [MAIN ] BMI: Generated 138 derivative records from 24626 primary records. [2025-10-27T22:06:15.594573] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-27T22:06:15.611589] [INFO ] [MAIN ] BMN: Generated 138 derivative records from 2612 primary records. [2025-10-27T22:06:15.611710] [DEBUG] [LOCAL ] BMI: Derivative data saved (138 records). [2025-10-27T22:06:15.611776] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-27T22:06:15.612230] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-27T22:06:15.614857] [INFO ] [MAIN ] Derivative Progress: 239/1881 symbols completed. BMI took 1.1s. Estimated remaining: 11m 9s. Rate: 147.4 symbols/min [2025-10-27T22:06:15.624263] [DEBUG] [LOCAL ] BMN: Derivative data saved (138 records). [2025-10-27T22:06:15.624322] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-27T22:06:15.626530] [INFO ] [MAIN ] Derivative Progress: 240/1881 symbols completed. BMN took 1.1s. Estimated remaining: 11m 5s. Rate: 148.0 symbols/min [2025-10-27T22:06:15.626967] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:15.627097] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:15.627263] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:15.691088] [DEBUG] [LOCAL ] BMO: Loaded 40521 existing records from primary storage. [2025-10-27T22:06:15.705523] [INFO ] [MAIN ] BMO: Loaded 40521 primary data records. [2025-10-27T22:06:15.706253] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-27T22:06:15.718165] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-27T22:06:15.809794] [DEBUG] [LOCAL ] BN: Loaded 52973 existing records from primary storage. [2025-10-27T22:06:15.845812] [INFO ] [MAIN ] BN: Loaded 52973 primary data records. [2025-10-27T22:06:16.690379] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:16.717241] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:16.750023] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:16.809575] [INFO ] [MAIN ] BMO: Generated 138 derivative records from 40521 primary records. [2025-10-27T22:06:16.811391] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-27T22:06:16.827066] [INFO ] [MAIN ] BN: Generated 138 derivative records from 52973 primary records. [2025-10-27T22:06:16.829696] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-27T22:06:16.830206] [DEBUG] [LOCAL ] BMO: Derivative data saved (138 records). [2025-10-27T22:06:16.830900] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-27T22:06:16.834386] [INFO ] [MAIN ] Derivative Progress: 241/1881 symbols completed. BMO took 1.2s. Estimated remaining: 11m 10s. Rate: 146.8 symbols/min [2025-10-27T22:06:16.834935] [INFO ] [MAIN ] BMY: Generated 138 derivative records from 53757 primary records. [2025-10-27T22:06:16.834544] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:16.846209] [DEBUG] [LOCAL ] BN: Derivative data saved (138 records). [2025-10-27T22:06:16.843497] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-27T22:06:16.846335] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-27T22:06:16.850085] [INFO ] [MAIN ] Derivative Progress: 242/1881 symbols completed. BN took 1.2s. Estimated remaining: 11m 7s. Rate: 147.3 symbols/min [2025-10-27T22:06:16.850885] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:16.863388] [DEBUG] [LOCAL ] BMY: Derivative data saved (138 records). [2025-10-27T22:06:16.864793] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-27T22:06:16.867227] [INFO ] [MAIN ] Derivative Progress: 243/1881 symbols completed. BMY took 1.2s. Estimated remaining: 11m 4s. Rate: 147.9 symbols/min [2025-10-27T22:06:16.867432] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:16.870957] [DEBUG] [LOCAL ] BNH: Loaded 4511 existing records from primary storage. [2025-10-27T22:06:16.871125] [INFO ] [MAIN ] BNH: Loaded 4511 primary data records. [2025-10-27T22:06:16.961967] [DEBUG] [LOCAL ] BNJ: Loaded 2407 existing records from primary storage. [2025-10-27T22:06:16.989060] [DEBUG] [LOCAL ] BNED: Loaded 27853 existing records from primary storage. [2025-10-27T22:06:16.992327] [INFO ] [MAIN ] BNED: Loaded 27853 primary data records. [2025-10-27T22:06:16.988537] [INFO ] [MAIN ] BNJ: Loaded 2407 primary data records. [2025-10-27T22:06:17.832186] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:17.871245] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:17.902914] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:17.963468] [INFO ] [MAIN ] BNH: Generated 138 derivative records from 4511 primary records. [2025-10-27T22:06:17.963872] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-27T22:06:17.984062] [DEBUG] [LOCAL ] BNH: Derivative data saved (138 records). [2025-10-27T22:06:17.986783] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-27T22:06:17.988804] [INFO ] [MAIN ] Derivative Progress: 244/1881 symbols completed. BNH took 1.1s. Estimated remaining: 11m 9s. Rate: 146.9 symbols/min [2025-10-27T22:06:17.989048] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:17.994187] [INFO ] [MAIN ] BNED: Generated 138 derivative records from 27853 primary records. [2025-10-27T22:06:17.994427] [INFO ] [MAIN ] BNJ: Generated 138 derivative records from 2407 primary records. [2025-10-27T22:06:17.994639] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-27T22:06:17.995305] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-27T22:06:18.015970] [DEBUG] [LOCAL ] BNED: Derivative data saved (138 records). [2025-10-27T22:06:18.016340] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-27T22:06:18.021235] [INFO ] [MAIN ] Derivative Progress: 245/1881 symbols completed. BNED took 1.2s. Estimated remaining: 11m 6s. Rate: 147.4 symbols/min [2025-10-27T22:06:18.018562] [DEBUG] [LOCAL ] BNJ: Derivative data saved (138 records). [2025-10-27T22:06:18.021440] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:18.021806] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-27T22:06:18.024250] [INFO ] [MAIN ] Derivative Progress: 246/1881 symbols completed. BNJ took 1.2s. Estimated remaining: 11m 3s. Rate: 148.0 symbols/min [2025-10-27T22:06:18.024447] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:18.030551] [DEBUG] [LOCAL ] BNT: Loaded 3318 existing records from primary storage. [2025-10-27T22:06:18.030744] [INFO ] [MAIN ] BNT: Loaded 3318 primary data records. [2025-10-27T22:06:18.249416] [DEBUG] [LOCAL ] BNL: Loaded 46837 existing records from primary storage. [2025-10-27T22:06:18.356941] [INFO ] [MAIN ] BNL: Loaded 46837 primary data records. [2025-10-27T22:06:18.482088] [DEBUG] [LOCAL ] BNS: Loaded 51296 existing records from primary storage. [2025-10-27T22:06:18.486358] [INFO ] [MAIN ] BNS: Loaded 51296 primary data records. [2025-10-27T22:06:19.031136] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:19.083867] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:19.106072] [INFO ] [MAIN ] BNT: Generated 138 derivative records from 3318 primary records. [2025-10-27T22:06:19.121462] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-27T22:06:19.121117] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:19.149622] [DEBUG] [LOCAL ] BNT: Derivative data saved (138 records). [2025-10-27T22:06:19.150477] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-27T22:06:19.154979] [INFO ] [MAIN ] Derivative Progress: 247/1881 symbols completed. BNT took 1.1s. Estimated remaining: 11m 7s. Rate: 147.0 symbols/min [2025-10-27T22:06:19.158027] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:19.175812] [DEBUG] [LOCAL ] BNY: Loaded 7109 existing records from primary storage. [2025-10-27T22:06:19.178631] [INFO ] [MAIN ] BNY: Loaded 7109 primary data records. [2025-10-27T22:06:19.291558] [INFO ] [MAIN ] BNL: Generated 138 derivative records from 46837 primary records. [2025-10-27T22:06:19.313868] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-27T22:06:19.385923] [INFO ] [MAIN ] BNS: Generated 138 derivative records from 51296 primary records. [2025-10-27T22:06:19.488446] [DEBUG] [LOCAL ] BNL: Derivative data saved (138 records). [2025-10-27T22:06:19.502016] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-27T22:06:19.493744] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-27T22:06:19.505165] [INFO ] [MAIN ] Derivative Progress: 248/1881 symbols completed. BNL took 1.5s. Estimated remaining: 11m 6s. Rate: 147.0 symbols/min [2025-10-27T22:06:19.505752] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:19.521071] [DEBUG] [LOCAL ] BNS: Derivative data saved (138 records). [2025-10-27T22:06:19.521596] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-27T22:06:19.524251] [INFO ] [MAIN ] Derivative Progress: 249/1881 symbols completed. BNS took 1.5s. Estimated remaining: 11m 3s. Rate: 147.6 symbols/min [2025-10-27T22:06:19.524514] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:19.538965] [DEBUG] [LOCAL ] BOE: Loaded 17571 existing records from primary storage. [2025-10-27T22:06:19.539344] [INFO ] [MAIN ] BOE: Loaded 17571 primary data records. [2025-10-27T22:06:19.712121] [DEBUG] [LOCAL ] BOH: Loaded 30475 existing records from primary storage. [2025-10-27T22:06:19.871407] [INFO ] [MAIN ] BOH: Loaded 30475 primary data records. [2025-10-27T22:06:19.877551] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:20.236536] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:20.248747] [INFO ] [MAIN ] BNY: Generated 138 derivative records from 7109 primary records. [2025-10-27T22:06:20.250154] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-27T22:06:20.265506] [DEBUG] [LOCAL ] BNY: Derivative data saved (138 records). [2025-10-27T22:06:20.265887] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-27T22:06:20.270407] [INFO ] [MAIN ] Derivative Progress: 250/1881 symbols completed. BNY took 1.1s. Estimated remaining: 11m 5s. Rate: 147.1 symbols/min [2025-10-27T22:06:20.271079] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:20.293003] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:20.330526] [INFO ] [MAIN ] BOE: Generated 138 derivative records from 17571 primary records. [2025-10-27T22:06:20.334256] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-27T22:06:20.347815] [DEBUG] [LOCAL ] BOE: Derivative data saved (138 records). [2025-10-27T22:06:20.360877] [DEBUG] [LOCAL ] BOND: Loaded 32267 existing records from primary storage. [2025-10-27T22:06:20.356855] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-27T22:06:20.361089] [INFO ] [MAIN ] BOND: Loaded 32267 primary data records. [2025-10-27T22:06:20.363247] [INFO ] [MAIN ] Derivative Progress: 251/1881 symbols completed. BOE took 0.9s. Estimated remaining: 11m 3s. Rate: 147.6 symbols/min [2025-10-27T22:06:20.363479] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:20.525021] [INFO ] [MAIN ] BOH: Generated 138 derivative records from 30475 primary records. [2025-10-27T22:06:20.551272] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-27T22:06:20.692537] [DEBUG] [LOCAL ] BOH: Derivative data saved (138 records). [2025-10-27T22:06:20.692885] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-27T22:06:20.695171] [INFO ] [MAIN ] Derivative Progress: 252/1881 symbols completed. BOH took 1.2s. Estimated remaining: 11m 2s. Rate: 147.7 symbols/min [2025-10-27T22:06:20.696230] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:20.711706] [DEBUG] [LOCAL ] BOOT: Loaded 39109 existing records from primary storage. [2025-10-27T22:06:20.712004] [INFO ] [MAIN ] BOOT: Loaded 39109 primary data records. [2025-10-27T22:06:21.071528] [DEBUG] [LOCAL ] BORR: Loaded 51047 existing records from primary storage. [2025-10-27T22:06:21.072638] [INFO ] [MAIN ] BORR: Loaded 51047 primary data records. [2025-10-27T22:06:21.143756] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:21.477328] [INFO ] [MAIN ] BOND: Generated 138 derivative records from 32267 primary records. [2025-10-27T22:06:21.477086] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:21.477744] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-27T22:06:21.504821] [DEBUG] [LOCAL ] BOND: Derivative data saved (138 records). [2025-10-27T22:06:21.505908] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-27T22:06:21.508121] [INFO ] [MAIN ] Derivative Progress: 253/1881 symbols completed. BOND took 1.2s. Estimated remaining: 11m 4s. Rate: 147.1 symbols/min [2025-10-27T22:06:21.538000] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:21.553516] [INFO ] [MAIN ] BOOT: Generated 138 derivative records from 39109 primary records. [2025-10-27T22:06:21.553818] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-27T22:06:21.567115] [DEBUG] [LOCAL ] BOOT: Derivative data saved (138 records). [2025-10-27T22:06:21.569360] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-27T22:06:21.572012] [INFO ] [MAIN ] Derivative Progress: 254/1881 symbols completed. BOOT took 1.2s. Estimated remaining: 11m 1s. Rate: 147.6 symbols/min [2025-10-27T22:06:21.584298] [INFO ] [MAIN ] BORR: Generated 138 derivative records from 51047 primary records. [2025-10-27T22:06:21.584453] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-27T22:06:21.596207] [DEBUG] [LOCAL ] BORR: Derivative data saved (138 records). [2025-10-27T22:06:21.596261] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-27T22:06:21.598451] [INFO ] [MAIN ] Derivative Progress: 255/1881 symbols completed. BORR took 0.9s. Estimated remaining: 10m 59s. Rate: 148.1 symbols/min [2025-10-27T22:06:21.598862] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:21.599021] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:21.598970] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:21.620811] [DEBUG] [LOCAL ] BOW: Loaded 22536 existing records from primary storage. [2025-10-27T22:06:21.621011] [INFO ] [MAIN ] BOW: Loaded 22536 primary data records. [2025-10-27T22:06:21.881517] [DEBUG] [LOCAL ] BOX: Loaded 49989 existing records from primary storage. [2025-10-27T22:06:21.958676] [INFO ] [MAIN ] BOX: Loaded 49989 primary data records. [2025-10-27T22:06:21.966730] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-27T22:06:21.967495] [INFO ] [MAIN ] BP: Loaded 53705 primary data records. [2025-10-27T22:06:22.583416] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:22.628955] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:22.662906] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:22.684588] [INFO ] [MAIN ] BOW: Generated 138 derivative records from 22536 primary records. [2025-10-27T22:06:22.685145] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-27T22:06:22.705403] [DEBUG] [LOCAL ] BOW: Derivative data saved (138 records). [2025-10-27T22:06:22.706488] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-27T22:06:22.709690] [INFO ] [MAIN ] Derivative Progress: 256/1881 symbols completed. BOW took 1.1s. Estimated remaining: 11m 3s. Rate: 147.1 symbols/min [2025-10-27T22:06:22.712443] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:22.730458] [INFO ] [MAIN ] BP: Generated 138 derivative records from 53705 primary records. [2025-10-27T22:06:22.733466] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-27T22:06:22.757164] [DEBUG] [LOCAL ] BP: Derivative data saved (138 records). [2025-10-27T22:06:22.757595] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-27T22:06:22.757438] [INFO ] [MAIN ] BOX: Generated 138 derivative records from 49989 primary records. [2025-10-27T22:06:22.759805] [INFO ] [MAIN ] Derivative Progress: 257/1881 symbols completed. BP took 1.2s. Estimated remaining: 11m 0s. Rate: 147.6 symbols/min [2025-10-27T22:06:22.760185] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-27T22:06:22.760032] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:22.773395] [DEBUG] [LOCAL ] BOX: Derivative data saved (138 records). [2025-10-27T22:06:22.782976] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-27T22:06:22.785530] [INFO ] [MAIN ] Derivative Progress: 258/1881 symbols completed. BOX took 1.2s. Estimated remaining: 10m 57s. Rate: 148.2 symbols/min [2025-10-27T22:06:22.785751] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:22.787268] [DEBUG] [LOCAL ] BR: Loaded 34300 existing records from primary storage. [2025-10-27T22:06:22.787555] [INFO ] [MAIN ] BR: Loaded 34300 primary data records. [2025-10-27T22:06:22.988467] [DEBUG] [LOCAL ] BRC: Loaded 17909 existing records from primary storage. [2025-10-27T22:06:23.121881] [INFO ] [MAIN ] BRC: Loaded 17909 primary data records. [2025-10-27T22:06:23.173539] [DEBUG] [LOCAL ] BRBR: Loaded 51815 existing records from primary storage. [2025-10-27T22:06:23.201371] [INFO ] [MAIN ] BRBR: Loaded 51815 primary data records. [2025-10-27T22:06:23.755330] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:23.792098] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:23.824289] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:23.871080] [INFO ] [MAIN ] BR: Generated 138 derivative records from 34300 primary records. [2025-10-27T22:06:23.877189] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-27T22:06:23.897995] [DEBUG] [LOCAL ] BR: Derivative data saved (138 records). [2025-10-27T22:06:23.899705] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-27T22:06:23.902037] [INFO ] [MAIN ] Derivative Progress: 259/1881 symbols completed. BR took 1.2s. Estimated remaining: 11m 1s. Rate: 147.2 symbols/min [2025-10-27T22:06:23.903378] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:23.908399] [INFO ] [MAIN ] BRC: Generated 138 derivative records from 17909 primary records. [2025-10-27T22:06:23.908817] [INFO ] [MAIN ] BRBR: Generated 138 derivative records from 51815 primary records. [2025-10-27T22:06:23.909044] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-27T22:06:23.909597] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-27T22:06:23.921987] [DEBUG] [LOCAL ] BRC: Derivative data saved (138 records). [2025-10-27T22:06:23.933356] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-27T22:06:23.933264] [DEBUG] [LOCAL ] BRBR: Derivative data saved (138 records). [2025-10-27T22:06:23.935910] [INFO ] [MAIN ] Derivative Progress: 260/1881 symbols completed. BRC took 1.2s. Estimated remaining: 10m 59s. Rate: 147.7 symbols/min [2025-10-27T22:06:23.936279] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:23.936116] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-27T22:06:23.938859] [INFO ] [MAIN ] Derivative Progress: 261/1881 symbols completed. BRBR took 1.2s. Estimated remaining: 10m 56s. Rate: 148.3 symbols/min [2025-10-27T22:06:23.939550] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:23.966708] [DEBUG] [LOCAL ] BRCC: Loaded 39939 existing records from primary storage. [2025-10-27T22:06:23.966918] [INFO ] [MAIN ] BRCC: Loaded 39939 primary data records. [2025-10-27T22:06:24.318570] [DEBUG] [LOCAL ] BRO: Loaded 52099 existing records from primary storage. [2025-10-27T22:06:24.333422] [INFO ] [MAIN ] BRO: Loaded 52099 primary data records. [2025-10-27T22:06:24.333188] [DEBUG] [LOCAL ] BROS: Loaded 53298 existing records from primary storage. [2025-10-27T22:06:24.333778] [INFO ] [MAIN ] BROS: Loaded 53298 primary data records. [2025-10-27T22:06:25.016036] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:25.071569] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:25.101524] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:25.134129] [INFO ] [MAIN ] BRCC: Generated 138 derivative records from 39939 primary records. [2025-10-27T22:06:25.134502] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-27T22:06:25.150061] [DEBUG] [LOCAL ] BRCC: Derivative data saved (138 records). [2025-10-27T22:06:25.153681] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-27T22:06:25.156625] [INFO ] [MAIN ] Derivative Progress: 262/1881 symbols completed. BRCC took 1.3s. Estimated remaining: 11m 0s. Rate: 147.1 symbols/min [2025-10-27T22:06:25.157359] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:25.184786] [DEBUG] [LOCAL ] BRT: Loaded 5162 existing records from primary storage. [2025-10-27T22:06:25.185817] [INFO ] [MAIN ] BRT: Loaded 5162 primary data records. [2025-10-27T22:06:25.237477] [INFO ] [MAIN ] BRO: Generated 138 derivative records from 52099 primary records. [2025-10-27T22:06:25.249868] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-27T22:06:25.258635] [INFO ] [MAIN ] BROS: Generated 138 derivative records from 53298 primary records. [2025-10-27T22:06:25.265103] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-27T22:06:25.320154] [DEBUG] [LOCAL ] BROS: Derivative data saved (138 records). [2025-10-27T22:06:25.320388] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-27T22:06:25.322669] [INFO ] [MAIN ] Derivative Progress: 263/1881 symbols completed. BROS took 1.4s. Estimated remaining: 10m 58s. Rate: 147.5 symbols/min [2025-10-27T22:06:25.320277] [DEBUG] [LOCAL ] BRO: Derivative data saved (138 records). [2025-10-27T22:06:25.325957] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-27T22:06:25.326080] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:25.329419] [INFO ] [MAIN ] Derivative Progress: 264/1881 symbols completed. BRO took 1.4s. Estimated remaining: 10m 56s. Rate: 148.0 symbols/min [2025-10-27T22:06:25.340605] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:25.535282] [DEBUG] [LOCAL ] BRW: Loaded 20882 existing records from primary storage. [2025-10-27T22:06:25.535633] [INFO ] [MAIN ] BRW: Loaded 20882 primary data records. [2025-10-27T22:06:25.869235] [DEBUG] [LOCAL ] BRX: Loaded 51796 existing records from primary storage. [2025-10-27T22:06:25.869575] [INFO ] [MAIN ] BRX: Loaded 51796 primary data records. [2025-10-27T22:06:26.053883] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:26.242229] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:26.268856] [INFO ] [MAIN ] BRT: Generated 138 derivative records from 5162 primary records. [2025-10-27T22:06:26.270178] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-27T22:06:26.296626] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:26.310956] [DEBUG] [LOCAL ] BRT: Derivative data saved (138 records). [2025-10-27T22:06:26.313827] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-27T22:06:26.316171] [INFO ] [MAIN ] Derivative Progress: 265/1881 symbols completed. BRT took 1.2s. Estimated remaining: 10m 59s. Rate: 147.2 symbols/min [2025-10-27T22:06:26.317157] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:26.345728] [INFO ] [MAIN ] BRW: Generated 138 derivative records from 20882 primary records. [2025-10-27T22:06:26.347448] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-27T22:06:26.377196] [DEBUG] [LOCAL ] BRW: Derivative data saved (138 records). [2025-10-27T22:06:26.377331] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-27T22:06:26.375177] [DEBUG] [LOCAL ] BSAC: Loaded 32455 existing records from primary storage. [2025-10-27T22:06:26.381213] [INFO ] [MAIN ] Derivative Progress: 266/1881 symbols completed. BRW took 1.1s. Estimated remaining: 10m 56s. Rate: 147.7 symbols/min [2025-10-27T22:06:26.381441] [INFO ] [MAIN ] BSAC: Loaded 32455 primary data records. [2025-10-27T22:06:26.381382] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:26.394849] [INFO ] [MAIN ] BRX: Generated 138 derivative records from 51796 primary records. [2025-10-27T22:06:26.414257] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-27T22:06:26.506256] [DEBUG] [LOCAL ] BRX: Derivative data saved (138 records). [2025-10-27T22:06:26.532804] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-27T22:06:26.556533] [INFO ] [MAIN ] Derivative Progress: 267/1881 symbols completed. BRX took 1.2s. Estimated remaining: 10m 54s. Rate: 148.0 symbols/min [2025-10-27T22:06:26.554311] [DEBUG] [LOCAL ] BST: Loaded 17979 existing records from primary storage. [2025-10-27T22:06:26.584611] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:26.585394] [INFO ] [MAIN ] BST: Loaded 17979 primary data records. [2025-10-27T22:06:26.895551] [DEBUG] [LOCAL ] BSTZ: Loaded 24166 existing records from primary storage. [2025-10-27T22:06:27.033077] [INFO ] [MAIN ] BSTZ: Loaded 24166 primary data records. [2025-10-27T22:06:27.370549] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:27.411201] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:27.466520] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:27.487357] [INFO ] [MAIN ] BSAC: Generated 138 derivative records from 32455 primary records. [2025-10-27T22:06:27.497085] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-27T22:06:27.516243] [DEBUG] [LOCAL ] BSAC: Derivative data saved (138 records). [2025-10-27T22:06:27.516489] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-27T22:06:27.524141] [INFO ] [MAIN ] Derivative Progress: 268/1881 symbols completed. BSAC took 1.2s. Estimated remaining: 10m 57s. Rate: 147.2 symbols/min [2025-10-27T22:06:27.525446] [INFO ] [MAIN ] BST: Generated 138 derivative records from 17979 primary records. [2025-10-27T22:06:27.525905] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-27T22:06:27.545638] [DEBUG] [LOCAL ] BST: Derivative data saved (138 records). [2025-10-27T22:06:27.546048] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-27T22:06:27.549830] [INFO ] [MAIN ] Derivative Progress: 269/1881 symbols completed. BST took 1.2s. Estimated remaining: 10m 55s. Rate: 147.7 symbols/min [2025-10-27T22:06:27.551435] [INFO ] [MAIN ] BSTZ: Generated 138 derivative records from 24166 primary records. [2025-10-27T22:06:27.551534] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-27T22:06:27.563177] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (138 records). [2025-10-27T22:06:27.563233] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-27T22:06:27.565673] [INFO ] [MAIN ] Derivative Progress: 270/1881 symbols completed. BSTZ took 1.0s. Estimated remaining: 10m 52s. Rate: 148.3 symbols/min [2025-10-27T22:06:27.566052] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:27.566250] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:27.566143] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:27.575150] [DEBUG] [LOCAL ] BTA: Loaded 5673 existing records from primary storage. [2025-10-27T22:06:27.575366] [INFO ] [MAIN ] BTA: Loaded 5673 primary data records. [2025-10-27T22:06:27.920162] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-27T22:06:27.920337] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-27T22:06:27.918896] [DEBUG] [LOCAL ] BTE: Loaded 52671 existing records from primary storage. [2025-10-27T22:06:27.920677] [INFO ] [MAIN ] BTE: Loaded 52671 primary data records. [2025-10-27T22:06:28.522611] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:28.574220] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:28.598327] [INFO ] [MAIN ] BTA: Generated 138 derivative records from 5673 primary records. [2025-10-27T22:06:28.613233] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-27T22:06:28.614789] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:28.641111] [DEBUG] [LOCAL ] BTA: Derivative data saved (138 records). [2025-10-27T22:06:28.643867] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-27T22:06:28.646361] [INFO ] [MAIN ] Derivative Progress: 271/1881 symbols completed. BTA took 1.1s. Estimated remaining: 10m 56s. Rate: 147.4 symbols/min [2025-10-27T22:06:28.646879] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:28.671351] [INFO ] [MAIN ] BSX: Generated 138 derivative records from 53688 primary records. [2025-10-27T22:06:28.675053] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-27T22:06:28.704133] [DEBUG] [LOCAL ] BSX: Derivative data saved (138 records). [2025-10-27T22:06:28.705635] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-27T22:06:28.707772] [INFO ] [MAIN ] Derivative Progress: 272/1881 symbols completed. BSX took 1.1s. Estimated remaining: 10m 53s. Rate: 147.8 symbols/min [2025-10-27T22:06:28.708014] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:28.710897] [INFO ] [MAIN ] BTE: Generated 138 derivative records from 52671 primary records. [2025-10-27T22:06:28.711240] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-27T22:06:28.739306] [DEBUG] [LOCAL ] BTE: Derivative data saved (138 records). [2025-10-27T22:06:28.739460] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-27T22:06:28.741793] [INFO ] [MAIN ] Derivative Progress: 273/1881 symbols completed. BTE took 1.2s. Estimated remaining: 10m 50s. Rate: 148.3 symbols/min [2025-10-27T22:06:28.742899] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-27T22:06:28.743117] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:28.743300] [INFO ] [MAIN ] BTI: Loaded 53583 primary data records. [2025-10-27T22:06:28.783583] [DEBUG] [LOCAL ] BTO: Loaded 8609 existing records from primary storage. [2025-10-27T22:06:28.801142] [INFO ] [MAIN ] BTO: Loaded 8609 primary data records. [2025-10-27T22:06:29.124725] [DEBUG] [LOCAL ] BTT: Loaded 15124 existing records from primary storage. [2025-10-27T22:06:29.227695] [INFO ] [MAIN ] BTT: Loaded 15124 primary data records. [2025-10-27T22:06:29.728203] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:29.757222] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:29.823890] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:29.852126] [INFO ] [MAIN ] BTO: Generated 138 derivative records from 8609 primary records. [2025-10-27T22:06:29.854402] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-27T22:06:29.854663] [INFO ] [MAIN ] BTI: Generated 138 derivative records from 53583 primary records. [2025-10-27T22:06:29.854957] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-27T22:06:29.884094] [DEBUG] [LOCAL ] BTO: Derivative data saved (138 records). [2025-10-27T22:06:29.884245] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-27T22:06:29.884017] [DEBUG] [LOCAL ] BTI: Derivative data saved (138 records). [2025-10-27T22:06:29.887187] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-27T22:06:29.889807] [INFO ] [MAIN ] Derivative Progress: 274/1881 symbols completed. BTO took 1.2s. Estimated remaining: 10m 54s. Rate: 147.3 symbols/min [2025-10-27T22:06:29.892059] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:29.892344] [INFO ] [MAIN ] Derivative Progress: 275/1881 symbols completed. BTI took 1.2s. Estimated remaining: 10m 52s. Rate: 147.9 symbols/min [2025-10-27T22:06:29.892990] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:29.910617] [INFO ] [MAIN ] BTT: Generated 138 derivative records from 15124 primary records. [2025-10-27T22:06:29.910858] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-27T22:06:29.923376] [DEBUG] [LOCAL ] BTT: Derivative data saved (138 records). [2025-10-27T22:06:29.929472] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-27T22:06:29.933707] [INFO ] [MAIN ] Derivative Progress: 276/1881 symbols completed. BTT took 1.2s. Estimated remaining: 10m 49s. Rate: 148.4 symbols/min [2025-10-27T22:06:29.934515] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:29.934402] [DEBUG] [LOCAL ] BTZ: Loaded 22002 existing records from primary storage. [2025-10-27T22:06:29.935156] [INFO ] [MAIN ] BTZ: Loaded 22002 primary data records. [2025-10-27T22:06:30.122250] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-27T22:06:30.145572] [INFO ] [MAIN ] BTU: Loaded 53318 primary data records. [2025-10-27T22:06:30.417497] [DEBUG] [LOCAL ] BUD: Loaded 52580 existing records from primary storage. [2025-10-27T22:06:30.423908] [INFO ] [MAIN ] BUD: Loaded 52580 primary data records. [2025-10-27T22:06:31.009506] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:31.053991] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:31.105190] [INFO ] [MAIN ] BTZ: Generated 138 derivative records from 22002 primary records. [2025-10-27T22:06:31.104252] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:31.118201] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-27T22:06:31.139232] [DEBUG] [LOCAL ] BTZ: Derivative data saved (138 records). [2025-10-27T22:06:31.139815] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-27T22:06:31.144136] [INFO ] [MAIN ] Derivative Progress: 277/1881 symbols completed. BTZ took 1.3s. Estimated remaining: 10m 53s. Rate: 147.3 symbols/min [2025-10-27T22:06:31.147727] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:31.161718] [INFO ] [MAIN ] BTU: Generated 138 derivative records from 53318 primary records. [2025-10-27T22:06:31.166021] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-27T22:06:31.183295] [DEBUG] [LOCAL ] BUI: Loaded 11639 existing records from primary storage. [2025-10-27T22:06:31.187387] [DEBUG] [LOCAL ] BTU: Derivative data saved (138 records). [2025-10-27T22:06:31.187562] [INFO ] [MAIN ] BUI: Loaded 11639 primary data records. [2025-10-27T22:06:31.187920] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-27T22:06:31.245063] [INFO ] [MAIN ] BUD: Generated 138 derivative records from 52580 primary records. [2025-10-27T22:06:31.244806] [INFO ] [MAIN ] Derivative Progress: 278/1881 symbols completed. BTU took 1.4s. Estimated remaining: 10m 51s. Rate: 147.7 symbols/min [2025-10-27T22:06:31.252955] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-27T22:06:31.274575] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:31.321062] [DEBUG] [LOCAL ] BUD: Derivative data saved (138 records). [2025-10-27T22:06:31.341780] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-27T22:06:31.397735] [INFO ] [MAIN ] Derivative Progress: 279/1881 symbols completed. BUD took 1.5s. Estimated remaining: 10m 49s. Rate: 148.0 symbols/min [2025-10-27T22:06:31.503280] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:31.543278] [DEBUG] [LOCAL ] BUR: Loaded 45425 existing records from primary storage. [2025-10-27T22:06:31.543619] [INFO ] [MAIN ] BUR: Loaded 45425 primary data records. [2025-10-27T22:06:31.697979] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:31.897595] [DEBUG] [LOCAL ] BURL: Loaded 45188 existing records from primary storage. [2025-10-27T22:06:31.898134] [INFO ] [MAIN ] BURL: Loaded 45188 primary data records. [2025-10-27T22:06:32.220495] [INFO ] [MAIN ] BUI: Generated 138 derivative records from 11639 primary records. [2025-10-27T22:06:32.224312] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-27T22:06:32.249312] [DEBUG] [LOCAL ] BUI: Derivative data saved (138 records). [2025-10-27T22:06:32.249803] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-27T22:06:32.251763] [INFO ] [MAIN ] Derivative Progress: 280/1881 symbols completed. BUI took 1.1s. Estimated remaining: 10m 52s. Rate: 147.4 symbols/min [2025-10-27T22:06:32.252249] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:32.252130] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:32.301690] [INFO ] [MAIN ] BUR: Generated 138 derivative records from 45425 primary records. [2025-10-27T22:06:32.301928] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-27T22:06:32.322292] [DEBUG] [LOCAL ] BUR: Derivative data saved (138 records). [2025-10-27T22:06:32.337522] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-27T22:06:32.341109] [INFO ] [MAIN ] Derivative Progress: 281/1881 symbols completed. BUR took 1.1s. Estimated remaining: 10m 49s. Rate: 147.9 symbols/min [2025-10-27T22:06:32.341299] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:32.342153] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:32.342962] [DEBUG] [LOCAL ] BW: Loaded 40358 existing records from primary storage. [2025-10-27T22:06:32.343479] [INFO ] [MAIN ] BW: Loaded 40358 primary data records. [2025-10-27T22:06:32.702307] [DEBUG] [LOCAL ] BWA: Loaded 52031 existing records from primary storage. [2025-10-27T22:06:32.703421] [INFO ] [MAIN ] BWA: Loaded 52031 primary data records. [2025-10-27T22:06:32.775605] [INFO ] [MAIN ] BURL: Generated 138 derivative records from 45188 primary records. [2025-10-27T22:06:32.792683] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-27T22:06:32.848541] [DEBUG] [LOCAL ] BURL: Derivative data saved (138 records). [2025-10-27T22:06:32.848721] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-27T22:06:32.856131] [INFO ] [MAIN ] Derivative Progress: 282/1881 symbols completed. BURL took 1.4s. Estimated remaining: 10m 50s. Rate: 147.7 symbols/min [2025-10-27T22:06:32.870044] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:33.078896] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:06:33.100326] [DEBUG] [LOCAL ] BWG: Loaded 12426 existing records from primary storage. [2025-10-27T22:06:33.100888] [INFO ] [MAIN ] BWG: Loaded 12426 primary data records. [2025-10-27T22:06:33.432792] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:33.456507] [INFO ] [MAIN ] BW: Generated 138 derivative records from 40358 primary records. [2025-10-27T22:06:33.457665] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-27T22:06:33.475490] [DEBUG] [LOCAL ] BW: Derivative data saved (138 records). [2025-10-27T22:06:33.475670] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-27T22:06:33.478150] [INFO ] [MAIN ] Derivative Progress: 283/1881 symbols completed. BW took 1.2s. Estimated remaining: 10m 50s. Rate: 147.4 symbols/min [2025-10-27T22:06:33.492123] [INFO ] [MAIN ] BWA: Generated 138 derivative records from 52031 primary records. [2025-10-27T22:06:33.503958] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-27T22:06:33.504807] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:33.529340] [DEBUG] [LOCAL ] BWA: Derivative data saved (138 records). [2025-10-27T22:06:33.530517] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-27T22:06:33.532789] [INFO ] [MAIN ] Derivative Progress: 284/1881 symbols completed. BWA took 1.2s. Estimated remaining: 10m 48s. Rate: 147.9 symbols/min [2025-10-27T22:06:33.546121] [INFO ] [MAIN ] BWG: Generated 138 derivative records from 12426 primary records. [2025-10-27T22:06:33.546212] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-27T22:06:33.557590] [DEBUG] [LOCAL ] BWG: Derivative data saved (138 records). [2025-10-27T22:06:33.557709] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-27T22:06:33.560014] [INFO ] [MAIN ] Derivative Progress: 285/1881 symbols completed. BWG took 0.7s. Estimated remaining: 10m 45s. Rate: 148.4 symbols/min [2025-10-27T22:06:33.560434] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:33.560663] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:33.560530] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:33.571812] [DEBUG] [LOCAL ] BWNB: Loaded 4033 existing records from primary storage. [2025-10-27T22:06:33.575537] [INFO ] [MAIN ] BWNB: Loaded 4033 primary data records. [2025-10-27T22:06:33.575780] [DEBUG] [LOCAL ] BWSN: Loaded 5047 existing records from primary storage. [2025-10-27T22:06:33.603058] [DEBUG] [LOCAL ] BWMX: Loaded 7931 existing records from primary storage. [2025-10-27T22:06:33.603176] [INFO ] [MAIN ] BWMX: Loaded 7931 primary data records. [2025-10-27T22:06:33.610356] [INFO ] [MAIN ] BWSN: Loaded 5047 primary data records. [2025-10-27T22:06:34.502348] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:34.545594] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:34.546516] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:34.624720] [INFO ] [MAIN ] BWNB: Generated 138 derivative records from 4033 primary records. [2025-10-27T22:06:34.630263] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-27T22:06:34.645392] [INFO ] [MAIN ] BWMX: Generated 138 derivative records from 7931 primary records. [2025-10-27T22:06:34.647690] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-27T22:06:34.647603] [INFO ] [MAIN ] BWSN: Generated 138 derivative records from 5047 primary records. [2025-10-27T22:06:34.648346] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-27T22:06:34.649237] [DEBUG] [LOCAL ] BWNB: Derivative data saved (138 records). [2025-10-27T22:06:34.649907] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-27T22:06:34.652326] [INFO ] [MAIN ] Derivative Progress: 286/1881 symbols completed. BWNB took 1.1s. Estimated remaining: 10m 49s. Rate: 147.5 symbols/min [2025-10-27T22:06:34.659441] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:34.672817] [DEBUG] [LOCAL ] BWMX: Derivative data saved (138 records). [2025-10-27T22:06:34.674163] [DEBUG] [LOCAL ] BWSN: Derivative data saved (138 records). [2025-10-27T22:06:34.674420] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-27T22:06:34.674340] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-27T22:06:34.676676] [INFO ] [MAIN ] Derivative Progress: 287/1881 symbols completed. BWSN took 1.1s. Estimated remaining: 10m 46s. Rate: 148.0 symbols/min [2025-10-27T22:06:34.679340] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:34.679622] [INFO ] [MAIN ] Derivative Progress: 288/1881 symbols completed. BWMX took 1.1s. Estimated remaining: 10m 44s. Rate: 148.5 symbols/min [2025-10-27T22:06:34.679937] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:34.700630] [DEBUG] [LOCAL ] BXMX: Loaded 18764 existing records from primary storage. [2025-10-27T22:06:34.700772] [INFO ] [MAIN ] BXMX: Loaded 18764 primary data records. [2025-10-27T22:06:34.911903] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-27T22:06:35.028188] [INFO ] [MAIN ] BX: Loaded 53483 primary data records. [2025-10-27T22:06:35.098399] [DEBUG] [LOCAL ] BXMT: Loaded 47144 existing records from primary storage. [2025-10-27T22:06:35.113321] [INFO ] [MAIN ] BXMT: Loaded 47144 primary data records. [2025-10-27T22:06:35.692225] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:35.731805] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:35.769823] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:35.808561] [INFO ] [MAIN ] BXMX: Generated 138 derivative records from 18764 primary records. [2025-10-27T22:06:35.810153] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-27T22:06:35.826471] [DEBUG] [LOCAL ] BXMX: Derivative data saved (138 records). [2025-10-27T22:06:35.829250] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-27T22:06:35.831631] [INFO ] [MAIN ] Derivative Progress: 289/1881 symbols completed. BXMX took 1.2s. Estimated remaining: 10m 47s. Rate: 147.5 symbols/min [2025-10-27T22:06:35.831948] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:35.847354] [INFO ] [MAIN ] BXMT: Generated 138 derivative records from 47144 primary records. [2025-10-27T22:06:35.849198] [INFO ] [MAIN ] BX: Generated 138 derivative records from 53483 primary records. [2025-10-27T22:06:35.849582] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-27T22:06:35.849298] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-27T22:06:35.854716] [DEBUG] [LOCAL ] BYM: Loaded 11121 existing records from primary storage. [2025-10-27T22:06:35.866890] [DEBUG] [LOCAL ] BX: Derivative data saved (138 records). [2025-10-27T22:06:35.867304] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-27T22:06:35.869551] [INFO ] [MAIN ] Derivative Progress: 290/1881 symbols completed. BX took 1.2s. Estimated remaining: 10m 45s. Rate: 148.0 symbols/min [2025-10-27T22:06:35.876976] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:35.869630] [INFO ] [MAIN ] BYM: Loaded 11121 primary data records. [2025-10-27T22:06:35.893203] [DEBUG] [LOCAL ] BXMT: Derivative data saved (138 records). [2025-10-27T22:06:35.912751] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-27T22:06:35.927151] [INFO ] [MAIN ] Derivative Progress: 291/1881 symbols completed. BXMT took 1.2s. Estimated remaining: 10m 43s. Rate: 148.4 symbols/min [2025-10-27T22:06:35.940265] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:36.196063] [DEBUG] [LOCAL ] BZH: Loaded 31712 existing records from primary storage. [2025-10-27T22:06:36.196200] [INFO ] [MAIN ] BZH: Loaded 31712 primary data records. [2025-10-27T22:06:36.413204] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-27T22:06:36.518118] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-10-27T22:06:36.851575] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:36.889909] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:36.946191] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:36.973324] [INFO ] [MAIN ] BYM: Generated 138 derivative records from 11121 primary records. [2025-10-27T22:06:36.974019] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-27T22:06:36.996351] [DEBUG] [LOCAL ] BYM: Derivative data saved (138 records). [2025-10-27T22:06:36.996595] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-27T22:06:37.001272] [INFO ] [MAIN ] Derivative Progress: 292/1881 symbols completed. BYM took 1.2s. Estimated remaining: 10m 46s. Rate: 147.6 symbols/min [2025-10-27T22:06:37.004553] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:37.010443] [INFO ] [MAIN ] BZH: Generated 138 derivative records from 31712 primary records. [2025-10-27T22:06:37.013355] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-27T22:06:37.027481] [DEBUG] [LOCAL ] BZH: Derivative data saved (138 records). [2025-10-27T22:06:37.027634] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-27T22:06:37.030431] [INFO ] [MAIN ] Derivative Progress: 293/1881 symbols completed. BZH took 1.2s. Estimated remaining: 10m 43s. Rate: 148.1 symbols/min [2025-10-27T22:06:37.030627] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:37.043812] [INFO ] [MAIN ] C: Generated 138 derivative records from 53741 primary records. [2025-10-27T22:06:37.044020] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-27T22:06:37.064115] [DEBUG] [LOCAL ] C: Derivative data saved (138 records). [2025-10-27T22:06:37.070352] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-27T22:06:37.072799] [INFO ] [MAIN ] Derivative Progress: 294/1881 symbols completed. C took 1.1s. Estimated remaining: 10m 41s. Rate: 148.5 symbols/min [2025-10-27T22:06:37.072983] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:37.073925] [DEBUG] [LOCAL ] CABO: Loaded 16486 existing records from primary storage. [2025-10-27T22:06:37.074190] [INFO ] [MAIN ] CABO: Loaded 16486 primary data records. [2025-10-27T22:06:37.182844] [DEBUG] [LOCAL ] CACI: Loaded 22047 existing records from primary storage. [2025-10-27T22:06:37.194799] [INFO ] [MAIN ] CACI: Loaded 22047 primary data records. [2025-10-27T22:06:37.609286] [DEBUG] [LOCAL ] CADE: Loaded 49705 existing records from primary storage. [2025-10-27T22:06:37.614607] [INFO ] [MAIN ] CADE: Loaded 49705 primary data records. [2025-10-27T22:06:38.070718] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:38.114227] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:38.165754] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:38.204867] [INFO ] [MAIN ] CABO: Generated 138 derivative records from 16486 primary records. [2025-10-27T22:06:38.205550] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-27T22:06:38.234856] [DEBUG] [LOCAL ] CABO: Derivative data saved (138 records). [2025-10-27T22:06:38.235525] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-27T22:06:38.242114] [INFO ] [MAIN ] Derivative Progress: 295/1881 symbols completed. CABO took 1.2s. Estimated remaining: 10m 45s. Rate: 147.6 symbols/min [2025-10-27T22:06:38.243068] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:38.246358] [INFO ] [MAIN ] CACI: Generated 138 derivative records from 22047 primary records. [2025-10-27T22:06:38.248050] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-27T22:06:38.264714] [DEBUG] [LOCAL ] CACI: Derivative data saved (138 records). [2025-10-27T22:06:38.264989] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-27T22:06:38.267682] [INFO ] [MAIN ] Derivative Progress: 296/1881 symbols completed. CACI took 1.2s. Estimated remaining: 10m 42s. Rate: 148.0 symbols/min [2025-10-27T22:06:38.268847] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:38.271543] [INFO ] [MAIN ] CADE: Generated 138 derivative records from 49705 primary records. [2025-10-27T22:06:38.271924] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-27T22:06:38.285291] [DEBUG] [LOCAL ] CADE: Derivative data saved (138 records). [2025-10-27T22:06:38.285530] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-27T22:06:38.291744] [INFO ] [MAIN ] Derivative Progress: 297/1881 symbols completed. CADE took 1.2s. Estimated remaining: 10m 40s. Rate: 148.5 symbols/min [2025-10-27T22:06:38.288289] [DEBUG] [LOCAL ] CAF: Loaded 3393 existing records from primary storage. [2025-10-27T22:06:38.303456] [INFO ] [MAIN ] CAF: Loaded 3393 primary data records. [2025-10-27T22:06:38.303720] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:38.422799] [DEBUG] [LOCAL ] CAE: Loaded 38731 existing records from primary storage. [2025-10-27T22:06:38.436948] [INFO ] [MAIN ] CAE: Loaded 38731 primary data records. [2025-10-27T22:06:39.030766] [DEBUG] [LOCAL ] CAH: Loaded 51367 existing records from primary storage. [2025-10-27T22:06:39.032371] [INFO ] [MAIN ] CAH: Loaded 51367 primary data records. [2025-10-27T22:06:39.428945] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:39.472184] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:39.541125] [INFO ] [MAIN ] CAF: Generated 138 derivative records from 3393 primary records. [2025-10-27T22:06:39.555921] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:39.555027] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-27T22:06:39.607047] [DEBUG] [LOCAL ] CAF: Derivative data saved (138 records). [2025-10-27T22:06:39.610618] [INFO ] [MAIN ] CAE: Generated 138 derivative records from 38731 primary records. [2025-10-27T22:06:39.611012] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-27T22:06:39.613899] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-27T22:06:39.618053] [INFO ] [MAIN ] Derivative Progress: 298/1881 symbols completed. CAF took 1.3s. Estimated remaining: 10m 44s. Rate: 147.4 symbols/min [2025-10-27T22:06:39.635053] [DEBUG] [LOCAL ] CAE: Derivative data saved (138 records). [2025-10-27T22:06:39.636965] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-27T22:06:39.640745] [INFO ] [MAIN ] Derivative Progress: 299/1881 symbols completed. CAE took 1.4s. Estimated remaining: 10m 42s. Rate: 147.9 symbols/min [2025-10-27T22:06:39.657884] [INFO ] [MAIN ] CAH: Generated 138 derivative records from 51367 primary records. [2025-10-27T22:06:39.658103] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-27T22:06:39.679102] [DEBUG] [LOCAL ] CAH: Derivative data saved (138 records). [2025-10-27T22:06:39.679249] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-27T22:06:39.683558] [INFO ] [MAIN ] Derivative Progress: 300/1881 symbols completed. CAH took 1.4s. Estimated remaining: 10m 40s. Rate: 148.3 symbols/min [2025-10-27T22:06:39.684352] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:39.684518] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:39.684236] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:39.729956] [DEBUG] [LOCAL ] CANG: Loaded 26993 existing records from primary storage. [2025-10-27T22:06:39.730262] [INFO ] [MAIN ] CANG: Loaded 26993 primary data records. [2025-10-27T22:06:39.876109] [DEBUG] [LOCAL ] CAL: Loaded 42457 existing records from primary storage. [2025-10-27T22:06:39.901670] [INFO ] [MAIN ] CAL: Loaded 42457 primary data records. [2025-10-27T22:06:40.041791] [DEBUG] [LOCAL ] CAT: Loaded 52903 existing records from primary storage. [2025-10-27T22:06:40.102402] [INFO ] [MAIN ] CAT: Loaded 52903 primary data records. [2025-10-27T22:06:40.975002] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:41.020368] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:41.065341] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:41.087025] [INFO ] [MAIN ] CANG: Generated 138 derivative records from 26993 primary records. [2025-10-27T22:06:41.087627] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-27T22:06:41.111564] [DEBUG] [LOCAL ] CANG: Derivative data saved (138 records). [2025-10-27T22:06:41.113017] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-27T22:06:41.116418] [INFO ] [MAIN ] Derivative Progress: 301/1881 symbols completed. CANG took 1.4s. Estimated remaining: 10m 45s. Rate: 147.1 symbols/min [2025-10-27T22:06:41.116833] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:41.122618] [INFO ] [MAIN ] CAL: Generated 138 derivative records from 42457 primary records. [2025-10-27T22:06:41.124041] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-27T22:06:41.133178] [DEBUG] [LOCAL ] CATO: Loaded 6605 existing records from primary storage. [2025-10-27T22:06:41.133566] [INFO ] [MAIN ] CATO: Loaded 6605 primary data records. [2025-10-27T22:06:41.177908] [DEBUG] [LOCAL ] CAL: Derivative data saved (138 records). [2025-10-27T22:06:41.216231] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-27T22:06:41.241236] [INFO ] [MAIN ] Derivative Progress: 302/1881 symbols completed. CAL took 1.6s. Estimated remaining: 10m 43s. Rate: 147.4 symbols/min [2025-10-27T22:06:41.257551] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:41.265834] [INFO ] [MAIN ] CAT: Generated 138 derivative records from 52903 primary records. [2025-10-27T22:06:41.276583] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-27T22:06:41.464315] [DEBUG] [LOCAL ] CAT: Derivative data saved (138 records). [2025-10-27T22:06:41.464611] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-27T22:06:41.467890] [INFO ] [MAIN ] Derivative Progress: 303/1881 symbols completed. CAT took 1.8s. Estimated remaining: 10m 41s. Rate: 147.6 symbols/min [2025-10-27T22:06:41.468206] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:41.522736] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:06:41.534783] [DEBUG] [LOCAL ] CAVA: Loaded 53539 existing records from primary storage. [2025-10-27T22:06:41.537759] [INFO ] [MAIN ] CAVA: Loaded 53539 primary data records. [2025-10-27T22:06:41.673949] [DEBUG] [LOCAL ] CB: Loaded 49917 existing records from primary storage. [2025-10-27T22:06:41.695989] [INFO ] [MAIN ] CB: Loaded 49917 primary data records. [2025-10-27T22:06:42.211980] [INFO ] [MAIN ] CATO: Generated 138 derivative records from 6605 primary records. [2025-10-27T22:06:42.212322] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-27T22:06:42.226052] [DEBUG] [LOCAL ] CATO: Derivative data saved (138 records). [2025-10-27T22:06:42.226481] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-27T22:06:42.228572] [INFO ] [MAIN ] Derivative Progress: 304/1881 symbols completed. CATO took 1.1s. Estimated remaining: 10m 43s. Rate: 147.2 symbols/min [2025-10-27T22:06:42.229092] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:42.243135] [DEBUG] [LOCAL ] CBAN: Loaded 10025 existing records from primary storage. [2025-10-27T22:06:42.243468] [INFO ] [MAIN ] CBAN: Loaded 10025 primary data records. [2025-10-27T22:06:42.329416] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:42.442277] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:42.626801] [INFO ] [MAIN ] CAVA: Generated 138 derivative records from 53539 primary records. [2025-10-27T22:06:42.627084] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-27T22:06:42.663054] [DEBUG] [LOCAL ] CAVA: Derivative data saved (138 records). [2025-10-27T22:06:42.663795] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-27T22:06:42.666260] [INFO ] [MAIN ] Derivative Progress: 305/1881 symbols completed. CAVA took 1.4s. Estimated remaining: 10m 43s. Rate: 147.2 symbols/min [2025-10-27T22:06:42.669050] [INFO ] [MAIN ] CB: Generated 138 derivative records from 49917 primary records. [2025-10-27T22:06:42.668736] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:42.669554] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-27T22:06:42.668599] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:42.697943] [DEBUG] [LOCAL ] CB: Derivative data saved (138 records). [2025-10-27T22:06:42.704450] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-27T22:06:42.707094] [INFO ] [MAIN ] Derivative Progress: 306/1881 symbols completed. CB took 1.2s. Estimated remaining: 10m 40s. Rate: 147.6 symbols/min [2025-10-27T22:06:42.707336] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:42.720678] [DEBUG] [LOCAL ] CBL: Loaded 15649 existing records from primary storage. [2025-10-27T22:06:42.721965] [INFO ] [MAIN ] CBL: Loaded 15649 primary data records. [2025-10-27T22:06:42.732265] [DEBUG] [LOCAL ] CBNA: Loaded 2817 existing records from primary storage. [2025-10-27T22:06:42.742621] [INFO ] [MAIN ] CBNA: Loaded 2817 primary data records. [2025-10-27T22:06:43.362172] [INFO ] [MAIN ] CBAN: Generated 138 derivative records from 10025 primary records. [2025-10-27T22:06:43.362968] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-27T22:06:43.377162] [DEBUG] [LOCAL ] CBAN: Derivative data saved (138 records). [2025-10-27T22:06:43.377922] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-27T22:06:43.380307] [INFO ] [MAIN ] Derivative Progress: 307/1881 symbols completed. CBAN took 1.2s. Estimated remaining: 10m 41s. Rate: 147.3 symbols/min [2025-10-27T22:06:43.380736] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:43.413761] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:43.425176] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:43.489412] [DEBUG] [LOCAL ] CBRE: Loaded 50256 existing records from primary storage. [2025-10-27T22:06:43.492672] [INFO ] [MAIN ] CBRE: Loaded 50256 primary data records. [2025-10-27T22:06:43.684980] [INFO ] [MAIN ] CBL: Generated 138 derivative records from 15649 primary records. [2025-10-27T22:06:43.691191] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-27T22:06:43.846824] [INFO ] [MAIN ] CBNA: Generated 138 derivative records from 2817 primary records. [2025-10-27T22:06:43.861400] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-27T22:06:43.864601] [DEBUG] [LOCAL ] CBL: Derivative data saved (138 records). [2025-10-27T22:06:43.864761] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-27T22:06:43.867482] [INFO ] [MAIN ] Derivative Progress: 308/1881 symbols completed. CBL took 1.2s. Estimated remaining: 10m 41s. Rate: 147.2 symbols/min [2025-10-27T22:06:43.867992] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:43.877903] [DEBUG] [LOCAL ] CBNA: Derivative data saved (138 records). [2025-10-27T22:06:43.879274] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-27T22:06:43.882252] [INFO ] [MAIN ] Derivative Progress: 309/1881 symbols completed. CBNA took 1.2s. Estimated remaining: 10m 39s. Rate: 147.6 symbols/min [2025-10-27T22:06:43.882959] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:43.932501] [DEBUG] [LOCAL ] CBU: Loaded 22333 existing records from primary storage. [2025-10-27T22:06:43.933056] [INFO ] [MAIN ] CBU: Loaded 22333 primary data records. [2025-10-27T22:06:43.932980] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:43.966964] [DEBUG] [LOCAL ] CBT: Loaded 30570 existing records from primary storage. [2025-10-27T22:06:43.972239] [INFO ] [MAIN ] CBT: Loaded 30570 primary data records. [2025-10-27T22:06:44.569279] [INFO ] [MAIN ] CBRE: Generated 138 derivative records from 50256 primary records. [2025-10-27T22:06:44.569942] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-27T22:06:44.583865] [DEBUG] [LOCAL ] CBRE: Derivative data saved (138 records). [2025-10-27T22:06:44.584065] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-27T22:06:44.586440] [INFO ] [MAIN ] Derivative Progress: 310/1881 symbols completed. CBRE took 1.2s. Estimated remaining: 10m 40s. Rate: 147.3 symbols/min [2025-10-27T22:06:44.586748] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:44.603301] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:44.636025] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:44.673869] [DEBUG] [LOCAL ] CBZ: Loaded 34157 existing records from primary storage. [2025-10-27T22:06:44.675539] [INFO ] [MAIN ] CBZ: Loaded 34157 primary data records. [2025-10-27T22:06:44.997101] [INFO ] [MAIN ] CBU: Generated 138 derivative records from 22333 primary records. [2025-10-27T22:06:45.000508] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-27T22:06:45.013478] [INFO ] [MAIN ] CBT: Generated 138 derivative records from 30570 primary records. [2025-10-27T22:06:45.017921] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-27T22:06:45.018805] [DEBUG] [LOCAL ] CBU: Derivative data saved (138 records). [2025-10-27T22:06:45.019133] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-27T22:06:45.021608] [INFO ] [MAIN ] Derivative Progress: 311/1881 symbols completed. CBU took 1.1s. Estimated remaining: 10m 40s. Rate: 147.3 symbols/min [2025-10-27T22:06:45.022695] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:45.034356] [DEBUG] [LOCAL ] CBT: Derivative data saved (138 records). [2025-10-27T22:06:45.034715] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-27T22:06:45.037235] [INFO ] [MAIN ] Derivative Progress: 312/1881 symbols completed. CBT took 1.2s. Estimated remaining: 10m 37s. Rate: 147.7 symbols/min [2025-10-27T22:06:45.037459] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:45.058875] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:45.127466] [DEBUG] [LOCAL ] CC: Loaded 52972 existing records from primary storage. [2025-10-27T22:06:45.130687] [INFO ] [MAIN ] CC: Loaded 52972 primary data records. [2025-10-27T22:06:45.213188] [DEBUG] [LOCAL ] CCI: Loaded 53098 existing records from primary storage. [2025-10-27T22:06:45.225694] [INFO ] [MAIN ] CCI: Loaded 53098 primary data records. [2025-10-27T22:06:45.345520] [INFO ] [MAIN ] CBZ: Generated 138 derivative records from 34157 primary records. [2025-10-27T22:06:45.515138] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-27T22:06:45.559133] [DEBUG] [LOCAL ] CBZ: Derivative data saved (138 records). [2025-10-27T22:06:45.565275] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-27T22:06:45.572797] [INFO ] [MAIN ] Derivative Progress: 313/1881 symbols completed. CBZ took 1.0s. Estimated remaining: 10m 38s. Rate: 147.6 symbols/min [2025-10-27T22:06:45.792874] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:45.871254] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:45.901940] [INFO ] [MAIN ] CC: Generated 138 derivative records from 52972 primary records. [2025-10-27T22:06:45.904550] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-27T22:06:45.920668] [DEBUG] [LOCAL ] CC: Derivative data saved (138 records). [2025-10-27T22:06:45.920808] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-27T22:06:45.924234] [INFO ] [MAIN ] Derivative Progress: 314/1881 symbols completed. CC took 0.9s. Estimated remaining: 10m 37s. Rate: 147.6 symbols/min [2025-10-27T22:06:45.928520] [INFO ] [MAIN ] CCI: Generated 138 derivative records from 53098 primary records. [2025-10-27T22:06:45.928614] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-27T22:06:45.940425] [DEBUG] [LOCAL ] CCI: Derivative data saved (138 records). [2025-10-27T22:06:45.940482] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-27T22:06:45.942825] [INFO ] [MAIN ] Derivative Progress: 315/1881 symbols completed. CCI took 0.9s. Estimated remaining: 10m 35s. Rate: 148.1 symbols/min [2025-10-27T22:06:45.943278] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:45.943216] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:45.944151] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:45.960798] [DEBUG] [LOCAL ] CCIF: Loaded 15071 existing records from primary storage. [2025-10-27T22:06:45.961024] [INFO ] [MAIN ] CCIF: Loaded 15071 primary data records. [2025-10-27T22:06:46.319681] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-27T22:06:46.320405] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-27T22:06:46.320502] [INFO ] [MAIN ] CCJ: Loaded 53690 primary data records. [2025-10-27T22:06:46.320589] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-27T22:06:46.930355] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:46.970363] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:47.001059] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:47.047209] [INFO ] [MAIN ] CCIF: Generated 138 derivative records from 15071 primary records. [2025-10-27T22:06:47.048721] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-27T22:06:47.067280] [DEBUG] [LOCAL ] CCIF: Derivative data saved (138 records). [2025-10-27T22:06:47.067878] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-27T22:06:47.074041] [INFO ] [MAIN ] Derivative Progress: 316/1881 symbols completed. CCIF took 1.1s. Estimated remaining: 10m 38s. Rate: 147.2 symbols/min [2025-10-27T22:06:47.074452] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:47.081526] [INFO ] [MAIN ] CCL: Generated 138 derivative records from 53800 primary records. [2025-10-27T22:06:47.082088] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-27T22:06:47.093582] [INFO ] [MAIN ] CCJ: Generated 138 derivative records from 53690 primary records. [2025-10-27T22:06:47.098397] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-27T22:06:47.098460] [DEBUG] [LOCAL ] CCL: Derivative data saved (138 records). [2025-10-27T22:06:47.099250] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-27T22:06:47.101306] [INFO ] [MAIN ] Derivative Progress: 317/1881 symbols completed. CCL took 1.2s. Estimated remaining: 10m 35s. Rate: 147.7 symbols/min [2025-10-27T22:06:47.108579] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:47.114108] [DEBUG] [LOCAL ] CCJ: Derivative data saved (138 records). [2025-10-27T22:06:47.114174] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-27T22:06:47.116332] [INFO ] [MAIN ] Derivative Progress: 318/1881 symbols completed. CCJ took 1.2s. Estimated remaining: 10m 33s. Rate: 148.1 symbols/min [2025-10-27T22:06:47.116679] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:47.135926] [DEBUG] [LOCAL ] CCRD: Loaded 9616 existing records from primary storage. [2025-10-27T22:06:47.136167] [INFO ] [MAIN ] CCRD: Loaded 9616 primary data records. [2025-10-27T22:06:47.262887] [DEBUG] [LOCAL ] CCO: Loaded 48691 existing records from primary storage. [2025-10-27T22:06:47.268985] [INFO ] [MAIN ] CCO: Loaded 48691 primary data records. [2025-10-27T22:06:47.393839] [DEBUG] [LOCAL ] CCS: Loaded 29822 existing records from primary storage. [2025-10-27T22:06:47.500738] [INFO ] [MAIN ] CCS: Loaded 29822 primary data records. [2025-10-27T22:06:48.147087] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:48.181316] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:48.220577] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:48.260491] [INFO ] [MAIN ] CCRD: Generated 138 derivative records from 9616 primary records. [2025-10-27T22:06:48.263507] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-27T22:06:48.278363] [DEBUG] [LOCAL ] CCRD: Derivative data saved (138 records). [2025-10-27T22:06:48.282556] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-27T22:06:48.286130] [INFO ] [MAIN ] Derivative Progress: 319/1881 symbols completed. CCRD took 1.2s. Estimated remaining: 10m 36s. Rate: 147.3 symbols/min [2025-10-27T22:06:48.286468] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:48.293035] [INFO ] [MAIN ] CCO: Generated 138 derivative records from 48691 primary records. [2025-10-27T22:06:48.294575] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-27T22:06:48.301205] [INFO ] [MAIN ] CCS: Generated 138 derivative records from 29822 primary records. [2025-10-27T22:06:48.301374] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-27T22:06:48.313163] [DEBUG] [LOCAL ] CCO: Derivative data saved (138 records). [2025-10-27T22:06:48.313793] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-27T22:06:48.316444] [INFO ] [MAIN ] Derivative Progress: 320/1881 symbols completed. CCO took 1.2s. Estimated remaining: 10m 34s. Rate: 147.7 symbols/min [2025-10-27T22:06:48.331752] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:48.333239] [DEBUG] [LOCAL ] CCS: Derivative data saved (138 records). [2025-10-27T22:06:48.333504] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-27T22:06:48.335591] [INFO ] [MAIN ] Derivative Progress: 321/1881 symbols completed. CCS took 1.2s. Estimated remaining: 10m 32s. Rate: 148.1 symbols/min [2025-10-27T22:06:48.336158] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:48.346023] [DEBUG] [LOCAL ] CCU: Loaded 21160 existing records from primary storage. [2025-10-27T22:06:48.346273] [INFO ] [MAIN ] CCU: Loaded 21160 primary data records. [2025-10-27T22:06:48.431402] [DEBUG] [LOCAL ] CDLR: Loaded 10141 existing records from primary storage. [2025-10-27T22:06:48.442326] [INFO ] [MAIN ] CDLR: Loaded 10141 primary data records. [2025-10-27T22:06:49.008224] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-27T22:06:49.008917] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-27T22:06:49.323844] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:49.362731] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:49.403991] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:49.419744] [INFO ] [MAIN ] CCU: Generated 138 derivative records from 21160 primary records. [2025-10-27T22:06:49.421563] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-27T22:06:49.440679] [DEBUG] [LOCAL ] CCU: Derivative data saved (138 records). [2025-10-27T22:06:49.444125] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-27T22:06:49.446369] [INFO ] [MAIN ] Derivative Progress: 322/1881 symbols completed. CCU took 1.2s. Estimated remaining: 10m 35s. Rate: 147.3 symbols/min [2025-10-27T22:06:49.449793] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:49.470103] [INFO ] [MAIN ] CDLR: Generated 138 derivative records from 10141 primary records. [2025-10-27T22:06:49.470380] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-27T22:06:49.496710] [DEBUG] [LOCAL ] CDLR: Derivative data saved (138 records). [2025-10-27T22:06:49.496940] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-27T22:06:49.501775] [INFO ] [MAIN ] CDE: Generated 138 derivative records from 53644 primary records. [2025-10-27T22:06:49.501468] [INFO ] [MAIN ] Derivative Progress: 323/1881 symbols completed. CDLR took 1.2s. Estimated remaining: 10m 33s. Rate: 147.7 symbols/min [2025-10-27T22:06:49.501937] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-27T22:06:49.502743] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:49.516180] [DEBUG] [LOCAL ] CDE: Derivative data saved (138 records). [2025-10-27T22:06:49.516581] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-27T22:06:49.532232] [INFO ] [MAIN ] Derivative Progress: 324/1881 symbols completed. CDE took 1.2s. Estimated remaining: 10m 31s. Rate: 148.1 symbols/min [2025-10-27T22:06:49.533543] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:49.535088] [DEBUG] [LOCAL ] CDP: Loaded 42185 existing records from primary storage. [2025-10-27T22:06:49.535461] [INFO ] [MAIN ] CDP: Loaded 42185 primary data records. [2025-10-27T22:06:49.674506] [DEBUG] [LOCAL ] CDRE: Loaded 24420 existing records from primary storage. [2025-10-27T22:06:49.690214] [INFO ] [MAIN ] CDRE: Loaded 24420 primary data records. [2025-10-27T22:06:50.018989] [DEBUG] [LOCAL ] CE: Loaded 51167 existing records from primary storage. [2025-10-27T22:06:50.045381] [INFO ] [MAIN ] CE: Loaded 51167 primary data records. [2025-10-27T22:06:50.543770] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:50.581905] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:50.630451] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:50.659771] [INFO ] [MAIN ] CDP: Generated 138 derivative records from 42185 primary records. [2025-10-27T22:06:50.660279] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-27T22:06:50.678424] [DEBUG] [LOCAL ] CDP: Derivative data saved (138 records). [2025-10-27T22:06:50.679576] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-27T22:06:50.681795] [INFO ] [MAIN ] Derivative Progress: 325/1881 symbols completed. CDP took 1.2s. Estimated remaining: 10m 34s. Rate: 147.3 symbols/min [2025-10-27T22:06:50.683597] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:50.688682] [INFO ] [MAIN ] CDRE: Generated 138 derivative records from 24420 primary records. [2025-10-27T22:06:50.689082] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-27T22:06:50.708449] [DEBUG] [LOCAL ] CDRE: Derivative data saved (138 records). [2025-10-27T22:06:50.708631] [DEBUG] [LOCAL ] CEE: Loaded 4934 existing records from primary storage. [2025-10-27T22:06:50.708831] [INFO ] [MAIN ] CEE: Loaded 4934 primary data records. [2025-10-27T22:06:50.709027] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-27T22:06:50.732956] [INFO ] [MAIN ] Derivative Progress: 326/1881 symbols completed. CDRE took 1.2s. Estimated remaining: 10m 32s. Rate: 147.7 symbols/min [2025-10-27T22:06:50.787446] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:50.879024] [INFO ] [MAIN ] CE: Generated 138 derivative records from 51167 primary records. [2025-10-27T22:06:50.894665] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-27T22:06:51.032300] [DEBUG] [LOCAL ] CE: Derivative data saved (138 records). [2025-10-27T22:06:51.033090] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-27T22:06:51.035613] [INFO ] [MAIN ] Derivative Progress: 327/1881 symbols completed. CE took 1.5s. Estimated remaining: 10m 31s. Rate: 147.8 symbols/min [2025-10-27T22:06:51.036299] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:51.048980] [DEBUG] [LOCAL ] CEPU: Loaded 27156 existing records from primary storage. [2025-10-27T22:06:51.049273] [INFO ] [MAIN ] CEPU: Loaded 27156 primary data records. [2025-10-27T22:06:51.371149] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:51.403583] [DEBUG] [LOCAL ] CF: Loaded 52070 existing records from primary storage. [2025-10-27T22:06:51.406189] [INFO ] [MAIN ] CF: Loaded 52070 primary data records. [2025-10-27T22:06:51.776739] [INFO ] [MAIN ] CEE: Generated 138 derivative records from 4934 primary records. [2025-10-27T22:06:51.773564] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:51.788206] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-27T22:06:51.804995] [DEBUG] [LOCAL ] CEE: Derivative data saved (138 records). [2025-10-27T22:06:51.805211] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-27T22:06:51.807273] [INFO ] [MAIN ] Derivative Progress: 328/1881 symbols completed. CEE took 1.1s. Estimated remaining: 10m 32s. Rate: 147.4 symbols/min [2025-10-27T22:06:51.826738] [INFO ] [MAIN ] CEPU: Generated 138 derivative records from 27156 primary records. [2025-10-27T22:06:51.826977] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-27T22:06:51.841330] [DEBUG] [LOCAL ] CEPU: Derivative data saved (138 records). [2025-10-27T22:06:51.841597] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-27T22:06:51.843826] [INFO ] [MAIN ] Derivative Progress: 329/1881 symbols completed. CEPU took 1.1s. Estimated remaining: 10m 30s. Rate: 147.8 symbols/min [2025-10-27T22:06:51.856196] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:51.881288] [INFO ] [MAIN ] CF: Generated 138 derivative records from 52070 primary records. [2025-10-27T22:06:51.881370] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-27T22:06:51.893228] [DEBUG] [LOCAL ] CF: Derivative data saved (138 records). [2025-10-27T22:06:51.893313] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-27T22:06:51.895989] [INFO ] [MAIN ] Derivative Progress: 330/1881 symbols completed. CF took 0.9s. Estimated remaining: 10m 28s. Rate: 148.2 symbols/min [2025-10-27T22:06:51.896509] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:51.896617] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:51.897057] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:51.900609] [DEBUG] [LOCAL ] CGV: Loaded 1306 existing records from primary storage. [2025-10-27T22:06:51.900892] [INFO ] [MAIN ] CGV: Loaded 1306 primary data records. [2025-10-27T22:06:52.255571] [DEBUG] [LOCAL ] CGAU: Loaded 43897 existing records from primary storage. [2025-10-27T22:06:52.255902] [INFO ] [MAIN ] CGAU: Loaded 43897 primary data records. [2025-10-27T22:06:52.373407] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-27T22:06:52.373853] [INFO ] [MAIN ] CFG: Loaded 53622 primary data records. [2025-10-27T22:06:52.879364] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:06:52.921228] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:52.962427] [INFO ] [MAIN ] CGV: Generated 138 derivative records from 1306 primary records. [2025-10-27T22:06:52.965984] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-27T22:06:52.962284] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:52.990842] [DEBUG] [LOCAL ] CGV: Derivative data saved (138 records). [2025-10-27T22:06:52.991097] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-27T22:06:52.996230] [INFO ] [MAIN ] Derivative Progress: 331/1881 symbols completed. CGV took 1.1s. Estimated remaining: 10m 31s. Rate: 147.5 symbols/min [2025-10-27T22:06:52.996413] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:53.031169] [DEBUG] [LOCAL ] CHE: Loaded 15307 existing records from primary storage. [2025-10-27T22:06:53.034950] [INFO ] [MAIN ] CHE: Loaded 15307 primary data records. [2025-10-27T22:06:53.037345] [INFO ] [MAIN ] CGAU: Generated 138 derivative records from 43897 primary records. [2025-10-27T22:06:53.074117] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-27T22:06:53.115884] [INFO ] [MAIN ] CFG: Generated 138 derivative records from 53622 primary records. [2025-10-27T22:06:53.138945] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-27T22:06:53.155911] [DEBUG] [LOCAL ] CGAU: Derivative data saved (138 records). [2025-10-27T22:06:53.156069] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-27T22:06:53.159253] [INFO ] [MAIN ] Derivative Progress: 332/1881 symbols completed. CGAU took 1.3s. Estimated remaining: 10m 29s. Rate: 147.7 symbols/min [2025-10-27T22:06:53.171879] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:53.242470] [DEBUG] [LOCAL ] CFG: Derivative data saved (138 records). [2025-10-27T22:06:53.299775] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-27T22:06:53.362870] [INFO ] [MAIN ] Derivative Progress: 333/1881 symbols completed. CFG took 1.5s. Estimated remaining: 10m 28s. Rate: 147.9 symbols/min [2025-10-27T22:06:53.363257] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:53.396744] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:53.434966] [DEBUG] [LOCAL ] CHH: Loaded 32110 existing records from primary storage. [2025-10-27T22:06:53.436704] [INFO ] [MAIN ] CHH: Loaded 32110 primary data records. [2025-10-27T22:06:53.560226] [DEBUG] [LOCAL ] CHGG: Loaded 47346 existing records from primary storage. [2025-10-27T22:06:53.566318] [INFO ] [MAIN ] CHGG: Loaded 47346 primary data records. [2025-10-27T22:06:53.871223] [INFO ] [MAIN ] CHE: Generated 138 derivative records from 15307 primary records. [2025-10-27T22:06:53.906473] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-27T22:06:53.961514] [DEBUG] [LOCAL ] CHE: Derivative data saved (138 records). [2025-10-27T22:06:54.115945] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-27T22:06:54.127261] [INFO ] [MAIN ] Derivative Progress: 334/1881 symbols completed. CHE took 1.1s. Estimated remaining: 10m 29s. Rate: 147.5 symbols/min [2025-10-27T22:06:54.127700] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:54.152820] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:54.205693] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:54.241913] [DEBUG] [LOCAL ] CHPT: Loaded 46484 existing records from primary storage. [2025-10-27T22:06:54.243589] [INFO ] [MAIN ] CHPT: Loaded 46484 primary data records. [2025-10-27T22:06:54.280314] [INFO ] [MAIN ] CHH: Generated 138 derivative records from 32110 primary records. [2025-10-27T22:06:54.282778] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-27T22:06:54.362663] [DEBUG] [LOCAL ] CHH: Derivative data saved (138 records). [2025-10-27T22:06:54.365838] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-27T22:06:54.370362] [INFO ] [MAIN ] Derivative Progress: 335/1881 symbols completed. CHH took 1.0s. Estimated remaining: 10m 28s. Rate: 147.7 symbols/min [2025-10-27T22:06:54.371045] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:54.573066] [INFO ] [MAIN ] CHGG: Generated 138 derivative records from 47346 primary records. [2025-10-27T22:06:54.573261] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-27T22:06:54.594793] [DEBUG] [LOCAL ] CHGG: Derivative data saved (138 records). [2025-10-27T22:06:54.594614] [DEBUG] [LOCAL ] CHT: Loaded 19042 existing records from primary storage. [2025-10-27T22:06:54.595017] [INFO ] [MAIN ] CHT: Loaded 19042 primary data records. [2025-10-27T22:06:54.595828] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-27T22:06:54.620418] [INFO ] [MAIN ] Derivative Progress: 336/1881 symbols completed. CHGG took 1.4s. Estimated remaining: 10m 27s. Rate: 147.9 symbols/min [2025-10-27T22:06:54.644771] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:54.945472] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:54.987360] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-27T22:06:54.988341] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-27T22:06:55.154302] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:55.355581] [INFO ] [MAIN ] CHPT: Generated 138 derivative records from 46484 primary records. [2025-10-27T22:06:55.358345] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-27T22:06:55.375848] [DEBUG] [LOCAL ] CHPT: Derivative data saved (138 records). [2025-10-27T22:06:55.376337] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-27T22:06:55.380139] [INFO ] [MAIN ] Derivative Progress: 337/1881 symbols completed. CHPT took 1.3s. Estimated remaining: 10m 28s. Rate: 147.5 symbols/min [2025-10-27T22:06:55.380381] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:55.393865] [INFO ] [MAIN ] CHT: Generated 138 derivative records from 19042 primary records. [2025-10-27T22:06:55.394060] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-27T22:06:55.406310] [DEBUG] [LOCAL ] CHT: Derivative data saved (138 records). [2025-10-27T22:06:55.406482] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-27T22:06:55.409727] [INFO ] [MAIN ] Derivative Progress: 338/1881 symbols completed. CHT took 1.0s. Estimated remaining: 10m 26s. Rate: 147.9 symbols/min [2025-10-27T22:06:55.409893] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:55.438062] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:55.464317] [DEBUG] [LOCAL ] CIA: Loaded 16250 existing records from primary storage. [2025-10-27T22:06:55.466811] [INFO ] [MAIN ] CIA: Loaded 16250 primary data records. [2025-10-27T22:06:55.570268] [DEBUG] [LOCAL ] CI: Loaded 49475 existing records from primary storage. [2025-10-27T22:06:55.575673] [INFO ] [MAIN ] CI: Loaded 49475 primary data records. [2025-10-27T22:06:56.152349] [INFO ] [MAIN ] CHWY: Generated 138 derivative records from 53654 primary records. [2025-10-27T22:06:56.152816] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-27T22:06:56.165840] [DEBUG] [LOCAL ] CHWY: Derivative data saved (138 records). [2025-10-27T22:06:56.165968] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-27T22:06:56.168164] [INFO ] [MAIN ] Derivative Progress: 339/1881 symbols completed. CHWY took 1.5s. Estimated remaining: 10m 27s. Rate: 147.5 symbols/min [2025-10-27T22:06:56.170046] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:56.193614] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:56.246973] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:56.288079] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-10-27T22:06:56.289740] [INFO ] [MAIN ] CIEN: Loaded 52090 primary data records. [2025-10-27T22:06:56.594816] [INFO ] [MAIN ] CIA: Generated 138 derivative records from 16250 primary records. [2025-10-27T22:06:56.611125] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-27T22:06:56.623831] [DEBUG] [LOCAL ] CIA: Derivative data saved (138 records). [2025-10-27T22:06:56.624772] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-27T22:06:56.626894] [INFO ] [MAIN ] Derivative Progress: 340/1881 symbols completed. CIA took 1.2s. Estimated remaining: 10m 27s. Rate: 147.5 symbols/min [2025-10-27T22:06:56.627603] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:56.636835] [INFO ] [MAIN ] CI: Generated 138 derivative records from 49475 primary records. [2025-10-27T22:06:56.637045] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-27T22:06:56.650323] [DEBUG] [LOCAL ] CIF: Loaded 3862 existing records from primary storage. [2025-10-27T22:06:56.653147] [DEBUG] [LOCAL ] CI: Derivative data saved (138 records). [2025-10-27T22:06:56.653425] [INFO ] [MAIN ] CIF: Loaded 3862 primary data records. [2025-10-27T22:06:56.653354] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-27T22:06:56.667731] [INFO ] [MAIN ] Derivative Progress: 341/1881 symbols completed. CI took 1.3s. Estimated remaining: 10m 25s. Rate: 147.9 symbols/min [2025-10-27T22:06:56.687131] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:56.965273] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:57.010025] [DEBUG] [LOCAL ] CIG: Loaded 44462 existing records from primary storage. [2025-10-27T22:06:57.012705] [INFO ] [MAIN ] CIG: Loaded 44462 primary data records. [2025-10-27T22:06:57.329180] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:57.331439] [INFO ] [MAIN ] CIEN: Generated 138 derivative records from 52090 primary records. [2025-10-27T22:06:57.345345] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-27T22:06:57.362186] [DEBUG] [LOCAL ] CIEN: Derivative data saved (138 records). [2025-10-27T22:06:57.365558] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-27T22:06:57.367689] [INFO ] [MAIN ] Derivative Progress: 342/1881 symbols completed. CIEN took 1.2s. Estimated remaining: 10m 26s. Rate: 147.6 symbols/min [2025-10-27T22:06:57.368498] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:57.397879] [DEBUG] [LOCAL ] CII: Loaded 14625 existing records from primary storage. [2025-10-27T22:06:57.399542] [INFO ] [MAIN ] CII: Loaded 14625 primary data records. [2025-10-27T22:06:57.401807] [INFO ] [MAIN ] CIF: Generated 138 derivative records from 3862 primary records. [2025-10-27T22:06:57.421804] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-27T22:06:57.487774] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:57.513833] [DEBUG] [LOCAL ] CIF: Derivative data saved (138 records). [2025-10-27T22:06:57.538552] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-27T22:06:57.543010] [INFO ] [MAIN ] Derivative Progress: 343/1881 symbols completed. CIF took 0.9s. Estimated remaining: 10m 24s. Rate: 147.8 symbols/min [2025-10-27T22:06:57.776920] [INFO ] [MAIN ] CIG: Generated 138 derivative records from 44462 primary records. [2025-10-27T22:06:57.777169] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-27T22:06:57.790212] [DEBUG] [LOCAL ] CIG: Derivative data saved (138 records). [2025-10-27T22:06:57.790298] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-27T22:06:57.792243] [INFO ] [MAIN ] Derivative Progress: 344/1881 symbols completed. CIG took 1.1s. Estimated remaining: 10m 23s. Rate: 148.0 symbols/min [2025-10-27T22:06:57.811664] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:57.839773] [INFO ] [MAIN ] CII: Generated 138 derivative records from 14625 primary records. [2025-10-27T22:06:57.839879] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-27T22:06:57.852060] [DEBUG] [LOCAL ] CII: Derivative data saved (138 records). [2025-10-27T22:06:57.852122] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-27T22:06:57.854379] [INFO ] [MAIN ] Derivative Progress: 345/1881 symbols completed. CII took 0.5s. Estimated remaining: 10m 21s. Rate: 148.3 symbols/min [2025-10-27T22:06:57.854838] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:57.854933] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:57.855202] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:57.892771] [DEBUG] [LOCAL ] CINT: Loaded 20484 existing records from primary storage. [2025-10-27T22:06:57.893334] [DEBUG] [LOCAL ] CIO: Loaded 21195 existing records from primary storage. [2025-10-27T22:06:57.893410] [INFO ] [MAIN ] CINT: Loaded 20484 primary data records. [2025-10-27T22:06:57.893492] [INFO ] [MAIN ] CIO: Loaded 21195 primary data records. [2025-10-27T22:06:58.112902] [DEBUG] [LOCAL ] CIM: Loaded 37039 existing records from primary storage. [2025-10-27T22:06:58.121749] [INFO ] [MAIN ] CIM: Loaded 37039 primary data records. [2025-10-27T22:06:58.877585] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:58.882892] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:58.931609] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:06:58.995021] [INFO ] [MAIN ] CIO: Generated 138 derivative records from 21195 primary records. [2025-10-27T22:06:58.995925] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-27T22:06:59.009079] [DEBUG] [LOCAL ] CIO: Derivative data saved (138 records). [2025-10-27T22:06:59.010857] [INFO ] [MAIN ] CINT: Generated 138 derivative records from 20484 primary records. [2025-10-27T22:06:59.013499] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-27T22:06:59.014511] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-27T22:06:59.016901] [INFO ] [MAIN ] Derivative Progress: 346/1881 symbols completed. CIO took 1.2s. Estimated remaining: 10m 24s. Rate: 147.5 symbols/min [2025-10-27T22:06:59.023748] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:59.028053] [DEBUG] [LOCAL ] CINT: Derivative data saved (138 records). [2025-10-27T22:06:59.030469] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-27T22:06:59.032762] [INFO ] [MAIN ] Derivative Progress: 347/1881 symbols completed. CINT took 1.2s. Estimated remaining: 10m 22s. Rate: 147.9 symbols/min [2025-10-27T22:06:59.033195] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:59.036079] [INFO ] [MAIN ] CIM: Generated 138 derivative records from 37039 primary records. [2025-10-27T22:06:59.036243] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-27T22:06:59.050458] [DEBUG] [LOCAL ] CIM: Derivative data saved (138 records). [2025-10-27T22:06:59.050583] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-27T22:06:59.052845] [INFO ] [MAIN ] Derivative Progress: 348/1881 symbols completed. CIM took 1.2s. Estimated remaining: 10m 20s. Rate: 148.4 symbols/min [2025-10-27T22:06:59.053057] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:06:59.115193] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-27T22:06:59.115868] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-27T22:06:59.180561] [DEBUG] [LOCAL ] CLB: Loaded 33471 existing records from primary storage. [2025-10-27T22:06:59.238002] [DEBUG] [LOCAL ] CIVI: Loaded 52668 existing records from primary storage. [2025-10-27T22:06:59.219451] [INFO ] [MAIN ] CLB: Loaded 33471 primary data records. [2025-10-27T22:06:59.241069] [INFO ] [MAIN ] CIVI: Loaded 52668 primary data records. [2025-10-27T22:07:00.035975] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:00.071357] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:00.098917] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:00.145108] [INFO ] [MAIN ] CL: Generated 138 derivative records from 53649 primary records. [2025-10-27T22:07:00.146231] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-27T22:07:00.164942] [DEBUG] [LOCAL ] CL: Derivative data saved (138 records). [2025-10-27T22:07:00.166191] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-27T22:07:00.168042] [INFO ] [MAIN ] Derivative Progress: 349/1881 symbols completed. CL took 1.1s. Estimated remaining: 10m 23s. Rate: 147.6 symbols/min [2025-10-27T22:07:00.168277] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:00.174856] [INFO ] [MAIN ] CLB: Generated 138 derivative records from 33471 primary records. [2025-10-27T22:07:00.175139] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-27T22:07:00.189142] [INFO ] [MAIN ] CIVI: Generated 138 derivative records from 52668 primary records. [2025-10-27T22:07:00.189246] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-27T22:07:00.193441] [DEBUG] [LOCAL ] CLB: Derivative data saved (138 records). [2025-10-27T22:07:00.194235] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-27T22:07:00.201172] [DEBUG] [LOCAL ] CLCO: Loaded 12926 existing records from primary storage. [2025-10-27T22:07:00.200792] [INFO ] [MAIN ] Derivative Progress: 350/1881 symbols completed. CLB took 1.1s. Estimated remaining: 10m 21s. Rate: 148.0 symbols/min [2025-10-27T22:07:00.208552] [INFO ] [MAIN ] CLCO: Loaded 12926 primary data records. [2025-10-27T22:07:00.208688] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:00.245353] [DEBUG] [LOCAL ] CIVI: Derivative data saved (138 records). [2025-10-27T22:07:00.264124] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-27T22:07:00.266964] [INFO ] [MAIN ] Derivative Progress: 351/1881 symbols completed. CIVI took 1.2s. Estimated remaining: 10m 19s. Rate: 148.4 symbols/min [2025-10-27T22:07:00.283817] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:00.555112] [DEBUG] [LOCAL ] CLDT: Loaded 24789 existing records from primary storage. [2025-10-27T22:07:00.555364] [INFO ] [MAIN ] CLDT: Loaded 24789 primary data records. [2025-10-27T22:07:00.877475] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-27T22:07:00.878541] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-27T22:07:01.196407] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:01.244575] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:01.289960] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:01.305922] [INFO ] [MAIN ] CLCO: Generated 138 derivative records from 12926 primary records. [2025-10-27T22:07:01.308711] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-27T22:07:01.325417] [DEBUG] [LOCAL ] CLCO: Derivative data saved (138 records). [2025-10-27T22:07:01.327007] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-27T22:07:01.328832] [INFO ] [MAIN ] Derivative Progress: 352/1881 symbols completed. CLCO took 1.2s. Estimated remaining: 10m 21s. Rate: 147.7 symbols/min [2025-10-27T22:07:01.328992] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:01.360449] [INFO ] [MAIN ] CLDT: Generated 138 derivative records from 24789 primary records. [2025-10-27T22:07:01.361904] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-27T22:07:01.374300] [DEBUG] [LOCAL ] CLH: Loaded 27306 existing records from primary storage. [2025-10-27T22:07:01.389963] [DEBUG] [LOCAL ] CLDT: Derivative data saved (138 records). [2025-10-27T22:07:01.388927] [INFO ] [MAIN ] CLH: Loaded 27306 primary data records. [2025-10-27T22:07:01.392190] [INFO ] [MAIN ] CLF: Generated 138 derivative records from 53741 primary records. [2025-10-27T22:07:01.390168] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-27T22:07:01.433547] [INFO ] [MAIN ] Derivative Progress: 353/1881 symbols completed. CLDT took 1.2s. Estimated remaining: 10m 20s. Rate: 148.0 symbols/min [2025-10-27T22:07:01.433729] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-27T22:07:01.433862] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:01.511229] [DEBUG] [LOCAL ] CLF: Derivative data saved (138 records). [2025-10-27T22:07:01.513974] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-27T22:07:01.516554] [INFO ] [MAIN ] Derivative Progress: 354/1881 symbols completed. CLF took 1.2s. Estimated remaining: 10m 18s. Rate: 148.3 symbols/min [2025-10-27T22:07:01.522108] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:01.570490] [DEBUG] [LOCAL ] CLPR: Loaded 9660 existing records from primary storage. [2025-10-27T22:07:01.599505] [INFO ] [MAIN ] CLPR: Loaded 9660 primary data records. [2025-10-27T22:07:02.046871] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-27T22:07:02.048076] [INFO ] [MAIN ] CLS: Loaded 53546 primary data records. [2025-10-27T22:07:02.398455] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:02.457052] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:02.495747] [INFO ] [MAIN ] CLH: Generated 138 derivative records from 27306 primary records. [2025-10-27T22:07:02.496877] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-27T22:07:02.512347] [DEBUG] [LOCAL ] CLH: Derivative data saved (138 records). [2025-10-27T22:07:02.512493] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-27T22:07:02.522340] [INFO ] [MAIN ] Derivative Progress: 355/1881 symbols completed. CLH took 1.2s. Estimated remaining: 10m 20s. Rate: 147.7 symbols/min [2025-10-27T22:07:02.528972] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:02.530388] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:02.556441] [INFO ] [MAIN ] CLPR: Generated 138 derivative records from 9660 primary records. [2025-10-27T22:07:02.557026] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-27T22:07:02.573859] [DEBUG] [LOCAL ] CLPR: Derivative data saved (138 records). [2025-10-27T22:07:02.577883] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-27T22:07:02.581687] [INFO ] [MAIN ] Derivative Progress: 356/1881 symbols completed. CLPR took 1.1s. Estimated remaining: 10m 18s. Rate: 148.1 symbols/min [2025-10-27T22:07:02.581932] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:02.589616] [INFO ] [MAIN ] CLS: Generated 138 derivative records from 53546 primary records. [2025-10-27T22:07:02.602966] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-27T22:07:02.620144] [DEBUG] [LOCAL ] CLS: Derivative data saved (138 records). [2025-10-27T22:07:02.620267] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-27T22:07:02.622245] [INFO ] [MAIN ] Derivative Progress: 357/1881 symbols completed. CLS took 1.1s. Estimated remaining: 10m 16s. Rate: 148.4 symbols/min [2025-10-27T22:07:02.622559] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:02.644963] [DEBUG] [LOCAL ] CLW: Loaded 20956 existing records from primary storage. [2025-10-27T22:07:02.646263] [DEBUG] [LOCAL ] CLVT: Loaded 51854 existing records from primary storage. [2025-10-27T22:07:02.646405] [INFO ] [MAIN ] CLVT: Loaded 51854 primary data records. [2025-10-27T22:07:02.645141] [INFO ] [MAIN ] CLW: Loaded 20956 primary data records. [2025-10-27T22:07:03.268907] [DEBUG] [LOCAL ] CM: Loaded 48138 existing records from primary storage. [2025-10-27T22:07:03.269306] [INFO ] [MAIN ] CM: Loaded 48138 primary data records. [2025-10-27T22:07:03.620084] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:03.620988] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:03.690770] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:03.725832] [INFO ] [MAIN ] CLVT: Generated 138 derivative records from 51854 primary records. [2025-10-27T22:07:03.726434] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-27T22:07:03.730471] [INFO ] [MAIN ] CLW: Generated 138 derivative records from 20956 primary records. [2025-10-27T22:07:03.742594] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-27T22:07:03.759102] [DEBUG] [LOCAL ] CLVT: Derivative data saved (138 records). [2025-10-27T22:07:03.765505] [DEBUG] [LOCAL ] CLW: Derivative data saved (138 records). [2025-10-27T22:07:03.765861] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-27T22:07:03.765588] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-27T22:07:03.769263] [INFO ] [MAIN ] Derivative Progress: 358/1881 symbols completed. CLW took 1.2s. Estimated remaining: 10m 19s. Rate: 147.7 symbols/min [2025-10-27T22:07:03.771698] [INFO ] [MAIN ] Derivative Progress: 359/1881 symbols completed. CLVT took 1.2s. Estimated remaining: 10m 17s. Rate: 148.1 symbols/min [2025-10-27T22:07:03.777459] [INFO ] [MAIN ] CM: Generated 138 derivative records from 48138 primary records. [2025-10-27T22:07:03.777557] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-27T22:07:03.789414] [DEBUG] [LOCAL ] CM: Derivative data saved (138 records). [2025-10-27T22:07:03.789486] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-27T22:07:03.792493] [INFO ] [MAIN ] Derivative Progress: 360/1881 symbols completed. CM took 1.2s. Estimated remaining: 10m 15s. Rate: 148.5 symbols/min [2025-10-27T22:07:03.792925] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:03.793383] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:03.792879] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:03.820617] [DEBUG] [LOCAL ] CMBT: Loaded 28308 existing records from primary storage. [2025-10-27T22:07:03.820766] [INFO ] [MAIN ] CMBT: Loaded 28308 primary data records. [2025-10-27T22:07:03.994549] [DEBUG] [LOCAL ] CMC: Loaded 45505 existing records from primary storage. [2025-10-27T22:07:04.013332] [INFO ] [MAIN ] CMC: Loaded 45505 primary data records. [2025-10-27T22:07:03.993882] [DEBUG] [LOCAL ] CMA: Loaded 50157 existing records from primary storage. [2025-10-27T22:07:04.033747] [INFO ] [MAIN ] CMA: Loaded 50157 primary data records. [2025-10-27T22:07:04.844607] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:04.918562] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:04.916915] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:04.957361] [INFO ] [MAIN ] CMBT: Generated 138 derivative records from 28308 primary records. [2025-10-27T22:07:04.960060] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-27T22:07:04.976379] [DEBUG] [LOCAL ] CMBT: Derivative data saved (138 records). [2025-10-27T22:07:04.976732] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-27T22:07:04.981325] [INFO ] [MAIN ] Derivative Progress: 361/1881 symbols completed. CMBT took 1.2s. Estimated remaining: 10m 18s. Rate: 147.7 symbols/min [2025-10-27T22:07:04.983008] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:04.997667] [DEBUG] [LOCAL ] CMCM: Loaded 4809 existing records from primary storage. [2025-10-27T22:07:04.998296] [INFO ] [MAIN ] CMCM: Loaded 4809 primary data records. [2025-10-27T22:07:05.183538] [INFO ] [MAIN ] CMC: Generated 138 derivative records from 45505 primary records. [2025-10-27T22:07:05.188625] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-27T22:07:05.318309] [INFO ] [MAIN ] CMA: Generated 138 derivative records from 50157 primary records. [2025-10-27T22:07:05.322788] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-27T22:07:05.333003] [DEBUG] [LOCAL ] CMC: Derivative data saved (138 records). [2025-10-27T22:07:05.335614] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-27T22:07:05.339526] [INFO ] [MAIN ] Derivative Progress: 362/1881 symbols completed. CMC took 1.5s. Estimated remaining: 10m 17s. Rate: 147.7 symbols/min [2025-10-27T22:07:05.342353] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:05.342231] [DEBUG] [LOCAL ] CMA: Derivative data saved (138 records). [2025-10-27T22:07:05.343312] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-27T22:07:05.345862] [INFO ] [MAIN ] Derivative Progress: 363/1881 symbols completed. CMA took 1.6s. Estimated remaining: 10m 15s. Rate: 148.1 symbols/min [2025-10-27T22:07:05.346240] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:05.368380] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:05.430077] [DEBUG] [LOCAL ] CMI: Loaded 41324 existing records from primary storage. [2025-10-27T22:07:05.431109] [INFO ] [MAIN ] CMI: Loaded 41324 primary data records. [2025-10-27T22:07:05.493900] [DEBUG] [LOCAL ] CMG: Loaded 53723 existing records from primary storage. [2025-10-27T22:07:05.533418] [INFO ] [MAIN ] CMG: Loaded 53723 primary data records. [2025-10-27T22:07:05.664309] [INFO ] [MAIN ] CMCM: Generated 138 derivative records from 4809 primary records. [2025-10-27T22:07:05.685695] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-27T22:07:05.762840] [DEBUG] [LOCAL ] CMCM: Derivative data saved (138 records). [2025-10-27T22:07:05.881854] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-27T22:07:05.900267] [INFO ] [MAIN ] Derivative Progress: 364/1881 symbols completed. CMCM took 0.9s. Estimated remaining: 10m 15s. Rate: 148.0 symbols/min [2025-10-27T22:07:05.910784] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:06.120136] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:06.145529] [DEBUG] [LOCAL ] CMP: Loaded 35271 existing records from primary storage. [2025-10-27T22:07:06.147342] [INFO ] [MAIN ] CMP: Loaded 35271 primary data records. [2025-10-27T22:07:06.272431] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:06.565207] [INFO ] [MAIN ] CMI: Generated 138 derivative records from 41324 primary records. [2025-10-27T22:07:06.566441] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-27T22:07:06.591844] [INFO ] [MAIN ] CMG: Generated 138 derivative records from 53723 primary records. [2025-10-27T22:07:06.594279] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-27T22:07:06.596598] [DEBUG] [LOCAL ] CMI: Derivative data saved (138 records). [2025-10-27T22:07:06.596785] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-27T22:07:06.605882] [INFO ] [MAIN ] Derivative Progress: 365/1881 symbols completed. CMI took 1.3s. Estimated remaining: 10m 16s. Rate: 147.7 symbols/min [2025-10-27T22:07:06.623254] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:06.622852] [DEBUG] [LOCAL ] CMG: Derivative data saved (138 records). [2025-10-27T22:07:06.622952] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:06.635265] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-27T22:07:06.637327] [INFO ] [MAIN ] Derivative Progress: 366/1881 symbols completed. CMG took 1.3s. Estimated remaining: 10m 14s. Rate: 148.0 symbols/min [2025-10-27T22:07:06.639898] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:06.675681] [INFO ] [MAIN ] CMP: Generated 138 derivative records from 35271 primary records. [2025-10-27T22:07:06.675840] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-27T22:07:06.689066] [DEBUG] [LOCAL ] CMP: Derivative data saved (138 records). [2025-10-27T22:07:06.698884] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-27T22:07:06.711817] [INFO ] [MAIN ] Derivative Progress: 367/1881 symbols completed. CMP took 0.8s. Estimated remaining: 10m 12s. Rate: 148.4 symbols/min [2025-10-27T22:07:06.712413] [DEBUG] [LOCAL ] CMRE: Loaded 35264 existing records from primary storage. [2025-10-27T22:07:06.713488] [DEBUG] [LOCAL ] CMPO: Loaded 37974 existing records from primary storage. [2025-10-27T22:07:06.713832] [INFO ] [MAIN ] CMRE: Loaded 35264 primary data records. [2025-10-27T22:07:06.713605] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:06.714158] [INFO ] [MAIN ] CMPO: Loaded 37974 primary data records. [2025-10-27T22:07:07.350433] [DEBUG] [LOCAL ] CMS: Loaded 52509 existing records from primary storage. [2025-10-27T22:07:07.350720] [INFO ] [MAIN ] CMS: Loaded 52509 primary data records. [2025-10-27T22:07:07.712366] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:07.740336] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:07.804846] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:07.827414] [INFO ] [MAIN ] CMPO: Generated 138 derivative records from 37974 primary records. [2025-10-27T22:07:07.827713] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-27T22:07:07.845370] [DEBUG] [LOCAL ] CMPO: Derivative data saved (138 records). [2025-10-27T22:07:07.845698] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-27T22:07:07.849497] [INFO ] [MAIN ] Derivative Progress: 368/1881 symbols completed. CMPO took 1.2s. Estimated remaining: 10m 15s. Rate: 147.7 symbols/min [2025-10-27T22:07:07.850889] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:07.849725] [INFO ] [MAIN ] CMRE: Generated 138 derivative records from 35264 primary records. [2025-10-27T22:07:07.851387] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-27T22:07:07.869587] [DEBUG] [LOCAL ] CMRE: Derivative data saved (138 records). [2025-10-27T22:07:07.869733] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-27T22:07:07.871920] [INFO ] [MAIN ] Derivative Progress: 369/1881 symbols completed. CMRE took 1.2s. Estimated remaining: 10m 13s. Rate: 148.0 symbols/min [2025-10-27T22:07:07.875688] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:07.876089] [DEBUG] [LOCAL ] CMSD: Loaded 7446 existing records from primary storage. [2025-10-27T22:07:07.879106] [INFO ] [MAIN ] CMSD: Loaded 7446 primary data records. [2025-10-27T22:07:08.004372] [DEBUG] [LOCAL ] CMU: Loaded 6086 existing records from primary storage. [2025-10-27T22:07:08.014901] [INFO ] [MAIN ] CMU: Loaded 6086 primary data records. [2025-10-27T22:07:08.082180] [INFO ] [MAIN ] CMS: Generated 138 derivative records from 52509 primary records. [2025-10-27T22:07:08.155839] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-27T22:07:08.331194] [DEBUG] [LOCAL ] CMS: Derivative data saved (138 records). [2025-10-27T22:07:08.337229] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-27T22:07:08.344700] [INFO ] [MAIN ] Derivative Progress: 370/1881 symbols completed. CMS took 1.6s. Estimated remaining: 10m 13s. Rate: 148.0 symbols/min [2025-10-27T22:07:08.350017] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:08.597316] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:08.597839] [DEBUG] [LOCAL ] CNA: Loaded 32238 existing records from primary storage. [2025-10-27T22:07:08.609690] [INFO ] [MAIN ] CNA: Loaded 32238 primary data records. [2025-10-27T22:07:08.727091] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:08.967063] [INFO ] [MAIN ] CMSD: Generated 138 derivative records from 7446 primary records. [2025-10-27T22:07:08.969562] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-27T22:07:08.973315] [INFO ] [MAIN ] CMU: Generated 138 derivative records from 6086 primary records. [2025-10-27T22:07:08.973844] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-27T22:07:08.993109] [DEBUG] [LOCAL ] CMSD: Derivative data saved (138 records). [2025-10-27T22:07:08.997493] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-27T22:07:09.000867] [INFO ] [MAIN ] Derivative Progress: 371/1881 symbols completed. CMSD took 1.1s. Estimated remaining: 10m 13s. Rate: 147.7 symbols/min [2025-10-27T22:07:08.998511] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:09.006847] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:09.022792] [DEBUG] [LOCAL ] CMU: Derivative data saved (138 records). [2025-10-27T22:07:09.024314] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-27T22:07:09.026433] [INFO ] [MAIN ] Derivative Progress: 372/1881 symbols completed. CMU took 1.2s. Estimated remaining: 10m 11s. Rate: 148.1 symbols/min [2025-10-27T22:07:09.026756] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:09.046838] [DEBUG] [LOCAL ] CNF: Loaded 10606 existing records from primary storage. [2025-10-27T22:07:09.046996] [INFO ] [MAIN ] CNF: Loaded 10606 primary data records. [2025-10-27T22:07:09.242706] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-27T22:07:09.259159] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-27T22:07:09.234099] [INFO ] [MAIN ] CNA: Generated 138 derivative records from 32238 primary records. [2025-10-27T22:07:09.364185] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-27T22:07:09.459422] [DEBUG] [LOCAL ] CNA: Derivative data saved (138 records). [2025-10-27T22:07:09.466021] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-27T22:07:09.468976] [INFO ] [MAIN ] Derivative Progress: 373/1881 symbols completed. CNA took 1.1s. Estimated remaining: 10m 11s. Rate: 148.1 symbols/min [2025-10-27T22:07:09.708170] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:09.749250] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:09.775763] [INFO ] [MAIN ] CNF: Generated 138 derivative records from 10606 primary records. [2025-10-27T22:07:09.776392] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-27T22:07:09.796032] [DEBUG] [LOCAL ] CNF: Derivative data saved (138 records). [2025-10-27T22:07:09.796276] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-27T22:07:09.798353] [INFO ] [MAIN ] Derivative Progress: 374/1881 symbols completed. CNF took 0.8s. Estimated remaining: 10m 10s. Rate: 148.1 symbols/min [2025-10-27T22:07:09.803199] [INFO ] [MAIN ] CNC: Generated 138 derivative records from 53779 primary records. [2025-10-27T22:07:09.803309] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-27T22:07:09.815231] [DEBUG] [LOCAL ] CNC: Derivative data saved (138 records). [2025-10-27T22:07:09.815321] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-27T22:07:09.817518] [INFO ] [MAIN ] Derivative Progress: 375/1881 symbols completed. CNC took 0.8s. Estimated remaining: 10m 8s. Rate: 148.5 symbols/min [2025-10-27T22:07:09.817973] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:09.818109] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:09.818215] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:09.888045] [DEBUG] [LOCAL ] CNM: Loaded 50952 existing records from primary storage. [2025-10-27T22:07:09.902534] [INFO ] [MAIN ] CNM: Loaded 50952 primary data records. [2025-10-27T22:07:09.903443] [DEBUG] [LOCAL ] CNK: Loaded 52892 existing records from primary storage. [2025-10-27T22:07:09.903582] [INFO ] [MAIN ] CNK: Loaded 52892 primary data records. [2025-10-27T22:07:10.054436] [DEBUG] [LOCAL ] CNI: Loaded 51583 existing records from primary storage. [2025-10-27T22:07:10.072920] [INFO ] [MAIN ] CNI: Loaded 51583 primary data records. [2025-10-27T22:07:10.882064] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:10.896452] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:10.910869] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:10.991861] [INFO ] [MAIN ] CNM: Generated 138 derivative records from 50952 primary records. [2025-10-27T22:07:10.993622] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-27T22:07:11.016215] [DEBUG] [LOCAL ] CNM: Derivative data saved (138 records). [2025-10-27T22:07:11.018363] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-27T22:07:11.018253] [INFO ] [MAIN ] CNI: Generated 138 derivative records from 51583 primary records. [2025-10-27T22:07:11.018549] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-27T22:07:11.021848] [INFO ] [MAIN ] Derivative Progress: 376/1881 symbols completed. CNM took 1.2s. Estimated remaining: 10m 11s. Rate: 147.7 symbols/min [2025-10-27T22:07:11.022218] [INFO ] [MAIN ] CNK: Generated 138 derivative records from 52892 primary records. [2025-10-27T22:07:11.022936] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:11.023492] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-27T22:07:11.045180] [DEBUG] [LOCAL ] CNI: Derivative data saved (138 records). [2025-10-27T22:07:11.045678] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-27T22:07:11.048468] [INFO ] [MAIN ] Derivative Progress: 377/1881 symbols completed. CNI took 1.2s. Estimated remaining: 10m 9s. Rate: 148.1 symbols/min [2025-10-27T22:07:11.050780] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:11.051128] [DEBUG] [LOCAL ] CNK: Derivative data saved (138 records). [2025-10-27T22:07:11.051240] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-27T22:07:11.053484] [INFO ] [MAIN ] Derivative Progress: 378/1881 symbols completed. CNK took 1.2s. Estimated remaining: 10m 7s. Rate: 148.5 symbols/min [2025-10-27T22:07:11.053608] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:11.089052] [DEBUG] [LOCAL ] CNS: Loaded 21224 existing records from primary storage. [2025-10-27T22:07:11.089893] [DEBUG] [LOCAL ] CNMD: Loaded 31736 existing records from primary storage. [2025-10-27T22:07:11.090235] [INFO ] [MAIN ] CNS: Loaded 21224 primary data records. [2025-10-27T22:07:11.090348] [INFO ] [MAIN ] CNMD: Loaded 31736 primary data records. [2025-10-27T22:07:11.722466] [DEBUG] [LOCAL ] CNP: Loaded 53474 existing records from primary storage. [2025-10-27T22:07:11.723168] [INFO ] [MAIN ] CNP: Loaded 53474 primary data records. [2025-10-27T22:07:12.075321] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:12.075872] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:12.139967] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:12.197708] [INFO ] [MAIN ] CNMD: Generated 138 derivative records from 31736 primary records. [2025-10-27T22:07:12.198223] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-27T22:07:12.201473] [INFO ] [MAIN ] CNS: Generated 138 derivative records from 21224 primary records. [2025-10-27T22:07:12.214506] [DEBUG] [LOCAL ] CNMD: Derivative data saved (138 records). [2025-10-27T22:07:12.214681] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-27T22:07:12.216926] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-27T22:07:12.220042] [INFO ] [MAIN ] Derivative Progress: 379/1881 symbols completed. CNMD took 1.2s. Estimated remaining: 10m 10s. Rate: 147.7 symbols/min [2025-10-27T22:07:12.232985] [DEBUG] [LOCAL ] CNS: Derivative data saved (138 records). [2025-10-27T22:07:12.233300] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:12.236076] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-27T22:07:12.238786] [INFO ] [MAIN ] Derivative Progress: 380/1881 symbols completed. CNS took 1.2s. Estimated remaining: 10m 8s. Rate: 148.1 symbols/min [2025-10-27T22:07:12.239089] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:12.243541] [INFO ] [MAIN ] CNP: Generated 138 derivative records from 53474 primary records. [2025-10-27T22:07:12.243763] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-27T22:07:12.256107] [DEBUG] [LOCAL ] CNP: Derivative data saved (138 records). [2025-10-27T22:07:12.256280] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-27T22:07:12.258682] [INFO ] [MAIN ] Derivative Progress: 381/1881 symbols completed. CNP took 1.2s. Estimated remaining: 10m 6s. Rate: 148.5 symbols/min [2025-10-27T22:07:12.258942] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:12.316142] [DEBUG] [LOCAL ] CODI: Loaded 41978 existing records from primary storage. [2025-10-27T22:07:12.330837] [INFO ] [MAIN ] CODI: Loaded 41978 primary data records. [2025-10-27T22:07:12.353024] [DEBUG] [LOCAL ] CNX: Loaded 51282 existing records from primary storage. [2025-10-27T22:07:12.369565] [INFO ] [MAIN ] CNX: Loaded 51282 primary data records. [2025-10-27T22:07:12.533219] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-27T22:07:12.544176] [INFO ] [MAIN ] COF: Loaded 53625 primary data records. [2025-10-27T22:07:13.329710] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:13.356607] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:13.402012] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:13.463143] [INFO ] [MAIN ] CODI: Generated 138 derivative records from 41978 primary records. [2025-10-27T22:07:13.463446] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-27T22:07:13.464891] [INFO ] [MAIN ] CNX: Generated 138 derivative records from 51282 primary records. [2025-10-27T22:07:13.465974] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-27T22:07:13.477117] [DEBUG] [LOCAL ] CODI: Derivative data saved (138 records). [2025-10-27T22:07:13.478694] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-27T22:07:13.482855] [INFO ] [MAIN ] Derivative Progress: 382/1881 symbols completed. CODI took 1.2s. Estimated remaining: 10m 9s. Rate: 147.7 symbols/min [2025-10-27T22:07:13.483590] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:13.495543] [DEBUG] [LOCAL ] CNX: Derivative data saved (138 records). [2025-10-27T22:07:13.496077] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-27T22:07:13.499939] [INFO ] [MAIN ] Derivative Progress: 383/1881 symbols completed. CNX took 1.3s. Estimated remaining: 10m 7s. Rate: 148.1 symbols/min [2025-10-27T22:07:13.501484] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:13.504429] [INFO ] [MAIN ] COF: Generated 138 derivative records from 53625 primary records. [2025-10-27T22:07:13.504628] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-27T22:07:13.517579] [DEBUG] [LOCAL ] COF: Derivative data saved (138 records). [2025-10-27T22:07:13.517786] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-27T22:07:13.520867] [INFO ] [MAIN ] Derivative Progress: 384/1881 symbols completed. COF took 1.3s. Estimated remaining: 10m 5s. Rate: 148.4 symbols/min [2025-10-27T22:07:13.521146] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:13.590359] [DEBUG] [LOCAL ] COLD: Loaded 52495 existing records from primary storage. [2025-10-27T22:07:13.605527] [INFO ] [MAIN ] COLD: Loaded 52495 primary data records. [2025-10-27T22:07:13.619364] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-27T22:07:13.633091] [INFO ] [MAIN ] COHR: Loaded 53376 primary data records. [2025-10-27T22:07:13.672052] [DEBUG] [LOCAL ] COMP: Loaded 53399 existing records from primary storage. [2025-10-27T22:07:13.704085] [INFO ] [MAIN ] COMP: Loaded 53399 primary data records. [2025-10-27T22:07:14.630780] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:14.635998] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:14.672194] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:14.755064] [INFO ] [MAIN ] COLD: Generated 138 derivative records from 52495 primary records. [2025-10-27T22:07:14.754784] [INFO ] [MAIN ] COHR: Generated 138 derivative records from 53376 primary records. [2025-10-27T22:07:14.757264] [INFO ] [MAIN ] COMP: Generated 138 derivative records from 53399 primary records. [2025-10-27T22:07:14.757072] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-27T22:07:14.757921] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-27T22:07:14.757859] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-27T22:07:14.794088] [DEBUG] [LOCAL ] COHR: Derivative data saved (138 records). [2025-10-27T22:07:14.796258] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-27T22:07:14.796168] [DEBUG] [LOCAL ] COMP: Derivative data saved (138 records). [2025-10-27T22:07:14.798599] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-27T22:07:14.801510] [INFO ] [MAIN ] Derivative Progress: 385/1881 symbols completed. COMP took 1.3s. Estimated remaining: 10m 8s. Rate: 147.6 symbols/min [2025-10-27T22:07:14.805118] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:14.805727] [INFO ] [MAIN ] Derivative Progress: 386/1881 symbols completed. COHR took 1.3s. Estimated remaining: 10m 6s. Rate: 148.0 symbols/min [2025-10-27T22:07:14.806133] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:14.807984] [DEBUG] [LOCAL ] COLD: Derivative data saved (138 records). [2025-10-27T22:07:14.808140] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-27T22:07:14.811361] [INFO ] [MAIN ] Derivative Progress: 387/1881 symbols completed. COLD took 1.3s. Estimated remaining: 10m 4s. Rate: 148.4 symbols/min [2025-10-27T22:07:14.811878] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:14.874199] [DEBUG] [LOCAL ] CON: Loaded 38586 existing records from primary storage. [2025-10-27T22:07:14.887635] [INFO ] [MAIN ] CON: Loaded 38586 primary data records. [2025-10-27T22:07:14.902016] [DEBUG] [LOCAL ] COR: Loaded 45968 existing records from primary storage. [2025-10-27T22:07:14.902297] [INFO ] [MAIN ] COR: Loaded 45968 primary data records. [2025-10-27T22:07:14.902925] [DEBUG] [LOCAL ] COTY: Loaded 53247 existing records from primary storage. [2025-10-27T22:07:14.944239] [INFO ] [MAIN ] COTY: Loaded 53247 primary data records. [2025-10-27T22:07:15.863687] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:15.864415] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:15.894100] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:15.975460] [INFO ] [MAIN ] COTY: Generated 138 derivative records from 53247 primary records. [2025-10-27T22:07:15.980100] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-27T22:07:15.979994] [INFO ] [MAIN ] CON: Generated 138 derivative records from 38586 primary records. [2025-10-27T22:07:15.980360] [INFO ] [MAIN ] COR: Generated 138 derivative records from 45968 primary records. [2025-10-27T22:07:15.981152] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-27T22:07:15.981442] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-27T22:07:16.000630] [DEBUG] [LOCAL ] COTY: Derivative data saved (138 records). [2025-10-27T22:07:16.003003] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-27T22:07:16.005780] [DEBUG] [LOCAL ] COR: Derivative data saved (138 records). [2025-10-27T22:07:16.007839] [INFO ] [MAIN ] Derivative Progress: 388/1881 symbols completed. COTY took 1.2s. Estimated remaining: 10m 7s. Rate: 147.6 symbols/min [2025-10-27T22:07:16.015116] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-27T22:07:16.019783] [INFO ] [MAIN ] Derivative Progress: 389/1881 symbols completed. COR took 1.2s. Estimated remaining: 10m 5s. Rate: 148.0 symbols/min [2025-10-27T22:07:16.022519] [DEBUG] [LOCAL ] CON: Derivative data saved (138 records). [2025-10-27T22:07:16.022662] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-27T22:07:16.024849] [INFO ] [MAIN ] Derivative Progress: 390/1881 symbols completed. CON took 1.2s. Estimated remaining: 10m 3s. Rate: 148.4 symbols/min [2025-10-27T22:07:16.025244] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:16.025436] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:16.025388] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:16.078199] [DEBUG] [LOCAL ] CPA: Loaded 27383 existing records from primary storage. [2025-10-27T22:07:16.079012] [DEBUG] [LOCAL ] CPAY: Loaded 29565 existing records from primary storage. [2025-10-27T22:07:16.079143] [INFO ] [MAIN ] CPA: Loaded 27383 primary data records. [2025-10-27T22:07:16.079246] [INFO ] [MAIN ] CPAY: Loaded 29565 primary data records. [2025-10-27T22:07:16.228874] [DEBUG] [LOCAL ] COUR: Loaded 49420 existing records from primary storage. [2025-10-27T22:07:16.236924] [INFO ] [MAIN ] COUR: Loaded 49420 primary data records. [2025-10-27T22:07:17.081259] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:17.087107] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:17.147590] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:17.201797] [INFO ] [MAIN ] CPA: Generated 138 derivative records from 27383 primary records. [2025-10-27T22:07:17.204372] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-27T22:07:17.207984] [INFO ] [MAIN ] CPAY: Generated 138 derivative records from 29565 primary records. [2025-10-27T22:07:17.221224] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-27T22:07:17.226029] [DEBUG] [LOCAL ] CPA: Derivative data saved (138 records). [2025-10-27T22:07:17.238313] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-27T22:07:17.241545] [DEBUG] [LOCAL ] CPAY: Derivative data saved (138 records). [2025-10-27T22:07:17.245247] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-27T22:07:17.243941] [INFO ] [MAIN ] Derivative Progress: 391/1881 symbols completed. CPA took 1.2s. Estimated remaining: 10m 6s. Rate: 147.6 symbols/min [2025-10-27T22:07:17.247853] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:17.247941] [INFO ] [MAIN ] Derivative Progress: 392/1881 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 4s. Rate: 148.0 symbols/min [2025-10-27T22:07:17.250706] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:17.255423] [INFO ] [MAIN ] COUR: Generated 138 derivative records from 49420 primary records. [2025-10-27T22:07:17.255528] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-27T22:07:17.267636] [DEBUG] [LOCAL ] COUR: Derivative data saved (138 records). [2025-10-27T22:07:17.271181] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-27T22:07:17.273528] [INFO ] [MAIN ] Derivative Progress: 393/1881 symbols completed. COUR took 1.2s. Estimated remaining: 10m 2s. Rate: 148.3 symbols/min [2025-10-27T22:07:17.273779] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:17.290063] [DEBUG] [LOCAL ] CPF: Loaded 14882 existing records from primary storage. [2025-10-27T22:07:17.290544] [INFO ] [MAIN ] CPF: Loaded 14882 primary data records. [2025-10-27T22:07:17.290455] [DEBUG] [LOCAL ] CPK: Loaded 13687 existing records from primary storage. [2025-10-27T22:07:17.307096] [INFO ] [MAIN ] CPK: Loaded 13687 primary data records. [2025-10-27T22:07:17.921777] [DEBUG] [LOCAL ] CPRI: Loaded 52365 existing records from primary storage. [2025-10-27T22:07:17.922362] [INFO ] [MAIN ] CPRI: Loaded 52365 primary data records. [2025-10-27T22:07:18.235935] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:18.272802] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:18.327078] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:18.345949] [INFO ] [MAIN ] CPF: Generated 138 derivative records from 14882 primary records. [2025-10-27T22:07:18.346570] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-27T22:07:18.363912] [DEBUG] [LOCAL ] CPF: Derivative data saved (138 records). [2025-10-27T22:07:18.364355] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-27T22:07:18.367267] [INFO ] [MAIN ] Derivative Progress: 394/1881 symbols completed. CPF took 1.1s. Estimated remaining: 10m 4s. Rate: 147.7 symbols/min [2025-10-27T22:07:18.370016] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:18.374116] [INFO ] [MAIN ] CPK: Generated 138 derivative records from 13687 primary records. [2025-10-27T22:07:18.374759] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-27T22:07:18.392775] [DEBUG] [LOCAL ] CPK: Derivative data saved (138 records). [2025-10-27T22:07:18.399928] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-27T22:07:18.402241] [INFO ] [MAIN ] Derivative Progress: 395/1881 symbols completed. CPK took 1.2s. Estimated remaining: 10m 2s. Rate: 148.0 symbols/min [2025-10-27T22:07:18.405279] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:18.416812] [DEBUG] [LOCAL ] CPS: Loaded 24342 existing records from primary storage. [2025-10-27T22:07:18.416339] [INFO ] [MAIN ] CPRI: Generated 138 derivative records from 52365 primary records. [2025-10-27T22:07:18.416999] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-27T22:07:18.417355] [INFO ] [MAIN ] CPS: Loaded 24342 primary data records. [2025-10-27T22:07:18.504009] [DEBUG] [LOCAL ] CPRI: Derivative data saved (138 records). [2025-10-27T22:07:18.519967] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-27T22:07:18.533148] [INFO ] [MAIN ] Derivative Progress: 396/1881 symbols completed. CPRI took 1.3s. Estimated remaining: 10m 1s. Rate: 148.3 symbols/min [2025-10-27T22:07:18.544273] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:18.766888] [DEBUG] [LOCAL ] CR: Loaded 23894 existing records from primary storage. [2025-10-27T22:07:18.766394] [DEBUG] [LOCAL ] CPT: Loaded 44324 existing records from primary storage. [2025-10-27T22:07:18.767985] [INFO ] [MAIN ] CR: Loaded 23894 primary data records. [2025-10-27T22:07:18.768449] [INFO ] [MAIN ] CPT: Loaded 44324 primary data records. [2025-10-27T22:07:19.256126] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:19.465583] [INFO ] [MAIN ] CPS: Generated 138 derivative records from 24342 primary records. [2025-10-27T22:07:19.466779] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-27T22:07:19.497986] [DEBUG] [LOCAL ] CPS: Derivative data saved (138 records). [2025-10-27T22:07:19.498512] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:19.498738] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-27T22:07:19.511618] [INFO ] [MAIN ] Derivative Progress: 397/1881 symbols completed. CPS took 1.1s. Estimated remaining: 10m 3s. Rate: 147.8 symbols/min [2025-10-27T22:07:19.511790] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:19.527907] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:19.552821] [DEBUG] [LOCAL ] CRBD: Loaded 8602 existing records from primary storage. [2025-10-27T22:07:19.554054] [INFO ] [MAIN ] CRBD: Loaded 8602 primary data records. [2025-10-27T22:07:19.875460] [INFO ] [MAIN ] CR: Generated 138 derivative records from 23894 primary records. [2025-10-27T22:07:19.877351] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-27T22:07:19.880906] [INFO ] [MAIN ] CPT: Generated 138 derivative records from 44324 primary records. [2025-10-27T22:07:19.888190] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-27T22:07:19.893259] [DEBUG] [LOCAL ] CR: Derivative data saved (138 records). [2025-10-27T22:07:19.900779] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-27T22:07:19.906051] [INFO ] [MAIN ] Derivative Progress: 398/1881 symbols completed. CR took 1.4s. Estimated remaining: 10m 2s. Rate: 147.8 symbols/min [2025-10-27T22:07:19.906547] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:19.909015] [DEBUG] [LOCAL ] CPT: Derivative data saved (138 records). [2025-10-27T22:07:19.909124] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-27T22:07:19.911387] [INFO ] [MAIN ] Derivative Progress: 399/1881 symbols completed. CPT took 1.5s. Estimated remaining: 10m 0s. Rate: 148.1 symbols/min [2025-10-27T22:07:19.911775] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:19.930070] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:19.998408] [DEBUG] [LOCAL ] CRC: Loaded 43808 existing records from primary storage. [2025-10-27T22:07:20.011986] [INFO ] [MAIN ] CRBD: Generated 138 derivative records from 8602 primary records. [2025-10-27T22:07:20.012231] [INFO ] [MAIN ] CRC: Loaded 43808 primary data records. [2025-10-27T22:07:20.012184] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-27T22:07:20.033764] [DEBUG] [LOCAL ] CRBG: Loaded 52566 existing records from primary storage. [2025-10-27T22:07:20.055753] [INFO ] [MAIN ] CRBG: Loaded 52566 primary data records. [2025-10-27T22:07:20.103262] [DEBUG] [LOCAL ] CRBD: Derivative data saved (138 records). [2025-10-27T22:07:20.186268] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-27T22:07:20.218976] [INFO ] [MAIN ] Derivative Progress: 400/1881 symbols completed. CRBD took 0.7s. Estimated remaining: 9m 59s. Rate: 148.2 symbols/min [2025-10-27T22:07:20.330001] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:20.686552] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:20.700751] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:20.728578] [DEBUG] [LOCAL ] CRGY: Loaded 52486 existing records from primary storage. [2025-10-27T22:07:20.732597] [INFO ] [MAIN ] CRGY: Loaded 52486 primary data records. [2025-10-27T22:07:21.146217] [INFO ] [MAIN ] CRBG: Generated 138 derivative records from 52566 primary records. [2025-10-27T22:07:21.150886] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-27T22:07:21.166301] [INFO ] [MAIN ] CRC: Generated 138 derivative records from 43808 primary records. [2025-10-27T22:07:21.167788] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-27T22:07:21.169597] [DEBUG] [LOCAL ] CRBG: Derivative data saved (138 records). [2025-10-27T22:07:21.170184] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-27T22:07:21.172158] [INFO ] [MAIN ] Derivative Progress: 401/1881 symbols completed. CRBG took 1.3s. Estimated remaining: 10m 1s. Rate: 147.7 symbols/min [2025-10-27T22:07:21.180443] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:21.185639] [DEBUG] [LOCAL ] CRC: Derivative data saved (138 records). [2025-10-27T22:07:21.185944] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-27T22:07:21.188122] [INFO ] [MAIN ] Derivative Progress: 402/1881 symbols completed. CRC took 1.3s. Estimated remaining: 9m 59s. Rate: 148.1 symbols/min [2025-10-27T22:07:21.188422] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:21.209164] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:21.280188] [DEBUG] [LOCAL ] CRI: Loaded 49480 existing records from primary storage. [2025-10-27T22:07:21.300043] [INFO ] [MAIN ] CRGY: Generated 138 derivative records from 52486 primary records. [2025-10-27T22:07:21.300815] [DEBUG] [LOCAL ] CRH: Loaded 53392 existing records from primary storage. [2025-10-27T22:07:21.300962] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-27T22:07:21.301325] [INFO ] [MAIN ] CRH: Loaded 53392 primary data records. [2025-10-27T22:07:21.300187] [INFO ] [MAIN ] CRI: Loaded 49480 primary data records. [2025-10-27T22:07:21.348356] [DEBUG] [LOCAL ] CRGY: Derivative data saved (138 records). [2025-10-27T22:07:21.348462] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-27T22:07:21.369155] [INFO ] [MAIN ] Derivative Progress: 403/1881 symbols completed. CRGY took 1.0s. Estimated remaining: 9m 58s. Rate: 148.3 symbols/min [2025-10-27T22:07:21.962456] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:21.999691] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:22.031301] [INFO ] [MAIN ] CRH: Generated 138 derivative records from 53392 primary records. [2025-10-27T22:07:22.032395] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-27T22:07:22.051699] [DEBUG] [LOCAL ] CRH: Derivative data saved (138 records). [2025-10-27T22:07:22.051983] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-27T22:07:22.054208] [INFO ] [MAIN ] Derivative Progress: 404/1881 symbols completed. CRH took 0.9s. Estimated remaining: 9m 59s. Rate: 148.0 symbols/min [2025-10-27T22:07:22.059508] [INFO ] [MAIN ] CRI: Generated 138 derivative records from 49480 primary records. [2025-10-27T22:07:22.059579] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-27T22:07:22.071546] [DEBUG] [LOCAL ] CRI: Derivative data saved (138 records). [2025-10-27T22:07:22.071606] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-27T22:07:22.073418] [INFO ] [MAIN ] Derivative Progress: 405/1881 symbols completed. CRI took 0.9s. Estimated remaining: 9m 57s. Rate: 148.4 symbols/min [2025-10-27T22:07:22.073892] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:22.073978] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:22.073842] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:22.152563] [DEBUG] [LOCAL ] CRL: Loaded 42476 existing records from primary storage. [2025-10-27T22:07:22.153705] [INFO ] [MAIN ] CRL: Loaded 42476 primary data records. [2025-10-27T22:07:22.154426] [DEBUG] [LOCAL ] CRK: Loaded 52167 existing records from primary storage. [2025-10-27T22:07:22.186224] [INFO ] [MAIN ] CRK: Loaded 52167 primary data records. [2025-10-27T22:07:22.330327] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-27T22:07:22.355469] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-27T22:07:23.097845] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:23.118033] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:23.143000] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:23.207873] [INFO ] [MAIN ] CRL: Generated 138 derivative records from 42476 primary records. [2025-10-27T22:07:23.208472] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-27T22:07:23.223476] [DEBUG] [LOCAL ] CRL: Derivative data saved (138 records). [2025-10-27T22:07:23.226872] [INFO ] [MAIN ] CRK: Generated 138 derivative records from 52167 primary records. [2025-10-27T22:07:23.223636] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-27T22:07:23.228970] [INFO ] [MAIN ] Derivative Progress: 406/1881 symbols completed. CRL took 1.2s. Estimated remaining: 9m 59s. Rate: 147.7 symbols/min [2025-10-27T22:07:23.227245] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-27T22:07:23.227180] [INFO ] [MAIN ] CRM: Generated 138 derivative records from 53770 primary records. [2025-10-27T22:07:23.229628] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-27T22:07:23.229751] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:23.251269] [DEBUG] [LOCAL ] CRM: Derivative data saved (138 records). [2025-10-27T22:07:23.254140] [DEBUG] [LOCAL ] CRK: Derivative data saved (138 records). [2025-10-27T22:07:23.254245] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-27T22:07:23.256382] [INFO ] [MAIN ] Derivative Progress: 407/1881 symbols completed. CRK took 1.2s. Estimated remaining: 9m 57s. Rate: 148.0 symbols/min [2025-10-27T22:07:23.254355] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-27T22:07:23.259336] [INFO ] [MAIN ] Derivative Progress: 408/1881 symbols completed. CRM took 1.2s. Estimated remaining: 9m 56s. Rate: 148.4 symbols/min [2025-10-27T22:07:23.256551] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:23.259475] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:23.269417] [DEBUG] [LOCAL ] CRT: Loaded 4799 existing records from primary storage. [2025-10-27T22:07:23.269763] [INFO ] [MAIN ] CRT: Loaded 4799 primary data records. [2025-10-27T22:07:23.485425] [DEBUG] [LOCAL ] CRS: Loaded 43082 existing records from primary storage. [2025-10-27T22:07:23.516125] [INFO ] [MAIN ] CRS: Loaded 43082 primary data records. [2025-10-27T22:07:23.558401] [DEBUG] [LOCAL ] CSAN: Loaded 42109 existing records from primary storage. [2025-10-27T22:07:23.674918] [INFO ] [MAIN ] CSAN: Loaded 42109 primary data records. [2025-10-27T22:07:24.275112] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:24.319447] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:24.354115] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:24.381235] [INFO ] [MAIN ] CRT: Generated 138 derivative records from 4799 primary records. [2025-10-27T22:07:24.381798] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-27T22:07:24.398954] [DEBUG] [LOCAL ] CRT: Derivative data saved (138 records). [2025-10-27T22:07:24.402358] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-27T22:07:24.404256] [INFO ] [MAIN ] Derivative Progress: 409/1881 symbols completed. CRT took 1.1s. Estimated remaining: 9m 58s. Rate: 147.7 symbols/min [2025-10-27T22:07:24.404454] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:24.436306] [INFO ] [MAIN ] CRS: Generated 138 derivative records from 43082 primary records. [2025-10-27T22:07:24.436634] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-27T22:07:24.447892] [INFO ] [MAIN ] CSAN: Generated 138 derivative records from 42109 primary records. [2025-10-27T22:07:24.449556] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-27T22:07:24.452204] [DEBUG] [LOCAL ] CRS: Derivative data saved (138 records). [2025-10-27T22:07:24.452430] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-27T22:07:24.454938] [INFO ] [MAIN ] Derivative Progress: 410/1881 symbols completed. CRS took 1.2s. Estimated remaining: 9m 56s. Rate: 148.1 symbols/min [2025-10-27T22:07:24.464851] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:24.475808] [DEBUG] [LOCAL ] CSL: Loaded 30902 existing records from primary storage. [2025-10-27T22:07:24.477068] [DEBUG] [LOCAL ] CSAN: Derivative data saved (138 records). [2025-10-27T22:07:24.477464] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-27T22:07:24.477396] [INFO ] [MAIN ] CSL: Loaded 30902 primary data records. [2025-10-27T22:07:24.480011] [INFO ] [MAIN ] Derivative Progress: 411/1881 symbols completed. CSAN took 1.2s. Estimated remaining: 9m 54s. Rate: 148.4 symbols/min [2025-10-27T22:07:24.491571] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:24.600611] [DEBUG] [LOCAL ] CSR: Loaded 13284 existing records from primary storage. [2025-10-27T22:07:24.628774] [INFO ] [MAIN ] CSR: Loaded 13284 primary data records. [2025-10-27T22:07:25.097247] [DEBUG] [LOCAL ] CSTM: Loaded 47323 existing records from primary storage. [2025-10-27T22:07:25.097988] [INFO ] [MAIN ] CSTM: Loaded 47323 primary data records. [2025-10-27T22:07:25.451526] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:25.489457] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:25.543086] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:25.563546] [INFO ] [MAIN ] CSL: Generated 138 derivative records from 30902 primary records. [2025-10-27T22:07:25.565256] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-27T22:07:25.585907] [DEBUG] [LOCAL ] CSL: Derivative data saved (138 records). [2025-10-27T22:07:25.586204] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-27T22:07:25.588207] [INFO ] [MAIN ] Derivative Progress: 412/1881 symbols completed. CSL took 1.2s. Estimated remaining: 9m 56s. Rate: 147.8 symbols/min [2025-10-27T22:07:25.588360] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:25.596205] [INFO ] [MAIN ] CSR: Generated 138 derivative records from 13284 primary records. [2025-10-27T22:07:25.597541] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-27T22:07:25.616416] [DEBUG] [LOCAL ] CSR: Derivative data saved (138 records). [2025-10-27T22:07:25.621150] [DEBUG] [LOCAL ] CSV: Loaded 12119 existing records from primary storage. [2025-10-27T22:07:25.621231] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-27T22:07:25.624173] [INFO ] [MAIN ] Derivative Progress: 413/1881 symbols completed. CSR took 1.2s. Estimated remaining: 9m 55s. Rate: 148.1 symbols/min [2025-10-27T22:07:25.624702] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:25.624560] [INFO ] [MAIN ] CSV: Loaded 12119 primary data records. [2025-10-27T22:07:25.703094] [DEBUG] [LOCAL ] CTBB: Loaded 6201 existing records from primary storage. [2025-10-27T22:07:25.710050] [INFO ] [MAIN ] CTBB: Loaded 6201 primary data records. [2025-10-27T22:07:25.801091] [INFO ] [MAIN ] CSTM: Generated 138 derivative records from 47323 primary records. [2025-10-27T22:07:25.869473] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-27T22:07:26.061483] [DEBUG] [LOCAL ] CSTM: Derivative data saved (138 records). [2025-10-27T22:07:26.062478] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-27T22:07:26.086075] [INFO ] [MAIN ] Derivative Progress: 414/1881 symbols completed. CSTM took 1.6s. Estimated remaining: 9m 55s. Rate: 148.1 symbols/min [2025-10-27T22:07:26.131809] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:26.256609] [DEBUG] [LOCAL ] CTDD: Loaded 5011 existing records from primary storage. [2025-10-27T22:07:26.257196] [INFO ] [MAIN ] CTDD: Loaded 5011 primary data records. [2025-10-27T22:07:26.565901] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:26.604121] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:26.656263] [INFO ] [MAIN ] CSV: Generated 138 derivative records from 12119 primary records. [2025-10-27T22:07:26.658857] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-27T22:07:26.659854] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:26.685545] [DEBUG] [LOCAL ] CSV: Derivative data saved (138 records). [2025-10-27T22:07:26.686068] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-27T22:07:26.691081] [INFO ] [MAIN ] Derivative Progress: 415/1881 symbols completed. CSV took 1.1s. Estimated remaining: 9m 55s. Rate: 147.9 symbols/min [2025-10-27T22:07:26.692061] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:26.699210] [INFO ] [MAIN ] CTBB: Generated 138 derivative records from 6201 primary records. [2025-10-27T22:07:26.700620] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-27T22:07:26.725438] [DEBUG] [LOCAL ] CTBB: Derivative data saved (138 records). [2025-10-27T22:07:26.726753] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-27T22:07:26.728967] [INFO ] [MAIN ] Derivative Progress: 416/1881 symbols completed. CTBB took 1.1s. Estimated remaining: 9m 53s. Rate: 148.2 symbols/min [2025-10-27T22:07:26.732021] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:26.741173] [DEBUG] [LOCAL ] CTO: Loaded 27078 existing records from primary storage. [2025-10-27T22:07:26.742884] [INFO ] [MAIN ] CTO: Loaded 27078 primary data records. [2025-10-27T22:07:26.744794] [INFO ] [MAIN ] CTDD: Generated 138 derivative records from 5011 primary records. [2025-10-27T22:07:26.744893] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-27T22:07:26.841077] [DEBUG] [LOCAL ] CTDD: Derivative data saved (138 records). [2025-10-27T22:07:26.865514] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-27T22:07:26.873238] [INFO ] [MAIN ] Derivative Progress: 417/1881 symbols completed. CTDD took 0.7s. Estimated remaining: 9m 52s. Rate: 148.4 symbols/min [2025-10-27T22:07:26.915607] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:27.075257] [DEBUG] [LOCAL ] CTOS: Loaded 37098 existing records from primary storage. [2025-10-27T22:07:27.075473] [INFO ] [MAIN ] CTOS: Loaded 37098 primary data records. [2025-10-27T22:07:27.440459] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-27T22:07:27.440851] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-27T22:07:27.517628] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:27.796147] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:27.828539] [INFO ] [MAIN ] CTO: Generated 138 derivative records from 27078 primary records. [2025-10-27T22:07:27.831303] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-27T22:07:27.847374] [DEBUG] [LOCAL ] CTO: Derivative data saved (138 records). [2025-10-27T22:07:27.849681] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-27T22:07:27.852066] [INFO ] [MAIN ] Derivative Progress: 418/1881 symbols completed. CTO took 1.2s. Estimated remaining: 9m 53s. Rate: 147.9 symbols/min [2025-10-27T22:07:27.860504] [INFO ] [MAIN ] CTOS: Generated 138 derivative records from 37098 primary records. [2025-10-27T22:07:27.860776] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-27T22:07:27.873805] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:27.897639] [DEBUG] [LOCAL ] CTOS: Derivative data saved (138 records). [2025-10-27T22:07:27.900986] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-27T22:07:27.903823] [INFO ] [MAIN ] Derivative Progress: 419/1881 symbols completed. CTOS took 1.2s. Estimated remaining: 9m 52s. Rate: 148.2 symbols/min [2025-10-27T22:07:27.914571] [INFO ] [MAIN ] CTRA: Generated 138 derivative records from 53647 primary records. [2025-10-27T22:07:27.914701] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-27T22:07:27.926570] [DEBUG] [LOCAL ] CTRA: Derivative data saved (138 records). [2025-10-27T22:07:27.926631] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-27T22:07:27.928639] [INFO ] [MAIN ] Derivative Progress: 420/1881 symbols completed. CTRA took 1.0s. Estimated remaining: 9m 50s. Rate: 148.6 symbols/min [2025-10-27T22:07:27.929133] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:27.929311] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:27.929447] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:27.955591] [DEBUG] [LOCAL ] CTS: Loaded 19302 existing records from primary storage. [2025-10-27T22:07:27.955888] [INFO ] [MAIN ] CTS: Loaded 19302 primary data records. [2025-10-27T22:07:28.186016] [DEBUG] [LOCAL ] CTRE: Loaded 49379 existing records from primary storage. [2025-10-27T22:07:28.191930] [INFO ] [MAIN ] CTRE: Loaded 49379 primary data records. [2025-10-27T22:07:28.191789] [DEBUG] [LOCAL ] CTRI: Loaded 41068 existing records from primary storage. [2025-10-27T22:07:28.223864] [INFO ] [MAIN ] CTRI: Loaded 41068 primary data records. [2025-10-27T22:07:28.985692] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:29.038005] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:29.038838] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:29.141202] [INFO ] [MAIN ] CTS: Generated 138 derivative records from 19302 primary records. [2025-10-27T22:07:29.143339] [INFO ] [MAIN ] CTRI: Generated 138 derivative records from 41068 primary records. [2025-10-27T22:07:29.146177] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-27T22:07:29.146087] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-27T22:07:29.146554] [INFO ] [MAIN ] CTRE: Generated 138 derivative records from 49379 primary records. [2025-10-27T22:07:29.148506] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-27T22:07:29.178400] [DEBUG] [LOCAL ] CTS: Derivative data saved (138 records). [2025-10-27T22:07:29.179929] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-27T22:07:29.189253] [INFO ] [MAIN ] Derivative Progress: 421/1881 symbols completed. CTS took 1.3s. Estimated remaining: 9m 53s. Rate: 147.8 symbols/min [2025-10-27T22:07:29.194698] [DEBUG] [LOCAL ] CTRE: Derivative data saved (138 records). [2025-10-27T22:07:29.194951] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:29.179322] [DEBUG] [LOCAL ] CTRI: Derivative data saved (138 records). [2025-10-27T22:07:29.195239] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-27T22:07:29.199527] [INFO ] [MAIN ] Derivative Progress: 422/1881 symbols completed. CTRE took 1.3s. Estimated remaining: 9m 51s. Rate: 148.2 symbols/min [2025-10-27T22:07:29.200233] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:29.200455] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-27T22:07:29.204336] [INFO ] [MAIN ] Derivative Progress: 423/1881 symbols completed. CTRI took 1.3s. Estimated remaining: 9m 49s. Rate: 148.5 symbols/min [2025-10-27T22:07:29.204900] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:29.250765] [DEBUG] [LOCAL ] CUBI: Loaded 26871 existing records from primary storage. [2025-10-27T22:07:29.251072] [INFO ] [MAIN ] CUBI: Loaded 26871 primary data records. [2025-10-27T22:07:29.398347] [DEBUG] [LOCAL ] CTVA: Loaded 53299 existing records from primary storage. [2025-10-27T22:07:29.414925] [INFO ] [MAIN ] CTVA: Loaded 53299 primary data records. [2025-10-27T22:07:29.592172] [DEBUG] [LOCAL ] CUK: Loaded 51033 existing records from primary storage. [2025-10-27T22:07:29.792701] [INFO ] [MAIN ] CUK: Loaded 51033 primary data records. [2025-10-27T22:07:30.308458] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:30.341402] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:30.382258] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:30.434615] [INFO ] [MAIN ] CUBI: Generated 138 derivative records from 26871 primary records. [2025-10-27T22:07:30.435815] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-27T22:07:30.461155] [DEBUG] [LOCAL ] CUBI: Derivative data saved (138 records). [2025-10-27T22:07:30.463325] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-27T22:07:30.465537] [INFO ] [MAIN ] Derivative Progress: 424/1881 symbols completed. CUBI took 1.3s. Estimated remaining: 9m 52s. Rate: 147.8 symbols/min [2025-10-27T22:07:30.469805] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:30.475586] [INFO ] [MAIN ] CTVA: Generated 138 derivative records from 53299 primary records. [2025-10-27T22:07:30.479149] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-27T22:07:30.479361] [INFO ] [MAIN ] CUK: Generated 138 derivative records from 51033 primary records. [2025-10-27T22:07:30.480159] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-27T22:07:30.483469] [DEBUG] [LOCAL ] CULP: Loaded 2757 existing records from primary storage. [2025-10-27T22:07:30.493488] [INFO ] [MAIN ] CULP: Loaded 2757 primary data records. [2025-10-27T22:07:30.502918] [DEBUG] [LOCAL ] CTVA: Derivative data saved (138 records). [2025-10-27T22:07:30.533042] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-27T22:07:30.535302] [INFO ] [MAIN ] Derivative Progress: 425/1881 symbols completed. CTVA took 1.3s. Estimated remaining: 9m 50s. Rate: 148.1 symbols/min [2025-10-27T22:07:30.547988] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:30.552551] [DEBUG] [LOCAL ] CUK: Derivative data saved (138 records). [2025-10-27T22:07:30.563668] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-27T22:07:30.572098] [INFO ] [MAIN ] Derivative Progress: 426/1881 symbols completed. CUK took 1.4s. Estimated remaining: 9m 48s. Rate: 148.4 symbols/min [2025-10-27T22:07:30.573689] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:30.898938] [DEBUG] [LOCAL ] CURB: Loaded 32698 existing records from primary storage. [2025-10-27T22:07:30.899402] [DEBUG] [LOCAL ] CURV: Loaded 27358 existing records from primary storage. [2025-10-27T22:07:30.899776] [INFO ] [MAIN ] CURV: Loaded 27358 primary data records. [2025-10-27T22:07:30.899857] [INFO ] [MAIN ] CURB: Loaded 32698 primary data records. [2025-10-27T22:07:31.571833] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:31.633911] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:31.640885] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:31.670669] [INFO ] [MAIN ] CULP: Generated 138 derivative records from 2757 primary records. [2025-10-27T22:07:31.672115] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-27T22:07:31.686775] [DEBUG] [LOCAL ] CULP: Derivative data saved (138 records). [2025-10-27T22:07:31.689847] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-27T22:07:31.693298] [INFO ] [MAIN ] Derivative Progress: 427/1881 symbols completed. CULP took 1.2s. Estimated remaining: 9m 50s. Rate: 147.8 symbols/min [2025-10-27T22:07:31.693517] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:31.729481] [INFO ] [MAIN ] CURB: Generated 138 derivative records from 32698 primary records. [2025-10-27T22:07:31.729299] [INFO ] [MAIN ] CURV: Generated 138 derivative records from 27358 primary records. [2025-10-27T22:07:31.729740] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-27T22:07:31.730070] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-27T22:07:31.765005] [DEBUG] [LOCAL ] CURB: Derivative data saved (138 records). [2025-10-27T22:07:31.763401] [DEBUG] [LOCAL ] CURV: Derivative data saved (138 records). [2025-10-27T22:07:31.765119] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-27T22:07:31.767544] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-27T22:07:31.767371] [INFO ] [MAIN ] Derivative Progress: 428/1881 symbols completed. CURB took 1.2s. Estimated remaining: 9m 49s. Rate: 148.0 symbols/min [2025-10-27T22:07:31.770027] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:31.770144] [INFO ] [MAIN ] Derivative Progress: 429/1881 symbols completed. CURV took 1.2s. Estimated remaining: 9m 47s. Rate: 148.4 symbols/min [2025-10-27T22:07:31.770427] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:31.795440] [DEBUG] [LOCAL ] CUZ: Loaded 49312 existing records from primary storage. [2025-10-27T22:07:31.795774] [INFO ] [MAIN ] CUZ: Loaded 49312 primary data records. [2025-10-27T22:07:31.845220] [DEBUG] [LOCAL ] CVEO: Loaded 15001 existing records from primary storage. [2025-10-27T22:07:31.878239] [INFO ] [MAIN ] CVEO: Loaded 15001 primary data records. [2025-10-27T22:07:32.215762] [DEBUG] [LOCAL ] CVE: Loaded 53560 existing records from primary storage. [2025-10-27T22:07:32.257139] [INFO ] [MAIN ] CVE: Loaded 53560 primary data records. [2025-10-27T22:07:32.743748] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:32.776245] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:32.812636] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:32.853492] [INFO ] [MAIN ] CUZ: Generated 138 derivative records from 49312 primary records. [2025-10-27T22:07:32.856262] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-27T22:07:32.871182] [DEBUG] [LOCAL ] CUZ: Derivative data saved (138 records). [2025-10-27T22:07:32.872817] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-27T22:07:32.877943] [INFO ] [MAIN ] Derivative Progress: 430/1881 symbols completed. CUZ took 1.2s. Estimated remaining: 9m 49s. Rate: 147.8 symbols/min [2025-10-27T22:07:32.875456] [INFO ] [MAIN ] CVEO: Generated 138 derivative records from 15001 primary records. [2025-10-27T22:07:32.878120] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:32.878199] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-27T22:07:32.894951] [DEBUG] [LOCAL ] CVEO: Derivative data saved (138 records). [2025-10-27T22:07:32.895299] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-27T22:07:32.897575] [INFO ] [MAIN ] Derivative Progress: 431/1881 symbols completed. CVEO took 1.1s. Estimated remaining: 9m 47s. Rate: 148.1 symbols/min [2025-10-27T22:07:32.898869] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:32.901518] [INFO ] [MAIN ] CVE: Generated 138 derivative records from 53560 primary records. [2025-10-27T22:07:32.901605] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-27T22:07:32.919173] [DEBUG] [LOCAL ] CVE: Derivative data saved (138 records). [2025-10-27T22:07:32.919876] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-27T22:07:32.922441] [INFO ] [MAIN ] Derivative Progress: 432/1881 symbols completed. CVE took 1.2s. Estimated remaining: 9m 46s. Rate: 148.4 symbols/min [2025-10-27T22:07:32.922627] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:32.929598] [DEBUG] [LOCAL ] CVLG: Loaded 15185 existing records from primary storage. [2025-10-27T22:07:32.929869] [INFO ] [MAIN ] CVLG: Loaded 15185 primary data records. [2025-10-27T22:07:33.109127] [DEBUG] [LOCAL ] CVI: Loaded 46550 existing records from primary storage. [2025-10-27T22:07:33.137306] [INFO ] [MAIN ] CVI: Loaded 46550 primary data records. [2025-10-27T22:07:33.385064] [DEBUG] [LOCAL ] CVNA: Loaded 52806 existing records from primary storage. [2025-10-27T22:07:33.386250] [INFO ] [MAIN ] CVNA: Loaded 52806 primary data records. [2025-10-27T22:07:33.951584] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:34.012524] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:34.043413] [INFO ] [MAIN ] CVLG: Generated 138 derivative records from 15185 primary records. [2025-10-27T22:07:34.056457] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-27T22:07:34.058186] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:34.086802] [DEBUG] [LOCAL ] CVLG: Derivative data saved (138 records). [2025-10-27T22:07:34.087880] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-27T22:07:34.095384] [INFO ] [MAIN ] Derivative Progress: 433/1881 symbols completed. CVLG took 1.2s. Estimated remaining: 9m 48s. Rate: 147.8 symbols/min [2025-10-27T22:07:34.122524] [INFO ] [MAIN ] CVI: Generated 138 derivative records from 46550 primary records. [2025-10-27T22:07:34.124285] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-27T22:07:34.142063] [DEBUG] [LOCAL ] CVI: Derivative data saved (138 records). [2025-10-27T22:07:34.142217] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-27T22:07:34.144110] [INFO ] [MAIN ] CVNA: Generated 138 derivative records from 52806 primary records. [2025-10-27T22:07:34.148104] [INFO ] [MAIN ] Derivative Progress: 434/1881 symbols completed. CVI took 1.3s. Estimated remaining: 9m 46s. Rate: 148.1 symbols/min [2025-10-27T22:07:34.144304] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-27T22:07:34.160953] [DEBUG] [LOCAL ] CVNA: Derivative data saved (138 records). [2025-10-27T22:07:34.161018] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-27T22:07:34.163318] [INFO ] [MAIN ] Derivative Progress: 435/1881 symbols completed. CVNA took 1.2s. Estimated remaining: 9m 45s. Rate: 148.4 symbols/min [2025-10-27T22:07:34.163933] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:34.163827] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:34.164125] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:34.186629] [DEBUG] [LOCAL ] CW: Loaded 21509 existing records from primary storage. [2025-10-27T22:07:34.186906] [INFO ] [MAIN ] CW: Loaded 21509 primary data records. [2025-10-27T22:07:34.524735] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-27T22:07:34.525153] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-27T22:07:34.574030] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-27T22:07:34.600181] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-27T22:07:35.188954] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:35.235484] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:35.276524] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:35.308136] [INFO ] [MAIN ] CW: Generated 138 derivative records from 21509 primary records. [2025-10-27T22:07:35.308879] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-27T22:07:35.323938] [DEBUG] [LOCAL ] CW: Derivative data saved (138 records). [2025-10-27T22:07:35.325614] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-27T22:07:35.333443] [INFO ] [MAIN ] Derivative Progress: 436/1881 symbols completed. CW took 1.2s. Estimated remaining: 9m 47s. Rate: 147.8 symbols/min [2025-10-27T22:07:35.336944] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:35.357236] [INFO ] [MAIN ] CVS: Generated 138 derivative records from 53694 primary records. [2025-10-27T22:07:35.358101] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-27T22:07:35.374725] [INFO ] [MAIN ] CVX: Generated 138 derivative records from 53760 primary records. [2025-10-27T22:07:35.375500] [DEBUG] [LOCAL ] CVS: Derivative data saved (138 records). [2025-10-27T22:07:35.375751] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-27T22:07:35.375892] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-27T22:07:35.378852] [INFO ] [MAIN ] Derivative Progress: 437/1881 symbols completed. CVS took 1.2s. Estimated remaining: 9m 45s. Rate: 148.1 symbols/min [2025-10-27T22:07:35.388441] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:35.392119] [DEBUG] [LOCAL ] CVX: Derivative data saved (138 records). [2025-10-27T22:07:35.411288] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-27T22:07:35.414105] [INFO ] [MAIN ] Derivative Progress: 438/1881 symbols completed. CVX took 1.2s. Estimated remaining: 9m 43s. Rate: 148.4 symbols/min [2025-10-27T22:07:35.414378] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:35.437355] [DEBUG] [LOCAL ] CWAN: Loaded 52664 existing records from primary storage. [2025-10-27T22:07:35.437587] [INFO ] [MAIN ] CWAN: Loaded 52664 primary data records. [2025-10-27T22:07:35.838541] [DEBUG] [LOCAL ] CWH: Loaded 51204 existing records from primary storage. [2025-10-27T22:07:35.867706] [INFO ] [MAIN ] CWH: Loaded 51204 primary data records. [2025-10-27T22:07:35.883994] [DEBUG] [LOCAL ] CWEN: Loaded 45119 existing records from primary storage. [2025-10-27T22:07:35.884287] [INFO ] [MAIN ] CWEN: Loaded 45119 primary data records. [2025-10-27T22:07:36.512787] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:36.560230] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:36.594624] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:36.627982] [INFO ] [MAIN ] CWAN: Generated 138 derivative records from 52664 primary records. [2025-10-27T22:07:36.630219] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-27T22:07:36.653795] [DEBUG] [LOCAL ] CWAN: Derivative data saved (138 records). [2025-10-27T22:07:36.655530] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-27T22:07:36.658293] [INFO ] [MAIN ] Derivative Progress: 439/1881 symbols completed. CWAN took 1.3s. Estimated remaining: 9m 46s. Rate: 147.7 symbols/min [2025-10-27T22:07:36.658547] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:36.664139] [INFO ] [MAIN ] CWH: Generated 138 derivative records from 51204 primary records. [2025-10-27T22:07:36.664620] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-27T22:07:36.675714] [INFO ] [MAIN ] CWEN: Generated 138 derivative records from 45119 primary records. [2025-10-27T22:07:36.678742] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-27T22:07:36.688020] [DEBUG] [LOCAL ] CWH: Derivative data saved (138 records). [2025-10-27T22:07:36.689477] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-27T22:07:36.693254] [INFO ] [MAIN ] Derivative Progress: 440/1881 symbols completed. CWH took 1.3s. Estimated remaining: 9m 44s. Rate: 148.0 symbols/min [2025-10-27T22:07:36.694148] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:36.697587] [DEBUG] [LOCAL ] CWEN: Derivative data saved (138 records). [2025-10-27T22:07:36.697999] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-27T22:07:36.701964] [INFO ] [MAIN ] Derivative Progress: 441/1881 symbols completed. CWEN took 1.3s. Estimated remaining: 9m 43s. Rate: 148.3 symbols/min [2025-10-27T22:07:36.702267] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:36.753632] [DEBUG] [LOCAL ] CWK: Loaded 49600 existing records from primary storage. [2025-10-27T22:07:36.752815] [DEBUG] [LOCAL ] CWT: Loaded 27782 existing records from primary storage. [2025-10-27T22:07:36.753933] [INFO ] [MAIN ] CWK: Loaded 49600 primary data records. [2025-10-27T22:07:36.753863] [INFO ] [MAIN ] CWT: Loaded 27782 primary data records. [2025-10-27T22:07:37.165983] [DEBUG] [LOCAL ] CX: Loaded 52770 existing records from primary storage. [2025-10-27T22:07:37.249435] [INFO ] [MAIN ] CX: Loaded 52770 primary data records. [2025-10-27T22:07:37.710420] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:37.711494] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:37.778274] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:37.860151] [INFO ] [MAIN ] CWK: Generated 138 derivative records from 49600 primary records. [2025-10-27T22:07:37.861742] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-27T22:07:37.880504] [DEBUG] [LOCAL ] CWK: Derivative data saved (138 records). [2025-10-27T22:07:37.883103] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-27T22:07:37.885386] [INFO ] [MAIN ] Derivative Progress: 442/1881 symbols completed. CWK took 1.2s. Estimated remaining: 9m 45s. Rate: 147.7 symbols/min [2025-10-27T22:07:37.886168] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:37.891630] [INFO ] [MAIN ] CWT: Generated 138 derivative records from 27782 primary records. [2025-10-27T22:07:37.892188] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-27T22:07:37.912820] [DEBUG] [LOCAL ] CXE: Loaded 6300 existing records from primary storage. [2025-10-27T22:07:37.913591] [INFO ] [MAIN ] CXE: Loaded 6300 primary data records. [2025-10-27T22:07:37.927417] [DEBUG] [LOCAL ] CWT: Derivative data saved (138 records). [2025-10-27T22:07:37.927546] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-27T22:07:37.939290] [INFO ] [MAIN ] Derivative Progress: 443/1881 symbols completed. CWT took 1.2s. Estimated remaining: 9m 43s. Rate: 148.0 symbols/min [2025-10-27T22:07:37.949721] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:38.052026] [INFO ] [MAIN ] CX: Generated 138 derivative records from 52770 primary records. [2025-10-27T22:07:38.067599] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-27T22:07:38.051394] [DEBUG] [LOCAL ] CXH: Loaded 4349 existing records from primary storage. [2025-10-27T22:07:38.114243] [INFO ] [MAIN ] CXH: Loaded 4349 primary data records. [2025-10-27T22:07:38.259546] [DEBUG] [LOCAL ] CX: Derivative data saved (138 records). [2025-10-27T22:07:38.295698] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-27T22:07:38.329084] [INFO ] [MAIN ] Derivative Progress: 444/1881 symbols completed. CX took 1.6s. Estimated remaining: 9m 43s. Rate: 148.0 symbols/min [2025-10-27T22:07:38.334448] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:38.611100] [DEBUG] [LOCAL ] CXM: Loaded 47108 existing records from primary storage. [2025-10-27T22:07:38.611462] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:38.611616] [INFO ] [MAIN ] CXM: Loaded 47108 primary data records. [2025-10-27T22:07:38.951180] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:07:38.976314] [INFO ] [MAIN ] CXE: Generated 138 derivative records from 6300 primary records. [2025-10-27T22:07:38.977915] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-27T22:07:38.994472] [DEBUG] [LOCAL ] CXE: Derivative data saved (138 records). [2025-10-27T22:07:38.994958] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-27T22:07:38.999363] [INFO ] [MAIN ] Derivative Progress: 445/1881 symbols completed. CXE took 1.1s. Estimated remaining: 9m 43s. Rate: 147.8 symbols/min [2025-10-27T22:07:39.000313] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:39.022791] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:39.035463] [INFO ] [MAIN ] CXH: Generated 138 derivative records from 4349 primary records. [2025-10-27T22:07:39.036973] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-27T22:07:39.061449] [DEBUG] [LOCAL ] CXH: Derivative data saved (138 records). [2025-10-27T22:07:39.069308] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-27T22:07:39.073456] [INFO ] [MAIN ] Derivative Progress: 446/1881 symbols completed. CXH took 1.1s. Estimated remaining: 9m 42s. Rate: 148.0 symbols/min [2025-10-27T22:07:39.074687] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:39.076129] [DEBUG] [LOCAL ] CXT: Loaded 30425 existing records from primary storage. [2025-10-27T22:07:39.077390] [INFO ] [MAIN ] CXT: Loaded 30425 primary data records. [2025-10-27T22:07:39.405212] [DEBUG] [LOCAL ] CXW: Loaded 43394 existing records from primary storage. [2025-10-27T22:07:39.406706] [INFO ] [MAIN ] CXW: Loaded 43394 primary data records. [2025-10-27T22:07:39.517329] [INFO ] [MAIN ] CXM: Generated 138 derivative records from 47108 primary records. [2025-10-27T22:07:39.522970] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-27T22:07:39.726722] [DEBUG] [LOCAL ] CXM: Derivative data saved (138 records). [2025-10-27T22:07:39.728834] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-27T22:07:39.731485] [INFO ] [MAIN ] Derivative Progress: 447/1881 symbols completed. CXM took 1.4s. Estimated remaining: 9m 42s. Rate: 147.8 symbols/min [2025-10-27T22:07:39.731859] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:39.747508] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:39.800743] [DEBUG] [LOCAL ] CYD: Loaded 27069 existing records from primary storage. [2025-10-27T22:07:39.802292] [INFO ] [MAIN ] CYD: Loaded 27069 primary data records. [2025-10-27T22:07:39.817746] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:39.942839] [INFO ] [MAIN ] CXT: Generated 138 derivative records from 30425 primary records. [2025-10-27T22:07:39.954588] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-27T22:07:40.204342] [DEBUG] [LOCAL ] CXT: Derivative data saved (138 records). [2025-10-27T22:07:40.206510] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-27T22:07:40.209874] [INFO ] [MAIN ] Derivative Progress: 448/1881 symbols completed. CXT took 1.2s. Estimated remaining: 9m 42s. Rate: 147.8 symbols/min [2025-10-27T22:07:40.218053] [INFO ] [MAIN ] CXW: Generated 138 derivative records from 43394 primary records. [2025-10-27T22:07:40.218399] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-27T22:07:40.231162] [DEBUG] [LOCAL ] CXW: Derivative data saved (138 records). [2025-10-27T22:07:40.231354] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-27T22:07:40.234721] [INFO ] [MAIN ] Derivative Progress: 449/1881 symbols completed. CXW took 1.2s. Estimated remaining: 9m 40s. Rate: 148.1 symbols/min [2025-10-27T22:07:40.250312] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:40.275851] [INFO ] [MAIN ] CYD: Generated 138 derivative records from 27069 primary records. [2025-10-27T22:07:40.275946] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-27T22:07:40.287469] [DEBUG] [LOCAL ] CYD: Derivative data saved (138 records). [2025-10-27T22:07:40.287529] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-27T22:07:40.290213] [INFO ] [MAIN ] Derivative Progress: 450/1881 symbols completed. CYD took 0.6s. Estimated remaining: 9m 39s. Rate: 148.4 symbols/min [2025-10-27T22:07:40.290835] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:40.291054] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:40.290948] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:40.306280] [DEBUG] [LOCAL ] DAC: Loaded 11984 existing records from primary storage. [2025-10-27T22:07:40.306610] [INFO ] [MAIN ] DAC: Loaded 11984 primary data records. [2025-10-27T22:07:40.644022] [DEBUG] [LOCAL ] CYH: Loaded 47628 existing records from primary storage. [2025-10-27T22:07:40.644969] [INFO ] [MAIN ] CYH: Loaded 47628 primary data records. [2025-10-27T22:07:40.644882] [DEBUG] [LOCAL ] DAN: Loaded 49315 existing records from primary storage. [2025-10-27T22:07:40.645153] [INFO ] [MAIN ] DAN: Loaded 49315 primary data records. [2025-10-27T22:07:41.259134] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:41.298295] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:41.335961] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:41.380141] [INFO ] [MAIN ] DAC: Generated 138 derivative records from 11984 primary records. [2025-10-27T22:07:41.384200] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-27T22:07:41.400677] [DEBUG] [LOCAL ] DAC: Derivative data saved (138 records). [2025-10-27T22:07:41.400987] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-27T22:07:41.403405] [INFO ] [MAIN ] Derivative Progress: 451/1881 symbols completed. DAC took 1.1s. Estimated remaining: 9m 41s. Rate: 147.8 symbols/min [2025-10-27T22:07:41.405760] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:41.421482] [INFO ] [MAIN ] CYH: Generated 138 derivative records from 47628 primary records. [2025-10-27T22:07:41.421287] [INFO ] [MAIN ] DAN: Generated 138 derivative records from 49315 primary records. [2025-10-27T22:07:41.421856] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-27T22:07:41.421929] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-27T22:07:41.448442] [DEBUG] [LOCAL ] CYH: Derivative data saved (138 records). [2025-10-27T22:07:41.451452] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-27T22:07:41.451296] [DEBUG] [LOCAL ] DAN: Derivative data saved (138 records). [2025-10-27T22:07:41.453876] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-27T22:07:41.453596] [INFO ] [MAIN ] Derivative Progress: 452/1881 symbols completed. CYH took 1.2s. Estimated remaining: 9m 39s. Rate: 148.1 symbols/min [2025-10-27T22:07:41.454026] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:41.456502] [INFO ] [MAIN ] Derivative Progress: 453/1881 symbols completed. DAN took 1.2s. Estimated remaining: 9m 37s. Rate: 148.4 symbols/min [2025-10-27T22:07:41.456913] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:41.465248] [DEBUG] [LOCAL ] DAO: Loaded 19588 existing records from primary storage. [2025-10-27T22:07:41.465424] [INFO ] [MAIN ] DAO: Loaded 19588 primary data records. [2025-10-27T22:07:41.821351] [DEBUG] [LOCAL ] DAVA: Loaded 41895 existing records from primary storage. [2025-10-27T22:07:41.820771] [DEBUG] [LOCAL ] DAR: Loaded 51980 existing records from primary storage. [2025-10-27T22:07:41.822499] [INFO ] [MAIN ] DAVA: Loaded 41895 primary data records. [2025-10-27T22:07:41.843693] [INFO ] [MAIN ] DAR: Loaded 51980 primary data records. [2025-10-27T22:07:42.491862] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:42.550088] [INFO ] [MAIN ] DAO: Generated 138 derivative records from 19588 primary records. [2025-10-27T22:07:42.549938] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:42.560946] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-27T22:07:42.580493] [DEBUG] [LOCAL ] DAO: Derivative data saved (138 records). [2025-10-27T22:07:42.598110] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-27T22:07:42.600452] [INFO ] [MAIN ] Derivative Progress: 454/1881 symbols completed. DAO took 1.2s. Estimated remaining: 9m 39s. Rate: 147.8 symbols/min [2025-10-27T22:07:42.600833] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:42.602024] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:42.639895] [INFO ] [MAIN ] DAVA: Generated 138 derivative records from 41895 primary records. [2025-10-27T22:07:42.641728] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-27T22:07:42.666597] [DEBUG] [LOCAL ] DAVA: Derivative data saved (138 records). [2025-10-27T22:07:42.668111] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-27T22:07:42.670458] [INFO ] [MAIN ] Derivative Progress: 455/1881 symbols completed. DAVA took 1.2s. Estimated remaining: 9m 38s. Rate: 148.1 symbols/min [2025-10-27T22:07:42.670823] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:42.677175] [INFO ] [MAIN ] DAR: Generated 138 derivative records from 51980 primary records. [2025-10-27T22:07:42.677928] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-27T22:07:42.703999] [DEBUG] [LOCAL ] DAR: Derivative data saved (138 records). [2025-10-27T22:07:42.704390] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-27T22:07:42.701797] [DEBUG] [LOCAL ] DAY: Loaded 49047 existing records from primary storage. [2025-10-27T22:07:42.707011] [INFO ] [MAIN ] Derivative Progress: 456/1881 symbols completed. DAR took 1.3s. Estimated remaining: 9m 36s. Rate: 148.4 symbols/min [2025-10-27T22:07:42.707216] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:42.707671] [INFO ] [MAIN ] DAY: Loaded 49047 primary data records. [2025-10-27T22:07:43.037593] [DEBUG] [LOCAL ] DB: Loaded 52404 existing records from primary storage. [2025-10-27T22:07:43.038890] [INFO ] [MAIN ] DB: Loaded 52404 primary data records. [2025-10-27T22:07:43.146795] [DEBUG] [LOCAL ] DBI: Loaded 43009 existing records from primary storage. [2025-10-27T22:07:43.158823] [INFO ] [MAIN ] DBI: Loaded 43009 primary data records. [2025-10-27T22:07:43.705788] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:43.758457] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:43.789043] [INFO ] [MAIN ] DAY: Generated 138 derivative records from 49047 primary records. [2025-10-27T22:07:43.788808] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:43.789388] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-27T22:07:43.822240] [DEBUG] [LOCAL ] DAY: Derivative data saved (138 records). [2025-10-27T22:07:43.822434] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-27T22:07:43.825492] [INFO ] [MAIN ] Derivative Progress: 457/1881 symbols completed. DAY took 1.2s. Estimated remaining: 9m 38s. Rate: 147.8 symbols/min [2025-10-27T22:07:43.830071] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:43.855210] [DEBUG] [LOCAL ] DBL: Loaded 9267 existing records from primary storage. [2025-10-27T22:07:43.859602] [INFO ] [MAIN ] DBL: Loaded 9267 primary data records. [2025-10-27T22:07:43.942620] [INFO ] [MAIN ] DBI: Generated 138 derivative records from 43009 primary records. [2025-10-27T22:07:43.958466] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-27T22:07:43.982877] [INFO ] [MAIN ] DB: Generated 138 derivative records from 52404 primary records. [2025-10-27T22:07:43.988115] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-27T22:07:44.024888] [DEBUG] [LOCAL ] DBI: Derivative data saved (138 records). [2025-10-27T22:07:44.066936] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-27T22:07:44.071254] [INFO ] [MAIN ] Derivative Progress: 458/1881 symbols completed. DBI took 1.4s. Estimated remaining: 9m 37s. Rate: 147.9 symbols/min [2025-10-27T22:07:44.073863] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:44.078455] [DEBUG] [LOCAL ] DB: Derivative data saved (138 records). [2025-10-27T22:07:44.219103] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-27T22:07:44.234626] [INFO ] [MAIN ] Derivative Progress: 459/1881 symbols completed. DB took 1.6s. Estimated remaining: 9m 36s. Rate: 148.1 symbols/min [2025-10-27T22:07:44.235617] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:44.297116] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:44.312959] [DEBUG] [LOCAL ] DBRG: Loaded 49964 existing records from primary storage. [2025-10-27T22:07:44.326898] [INFO ] [MAIN ] DBRG: Loaded 49964 primary data records. [2025-10-27T22:07:44.326806] [DEBUG] [LOCAL ] DCI: Loaded 36620 existing records from primary storage. [2025-10-27T22:07:44.359429] [INFO ] [MAIN ] DCI: Loaded 36620 primary data records. [2025-10-27T22:07:44.951199] [INFO ] [MAIN ] DBL: Generated 138 derivative records from 9267 primary records. [2025-10-27T22:07:44.951477] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-27T22:07:44.965337] [DEBUG] [LOCAL ] DBL: Derivative data saved (138 records). [2025-10-27T22:07:44.965521] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-27T22:07:44.968105] [INFO ] [MAIN ] Derivative Progress: 460/1881 symbols completed. DBL took 1.1s. Estimated remaining: 9m 37s. Rate: 147.9 symbols/min [2025-10-27T22:07:44.968367] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:44.988033] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:45.018260] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:45.088889] [DEBUG] [LOCAL ] DD: Loaded 52906 existing records from primary storage. [2025-10-27T22:07:45.090950] [INFO ] [MAIN ] DD: Loaded 52906 primary data records. [2025-10-27T22:07:45.213085] [INFO ] [MAIN ] DBRG: Generated 138 derivative records from 49964 primary records. [2025-10-27T22:07:45.221270] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-27T22:07:45.285715] [INFO ] [MAIN ] DCI: Generated 138 derivative records from 36620 primary records. [2025-10-27T22:07:45.384773] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-27T22:07:45.411258] [DEBUG] [LOCAL ] DBRG: Derivative data saved (138 records). [2025-10-27T22:07:45.411968] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-27T22:07:45.420940] [INFO ] [MAIN ] Derivative Progress: 461/1881 symbols completed. DBRG took 1.3s. Estimated remaining: 9m 36s. Rate: 147.8 symbols/min [2025-10-27T22:07:45.422878] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:45.427604] [DEBUG] [LOCAL ] DCI: Derivative data saved (138 records). [2025-10-27T22:07:45.428015] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-27T22:07:45.430825] [INFO ] [MAIN ] Derivative Progress: 462/1881 symbols completed. DCI took 1.2s. Estimated remaining: 9m 35s. Rate: 148.1 symbols/min [2025-10-27T22:07:45.431178] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:45.446044] [DEBUG] [LOCAL ] DDS: Loaded 11957 existing records from primary storage. [2025-10-27T22:07:45.446304] [INFO ] [MAIN ] DDS: Loaded 11957 primary data records. [2025-10-27T22:07:45.586058] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:45.725083] [DEBUG] [LOCAL ] DDD: Loaded 50909 existing records from primary storage. [2025-10-27T22:07:45.789080] [INFO ] [MAIN ] DDD: Loaded 50909 primary data records. [2025-10-27T22:07:46.172711] [INFO ] [MAIN ] DD: Generated 138 derivative records from 52906 primary records. [2025-10-27T22:07:46.173708] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-27T22:07:46.201524] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:46.201245] [DEBUG] [LOCAL ] DD: Derivative data saved (138 records). [2025-10-27T22:07:46.201777] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-27T22:07:46.216621] [INFO ] [MAIN ] Derivative Progress: 463/1881 symbols completed. DD took 1.2s. Estimated remaining: 9m 35s. Rate: 147.8 symbols/min [2025-10-27T22:07:46.253958] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:46.276831] [INFO ] [MAIN ] DDS: Generated 138 derivative records from 11957 primary records. [2025-10-27T22:07:46.276952] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-27T22:07:46.290167] [DEBUG] [LOCAL ] DDS: Derivative data saved (138 records). [2025-10-27T22:07:46.291851] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-27T22:07:46.296461] [INFO ] [MAIN ] Derivative Progress: 464/1881 symbols completed. DDS took 0.9s. Estimated remaining: 9m 34s. Rate: 148.1 symbols/min [2025-10-27T22:07:46.304507] [INFO ] [MAIN ] DDD: Generated 138 derivative records from 50909 primary records. [2025-10-27T22:07:46.304578] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-27T22:07:46.316092] [DEBUG] [LOCAL ] DDD: Derivative data saved (138 records). [2025-10-27T22:07:46.316148] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-27T22:07:46.319282] [INFO ] [MAIN ] Derivative Progress: 465/1881 symbols completed. DDD took 0.9s. Estimated remaining: 9m 33s. Rate: 148.4 symbols/min [2025-10-27T22:07:46.319690] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:46.319619] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:46.319842] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:46.324846] [DEBUG] [LOCAL ] DDT: Loaded 1794 existing records from primary storage. [2025-10-27T22:07:46.325147] [INFO ] [MAIN ] DDT: Loaded 1794 primary data records. [2025-10-27T22:07:46.646841] [DEBUG] [LOCAL ] DEA: Loaded 39763 existing records from primary storage. [2025-10-27T22:07:46.647586] [INFO ] [MAIN ] DEA: Loaded 39763 primary data records. [2025-10-27T22:07:46.770439] [DEBUG] [LOCAL ] DE: Loaded 47383 existing records from primary storage. [2025-10-27T22:07:46.782531] [INFO ] [MAIN ] DE: Loaded 47383 primary data records. [2025-10-27T22:07:47.288948] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:07:47.344108] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:47.383325] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:47.383577] [INFO ] [MAIN ] DDT: Generated 138 derivative records from 1794 primary records. [2025-10-27T22:07:47.399496] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-27T22:07:47.413340] [DEBUG] [LOCAL ] DDT: Derivative data saved (138 records). [2025-10-27T22:07:47.414808] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-27T22:07:47.417620] [INFO ] [MAIN ] Derivative Progress: 466/1881 symbols completed. DDT took 1.1s. Estimated remaining: 9m 34s. Rate: 147.9 symbols/min [2025-10-27T22:07:47.417959] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:47.460239] [INFO ] [MAIN ] DEA: Generated 138 derivative records from 39763 primary records. [2025-10-27T22:07:47.461742] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-27T22:07:47.473723] [INFO ] [MAIN ] DE: Generated 138 derivative records from 47383 primary records. [2025-10-27T22:07:47.473918] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-27T22:07:47.474917] [DEBUG] [LOCAL ] DEC: Loaded 29884 existing records from primary storage. [2025-10-27T22:07:47.475984] [INFO ] [MAIN ] DEC: Loaded 29884 primary data records. [2025-10-27T22:07:47.516258] [DEBUG] [LOCAL ] DE: Derivative data saved (138 records). [2025-10-27T22:07:47.525245] [DEBUG] [LOCAL ] DEA: Derivative data saved (138 records). [2025-10-27T22:07:47.538349] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-27T22:07:47.530494] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-27T22:07:47.555565] [INFO ] [MAIN ] Derivative Progress: 467/1881 symbols completed. DE took 1.2s. Estimated remaining: 9m 33s. Rate: 148.1 symbols/min [2025-10-27T22:07:47.555772] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:47.563332] [INFO ] [MAIN ] Derivative Progress: 468/1881 symbols completed. DEA took 1.2s. Estimated remaining: 9m 31s. Rate: 148.4 symbols/min [2025-10-27T22:07:47.589120] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:47.891703] [DEBUG] [LOCAL ] DEI: Loaded 48162 existing records from primary storage. [2025-10-27T22:07:47.891961] [INFO ] [MAIN ] DEI: Loaded 48162 primary data records. [2025-10-27T22:07:47.992293] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-27T22:07:48.008475] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-27T22:07:48.371561] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:48.585016] [INFO ] [MAIN ] DEC: Generated 138 derivative records from 29884 primary records. [2025-10-27T22:07:48.585442] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-27T22:07:48.598470] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:48.624300] [DEBUG] [LOCAL ] DEC: Derivative data saved (138 records). [2025-10-27T22:07:48.624441] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-27T22:07:48.627185] [INFO ] [MAIN ] Derivative Progress: 469/1881 symbols completed. DEC took 1.2s. Estimated remaining: 9m 33s. Rate: 147.9 symbols/min [2025-10-27T22:07:48.628008] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:48.645445] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:48.695768] [INFO ] [MAIN ] DEI: Generated 138 derivative records from 48162 primary records. [2025-10-27T22:07:48.697282] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-27T22:07:48.713824] [INFO ] [MAIN ] DELL: Generated 138 derivative records from 53736 primary records. [2025-10-27T22:07:48.714501] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-27T22:07:48.716483] [DEBUG] [LOCAL ] DEI: Derivative data saved (138 records). [2025-10-27T22:07:48.729710] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-27T22:07:48.742547] [INFO ] [MAIN ] Derivative Progress: 470/1881 symbols completed. DEI took 1.2s. Estimated remaining: 9m 32s. Rate: 148.1 symbols/min [2025-10-27T22:07:48.739070] [DEBUG] [LOCAL ] DEO: Loaded 49158 existing records from primary storage. [2025-10-27T22:07:48.743522] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:48.743682] [INFO ] [MAIN ] DEO: Loaded 49158 primary data records. [2025-10-27T22:07:48.744538] [DEBUG] [LOCAL ] DELL: Derivative data saved (138 records). [2025-10-27T22:07:48.764755] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-27T22:07:48.786270] [INFO ] [MAIN ] Derivative Progress: 471/1881 symbols completed. DELL took 1.2s. Estimated remaining: 9m 30s. Rate: 148.4 symbols/min [2025-10-27T22:07:48.806334] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:49.069815] [DEBUG] [LOCAL ] DFIN: Loaded 22124 existing records from primary storage. [2025-10-27T22:07:49.070158] [INFO ] [MAIN ] DFIN: Loaded 22124 primary data records. [2025-10-27T22:07:49.092442] [DEBUG] [LOCAL ] DFH: Loaded 31185 existing records from primary storage. [2025-10-27T22:07:49.116004] [INFO ] [MAIN ] DFH: Loaded 31185 primary data records. [2025-10-27T22:07:49.705118] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:49.764574] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:49.808917] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:49.842323] [INFO ] [MAIN ] DEO: Generated 138 derivative records from 49158 primary records. [2025-10-27T22:07:49.844180] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-27T22:07:49.877303] [DEBUG] [LOCAL ] DEO: Derivative data saved (138 records). [2025-10-27T22:07:49.879119] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-27T22:07:49.884949] [INFO ] [MAIN ] Derivative Progress: 472/1881 symbols completed. DEO took 1.3s. Estimated remaining: 9m 32s. Rate: 147.8 symbols/min [2025-10-27T22:07:49.893883] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:49.915867] [INFO ] [MAIN ] DFH: Generated 138 derivative records from 31185 primary records. [2025-10-27T22:07:49.916361] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-27T22:07:49.921117] [INFO ] [MAIN ] DFIN: Generated 138 derivative records from 22124 primary records. [2025-10-27T22:07:49.939709] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-27T22:07:49.946985] [DEBUG] [LOCAL ] DFP: Loaded 10752 existing records from primary storage. [2025-10-27T22:07:49.948387] [DEBUG] [LOCAL ] DFH: Derivative data saved (138 records). [2025-10-27T22:07:49.960551] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-27T22:07:49.948839] [INFO ] [MAIN ] DFP: Loaded 10752 primary data records. [2025-10-27T22:07:49.966329] [INFO ] [MAIN ] Derivative Progress: 473/1881 symbols completed. DFH took 1.2s. Estimated remaining: 9m 31s. Rate: 148.1 symbols/min [2025-10-27T22:07:49.971365] [DEBUG] [LOCAL ] DFIN: Derivative data saved (138 records). [2025-10-27T22:07:49.971594] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-27T22:07:49.967787] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:49.993138] [INFO ] [MAIN ] Derivative Progress: 474/1881 symbols completed. DFIN took 1.2s. Estimated remaining: 9m 29s. Rate: 148.4 symbols/min [2025-10-27T22:07:50.019968] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:50.448943] [DEBUG] [LOCAL ] DG: Loaded 53220 existing records from primary storage. [2025-10-27T22:07:50.461454] [INFO ] [MAIN ] DG: Loaded 53220 primary data records. [2025-10-27T22:07:50.462168] [DEBUG] [LOCAL ] DGX: Loaded 44445 existing records from primary storage. [2025-10-27T22:07:50.462386] [INFO ] [MAIN ] DGX: Loaded 44445 primary data records. [2025-10-27T22:07:51.134126] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:51.194588] [INFO ] [MAIN ] DFP: Generated 138 derivative records from 10752 primary records. [2025-10-27T22:07:51.213890] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-27T22:07:51.214911] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:51.215917] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:51.255889] [DEBUG] [LOCAL ] DFP: Derivative data saved (138 records). [2025-10-27T22:07:51.256241] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-27T22:07:51.260024] [INFO ] [MAIN ] Derivative Progress: 475/1881 symbols completed. DFP took 1.4s. Estimated remaining: 9m 31s. Rate: 147.7 symbols/min [2025-10-27T22:07:51.260333] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:51.296320] [DEBUG] [LOCAL ] DHF: Loaded 20579 existing records from primary storage. [2025-10-27T22:07:51.296741] [INFO ] [MAIN ] DHF: Loaded 20579 primary data records. [2025-10-27T22:07:51.423391] [INFO ] [MAIN ] DG: Generated 138 derivative records from 53220 primary records. [2025-10-27T22:07:51.434133] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-27T22:07:51.492856] [INFO ] [MAIN ] DGX: Generated 138 derivative records from 44445 primary records. [2025-10-27T22:07:51.498104] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-27T22:07:51.636416] [DEBUG] [LOCAL ] DGX: Derivative data saved (138 records). [2025-10-27T22:07:51.637674] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-27T22:07:51.640893] [INFO ] [MAIN ] Derivative Progress: 476/1881 symbols completed. DGX took 1.6s. Estimated remaining: 9m 31s. Rate: 147.7 symbols/min [2025-10-27T22:07:51.641047] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:51.644534] [DEBUG] [LOCAL ] DG: Derivative data saved (138 records). [2025-10-27T22:07:51.645626] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-27T22:07:51.647739] [INFO ] [MAIN ] Derivative Progress: 477/1881 symbols completed. DG took 1.7s. Estimated remaining: 9m 29s. Rate: 148.0 symbols/min [2025-10-27T22:07:51.648609] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:51.672826] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:51.743439] [INFO ] [MAIN ] DHF: Generated 138 derivative records from 20579 primary records. [2025-10-27T22:07:51.758920] [DEBUG] [LOCAL ] DHT: Loaded 47756 existing records from primary storage. [2025-10-27T22:07:51.759268] [INFO ] [MAIN ] DHT: Loaded 47756 primary data records. [2025-10-27T22:07:51.759157] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-27T22:07:51.760434] [DEBUG] [LOCAL ] DHR: Loaded 53369 existing records from primary storage. [2025-10-27T22:07:51.796748] [INFO ] [MAIN ] DHR: Loaded 53369 primary data records. [2025-10-27T22:07:51.879463] [DEBUG] [LOCAL ] DHF: Derivative data saved (138 records). [2025-10-27T22:07:51.914778] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-27T22:07:51.936614] [INFO ] [MAIN ] Derivative Progress: 478/1881 symbols completed. DHF took 0.7s. Estimated remaining: 9m 28s. Rate: 148.1 symbols/min [2025-10-27T22:07:52.411752] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:52.411437] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:52.469472] [INFO ] [MAIN ] DHT: Generated 138 derivative records from 47756 primary records. [2025-10-27T22:07:52.470601] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-27T22:07:52.481614] [INFO ] [MAIN ] DHR: Generated 138 derivative records from 53369 primary records. [2025-10-27T22:07:52.484317] [DEBUG] [LOCAL ] DHT: Derivative data saved (138 records). [2025-10-27T22:07:52.484373] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-27T22:07:52.484913] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-27T22:07:52.487070] [INFO ] [MAIN ] Derivative Progress: 479/1881 symbols completed. DHT took 0.8s. Estimated remaining: 9m 28s. Rate: 148.0 symbols/min [2025-10-27T22:07:52.498681] [DEBUG] [LOCAL ] DHR: Derivative data saved (138 records). [2025-10-27T22:07:52.498746] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-27T22:07:52.501273] [INFO ] [MAIN ] Derivative Progress: 480/1881 symbols completed. DHR took 0.9s. Estimated remaining: 9m 27s. Rate: 148.3 symbols/min [2025-10-27T22:07:52.501788] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:52.501734] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:52.501688] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:52.517586] [DEBUG] [LOCAL ] DHX: Loaded 13037 existing records from primary storage. [2025-10-27T22:07:52.517871] [INFO ] [MAIN ] DHX: Loaded 13037 primary data records. [2025-10-27T22:07:52.735047] [DEBUG] [LOCAL ] DIN: Loaded 36358 existing records from primary storage. [2025-10-27T22:07:52.757761] [INFO ] [MAIN ] DIN: Loaded 36358 primary data records. [2025-10-27T22:07:52.966344] [DEBUG] [LOCAL ] DINO: Loaded 52788 existing records from primary storage. [2025-10-27T22:07:53.013635] [INFO ] [MAIN ] DINO: Loaded 52788 primary data records. [2025-10-27T22:07:53.601509] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:53.671815] [INFO ] [MAIN ] DHX: Generated 138 derivative records from 13037 primary records. [2025-10-27T22:07:53.684545] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-27T22:07:53.684390] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:53.714163] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:53.743815] [DEBUG] [LOCAL ] DHX: Derivative data saved (138 records). [2025-10-27T22:07:53.744960] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-27T22:07:53.748551] [INFO ] [MAIN ] Derivative Progress: 481/1881 symbols completed. DHX took 1.2s. Estimated remaining: 9m 29s. Rate: 147.7 symbols/min [2025-10-27T22:07:53.754910] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:53.823502] [INFO ] [MAIN ] DINO: Generated 138 derivative records from 52788 primary records. [2025-10-27T22:07:53.824208] [INFO ] [MAIN ] DIN: Generated 138 derivative records from 36358 primary records. [2025-10-27T22:07:53.824340] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-27T22:07:53.824575] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-27T22:07:53.850285] [DEBUG] [LOCAL ] DIN: Derivative data saved (138 records). [2025-10-27T22:07:53.857544] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-27T22:07:53.859619] [INFO ] [MAIN ] Derivative Progress: 482/1881 symbols completed. DIN took 1.4s. Estimated remaining: 9m 28s. Rate: 147.9 symbols/min [2025-10-27T22:07:53.857387] [DEBUG] [LOCAL ] DINO: Derivative data saved (138 records). [2025-10-27T22:07:53.879720] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-27T22:07:53.880889] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-27T22:07:53.879584] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:53.886097] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-27T22:07:53.885938] [INFO ] [MAIN ] Derivative Progress: 483/1881 symbols completed. DINO took 1.4s. Estimated remaining: 9m 26s. Rate: 148.2 symbols/min [2025-10-27T22:07:53.917294] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:54.214548] [DEBUG] [LOCAL ] DK: Loaded 49105 existing records from primary storage. [2025-10-27T22:07:54.224000] [INFO ] [MAIN ] DK: Loaded 49105 primary data records. [2025-10-27T22:07:54.355185] [DEBUG] [LOCAL ] DKS: Loaded 49014 existing records from primary storage. [2025-10-27T22:07:54.366014] [INFO ] [MAIN ] DKS: Loaded 49014 primary data records. [2025-10-27T22:07:54.890546] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:54.958326] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:54.993142] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:54.987755] [INFO ] [MAIN ] DIS: Generated 138 derivative records from 53788 primary records. [2025-10-27T22:07:54.993351] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-27T22:07:55.026482] [DEBUG] [LOCAL ] DIS: Derivative data saved (138 records). [2025-10-27T22:07:55.028531] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-27T22:07:55.034986] [INFO ] [MAIN ] Derivative Progress: 484/1881 symbols completed. DIS took 1.3s. Estimated remaining: 9m 28s. Rate: 147.6 symbols/min [2025-10-27T22:07:55.037941] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:55.079215] [INFO ] [MAIN ] DK: Generated 138 derivative records from 49105 primary records. [2025-10-27T22:07:55.081734] [INFO ] [MAIN ] DKS: Generated 138 derivative records from 49014 primary records. [2025-10-27T22:07:55.081944] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-27T22:07:55.082017] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-27T22:07:55.114781] [DEBUG] [LOCAL ] DLB: Loaded 32098 existing records from primary storage. [2025-10-27T22:07:55.121817] [DEBUG] [LOCAL ] DK: Derivative data saved (138 records). [2025-10-27T22:07:55.118727] [INFO ] [MAIN ] DLB: Loaded 32098 primary data records. [2025-10-27T22:07:55.122197] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-27T22:07:55.126375] [DEBUG] [LOCAL ] DKS: Derivative data saved (138 records). [2025-10-27T22:07:55.126476] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-27T22:07:55.125832] [INFO ] [MAIN ] Derivative Progress: 485/1881 symbols completed. DK took 1.2s. Estimated remaining: 9m 27s. Rate: 147.9 symbols/min [2025-10-27T22:07:55.174736] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:55.186407] [INFO ] [MAIN ] Derivative Progress: 486/1881 symbols completed. DKS took 1.2s. Estimated remaining: 9m 25s. Rate: 148.1 symbols/min [2025-10-27T22:07:55.207184] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:55.262494] [DEBUG] [LOCAL ] DLNG: Loaded 5896 existing records from primary storage. [2025-10-27T22:07:55.289124] [INFO ] [MAIN ] DLNG: Loaded 5896 primary data records. [2025-10-27T22:07:55.727789] [DEBUG] [LOCAL ] DLR: Loaded 50574 existing records from primary storage. [2025-10-27T22:07:55.763315] [INFO ] [MAIN ] DLR: Loaded 50574 primary data records. [2025-10-27T22:07:56.109603] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:56.151566] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:56.209101] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:56.227585] [INFO ] [MAIN ] DLB: Generated 138 derivative records from 32098 primary records. [2025-10-27T22:07:56.230792] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-27T22:07:56.253428] [DEBUG] [LOCAL ] DLB: Derivative data saved (138 records). [2025-10-27T22:07:56.255218] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-27T22:07:56.258015] [INFO ] [MAIN ] Derivative Progress: 487/1881 symbols completed. DLB took 1.2s. Estimated remaining: 9m 27s. Rate: 147.6 symbols/min [2025-10-27T22:07:56.258602] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:56.266830] [INFO ] [MAIN ] DLNG: Generated 138 derivative records from 5896 primary records. [2025-10-27T22:07:56.267156] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-27T22:07:56.283016] [DEBUG] [LOCAL ] DLNG: Derivative data saved (138 records). [2025-10-27T22:07:56.283412] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-27T22:07:56.285481] [INFO ] [MAIN ] Derivative Progress: 488/1881 symbols completed. DLNG took 1.1s. Estimated remaining: 9m 25s. Rate: 147.9 symbols/min [2025-10-27T22:07:56.292271] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:56.300581] [INFO ] [MAIN ] DLR: Generated 138 derivative records from 50574 primary records. [2025-10-27T22:07:56.300896] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-27T22:07:56.311116] [DEBUG] [LOCAL ] DMA: Loaded 4689 existing records from primary storage. [2025-10-27T22:07:56.320309] [DEBUG] [LOCAL ] DLY: Loaded 20602 existing records from primary storage. [2025-10-27T22:07:56.311636] [INFO ] [MAIN ] DMA: Loaded 4689 primary data records. [2025-10-27T22:07:56.343301] [INFO ] [MAIN ] DLY: Loaded 20602 primary data records. [2025-10-27T22:07:56.346392] [DEBUG] [LOCAL ] DLR: Derivative data saved (138 records). [2025-10-27T22:07:56.382245] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-27T22:07:56.402660] [INFO ] [MAIN ] Derivative Progress: 489/1881 symbols completed. DLR took 1.2s. Estimated remaining: 9m 24s. Rate: 148.1 symbols/min [2025-10-27T22:07:56.438489] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:56.672356] [DEBUG] [LOCAL ] DMB: Loaded 10487 existing records from primary storage. [2025-10-27T22:07:56.678073] [INFO ] [MAIN ] DMB: Loaded 10487 primary data records. [2025-10-27T22:07:57.341399] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:57.354621] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-27T22:07:57.404436] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:57.453547] [INFO ] [MAIN ] DLY: Generated 138 derivative records from 20602 primary records. [2025-10-27T22:07:57.454177] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-27T22:07:57.455962] [INFO ] [MAIN ] DMA: Generated 138 derivative records from 4689 primary records. [2025-10-27T22:07:57.456212] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-27T22:07:57.485754] [DEBUG] [LOCAL ] DMA: Derivative data saved (138 records). [2025-10-27T22:07:57.485924] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-27T22:07:57.483303] [DEBUG] [LOCAL ] DLY: Derivative data saved (138 records). [2025-10-27T22:07:57.487878] [INFO ] [MAIN ] Derivative Progress: 490/1881 symbols completed. DMA took 1.2s. Estimated remaining: 9m 25s. Rate: 147.6 symbols/min [2025-10-27T22:07:57.488224] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-27T22:07:57.488127] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:57.493270] [INFO ] [MAIN ] Derivative Progress: 491/1881 symbols completed. DLY took 1.2s. Estimated remaining: 9m 24s. Rate: 147.9 symbols/min [2025-10-27T22:07:57.493905] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:57.498762] [INFO ] [MAIN ] DMB: Generated 138 derivative records from 10487 primary records. [2025-10-27T22:07:57.498966] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-27T22:07:57.513252] [DEBUG] [LOCAL ] DMB: Derivative data saved (138 records). [2025-10-27T22:07:57.513430] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-27T22:07:57.516033] [INFO ] [MAIN ] Derivative Progress: 492/1881 symbols completed. DMB took 1.1s. Estimated remaining: 9m 22s. Rate: 148.2 symbols/min [2025-10-27T22:07:57.516344] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:57.524132] [DEBUG] [LOCAL ] DMO: Loaded 9505 existing records from primary storage. [2025-10-27T22:07:57.524410] [INFO ] [MAIN ] DMO: Loaded 9505 primary data records. [2025-10-27T22:07:57.855133] [DEBUG] [LOCAL ] DNA: Loaded 48413 existing records from primary storage. [2025-10-27T22:07:57.853883] [DEBUG] [LOCAL ] DNP: Loaded 32861 existing records from primary storage. [2025-10-27T22:07:57.855435] [INFO ] [MAIN ] DNA: Loaded 48413 primary data records. [2025-10-27T22:07:57.855619] [INFO ] [MAIN ] DNP: Loaded 32861 primary data records. [2025-10-27T22:07:58.502895] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:58.555269] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:58.575663] [INFO ] [MAIN ] DMO: Generated 138 derivative records from 9505 primary records. [2025-10-27T22:07:58.576283] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-27T22:07:58.604784] [DEBUG] [LOCAL ] DMO: Derivative data saved (138 records). [2025-10-27T22:07:58.604894] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-27T22:07:58.605454] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:58.607953] [INFO ] [MAIN ] Derivative Progress: 493/1881 symbols completed. DMO took 1.1s. Estimated remaining: 9m 24s. Rate: 147.7 symbols/min [2025-10-27T22:07:58.646970] [INFO ] [MAIN ] DNA: Generated 138 derivative records from 48413 primary records. [2025-10-27T22:07:58.649120] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-27T22:07:58.663523] [INFO ] [MAIN ] DNP: Generated 138 derivative records from 32861 primary records. [2025-10-27T22:07:58.663821] [DEBUG] [LOCAL ] DNA: Derivative data saved (138 records). [2025-10-27T22:07:58.663925] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-27T22:07:58.663998] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-27T22:07:58.666317] [INFO ] [MAIN ] Derivative Progress: 494/1881 symbols completed. DNA took 1.2s. Estimated remaining: 9m 23s. Rate: 147.9 symbols/min [2025-10-27T22:07:58.677447] [DEBUG] [LOCAL ] DNP: Derivative data saved (138 records). [2025-10-27T22:07:58.677504] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-27T22:07:58.679856] [INFO ] [MAIN ] Derivative Progress: 495/1881 symbols completed. DNP took 1.2s. Estimated remaining: 9m 21s. Rate: 148.2 symbols/min [2025-10-27T22:07:58.680314] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:58.680260] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:58.680415] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:58.763597] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-27T22:07:58.777393] [INFO ] [MAIN ] DOC: Loaded 53554 primary data records. [2025-10-27T22:07:58.789222] [DEBUG] [LOCAL ] DOCS: Loaded 50150 existing records from primary storage. [2025-10-27T22:07:58.809136] [INFO ] [MAIN ] DOCS: Loaded 50150 primary data records. [2025-10-27T22:07:58.799049] [DEBUG] [LOCAL ] DOCN: Loaded 51095 existing records from primary storage. [2025-10-27T22:07:58.844580] [INFO ] [MAIN ] DOCN: Loaded 51095 primary data records. [2025-10-27T22:07:59.726371] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:59.757139] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:59.786549] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:07:59.850377] [INFO ] [MAIN ] DOC: Generated 138 derivative records from 53554 primary records. [2025-10-27T22:07:59.851929] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-27T22:07:59.864042] [INFO ] [MAIN ] DOCN: Generated 138 derivative records from 51095 primary records. [2025-10-27T22:07:59.868503] [DEBUG] [LOCAL ] DOC: Derivative data saved (138 records). [2025-10-27T22:07:59.868732] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-27T22:07:59.870406] [INFO ] [MAIN ] Derivative Progress: 496/1881 symbols completed. DOC took 1.2s. Estimated remaining: 9m 23s. Rate: 147.6 symbols/min [2025-10-27T22:07:59.870534] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:59.866878] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-27T22:07:59.883618] [INFO ] [MAIN ] DOCS: Generated 138 derivative records from 50150 primary records. [2025-10-27T22:07:59.886999] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-27T22:07:59.888394] [DEBUG] [LOCAL ] DOCN: Derivative data saved (138 records). [2025-10-27T22:07:59.888583] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-27T22:07:59.892053] [INFO ] [MAIN ] Derivative Progress: 497/1881 symbols completed. DOCN took 1.2s. Estimated remaining: 9m 21s. Rate: 147.9 symbols/min [2025-10-27T22:07:59.892536] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:59.912516] [DEBUG] [LOCAL ] DOCS: Derivative data saved (138 records). [2025-10-27T22:07:59.912804] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-27T22:07:59.916624] [INFO ] [MAIN ] Derivative Progress: 498/1881 symbols completed. DOCS took 1.2s. Estimated remaining: 9m 20s. Rate: 148.2 symbols/min [2025-10-27T22:07:59.917094] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:07:59.930432] [DEBUG] [LOCAL ] DOUG: Loaded 33433 existing records from primary storage. [2025-10-27T22:07:59.930554] [INFO ] [MAIN ] DOUG: Loaded 33433 primary data records. [2025-10-27T22:08:00.038902] [DEBUG] [LOCAL ] DPG: Loaded 13105 existing records from primary storage. [2025-10-27T22:08:00.042334] [INFO ] [MAIN ] DPG: Loaded 13105 primary data records. [2025-10-27T22:08:00.550780] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-27T22:08:00.564236] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-27T22:08:00.938056] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:00.985454] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:01.033638] [INFO ] [MAIN ] DOUG: Generated 138 derivative records from 33433 primary records. [2025-10-27T22:08:01.046988] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-27T22:08:01.048498] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:01.065872] [DEBUG] [LOCAL ] DOUG: Derivative data saved (138 records). [2025-10-27T22:08:01.066159] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-27T22:08:01.068718] [INFO ] [MAIN ] Derivative Progress: 499/1881 symbols completed. DOUG took 1.2s. Estimated remaining: 9m 22s. Rate: 147.7 symbols/min [2025-10-27T22:08:01.081349] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:01.093611] [INFO ] [MAIN ] DPG: Generated 138 derivative records from 13105 primary records. [2025-10-27T22:08:01.094215] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-27T22:08:01.110605] [DEBUG] [LOCAL ] DPG: Derivative data saved (138 records). [2025-10-27T22:08:01.110827] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-27T22:08:01.113334] [INFO ] [MAIN ] Derivative Progress: 500/1881 symbols completed. DPG took 1.2s. Estimated remaining: 9m 20s. Rate: 147.9 symbols/min [2025-10-27T22:08:01.113589] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:01.138227] [INFO ] [MAIN ] DOW: Generated 138 derivative records from 53733 primary records. [2025-10-27T22:08:01.138439] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-27T22:08:01.155237] [DEBUG] [LOCAL ] DOW: Derivative data saved (138 records). [2025-10-27T22:08:01.172222] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-27T22:08:01.186366] [INFO ] [MAIN ] Derivative Progress: 501/1881 symbols completed. DOW took 1.3s. Estimated remaining: 9m 19s. Rate: 148.2 symbols/min [2025-10-27T22:08:01.186769] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:01.188737] [DEBUG] [LOCAL ] DQ: Loaded 43643 existing records from primary storage. [2025-10-27T22:08:01.189425] [INFO ] [MAIN ] DQ: Loaded 43643 primary data records. [2025-10-27T22:08:01.301355] [DEBUG] [LOCAL ] DRD: Loaded 37947 existing records from primary storage. [2025-10-27T22:08:01.301727] [INFO ] [MAIN ] DRD: Loaded 37947 primary data records. [2025-10-27T22:08:01.727777] [DEBUG] [LOCAL ] DRH: Loaded 50096 existing records from primary storage. [2025-10-27T22:08:01.728817] [INFO ] [MAIN ] DRH: Loaded 50096 primary data records. [2025-10-27T22:08:02.181582] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:02.223112] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:02.265482] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:02.289354] [INFO ] [MAIN ] DQ: Generated 138 derivative records from 43643 primary records. [2025-10-27T22:08:02.292262] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-27T22:08:02.312068] [DEBUG] [LOCAL ] DQ: Derivative data saved (138 records). [2025-10-27T22:08:02.312709] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-27T22:08:02.314667] [INFO ] [MAIN ] Derivative Progress: 502/1881 symbols completed. DQ took 1.2s. Estimated remaining: 9m 20s. Rate: 147.6 symbols/min [2025-10-27T22:08:02.314879] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:02.330230] [INFO ] [MAIN ] DRD: Generated 138 derivative records from 37947 primary records. [2025-10-27T22:08:02.333046] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-27T22:08:02.333802] [INFO ] [MAIN ] DRH: Generated 138 derivative records from 50096 primary records. [2025-10-27T22:08:02.334188] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-27T22:08:02.357975] [DEBUG] [LOCAL ] DRD: Derivative data saved (138 records). [2025-10-27T22:08:02.357682] [DEBUG] [LOCAL ] DRH: Derivative data saved (138 records). [2025-10-27T22:08:02.367415] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-27T22:08:02.370976] [INFO ] [MAIN ] Derivative Progress: 503/1881 symbols completed. DRH took 1.2s. Estimated remaining: 9m 19s. Rate: 147.9 symbols/min [2025-10-27T22:08:02.367528] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-27T22:08:02.371237] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:02.373440] [INFO ] [MAIN ] Derivative Progress: 504/1881 symbols completed. DRD took 1.3s. Estimated remaining: 9m 18s. Rate: 148.2 symbols/min [2025-10-27T22:08:02.374074] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:02.394120] [DEBUG] [LOCAL ] DRI: Loaded 47373 existing records from primary storage. [2025-10-27T22:08:02.397820] [INFO ] [MAIN ] DRI: Loaded 47373 primary data records. [2025-10-27T22:08:02.398127] [DEBUG] [LOCAL ] DRLL: Loaded 8444 existing records from primary storage. [2025-10-27T22:08:02.398242] [INFO ] [MAIN ] DRLL: Loaded 8444 primary data records. [2025-10-27T22:08:02.610001] [DEBUG] [LOCAL ] DSL: Loaded 28643 existing records from primary storage. [2025-10-27T22:08:02.631449] [INFO ] [MAIN ] DSL: Loaded 28643 primary data records. [2025-10-27T22:08:03.432410] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:03.472330] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:03.512180] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:03.563390] [INFO ] [MAIN ] DRI: Generated 138 derivative records from 47373 primary records. [2025-10-27T22:08:03.566416] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-27T22:08:03.585740] [DEBUG] [LOCAL ] DRI: Derivative data saved (138 records). [2025-10-27T22:08:03.586182] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-27T22:08:03.589203] [INFO ] [MAIN ] Derivative Progress: 505/1881 symbols completed. DRI took 1.3s. Estimated remaining: 9m 19s. Rate: 147.6 symbols/min [2025-10-27T22:08:03.589777] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:03.598120] [DEBUG] [LOCAL ] DSMC: Loaded 1704 existing records from primary storage. [2025-10-27T22:08:03.598332] [INFO ] [MAIN ] DSMC: Loaded 1704 primary data records. [2025-10-27T22:08:03.620806] [INFO ] [MAIN ] DRLL: Generated 138 derivative records from 8444 primary records. [2025-10-27T22:08:03.637566] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-27T22:08:03.696867] [INFO ] [MAIN ] DSL: Generated 138 derivative records from 28643 primary records. [2025-10-27T22:08:03.705203] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-27T22:08:03.724405] [DEBUG] [LOCAL ] DRLL: Derivative data saved (138 records). [2025-10-27T22:08:03.729346] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-27T22:08:03.751502] [INFO ] [MAIN ] Derivative Progress: 506/1881 symbols completed. DRLL took 1.4s. Estimated remaining: 9m 18s. Rate: 147.8 symbols/min [2025-10-27T22:08:03.757171] [DEBUG] [LOCAL ] DSL: Derivative data saved (138 records). [2025-10-27T22:08:03.772771] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-27T22:08:03.757277] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:03.826902] [INFO ] [MAIN ] Derivative Progress: 507/1881 symbols completed. DSL took 1.5s. Estimated remaining: 9m 17s. Rate: 148.0 symbols/min [2025-10-27T22:08:03.833017] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:03.976362] [DEBUG] [LOCAL ] DSX: Loaded 23205 existing records from primary storage. [2025-10-27T22:08:03.977095] [INFO ] [MAIN ] DSX: Loaded 23205 primary data records. [2025-10-27T22:08:04.308329] [DEBUG] [LOCAL ] DT: Loaded 52910 existing records from primary storage. [2025-10-27T22:08:04.321550] [INFO ] [MAIN ] DT: Loaded 52910 primary data records. [2025-10-27T22:08:04.322224] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:08:04.703177] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:04.719039] [INFO ] [MAIN ] DSMC: Generated 138 derivative records from 1704 primary records. [2025-10-27T22:08:04.719249] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-27T22:08:04.734024] [DEBUG] [LOCAL ] DSMC: Derivative data saved (138 records). [2025-10-27T22:08:04.734218] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-27T22:08:04.736373] [INFO ] [MAIN ] Derivative Progress: 508/1881 symbols completed. DSMC took 1.1s. Estimated remaining: 9m 18s. Rate: 147.7 symbols/min [2025-10-27T22:08:04.774785] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:04.778871] [INFO ] [MAIN ] DSX: Generated 138 derivative records from 23205 primary records. [2025-10-27T22:08:04.792404] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-27T22:08:04.812049] [DEBUG] [LOCAL ] DSX: Derivative data saved (138 records). [2025-10-27T22:08:04.815311] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-27T22:08:04.818084] [INFO ] [MAIN ] Derivative Progress: 509/1881 symbols completed. DSX took 1.1s. Estimated remaining: 9m 17s. Rate: 147.9 symbols/min [2025-10-27T22:08:04.830442] [INFO ] [MAIN ] DT: Generated 138 derivative records from 52910 primary records. [2025-10-27T22:08:04.830703] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-27T22:08:04.843495] [DEBUG] [LOCAL ] DT: Derivative data saved (138 records). [2025-10-27T22:08:04.843587] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-27T22:08:04.848107] [INFO ] [MAIN ] Derivative Progress: 510/1881 symbols completed. DT took 1.0s. Estimated remaining: 9m 15s. Rate: 148.2 symbols/min [2025-10-27T22:08:04.848851] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:04.848749] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:04.849167] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:04.860668] [DEBUG] [LOCAL ] DTG: Loaded 5634 existing records from primary storage. [2025-10-27T22:08:04.861007] [INFO ] [MAIN ] DTG: Loaded 5634 primary data records. [2025-10-27T22:08:05.214953] [DEBUG] [LOCAL ] DTM: Loaded 43642 existing records from primary storage. [2025-10-27T22:08:05.215734] [INFO ] [MAIN ] DTM: Loaded 43642 primary data records. [2025-10-27T22:08:05.216457] [DEBUG] [LOCAL ] DTE: Loaded 46946 existing records from primary storage. [2025-10-27T22:08:05.216744] [INFO ] [MAIN ] DTE: Loaded 46946 primary data records. [2025-10-27T22:08:05.893825] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:05.935424] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:05.974720] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:06.011278] [INFO ] [MAIN ] DTG: Generated 138 derivative records from 5634 primary records. [2025-10-27T22:08:06.011762] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-27T22:08:06.034292] [DEBUG] [LOCAL ] DTG: Derivative data saved (138 records). [2025-10-27T22:08:06.034413] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-27T22:08:06.037530] [INFO ] [MAIN ] Derivative Progress: 511/1881 symbols completed. DTG took 1.2s. Estimated remaining: 9m 17s. Rate: 147.6 symbols/min [2025-10-27T22:08:06.038928] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:06.054382] [INFO ] [MAIN ] DTM: Generated 138 derivative records from 43642 primary records. [2025-10-27T22:08:06.054067] [DEBUG] [LOCAL ] DTW: Loaded 4638 existing records from primary storage. [2025-10-27T22:08:06.054526] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-27T22:08:06.054705] [INFO ] [MAIN ] DTW: Loaded 4638 primary data records. [2025-10-27T22:08:06.084318] [INFO ] [MAIN ] DTE: Generated 138 derivative records from 46946 primary records. [2025-10-27T22:08:06.101572] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-27T22:08:06.123893] [DEBUG] [LOCAL ] DTM: Derivative data saved (138 records). [2025-10-27T22:08:06.137887] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-27T22:08:06.158304] [INFO ] [MAIN ] Derivative Progress: 512/1881 symbols completed. DTM took 1.3s. Estimated remaining: 9m 16s. Rate: 147.8 symbols/min [2025-10-27T22:08:06.183552] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:06.183620] [DEBUG] [LOCAL ] DTE: Derivative data saved (138 records). [2025-10-27T22:08:06.184176] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-27T22:08:06.192601] [INFO ] [MAIN ] Derivative Progress: 513/1881 symbols completed. DTE took 1.3s. Estimated remaining: 9m 14s. Rate: 148.1 symbols/min [2025-10-27T22:08:06.226170] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:06.442279] [DEBUG] [LOCAL ] DV: Loaded 51235 existing records from primary storage. [2025-10-27T22:08:06.445253] [INFO ] [MAIN ] DV: Loaded 51235 primary data records. [2025-10-27T22:08:06.515908] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-27T22:08:06.537070] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:06.542353] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-10-27T22:08:07.155411] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:07.155936] [INFO ] [MAIN ] DTW: Generated 138 derivative records from 4638 primary records. [2025-10-27T22:08:07.169056] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-27T22:08:07.191041] [DEBUG] [LOCAL ] DTW: Derivative data saved (138 records). [2025-10-27T22:08:07.195976] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-27T22:08:07.200768] [INFO ] [MAIN ] Derivative Progress: 514/1881 symbols completed. DTW took 1.2s. Estimated remaining: 9m 16s. Rate: 147.6 symbols/min [2025-10-27T22:08:07.201087] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:07.223339] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:07.251401] [INFO ] [MAIN ] DV: Generated 138 derivative records from 51235 primary records. [2025-10-27T22:08:07.251610] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-27T22:08:07.280550] [DEBUG] [LOCAL ] DV: Derivative data saved (138 records). [2025-10-27T22:08:07.281146] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-27T22:08:07.283246] [INFO ] [MAIN ] Derivative Progress: 515/1881 symbols completed. DV took 1.1s. Estimated remaining: 9m 14s. Rate: 147.9 symbols/min [2025-10-27T22:08:07.284919] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:07.312738] [DEBUG] [LOCAL ] DXC: Loaded 49831 existing records from primary storage. [2025-10-27T22:08:07.313162] [INFO ] [MAIN ] DXC: Loaded 49831 primary data records. [2025-10-27T22:08:07.315200] [INFO ] [MAIN ] DVN: Generated 138 derivative records from 53699 primary records. [2025-10-27T22:08:07.338956] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-10-27T22:08:07.439975] [DEBUG] [LOCAL ] DVN: Derivative data saved (138 records). [2025-10-27T22:08:07.470605] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-10-27T22:08:07.510471] [INFO ] [MAIN ] Derivative Progress: 516/1881 symbols completed. DVN took 1.3s. Estimated remaining: 9m 13s. Rate: 148.0 symbols/min [2025-10-27T22:08:07.522256] [DEBUG] [LOCAL ] DXYZ: Loaded 36706 existing records from primary storage. [2025-10-27T22:08:07.560911] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:07.563532] [INFO ] [MAIN ] DXYZ: Loaded 36706 primary data records. [2025-10-27T22:08:07.929872] [DEBUG] [LOCAL ] DY: Loaded 27690 existing records from primary storage. [2025-10-27T22:08:08.034913] [INFO ] [MAIN ] DY: Loaded 27690 primary data records. [2025-10-27T22:08:08.254545] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:08.427998] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:08.463132] [INFO ] [MAIN ] DXC: Generated 138 derivative records from 49831 primary records. [2025-10-27T22:08:08.463763] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-27T22:08:08.484191] [DEBUG] [LOCAL ] DXC: Derivative data saved (138 records). [2025-10-27T22:08:08.484737] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-27T22:08:08.487359] [INFO ] [MAIN ] Derivative Progress: 517/1881 symbols completed. DXC took 1.3s. Estimated remaining: 9m 15s. Rate: 147.6 symbols/min [2025-10-27T22:08:08.505567] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:08.505943] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:08.534837] [INFO ] [MAIN ] DXYZ: Generated 138 derivative records from 36706 primary records. [2025-10-27T22:08:08.535419] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-27T22:08:08.552978] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (138 records). [2025-10-27T22:08:08.553155] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-27T22:08:08.555438] [INFO ] [MAIN ] Derivative Progress: 518/1881 symbols completed. DXYZ took 1.3s. Estimated remaining: 9m 13s. Rate: 147.8 symbols/min [2025-10-27T22:08:08.556312] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:08.584241] [INFO ] [MAIN ] DY: Generated 138 derivative records from 27690 primary records. [2025-10-27T22:08:08.584440] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-27T22:08:08.610977] [DEBUG] [LOCAL ] E: Loaded 32833 existing records from primary storage. [2025-10-27T22:08:08.621961] [INFO ] [MAIN ] E: Loaded 32833 primary data records. [2025-10-27T22:08:08.622606] [DEBUG] [LOCAL ] DY: Derivative data saved (138 records). [2025-10-27T22:08:08.622803] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-27T22:08:08.637415] [INFO ] [MAIN ] Derivative Progress: 519/1881 symbols completed. DY took 1.1s. Estimated remaining: 9m 12s. Rate: 148.1 symbols/min [2025-10-27T22:08:08.647278] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:08.761269] [DEBUG] [LOCAL ] EAF: Loaded 40545 existing records from primary storage. [2025-10-27T22:08:08.769018] [DEBUG] [LOCAL ] EAI: Loaded 3807 existing records from primary storage. [2025-10-27T22:08:08.779705] [INFO ] [MAIN ] EAF: Loaded 40545 primary data records. [2025-10-27T22:08:08.797710] [INFO ] [MAIN ] EAI: Loaded 3807 primary data records. [2025-10-27T22:08:09.722970] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:09.764776] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:09.795824] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:09.845033] [INFO ] [MAIN ] E: Generated 138 derivative records from 32833 primary records. [2025-10-27T22:08:09.850914] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-27T22:08:09.871343] [DEBUG] [LOCAL ] E: Derivative data saved (138 records). [2025-10-27T22:08:09.871729] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-27T22:08:09.874104] [INFO ] [MAIN ] Derivative Progress: 520/1881 symbols completed. E took 1.4s. Estimated remaining: 9m 14s. Rate: 147.5 symbols/min [2025-10-27T22:08:09.876809] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:09.884590] [INFO ] [MAIN ] EAI: Generated 138 derivative records from 3807 primary records. [2025-10-27T22:08:09.886531] [INFO ] [MAIN ] EAF: Generated 138 derivative records from 40545 primary records. [2025-10-27T22:08:09.886622] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-27T22:08:09.886739] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-27T22:08:09.905579] [DEBUG] [LOCAL ] EAF: Derivative data saved (138 records). [2025-10-27T22:08:09.916466] [DEBUG] [LOCAL ] EAI: Derivative data saved (138 records). [2025-10-27T22:08:09.916740] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-27T22:08:09.918998] [INFO ] [MAIN ] Derivative Progress: 521/1881 symbols completed. EAI took 1.3s. Estimated remaining: 9m 12s. Rate: 147.7 symbols/min [2025-10-27T22:08:09.916572] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-27T22:08:09.919198] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:09.921901] [INFO ] [MAIN ] Derivative Progress: 522/1881 symbols completed. EAF took 1.4s. Estimated remaining: 9m 11s. Rate: 148.0 symbols/min [2025-10-27T22:08:09.922468] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:09.934557] [DEBUG] [LOCAL ] EARN: Loaded 27168 existing records from primary storage. [2025-10-27T22:08:09.934743] [INFO ] [MAIN ] EARN: Loaded 27168 primary data records. [2025-10-27T22:08:10.220788] [DEBUG] [LOCAL ] EB: Loaded 35786 existing records from primary storage. [2025-10-27T22:08:10.221079] [INFO ] [MAIN ] EB: Loaded 35786 primary data records. [2025-10-27T22:08:10.381824] [DEBUG] [LOCAL ] EAT: Loaded 49667 existing records from primary storage. [2025-10-27T22:08:10.392856] [INFO ] [MAIN ] EAT: Loaded 49667 primary data records. [2025-10-27T22:08:10.920599] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:10.956747] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:11.005066] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:11.055403] [INFO ] [MAIN ] EARN: Generated 138 derivative records from 27168 primary records. [2025-10-27T22:08:11.057249] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-27T22:08:11.062573] [INFO ] [MAIN ] EB: Generated 138 derivative records from 35786 primary records. [2025-10-27T22:08:11.063244] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-27T22:08:11.078384] [DEBUG] [LOCAL ] EARN: Derivative data saved (138 records). [2025-10-27T22:08:11.093808] [DEBUG] [LOCAL ] EB: Derivative data saved (138 records). [2025-10-27T22:08:11.094159] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-27T22:08:11.096144] [INFO ] [MAIN ] Derivative Progress: 523/1881 symbols completed. EB took 1.2s. Estimated remaining: 9m 13s. Rate: 147.5 symbols/min [2025-10-27T22:08:11.096312] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-27T22:08:11.099875] [INFO ] [MAIN ] Derivative Progress: 524/1881 symbols completed. EARN took 1.2s. Estimated remaining: 9m 11s. Rate: 147.7 symbols/min [2025-10-27T22:08:11.106150] [INFO ] [MAIN ] EAT: Generated 138 derivative records from 49667 primary records. [2025-10-27T22:08:11.106242] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-27T22:08:11.118117] [DEBUG] [LOCAL ] EAT: Derivative data saved (138 records). [2025-10-27T22:08:11.118177] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-27T22:08:11.120849] [INFO ] [MAIN ] Derivative Progress: 525/1881 symbols completed. EAT took 1.2s. Estimated remaining: 9m 10s. Rate: 148.0 symbols/min [2025-10-27T22:08:11.121346] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:11.121468] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:11.121565] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:11.142409] [DEBUG] [LOCAL ] EBF: Loaded 19197 existing records from primary storage. [2025-10-27T22:08:11.142533] [INFO ] [MAIN ] EBF: Loaded 19197 primary data records. [2025-10-27T22:08:11.348427] [DEBUG] [LOCAL ] EC: Loaded 48770 existing records from primary storage. [2025-10-27T22:08:11.389804] [DEBUG] [LOCAL ] EBS: Loaded 46495 existing records from primary storage. [2025-10-27T22:08:11.390210] [INFO ] [MAIN ] EC: Loaded 48770 primary data records. [2025-10-27T22:08:11.492859] [INFO ] [MAIN ] EBS: Loaded 46495 primary data records. [2025-10-27T22:08:12.195385] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:12.252630] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:12.271907] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:12.303152] [INFO ] [MAIN ] EBF: Generated 138 derivative records from 19197 primary records. [2025-10-27T22:08:12.304950] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-27T22:08:12.323393] [DEBUG] [LOCAL ] EBF: Derivative data saved (138 records). [2025-10-27T22:08:12.324267] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-27T22:08:12.326562] [INFO ] [MAIN ] Derivative Progress: 526/1881 symbols completed. EBF took 1.2s. Estimated remaining: 9m 11s. Rate: 147.5 symbols/min [2025-10-27T22:08:12.329375] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:12.344049] [INFO ] [MAIN ] EC: Generated 138 derivative records from 48770 primary records. [2025-10-27T22:08:12.346876] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-27T22:08:12.368140] [DEBUG] [LOCAL ] EC: Derivative data saved (138 records). [2025-10-27T22:08:12.368570] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-27T22:08:12.372331] [INFO ] [MAIN ] Derivative Progress: 527/1881 symbols completed. EC took 1.3s. Estimated remaining: 9m 10s. Rate: 147.7 symbols/min [2025-10-27T22:08:12.372563] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:12.373047] [INFO ] [MAIN ] EBS: Generated 138 derivative records from 46495 primary records. [2025-10-27T22:08:12.373192] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-27T22:08:12.396422] [DEBUG] [LOCAL ] ECCU: Loaded 2087 existing records from primary storage. [2025-10-27T22:08:12.396279] [DEBUG] [LOCAL ] EBS: Derivative data saved (138 records). [2025-10-27T22:08:12.396630] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-27T22:08:12.399869] [INFO ] [MAIN ] Derivative Progress: 528/1881 symbols completed. EBS took 1.3s. Estimated remaining: 9m 9s. Rate: 148.0 symbols/min [2025-10-27T22:08:12.396741] [INFO ] [MAIN ] ECCU: Loaded 2087 primary data records. [2025-10-27T22:08:12.400784] [DEBUG] [LOCAL ] ECAT: Loaded 28876 existing records from primary storage. [2025-10-27T22:08:12.400930] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:12.437002] [INFO ] [MAIN ] ECAT: Loaded 28876 primary data records. [2025-10-27T22:08:12.886293] [DEBUG] [LOCAL ] ECG: Loaded 32450 existing records from primary storage. [2025-10-27T22:08:12.886570] [INFO ] [MAIN ] ECG: Loaded 32450 primary data records. [2025-10-27T22:08:13.358800] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:08:13.392539] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:13.462143] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:13.493744] [INFO ] [MAIN ] ECAT: Generated 138 derivative records from 28876 primary records. [2025-10-27T22:08:13.494565] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-27T22:08:13.497171] [INFO ] [MAIN ] ECCU: Generated 138 derivative records from 2087 primary records. [2025-10-27T22:08:13.498881] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-27T22:08:13.519493] [DEBUG] [LOCAL ] ECAT: Derivative data saved (138 records). [2025-10-27T22:08:13.521023] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-27T22:08:13.523360] [INFO ] [MAIN ] Derivative Progress: 529/1881 symbols completed. ECAT took 1.2s. Estimated remaining: 9m 10s. Rate: 147.5 symbols/min [2025-10-27T22:08:13.528063] [DEBUG] [LOCAL ] ECCU: Derivative data saved (138 records). [2025-10-27T22:08:13.527837] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:13.528329] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-27T22:08:13.534117] [INFO ] [MAIN ] Derivative Progress: 530/1881 symbols completed. ECCU took 1.2s. Estimated remaining: 9m 9s. Rate: 147.8 symbols/min [2025-10-27T22:08:13.534487] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:13.543614] [INFO ] [MAIN ] ECG: Generated 138 derivative records from 32450 primary records. [2025-10-27T22:08:13.543885] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-27T22:08:13.561208] [DEBUG] [LOCAL ] ECG: Derivative data saved (138 records). [2025-10-27T22:08:13.561321] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-27T22:08:13.563987] [INFO ] [MAIN ] Derivative Progress: 531/1881 symbols completed. ECG took 1.2s. Estimated remaining: 9m 7s. Rate: 148.0 symbols/min [2025-10-27T22:08:13.564361] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:13.582204] [DEBUG] [LOCAL ] ECO: Loaded 17789 existing records from primary storage. [2025-10-27T22:08:13.582346] [INFO ] [MAIN ] ECO: Loaded 17789 primary data records. [2025-10-27T22:08:13.755501] [DEBUG] [LOCAL ] ECL: Loaded 46631 existing records from primary storage. [2025-10-27T22:08:13.790154] [INFO ] [MAIN ] ECL: Loaded 46631 primary data records. [2025-10-27T22:08:13.907851] [DEBUG] [LOCAL ] ECVT: Loaded 42785 existing records from primary storage. [2025-10-27T22:08:13.993334] [INFO ] [MAIN ] ECVT: Loaded 42785 primary data records. [2025-10-27T22:08:14.559074] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:14.596279] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:14.641985] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:14.675463] [INFO ] [MAIN ] ECO: Generated 138 derivative records from 17789 primary records. [2025-10-27T22:08:14.681327] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-27T22:08:14.697317] [DEBUG] [LOCAL ] ECO: Derivative data saved (138 records). [2025-10-27T22:08:14.701940] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-27T22:08:14.704185] [INFO ] [MAIN ] Derivative Progress: 532/1881 symbols completed. ECO took 1.2s. Estimated remaining: 9m 9s. Rate: 147.5 symbols/min [2025-10-27T22:08:14.704345] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:14.713707] [INFO ] [MAIN ] ECL: Generated 138 derivative records from 46631 primary records. [2025-10-27T22:08:14.716364] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-27T22:08:14.730817] [DEBUG] [LOCAL ] ECL: Derivative data saved (138 records). [2025-10-27T22:08:14.732624] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-27T22:08:14.732819] [INFO ] [MAIN ] ECVT: Generated 138 derivative records from 42785 primary records. [2025-10-27T22:08:14.735347] [INFO ] [MAIN ] Derivative Progress: 533/1881 symbols completed. ECL took 1.2s. Estimated remaining: 9m 7s. Rate: 147.8 symbols/min [2025-10-27T22:08:14.735896] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:14.735785] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-27T22:08:14.749808] [DEBUG] [LOCAL ] ECVT: Derivative data saved (138 records). [2025-10-27T22:08:14.750028] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-27T22:08:14.752797] [INFO ] [MAIN ] Derivative Progress: 534/1881 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 6s. Rate: 148.0 symbols/min [2025-10-27T22:08:14.753121] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:14.780776] [DEBUG] [LOCAL ] EDN: Loaded 19576 existing records from primary storage. [2025-10-27T22:08:14.780948] [INFO ] [MAIN ] EDN: Loaded 19576 primary data records. [2025-10-27T22:08:14.904907] [DEBUG] [LOCAL ] ED: Loaded 52504 existing records from primary storage. [2025-10-27T22:08:14.915574] [INFO ] [MAIN ] ED: Loaded 52504 primary data records. [2025-10-27T22:08:15.226832] [DEBUG] [LOCAL ] EDU: Loaded 44629 existing records from primary storage. [2025-10-27T22:08:15.237974] [INFO ] [MAIN ] EDU: Loaded 44629 primary data records. [2025-10-27T22:08:15.796424] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:15.826213] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:15.873559] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:15.905407] [INFO ] [MAIN ] EDN: Generated 138 derivative records from 19576 primary records. [2025-10-27T22:08:15.905961] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-27T22:08:15.921218] [DEBUG] [LOCAL ] EDN: Derivative data saved (138 records). [2025-10-27T22:08:15.921377] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-27T22:08:15.923612] [INFO ] [MAIN ] Derivative Progress: 535/1881 symbols completed. EDN took 1.2s. Estimated remaining: 9m 7s. Rate: 147.5 symbols/min [2025-10-27T22:08:15.926351] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:15.931612] [INFO ] [MAIN ] ED: Generated 138 derivative records from 52504 primary records. [2025-10-27T22:08:15.932133] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-27T22:08:15.948447] [DEBUG] [LOCAL ] ED: Derivative data saved (138 records). [2025-10-27T22:08:15.951577] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-27T22:08:15.953930] [INFO ] [MAIN ] Derivative Progress: 536/1881 symbols completed. ED took 1.2s. Estimated remaining: 9m 6s. Rate: 147.8 symbols/min [2025-10-27T22:08:15.963676] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:15.965998] [INFO ] [MAIN ] EDU: Generated 138 derivative records from 44629 primary records. [2025-10-27T22:08:15.966150] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-27T22:08:15.987348] [DEBUG] [LOCAL ] EDU: Derivative data saved (138 records). [2025-10-27T22:08:15.988186] [DEBUG] [LOCAL ] EE: Loaded 32366 existing records from primary storage. [2025-10-27T22:08:15.987681] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-27T22:08:15.991304] [INFO ] [MAIN ] Derivative Progress: 537/1881 symbols completed. EDU took 1.2s. Estimated remaining: 9m 5s. Rate: 148.0 symbols/min [2025-10-27T22:08:15.991476] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:15.991973] [INFO ] [MAIN ] EE: Loaded 32366 primary data records. [2025-10-27T22:08:16.103895] [DEBUG] [LOCAL ] EFR: Loaded 14825 existing records from primary storage. [2025-10-27T22:08:16.109502] [INFO ] [MAIN ] EFR: Loaded 14825 primary data records. [2025-10-27T22:08:16.523696] [DEBUG] [LOCAL ] EFC: Loaded 46165 existing records from primary storage. [2025-10-27T22:08:16.609967] [INFO ] [MAIN ] EFC: Loaded 46165 primary data records. [2025-10-27T22:08:16.942550] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:16.975359] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:17.023073] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:17.051916] [INFO ] [MAIN ] EFR: Generated 138 derivative records from 14825 primary records. [2025-10-27T22:08:17.052136] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-27T22:08:17.071485] [DEBUG] [LOCAL ] EFR: Derivative data saved (138 records). [2025-10-27T22:08:17.071616] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-27T22:08:17.077200] [INFO ] [MAIN ] Derivative Progress: 538/1881 symbols completed. EFR took 1.1s. Estimated remaining: 9m 6s. Rate: 147.6 symbols/min [2025-10-27T22:08:17.081086] [INFO ] [MAIN ] EE: Generated 138 derivative records from 32366 primary records. [2025-10-27T22:08:17.081314] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-27T22:08:17.098852] [DEBUG] [LOCAL ] EE: Derivative data saved (138 records). [2025-10-27T22:08:17.099018] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-27T22:08:17.101224] [INFO ] [MAIN ] Derivative Progress: 539/1881 symbols completed. EE took 1.2s. Estimated remaining: 9m 5s. Rate: 147.8 symbols/min [2025-10-27T22:08:17.103681] [INFO ] [MAIN ] EFC: Generated 138 derivative records from 46165 primary records. [2025-10-27T22:08:17.103750] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-27T22:08:17.115281] [DEBUG] [LOCAL ] EFC: Derivative data saved (138 records). [2025-10-27T22:08:17.115335] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-27T22:08:17.117698] [INFO ] [MAIN ] Derivative Progress: 540/1881 symbols completed. EFC took 1.2s. Estimated remaining: 9m 3s. Rate: 148.1 symbols/min [2025-10-27T22:08:17.118078] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:17.118171] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:17.118027] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:17.132518] [DEBUG] [LOCAL ] EFT: Loaded 12689 existing records from primary storage. [2025-10-27T22:08:17.132730] [INFO ] [MAIN ] EFT: Loaded 12689 primary data records. [2025-10-27T22:08:17.252571] [DEBUG] [LOCAL ] EFXT: Loaded 29414 existing records from primary storage. [2025-10-27T22:08:17.273679] [INFO ] [MAIN ] EFXT: Loaded 29414 primary data records. [2025-10-27T22:08:17.563748] [DEBUG] [LOCAL ] EFX: Loaded 44559 existing records from primary storage. [2025-10-27T22:08:17.572605] [INFO ] [MAIN ] EFX: Loaded 44559 primary data records. [2025-10-27T22:08:18.118204] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:18.158602] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:18.200597] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:18.228045] [INFO ] [MAIN ] EFT: Generated 138 derivative records from 12689 primary records. [2025-10-27T22:08:18.232159] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-27T22:08:18.254519] [DEBUG] [LOCAL ] EFT: Derivative data saved (138 records). [2025-10-27T22:08:18.255385] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-27T22:08:18.257756] [INFO ] [MAIN ] Derivative Progress: 541/1881 symbols completed. EFT took 1.1s. Estimated remaining: 9m 5s. Rate: 147.6 symbols/min [2025-10-27T22:08:18.259277] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:18.270107] [INFO ] [MAIN ] EFXT: Generated 138 derivative records from 29414 primary records. [2025-10-27T22:08:18.270328] [INFO ] [MAIN ] EFX: Generated 138 derivative records from 44559 primary records. [2025-10-27T22:08:18.270608] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-27T22:08:18.270556] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-27T22:08:18.292893] [DEBUG] [LOCAL ] EFX: Derivative data saved (138 records). [2025-10-27T22:08:18.293048] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-27T22:08:18.295752] [DEBUG] [LOCAL ] EFXT: Derivative data saved (138 records). [2025-10-27T22:08:18.302776] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-27T22:08:18.305340] [INFO ] [MAIN ] Derivative Progress: 542/1881 symbols completed. EFX took 1.2s. Estimated remaining: 9m 3s. Rate: 147.8 symbols/min [2025-10-27T22:08:18.308095] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:18.308578] [INFO ] [MAIN ] Derivative Progress: 543/1881 symbols completed. EFXT took 1.2s. Estimated remaining: 9m 2s. Rate: 148.1 symbols/min [2025-10-27T22:08:18.308818] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:18.319441] [DEBUG] [LOCAL ] EG: Loaded 27095 existing records from primary storage. [2025-10-27T22:08:18.319681] [INFO ] [MAIN ] EG: Loaded 27095 primary data records. [2025-10-27T22:08:18.469007] [DEBUG] [LOCAL ] EHAB: Loaded 29072 existing records from primary storage. [2025-10-27T22:08:18.487313] [INFO ] [MAIN ] EHAB: Loaded 29072 primary data records. [2025-10-27T22:08:18.725386] [DEBUG] [LOCAL ] EGY: Loaded 40974 existing records from primary storage. [2025-10-27T22:08:18.737759] [INFO ] [MAIN ] EGY: Loaded 40974 primary data records. [2025-10-27T22:08:19.295541] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:19.361440] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:19.361735] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:19.391871] [INFO ] [MAIN ] EG: Generated 138 derivative records from 27095 primary records. [2025-10-27T22:08:19.392064] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-27T22:08:19.409357] [DEBUG] [LOCAL ] EG: Derivative data saved (138 records). [2025-10-27T22:08:19.409680] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-27T22:08:19.412186] [INFO ] [MAIN ] Derivative Progress: 544/1881 symbols completed. EG took 1.2s. Estimated remaining: 9m 3s. Rate: 147.6 symbols/min [2025-10-27T22:08:19.413397] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:19.452214] [INFO ] [MAIN ] EHAB: Generated 138 derivative records from 29072 primary records. [2025-10-27T22:08:19.453930] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-27T22:08:19.454158] [INFO ] [MAIN ] EGY: Generated 138 derivative records from 40974 primary records. [2025-10-27T22:08:19.454274] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-27T22:08:19.477203] [DEBUG] [LOCAL ] EHAB: Derivative data saved (138 records). [2025-10-27T22:08:19.478081] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-27T22:08:19.477918] [DEBUG] [LOCAL ] EGY: Derivative data saved (138 records). [2025-10-27T22:08:19.493637] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-27T22:08:19.493529] [INFO ] [MAIN ] Derivative Progress: 545/1881 symbols completed. EHAB took 1.2s. Estimated remaining: 9m 2s. Rate: 147.8 symbols/min [2025-10-27T22:08:19.498450] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:19.498703] [INFO ] [MAIN ] Derivative Progress: 546/1881 symbols completed. EGY took 1.2s. Estimated remaining: 9m 1s. Rate: 148.1 symbols/min [2025-10-27T22:08:19.499221] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:19.501052] [DEBUG] [LOCAL ] EHC: Loaded 40655 existing records from primary storage. [2025-10-27T22:08:19.501325] [INFO ] [MAIN ] EHC: Loaded 40655 primary data records. [2025-10-27T22:08:19.630388] [DEBUG] [LOCAL ] EHI: Loaded 10481 existing records from primary storage. [2025-10-27T22:08:19.651500] [INFO ] [MAIN ] EHI: Loaded 10481 primary data records. [2025-10-27T22:08:19.715629] [DEBUG] [LOCAL ] EIG: Loaded 19836 existing records from primary storage. [2025-10-27T22:08:19.862495] [INFO ] [MAIN ] EIG: Loaded 19836 primary data records. [2025-10-27T22:08:20.464043] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:20.516814] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:20.517295] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:20.580975] [INFO ] [MAIN ] EHC: Generated 138 derivative records from 40655 primary records. [2025-10-27T22:08:20.583347] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-27T22:08:20.604313] [DEBUG] [LOCAL ] EHC: Derivative data saved (138 records). [2025-10-27T22:08:20.604524] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-27T22:08:20.606967] [INFO ] [MAIN ] Derivative Progress: 547/1881 symbols completed. EHC took 1.2s. Estimated remaining: 9m 2s. Rate: 147.6 symbols/min [2025-10-27T22:08:20.608249] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:20.614291] [INFO ] [MAIN ] EIG: Generated 138 derivative records from 19836 primary records. [2025-10-27T22:08:20.615888] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-27T22:08:20.618572] [INFO ] [MAIN ] EHI: Generated 138 derivative records from 10481 primary records. [2025-10-27T22:08:20.625477] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-27T22:08:20.639578] [DEBUG] [LOCAL ] EHI: Derivative data saved (138 records). [2025-10-27T22:08:20.639968] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-27T22:08:20.642665] [INFO ] [MAIN ] Derivative Progress: 548/1881 symbols completed. EHI took 1.1s. Estimated remaining: 9m 1s. Rate: 147.9 symbols/min [2025-10-27T22:08:20.643012] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:20.644974] [DEBUG] [LOCAL ] EIG: Derivative data saved (138 records). [2025-10-27T22:08:20.646189] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-27T22:08:20.648749] [INFO ] [MAIN ] Derivative Progress: 549/1881 symbols completed. EIG took 1.1s. Estimated remaining: 8m 59s. Rate: 148.2 symbols/min [2025-10-27T22:08:20.649056] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:20.701771] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-10-27T22:08:20.702050] [INFO ] [MAIN ] EIX: Loaded 53339 primary data records. [2025-10-27T22:08:20.831460] [DEBUG] [LOCAL ] EL: Loaded 53370 existing records from primary storage. [2025-10-27T22:08:20.848343] [INFO ] [MAIN ] EL: Loaded 53370 primary data records. [2025-10-27T22:08:21.125791] [DEBUG] [LOCAL ] ELAN: Loaded 53308 existing records from primary storage. [2025-10-27T22:08:21.140193] [INFO ] [MAIN ] ELAN: Loaded 53308 primary data records. [2025-10-27T22:08:21.658374] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:21.708326] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:21.709184] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:21.780741] [INFO ] [MAIN ] EIX: Generated 138 derivative records from 53339 primary records. [2025-10-27T22:08:21.782557] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-27T22:08:21.799475] [DEBUG] [LOCAL ] EIX: Derivative data saved (138 records). [2025-10-27T22:08:21.805564] [INFO ] [MAIN ] EL: Generated 138 derivative records from 53370 primary records. [2025-10-27T22:08:21.803701] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-27T22:08:21.808456] [INFO ] [MAIN ] Derivative Progress: 550/1881 symbols completed. EIX took 1.2s. Estimated remaining: 9m 1s. Rate: 147.7 symbols/min [2025-10-27T22:08:21.808857] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-27T22:08:21.808736] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:21.822903] [DEBUG] [LOCAL ] EL: Derivative data saved (138 records). [2025-10-27T22:08:21.825787] [INFO ] [MAIN ] ELAN: Generated 138 derivative records from 53308 primary records. [2025-10-27T22:08:21.825956] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-27T22:08:21.828321] [INFO ] [MAIN ] Derivative Progress: 551/1881 symbols completed. EL took 1.2s. Estimated remaining: 8m 60s. Rate: 147.9 symbols/min [2025-10-27T22:08:21.828559] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:21.826060] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-27T22:08:21.832372] [DEBUG] [LOCAL ] ELC: Loaded 3391 existing records from primary storage. [2025-10-27T22:08:21.841063] [INFO ] [MAIN ] ELC: Loaded 3391 primary data records. [2025-10-27T22:08:21.854889] [DEBUG] [LOCAL ] ELAN: Derivative data saved (138 records). [2025-10-27T22:08:21.864205] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-27T22:08:21.867398] [INFO ] [MAIN ] Derivative Progress: 552/1881 symbols completed. ELAN took 1.2s. Estimated remaining: 8m 58s. Rate: 148.1 symbols/min [2025-10-27T22:08:21.877677] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:22.209560] [DEBUG] [LOCAL ] ELF: Loaded 51744 existing records from primary storage. [2025-10-27T22:08:22.222804] [INFO ] [MAIN ] ELF: Loaded 51744 primary data records. [2025-10-27T22:08:22.244347] [DEBUG] [LOCAL ] ELS: Loaded 49837 existing records from primary storage. [2025-10-27T22:08:22.259917] [INFO ] [MAIN ] ELS: Loaded 49837 primary data records. [2025-10-27T22:08:22.819041] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:22.879307] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:22.879788] [INFO ] [MAIN ] ELC: Generated 138 derivative records from 3391 primary records. [2025-10-27T22:08:22.891175] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-27T22:08:22.916533] [DEBUG] [LOCAL ] ELC: Derivative data saved (138 records). [2025-10-27T22:08:22.917268] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-27T22:08:22.917201] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:22.919495] [INFO ] [MAIN ] Derivative Progress: 553/1881 symbols completed. ELC took 1.1s. Estimated remaining: 8m 59s. Rate: 147.7 symbols/min [2025-10-27T22:08:22.956956] [INFO ] [MAIN ] ELS: Generated 138 derivative records from 49837 primary records. [2025-10-27T22:08:22.958047] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-27T22:08:22.973266] [DEBUG] [LOCAL ] ELS: Derivative data saved (138 records). [2025-10-27T22:08:22.975381] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-27T22:08:22.978195] [INFO ] [MAIN ] Derivative Progress: 554/1881 symbols completed. ELS took 1.1s. Estimated remaining: 8m 58s. Rate: 148.0 symbols/min [2025-10-27T22:08:22.980617] [INFO ] [MAIN ] ELF: Generated 138 derivative records from 51744 primary records. [2025-10-27T22:08:22.980707] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-27T22:08:22.992406] [DEBUG] [LOCAL ] ELF: Derivative data saved (138 records). [2025-10-27T22:08:22.992461] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-27T22:08:22.994753] [INFO ] [MAIN ] Derivative Progress: 555/1881 symbols completed. ELF took 1.2s. Estimated remaining: 8m 57s. Rate: 148.2 symbols/min [2025-10-27T22:08:22.995143] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:22.995243] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:22.995509] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:23.000967] [DEBUG] [LOCAL ] EMF: Loaded 3001 existing records from primary storage. [2025-10-27T22:08:23.001258] [INFO ] [MAIN ] EMF: Loaded 3001 primary data records. [2025-10-27T22:08:23.200086] [DEBUG] [LOCAL ] EME: Loaded 30529 existing records from primary storage. [2025-10-27T22:08:23.322571] [INFO ] [MAIN ] EME: Loaded 30529 primary data records. [2025-10-27T22:08:23.467973] [DEBUG] [LOCAL ] EMN: Loaded 50796 existing records from primary storage. [2025-10-27T22:08:23.473262] [INFO ] [MAIN ] EMN: Loaded 50796 primary data records. [2025-10-27T22:08:24.034403] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:24.080686] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:24.121872] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:24.122253] [INFO ] [MAIN ] EMF: Generated 138 derivative records from 3001 primary records. [2025-10-27T22:08:24.122419] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-27T22:08:24.149995] [DEBUG] [LOCAL ] EMF: Derivative data saved (138 records). [2025-10-27T22:08:24.150124] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-27T22:08:24.152049] [INFO ] [MAIN ] Derivative Progress: 556/1881 symbols completed. EMF took 1.2s. Estimated remaining: 8m 58s. Rate: 147.7 symbols/min [2025-10-27T22:08:24.153717] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:24.165136] [DEBUG] [LOCAL ] EMP: Loaded 2836 existing records from primary storage. [2025-10-27T22:08:24.166200] [INFO ] [MAIN ] EMP: Loaded 2836 primary data records. [2025-10-27T22:08:24.306968] [INFO ] [MAIN ] EME: Generated 138 derivative records from 30529 primary records. [2025-10-27T22:08:24.318114] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-27T22:08:24.407154] [DEBUG] [LOCAL ] EME: Derivative data saved (138 records). [2025-10-27T22:08:24.525722] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-27T22:08:24.539693] [INFO ] [MAIN ] Derivative Progress: 557/1881 symbols completed. EME took 1.5s. Estimated remaining: 8m 58s. Rate: 147.7 symbols/min [2025-10-27T22:08:24.541480] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:24.546562] [INFO ] [MAIN ] EMN: Generated 138 derivative records from 50796 primary records. [2025-10-27T22:08:24.547150] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-27T22:08:24.561998] [DEBUG] [LOCAL ] EMN: Derivative data saved (138 records). [2025-10-27T22:08:24.563171] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-27T22:08:24.566087] [INFO ] [MAIN ] Derivative Progress: 558/1881 symbols completed. EMN took 1.6s. Estimated remaining: 8m 56s. Rate: 148.0 symbols/min [2025-10-27T22:08:24.566328] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:24.585828] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:24.643493] [INFO ] [MAIN ] EMP: Generated 138 derivative records from 2836 primary records. [2025-10-27T22:08:24.643722] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-27T22:08:24.655085] [DEBUG] [LOCAL ] EMP: Derivative data saved (138 records). [2025-10-27T22:08:24.655343] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-27T22:08:24.657465] [INFO ] [MAIN ] Derivative Progress: 559/1881 symbols completed. EMP took 0.5s. Estimated remaining: 8m 55s. Rate: 148.2 symbols/min [2025-10-27T22:08:24.671712] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:24.675474] [DEBUG] [LOCAL ] EMR: Loaded 53121 existing records from primary storage. [2025-10-27T22:08:24.675689] [INFO ] [MAIN ] EMR: Loaded 53121 primary data records. [2025-10-27T22:08:24.732590] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-27T22:08:24.764578] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-10-27T22:08:25.320621] [DEBUG] [LOCAL ] ENR: Loaded 43645 existing records from primary storage. [2025-10-27T22:08:25.321146] [INFO ] [MAIN ] ENR: Loaded 43645 primary data records. [2025-10-27T22:08:25.664255] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:25.704037] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:25.759579] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:25.791230] [INFO ] [MAIN ] EMR: Generated 138 derivative records from 53121 primary records. [2025-10-27T22:08:25.795046] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-27T22:08:25.805763] [INFO ] [MAIN ] ENB: Generated 138 derivative records from 53511 primary records. [2025-10-27T22:08:25.817879] [DEBUG] [LOCAL ] EMR: Derivative data saved (138 records). [2025-10-27T22:08:25.821502] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-27T22:08:25.822706] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-27T22:08:25.826159] [INFO ] [MAIN ] Derivative Progress: 560/1881 symbols completed. EMR took 1.3s. Estimated remaining: 8m 57s. Rate: 147.7 symbols/min [2025-10-27T22:08:25.826812] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:25.843733] [DEBUG] [LOCAL ] ENB: Derivative data saved (138 records). [2025-10-27T22:08:25.844184] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-27T22:08:25.846929] [INFO ] [MAIN ] Derivative Progress: 561/1881 symbols completed. ENB took 1.3s. Estimated remaining: 8m 55s. Rate: 147.9 symbols/min [2025-10-27T22:08:25.847236] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:25.854780] [INFO ] [MAIN ] ENR: Generated 138 derivative records from 43645 primary records. [2025-10-27T22:08:25.854945] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-27T22:08:25.867524] [DEBUG] [LOCAL ] ENR: Derivative data saved (138 records). [2025-10-27T22:08:25.867758] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-27T22:08:25.870100] [INFO ] [MAIN ] Derivative Progress: 562/1881 symbols completed. ENR took 1.2s. Estimated remaining: 8m 54s. Rate: 148.2 symbols/min [2025-10-27T22:08:25.870452] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:25.910841] [DEBUG] [LOCAL ] ENVA: Loaded 25041 existing records from primary storage. [2025-10-27T22:08:25.911491] [DEBUG] [LOCAL ] ENS: Loaded 29376 existing records from primary storage. [2025-10-27T22:08:25.911744] [INFO ] [MAIN ] ENS: Loaded 29376 primary data records. [2025-10-27T22:08:25.911626] [INFO ] [MAIN ] ENVA: Loaded 25041 primary data records. [2025-10-27T22:08:26.020069] [DEBUG] [LOCAL ] EOD: Loaded 14650 existing records from primary storage. [2025-10-27T22:08:26.076041] [INFO ] [MAIN ] EOD: Loaded 14650 primary data records. [2025-10-27T22:08:26.906966] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:26.907763] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:26.932454] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:27.017424] [INFO ] [MAIN ] ENS: Generated 138 derivative records from 29376 primary records. [2025-10-27T22:08:27.018025] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-27T22:08:27.034289] [INFO ] [MAIN ] ENVA: Generated 138 derivative records from 25041 primary records. [2025-10-27T22:08:27.036490] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-27T22:08:27.037866] [DEBUG] [LOCAL ] ENS: Derivative data saved (138 records). [2025-10-27T22:08:27.049774] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-27T22:08:27.050362] [INFO ] [MAIN ] EOD: Generated 138 derivative records from 14650 primary records. [2025-10-27T22:08:27.053052] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-27T22:08:27.052945] [INFO ] [MAIN ] Derivative Progress: 563/1881 symbols completed. ENS took 1.2s. Estimated remaining: 8m 55s. Rate: 147.7 symbols/min [2025-10-27T22:08:27.054829] [DEBUG] [LOCAL ] ENVA: Derivative data saved (138 records). [2025-10-27T22:08:27.055224] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-27T22:08:27.055143] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:27.067751] [INFO ] [MAIN ] Derivative Progress: 564/1881 symbols completed. ENVA took 1.2s. Estimated remaining: 8m 54s. Rate: 147.9 symbols/min [2025-10-27T22:08:27.069338] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:27.069490] [DEBUG] [LOCAL ] EOD: Derivative data saved (138 records). [2025-10-27T22:08:27.070486] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-27T22:08:27.072882] [INFO ] [MAIN ] Derivative Progress: 565/1881 symbols completed. EOD took 1.2s. Estimated remaining: 8m 53s. Rate: 148.2 symbols/min [2025-10-27T22:08:27.073132] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:27.082140] [DEBUG] [LOCAL ] EOI: Loaded 9956 existing records from primary storage. [2025-10-27T22:08:27.082387] [INFO ] [MAIN ] EOI: Loaded 9956 primary data records. [2025-10-27T22:08:27.185873] [DEBUG] [LOCAL ] EOS: Loaded 14302 existing records from primary storage. [2025-10-27T22:08:27.196633] [INFO ] [MAIN ] EOS: Loaded 14302 primary data records. [2025-10-27T22:08:27.575496] [DEBUG] [LOCAL ] EOG: Loaded 53389 existing records from primary storage. [2025-10-27T22:08:27.697319] [INFO ] [MAIN ] EOG: Loaded 53389 primary data records. [2025-10-27T22:08:28.087340] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:28.092401] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:28.159225] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:28.195518] [INFO ] [MAIN ] EOS: Generated 138 derivative records from 14302 primary records. [2025-10-27T22:08:28.196585] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-27T22:08:28.213618] [DEBUG] [LOCAL ] EOS: Derivative data saved (138 records). [2025-10-27T22:08:28.210608] [INFO ] [MAIN ] EOI: Generated 138 derivative records from 9956 primary records. [2025-10-27T22:08:28.213861] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-27T22:08:28.216195] [INFO ] [MAIN ] Derivative Progress: 566/1881 symbols completed. EOS took 1.1s. Estimated remaining: 8m 54s. Rate: 147.7 symbols/min [2025-10-27T22:08:28.216332] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-27T22:08:28.217761] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:28.231135] [DEBUG] [LOCAL ] EOI: Derivative data saved (138 records). [2025-10-27T22:08:28.233981] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-27T22:08:28.236255] [INFO ] [MAIN ] Derivative Progress: 567/1881 symbols completed. EOI took 1.2s. Estimated remaining: 8m 53s. Rate: 148.0 symbols/min [2025-10-27T22:08:28.237685] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:28.244476] [INFO ] [MAIN ] EOG: Generated 138 derivative records from 53389 primary records. [2025-10-27T22:08:28.244620] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-27T22:08:28.264247] [DEBUG] [LOCAL ] EOG: Derivative data saved (138 records). [2025-10-27T22:08:28.264358] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-27T22:08:28.266563] [INFO ] [MAIN ] Derivative Progress: 568/1881 symbols completed. EOG took 1.2s. Estimated remaining: 8m 52s. Rate: 148.2 symbols/min [2025-10-27T22:08:28.275921] [DEBUG] [LOCAL ] EPAC: Loaded 26063 existing records from primary storage. [2025-10-27T22:08:28.276044] [INFO ] [MAIN ] EPAC: Loaded 26063 primary data records. [2025-10-27T22:08:28.595219] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-27T22:08:28.596024] [INFO ] [MAIN ] EPD: Loaded 53606 primary data records. [2025-10-27T22:08:28.917455] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:28.957119] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:28.986926] [INFO ] [MAIN ] EPAC: Generated 138 derivative records from 26063 primary records. [2025-10-27T22:08:28.987267] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-27T22:08:29.003292] [DEBUG] [LOCAL ] EPAC: Derivative data saved (138 records). [2025-10-27T22:08:29.005532] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-27T22:08:29.008154] [INFO ] [MAIN ] Derivative Progress: 569/1881 symbols completed. EPAC took 0.8s. Estimated remaining: 8m 52s. Rate: 148.0 symbols/min [2025-10-27T22:08:29.013386] [INFO ] [MAIN ] EPD: Generated 138 derivative records from 53606 primary records. [2025-10-27T22:08:29.013532] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-27T22:08:29.025405] [DEBUG] [LOCAL ] EPD: Derivative data saved (138 records). [2025-10-27T22:08:29.025495] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-27T22:08:29.027745] [INFO ] [MAIN ] Derivative Progress: 570/1881 symbols completed. EPD took 0.8s. Estimated remaining: 8m 51s. Rate: 148.2 symbols/min [2025-10-27T22:08:29.028375] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:29.028491] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:29.029464] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:29.110217] [DEBUG] [LOCAL ] EQNR: Loaded 53043 existing records from primary storage. [2025-10-27T22:08:29.110437] [INFO ] [MAIN ] EQNR: Loaded 53043 primary data records. [2025-10-27T22:08:29.111252] [DEBUG] [LOCAL ] EPRT: Loaded 48434 existing records from primary storage. [2025-10-27T22:08:29.124116] [INFO ] [MAIN ] EPRT: Loaded 48434 primary data records. [2025-10-27T22:08:29.244879] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-27T22:08:29.259584] [INFO ] [MAIN ] EQH: Loaded 52653 primary data records. [2025-10-27T22:08:30.052565] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:30.091836] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:30.108687] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:30.227374] [INFO ] [MAIN ] EQNR: Generated 138 derivative records from 53043 primary records. [2025-10-27T22:08:30.227854] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-27T22:08:30.230727] [INFO ] [MAIN ] EPRT: Generated 138 derivative records from 48434 primary records. [2025-10-27T22:08:30.241228] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-27T22:08:30.244696] [DEBUG] [LOCAL ] EQNR: Derivative data saved (138 records). [2025-10-27T22:08:30.244971] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-27T22:08:30.246849] [INFO ] [MAIN ] Derivative Progress: 571/1881 symbols completed. EQNR took 1.2s. Estimated remaining: 8m 52s. Rate: 147.7 symbols/min [2025-10-27T22:08:30.247199] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:30.260177] [INFO ] [MAIN ] EQH: Generated 138 derivative records from 52653 primary records. [2025-10-27T22:08:30.261882] [DEBUG] [LOCAL ] EPRT: Derivative data saved (138 records). [2025-10-27T22:08:30.262058] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-27T22:08:30.262126] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-27T22:08:30.264783] [INFO ] [MAIN ] Derivative Progress: 572/1881 symbols completed. EPRT took 1.2s. Estimated remaining: 8m 51s. Rate: 148.0 symbols/min [2025-10-27T22:08:30.265052] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:30.278900] [DEBUG] [LOCAL ] EQH: Derivative data saved (138 records). [2025-10-27T22:08:30.279128] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-27T22:08:30.281474] [INFO ] [MAIN ] Derivative Progress: 573/1881 symbols completed. EQH took 1.3s. Estimated remaining: 8m 50s. Rate: 148.2 symbols/min [2025-10-27T22:08:30.281683] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:30.286787] [DEBUG] [LOCAL ] EQV: Loaded 2764 existing records from primary storage. [2025-10-27T22:08:30.287093] [INFO ] [MAIN ] EQV: Loaded 2764 primary data records. [2025-10-27T22:08:30.467316] [DEBUG] [LOCAL ] EQR: Loaded 51787 existing records from primary storage. [2025-10-27T22:08:30.505785] [INFO ] [MAIN ] EQR: Loaded 51787 primary data records. [2025-10-27T22:08:30.709204] [DEBUG] [LOCAL ] EQT: Loaded 53684 existing records from primary storage. [2025-10-27T22:08:30.728310] [INFO ] [MAIN ] EQT: Loaded 53684 primary data records. [2025-10-27T22:08:31.263534] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:31.305260] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:31.358954] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:31.361351] [INFO ] [MAIN ] EQV: Generated 138 derivative records from 2764 primary records. [2025-10-27T22:08:31.373170] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-27T22:08:31.406030] [DEBUG] [LOCAL ] EQV: Derivative data saved (138 records). [2025-10-27T22:08:31.406501] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-27T22:08:31.409679] [INFO ] [MAIN ] Derivative Progress: 574/1881 symbols completed. EQV took 1.1s. Estimated remaining: 8m 51s. Rate: 147.7 symbols/min [2025-10-27T22:08:31.410145] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:31.427740] [INFO ] [MAIN ] EQT: Generated 138 derivative records from 53684 primary records. [2025-10-27T22:08:31.426022] [INFO ] [MAIN ] EQR: Generated 138 derivative records from 51787 primary records. [2025-10-27T22:08:31.427889] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-27T22:08:31.427931] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-27T22:08:31.451107] [DEBUG] [LOCAL ] EQT: Derivative data saved (138 records). [2025-10-27T22:08:31.452327] [DEBUG] [LOCAL ] EQR: Derivative data saved (138 records). [2025-10-27T22:08:31.452457] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-27T22:08:31.452523] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-27T22:08:31.454506] [INFO ] [MAIN ] Derivative Progress: 575/1881 symbols completed. EQR took 1.2s. Estimated remaining: 8m 50s. Rate: 148.0 symbols/min [2025-10-27T22:08:31.457113] [INFO ] [MAIN ] Derivative Progress: 576/1881 symbols completed. EQT took 1.2s. Estimated remaining: 8m 48s. Rate: 148.2 symbols/min [2025-10-27T22:08:31.454665] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:31.457500] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:31.492537] [DEBUG] [LOCAL ] ERJ: Loaded 50207 existing records from primary storage. [2025-10-27T22:08:31.492851] [INFO ] [MAIN ] ERJ: Loaded 50207 primary data records. [2025-10-27T22:08:31.634989] [DEBUG] [LOCAL ] ERO: Loaded 42023 existing records from primary storage. [2025-10-27T22:08:31.661605] [INFO ] [MAIN ] ERO: Loaded 42023 primary data records. [2025-10-27T22:08:31.913512] [DEBUG] [LOCAL ] ES: Loaded 52682 existing records from primary storage. [2025-10-27T22:08:31.927066] [INFO ] [MAIN ] ES: Loaded 52682 primary data records. [2025-10-27T22:08:32.527844] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:32.559924] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:32.617169] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:32.641261] [INFO ] [MAIN ] ERJ: Generated 138 derivative records from 50207 primary records. [2025-10-27T22:08:32.641920] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-27T22:08:32.664478] [DEBUG] [LOCAL ] ERJ: Derivative data saved (138 records). [2025-10-27T22:08:32.665477] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-27T22:08:32.670887] [INFO ] [MAIN ] Derivative Progress: 577/1881 symbols completed. ERJ took 1.3s. Estimated remaining: 8m 50s. Rate: 147.7 symbols/min [2025-10-27T22:08:32.671308] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:32.684451] [INFO ] [MAIN ] ERO: Generated 138 derivative records from 42023 primary records. [2025-10-27T22:08:32.685184] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-27T22:08:32.701744] [DEBUG] [LOCAL ] ERO: Derivative data saved (138 records). [2025-10-27T22:08:32.711410] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-27T22:08:32.713544] [INFO ] [MAIN ] Derivative Progress: 578/1881 symbols completed. ERO took 1.3s. Estimated remaining: 8m 48s. Rate: 147.9 symbols/min [2025-10-27T22:08:32.715921] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:32.715801] [INFO ] [MAIN ] ES: Generated 138 derivative records from 52682 primary records. [2025-10-27T22:08:32.716424] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-27T22:08:32.738371] [DEBUG] [LOCAL ] ES: Derivative data saved (138 records). [2025-10-27T22:08:32.738574] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-27T22:08:32.741636] [INFO ] [MAIN ] Derivative Progress: 579/1881 symbols completed. ES took 1.3s. Estimated remaining: 8m 47s. Rate: 148.2 symbols/min [2025-10-27T22:08:32.741848] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:32.742940] [DEBUG] [LOCAL ] ESAB: Loaded 25775 existing records from primary storage. [2025-10-27T22:08:32.747623] [INFO ] [MAIN ] ESAB: Loaded 25775 primary data records. [2025-10-27T22:08:32.836537] [DEBUG] [LOCAL ] ESE: Loaded 16199 existing records from primary storage. [2025-10-27T22:08:32.861461] [INFO ] [MAIN ] ESE: Loaded 16199 primary data records. [2025-10-27T22:08:33.073484] [DEBUG] [LOCAL ] ESI: Loaded 50575 existing records from primary storage. [2025-10-27T22:08:33.077191] [INFO ] [MAIN ] ESI: Loaded 50575 primary data records. [2025-10-27T22:08:33.722205] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:33.758254] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:33.788962] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:33.854243] [INFO ] [MAIN ] ESAB: Generated 138 derivative records from 25775 primary records. [2025-10-27T22:08:33.856545] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-27T22:08:33.861202] [INFO ] [MAIN ] ESE: Generated 138 derivative records from 16199 primary records. [2025-10-27T22:08:33.872702] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-27T22:08:33.875318] [DEBUG] [LOCAL ] ESAB: Derivative data saved (138 records). [2025-10-27T22:08:33.876041] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-27T22:08:33.878274] [INFO ] [MAIN ] Derivative Progress: 580/1881 symbols completed. ESAB took 1.2s. Estimated remaining: 8m 48s. Rate: 147.7 symbols/min [2025-10-27T22:08:33.878472] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:33.892633] [DEBUG] [LOCAL ] ESE: Derivative data saved (138 records). [2025-10-27T22:08:33.892928] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-27T22:08:33.895270] [INFO ] [MAIN ] Derivative Progress: 581/1881 symbols completed. ESE took 1.2s. Estimated remaining: 8m 47s. Rate: 148.0 symbols/min [2025-10-27T22:08:33.897244] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:33.897758] [INFO ] [MAIN ] ESI: Generated 138 derivative records from 50575 primary records. [2025-10-27T22:08:33.898270] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-27T22:08:33.911032] [DEBUG] [LOCAL ] ESI: Derivative data saved (138 records). [2025-10-27T22:08:33.911232] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-27T22:08:33.916363] [INFO ] [MAIN ] Derivative Progress: 582/1881 symbols completed. ESI took 1.2s. Estimated remaining: 8m 46s. Rate: 148.2 symbols/min [2025-10-27T22:08:33.916605] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:33.953036] [DEBUG] [LOCAL ] ESNT: Loaded 37618 existing records from primary storage. [2025-10-27T22:08:33.953352] [INFO ] [MAIN ] ESNT: Loaded 37618 primary data records. [2025-10-27T22:08:34.062258] [DEBUG] [LOCAL ] ESRT: Loaded 46460 existing records from primary storage. [2025-10-27T22:08:34.082430] [INFO ] [MAIN ] ESRT: Loaded 46460 primary data records. [2025-10-27T22:08:34.111834] [DEBUG] [LOCAL ] ESS: Loaded 29996 existing records from primary storage. [2025-10-27T22:08:34.166510] [INFO ] [MAIN ] ESS: Loaded 29996 primary data records. [2025-10-27T22:08:34.968446] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:35.005093] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:35.048402] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:35.085014] [INFO ] [MAIN ] ESNT: Generated 138 derivative records from 37618 primary records. [2025-10-27T22:08:35.086109] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-27T22:08:35.104762] [DEBUG] [LOCAL ] ESNT: Derivative data saved (138 records). [2025-10-27T22:08:35.105680] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-27T22:08:35.107842] [INFO ] [MAIN ] Derivative Progress: 583/1881 symbols completed. ESNT took 1.2s. Estimated remaining: 8m 47s. Rate: 147.7 symbols/min [2025-10-27T22:08:35.114793] [INFO ] [MAIN ] ESRT: Generated 138 derivative records from 46460 primary records. [2025-10-27T22:08:35.115043] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-27T22:08:35.132176] [INFO ] [MAIN ] ESS: Generated 138 derivative records from 29996 primary records. [2025-10-27T22:08:35.131916] [DEBUG] [LOCAL ] ESRT: Derivative data saved (138 records). [2025-10-27T22:08:35.132275] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-27T22:08:35.132616] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-27T22:08:35.135204] [INFO ] [MAIN ] Derivative Progress: 584/1881 symbols completed. ESRT took 1.2s. Estimated remaining: 8m 46s. Rate: 148.0 symbols/min [2025-10-27T22:08:35.146341] [DEBUG] [LOCAL ] ESS: Derivative data saved (138 records). [2025-10-27T22:08:35.146399] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-27T22:08:35.148839] [INFO ] [MAIN ] Derivative Progress: 585/1881 symbols completed. ESS took 1.2s. Estimated remaining: 8m 45s. Rate: 148.2 symbols/min [2025-10-27T22:08:35.149319] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:35.149421] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:35.149252] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:35.163402] [DEBUG] [LOCAL ] ETB: Loaded 11479 existing records from primary storage. [2025-10-27T22:08:35.163598] [INFO ] [MAIN ] ETB: Loaded 11479 primary data records. [2025-10-27T22:08:35.370733] [DEBUG] [LOCAL ] ESTC: Loaded 50185 existing records from primary storage. [2025-10-27T22:08:35.389359] [INFO ] [MAIN ] ESTC: Loaded 50185 primary data records. [2025-10-27T22:08:35.596339] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-27T22:08:35.633465] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-27T22:08:36.156213] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:36.209237] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:36.236705] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:36.257411] [INFO ] [MAIN ] ETB: Generated 138 derivative records from 11479 primary records. [2025-10-27T22:08:36.257560] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-27T22:08:36.271628] [DEBUG] [LOCAL ] ETB: Derivative data saved (138 records). [2025-10-27T22:08:36.273748] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-27T22:08:36.276552] [INFO ] [MAIN ] Derivative Progress: 586/1881 symbols completed. ETB took 1.1s. Estimated remaining: 8m 46s. Rate: 147.8 symbols/min [2025-10-27T22:08:36.279685] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:36.326283] [DEBUG] [LOCAL ] ETD: Loaded 26664 existing records from primary storage. [2025-10-27T22:08:36.330359] [INFO ] [MAIN ] ETD: Loaded 26664 primary data records. [2025-10-27T22:08:36.328589] [INFO ] [MAIN ] ESTC: Generated 138 derivative records from 50185 primary records. [2025-10-27T22:08:36.335994] [INFO ] [MAIN ] ET: Generated 138 derivative records from 53789 primary records. [2025-10-27T22:08:36.351749] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-27T22:08:36.351815] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-27T22:08:36.456034] [DEBUG] [LOCAL ] ESTC: Derivative data saved (138 records). [2025-10-27T22:08:36.464682] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-27T22:08:36.475075] [DEBUG] [LOCAL ] ET: Derivative data saved (138 records). [2025-10-27T22:08:36.484169] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-27T22:08:36.483983] [INFO ] [MAIN ] Derivative Progress: 587/1881 symbols completed. ESTC took 1.3s. Estimated remaining: 8m 45s. Rate: 147.9 symbols/min [2025-10-27T22:08:36.511728] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:36.542546] [INFO ] [MAIN ] Derivative Progress: 588/1881 symbols completed. ET took 1.4s. Estimated remaining: 8m 44s. Rate: 148.1 symbols/min [2025-10-27T22:08:36.549881] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:36.741444] [DEBUG] [LOCAL ] ETG: Loaded 16250 existing records from primary storage. [2025-10-27T22:08:36.741831] [INFO ] [MAIN ] ETG: Loaded 16250 primary data records. [2025-10-27T22:08:36.816460] [DEBUG] [LOCAL ] ETJ: Loaded 15848 existing records from primary storage. [2025-10-27T22:08:36.834568] [INFO ] [MAIN ] ETJ: Loaded 15848 primary data records. [2025-10-27T22:08:37.434111] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:37.475797] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:37.526318] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:37.573628] [INFO ] [MAIN ] ETD: Generated 138 derivative records from 26664 primary records. [2025-10-27T22:08:37.574278] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-27T22:08:37.594446] [DEBUG] [LOCAL ] ETD: Derivative data saved (138 records). [2025-10-27T22:08:37.598927] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-27T22:08:37.604295] [INFO ] [MAIN ] Derivative Progress: 589/1881 symbols completed. ETD took 1.3s. Estimated remaining: 8m 45s. Rate: 147.7 symbols/min [2025-10-27T22:08:37.606917] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:37.612255] [INFO ] [MAIN ] ETG: Generated 138 derivative records from 16250 primary records. [2025-10-27T22:08:37.615674] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-27T22:08:37.636635] [DEBUG] [LOCAL ] ETG: Derivative data saved (138 records). [2025-10-27T22:08:37.639154] [INFO ] [MAIN ] ETJ: Generated 138 derivative records from 15848 primary records. [2025-10-27T22:08:37.639240] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-27T22:08:37.642418] [INFO ] [MAIN ] Derivative Progress: 590/1881 symbols completed. ETG took 1.1s. Estimated remaining: 8m 44s. Rate: 147.9 symbols/min [2025-10-27T22:08:37.642811] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-27T22:08:37.642734] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:37.655790] [DEBUG] [LOCAL ] ETJ: Derivative data saved (138 records). [2025-10-27T22:08:37.657776] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-27T22:08:37.660599] [INFO ] [MAIN ] Derivative Progress: 591/1881 symbols completed. ETJ took 1.1s. Estimated remaining: 8m 42s. Rate: 148.1 symbols/min [2025-10-27T22:08:37.661012] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:37.665733] [DEBUG] [LOCAL ] ETO: Loaded 6726 existing records from primary storage. [2025-10-27T22:08:37.666051] [INFO ] [MAIN ] ETO: Loaded 6726 primary data records. [2025-10-27T22:08:37.866168] [DEBUG] [LOCAL ] ETN: Loaded 52514 existing records from primary storage. [2025-10-27T22:08:37.872731] [INFO ] [MAIN ] ETN: Loaded 52514 primary data records. [2025-10-27T22:08:38.073563] [DEBUG] [LOCAL ] ETR: Loaded 53171 existing records from primary storage. [2025-10-27T22:08:38.222983] [INFO ] [MAIN ] ETR: Loaded 53171 primary data records. [2025-10-27T22:08:38.842348] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:38.881236] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:38.920922] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:38.954548] [INFO ] [MAIN ] ETO: Generated 138 derivative records from 6726 primary records. [2025-10-27T22:08:38.956226] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-27T22:08:38.979671] [DEBUG] [LOCAL ] ETO: Derivative data saved (138 records). [2025-10-27T22:08:38.980335] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-27T22:08:38.984912] [INFO ] [MAIN ] Derivative Progress: 592/1881 symbols completed. ETO took 1.3s. Estimated remaining: 8m 44s. Rate: 147.6 symbols/min [2025-10-27T22:08:38.985315] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:38.998871] [INFO ] [MAIN ] ETR: Generated 138 derivative records from 53171 primary records. [2025-10-27T22:08:38.998582] [INFO ] [MAIN ] ETN: Generated 138 derivative records from 52514 primary records. [2025-10-27T22:08:38.999082] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-27T22:08:38.999143] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-27T22:08:39.020728] [DEBUG] [LOCAL ] ETR: Derivative data saved (138 records). [2025-10-27T22:08:39.023873] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-27T22:08:39.023465] [DEBUG] [LOCAL ] ETN: Derivative data saved (138 records). [2025-10-27T22:08:39.026356] [INFO ] [MAIN ] Derivative Progress: 593/1881 symbols completed. ETR took 1.4s. Estimated remaining: 8m 43s. Rate: 147.8 symbols/min [2025-10-27T22:08:39.026590] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:39.026505] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-27T22:08:39.030150] [INFO ] [MAIN ] Derivative Progress: 594/1881 symbols completed. ETN took 1.4s. Estimated remaining: 8m 42s. Rate: 148.1 symbols/min [2025-10-27T22:08:39.030547] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:39.070468] [DEBUG] [LOCAL ] EVC: Loaded 17464 existing records from primary storage. [2025-10-27T22:08:39.070703] [INFO ] [MAIN ] EVC: Loaded 17464 primary data records. [2025-10-27T22:08:39.071003] [DEBUG] [LOCAL ] ETV: Loaded 21341 existing records from primary storage. [2025-10-27T22:08:39.084745] [INFO ] [MAIN ] ETV: Loaded 21341 primary data records. [2025-10-27T22:08:39.141188] [DEBUG] [LOCAL ] ETSY: Loaded 53555 existing records from primary storage. [2025-10-27T22:08:39.190189] [INFO ] [MAIN ] ETSY: Loaded 53555 primary data records. [2025-10-27T22:08:39.985765] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:40.013137] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:40.041234] [DEBUG] [MAIN ] ETSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:40.092686] [INFO ] [MAIN ] ETV: Generated 138 derivative records from 21341 primary records. [2025-10-27T22:08:40.093738] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-27T22:08:40.111288] [DEBUG] [LOCAL ] ETV: Derivative data saved (138 records). [2025-10-27T22:08:40.111381] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-27T22:08:40.114342] [INFO ] [MAIN ] Derivative Progress: 595/1881 symbols completed. ETV took 1.1s. Estimated remaining: 8m 43s. Rate: 147.6 symbols/min [2025-10-27T22:08:40.114759] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:40.121394] [INFO ] [MAIN ] EVC: Generated 138 derivative records from 17464 primary records. [2025-10-27T22:08:40.122927] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-27T22:08:40.124499] [INFO ] [MAIN ] ETSY: Generated 138 derivative records from 53555 primary records. [2025-10-27T22:08:40.124671] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-27T22:08:40.152606] [DEBUG] [LOCAL ] EVC: Derivative data saved (138 records). [2025-10-27T22:08:40.153303] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-27T22:08:40.155667] [DEBUG] [LOCAL ] ETSY: Derivative data saved (138 records). [2025-10-27T22:08:40.155796] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-27T22:08:40.158448] [INFO ] [MAIN ] Derivative Progress: 596/1881 symbols completed. ETSY took 1.2s. Estimated remaining: 8m 41s. Rate: 147.9 symbols/min [2025-10-27T22:08:40.161029] [INFO ] [MAIN ] Derivative Progress: 597/1881 symbols completed. EVC took 1.1s. Estimated remaining: 8m 40s. Rate: 148.1 symbols/min [2025-10-27T22:08:40.160863] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:40.161442] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:40.173345] [DEBUG] [LOCAL ] EVEX: Loaded 33243 existing records from primary storage. [2025-10-27T22:08:40.176455] [INFO ] [MAIN ] EVEX: Loaded 33243 primary data records. [2025-10-27T22:08:40.216083] [DEBUG] [LOCAL ] EVG: Loaded 5652 existing records from primary storage. [2025-10-27T22:08:40.252439] [INFO ] [MAIN ] EVG: Loaded 5652 primary data records. [2025-10-27T22:08:40.276481] [DEBUG] [LOCAL ] EVF: Loaded 9436 existing records from primary storage. [2025-10-27T22:08:40.297025] [INFO ] [MAIN ] EVF: Loaded 9436 primary data records. [2025-10-27T22:08:41.135988] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:41.164803] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:41.191906] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:41.251452] [INFO ] [MAIN ] EVEX: Generated 138 derivative records from 33243 primary records. [2025-10-27T22:08:41.254065] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-27T22:08:41.265889] [DEBUG] [LOCAL ] EVEX: Derivative data saved (138 records). [2025-10-27T22:08:41.266863] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-27T22:08:41.269914] [INFO ] [MAIN ] Derivative Progress: 598/1881 symbols completed. EVEX took 1.2s. Estimated remaining: 8m 41s. Rate: 147.7 symbols/min [2025-10-27T22:08:41.272281] [INFO ] [MAIN ] EVF: Generated 138 derivative records from 9436 primary records. [2025-10-27T22:08:41.273844] [INFO ] [MAIN ] EVG: Generated 138 derivative records from 5652 primary records. [2025-10-27T22:08:41.273918] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-27T22:08:41.273998] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-27T22:08:41.294383] [DEBUG] [LOCAL ] EVF: Derivative data saved (138 records). [2025-10-27T22:08:41.295048] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-27T22:08:41.295116] [DEBUG] [LOCAL ] EVG: Derivative data saved (138 records). [2025-10-27T22:08:41.297779] [INFO ] [MAIN ] Derivative Progress: 599/1881 symbols completed. EVF took 1.1s. Estimated remaining: 8m 40s. Rate: 147.9 symbols/min [2025-10-27T22:08:41.297868] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-27T22:08:41.300297] [INFO ] [MAIN ] Derivative Progress: 600/1881 symbols completed. EVG took 1.1s. Estimated remaining: 8m 39s. Rate: 148.2 symbols/min [2025-10-27T22:08:41.300664] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:41.300614] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:41.300799] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:41.317741] [DEBUG] [LOCAL ] EVN: Loaded 10881 existing records from primary storage. [2025-10-27T22:08:41.317863] [INFO ] [MAIN ] EVN: Loaded 10881 primary data records. [2025-10-27T22:08:41.401802] [DEBUG] [LOCAL ] EVT: Loaded 16213 existing records from primary storage. [2025-10-27T22:08:41.407672] [INFO ] [MAIN ] EVT: Loaded 16213 primary data records. [2025-10-27T22:08:41.587407] [DEBUG] [LOCAL ] EVR: Loaded 32984 existing records from primary storage. [2025-10-27T22:08:41.646321] [INFO ] [MAIN ] EVR: Loaded 32984 primary data records. [2025-10-27T22:08:42.266333] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:42.266090] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:42.332445] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:42.368635] [INFO ] [MAIN ] EVT: Generated 138 derivative records from 16213 primary records. [2025-10-27T22:08:42.372089] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-27T22:08:42.374857] [INFO ] [MAIN ] EVN: Generated 138 derivative records from 10881 primary records. [2025-10-27T22:08:42.375780] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-27T22:08:42.388272] [DEBUG] [LOCAL ] EVT: Derivative data saved (138 records). [2025-10-27T22:08:42.389378] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-27T22:08:42.399100] [INFO ] [MAIN ] Derivative Progress: 601/1881 symbols completed. EVT took 1.1s. Estimated remaining: 8m 40s. Rate: 147.7 symbols/min [2025-10-27T22:08:42.403786] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:42.403544] [DEBUG] [LOCAL ] EVN: Derivative data saved (138 records). [2025-10-27T22:08:42.406224] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-27T22:08:42.408572] [INFO ] [MAIN ] Derivative Progress: 602/1881 symbols completed. EVN took 1.1s. Estimated remaining: 8m 39s. Rate: 148.0 symbols/min [2025-10-27T22:08:42.409178] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:42.417011] [INFO ] [MAIN ] EVR: Generated 138 derivative records from 32984 primary records. [2025-10-27T22:08:42.417152] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-27T22:08:42.429402] [DEBUG] [LOCAL ] EVR: Derivative data saved (138 records). [2025-10-27T22:08:42.429557] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-27T22:08:42.432349] [INFO ] [MAIN ] Derivative Progress: 603/1881 symbols completed. EVR took 1.1s. Estimated remaining: 8m 37s. Rate: 148.2 symbols/min [2025-10-27T22:08:42.432792] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:42.460299] [DEBUG] [LOCAL ] EVTC: Loaded 26579 existing records from primary storage. [2025-10-27T22:08:42.460430] [INFO ] [MAIN ] EVTC: Loaded 26579 primary data records. [2025-10-27T22:08:42.600243] [DEBUG] [LOCAL ] EVTL: Loaded 41802 existing records from primary storage. [2025-10-27T22:08:42.611534] [INFO ] [MAIN ] EVTL: Loaded 41802 primary data records. [2025-10-27T22:08:42.617081] [DEBUG] [LOCAL ] EVTR: Loaded 25721 existing records from primary storage. [2025-10-27T22:08:42.617184] [INFO ] [MAIN ] EVTR: Loaded 25721 primary data records. [2025-10-27T22:08:43.423911] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:43.470524] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:43.498760] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:08:43.561188] [INFO ] [MAIN ] EVTC: Generated 138 derivative records from 26579 primary records. [2025-10-27T22:08:43.563959] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-27T22:08:43.581556] [DEBUG] [LOCAL ] EVTC: Derivative data saved (138 records). [2025-10-27T22:08:43.581834] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-27T22:08:43.583805] [INFO ] [MAIN ] Derivative Progress: 604/1881 symbols completed. EVTC took 1.2s. Estimated remaining: 8m 39s. Rate: 147.8 symbols/min [2025-10-27T22:08:43.568842] [INFO ] [MAIN ] EVTL: Generated 138 derivative records from 41802 primary records. [2025-10-27T22:08:43.581766] [INFO ] [MAIN ] EVTR: Generated 138 derivative records from 25721 primary records. [2025-10-27T22:08:43.584109] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-27T22:08:43.584197] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:43.585110] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-27T22:08:43.610677] [DEBUG] [LOCAL ] EVTL: Derivative data saved (138 records). [2025-10-27T22:08:43.610573] [DEBUG] [LOCAL ] EVTR: Derivative data saved (138 records). [2025-10-27T22:08:43.611012] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-27T22:08:43.610931] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-27T22:08:43.613702] [INFO ] [MAIN ] Derivative Progress: 605/1881 symbols completed. EVTR took 1.2s. Estimated remaining: 8m 37s. Rate: 148.0 symbols/min [2025-10-27T22:08:43.616592] [INFO ] [MAIN ] Derivative Progress: 606/1881 symbols completed. EVTL took 1.2s. Estimated remaining: 8m 36s. Rate: 148.2 symbols/min [2025-10-27T22:08:43.616977] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:43.613982] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:43.687128] [DEBUG] [LOCAL ] EXG: Loaded 33130 existing records from primary storage. [2025-10-27T22:08:43.688222] [INFO ] [MAIN ] EXG: Loaded 33130 primary data records. [2025-10-27T22:08:43.689088] [DEBUG] [LOCAL ] EW: Loaded 53386 existing records from primary storage. [2025-10-27T22:08:43.694291] [INFO ] [MAIN ] EW: Loaded 53386 primary data records. [2025-10-27T22:08:43.901459] [DEBUG] [LOCAL ] EXK: Loaded 53188 existing records from primary storage. [2025-10-27T22:08:43.922548] [INFO ] [MAIN ] EXK: Loaded 53188 primary data records. [2025-10-27T22:08:44.666582] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:44.723763] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:44.771031] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:44.835363] [INFO ] [MAIN ] EW: Generated 138 derivative records from 53386 primary records. [2025-10-27T22:08:44.835224] [INFO ] [MAIN ] EXG: Generated 138 derivative records from 33130 primary records. [2025-10-27T22:08:44.835959] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-27T22:08:44.837755] [INFO ] [MAIN ] EXK: Generated 138 derivative records from 53188 primary records. [2025-10-27T22:08:44.835626] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-27T22:08:44.838229] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-27T22:08:44.859075] [DEBUG] [LOCAL ] EW: Derivative data saved (138 records). [2025-10-27T22:08:44.869211] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-27T22:08:44.874383] [INFO ] [MAIN ] Derivative Progress: 607/1881 symbols completed. EW took 1.3s. Estimated remaining: 8m 38s. Rate: 147.7 symbols/min [2025-10-27T22:08:44.874759] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:44.878204] [DEBUG] [LOCAL ] EXG: Derivative data saved (138 records). [2025-10-27T22:08:44.878429] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-27T22:08:44.871990] [DEBUG] [LOCAL ] EXK: Derivative data saved (138 records). [2025-10-27T22:08:44.882878] [INFO ] [MAIN ] Derivative Progress: 608/1881 symbols completed. EXG took 1.3s. Estimated remaining: 8m 36s. Rate: 147.9 symbols/min [2025-10-27T22:08:44.878701] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-27T22:08:44.883294] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:44.886096] [INFO ] [MAIN ] Derivative Progress: 609/1881 symbols completed. EXK took 1.3s. Estimated remaining: 8m 35s. Rate: 148.2 symbols/min [2025-10-27T22:08:44.886603] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:44.957384] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-27T22:08:44.957968] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-27T22:08:45.051079] [DEBUG] [LOCAL ] FAF: Loaded 41263 existing records from primary storage. [2025-10-27T22:08:45.087707] [INFO ] [MAIN ] FAF: Loaded 41263 primary data records. [2025-10-27T22:08:45.091921] [DEBUG] [LOCAL ] FBIN: Loaded 50259 existing records from primary storage. [2025-10-27T22:08:45.118233] [INFO ] [MAIN ] FBIN: Loaded 50259 primary data records. [2025-10-27T22:08:45.892995] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:45.940465] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:45.942039] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:46.002408] [INFO ] [MAIN ] F: Generated 138 derivative records from 53820 primary records. [2025-10-27T22:08:46.002892] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-27T22:08:46.025044] [DEBUG] [LOCAL ] F: Derivative data saved (138 records). [2025-10-27T22:08:46.027307] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-27T22:08:46.031391] [INFO ] [MAIN ] FBIN: Generated 138 derivative records from 50259 primary records. [2025-10-27T22:08:46.031620] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-27T22:08:46.031002] [INFO ] [MAIN ] Derivative Progress: 610/1881 symbols completed. F took 1.2s. Estimated remaining: 8m 36s. Rate: 147.7 symbols/min [2025-10-27T22:08:46.033972] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:46.034114] [INFO ] [MAIN ] FAF: Generated 138 derivative records from 41263 primary records. [2025-10-27T22:08:46.041872] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-27T22:08:46.047123] [DEBUG] [LOCAL ] FBIN: Derivative data saved (138 records). [2025-10-27T22:08:46.054507] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-27T22:08:46.060511] [INFO ] [MAIN ] Derivative Progress: 611/1881 symbols completed. FBIN took 1.2s. Estimated remaining: 8m 35s. Rate: 148.0 symbols/min [2025-10-27T22:08:46.061378] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:46.061436] [DEBUG] [LOCAL ] FAF: Derivative data saved (138 records). [2025-10-27T22:08:46.062034] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-27T22:08:46.064849] [INFO ] [MAIN ] Derivative Progress: 612/1881 symbols completed. FAF took 1.2s. Estimated remaining: 8m 34s. Rate: 148.2 symbols/min [2025-10-27T22:08:46.065217] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:46.085304] [DEBUG] [LOCAL ] FBK: Loaded 27185 existing records from primary storage. [2025-10-27T22:08:46.085802] [INFO ] [MAIN ] FBK: Loaded 27185 primary data records. [2025-10-27T22:08:46.367517] [DEBUG] [LOCAL ] FBRT: Loaded 34825 existing records from primary storage. [2025-10-27T22:08:46.381780] [INFO ] [MAIN ] FBRT: Loaded 34825 primary data records. [2025-10-27T22:08:46.471814] [DEBUG] [LOCAL ] FBP: Loaded 45446 existing records from primary storage. [2025-10-27T22:08:46.472114] [INFO ] [MAIN ] FBP: Loaded 45446 primary data records. [2025-10-27T22:08:47.075322] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:47.115894] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:47.152197] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:47.193580] [INFO ] [MAIN ] FBK: Generated 138 derivative records from 27185 primary records. [2025-10-27T22:08:47.194881] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-27T22:08:47.213549] [DEBUG] [LOCAL ] FBK: Derivative data saved (138 records). [2025-10-27T22:08:47.214083] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-27T22:08:47.219573] [INFO ] [MAIN ] Derivative Progress: 613/1881 symbols completed. FBK took 1.2s. Estimated remaining: 8m 35s. Rate: 147.8 symbols/min [2025-10-27T22:08:47.223906] [INFO ] [MAIN ] FBRT: Generated 138 derivative records from 34825 primary records. [2025-10-27T22:08:47.224340] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-27T22:08:47.241444] [INFO ] [MAIN ] FBP: Generated 138 derivative records from 45446 primary records. [2025-10-27T22:08:47.242184] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-27T22:08:47.255903] [DEBUG] [LOCAL ] FBRT: Derivative data saved (138 records). [2025-10-27T22:08:47.257502] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-27T22:08:47.260149] [INFO ] [MAIN ] Derivative Progress: 614/1881 symbols completed. FBRT took 1.2s. Estimated remaining: 8m 34s. Rate: 148.0 symbols/min [2025-10-27T22:08:47.261677] [DEBUG] [LOCAL ] FBP: Derivative data saved (138 records). [2025-10-27T22:08:47.261762] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-27T22:08:47.264582] [INFO ] [MAIN ] Derivative Progress: 615/1881 symbols completed. FBP took 1.2s. Estimated remaining: 8m 32s. Rate: 148.2 symbols/min [2025-10-27T22:08:47.264967] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:47.265084] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:47.265170] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:47.288812] [DEBUG] [LOCAL ] FC: Loaded 13951 existing records from primary storage. [2025-10-27T22:08:47.289327] [INFO ] [MAIN ] FC: Loaded 13951 primary data records. [2025-10-27T22:08:47.362328] [DEBUG] [LOCAL ] FCN: Loaded 25826 existing records from primary storage. [2025-10-27T22:08:47.377635] [INFO ] [MAIN ] FCN: Loaded 25826 primary data records. [2025-10-27T22:08:47.512943] [DEBUG] [LOCAL ] FCF: Loaded 38757 existing records from primary storage. [2025-10-27T22:08:47.568222] [INFO ] [MAIN ] FCF: Loaded 38757 primary data records. [2025-10-27T22:08:48.238529] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:48.283700] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:48.288944] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:48.356516] [INFO ] [MAIN ] FC: Generated 138 derivative records from 13951 primary records. [2025-10-27T22:08:48.358818] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-27T22:08:48.383433] [DEBUG] [LOCAL ] FC: Derivative data saved (138 records). [2025-10-27T22:08:48.383942] [INFO ] [MAIN ] FCN: Generated 138 derivative records from 25826 primary records. [2025-10-27T22:08:48.384303] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-27T22:08:48.384114] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-27T22:08:48.387786] [INFO ] [MAIN ] Derivative Progress: 616/1881 symbols completed. FC took 1.1s. Estimated remaining: 8m 34s. Rate: 147.8 symbols/min [2025-10-27T22:08:48.389044] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:48.402564] [DEBUG] [LOCAL ] FCN: Derivative data saved (138 records). [2025-10-27T22:08:48.403053] [INFO ] [MAIN ] FCF: Generated 138 derivative records from 38757 primary records. [2025-10-27T22:08:48.403199] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-27T22:08:48.403465] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-27T22:08:48.406334] [INFO ] [MAIN ] Derivative Progress: 617/1881 symbols completed. FCN took 1.1s. Estimated remaining: 8m 32s. Rate: 148.0 symbols/min [2025-10-27T22:08:48.407234] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:48.419533] [DEBUG] [LOCAL ] FCF: Derivative data saved (138 records). [2025-10-27T22:08:48.419753] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-27T22:08:48.422455] [INFO ] [MAIN ] Derivative Progress: 618/1881 symbols completed. FCF took 1.2s. Estimated remaining: 8m 31s. Rate: 148.3 symbols/min [2025-10-27T22:08:48.422703] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:48.470750] [DEBUG] [LOCAL ] FDP: Loaded 29418 existing records from primary storage. [2025-10-27T22:08:48.472089] [INFO ] [MAIN ] FDP: Loaded 29418 primary data records. [2025-10-27T22:08:48.482382] [DEBUG] [LOCAL ] FDS: Loaded 28149 existing records from primary storage. [2025-10-27T22:08:48.502820] [INFO ] [MAIN ] FDS: Loaded 28149 primary data records. [2025-10-27T22:08:48.525199] [DEBUG] [LOCAL ] FCPT: Loaded 36614 existing records from primary storage. [2025-10-27T22:08:48.525422] [INFO ] [MAIN ] FCPT: Loaded 36614 primary data records. [2025-10-27T22:08:49.536991] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:49.531925] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:49.563441] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:49.633410] [INFO ] [MAIN ] FDP: Generated 138 derivative records from 29418 primary records. [2025-10-27T22:08:49.637351] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-27T22:08:49.652867] [INFO ] [MAIN ] FCPT: Generated 138 derivative records from 36614 primary records. [2025-10-27T22:08:49.653153] [INFO ] [MAIN ] FDS: Generated 138 derivative records from 28149 primary records. [2025-10-27T22:08:49.653257] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-27T22:08:49.655069] [DEBUG] [LOCAL ] FDP: Derivative data saved (138 records). [2025-10-27T22:08:49.653343] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-27T22:08:49.655631] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-27T22:08:49.658141] [INFO ] [MAIN ] Derivative Progress: 619/1881 symbols completed. FDP took 1.3s. Estimated remaining: 8m 32s. Rate: 147.8 symbols/min [2025-10-27T22:08:49.658282] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:49.681608] [DEBUG] [LOCAL ] FDS: Derivative data saved (138 records). [2025-10-27T22:08:49.682251] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-27T22:08:49.685085] [INFO ] [MAIN ] Derivative Progress: 620/1881 symbols completed. FDS took 1.3s. Estimated remaining: 8m 31s. Rate: 148.0 symbols/min [2025-10-27T22:08:49.685306] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:49.681540] [DEBUG] [LOCAL ] FCPT: Derivative data saved (138 records). [2025-10-27T22:08:49.685499] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-27T22:08:49.688226] [INFO ] [MAIN ] Derivative Progress: 621/1881 symbols completed. FCPT took 1.3s. Estimated remaining: 8m 30s. Rate: 148.2 symbols/min [2025-10-27T22:08:49.688449] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:49.753219] [DEBUG] [LOCAL ] FDX: Loaded 51063 existing records from primary storage. [2025-10-27T22:08:49.753488] [INFO ] [MAIN ] FDX: Loaded 51063 primary data records. [2025-10-27T22:08:49.887123] [DEBUG] [LOCAL ] FERG: Loaded 48610 existing records from primary storage. [2025-10-27T22:08:49.886414] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-27T22:08:49.898276] [INFO ] [MAIN ] FE: Loaded 53430 primary data records. [2025-10-27T22:08:49.903576] [INFO ] [MAIN ] FERG: Loaded 48610 primary data records. [2025-10-27T22:08:50.741128] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:50.799601] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:50.800032] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:50.852788] [INFO ] [MAIN ] FDX: Generated 138 derivative records from 51063 primary records. [2025-10-27T22:08:50.857074] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-27T22:08:50.878553] [DEBUG] [LOCAL ] FDX: Derivative data saved (138 records). [2025-10-27T22:08:50.878717] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-27T22:08:50.883451] [INFO ] [MAIN ] Derivative Progress: 622/1881 symbols completed. FDX took 1.2s. Estimated remaining: 8m 31s. Rate: 147.8 symbols/min [2025-10-27T22:08:50.886564] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:50.899306] [INFO ] [MAIN ] FERG: Generated 138 derivative records from 48610 primary records. [2025-10-27T22:08:50.903692] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-27T22:08:50.905546] [INFO ] [MAIN ] FE: Generated 138 derivative records from 53430 primary records. [2025-10-27T22:08:50.906009] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-27T22:08:50.918733] [DEBUG] [LOCAL ] FET: Loaded 12924 existing records from primary storage. [2025-10-27T22:08:50.931680] [INFO ] [MAIN ] FET: Loaded 12924 primary data records. [2025-10-27T22:08:50.934470] [DEBUG] [LOCAL ] FE: Derivative data saved (138 records). [2025-10-27T22:08:50.955059] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-27T22:08:50.967732] [INFO ] [MAIN ] Derivative Progress: 623/1881 symbols completed. FE took 1.3s. Estimated remaining: 8m 30s. Rate: 147.9 symbols/min [2025-10-27T22:08:50.980188] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:51.005954] [DEBUG] [LOCAL ] FERG: Derivative data saved (138 records). [2025-10-27T22:08:51.018073] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-27T22:08:51.038484] [INFO ] [MAIN ] Derivative Progress: 624/1881 symbols completed. FERG took 1.4s. Estimated remaining: 8m 29s. Rate: 148.1 symbols/min [2025-10-27T22:08:51.041911] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:51.124611] [DEBUG] [LOCAL ] FFA: Loaded 5303 existing records from primary storage. [2025-10-27T22:08:51.137057] [INFO ] [MAIN ] FFA: Loaded 5303 primary data records. [2025-10-27T22:08:51.137578] [DEBUG] [LOCAL ] FF: Loaded 23163 existing records from primary storage. [2025-10-27T22:08:51.304144] [INFO ] [MAIN ] FF: Loaded 23163 primary data records. [2025-10-27T22:08:51.912342] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:51.959837] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:51.978261] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:52.035482] [INFO ] [MAIN ] FET: Generated 138 derivative records from 12924 primary records. [2025-10-27T22:08:52.039350] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-27T22:08:52.057739] [DEBUG] [LOCAL ] FET: Derivative data saved (138 records). [2025-10-27T22:08:52.065165] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-27T22:08:52.068231] [INFO ] [MAIN ] Derivative Progress: 625/1881 symbols completed. FET took 1.2s. Estimated remaining: 8m 30s. Rate: 147.8 symbols/min [2025-10-27T22:08:52.070221] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:52.074535] [INFO ] [MAIN ] FFA: Generated 138 derivative records from 5303 primary records. [2025-10-27T22:08:52.078085] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-27T22:08:52.091318] [DEBUG] [LOCAL ] FFA: Derivative data saved (138 records). [2025-10-27T22:08:52.097732] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-27T22:08:52.097662] [INFO ] [MAIN ] FF: Generated 138 derivative records from 23163 primary records. [2025-10-27T22:08:52.100299] [INFO ] [MAIN ] Derivative Progress: 626/1881 symbols completed. FFA took 1.1s. Estimated remaining: 8m 29s. Rate: 148.0 symbols/min [2025-10-27T22:08:52.100440] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:52.100498] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-27T22:08:52.113544] [DEBUG] [LOCAL ] FF: Derivative data saved (138 records). [2025-10-27T22:08:52.113945] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-27T22:08:52.116743] [INFO ] [MAIN ] Derivative Progress: 627/1881 symbols completed. FF took 1.1s. Estimated remaining: 8m 28s. Rate: 148.2 symbols/min [2025-10-27T22:08:52.116953] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:52.123622] [DEBUG] [LOCAL ] FFC: Loaded 16365 existing records from primary storage. [2025-10-27T22:08:52.123757] [INFO ] [MAIN ] FFC: Loaded 16365 primary data records. [2025-10-27T22:08:52.251794] [DEBUG] [LOCAL ] FFWM: Loaded 35352 existing records from primary storage. [2025-10-27T22:08:52.279524] [INFO ] [MAIN ] FFWM: Loaded 35352 primary data records. [2025-10-27T22:08:52.313876] [DEBUG] [LOCAL ] FG: Loaded 20750 existing records from primary storage. [2025-10-27T22:08:52.341856] [INFO ] [MAIN ] FG: Loaded 20750 primary data records. [2025-10-27T22:08:53.114360] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:53.176406] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:53.177287] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:53.216161] [INFO ] [MAIN ] FFC: Generated 138 derivative records from 16365 primary records. [2025-10-27T22:08:53.218909] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-27T22:08:53.236155] [DEBUG] [LOCAL ] FFC: Derivative data saved (138 records). [2025-10-27T22:08:53.239748] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-27T22:08:53.242016] [INFO ] [MAIN ] Derivative Progress: 628/1881 symbols completed. FFC took 1.2s. Estimated remaining: 8m 29s. Rate: 147.8 symbols/min [2025-10-27T22:08:53.267765] [INFO ] [MAIN ] FFWM: Generated 138 derivative records from 35352 primary records. [2025-10-27T22:08:53.265806] [INFO ] [MAIN ] FG: Generated 138 derivative records from 20750 primary records. [2025-10-27T22:08:53.267930] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-27T22:08:53.268032] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-27T22:08:53.290845] [DEBUG] [LOCAL ] FFWM: Derivative data saved (138 records). [2025-10-27T22:08:53.290942] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-27T22:08:53.294438] [DEBUG] [LOCAL ] FG: Derivative data saved (138 records). [2025-10-27T22:08:53.294537] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-27T22:08:53.293625] [INFO ] [MAIN ] Derivative Progress: 629/1881 symbols completed. FFWM took 1.2s. Estimated remaining: 8m 28s. Rate: 148.0 symbols/min [2025-10-27T22:08:53.297417] [INFO ] [MAIN ] Derivative Progress: 630/1881 symbols completed. FG took 1.2s. Estimated remaining: 8m 26s. Rate: 148.2 symbols/min [2025-10-27T22:08:53.298009] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:53.298106] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:53.297953] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:53.344996] [DEBUG] [LOCAL ] FHI: Loaded 39290 existing records from primary storage. [2025-10-27T22:08:53.345120] [INFO ] [MAIN ] FHI: Loaded 39290 primary data records. [2025-10-27T22:08:53.501207] [DEBUG] [LOCAL ] FI: Loaded 53574 existing records from primary storage. [2025-10-27T22:08:53.539748] [INFO ] [MAIN ] FI: Loaded 53574 primary data records. [2025-10-27T22:08:53.633883] [DEBUG] [LOCAL ] FHN: Loaded 53398 existing records from primary storage. [2025-10-27T22:08:53.724971] [INFO ] [MAIN ] FHN: Loaded 53398 primary data records. [2025-10-27T22:08:54.298159] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:54.334725] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:54.369004] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:54.405440] [INFO ] [MAIN ] FHI: Generated 138 derivative records from 39290 primary records. [2025-10-27T22:08:54.405798] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-27T22:08:54.422672] [DEBUG] [LOCAL ] FHI: Derivative data saved (138 records). [2025-10-27T22:08:54.426318] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-27T22:08:54.428597] [INFO ] [MAIN ] Derivative Progress: 631/1881 symbols completed. FHI took 1.1s. Estimated remaining: 8m 27s. Rate: 147.8 symbols/min [2025-10-27T22:08:54.429033] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:54.440365] [INFO ] [MAIN ] FI: Generated 138 derivative records from 53574 primary records. [2025-10-27T22:08:54.442031] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-27T22:08:54.459315] [INFO ] [MAIN ] FHN: Generated 138 derivative records from 53398 primary records. [2025-10-27T22:08:54.460583] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-27T22:08:54.462368] [DEBUG] [LOCAL ] FI: Derivative data saved (138 records). [2025-10-27T22:08:54.463040] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-27T22:08:54.466274] [INFO ] [MAIN ] Derivative Progress: 632/1881 symbols completed. FI took 1.2s. Estimated remaining: 8m 26s. Rate: 148.0 symbols/min [2025-10-27T22:08:54.466800] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:54.485845] [DEBUG] [LOCAL ] FHN: Derivative data saved (138 records). [2025-10-27T22:08:54.485960] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-27T22:08:54.486381] [DEBUG] [LOCAL ] FICO: Loaded 21863 existing records from primary storage. [2025-10-27T22:08:54.486576] [INFO ] [MAIN ] FICO: Loaded 21863 primary data records. [2025-10-27T22:08:54.489906] [INFO ] [MAIN ] Derivative Progress: 633/1881 symbols completed. FHN took 1.2s. Estimated remaining: 8m 25s. Rate: 148.3 symbols/min [2025-10-27T22:08:54.520873] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:54.829578] [DEBUG] [LOCAL ] FIGS: Loaded 48361 existing records from primary storage. [2025-10-27T22:08:54.830387] [INFO ] [MAIN ] FIGS: Loaded 48361 primary data records. [2025-10-27T22:08:54.830222] [DEBUG] [LOCAL ] FIHL: Loaded 38701 existing records from primary storage. [2025-10-27T22:08:54.864113] [INFO ] [MAIN ] FIHL: Loaded 38701 primary data records. [2025-10-27T22:08:55.486402] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:08:55.547402] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:55.566148] [INFO ] [MAIN ] FICO: Generated 138 derivative records from 21863 primary records. [2025-10-27T22:08:55.567548] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-27T22:08:55.585245] [DEBUG] [LOCAL ] FICO: Derivative data saved (138 records). [2025-10-27T22:08:55.585457] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-27T22:08:55.588080] [INFO ] [MAIN ] Derivative Progress: 634/1881 symbols completed. FICO took 1.2s. Estimated remaining: 8m 26s. Rate: 147.9 symbols/min [2025-10-27T22:08:55.601068] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:55.603802] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:55.632594] [DEBUG] [LOCAL ] FINS: Loaded 8194 existing records from primary storage. [2025-10-27T22:08:55.633881] [INFO ] [MAIN ] FINS: Loaded 8194 primary data records. [2025-10-27T22:08:55.943618] [INFO ] [MAIN ] FIHL: Generated 138 derivative records from 38701 primary records. [2025-10-27T22:08:55.945764] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-27T22:08:55.946134] [INFO ] [MAIN ] FIGS: Generated 138 derivative records from 48361 primary records. [2025-10-27T22:08:55.947351] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-27T22:08:55.959249] [DEBUG] [LOCAL ] FIHL: Derivative data saved (138 records). [2025-10-27T22:08:55.960204] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-27T22:08:55.973573] [INFO ] [MAIN ] Derivative Progress: 635/1881 symbols completed. FIHL took 1.5s. Estimated remaining: 8m 26s. Rate: 147.9 symbols/min [2025-10-27T22:08:55.974278] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:55.974832] [DEBUG] [LOCAL ] FIGS: Derivative data saved (138 records). [2025-10-27T22:08:55.975266] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-27T22:08:55.978178] [INFO ] [MAIN ] Derivative Progress: 636/1881 symbols completed. FIGS took 1.5s. Estimated remaining: 8m 24s. Rate: 148.1 symbols/min [2025-10-27T22:08:55.978324] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:56.003437] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:56.069377] [DEBUG] [LOCAL ] FINV: Loaded 45169 existing records from primary storage. [2025-10-27T22:08:56.082683] [INFO ] [MAIN ] FINV: Loaded 45169 primary data records. [2025-10-27T22:08:56.121526] [DEBUG] [LOCAL ] FIS: Loaded 53324 existing records from primary storage. [2025-10-27T22:08:56.162579] [INFO ] [MAIN ] FIS: Loaded 53324 primary data records. [2025-10-27T22:08:56.162969] [INFO ] [MAIN ] FINS: Generated 138 derivative records from 8194 primary records. [2025-10-27T22:08:56.168523] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-27T22:08:56.275903] [DEBUG] [LOCAL ] FINS: Derivative data saved (138 records). [2025-10-27T22:08:56.303280] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-27T22:08:56.328342] [INFO ] [MAIN ] Derivative Progress: 637/1881 symbols completed. FINS took 0.7s. Estimated remaining: 8m 24s. Rate: 148.1 symbols/min [2025-10-27T22:08:56.335685] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:56.724077] [DEBUG] [LOCAL ] FIX: Loaded 28309 existing records from primary storage. [2025-10-27T22:08:56.725385] [INFO ] [MAIN ] FIX: Loaded 28309 primary data records. [2025-10-27T22:08:56.920025] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:57.108919] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:57.203303] [INFO ] [MAIN ] FINV: Generated 138 derivative records from 45169 primary records. [2025-10-27T22:08:57.206729] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-27T22:08:57.230452] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:08:57.246524] [DEBUG] [LOCAL ] FINV: Derivative data saved (138 records). [2025-10-27T22:08:57.249638] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-27T22:08:57.252949] [INFO ] [MAIN ] Derivative Progress: 638/1881 symbols completed. FINV took 1.3s. Estimated remaining: 8m 24s. Rate: 147.8 symbols/min [2025-10-27T22:08:57.253171] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:57.270174] [INFO ] [MAIN ] FIS: Generated 138 derivative records from 53324 primary records. [2025-10-27T22:08:57.269902] [DEBUG] [LOCAL ] FLC: Loaded 5167 existing records from primary storage. [2025-10-27T22:08:57.270519] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-27T22:08:57.270454] [INFO ] [MAIN ] FLC: Loaded 5167 primary data records. [2025-10-27T22:08:57.353639] [DEBUG] [LOCAL ] FIS: Derivative data saved (138 records). [2025-10-27T22:08:57.354990] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-27T22:08:57.369700] [INFO ] [MAIN ] Derivative Progress: 639/1881 symbols completed. FIS took 1.4s. Estimated remaining: 8m 24s. Rate: 148.0 symbols/min [2025-10-27T22:08:57.388046] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:57.598379] [INFO ] [MAIN ] FIX: Generated 138 derivative records from 28309 primary records. [2025-10-27T22:08:57.598707] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-27T22:08:57.611936] [DEBUG] [LOCAL ] FIX: Derivative data saved (138 records). [2025-10-27T22:08:57.612480] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-27T22:08:57.615584] [INFO ] [MAIN ] Derivative Progress: 640/1881 symbols completed. FIX took 1.3s. Estimated remaining: 8m 23s. Rate: 148.1 symbols/min [2025-10-27T22:08:57.629566] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:57.672467] [DEBUG] [LOCAL ] FLG: Loaded 53317 existing records from primary storage. [2025-10-27T22:08:57.672871] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:57.673066] [INFO ] [MAIN ] FLG: Loaded 53317 primary data records. [2025-10-27T22:08:57.779349] [DEBUG] [LOCAL ] FLNG: Loaded 32921 existing records from primary storage. [2025-10-27T22:08:57.820537] [INFO ] [MAIN ] FLNG: Loaded 32921 primary data records. [2025-10-27T22:08:58.311557] [INFO ] [MAIN ] FLC: Generated 138 derivative records from 5167 primary records. [2025-10-27T22:08:58.312173] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-27T22:08:58.326316] [DEBUG] [LOCAL ] FLC: Derivative data saved (138 records). [2025-10-27T22:08:58.326516] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-27T22:08:58.328589] [INFO ] [MAIN ] Derivative Progress: 641/1881 symbols completed. FLC took 1.1s. Estimated remaining: 8m 23s. Rate: 147.9 symbols/min [2025-10-27T22:08:58.328926] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:58.347451] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:58.391122] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:58.429814] [INFO ] [MAIN ] FLG: Generated 138 derivative records from 53317 primary records. [2025-10-27T22:08:58.430313] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-27T22:08:58.461119] [DEBUG] [LOCAL ] FLG: Derivative data saved (138 records). [2025-10-27T22:08:58.462147] [DEBUG] [LOCAL ] FLO: Loaded 52066 existing records from primary storage. [2025-10-27T22:08:58.463480] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-27T22:08:58.463944] [INFO ] [MAIN ] FLO: Loaded 52066 primary data records. [2025-10-27T22:08:58.467059] [INFO ] [MAIN ] Derivative Progress: 642/1881 symbols completed. FLG took 1.1s. Estimated remaining: 8m 22s. Rate: 148.1 symbols/min [2025-10-27T22:08:58.467353] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:58.603153] [INFO ] [MAIN ] FLNG: Generated 138 derivative records from 32921 primary records. [2025-10-27T22:08:58.608623] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-27T22:08:58.676117] [DEBUG] [LOCAL ] FLNG: Derivative data saved (138 records). [2025-10-27T22:08:58.676304] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-27T22:08:58.679261] [INFO ] [MAIN ] Derivative Progress: 643/1881 symbols completed. FLNG took 1.0s. Estimated remaining: 8m 21s. Rate: 148.2 symbols/min [2025-10-27T22:08:58.826377] [DEBUG] [LOCAL ] FLR: Loaded 53242 existing records from primary storage. [2025-10-27T22:08:58.826739] [INFO ] [MAIN ] FLR: Loaded 53242 primary data records. [2025-10-27T22:08:59.129070] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:59.171970] [INFO ] [MAIN ] FLO: Generated 138 derivative records from 52066 primary records. [2025-10-27T22:08:59.184758] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:08:59.184853] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-27T22:08:59.213108] [DEBUG] [LOCAL ] FLO: Derivative data saved (138 records). [2025-10-27T22:08:59.215699] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-27T22:08:59.217972] [INFO ] [MAIN ] Derivative Progress: 644/1881 symbols completed. FLO took 0.9s. Estimated remaining: 8m 21s. Rate: 148.1 symbols/min [2025-10-27T22:08:59.228289] [INFO ] [MAIN ] FLR: Generated 138 derivative records from 53242 primary records. [2025-10-27T22:08:59.228396] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-27T22:08:59.239780] [DEBUG] [LOCAL ] FLR: Derivative data saved (138 records). [2025-10-27T22:08:59.239837] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-27T22:08:59.242453] [INFO ] [MAIN ] Derivative Progress: 645/1881 symbols completed. FLR took 0.8s. Estimated remaining: 8m 20s. Rate: 148.3 symbols/min [2025-10-27T22:08:59.243110] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:59.243252] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:59.243984] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:08:59.267381] [DEBUG] [LOCAL ] FLXR: Loaded 21635 existing records from primary storage. [2025-10-27T22:08:59.278227] [INFO ] [MAIN ] FLXR: Loaded 21635 primary data records. [2025-10-27T22:08:59.417101] [DEBUG] [LOCAL ] FLS: Loaded 50378 existing records from primary storage. [2025-10-27T22:08:59.448861] [INFO ] [MAIN ] FLS: Loaded 50378 primary data records. [2025-10-27T22:08:59.705677] [DEBUG] [LOCAL ] FLUT: Loaded 50601 existing records from primary storage. [2025-10-27T22:08:59.726844] [INFO ] [MAIN ] FLUT: Loaded 50601 primary data records. [2025-10-27T22:09:00.330186] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:00.374097] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:00.436721] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:00.458341] [INFO ] [MAIN ] FLXR: Generated 138 derivative records from 21635 primary records. [2025-10-27T22:09:00.459618] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-27T22:09:00.477761] [DEBUG] [LOCAL ] FLXR: Derivative data saved (138 records). [2025-10-27T22:09:00.481053] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-27T22:09:00.484063] [INFO ] [MAIN ] Derivative Progress: 646/1881 symbols completed. FLXR took 1.2s. Estimated remaining: 8m 21s. Rate: 147.8 symbols/min [2025-10-27T22:09:00.485942] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:00.506169] [INFO ] [MAIN ] FLS: Generated 138 derivative records from 50378 primary records. [2025-10-27T22:09:00.507577] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-27T22:09:00.523799] [DEBUG] [LOCAL ] FLS: Derivative data saved (138 records). [2025-10-27T22:09:00.523894] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-27T22:09:00.526148] [INFO ] [MAIN ] Derivative Progress: 647/1881 symbols completed. FLS took 1.3s. Estimated remaining: 8m 20s. Rate: 148.0 symbols/min [2025-10-27T22:09:00.526454] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:00.545306] [INFO ] [MAIN ] FLUT: Generated 138 derivative records from 50601 primary records. [2025-10-27T22:09:00.546737] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-27T22:09:00.563300] [DEBUG] [LOCAL ] FLUT: Derivative data saved (138 records). [2025-10-27T22:09:00.563399] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-27T22:09:00.560320] [DEBUG] [LOCAL ] FMN: Loaded 5419 existing records from primary storage. [2025-10-27T22:09:00.566760] [INFO ] [MAIN ] Derivative Progress: 648/1881 symbols completed. FLUT took 1.3s. Estimated remaining: 8m 19s. Rate: 148.3 symbols/min [2025-10-27T22:09:00.568010] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:00.567034] [INFO ] [MAIN ] FMN: Loaded 5419 primary data records. [2025-10-27T22:09:00.650701] [DEBUG] [LOCAL ] FMC: Loaded 51842 existing records from primary storage. [2025-10-27T22:09:00.662371] [INFO ] [MAIN ] FMC: Loaded 51842 primary data records. [2025-10-27T22:09:00.922059] [DEBUG] [LOCAL ] FMS: Loaded 30079 existing records from primary storage. [2025-10-27T22:09:01.038313] [INFO ] [MAIN ] FMS: Loaded 30079 primary data records. [2025-10-27T22:09:01.632612] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:01.681073] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:01.734402] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:01.757522] [INFO ] [MAIN ] FMN: Generated 138 derivative records from 5419 primary records. [2025-10-27T22:09:01.758925] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-27T22:09:01.777632] [DEBUG] [LOCAL ] FMN: Derivative data saved (138 records). [2025-10-27T22:09:01.778048] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-27T22:09:01.780033] [INFO ] [MAIN ] Derivative Progress: 649/1881 symbols completed. FMN took 1.3s. Estimated remaining: 8m 20s. Rate: 147.8 symbols/min [2025-10-27T22:09:01.782024] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:01.800516] [INFO ] [MAIN ] FMC: Generated 138 derivative records from 51842 primary records. [2025-10-27T22:09:01.802531] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-27T22:09:01.829798] [DEBUG] [LOCAL ] FMC: Derivative data saved (138 records). [2025-10-27T22:09:01.832356] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-27T22:09:01.832267] [INFO ] [MAIN ] FMS: Generated 138 derivative records from 30079 primary records. [2025-10-27T22:09:01.835540] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-27T22:09:01.835372] [INFO ] [MAIN ] Derivative Progress: 650/1881 symbols completed. FMC took 1.3s. Estimated remaining: 8m 19s. Rate: 148.0 symbols/min [2025-10-27T22:09:01.835780] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:01.850182] [DEBUG] [LOCAL ] FMS: Derivative data saved (138 records). [2025-10-27T22:09:01.853435] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-27T22:09:01.856726] [INFO ] [MAIN ] Derivative Progress: 651/1881 symbols completed. FMS took 1.3s. Estimated remaining: 8m 18s. Rate: 148.2 symbols/min [2025-10-27T22:09:01.867751] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:01.853714] [DEBUG] [LOCAL ] FMY: Loaded 1320 existing records from primary storage. [2025-10-27T22:09:01.868406] [INFO ] [MAIN ] FMY: Loaded 1320 primary data records. [2025-10-27T22:09:01.869182] [DEBUG] [LOCAL ] FMX: Loaded 39996 existing records from primary storage. [2025-10-27T22:09:01.882347] [INFO ] [MAIN ] FMX: Loaded 39996 primary data records. [2025-10-27T22:09:02.201266] [DEBUG] [LOCAL ] FN: Loaded 37005 existing records from primary storage. [2025-10-27T22:09:02.283305] [INFO ] [MAIN ] FN: Loaded 37005 primary data records. [2025-10-27T22:09:02.882760] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:02.883420] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:02.946888] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:02.988921] [INFO ] [MAIN ] FMX: Generated 138 derivative records from 39996 primary records. [2025-10-27T22:09:02.991976] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-27T22:09:03.008184] [DEBUG] [LOCAL ] FMX: Derivative data saved (138 records). [2025-10-27T22:09:03.009893] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-27T22:09:03.013345] [INFO ] [MAIN ] Derivative Progress: 652/1881 symbols completed. FMX took 1.2s. Estimated remaining: 8m 19s. Rate: 147.8 symbols/min [2025-10-27T22:09:03.013526] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:03.015544] [INFO ] [MAIN ] FMY: Generated 138 derivative records from 1320 primary records. [2025-10-27T22:09:03.017250] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-27T22:09:03.028760] [DEBUG] [LOCAL ] FMY: Derivative data saved (138 records). [2025-10-27T22:09:03.028931] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-27T22:09:03.031238] [INFO ] [MAIN ] Derivative Progress: 653/1881 symbols completed. FMY took 1.2s. Estimated remaining: 8m 18s. Rate: 148.0 symbols/min [2025-10-27T22:09:03.031509] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:03.034252] [INFO ] [MAIN ] FN: Generated 138 derivative records from 37005 primary records. [2025-10-27T22:09:03.034485] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-27T22:09:03.047349] [DEBUG] [LOCAL ] FN: Derivative data saved (138 records). [2025-10-27T22:09:03.048266] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-27T22:09:03.050987] [INFO ] [MAIN ] Derivative Progress: 654/1881 symbols completed. FN took 1.2s. Estimated remaining: 8m 17s. Rate: 148.2 symbols/min [2025-10-27T22:09:03.051358] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:03.101555] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-27T22:09:03.112850] [INFO ] [MAIN ] FNB: Loaded 52602 primary data records. [2025-10-27T22:09:03.181278] [DEBUG] [LOCAL ] FND: Loaded 52045 existing records from primary storage. [2025-10-27T22:09:03.201523] [INFO ] [MAIN ] FND: Loaded 52045 primary data records. [2025-10-27T22:09:03.406727] [DEBUG] [LOCAL ] FNF: Loaded 48527 existing records from primary storage. [2025-10-27T22:09:03.531492] [INFO ] [MAIN ] FNF: Loaded 48527 primary data records. [2025-10-27T22:09:04.095997] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:04.130455] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:04.170632] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:04.237202] [INFO ] [MAIN ] FNB: Generated 138 derivative records from 52602 primary records. [2025-10-27T22:09:04.238882] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-27T22:09:04.254724] [DEBUG] [LOCAL ] FNB: Derivative data saved (138 records). [2025-10-27T22:09:04.256991] [INFO ] [MAIN ] FNF: Generated 138 derivative records from 48527 primary records. [2025-10-27T22:09:04.254999] [INFO ] [MAIN ] FND: Generated 138 derivative records from 52045 primary records. [2025-10-27T22:09:04.257278] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-27T22:09:04.257402] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-27T22:09:04.259816] [INFO ] [MAIN ] Derivative Progress: 655/1881 symbols completed. FNB took 1.2s. Estimated remaining: 8m 18s. Rate: 147.8 symbols/min [2025-10-27T22:09:04.257840] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-27T22:09:04.259977] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:04.284209] [DEBUG] [LOCAL ] FND: Derivative data saved (138 records). [2025-10-27T22:09:04.285739] [DEBUG] [LOCAL ] FNF: Derivative data saved (138 records). [2025-10-27T22:09:04.285916] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-27T22:09:04.286118] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-27T22:09:04.289257] [INFO ] [MAIN ] Derivative Progress: 656/1881 symbols completed. FNF took 1.2s. Estimated remaining: 8m 17s. Rate: 148.0 symbols/min [2025-10-27T22:09:04.292562] [INFO ] [MAIN ] Derivative Progress: 657/1881 symbols completed. FND took 1.3s. Estimated remaining: 8m 16s. Rate: 148.2 symbols/min [2025-10-27T22:09:04.292851] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:04.292395] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:04.308824] [DEBUG] [LOCAL ] FOF: Loaded 8138 existing records from primary storage. [2025-10-27T22:09:04.309017] [INFO ] [MAIN ] FOF: Loaded 8138 primary data records. [2025-10-27T22:09:04.427301] [DEBUG] [LOCAL ] FOA: Loaded 12847 existing records from primary storage. [2025-10-27T22:09:04.431505] [INFO ] [MAIN ] FOA: Loaded 12847 primary data records. [2025-10-27T22:09:04.487539] [DEBUG] [LOCAL ] FNV: Loaded 45932 existing records from primary storage. [2025-10-27T22:09:04.571118] [INFO ] [MAIN ] FNV: Loaded 45932 primary data records. [2025-10-27T22:09:05.296289] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:05.325797] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:05.367236] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:05.420501] [INFO ] [MAIN ] FOF: Generated 138 derivative records from 8138 primary records. [2025-10-27T22:09:05.422348] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-27T22:09:05.444468] [DEBUG] [LOCAL ] FOF: Derivative data saved (138 records). [2025-10-27T22:09:05.447688] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-27T22:09:05.452681] [INFO ] [MAIN ] Derivative Progress: 658/1881 symbols completed. FOF took 1.2s. Estimated remaining: 8m 17s. Rate: 147.8 symbols/min [2025-10-27T22:09:05.453261] [INFO ] [MAIN ] FOA: Generated 138 derivative records from 12847 primary records. [2025-10-27T22:09:05.453874] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-27T22:09:05.456413] [INFO ] [MAIN ] FNV: Generated 138 derivative records from 45932 primary records. [2025-10-27T22:09:05.463911] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-27T22:09:05.468713] [DEBUG] [LOCAL ] FOA: Derivative data saved (138 records). [2025-10-27T22:09:05.469080] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-27T22:09:05.471599] [INFO ] [MAIN ] Derivative Progress: 659/1881 symbols completed. FOA took 1.2s. Estimated remaining: 8m 15s. Rate: 148.0 symbols/min [2025-10-27T22:09:05.483489] [DEBUG] [LOCAL ] FNV: Derivative data saved (138 records). [2025-10-27T22:09:05.483593] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-27T22:09:05.486350] [INFO ] [MAIN ] Derivative Progress: 660/1881 symbols completed. FNV took 1.2s. Estimated remaining: 8m 14s. Rate: 148.2 symbols/min [2025-10-27T22:09:05.486816] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:05.486926] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:05.487284] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:05.516611] [DEBUG] [LOCAL ] FOR: Loaded 19027 existing records from primary storage. [2025-10-27T22:09:05.516906] [INFO ] [MAIN ] FOR: Loaded 19027 primary data records. [2025-10-27T22:09:05.517262] [DEBUG] [LOCAL ] FPF: Loaded 18490 existing records from primary storage. [2025-10-27T22:09:05.561581] [INFO ] [MAIN ] FPF: Loaded 18490 primary data records. [2025-10-27T22:09:05.778229] [DEBUG] [LOCAL ] FOUR: Loaded 49574 existing records from primary storage. [2025-10-27T22:09:05.817761] [INFO ] [MAIN ] FOUR: Loaded 49574 primary data records. [2025-10-27T22:09:06.542994] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:06.543333] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:06.589764] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:06.658120] [INFO ] [MAIN ] FOR: Generated 138 derivative records from 19027 primary records. [2025-10-27T22:09:06.661667] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-27T22:09:06.678072] [DEBUG] [LOCAL ] FOR: Derivative data saved (138 records). [2025-10-27T22:09:06.675134] [INFO ] [MAIN ] FPF: Generated 138 derivative records from 18490 primary records. [2025-10-27T22:09:06.678345] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-27T22:09:06.680583] [INFO ] [MAIN ] Derivative Progress: 661/1881 symbols completed. FOR took 1.2s. Estimated remaining: 8m 15s. Rate: 147.8 symbols/min [2025-10-27T22:09:06.683394] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-27T22:09:06.683534] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:06.700076] [DEBUG] [LOCAL ] FPF: Derivative data saved (138 records). [2025-10-27T22:09:06.700427] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-27T22:09:06.705523] [INFO ] [MAIN ] FOUR: Generated 138 derivative records from 49574 primary records. [2025-10-27T22:09:06.705100] [INFO ] [MAIN ] Derivative Progress: 662/1881 symbols completed. FPF took 1.2s. Estimated remaining: 8m 14s. Rate: 148.0 symbols/min [2025-10-27T22:09:06.705852] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-27T22:09:06.705958] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:06.724615] [DEBUG] [LOCAL ] FOUR: Derivative data saved (138 records). [2025-10-27T22:09:06.724829] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-27T22:09:06.727374] [INFO ] [MAIN ] Derivative Progress: 663/1881 symbols completed. FOUR took 1.2s. Estimated remaining: 8m 13s. Rate: 148.2 symbols/min [2025-10-27T22:09:06.727613] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:06.735125] [DEBUG] [LOCAL ] FPH: Loaded 19064 existing records from primary storage. [2025-10-27T22:09:06.735257] [INFO ] [MAIN ] FPH: Loaded 19064 primary data records. [2025-10-27T22:09:06.857093] [DEBUG] [LOCAL ] FRA: Loaded 13514 existing records from primary storage. [2025-10-27T22:09:06.863110] [INFO ] [MAIN ] FRA: Loaded 13514 primary data records. [2025-10-27T22:09:06.983153] [DEBUG] [LOCAL ] FPI: Loaded 31057 existing records from primary storage. [2025-10-27T22:09:07.010267] [INFO ] [MAIN ] FPI: Loaded 31057 primary data records. [2025-10-27T22:09:07.758056] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:07.792980] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:07.833431] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:07.885027] [INFO ] [MAIN ] FPH: Generated 138 derivative records from 19064 primary records. [2025-10-27T22:09:07.887902] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-27T22:09:07.910852] [DEBUG] [LOCAL ] FPH: Derivative data saved (138 records). [2025-10-27T22:09:07.911560] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-27T22:09:07.913834] [INFO ] [MAIN ] Derivative Progress: 664/1881 symbols completed. FPH took 1.2s. Estimated remaining: 8m 14s. Rate: 147.8 symbols/min [2025-10-27T22:09:07.911134] [INFO ] [MAIN ] FRA: Generated 138 derivative records from 13514 primary records. [2025-10-27T22:09:07.914144] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:07.914358] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-27T22:09:07.919461] [INFO ] [MAIN ] FPI: Generated 138 derivative records from 31057 primary records. [2025-10-27T22:09:07.919837] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-27T22:09:07.932543] [DEBUG] [LOCAL ] FRA: Derivative data saved (138 records). [2025-10-27T22:09:07.932716] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-27T22:09:07.949520] [INFO ] [MAIN ] Derivative Progress: 665/1881 symbols completed. FRA took 1.2s. Estimated remaining: 8m 13s. Rate: 148.0 symbols/min [2025-10-27T22:09:07.951705] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:07.951865] [DEBUG] [LOCAL ] FPI: Derivative data saved (138 records). [2025-10-27T22:09:07.951996] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-27T22:09:07.955286] [INFO ] [MAIN ] Derivative Progress: 666/1881 symbols completed. FPI took 1.2s. Estimated remaining: 8m 12s. Rate: 148.2 symbols/min [2025-10-27T22:09:07.961152] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:07.961822] [DEBUG] [LOCAL ] FRGE: Loaded 15237 existing records from primary storage. [2025-10-27T22:09:07.961995] [INFO ] [MAIN ] FRGE: Loaded 15237 primary data records. [2025-10-27T22:09:08.306005] [DEBUG] [LOCAL ] FRO: Loaded 51628 existing records from primary storage. [2025-10-27T22:09:08.307280] [INFO ] [MAIN ] FRO: Loaded 51628 primary data records. [2025-10-27T22:09:08.330537] [DEBUG] [LOCAL ] FRT: Loaded 41110 existing records from primary storage. [2025-10-27T22:09:08.350185] [INFO ] [MAIN ] FRT: Loaded 41110 primary data records. [2025-10-27T22:09:08.942120] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:08.995742] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:09.020975] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:09.039819] [INFO ] [MAIN ] FRGE: Generated 138 derivative records from 15237 primary records. [2025-10-27T22:09:09.039986] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-27T22:09:09.056173] [DEBUG] [LOCAL ] FRGE: Derivative data saved (138 records). [2025-10-27T22:09:09.056303] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-27T22:09:09.064603] [INFO ] [MAIN ] Derivative Progress: 667/1881 symbols completed. FRGE took 1.2s. Estimated remaining: 8m 13s. Rate: 147.8 symbols/min [2025-10-27T22:09:09.066625] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:09.125774] [INFO ] [MAIN ] FRT: Generated 138 derivative records from 41110 primary records. [2025-10-27T22:09:09.128196] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-27T22:09:09.128875] [DEBUG] [LOCAL ] FSCO: Loaded 38336 existing records from primary storage. [2025-10-27T22:09:09.129962] [INFO ] [MAIN ] FSCO: Loaded 38336 primary data records. [2025-10-27T22:09:09.129541] [INFO ] [MAIN ] FRO: Generated 138 derivative records from 51628 primary records. [2025-10-27T22:09:09.148016] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-27T22:09:09.217892] [DEBUG] [LOCAL ] FRO: Derivative data saved (138 records). [2025-10-27T22:09:09.217533] [DEBUG] [LOCAL ] FRT: Derivative data saved (138 records). [2025-10-27T22:09:09.245367] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-27T22:09:09.261162] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-27T22:09:09.253594] [INFO ] [MAIN ] Derivative Progress: 668/1881 symbols completed. FRO took 1.3s. Estimated remaining: 8m 12s. Rate: 147.9 symbols/min [2025-10-27T22:09:09.275463] [INFO ] [MAIN ] Derivative Progress: 669/1881 symbols completed. FRT took 1.3s. Estimated remaining: 8m 11s. Rate: 148.1 symbols/min [2025-10-27T22:09:09.273014] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:09.276420] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:09.540147] [DEBUG] [LOCAL ] FSK: Loaded 49397 existing records from primary storage. [2025-10-27T22:09:09.541174] [DEBUG] [LOCAL ] FSLY: Loaded 51237 existing records from primary storage. [2025-10-27T22:09:09.541490] [INFO ] [MAIN ] FSLY: Loaded 51237 primary data records. [2025-10-27T22:09:09.541811] [INFO ] [MAIN ] FSK: Loaded 49397 primary data records. [2025-10-27T22:09:09.599601] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:10.263510] [INFO ] [MAIN ] FSCO: Generated 138 derivative records from 38336 primary records. [2025-10-27T22:09:10.264215] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-27T22:09:10.277563] [DEBUG] [LOCAL ] FSCO: Derivative data saved (138 records). [2025-10-27T22:09:10.277727] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-27T22:09:10.280194] [INFO ] [MAIN ] Derivative Progress: 670/1881 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 12s. Rate: 147.8 symbols/min [2025-10-27T22:09:10.280445] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:10.308606] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:10.328557] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:10.404297] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-27T22:09:10.406012] [INFO ] [MAIN ] FSM: Loaded 53298 primary data records. [2025-10-27T22:09:10.482141] [INFO ] [MAIN ] FSK: Generated 138 derivative records from 49397 primary records. [2025-10-27T22:09:10.516144] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-27T22:09:10.709418] [INFO ] [MAIN ] FSLY: Generated 138 derivative records from 51237 primary records. [2025-10-27T22:09:10.709588] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-27T22:09:10.738424] [DEBUG] [LOCAL ] FSK: Derivative data saved (138 records). [2025-10-27T22:09:10.738700] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-27T22:09:10.740865] [INFO ] [MAIN ] Derivative Progress: 671/1881 symbols completed. FSK took 1.5s. Estimated remaining: 8m 11s. Rate: 147.8 symbols/min [2025-10-27T22:09:10.741167] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:10.747628] [DEBUG] [LOCAL ] FSLY: Derivative data saved (138 records). [2025-10-27T22:09:10.748081] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-27T22:09:10.752837] [INFO ] [MAIN ] Derivative Progress: 672/1881 symbols completed. FSLY took 1.5s. Estimated remaining: 8m 10s. Rate: 148.0 symbols/min [2025-10-27T22:09:10.753204] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:10.767052] [DEBUG] [LOCAL ] FT: Loaded 6749 existing records from primary storage. [2025-10-27T22:09:10.767347] [INFO ] [MAIN ] FT: Loaded 6749 primary data records. [2025-10-27T22:09:10.932517] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:10.932118] [DEBUG] [LOCAL ] FSS: Loaded 32611 existing records from primary storage. [2025-10-27T22:09:10.964784] [INFO ] [MAIN ] FSS: Loaded 32611 primary data records. [2025-10-27T22:09:11.480987] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:11.502063] [INFO ] [MAIN ] FSM: Generated 138 derivative records from 53298 primary records. [2025-10-27T22:09:11.504289] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-27T22:09:11.525047] [DEBUG] [LOCAL ] FSM: Derivative data saved (138 records). [2025-10-27T22:09:11.525213] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-27T22:09:11.528897] [INFO ] [MAIN ] Derivative Progress: 673/1881 symbols completed. FSM took 1.2s. Estimated remaining: 8m 10s. Rate: 147.8 symbols/min [2025-10-27T22:09:11.544628] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:11.578317] [INFO ] [MAIN ] FT: Generated 138 derivative records from 6749 primary records. [2025-10-27T22:09:11.578725] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-27T22:09:11.593972] [DEBUG] [LOCAL ] FT: Derivative data saved (138 records). [2025-10-27T22:09:11.594181] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-27T22:09:11.596507] [INFO ] [MAIN ] Derivative Progress: 674/1881 symbols completed. FT took 0.8s. Estimated remaining: 8m 9s. Rate: 148.0 symbols/min [2025-10-27T22:09:11.604771] [INFO ] [MAIN ] FSS: Generated 138 derivative records from 32611 primary records. [2025-10-27T22:09:11.604844] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-27T22:09:11.616365] [DEBUG] [LOCAL ] FSS: Derivative data saved (138 records). [2025-10-27T22:09:11.616420] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-27T22:09:11.619027] [INFO ] [MAIN ] Derivative Progress: 675/1881 symbols completed. FSS took 0.9s. Estimated remaining: 8m 8s. Rate: 148.2 symbols/min [2025-10-27T22:09:11.619382] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:11.619850] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:11.619527] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:11.634333] [DEBUG] [LOCAL ] FTHY: Loaded 12001 existing records from primary storage. [2025-10-27T22:09:11.634471] [INFO ] [MAIN ] FTHY: Loaded 12001 primary data records. [2025-10-27T22:09:11.769155] [DEBUG] [LOCAL ] FTK: Loaded 33051 existing records from primary storage. [2025-10-27T22:09:11.784996] [INFO ] [MAIN ] FTK: Loaded 33051 primary data records. [2025-10-27T22:09:12.080188] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-27T22:09:12.118003] [INFO ] [MAIN ] FTI: Loaded 53292 primary data records. [2025-10-27T22:09:12.667584] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:12.706971] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:12.757538] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:12.781924] [INFO ] [MAIN ] FTHY: Generated 138 derivative records from 12001 primary records. [2025-10-27T22:09:12.782323] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-27T22:09:12.799836] [DEBUG] [LOCAL ] FTHY: Derivative data saved (138 records). [2025-10-27T22:09:12.800396] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-27T22:09:12.802817] [INFO ] [MAIN ] Derivative Progress: 676/1881 symbols completed. FTHY took 1.2s. Estimated remaining: 8m 9s. Rate: 147.8 symbols/min [2025-10-27T22:09:12.803180] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:12.818672] [INFO ] [MAIN ] FTK: Generated 138 derivative records from 33051 primary records. [2025-10-27T22:09:12.819104] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-27T22:09:12.837886] [DEBUG] [LOCAL ] FTK: Derivative data saved (138 records). [2025-10-27T22:09:12.840731] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-27T22:09:12.843017] [INFO ] [MAIN ] Derivative Progress: 677/1881 symbols completed. FTK took 1.2s. Estimated remaining: 8m 8s. Rate: 148.0 symbols/min [2025-10-27T22:09:12.854075] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:12.856535] [INFO ] [MAIN ] FTI: Generated 138 derivative records from 53292 primary records. [2025-10-27T22:09:12.856823] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-27T22:09:12.880429] [DEBUG] [LOCAL ] FTI: Derivative data saved (138 records). [2025-10-27T22:09:12.881700] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-27T22:09:12.884448] [INFO ] [MAIN ] Derivative Progress: 678/1881 symbols completed. FTI took 1.3s. Estimated remaining: 8m 7s. Rate: 148.2 symbols/min [2025-10-27T22:09:12.884783] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:12.885958] [DEBUG] [LOCAL ] FTS: Loaded 42295 existing records from primary storage. [2025-10-27T22:09:12.886252] [INFO ] [MAIN ] FTS: Loaded 42295 primary data records. [2025-10-27T22:09:12.952591] [DEBUG] [LOCAL ] FTWO: Loaded 1917 existing records from primary storage. [2025-10-27T22:09:12.969261] [INFO ] [MAIN ] FTWO: Loaded 1917 primary data records. [2025-10-27T22:09:13.208146] [DEBUG] [LOCAL ] FTV: Loaded 52997 existing records from primary storage. [2025-10-27T22:09:13.208358] [INFO ] [MAIN ] FTV: Loaded 52997 primary data records. [2025-10-27T22:09:13.841278] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:13.874717] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:13.927420] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:13.958897] [INFO ] [MAIN ] FTS: Generated 138 derivative records from 42295 primary records. [2025-10-27T22:09:13.962173] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-27T22:09:13.977106] [DEBUG] [LOCAL ] FTS: Derivative data saved (138 records). [2025-10-27T22:09:13.977492] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-27T22:09:13.981238] [INFO ] [MAIN ] Derivative Progress: 679/1881 symbols completed. FTS took 1.2s. Estimated remaining: 8m 8s. Rate: 147.8 symbols/min [2025-10-27T22:09:13.981833] [INFO ] [MAIN ] FTWO: Generated 138 derivative records from 1917 primary records. [2025-10-27T22:09:13.982195] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-27T22:09:13.981976] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:14.001341] [DEBUG] [LOCAL ] FTWO: Derivative data saved (138 records). [2025-10-27T22:09:14.001814] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-27T22:09:14.005412] [INFO ] [MAIN ] Derivative Progress: 680/1881 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 7s. Rate: 148.0 symbols/min [2025-10-27T22:09:14.006067] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:14.014180] [INFO ] [MAIN ] FTV: Generated 138 derivative records from 52997 primary records. [2025-10-27T22:09:14.014440] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-27T22:09:14.030371] [DEBUG] [LOCAL ] FTV: Derivative data saved (138 records). [2025-10-27T22:09:14.038511] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-27T22:09:14.041442] [INFO ] [MAIN ] Derivative Progress: 681/1881 symbols completed. FTV took 1.2s. Estimated remaining: 8m 6s. Rate: 148.2 symbols/min [2025-10-27T22:09:14.054113] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:14.066181] [DEBUG] [LOCAL ] FUL: Loaded 31762 existing records from primary storage. [2025-10-27T22:09:14.066363] [INFO ] [MAIN ] FUL: Loaded 31762 primary data records. [2025-10-27T22:09:14.188492] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-27T22:09:14.189120] [INFO ] [MAIN ] FUBO: Loaded 53714 primary data records. [2025-10-27T22:09:14.548742] [DEBUG] [LOCAL ] FUN: Loaded 52033 existing records from primary storage. [2025-10-27T22:09:14.560183] [INFO ] [MAIN ] FUN: Loaded 52033 primary data records. [2025-10-27T22:09:15.070055] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:15.110052] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:15.146476] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:15.187872] [INFO ] [MAIN ] FUL: Generated 138 derivative records from 31762 primary records. [2025-10-27T22:09:15.191132] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-27T22:09:15.208527] [DEBUG] [LOCAL ] FUL: Derivative data saved (138 records). [2025-10-27T22:09:15.213200] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-27T22:09:15.215941] [INFO ] [MAIN ] Derivative Progress: 682/1881 symbols completed. FUL took 1.2s. Estimated remaining: 8m 7s. Rate: 147.8 symbols/min [2025-10-27T22:09:15.216348] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:15.229582] [INFO ] [MAIN ] FUBO: Generated 138 derivative records from 53714 primary records. [2025-10-27T22:09:15.229856] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-27T22:09:15.249448] [DEBUG] [LOCAL ] FUBO: Derivative data saved (138 records). [2025-10-27T22:09:15.249758] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-27T22:09:15.254262] [INFO ] [MAIN ] Derivative Progress: 683/1881 symbols completed. FUBO took 1.3s. Estimated remaining: 8m 6s. Rate: 148.0 symbols/min [2025-10-27T22:09:15.254524] [INFO ] [MAIN ] FUN: Generated 138 derivative records from 52033 primary records. [2025-10-27T22:09:15.254852] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:15.255058] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-27T22:09:15.273905] [DEBUG] [LOCAL ] FVR: Loaded 20577 existing records from primary storage. [2025-10-27T22:09:15.274896] [INFO ] [MAIN ] FVR: Loaded 20577 primary data records. [2025-10-27T22:09:15.276831] [DEBUG] [LOCAL ] FUN: Derivative data saved (138 records). [2025-10-27T22:09:15.288767] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-27T22:09:15.291754] [INFO ] [MAIN ] Derivative Progress: 684/1881 symbols completed. FUN took 1.2s. Estimated remaining: 8m 5s. Rate: 148.2 symbols/min [2025-10-27T22:09:15.312313] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:15.382862] [DEBUG] [LOCAL ] FXED: Loaded 1221 existing records from primary storage. [2025-10-27T22:09:15.397343] [INFO ] [MAIN ] FXED: Loaded 1221 primary data records. [2025-10-27T22:09:15.540138] [DEBUG] [LOCAL ] FVRR: Loaded 40434 existing records from primary storage. [2025-10-27T22:09:15.567905] [INFO ] [MAIN ] FVRR: Loaded 40434 primary data records. [2025-10-27T22:09:16.317161] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:16.343861] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:16.385100] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:16.442774] [INFO ] [MAIN ] FVR: Generated 138 derivative records from 20577 primary records. [2025-10-27T22:09:16.444883] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-27T22:09:16.460330] [DEBUG] [LOCAL ] FVR: Derivative data saved (138 records). [2025-10-27T22:09:16.463436] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-27T22:09:16.463325] [INFO ] [MAIN ] FXED: Generated 138 derivative records from 1221 primary records. [2025-10-27T22:09:16.463740] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-27T22:09:16.465896] [INFO ] [MAIN ] Derivative Progress: 685/1881 symbols completed. FVR took 1.2s. Estimated remaining: 8m 6s. Rate: 147.8 symbols/min [2025-10-27T22:09:16.467163] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:16.477278] [DEBUG] [LOCAL ] FXED: Derivative data saved (138 records). [2025-10-27T22:09:16.477734] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-27T22:09:16.480542] [INFO ] [MAIN ] Derivative Progress: 686/1881 symbols completed. FXED took 1.2s. Estimated remaining: 8m 5s. Rate: 148.0 symbols/min [2025-10-27T22:09:16.480998] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:16.483577] [INFO ] [MAIN ] FVRR: Generated 138 derivative records from 40434 primary records. [2025-10-27T22:09:16.483748] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-27T22:09:16.496418] [DEBUG] [LOCAL ] FVRR: Derivative data saved (138 records). [2025-10-27T22:09:16.496720] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-27T22:09:16.499289] [INFO ] [MAIN ] Derivative Progress: 687/1881 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 3s. Rate: 148.2 symbols/min [2025-10-27T22:09:16.499602] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:16.513557] [DEBUG] [LOCAL ] GAM: Loaded 3682 existing records from primary storage. [2025-10-27T22:09:16.513860] [INFO ] [MAIN ] GAM: Loaded 3682 primary data records. [2025-10-27T22:09:16.622758] [DEBUG] [LOCAL ] GAB: Loaded 26973 existing records from primary storage. [2025-10-27T22:09:16.633174] [INFO ] [MAIN ] GAB: Loaded 26973 primary data records. [2025-10-27T22:09:16.957517] [DEBUG] [LOCAL ] G: Loaded 50010 existing records from primary storage. [2025-10-27T22:09:16.969492] [INFO ] [MAIN ] G: Loaded 50010 primary data records. [2025-10-27T22:09:17.482958] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:17.522087] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:17.567077] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:17.608229] [INFO ] [MAIN ] GAM: Generated 138 derivative records from 3682 primary records. [2025-10-27T22:09:17.612708] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-27T22:09:17.627985] [DEBUG] [LOCAL ] GAM: Derivative data saved (138 records). [2025-10-27T22:09:17.628849] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-27T22:09:17.631669] [INFO ] [MAIN ] Derivative Progress: 688/1881 symbols completed. GAM took 1.1s. Estimated remaining: 8m 4s. Rate: 147.8 symbols/min [2025-10-27T22:09:17.636885] [INFO ] [MAIN ] GAB: Generated 138 derivative records from 26973 primary records. [2025-10-27T22:09:17.638927] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-27T22:09:17.653345] [DEBUG] [LOCAL ] GAB: Derivative data saved (138 records). [2025-10-27T22:09:17.653680] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-27T22:09:17.657274] [INFO ] [MAIN ] Derivative Progress: 689/1881 symbols completed. GAB took 1.2s. Estimated remaining: 8m 3s. Rate: 148.0 symbols/min [2025-10-27T22:09:17.659157] [INFO ] [MAIN ] G: Generated 138 derivative records from 50010 primary records. [2025-10-27T22:09:17.659316] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-27T22:09:17.671213] [DEBUG] [LOCAL ] G: Derivative data saved (138 records). [2025-10-27T22:09:17.671271] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-27T22:09:17.674217] [INFO ] [MAIN ] Derivative Progress: 690/1881 symbols completed. G took 1.2s. Estimated remaining: 8m 2s. Rate: 148.2 symbols/min [2025-10-27T22:09:17.674625] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:17.674793] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:17.674919] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:17.692861] [DEBUG] [LOCAL ] GBAB: Loaded 12396 existing records from primary storage. [2025-10-27T22:09:17.693057] [INFO ] [MAIN ] GBAB: Loaded 12396 primary data records. [2025-10-27T22:09:17.730923] [DEBUG] [LOCAL ] GATX: Loaded 17782 existing records from primary storage. [2025-10-27T22:09:17.743163] [INFO ] [MAIN ] GATX: Loaded 17782 primary data records. [2025-10-27T22:09:18.195639] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-27T22:09:18.212631] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-27T22:09:18.714184] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:18.744628] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:18.782202] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:18.834015] [INFO ] [MAIN ] GBAB: Generated 138 derivative records from 12396 primary records. [2025-10-27T22:09:18.837268] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-27T22:09:18.855891] [DEBUG] [LOCAL ] GBAB: Derivative data saved (138 records). [2025-10-27T22:09:18.857914] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-27T22:09:18.860283] [INFO ] [MAIN ] Derivative Progress: 691/1881 symbols completed. GBAB took 1.2s. Estimated remaining: 8m 3s. Rate: 147.8 symbols/min [2025-10-27T22:09:18.861763] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:18.861545] [INFO ] [MAIN ] GATX: Generated 138 derivative records from 17782 primary records. [2025-10-27T22:09:18.862731] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-27T22:09:18.865010] [INFO ] [MAIN ] GAP: Generated 138 derivative records from 53653 primary records. [2025-10-27T22:09:18.865249] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-27T22:09:18.877371] [DEBUG] [LOCAL ] GATX: Derivative data saved (138 records). [2025-10-27T22:09:18.877483] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-27T22:09:18.887412] [INFO ] [MAIN ] Derivative Progress: 692/1881 symbols completed. GATX took 1.2s. Estimated remaining: 8m 2s. Rate: 148.0 symbols/min [2025-10-27T22:09:18.887683] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:18.893185] [DEBUG] [LOCAL ] GAP: Derivative data saved (138 records). [2025-10-27T22:09:18.893260] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-27T22:09:18.896357] [INFO ] [MAIN ] Derivative Progress: 693/1881 symbols completed. GAP took 1.2s. Estimated remaining: 8m 1s. Rate: 148.2 symbols/min [2025-10-27T22:09:18.897015] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:18.940426] [DEBUG] [LOCAL ] GBCI: Loaded 41110 existing records from primary storage. [2025-10-27T22:09:18.940676] [INFO ] [MAIN ] GBCI: Loaded 41110 primary data records. [2025-10-27T22:09:19.025774] [DEBUG] [LOCAL ] GBTG: Loaded 39966 existing records from primary storage. [2025-10-27T22:09:19.025234] [DEBUG] [LOCAL ] GBX: Loaded 27618 existing records from primary storage. [2025-10-27T22:09:19.047735] [INFO ] [MAIN ] GBTG: Loaded 39966 primary data records. [2025-10-27T22:09:19.061003] [INFO ] [MAIN ] GBX: Loaded 27618 primary data records. [2025-10-27T22:09:19.900910] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:19.933674] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:19.970491] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:20.039756] [INFO ] [MAIN ] GBCI: Generated 138 derivative records from 41110 primary records. [2025-10-27T22:09:20.041336] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-27T22:09:20.053674] [INFO ] [MAIN ] GBX: Generated 138 derivative records from 27618 primary records. [2025-10-27T22:09:20.058425] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-27T22:09:20.061278] [INFO ] [MAIN ] GBTG: Generated 138 derivative records from 39966 primary records. [2025-10-27T22:09:20.060978] [DEBUG] [LOCAL ] GBCI: Derivative data saved (138 records). [2025-10-27T22:09:20.061821] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-27T22:09:20.063726] [INFO ] [MAIN ] Derivative Progress: 694/1881 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 2s. Rate: 147.8 symbols/min [2025-10-27T22:09:20.061462] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-27T22:09:20.064281] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:20.088595] [DEBUG] [LOCAL ] GBTG: Derivative data saved (138 records). [2025-10-27T22:09:20.084080] [DEBUG] [LOCAL ] GBX: Derivative data saved (138 records). [2025-10-27T22:09:20.088893] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-27T22:09:20.091497] [INFO ] [MAIN ] Derivative Progress: 695/1881 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 1s. Rate: 148.0 symbols/min [2025-10-27T22:09:20.088960] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-27T22:09:20.095236] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:20.095380] [INFO ] [MAIN ] Derivative Progress: 696/1881 symbols completed. GBX took 1.2s. Estimated remaining: 7m 60s. Rate: 148.2 symbols/min [2025-10-27T22:09:20.096022] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:20.148807] [DEBUG] [LOCAL ] GCO: Loaded 22201 existing records from primary storage. [2025-10-27T22:09:20.149688] [INFO ] [MAIN ] GCO: Loaded 22201 primary data records. [2025-10-27T22:09:20.149544] [DEBUG] [LOCAL ] GCTS: Loaded 20201 existing records from primary storage. [2025-10-27T22:09:20.150271] [DEBUG] [LOCAL ] GCI: Loaded 43427 existing records from primary storage. [2025-10-27T22:09:20.161694] [INFO ] [MAIN ] GCTS: Loaded 20201 primary data records. [2025-10-27T22:09:20.171275] [INFO ] [MAIN ] GCI: Loaded 43427 primary data records. [2025-10-27T22:09:21.179380] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:21.191975] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:21.234008] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:21.300046] [INFO ] [MAIN ] GCO: Generated 138 derivative records from 22201 primary records. [2025-10-27T22:09:21.302087] [INFO ] [MAIN ] GCI: Generated 138 derivative records from 43427 primary records. [2025-10-27T22:09:21.304834] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-27T22:09:21.305115] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-27T22:09:21.327929] [DEBUG] [LOCAL ] GCO: Derivative data saved (138 records). [2025-10-27T22:09:21.332377] [DEBUG] [LOCAL ] GCI: Derivative data saved (138 records). [2025-10-27T22:09:21.332487] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-27T22:09:21.329272] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-27T22:09:21.330021] [INFO ] [MAIN ] GCTS: Generated 138 derivative records from 20201 primary records. [2025-10-27T22:09:21.334566] [INFO ] [MAIN ] Derivative Progress: 697/1881 symbols completed. GCO took 1.2s. Estimated remaining: 8m 1s. Rate: 147.8 symbols/min [2025-10-27T22:09:21.334744] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:21.337541] [INFO ] [MAIN ] Derivative Progress: 698/1881 symbols completed. GCI took 1.3s. Estimated remaining: 7m 60s. Rate: 148.0 symbols/min [2025-10-27T22:09:21.337815] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:21.334871] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-27T22:09:21.351080] [DEBUG] [LOCAL ] GCTS: Derivative data saved (138 records). [2025-10-27T22:09:21.351246] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-27T22:09:21.353810] [INFO ] [MAIN ] Derivative Progress: 699/1881 symbols completed. GCTS took 1.3s. Estimated remaining: 7m 59s. Rate: 148.2 symbols/min [2025-10-27T22:09:21.354084] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:21.361882] [DEBUG] [LOCAL ] GCV: Loaded 7919 existing records from primary storage. [2025-10-27T22:09:21.362103] [INFO ] [MAIN ] GCV: Loaded 7919 primary data records. [2025-10-27T22:09:21.686240] [DEBUG] [LOCAL ] GD: Loaded 46417 existing records from primary storage. [2025-10-27T22:09:21.699509] [INFO ] [MAIN ] GD: Loaded 46417 primary data records. [2025-10-27T22:09:21.721100] [DEBUG] [LOCAL ] GDDY: Loaded 49453 existing records from primary storage. [2025-10-27T22:09:21.744082] [INFO ] [MAIN ] GDDY: Loaded 49453 primary data records. [2025-10-27T22:09:22.383827] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:22.452984] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:22.459376] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:22.473339] [INFO ] [MAIN ] GCV: Generated 138 derivative records from 7919 primary records. [2025-10-27T22:09:22.488892] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-27T22:09:22.502889] [DEBUG] [LOCAL ] GCV: Derivative data saved (138 records). [2025-10-27T22:09:22.503183] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-27T22:09:22.508639] [INFO ] [MAIN ] Derivative Progress: 700/1881 symbols completed. GCV took 1.2s. Estimated remaining: 7m 59s. Rate: 147.8 symbols/min [2025-10-27T22:09:22.511438] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:22.526566] [DEBUG] [LOCAL ] GDIV: Loaded 3405 existing records from primary storage. [2025-10-27T22:09:22.531076] [INFO ] [MAIN ] GDIV: Loaded 3405 primary data records. [2025-10-27T22:09:22.849802] [INFO ] [MAIN ] GD: Generated 138 derivative records from 46417 primary records. [2025-10-27T22:09:22.850691] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-27T22:09:22.851943] [INFO ] [MAIN ] GDDY: Generated 138 derivative records from 49453 primary records. [2025-10-27T22:09:22.852481] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-27T22:09:22.865725] [DEBUG] [LOCAL ] GD: Derivative data saved (138 records). [2025-10-27T22:09:22.865908] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-27T22:09:22.868374] [INFO ] [MAIN ] Derivative Progress: 701/1881 symbols completed. GD took 1.5s. Estimated remaining: 7m 59s. Rate: 147.8 symbols/min [2025-10-27T22:09:22.876137] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:22.883716] [DEBUG] [LOCAL ] GDDY: Derivative data saved (138 records). [2025-10-27T22:09:22.883959] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-27T22:09:22.887470] [INFO ] [MAIN ] Derivative Progress: 702/1881 symbols completed. GDDY took 1.5s. Estimated remaining: 7m 58s. Rate: 148.0 symbols/min [2025-10-27T22:09:22.890545] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:22.889773] [DEBUG] [LOCAL ] GDL: Loaded 2495 existing records from primary storage. [2025-10-27T22:09:22.890910] [INFO ] [MAIN ] GDL: Loaded 2495 primary data records. [2025-10-27T22:09:22.973314] [DEBUG] [LOCAL ] GDO: Loaded 5681 existing records from primary storage. [2025-10-27T22:09:22.997712] [INFO ] [MAIN ] GDO: Loaded 5681 primary data records. [2025-10-27T22:09:23.389965] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:23.569768] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-27T22:09:23.571777] [INFO ] [MAIN ] GDIV: Generated 138 derivative records from 3405 primary records. [2025-10-27T22:09:23.583455] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-27T22:09:23.599150] [DEBUG] [LOCAL ] GDIV: Derivative data saved (138 records). [2025-10-27T22:09:23.600725] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-27T22:09:23.615443] [INFO ] [MAIN ] Derivative Progress: 703/1881 symbols completed. GDIV took 1.1s. Estimated remaining: 7m 58s. Rate: 147.8 symbols/min [2025-10-27T22:09:23.618521] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:23.658941] [INFO ] [MAIN ] GDL: Generated 138 derivative records from 2495 primary records. [2025-10-27T22:09:23.659346] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-27T22:09:23.667875] [INFO ] [MAIN ] GDO: Generated 138 derivative records from 5681 primary records. [2025-10-27T22:09:23.671427] [DEBUG] [LOCAL ] GDL: Derivative data saved (138 records). [2025-10-27T22:09:23.671491] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-27T22:09:23.671571] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-27T22:09:23.674133] [INFO ] [MAIN ] Derivative Progress: 704/1881 symbols completed. GDL took 0.8s. Estimated remaining: 7m 57s. Rate: 148.0 symbols/min [2025-10-27T22:09:23.686941] [DEBUG] [LOCAL ] GDO: Derivative data saved (138 records). [2025-10-27T22:09:23.687038] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-27T22:09:23.689687] [INFO ] [MAIN ] Derivative Progress: 705/1881 symbols completed. GDO took 0.8s. Estimated remaining: 7m 56s. Rate: 148.2 symbols/min [2025-10-27T22:09:23.690069] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:23.690158] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:23.690290] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:23.711843] [DEBUG] [LOCAL ] GDV: Loaded 18804 existing records from primary storage. [2025-10-27T22:09:23.711996] [INFO ] [MAIN ] GDV: Loaded 18804 primary data records. [2025-10-27T22:09:23.846466] [DEBUG] [LOCAL ] GDOT: Loaded 37431 existing records from primary storage. [2025-10-27T22:09:23.862946] [INFO ] [MAIN ] GDOT: Loaded 37431 primary data records. [2025-10-27T22:09:24.157852] [DEBUG] [LOCAL ] GE: Loaded 53689 existing records from primary storage. [2025-10-27T22:09:24.168537] [INFO ] [MAIN ] GE: Loaded 53689 primary data records. [2025-10-27T22:09:24.749995] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:24.798308] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:24.842533] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:24.844672] [INFO ] [MAIN ] GDV: Generated 138 derivative records from 18804 primary records. [2025-10-27T22:09:24.857144] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-27T22:09:24.873861] [DEBUG] [LOCAL ] GDV: Derivative data saved (138 records). [2025-10-27T22:09:24.875737] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-27T22:09:24.879249] [INFO ] [MAIN ] Derivative Progress: 706/1881 symbols completed. GDV took 1.2s. Estimated remaining: 7m 57s. Rate: 147.8 symbols/min [2025-10-27T22:09:24.882723] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:24.911074] [INFO ] [MAIN ] GDOT: Generated 138 derivative records from 37431 primary records. [2025-10-27T22:09:24.911633] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-27T22:09:24.930547] [DEBUG] [LOCAL ] GEF: Loaded 20495 existing records from primary storage. [2025-10-27T22:09:24.935818] [INFO ] [MAIN ] GEF: Loaded 20495 primary data records. [2025-10-27T22:09:24.935674] [DEBUG] [LOCAL ] GDOT: Derivative data saved (138 records). [2025-10-27T22:09:24.956536] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-27T22:09:24.970261] [INFO ] [MAIN ] Derivative Progress: 707/1881 symbols completed. GDOT took 1.3s. Estimated remaining: 7m 56s. Rate: 148.0 symbols/min [2025-10-27T22:09:24.995966] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:25.024781] [INFO ] [MAIN ] GE: Generated 138 derivative records from 53689 primary records. [2025-10-27T22:09:25.046628] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-27T22:09:25.131870] [DEBUG] [LOCAL ] GE: Derivative data saved (138 records). [2025-10-27T22:09:25.137275] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-27T22:09:25.140299] [INFO ] [MAIN ] Derivative Progress: 708/1881 symbols completed. GE took 1.5s. Estimated remaining: 7m 55s. Rate: 148.1 symbols/min [2025-10-27T22:09:25.252238] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:25.275901] [DEBUG] [LOCAL ] GEL: Loaded 30690 existing records from primary storage. [2025-10-27T22:09:25.276699] [INFO ] [MAIN ] GEL: Loaded 30690 primary data records. [2025-10-27T22:09:25.604334] [DEBUG] [LOCAL ] GENI: Loaded 52863 existing records from primary storage. [2025-10-27T22:09:25.617384] [INFO ] [MAIN ] GENI: Loaded 52863 primary data records. [2025-10-27T22:09:25.617845] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:25.985399] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:26.005415] [INFO ] [MAIN ] GEF: Generated 138 derivative records from 20495 primary records. [2025-10-27T22:09:26.005885] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-27T22:09:26.021332] [DEBUG] [LOCAL ] GEF: Derivative data saved (138 records). [2025-10-27T22:09:26.023251] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-27T22:09:26.025556] [INFO ] [MAIN ] Derivative Progress: 709/1881 symbols completed. GEF took 1.1s. Estimated remaining: 7m 56s. Rate: 147.9 symbols/min [2025-10-27T22:09:26.032045] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:26.058551] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:26.078344] [INFO ] [MAIN ] GEL: Generated 138 derivative records from 30690 primary records. [2025-10-27T22:09:26.081029] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-27T22:09:26.109785] [DEBUG] [LOCAL ] GEL: Derivative data saved (138 records). [2025-10-27T22:09:26.113254] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-27T22:09:26.116252] [INFO ] [MAIN ] Derivative Progress: 710/1881 symbols completed. GEL took 1.1s. Estimated remaining: 7m 55s. Rate: 148.0 symbols/min [2025-10-27T22:09:26.118162] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:26.138221] [DEBUG] [LOCAL ] GEO: Loaded 51578 existing records from primary storage. [2025-10-27T22:09:26.141237] [INFO ] [MAIN ] GEO: Loaded 51578 primary data records. [2025-10-27T22:09:26.156193] [INFO ] [MAIN ] GENI: Generated 138 derivative records from 52863 primary records. [2025-10-27T22:09:26.182258] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-27T22:09:26.240484] [DEBUG] [LOCAL ] GENI: Derivative data saved (138 records). [2025-10-27T22:09:26.271691] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-27T22:09:26.285861] [INFO ] [MAIN ] Derivative Progress: 711/1881 symbols completed. GENI took 1.0s. Estimated remaining: 7m 54s. Rate: 148.1 symbols/min [2025-10-27T22:09:26.317609] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:26.370327] [DEBUG] [LOCAL ] GES: Loaded 37496 existing records from primary storage. [2025-10-27T22:09:26.483066] [INFO ] [MAIN ] GES: Loaded 37496 primary data records. [2025-10-27T22:09:26.688315] [DEBUG] [LOCAL ] GETY: Loaded 35015 existing records from primary storage. [2025-10-27T22:09:26.834114] [INFO ] [MAIN ] GETY: Loaded 35015 primary data records. [2025-10-27T22:09:27.055987] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:27.213952] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:27.277009] [INFO ] [MAIN ] GEO: Generated 138 derivative records from 51578 primary records. [2025-10-27T22:09:27.277570] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-27T22:09:27.278123] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:27.312088] [DEBUG] [LOCAL ] GEO: Derivative data saved (138 records). [2025-10-27T22:09:27.312573] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-27T22:09:27.315192] [INFO ] [MAIN ] Derivative Progress: 712/1881 symbols completed. GEO took 1.3s. Estimated remaining: 7m 55s. Rate: 147.8 symbols/min [2025-10-27T22:09:27.316959] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:27.336674] [INFO ] [MAIN ] GES: Generated 138 derivative records from 37496 primary records. [2025-10-27T22:09:27.338415] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-27T22:09:27.354468] [DEBUG] [LOCAL ] GES: Derivative data saved (138 records). [2025-10-27T22:09:27.354868] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-27T22:09:27.357506] [INFO ] [MAIN ] Derivative Progress: 713/1881 symbols completed. GES took 1.2s. Estimated remaining: 7m 54s. Rate: 148.0 symbols/min [2025-10-27T22:09:27.358894] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:27.368123] [DEBUG] [LOCAL ] GF: Loaded 2566 existing records from primary storage. [2025-10-27T22:09:27.370559] [INFO ] [MAIN ] GF: Loaded 2566 primary data records. [2025-10-27T22:09:27.384358] [INFO ] [MAIN ] GETY: Generated 138 derivative records from 35015 primary records. [2025-10-27T22:09:27.415609] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-27T22:09:27.510374] [DEBUG] [LOCAL ] GEV: Loaded 52985 existing records from primary storage. [2025-10-27T22:09:27.518405] [DEBUG] [LOCAL ] GETY: Derivative data saved (138 records). [2025-10-27T22:09:27.523721] [INFO ] [MAIN ] GEV: Loaded 52985 primary data records. [2025-10-27T22:09:27.523623] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-27T22:09:27.536932] [INFO ] [MAIN ] Derivative Progress: 714/1881 symbols completed. GETY took 1.2s. Estimated remaining: 7m 53s. Rate: 148.1 symbols/min [2025-10-27T22:09:27.537124] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:27.927046] [DEBUG] [LOCAL ] GFF: Loaded 28918 existing records from primary storage. [2025-10-27T22:09:28.036046] [INFO ] [MAIN ] GFF: Loaded 28918 primary data records. [2025-10-27T22:09:28.358815] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:28.398354] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:28.452740] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:28.456717] [INFO ] [MAIN ] GF: Generated 138 derivative records from 2566 primary records. [2025-10-27T22:09:28.470950] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-27T22:09:28.485735] [DEBUG] [LOCAL ] GF: Derivative data saved (138 records). [2025-10-27T22:09:28.489802] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-27T22:09:28.493190] [INFO ] [MAIN ] Derivative Progress: 715/1881 symbols completed. GF took 1.1s. Estimated remaining: 7m 53s. Rate: 147.8 symbols/min [2025-10-27T22:09:28.494862] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:28.498727] [INFO ] [MAIN ] GEV: Generated 138 derivative records from 52985 primary records. [2025-10-27T22:09:28.498944] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-27T22:09:28.515969] [DEBUG] [LOCAL ] GEV: Derivative data saved (138 records). [2025-10-27T22:09:28.518283] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-27T22:09:28.520931] [INFO ] [MAIN ] Derivative Progress: 716/1881 symbols completed. GEV took 1.2s. Estimated remaining: 7m 52s. Rate: 148.0 symbols/min [2025-10-27T22:09:28.521271] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:28.530524] [INFO ] [MAIN ] GFF: Generated 138 derivative records from 28918 primary records. [2025-10-27T22:09:28.530763] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-27T22:09:28.543116] [DEBUG] [LOCAL ] GFF: Derivative data saved (138 records). [2025-10-27T22:09:28.543196] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-27T22:09:28.559170] [INFO ] [MAIN ] Derivative Progress: 717/1881 symbols completed. GFF took 1.0s. Estimated remaining: 7m 51s. Rate: 148.2 symbols/min [2025-10-27T22:09:28.559832] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:28.590862] [DEBUG] [LOCAL ] GFR: Loaded 6925 existing records from primary storage. [2025-10-27T22:09:28.592352] [INFO ] [MAIN ] GFR: Loaded 6925 primary data records. [2025-10-27T22:09:28.604583] [DEBUG] [LOCAL ] GFI: Loaded 53115 existing records from primary storage. [2025-10-27T22:09:28.629979] [INFO ] [MAIN ] GFI: Loaded 53115 primary data records. [2025-10-27T22:09:28.737218] [DEBUG] [LOCAL ] GFL: Loaded 47263 existing records from primary storage. [2025-10-27T22:09:28.756057] [INFO ] [MAIN ] GFL: Loaded 47263 primary data records. [2025-10-27T22:09:29.548191] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:29.580498] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:29.606411] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:29.669294] [INFO ] [MAIN ] GFI: Generated 138 derivative records from 53115 primary records. [2025-10-27T22:09:29.670556] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-27T22:09:29.672514] [INFO ] [MAIN ] GFR: Generated 138 derivative records from 6925 primary records. [2025-10-27T22:09:29.682032] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-27T22:09:29.686581] [DEBUG] [LOCAL ] GFI: Derivative data saved (138 records). [2025-10-27T22:09:29.686973] [INFO ] [MAIN ] GFL: Generated 138 derivative records from 47263 primary records. [2025-10-27T22:09:29.687286] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-27T22:09:29.687357] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-27T22:09:29.696098] [INFO ] [MAIN ] Derivative Progress: 718/1881 symbols completed. GFI took 1.2s. Estimated remaining: 7m 52s. Rate: 147.8 symbols/min [2025-10-27T22:09:29.707105] [DEBUG] [LOCAL ] GFR: Derivative data saved (138 records). [2025-10-27T22:09:29.707200] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-27T22:09:29.709207] [INFO ] [MAIN ] Derivative Progress: 719/1881 symbols completed. GFR took 1.1s. Estimated remaining: 7m 51s. Rate: 148.0 symbols/min [2025-10-27T22:09:29.713450] [DEBUG] [LOCAL ] GFL: Derivative data saved (138 records). [2025-10-27T22:09:29.713506] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-27T22:09:29.716077] [INFO ] [MAIN ] Derivative Progress: 720/1881 symbols completed. GFL took 1.2s. Estimated remaining: 7m 50s. Rate: 148.2 symbols/min [2025-10-27T22:09:29.716516] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:29.716605] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:29.716718] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:29.734238] [DEBUG] [LOCAL ] GGT: Loaded 14417 existing records from primary storage. [2025-10-27T22:09:29.734371] [INFO ] [MAIN ] GGT: Loaded 14417 primary data records. [2025-10-27T22:09:30.079260] [DEBUG] [LOCAL ] GGG: Loaded 40459 existing records from primary storage. [2025-10-27T22:09:30.080119] [INFO ] [MAIN ] GGG: Loaded 40459 primary data records. [2025-10-27T22:09:30.080884] [DEBUG] [LOCAL ] GGB: Loaded 51546 existing records from primary storage. [2025-10-27T22:09:30.081205] [INFO ] [MAIN ] GGB: Loaded 51546 primary data records. [2025-10-27T22:09:30.841781] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:30.932169] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:30.949459] [INFO ] [MAIN ] GGT: Generated 138 derivative records from 14417 primary records. [2025-10-27T22:09:30.968171] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-27T22:09:30.969494] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:31.020835] [DEBUG] [LOCAL ] GGT: Derivative data saved (138 records). [2025-10-27T22:09:31.024517] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-27T22:09:31.031397] [INFO ] [MAIN ] Derivative Progress: 721/1881 symbols completed. GGT took 1.3s. Estimated remaining: 7m 51s. Rate: 147.8 symbols/min [2025-10-27T22:09:31.037169] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:31.049923] [DEBUG] [LOCAL ] GGZ: Loaded 2291 existing records from primary storage. [2025-10-27T22:09:31.055789] [INFO ] [MAIN ] GGZ: Loaded 2291 primary data records. [2025-10-27T22:09:31.221144] [INFO ] [MAIN ] GGG: Generated 138 derivative records from 40459 primary records. [2025-10-27T22:09:31.258440] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-27T22:09:31.309273] [INFO ] [MAIN ] GGB: Generated 138 derivative records from 51546 primary records. [2025-10-27T22:09:31.448934] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-27T22:09:31.474951] [DEBUG] [LOCAL ] GGG: Derivative data saved (138 records). [2025-10-27T22:09:31.492766] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-27T22:09:31.495548] [DEBUG] [LOCAL ] GGB: Derivative data saved (138 records). [2025-10-27T22:09:31.496247] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-27T22:09:31.499590] [INFO ] [MAIN ] Derivative Progress: 722/1881 symbols completed. GGG took 1.8s. Estimated remaining: 7m 51s. Rate: 147.8 symbols/min [2025-10-27T22:09:31.503546] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:31.503699] [INFO ] [MAIN ] Derivative Progress: 723/1881 symbols completed. GGB took 1.8s. Estimated remaining: 7m 50s. Rate: 148.0 symbols/min [2025-10-27T22:09:31.503961] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:31.512153] [DEBUG] [LOCAL ] GHC: Loaded 2950 existing records from primary storage. [2025-10-27T22:09:31.512728] [INFO ] [MAIN ] GHC: Loaded 2950 primary data records. [2025-10-27T22:09:31.537514] [DEBUG] [LOCAL ] GHG: Loaded 3268 existing records from primary storage. [2025-10-27T22:09:31.560178] [INFO ] [MAIN ] GHG: Loaded 3268 primary data records. [2025-10-27T22:09:31.758051] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:32.203694] [INFO ] [MAIN ] GGZ: Generated 138 derivative records from 2291 primary records. [2025-10-27T22:09:32.204363] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-27T22:09:32.226682] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:32.244025] [DEBUG] [LOCAL ] GGZ: Derivative data saved (138 records). [2025-10-27T22:09:32.244403] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-27T22:09:32.247580] [INFO ] [MAIN ] Derivative Progress: 724/1881 symbols completed. GGZ took 1.2s. Estimated remaining: 7m 50s. Rate: 147.8 symbols/min [2025-10-27T22:09:32.261438] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:32.265492] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:32.299056] [DEBUG] [LOCAL ] GHI: Loaded 8001 existing records from primary storage. [2025-10-27T22:09:32.302317] [INFO ] [MAIN ] GHI: Loaded 8001 primary data records. [2025-10-27T22:09:32.471986] [INFO ] [MAIN ] GHC: Generated 138 derivative records from 2950 primary records. [2025-10-27T22:09:32.592514] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-27T22:09:32.622834] [DEBUG] [LOCAL ] GHC: Derivative data saved (138 records). [2025-10-27T22:09:32.625728] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-27T22:09:32.628046] [INFO ] [MAIN ] Derivative Progress: 725/1881 symbols completed. GHC took 1.1s. Estimated remaining: 7m 49s. Rate: 147.8 symbols/min [2025-10-27T22:09:32.628191] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:32.633927] [INFO ] [MAIN ] GHG: Generated 138 derivative records from 3268 primary records. [2025-10-27T22:09:32.636088] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-27T22:09:32.645261] [DEBUG] [LOCAL ] GHLD: Loaded 4334 existing records from primary storage. [2025-10-27T22:09:32.645464] [INFO ] [MAIN ] GHLD: Loaded 4334 primary data records. [2025-10-27T22:09:32.660377] [DEBUG] [LOCAL ] GHG: Derivative data saved (138 records). [2025-10-27T22:09:32.660555] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-27T22:09:32.663187] [INFO ] [MAIN ] Derivative Progress: 726/1881 symbols completed. GHG took 1.2s. Estimated remaining: 7m 48s. Rate: 148.0 symbols/min [2025-10-27T22:09:32.672685] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:32.808178] [DEBUG] [LOCAL ] GHM: Loaded 14338 existing records from primary storage. [2025-10-27T22:09:32.840593] [INFO ] [MAIN ] GHM: Loaded 14338 primary data records. [2025-10-27T22:09:33.037987] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:33.364013] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:33.386188] [INFO ] [MAIN ] GHI: Generated 138 derivative records from 8001 primary records. [2025-10-27T22:09:33.388284] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-27T22:09:33.407093] [DEBUG] [LOCAL ] GHI: Derivative data saved (138 records). [2025-10-27T22:09:33.419893] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-27T22:09:33.420544] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:33.424729] [INFO ] [MAIN ] Derivative Progress: 727/1881 symbols completed. GHI took 1.2s. Estimated remaining: 7m 48s. Rate: 147.8 symbols/min [2025-10-27T22:09:33.425273] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:33.475501] [DEBUG] [LOCAL ] GHY: Loaded 20669 existing records from primary storage. [2025-10-27T22:09:33.476148] [INFO ] [MAIN ] GHY: Loaded 20669 primary data records. [2025-10-27T22:09:33.477558] [INFO ] [MAIN ] GHLD: Generated 138 derivative records from 4334 primary records. [2025-10-27T22:09:33.511302] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-27T22:09:33.610545] [DEBUG] [LOCAL ] GHLD: Derivative data saved (138 records). [2025-10-27T22:09:33.615815] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-27T22:09:33.639136] [INFO ] [MAIN ] Derivative Progress: 728/1881 symbols completed. GHLD took 1.0s. Estimated remaining: 7m 48s. Rate: 147.9 symbols/min [2025-10-27T22:09:33.657452] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:33.797874] [INFO ] [MAIN ] GHM: Generated 138 derivative records from 14338 primary records. [2025-10-27T22:09:33.798269] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-27T22:09:33.812252] [DEBUG] [LOCAL ] GHM: Derivative data saved (138 records). [2025-10-27T22:09:33.812835] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-27T22:09:33.815810] [INFO ] [MAIN ] Derivative Progress: 729/1881 symbols completed. GHM took 1.1s. Estimated remaining: 7m 47s. Rate: 148.0 symbols/min [2025-10-27T22:09:33.816086] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:33.839166] [DEBUG] [LOCAL ] GIC: Loaded 12968 existing records from primary storage. [2025-10-27T22:09:33.849526] [INFO ] [MAIN ] GIC: Loaded 12968 primary data records. [2025-10-27T22:09:33.882735] [DEBUG] [LOCAL ] GIB: Loaded 30975 existing records from primary storage. [2025-10-27T22:09:33.935479] [INFO ] [MAIN ] GIB: Loaded 30975 primary data records. [2025-10-27T22:09:33.947785] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:34.496705] [INFO ] [MAIN ] GHY: Generated 138 derivative records from 20669 primary records. [2025-10-27T22:09:34.497108] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-27T22:09:34.511495] [DEBUG] [LOCAL ] GHY: Derivative data saved (138 records). [2025-10-27T22:09:34.512279] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-27T22:09:34.515523] [INFO ] [MAIN ] Derivative Progress: 730/1881 symbols completed. GHY took 1.1s. Estimated remaining: 7m 47s. Rate: 147.9 symbols/min [2025-10-27T22:09:34.515785] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:34.530907] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:34.554139] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:34.620384] [DEBUG] [LOCAL ] GIL: Loaded 43844 existing records from primary storage. [2025-10-27T22:09:34.623100] [INFO ] [MAIN ] GIL: Loaded 43844 primary data records. [2025-10-27T22:09:34.708900] [INFO ] [MAIN ] GIC: Generated 138 derivative records from 12968 primary records. [2025-10-27T22:09:34.721052] [INFO ] [MAIN ] GIB: Generated 138 derivative records from 30975 primary records. [2025-10-27T22:09:34.728480] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-27T22:09:34.731540] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-27T22:09:34.792331] [DEBUG] [LOCAL ] GIC: Derivative data saved (138 records). [2025-10-27T22:09:34.797975] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-27T22:09:34.800804] [INFO ] [MAIN ] Derivative Progress: 731/1881 symbols completed. GIC took 1.0s. Estimated remaining: 7m 46s. Rate: 147.9 symbols/min [2025-10-27T22:09:34.832969] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:34.990029] [DEBUG] [LOCAL ] GIB: Derivative data saved (138 records). [2025-10-27T22:09:34.990393] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-27T22:09:34.993766] [INFO ] [MAIN ] Derivative Progress: 732/1881 symbols completed. GIB took 1.3s. Estimated remaining: 7m 46s. Rate: 148.0 symbols/min [2025-10-27T22:09:34.994200] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:35.020267] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:35.086240] [INFO ] [MAIN ] GIL: Generated 138 derivative records from 43844 primary records. [2025-10-27T22:09:35.087291] [DEBUG] [LOCAL ] GKOS: Loaded 42292 existing records from primary storage. [2025-10-27T22:09:35.087586] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-27T22:09:35.087517] [INFO ] [MAIN ] GKOS: Loaded 42292 primary data records. [2025-10-27T22:09:35.145200] [DEBUG] [LOCAL ] GIL: Derivative data saved (138 records). [2025-10-27T22:09:35.157527] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-27T22:09:35.158273] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-27T22:09:35.182756] [INFO ] [MAIN ] Derivative Progress: 733/1881 symbols completed. GIL took 0.7s. Estimated remaining: 7m 45s. Rate: 148.1 symbols/min [2025-10-27T22:09:35.188008] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-10-27T22:09:35.735042] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:35.787885] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:35.806870] [INFO ] [MAIN ] GKOS: Generated 138 derivative records from 42292 primary records. [2025-10-27T22:09:35.807373] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-27T22:09:35.825348] [DEBUG] [LOCAL ] GKOS: Derivative data saved (138 records). [2025-10-27T22:09:35.827846] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-27T22:09:35.831439] [INFO ] [MAIN ] Derivative Progress: 734/1881 symbols completed. GKOS took 0.8s. Estimated remaining: 7m 45s. Rate: 148.0 symbols/min [2025-10-27T22:09:35.839721] [INFO ] [MAIN ] GIS: Generated 138 derivative records from 53675 primary records. [2025-10-27T22:09:35.839825] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-27T22:09:35.851484] [DEBUG] [LOCAL ] GIS: Derivative data saved (138 records). [2025-10-27T22:09:35.851582] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-27T22:09:35.853835] [INFO ] [MAIN ] Derivative Progress: 735/1881 symbols completed. GIS took 1.0s. Estimated remaining: 7m 44s. Rate: 148.2 symbols/min [2025-10-27T22:09:35.854409] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:35.854315] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:35.854516] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:35.865950] [DEBUG] [LOCAL ] GLP: Loaded 9104 existing records from primary storage. [2025-10-27T22:09:35.866157] [INFO ] [MAIN ] GLP: Loaded 9104 primary data records. [2025-10-27T22:09:36.058299] [DEBUG] [LOCAL ] GL: Loaded 37258 existing records from primary storage. [2025-10-27T22:09:36.075636] [INFO ] [MAIN ] GL: Loaded 37258 primary data records. [2025-10-27T22:09:36.284921] [DEBUG] [LOCAL ] GLOB: Loaded 48001 existing records from primary storage. [2025-10-27T22:09:36.296396] [INFO ] [MAIN ] GLOB: Loaded 48001 primary data records. [2025-10-27T22:09:36.873791] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:36.915025] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:36.954410] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:36.996495] [INFO ] [MAIN ] GLP: Generated 138 derivative records from 9104 primary records. [2025-10-27T22:09:36.997832] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-27T22:09:37.019619] [DEBUG] [LOCAL ] GLP: Derivative data saved (138 records). [2025-10-27T22:09:37.023054] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-27T22:09:37.025886] [INFO ] [MAIN ] Derivative Progress: 736/1881 symbols completed. GLP took 1.2s. Estimated remaining: 7m 45s. Rate: 147.8 symbols/min [2025-10-27T22:09:37.028666] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:37.038740] [INFO ] [MAIN ] GL: Generated 138 derivative records from 37258 primary records. [2025-10-27T22:09:37.038912] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-27T22:09:37.053114] [DEBUG] [LOCAL ] GL: Derivative data saved (138 records). [2025-10-27T22:09:37.055594] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-27T22:09:37.058983] [INFO ] [MAIN ] Derivative Progress: 737/1881 symbols completed. GL took 1.2s. Estimated remaining: 7m 44s. Rate: 148.0 symbols/min [2025-10-27T22:09:37.059130] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:37.055971] [INFO ] [MAIN ] GLOB: Generated 138 derivative records from 48001 primary records. [2025-10-27T22:09:37.060285] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-27T22:09:37.074388] [DEBUG] [LOCAL ] GLOB: Derivative data saved (138 records). [2025-10-27T22:09:37.074631] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-27T22:09:37.077517] [INFO ] [MAIN ] Derivative Progress: 738/1881 symbols completed. GLOB took 1.2s. Estimated remaining: 7m 43s. Rate: 148.2 symbols/min [2025-10-27T22:09:37.077762] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:37.132791] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-27T22:09:37.146748] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-10-27T22:09:37.147723] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-27T22:09:37.184362] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-27T22:09:37.429203] [DEBUG] [LOCAL ] GME: Loaded 53777 existing records from primary storage. [2025-10-27T22:09:37.486155] [INFO ] [MAIN ] GME: Loaded 53777 primary data records. [2025-10-27T22:09:38.122729] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:38.171095] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:38.178293] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:38.249701] [INFO ] [MAIN ] GLW: Generated 138 derivative records from 53635 primary records. [2025-10-27T22:09:38.251515] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-27T22:09:38.272697] [DEBUG] [LOCAL ] GLW: Derivative data saved (138 records). [2025-10-27T22:09:38.272989] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-27T22:09:38.275174] [INFO ] [MAIN ] Derivative Progress: 739/1881 symbols completed. GLW took 1.2s. Estimated remaining: 7m 44s. Rate: 147.8 symbols/min [2025-10-27T22:09:38.275612] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:38.285874] [INFO ] [MAIN ] GM: Generated 138 derivative records from 53729 primary records. [2025-10-27T22:09:38.287514] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-27T22:09:38.291152] [INFO ] [MAIN ] GME: Generated 138 derivative records from 53777 primary records. [2025-10-27T22:09:38.303598] [DEBUG] [LOCAL ] GM: Derivative data saved (138 records). [2025-10-27T22:09:38.303793] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-27T22:09:38.300715] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-27T22:09:38.308107] [INFO ] [MAIN ] Derivative Progress: 740/1881 symbols completed. GM took 1.2s. Estimated remaining: 7m 43s. Rate: 148.0 symbols/min [2025-10-27T22:09:38.308327] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:38.322264] [DEBUG] [LOCAL ] GME: Derivative data saved (138 records). [2025-10-27T22:09:38.322469] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-27T22:09:38.325826] [INFO ] [MAIN ] Derivative Progress: 741/1881 symbols completed. GME took 1.2s. Estimated remaining: 7m 42s. Rate: 148.2 symbols/min [2025-10-27T22:09:38.337056] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:38.367257] [DEBUG] [LOCAL ] GMED: Loaded 48055 existing records from primary storage. [2025-10-27T22:09:38.367515] [INFO ] [MAIN ] GMED: Loaded 48055 primary data records. [2025-10-27T22:09:38.425226] [DEBUG] [LOCAL ] GNE: Loaded 18127 existing records from primary storage. [2025-10-27T22:09:38.473403] [DEBUG] [LOCAL ] GMRE: Loaded 35708 existing records from primary storage. [2025-10-27T22:09:38.480790] [INFO ] [MAIN ] GNE: Loaded 18127 primary data records. [2025-10-27T22:09:38.473525] [INFO ] [MAIN ] GMRE: Loaded 35708 primary data records. [2025-10-27T22:09:39.347031] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:39.375373] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:39.412122] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:39.467303] [INFO ] [MAIN ] GMED: Generated 138 derivative records from 48055 primary records. [2025-10-27T22:09:39.470725] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-27T22:09:39.485949] [DEBUG] [LOCAL ] GMED: Derivative data saved (138 records). [2025-10-27T22:09:39.486150] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-27T22:09:39.488942] [INFO ] [MAIN ] Derivative Progress: 742/1881 symbols completed. GMED took 1.2s. Estimated remaining: 7m 42s. Rate: 147.8 symbols/min [2025-10-27T22:09:39.491728] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:39.493862] [INFO ] [MAIN ] GMRE: Generated 138 derivative records from 35708 primary records. [2025-10-27T22:09:39.494757] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-27T22:09:39.508358] [DEBUG] [LOCAL ] GMRE: Derivative data saved (138 records). [2025-10-27T22:09:39.508539] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-27T22:09:39.511205] [INFO ] [MAIN ] Derivative Progress: 743/1881 symbols completed. GMRE took 1.2s. Estimated remaining: 7m 41s. Rate: 148.0 symbols/min [2025-10-27T22:09:39.511583] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:39.517758] [INFO ] [MAIN ] GNE: Generated 138 derivative records from 18127 primary records. [2025-10-27T22:09:39.517862] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-27T22:09:39.530014] [DEBUG] [LOCAL ] GNE: Derivative data saved (138 records). [2025-10-27T22:09:39.530154] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-27T22:09:39.532952] [INFO ] [MAIN ] Derivative Progress: 744/1881 symbols completed. GNE took 1.2s. Estimated remaining: 7m 40s. Rate: 148.2 symbols/min [2025-10-27T22:09:39.533201] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:39.568962] [DEBUG] [LOCAL ] GNK: Loaded 39008 existing records from primary storage. [2025-10-27T22:09:39.569139] [INFO ] [MAIN ] GNK: Loaded 39008 primary data records. [2025-10-27T22:09:39.693530] [DEBUG] [LOCAL ] GNL: Loaded 46279 existing records from primary storage. [2025-10-27T22:09:39.710474] [INFO ] [MAIN ] GNL: Loaded 46279 primary data records. [2025-10-27T22:09:39.985888] [DEBUG] [LOCAL ] GNRC: Loaded 45165 existing records from primary storage. [2025-10-27T22:09:40.002807] [INFO ] [MAIN ] GNRC: Loaded 45165 primary data records. [2025-10-27T22:09:40.556996] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:40.602917] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:40.655994] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:40.692812] [INFO ] [MAIN ] GNK: Generated 138 derivative records from 39008 primary records. [2025-10-27T22:09:40.694920] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-27T22:09:40.716855] [DEBUG] [LOCAL ] GNK: Derivative data saved (138 records). [2025-10-27T22:09:40.720242] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-27T22:09:40.723611] [INFO ] [MAIN ] Derivative Progress: 745/1881 symbols completed. GNK took 1.2s. Estimated remaining: 7m 41s. Rate: 147.8 symbols/min [2025-10-27T22:09:40.724156] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:40.726992] [INFO ] [MAIN ] GNL: Generated 138 derivative records from 46279 primary records. [2025-10-27T22:09:40.730458] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-27T22:09:40.748814] [DEBUG] [LOCAL ] GNL: Derivative data saved (138 records). [2025-10-27T22:09:40.752095] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-27T22:09:40.754700] [INFO ] [MAIN ] Derivative Progress: 746/1881 symbols completed. GNL took 1.2s. Estimated remaining: 7m 40s. Rate: 148.0 symbols/min [2025-10-27T22:09:40.755121] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:40.762931] [DEBUG] [LOCAL ] GNT: Loaded 8608 existing records from primary storage. [2025-10-27T22:09:40.763504] [INFO ] [MAIN ] GNT: Loaded 8608 primary data records. [2025-10-27T22:09:40.778013] [INFO ] [MAIN ] GNRC: Generated 138 derivative records from 45165 primary records. [2025-10-27T22:09:40.804404] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-27T22:09:40.881064] [DEBUG] [LOCAL ] GNRC: Derivative data saved (138 records). [2025-10-27T22:09:40.895773] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-27T22:09:40.898477] [INFO ] [MAIN ] Derivative Progress: 747/1881 symbols completed. GNRC took 1.4s. Estimated remaining: 7m 39s. Rate: 148.1 symbols/min [2025-10-27T22:09:40.898760] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:41.149622] [DEBUG] [LOCAL ] GNW: Loaded 51289 existing records from primary storage. [2025-10-27T22:09:41.150676] [INFO ] [MAIN ] GNW: Loaded 51289 primary data records. [2025-10-27T22:09:41.559323] [DEBUG] [LOCAL ] GOF: Loaded 42668 existing records from primary storage. [2025-10-27T22:09:41.569028] [INFO ] [MAIN ] GOF: Loaded 42668 primary data records. [2025-10-27T22:09:41.756239] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:41.951497] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:41.988499] [INFO ] [MAIN ] GNT: Generated 138 derivative records from 8608 primary records. [2025-10-27T22:09:41.990785] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-27T22:09:42.019674] [DEBUG] [LOCAL ] GNT: Derivative data saved (138 records). [2025-10-27T22:09:42.020491] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:42.020935] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-27T22:09:42.026235] [INFO ] [MAIN ] Derivative Progress: 748/1881 symbols completed. GNT took 1.3s. Estimated remaining: 7m 40s. Rate: 147.8 symbols/min [2025-10-27T22:09:42.059842] [INFO ] [MAIN ] GNW: Generated 138 derivative records from 51289 primary records. [2025-10-27T22:09:42.060774] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-27T22:09:42.076554] [DEBUG] [LOCAL ] GNW: Derivative data saved (138 records). [2025-10-27T22:09:42.077883] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-27T22:09:42.080330] [INFO ] [MAIN ] Derivative Progress: 749/1881 symbols completed. GNW took 1.3s. Estimated remaining: 7m 39s. Rate: 147.9 symbols/min [2025-10-27T22:09:42.084906] [INFO ] [MAIN ] GOF: Generated 138 derivative records from 42668 primary records. [2025-10-27T22:09:42.085050] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-27T22:09:42.096971] [DEBUG] [LOCAL ] GOF: Derivative data saved (138 records). [2025-10-27T22:09:42.097026] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-27T22:09:42.099573] [INFO ] [MAIN ] Derivative Progress: 750/1881 symbols completed. GOF took 1.2s. Estimated remaining: 7m 38s. Rate: 148.1 symbols/min [2025-10-27T22:09:42.100337] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:42.100451] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:42.100548] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:42.145051] [DEBUG] [LOCAL ] GOLF: Loaded 29787 existing records from primary storage. [2025-10-27T22:09:42.155201] [INFO ] [MAIN ] GOLF: Loaded 29787 primary data records. [2025-10-27T22:09:42.177868] [DEBUG] [LOCAL ] GOTU: Loaded 36496 existing records from primary storage. [2025-10-27T22:09:42.223529] [INFO ] [MAIN ] GOTU: Loaded 36496 primary data records. [2025-10-27T22:09:42.291000] [DEBUG] [LOCAL ] GOOS: Loaded 43756 existing records from primary storage. [2025-10-27T22:09:42.300055] [INFO ] [MAIN ] GOOS: Loaded 43756 primary data records. [2025-10-27T22:09:43.118974] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:43.151133] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:43.194298] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:43.234387] [INFO ] [MAIN ] GOLF: Generated 138 derivative records from 29787 primary records. [2025-10-27T22:09:43.236574] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-27T22:09:43.255677] [DEBUG] [LOCAL ] GOLF: Derivative data saved (138 records). [2025-10-27T22:09:43.256265] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-27T22:09:43.259842] [INFO ] [MAIN ] Derivative Progress: 751/1881 symbols completed. GOLF took 1.2s. Estimated remaining: 7m 39s. Rate: 147.8 symbols/min [2025-10-27T22:09:43.261759] [INFO ] [MAIN ] GOOS: Generated 138 derivative records from 43756 primary records. [2025-10-27T22:09:43.262058] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-27T22:09:43.264588] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:43.279528] [DEBUG] [LOCAL ] GOOS: Derivative data saved (138 records). [2025-10-27T22:09:43.279761] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-27T22:09:43.282801] [INFO ] [MAIN ] Derivative Progress: 752/1881 symbols completed. GOOS took 1.2s. Estimated remaining: 7m 38s. Rate: 147.9 symbols/min [2025-10-27T22:09:43.285076] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:43.285379] [INFO ] [MAIN ] GOTU: Generated 138 derivative records from 36496 primary records. [2025-10-27T22:09:43.285487] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-27T22:09:43.298109] [DEBUG] [LOCAL ] GOTU: Derivative data saved (138 records). [2025-10-27T22:09:43.298354] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-27T22:09:43.302245] [INFO ] [MAIN ] Derivative Progress: 753/1881 symbols completed. GOTU took 1.2s. Estimated remaining: 7m 37s. Rate: 148.1 symbols/min [2025-10-27T22:09:43.302676] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:43.314991] [DEBUG] [LOCAL ] GPI: Loaded 14518 existing records from primary storage. [2025-10-27T22:09:43.315286] [INFO ] [MAIN ] GPI: Loaded 14518 primary data records. [2025-10-27T22:09:43.347892] [DEBUG] [LOCAL ] GPJA: Loaded 4035 existing records from primary storage. [2025-10-27T22:09:43.364026] [INFO ] [MAIN ] GPJA: Loaded 4035 primary data records. [2025-10-27T22:09:43.554693] [DEBUG] [LOCAL ] GPC: Loaded 45800 existing records from primary storage. [2025-10-27T22:09:43.588470] [INFO ] [MAIN ] GPC: Loaded 45800 primary data records. [2025-10-27T22:09:44.343350] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:44.374906] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:44.406411] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:44.479495] [INFO ] [MAIN ] GPJA: Generated 138 derivative records from 4035 primary records. [2025-10-27T22:09:44.481048] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-27T22:09:44.497588] [DEBUG] [LOCAL ] GPJA: Derivative data saved (138 records). [2025-10-27T22:09:44.498726] [INFO ] [MAIN ] GPI: Generated 138 derivative records from 14518 primary records. [2025-10-27T22:09:44.499326] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-27T22:09:44.501364] [INFO ] [MAIN ] GPC: Generated 138 derivative records from 45800 primary records. [2025-10-27T22:09:44.504156] [INFO ] [MAIN ] Derivative Progress: 754/1881 symbols completed. GPJA took 1.2s. Estimated remaining: 7m 38s. Rate: 147.7 symbols/min [2025-10-27T22:09:44.499662] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-27T22:09:44.504758] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-27T22:09:44.505146] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:44.517946] [DEBUG] [LOCAL ] GPI: Derivative data saved (138 records). [2025-10-27T22:09:44.525085] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-27T22:09:44.529159] [INFO ] [MAIN ] Derivative Progress: 755/1881 symbols completed. GPI took 1.2s. Estimated remaining: 7m 37s. Rate: 147.9 symbols/min [2025-10-27T22:09:44.531667] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:44.532224] [DEBUG] [LOCAL ] GPC: Derivative data saved (138 records). [2025-10-27T22:09:44.532810] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-27T22:09:44.536156] [INFO ] [MAIN ] Derivative Progress: 756/1881 symbols completed. GPC took 1.3s. Estimated remaining: 7m 36s. Rate: 148.1 symbols/min [2025-10-27T22:09:44.536474] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:44.564810] [DEBUG] [LOCAL ] GPMT: Loaded 25517 existing records from primary storage. [2025-10-27T22:09:44.564987] [INFO ] [MAIN ] GPMT: Loaded 25517 primary data records. [2025-10-27T22:09:44.922338] [DEBUG] [LOCAL ] GPN: Loaded 51720 existing records from primary storage. [2025-10-27T22:09:44.925032] [DEBUG] [LOCAL ] GPK: Loaded 52765 existing records from primary storage. [2025-10-27T22:09:44.925205] [INFO ] [MAIN ] GPN: Loaded 51720 primary data records. [2025-10-27T22:09:44.925461] [INFO ] [MAIN ] GPK: Loaded 52765 primary data records. [2025-10-27T22:09:45.660623] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:45.700746] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:45.734030] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:45.783356] [INFO ] [MAIN ] GPMT: Generated 138 derivative records from 25517 primary records. [2025-10-27T22:09:45.786585] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-27T22:09:45.807115] [DEBUG] [LOCAL ] GPMT: Derivative data saved (138 records). [2025-10-27T22:09:45.807329] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-27T22:09:45.812225] [INFO ] [MAIN ] Derivative Progress: 757/1881 symbols completed. GPMT took 1.3s. Estimated remaining: 7m 37s. Rate: 147.7 symbols/min [2025-10-27T22:09:45.813071] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:45.824571] [INFO ] [MAIN ] GPN: Generated 138 derivative records from 51720 primary records. [2025-10-27T22:09:45.826234] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-27T22:09:45.828670] [INFO ] [MAIN ] GPK: Generated 138 derivative records from 52765 primary records. [2025-10-27T22:09:45.828931] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-27T22:09:45.846514] [DEBUG] [LOCAL ] GPN: Derivative data saved (138 records). [2025-10-27T22:09:45.853772] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-27T22:09:45.856002] [INFO ] [MAIN ] Derivative Progress: 758/1881 symbols completed. GPN took 1.3s. Estimated remaining: 7m 36s. Rate: 147.9 symbols/min [2025-10-27T22:09:45.856193] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:45.860559] [DEBUG] [LOCAL ] GPK: Derivative data saved (138 records). [2025-10-27T22:09:45.860764] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-27T22:09:45.863897] [INFO ] [MAIN ] Derivative Progress: 759/1881 symbols completed. GPK took 1.4s. Estimated remaining: 7m 35s. Rate: 148.1 symbols/min [2025-10-27T22:09:45.872538] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:45.873132] [DEBUG] [LOCAL ] GPOR: Loaded 23320 existing records from primary storage. [2025-10-27T22:09:45.873228] [INFO ] [MAIN ] GPOR: Loaded 23320 primary data records. [2025-10-27T22:09:46.206576] [DEBUG] [LOCAL ] GPRK: Loaded 39943 existing records from primary storage. [2025-10-27T22:09:46.205985] [DEBUG] [LOCAL ] GRBK: Loaded 26261 existing records from primary storage. [2025-10-27T22:09:46.206780] [INFO ] [MAIN ] GRBK: Loaded 26261 primary data records. [2025-10-27T22:09:46.206882] [INFO ] [MAIN ] GPRK: Loaded 39943 primary data records. [2025-10-27T22:09:46.817971] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:46.876405] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:46.910720] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:46.937264] [INFO ] [MAIN ] GPOR: Generated 138 derivative records from 23320 primary records. [2025-10-27T22:09:46.941416] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-27T22:09:46.959516] [DEBUG] [LOCAL ] GPOR: Derivative data saved (138 records). [2025-10-27T22:09:46.959831] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-27T22:09:46.965611] [INFO ] [MAIN ] Derivative Progress: 760/1881 symbols completed. GPOR took 1.2s. Estimated remaining: 7m 35s. Rate: 147.7 symbols/min [2025-10-27T22:09:46.968109] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:46.988504] [DEBUG] [LOCAL ] GRC: Loaded 9285 existing records from primary storage. [2025-10-27T22:09:46.989347] [INFO ] [MAIN ] GRC: Loaded 9285 primary data records. [2025-10-27T22:09:47.197124] [INFO ] [MAIN ] GRBK: Generated 138 derivative records from 26261 primary records. [2025-10-27T22:09:47.302274] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-27T22:09:47.196770] [INFO ] [MAIN ] GPRK: Generated 138 derivative records from 39943 primary records. [2025-10-27T22:09:47.311027] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-27T22:09:47.331887] [DEBUG] [LOCAL ] GRBK: Derivative data saved (138 records). [2025-10-27T22:09:47.334519] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-27T22:09:47.337584] [INFO ] [MAIN ] Derivative Progress: 761/1881 symbols completed. GRBK took 1.5s. Estimated remaining: 7m 35s. Rate: 147.8 symbols/min [2025-10-27T22:09:47.338880] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:47.341005] [DEBUG] [LOCAL ] GPRK: Derivative data saved (138 records). [2025-10-27T22:09:47.342960] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-27T22:09:47.348270] [INFO ] [MAIN ] Derivative Progress: 762/1881 symbols completed. GPRK took 1.5s. Estimated remaining: 7m 34s. Rate: 147.9 symbols/min [2025-10-27T22:09:47.348611] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:47.371361] [DEBUG] [LOCAL ] GRDN: Loaded 21538 existing records from primary storage. [2025-10-27T22:09:47.371610] [INFO ] [MAIN ] GRDN: Loaded 21538 primary data records. [2025-10-27T22:09:47.448122] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:47.602123] [DEBUG] [LOCAL ] GRMN: Loaded 39400 existing records from primary storage. [2025-10-27T22:09:47.608066] [INFO ] [MAIN ] GRMN: Loaded 39400 primary data records. [2025-10-27T22:09:48.089789] [INFO ] [MAIN ] GRC: Generated 138 derivative records from 9285 primary records. [2025-10-27T22:09:48.091860] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-27T22:09:48.107465] [DEBUG] [LOCAL ] GRC: Derivative data saved (138 records). [2025-10-27T22:09:48.108277] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-27T22:09:48.112532] [INFO ] [MAIN ] Derivative Progress: 763/1881 symbols completed. GRC took 1.1s. Estimated remaining: 7m 34s. Rate: 147.8 symbols/min [2025-10-27T22:09:48.131727] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:48.160073] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:48.211309] [INFO ] [MAIN ] GRDN: Generated 138 derivative records from 21538 primary records. [2025-10-27T22:09:48.211774] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-27T22:09:48.215507] [INFO ] [MAIN ] GRMN: Generated 138 derivative records from 39400 primary records. [2025-10-27T22:09:48.227285] [DEBUG] [LOCAL ] GRDN: Derivative data saved (138 records). [2025-10-27T22:09:48.224538] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-27T22:09:48.227773] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-27T22:09:48.230105] [INFO ] [MAIN ] Derivative Progress: 764/1881 symbols completed. GRDN took 0.9s. Estimated remaining: 7m 33s. Rate: 147.9 symbols/min [2025-10-27T22:09:48.242086] [DEBUG] [LOCAL ] GRMN: Derivative data saved (138 records). [2025-10-27T22:09:48.242151] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-27T22:09:48.245001] [INFO ] [MAIN ] Derivative Progress: 765/1881 symbols completed. GRMN took 0.9s. Estimated remaining: 7m 32s. Rate: 148.1 symbols/min [2025-10-27T22:09:48.245639] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:48.245793] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:48.245512] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:48.259817] [DEBUG] [LOCAL ] GROV: Loaded 8633 existing records from primary storage. [2025-10-27T22:09:48.260099] [INFO ] [MAIN ] GROV: Loaded 8633 primary data records. [2025-10-27T22:09:48.408063] [DEBUG] [LOCAL ] GRNT: Loaded 33640 existing records from primary storage. [2025-10-27T22:09:48.408359] [INFO ] [MAIN ] GRNT: Loaded 33640 primary data records. [2025-10-27T22:09:48.718192] [DEBUG] [LOCAL ] GRND: Loaded 50170 existing records from primary storage. [2025-10-27T22:09:48.734882] [INFO ] [MAIN ] GRND: Loaded 50170 primary data records. [2025-10-27T22:09:49.295977] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:49.340559] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:49.401353] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:49.431478] [INFO ] [MAIN ] GROV: Generated 138 derivative records from 8633 primary records. [2025-10-27T22:09:49.438040] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-27T22:09:49.463620] [DEBUG] [LOCAL ] GROV: Derivative data saved (138 records). [2025-10-27T22:09:49.465749] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-27T22:09:49.464233] [INFO ] [MAIN ] GRNT: Generated 138 derivative records from 33640 primary records. [2025-10-27T22:09:49.466011] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-27T22:09:49.470070] [INFO ] [MAIN ] Derivative Progress: 766/1881 symbols completed. GROV took 1.2s. Estimated remaining: 7m 33s. Rate: 147.7 symbols/min [2025-10-27T22:09:49.475317] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:49.487988] [DEBUG] [LOCAL ] GRNT: Derivative data saved (138 records). [2025-10-27T22:09:49.489671] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-27T22:09:49.493767] [INFO ] [MAIN ] Derivative Progress: 767/1881 symbols completed. GRNT took 1.2s. Estimated remaining: 7m 32s. Rate: 147.9 symbols/min [2025-10-27T22:09:49.497715] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:49.503672] [DEBUG] [LOCAL ] GRX: Loaded 4811 existing records from primary storage. [2025-10-27T22:09:49.508030] [INFO ] [MAIN ] GRX: Loaded 4811 primary data records. [2025-10-27T22:09:49.561068] [INFO ] [MAIN ] GRND: Generated 138 derivative records from 50170 primary records. [2025-10-27T22:09:49.588415] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-27T22:09:49.639324] [DEBUG] [LOCAL ] GRND: Derivative data saved (138 records). [2025-10-27T22:09:49.644979] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-27T22:09:49.659457] [INFO ] [MAIN ] Derivative Progress: 768/1881 symbols completed. GRND took 1.4s. Estimated remaining: 7m 31s. Rate: 148.0 symbols/min [2025-10-27T22:09:49.701910] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:49.907889] [DEBUG] [LOCAL ] GS: Loaded 51743 existing records from primary storage. [2025-10-27T22:09:49.908178] [INFO ] [MAIN ] GS: Loaded 51743 primary data records. [2025-10-27T22:09:50.232512] [DEBUG] [LOCAL ] GSBD: Loaded 39315 existing records from primary storage. [2025-10-27T22:09:50.233128] [INFO ] [MAIN ] GSBD: Loaded 39315 primary data records. [2025-10-27T22:09:50.319487] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:50.620629] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:50.653129] [INFO ] [MAIN ] GRX: Generated 138 derivative records from 4811 primary records. [2025-10-27T22:09:50.653827] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-27T22:09:50.669278] [DEBUG] [LOCAL ] GRX: Derivative data saved (138 records). [2025-10-27T22:09:50.671124] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-27T22:09:50.673505] [INFO ] [MAIN ] Derivative Progress: 769/1881 symbols completed. GRX took 1.2s. Estimated remaining: 7m 32s. Rate: 147.7 symbols/min [2025-10-27T22:09:50.673916] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:50.708415] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:50.726717] [INFO ] [MAIN ] GS: Generated 138 derivative records from 51743 primary records. [2025-10-27T22:09:50.729003] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-27T22:09:50.761172] [DEBUG] [LOCAL ] GS: Derivative data saved (138 records). [2025-10-27T22:09:50.767599] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-27T22:09:50.789990] [INFO ] [MAIN ] Derivative Progress: 770/1881 symbols completed. GS took 1.3s. Estimated remaining: 7m 31s. Rate: 147.8 symbols/min [2025-10-27T22:09:50.791794] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:50.791918] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-27T22:09:50.792758] [INFO ] [MAIN ] GSK: Loaded 53510 primary data records. [2025-10-27T22:09:50.939491] [INFO ] [MAIN ] GSBD: Generated 138 derivative records from 39315 primary records. [2025-10-27T22:09:50.984810] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-27T22:09:51.124785] [DEBUG] [LOCAL ] GSBD: Derivative data saved (138 records). [2025-10-27T22:09:51.124665] [DEBUG] [LOCAL ] GSL: Loaded 32535 existing records from primary storage. [2025-10-27T22:09:51.125081] [INFO ] [MAIN ] GSL: Loaded 32535 primary data records. [2025-10-27T22:09:51.125248] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-27T22:09:51.148435] [INFO ] [MAIN ] Derivative Progress: 771/1881 symbols completed. GSBD took 1.4s. Estimated remaining: 7m 30s. Rate: 147.9 symbols/min [2025-10-27T22:09:51.159468] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:51.494538] [DEBUG] [LOCAL ] GTES: Loaded 50229 existing records from primary storage. [2025-10-27T22:09:51.494861] [INFO ] [MAIN ] GTES: Loaded 50229 primary data records. [2025-10-27T22:09:51.599459] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:51.957012] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:51.981266] [INFO ] [MAIN ] GSK: Generated 138 derivative records from 53510 primary records. [2025-10-27T22:09:51.986793] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-27T22:09:52.008961] [DEBUG] [LOCAL ] GSK: Derivative data saved (138 records). [2025-10-27T22:09:52.009189] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-27T22:09:52.012465] [INFO ] [MAIN ] Derivative Progress: 772/1881 symbols completed. GSK took 1.3s. Estimated remaining: 7m 31s. Rate: 147.7 symbols/min [2025-10-27T22:09:52.013313] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:52.040180] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:52.060385] [INFO ] [MAIN ] GSL: Generated 138 derivative records from 32535 primary records. [2025-10-27T22:09:52.062394] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-27T22:09:52.096730] [DEBUG] [LOCAL ] GSL: Derivative data saved (138 records). [2025-10-27T22:09:52.098437] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-27T22:09:52.102470] [INFO ] [MAIN ] Derivative Progress: 773/1881 symbols completed. GSL took 1.3s. Estimated remaining: 7m 30s. Rate: 147.8 symbols/min [2025-10-27T22:09:52.105610] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:52.126340] [DEBUG] [LOCAL ] GTLS: Loaded 42877 existing records from primary storage. [2025-10-27T22:09:52.128304] [INFO ] [MAIN ] GTLS: Loaded 42877 primary data records. [2025-10-27T22:09:52.234151] [INFO ] [MAIN ] GTES: Generated 138 derivative records from 50229 primary records. [2025-10-27T22:09:52.264824] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-27T22:09:52.299905] [DEBUG] [LOCAL ] GTES: Derivative data saved (138 records). [2025-10-27T22:09:52.332960] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-27T22:09:52.338351] [INFO ] [MAIN ] Derivative Progress: 774/1881 symbols completed. GTES took 1.2s. Estimated remaining: 7m 29s. Rate: 147.9 symbols/min [2025-10-27T22:09:52.372594] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:52.479150] [DEBUG] [LOCAL ] GTN: Loaded 44461 existing records from primary storage. [2025-10-27T22:09:52.494230] [INFO ] [MAIN ] GTN: Loaded 44461 primary data records. [2025-10-27T22:09:52.700451] [DEBUG] [LOCAL ] GTY: Loaded 29754 existing records from primary storage. [2025-10-27T22:09:52.710305] [INFO ] [MAIN ] GTY: Loaded 29754 primary data records. [2025-10-27T22:09:53.163632] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:53.202175] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:53.261763] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:53.299376] [INFO ] [MAIN ] GTLS: Generated 138 derivative records from 42877 primary records. [2025-10-27T22:09:53.302373] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-27T22:09:53.315251] [INFO ] [MAIN ] GTN: Generated 138 derivative records from 44461 primary records. [2025-10-27T22:09:53.315396] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-27T22:09:53.332242] [DEBUG] [LOCAL ] GTN: Derivative data saved (138 records). [2025-10-27T22:09:53.332345] [DEBUG] [LOCAL ] GTLS: Derivative data saved (138 records). [2025-10-27T22:09:53.332425] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-27T22:09:53.332488] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-27T22:09:53.335053] [INFO ] [MAIN ] Derivative Progress: 775/1881 symbols completed. GTLS took 1.3s. Estimated remaining: 7m 30s. Rate: 147.6 symbols/min [2025-10-27T22:09:53.335202] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:53.337865] [INFO ] [MAIN ] Derivative Progress: 776/1881 symbols completed. GTN took 1.2s. Estimated remaining: 7m 29s. Rate: 147.8 symbols/min [2025-10-27T22:09:53.340060] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:53.359981] [INFO ] [MAIN ] GTY: Generated 138 derivative records from 29754 primary records. [2025-10-27T22:09:53.364839] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-27T22:09:53.364739] [DEBUG] [LOCAL ] GUG: Loaded 11956 existing records from primary storage. [2025-10-27T22:09:53.364943] [INFO ] [MAIN ] GUG: Loaded 11956 primary data records. [2025-10-27T22:09:53.389267] [DEBUG] [LOCAL ] GUT: Loaded 15426 existing records from primary storage. [2025-10-27T22:09:53.398719] [INFO ] [MAIN ] GUT: Loaded 15426 primary data records. [2025-10-27T22:09:53.466466] [DEBUG] [LOCAL ] GTY: Derivative data saved (138 records). [2025-10-27T22:09:53.542342] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-27T22:09:53.564902] [INFO ] [MAIN ] Derivative Progress: 777/1881 symbols completed. GTY took 1.2s. Estimated remaining: 7m 28s. Rate: 147.9 symbols/min [2025-10-27T22:09:53.591499] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:54.037112] [DEBUG] [LOCAL ] GVA: Loaded 32201 existing records from primary storage. [2025-10-27T22:09:54.037629] [INFO ] [MAIN ] GVA: Loaded 32201 primary data records. [2025-10-27T22:09:54.250137] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:54.396105] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:54.465557] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:54.465254] [INFO ] [MAIN ] GUT: Generated 138 derivative records from 15426 primary records. [2025-10-27T22:09:54.477229] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-27T22:09:54.492085] [DEBUG] [LOCAL ] GUT: Derivative data saved (138 records). [2025-10-27T22:09:54.493862] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-27T22:09:54.494155] [INFO ] [MAIN ] GUG: Generated 138 derivative records from 11956 primary records. [2025-10-27T22:09:54.494322] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-27T22:09:54.497017] [INFO ] [MAIN ] Derivative Progress: 778/1881 symbols completed. GUT took 1.2s. Estimated remaining: 7m 28s. Rate: 147.6 symbols/min [2025-10-27T22:09:54.510747] [DEBUG] [LOCAL ] GUG: Derivative data saved (138 records). [2025-10-27T22:09:54.514050] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-27T22:09:54.516219] [INFO ] [MAIN ] Derivative Progress: 779/1881 symbols completed. GUG took 1.2s. Estimated remaining: 7m 27s. Rate: 147.8 symbols/min [2025-10-27T22:09:54.526470] [INFO ] [MAIN ] GVA: Generated 138 derivative records from 32201 primary records. [2025-10-27T22:09:54.526546] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-27T22:09:54.538368] [DEBUG] [LOCAL ] GVA: Derivative data saved (138 records). [2025-10-27T22:09:54.538423] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-27T22:09:54.541100] [INFO ] [MAIN ] Derivative Progress: 780/1881 symbols completed. GVA took 0.9s. Estimated remaining: 7m 26s. Rate: 148.0 symbols/min [2025-10-27T22:09:54.541619] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:54.541563] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:54.541508] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:54.572356] [DEBUG] [LOCAL ] GWW: Loaded 18953 existing records from primary storage. [2025-10-27T22:09:54.573030] [INFO ] [MAIN ] GWW: Loaded 18953 primary data records. [2025-10-27T22:09:54.572856] [DEBUG] [LOCAL ] GWH: Loaded 20891 existing records from primary storage. [2025-10-27T22:09:54.636119] [INFO ] [MAIN ] GWH: Loaded 20891 primary data records. [2025-10-27T22:09:54.795541] [DEBUG] [LOCAL ] GWRE: Loaded 39239 existing records from primary storage. [2025-10-27T22:09:54.827970] [INFO ] [MAIN ] GWRE: Loaded 39239 primary data records. [2025-10-27T22:09:55.548539] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:55.579361] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:55.629105] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:55.669390] [INFO ] [MAIN ] GWW: Generated 138 derivative records from 18953 primary records. [2025-10-27T22:09:55.670811] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-27T22:09:55.690853] [DEBUG] [LOCAL ] GWW: Derivative data saved (138 records). [2025-10-27T22:09:55.693377] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-27T22:09:55.696006] [INFO ] [MAIN ] Derivative Progress: 781/1881 symbols completed. GWW took 1.2s. Estimated remaining: 7m 27s. Rate: 147.6 symbols/min [2025-10-27T22:09:55.698245] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:55.703481] [INFO ] [MAIN ] GWRE: Generated 138 derivative records from 39239 primary records. [2025-10-27T22:09:55.701749] [INFO ] [MAIN ] GWH: Generated 138 derivative records from 20891 primary records. [2025-10-27T22:09:55.703606] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-27T22:09:55.703683] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-27T22:09:55.726370] [DEBUG] [LOCAL ] GWRE: Derivative data saved (138 records). [2025-10-27T22:09:55.727590] [DEBUG] [LOCAL ] GWH: Derivative data saved (138 records). [2025-10-27T22:09:55.727727] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-27T22:09:55.727956] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-27T22:09:55.730531] [INFO ] [MAIN ] Derivative Progress: 782/1881 symbols completed. GWRE took 1.2s. Estimated remaining: 7m 26s. Rate: 147.8 symbols/min [2025-10-27T22:09:55.733413] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:55.733574] [INFO ] [MAIN ] Derivative Progress: 783/1881 symbols completed. GWH took 1.2s. Estimated remaining: 7m 25s. Rate: 148.0 symbols/min [2025-10-27T22:09:55.734139] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:55.737675] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-27T22:09:55.737965] [INFO ] [MAIN ] GYLD: Loaded 1514 primary data records. [2025-10-27T22:09:55.959575] [DEBUG] [LOCAL ] GXO: Loaded 46145 existing records from primary storage. [2025-10-27T22:09:55.959782] [INFO ] [MAIN ] GXO: Loaded 46145 primary data records. [2025-10-27T22:09:56.211766] [DEBUG] [LOCAL ] H: Loaded 44189 existing records from primary storage. [2025-10-27T22:09:56.269919] [INFO ] [MAIN ] H: Loaded 44189 primary data records. [2025-10-27T22:09:56.738207] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:09:56.794015] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:56.847906] [INFO ] [MAIN ] GYLD: Generated 138 derivative records from 1514 primary records. [2025-10-27T22:09:56.848549] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:56.849292] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-27T22:09:56.876956] [DEBUG] [LOCAL ] GYLD: Derivative data saved (138 records). [2025-10-27T22:09:56.879502] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-27T22:09:56.882009] [INFO ] [MAIN ] Derivative Progress: 784/1881 symbols completed. GYLD took 1.1s. Estimated remaining: 7m 26s. Rate: 147.7 symbols/min [2025-10-27T22:09:56.882600] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:56.901276] [INFO ] [MAIN ] GXO: Generated 138 derivative records from 46145 primary records. [2025-10-27T22:09:56.902110] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-27T22:09:56.928053] [DEBUG] [LOCAL ] GXO: Derivative data saved (138 records). [2025-10-27T22:09:56.928404] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-27T22:09:56.934868] [INFO ] [MAIN ] Derivative Progress: 785/1881 symbols completed. GXO took 1.2s. Estimated remaining: 7m 25s. Rate: 147.8 symbols/min [2025-10-27T22:09:56.935392] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:56.944563] [INFO ] [MAIN ] H: Generated 138 derivative records from 44189 primary records. [2025-10-27T22:09:56.956112] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-27T22:09:56.958115] [DEBUG] [LOCAL ] HAE: Loaded 38963 existing records from primary storage. [2025-10-27T22:09:56.958764] [INFO ] [MAIN ] HAE: Loaded 38963 primary data records. [2025-10-27T22:09:57.014925] [DEBUG] [LOCAL ] H: Derivative data saved (138 records). [2025-10-27T22:09:57.020536] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-27T22:09:57.041871] [INFO ] [MAIN ] Derivative Progress: 786/1881 symbols completed. H took 1.3s. Estimated remaining: 7m 24s. Rate: 148.0 symbols/min [2025-10-27T22:09:57.059823] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:57.316359] [DEBUG] [LOCAL ] HAFN: Loaded 42433 existing records from primary storage. [2025-10-27T22:09:57.316761] [INFO ] [MAIN ] HAFN: Loaded 42433 primary data records. [2025-10-27T22:09:57.670326] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-27T22:09:57.670870] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-27T22:09:57.856290] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:58.072633] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:58.113528] [INFO ] [MAIN ] HAE: Generated 138 derivative records from 38963 primary records. [2025-10-27T22:09:58.115347] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-27T22:09:58.149676] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:58.149802] [DEBUG] [LOCAL ] HAE: Derivative data saved (138 records). [2025-10-27T22:09:58.167482] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-27T22:09:58.174018] [INFO ] [MAIN ] Derivative Progress: 787/1881 symbols completed. HAE took 1.3s. Estimated remaining: 7m 25s. Rate: 147.6 symbols/min [2025-10-27T22:09:58.175245] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:58.202008] [INFO ] [MAIN ] HAFN: Generated 138 derivative records from 42433 primary records. [2025-10-27T22:09:58.202522] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-27T22:09:58.226733] [DEBUG] [LOCAL ] HAFN: Derivative data saved (138 records). [2025-10-27T22:09:58.227098] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-27T22:09:58.233249] [INFO ] [MAIN ] Derivative Progress: 788/1881 symbols completed. HAFN took 1.3s. Estimated remaining: 7m 24s. Rate: 147.8 symbols/min [2025-10-27T22:09:58.234308] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:58.255528] [INFO ] [MAIN ] HAL: Generated 138 derivative records from 53718 primary records. [2025-10-27T22:09:58.255908] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-27T22:09:58.269698] [DEBUG] [LOCAL ] HAL: Derivative data saved (138 records). [2025-10-27T22:09:58.269960] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-27T22:09:58.285357] [INFO ] [MAIN ] Derivative Progress: 789/1881 symbols completed. HAL took 1.2s. Estimated remaining: 7m 23s. Rate: 147.9 symbols/min [2025-10-27T22:09:58.288101] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:58.290373] [DEBUG] [LOCAL ] HASI: Loaded 47503 existing records from primary storage. [2025-10-27T22:09:58.290973] [INFO ] [MAIN ] HASI: Loaded 47503 primary data records. [2025-10-27T22:09:58.398453] [DEBUG] [LOCAL ] HBB: Loaded 6050 existing records from primary storage. [2025-10-27T22:09:58.415812] [INFO ] [MAIN ] HBB: Loaded 6050 primary data records. [2025-10-27T22:09:58.529038] [DEBUG] [LOCAL ] HAYW: Loaded 48740 existing records from primary storage. [2025-10-27T22:09:58.564842] [INFO ] [MAIN ] HAYW: Loaded 48740 primary data records. [2025-10-27T22:09:59.374117] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:59.416941] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:59.458277] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:09:59.514731] [INFO ] [MAIN ] HASI: Generated 138 derivative records from 47503 primary records. [2025-10-27T22:09:59.518576] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-27T22:09:59.546299] [DEBUG] [LOCAL ] HASI: Derivative data saved (138 records). [2025-10-27T22:09:59.546550] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-27T22:09:59.553328] [INFO ] [MAIN ] HBB: Generated 138 derivative records from 6050 primary records. [2025-10-27T22:09:59.555835] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-27T22:09:59.552742] [INFO ] [MAIN ] Derivative Progress: 790/1881 symbols completed. HASI took 1.4s. Estimated remaining: 7m 24s. Rate: 147.6 symbols/min [2025-10-27T22:09:59.556500] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:59.568677] [DEBUG] [LOCAL ] HBB: Derivative data saved (138 records). [2025-10-27T22:09:59.572115] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-27T22:09:59.575287] [INFO ] [MAIN ] Derivative Progress: 791/1881 symbols completed. HBB took 1.3s. Estimated remaining: 7m 23s. Rate: 147.7 symbols/min [2025-10-27T22:09:59.575627] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:59.587200] [INFO ] [MAIN ] HAYW: Generated 138 derivative records from 48740 primary records. [2025-10-27T22:09:59.587626] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-27T22:09:59.610427] [DEBUG] [LOCAL ] HAYW: Derivative data saved (138 records). [2025-10-27T22:09:59.610935] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-27T22:09:59.615146] [INFO ] [MAIN ] Derivative Progress: 792/1881 symbols completed. HAYW took 1.4s. Estimated remaining: 7m 22s. Rate: 147.9 symbols/min [2025-10-27T22:09:59.615379] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:09:59.684583] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-27T22:09:59.684883] [INFO ] [MAIN ] HBM: Loaded 52979 primary data records. [2025-10-27T22:09:59.685811] [DEBUG] [LOCAL ] HBI: Loaded 52899 existing records from primary storage. [2025-10-27T22:09:59.720078] [INFO ] [MAIN ] HBI: Loaded 52899 primary data records. [2025-10-27T22:09:59.914825] [DEBUG] [LOCAL ] HCA: Loaded 46869 existing records from primary storage. [2025-10-27T22:09:59.933136] [INFO ] [MAIN ] HCA: Loaded 46869 primary data records. [2025-10-27T22:10:00.788636] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:00.821795] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:00.864671] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:00.903402] [INFO ] [MAIN ] HBM: Generated 138 derivative records from 52979 primary records. [2025-10-27T22:10:00.904993] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-27T22:10:00.923222] [DEBUG] [LOCAL ] HBM: Derivative data saved (138 records). [2025-10-27T22:10:00.927719] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-27T22:10:00.930906] [INFO ] [MAIN ] Derivative Progress: 793/1881 symbols completed. HBM took 1.4s. Estimated remaining: 7m 23s. Rate: 147.5 symbols/min [2025-10-27T22:10:00.939132] [INFO ] [MAIN ] HBI: Generated 138 derivative records from 52899 primary records. [2025-10-27T22:10:00.939337] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-27T22:10:00.954999] [INFO ] [MAIN ] HCA: Generated 138 derivative records from 46869 primary records. [2025-10-27T22:10:00.955584] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-27T22:10:00.957449] [DEBUG] [LOCAL ] HBI: Derivative data saved (138 records). [2025-10-27T22:10:00.957765] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-27T22:10:00.962693] [INFO ] [MAIN ] Derivative Progress: 794/1881 symbols completed. HBI took 1.4s. Estimated remaining: 7m 22s. Rate: 147.7 symbols/min [2025-10-27T22:10:00.974747] [DEBUG] [LOCAL ] HCA: Derivative data saved (138 records). [2025-10-27T22:10:00.974815] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-27T22:10:00.979444] [INFO ] [MAIN ] Derivative Progress: 795/1881 symbols completed. HCA took 1.4s. Estimated remaining: 7m 21s. Rate: 147.8 symbols/min [2025-10-27T22:10:00.980004] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:00.980145] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:00.980261] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:01.002674] [DEBUG] [LOCAL ] HCI: Loaded 13895 existing records from primary storage. [2025-10-27T22:10:01.002914] [INFO ] [MAIN ] HCI: Loaded 13895 primary data records. [2025-10-27T22:10:01.178546] [DEBUG] [LOCAL ] HCC: Loaded 44733 existing records from primary storage. [2025-10-27T22:10:01.234369] [INFO ] [MAIN ] HCC: Loaded 44733 primary data records. [2025-10-27T22:10:01.401953] [DEBUG] [LOCAL ] HD: Loaded 53453 existing records from primary storage. [2025-10-27T22:10:01.431238] [INFO ] [MAIN ] HD: Loaded 53453 primary data records. [2025-10-27T22:10:02.138109] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:02.195742] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:02.238950] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:02.242774] [INFO ] [MAIN ] HCI: Generated 138 derivative records from 13895 primary records. [2025-10-27T22:10:02.243094] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-27T22:10:02.294437] [DEBUG] [LOCAL ] HCI: Derivative data saved (138 records). [2025-10-27T22:10:02.301997] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-27T22:10:02.307524] [INFO ] [MAIN ] Derivative Progress: 796/1881 symbols completed. HCI took 1.3s. Estimated remaining: 7m 22s. Rate: 147.4 symbols/min [2025-10-27T22:10:02.314267] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:02.349038] [INFO ] [MAIN ] HCC: Generated 138 derivative records from 44733 primary records. [2025-10-27T22:10:02.351448] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-27T22:10:02.352624] [INFO ] [MAIN ] HD: Generated 138 derivative records from 53453 primary records. [2025-10-27T22:10:02.353777] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-27T22:10:02.370372] [DEBUG] [LOCAL ] HCC: Derivative data saved (138 records). [2025-10-27T22:10:02.383722] [DEBUG] [LOCAL ] HD: Derivative data saved (138 records). [2025-10-27T22:10:02.380831] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-27T22:10:02.383945] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-27T22:10:02.388468] [INFO ] [MAIN ] Derivative Progress: 797/1881 symbols completed. HD took 1.4s. Estimated remaining: 7m 21s. Rate: 147.6 symbols/min [2025-10-27T22:10:02.392196] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:02.392571] [INFO ] [MAIN ] Derivative Progress: 798/1881 symbols completed. HCC took 1.4s. Estimated remaining: 7m 20s. Rate: 147.7 symbols/min [2025-10-27T22:10:02.393459] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:02.475007] [DEBUG] [LOCAL ] HDB: Loaded 51901 existing records from primary storage. [2025-10-27T22:10:02.475730] [INFO ] [MAIN ] HDB: Loaded 51901 primary data records. [2025-10-27T22:10:02.608320] [DEBUG] [LOCAL ] HEI: Loaded 30061 existing records from primary storage. [2025-10-27T22:10:02.625359] [DEBUG] [LOCAL ] HE: Loaded 48626 existing records from primary storage. [2025-10-27T22:10:02.629899] [INFO ] [MAIN ] HEI: Loaded 30061 primary data records. [2025-10-27T22:10:02.630110] [INFO ] [MAIN ] HE: Loaded 48626 primary data records. [2025-10-27T22:10:03.567561] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:03.609243] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:03.644693] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:03.699629] [INFO ] [MAIN ] HDB: Generated 138 derivative records from 51901 primary records. [2025-10-27T22:10:03.703087] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-27T22:10:03.727514] [DEBUG] [LOCAL ] HDB: Derivative data saved (138 records). [2025-10-27T22:10:03.729821] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-27T22:10:03.735130] [INFO ] [MAIN ] Derivative Progress: 799/1881 symbols completed. HDB took 1.4s. Estimated remaining: 7m 21s. Rate: 147.3 symbols/min [2025-10-27T22:10:03.735456] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:03.743674] [INFO ] [MAIN ] HEI: Generated 138 derivative records from 30061 primary records. [2025-10-27T22:10:03.744160] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-27T22:10:03.758138] [INFO ] [MAIN ] HE: Generated 138 derivative records from 48626 primary records. [2025-10-27T22:10:03.764617] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-27T22:10:03.764973] [DEBUG] [LOCAL ] HEQ: Loaded 6624 existing records from primary storage. [2025-10-27T22:10:03.767867] [DEBUG] [LOCAL ] HEI: Derivative data saved (138 records). [2025-10-27T22:10:03.768845] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-27T22:10:03.768992] [INFO ] [MAIN ] HEQ: Loaded 6624 primary data records. [2025-10-27T22:10:03.772181] [INFO ] [MAIN ] Derivative Progress: 800/1881 symbols completed. HEI took 1.4s. Estimated remaining: 7m 20s. Rate: 147.5 symbols/min [2025-10-27T22:10:03.779443] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:03.901037] [DEBUG] [LOCAL ] HE: Derivative data saved (138 records). [2025-10-27T22:10:03.929478] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-27T22:10:03.969324] [INFO ] [MAIN ] Derivative Progress: 801/1881 symbols completed. HE took 1.6s. Estimated remaining: 7m 19s. Rate: 147.6 symbols/min [2025-10-27T22:10:04.092806] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:04.117297] [DEBUG] [LOCAL ] HESM: Loaded 48557 existing records from primary storage. [2025-10-27T22:10:04.117801] [INFO ] [MAIN ] HESM: Loaded 48557 primary data records. [2025-10-27T22:10:04.188698] [DEBUG] [LOCAL ] HFRO: Loaded 15780 existing records from primary storage. [2025-10-27T22:10:04.206986] [INFO ] [MAIN ] HFRO: Loaded 15780 primary data records. [2025-10-27T22:10:04.614068] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:04.853926] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:04.857084] [INFO ] [MAIN ] HEQ: Generated 138 derivative records from 6624 primary records. [2025-10-27T22:10:04.858280] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-27T22:10:04.898316] [DEBUG] [LOCAL ] HEQ: Derivative data saved (138 records). [2025-10-27T22:10:04.899347] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:04.899639] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-27T22:10:04.913516] [INFO ] [MAIN ] Derivative Progress: 802/1881 symbols completed. HEQ took 1.2s. Estimated remaining: 7m 19s. Rate: 147.3 symbols/min [2025-10-27T22:10:04.914138] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:04.947421] [DEBUG] [LOCAL ] HGER: Loaded 15806 existing records from primary storage. [2025-10-27T22:10:04.952113] [INFO ] [MAIN ] HGER: Loaded 15806 primary data records. [2025-10-27T22:10:05.072578] [INFO ] [MAIN ] HFRO: Generated 138 derivative records from 15780 primary records. [2025-10-27T22:10:05.072854] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-27T22:10:05.121522] [INFO ] [MAIN ] HESM: Generated 138 derivative records from 48557 primary records. [2025-10-27T22:10:05.140890] [DEBUG] [LOCAL ] HFRO: Derivative data saved (138 records). [2025-10-27T22:10:05.159037] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-27T22:10:05.166098] [INFO ] [MAIN ] Derivative Progress: 803/1881 symbols completed. HFRO took 1.1s. Estimated remaining: 7m 19s. Rate: 147.4 symbols/min [2025-10-27T22:10:05.271109] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:05.270852] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-27T22:10:05.336214] [DEBUG] [LOCAL ] HESM: Derivative data saved (138 records). [2025-10-27T22:10:05.337145] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-27T22:10:05.339614] [INFO ] [MAIN ] Derivative Progress: 804/1881 symbols completed. HESM took 1.6s. Estimated remaining: 7m 18s. Rate: 147.5 symbols/min [2025-10-27T22:10:05.344767] [DEBUG] [LOCAL ] HGLB: Loaded 9325 existing records from primary storage. [2025-10-27T22:10:05.345011] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:05.344915] [INFO ] [MAIN ] HGLB: Loaded 9325 primary data records. [2025-10-27T22:10:05.472372] [DEBUG] [LOCAL ] HGTY: Loaded 13404 existing records from primary storage. [2025-10-27T22:10:05.502189] [INFO ] [MAIN ] HGTY: Loaded 13404 primary data records. [2025-10-27T22:10:05.852743] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:06.026693] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:06.061985] [INFO ] [MAIN ] HGER: Generated 138 derivative records from 15806 primary records. [2025-10-27T22:10:06.061691] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:06.073427] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-27T22:10:06.094969] [DEBUG] [LOCAL ] HGER: Derivative data saved (138 records). [2025-10-27T22:10:06.095505] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-27T22:10:06.098202] [INFO ] [MAIN ] Derivative Progress: 805/1881 symbols completed. HGER took 1.2s. Estimated remaining: 7m 18s. Rate: 147.4 symbols/min [2025-10-27T22:10:06.099881] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:06.130424] [INFO ] [MAIN ] HGLB: Generated 138 derivative records from 9325 primary records. [2025-10-27T22:10:06.130941] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-27T22:10:06.142799] [INFO ] [MAIN ] HGTY: Generated 138 derivative records from 13404 primary records. [2025-10-27T22:10:06.143823] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-27T22:10:06.155462] [DEBUG] [LOCAL ] HGLB: Derivative data saved (138 records). [2025-10-27T22:10:06.162321] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-27T22:10:06.166577] [DEBUG] [LOCAL ] HGTY: Derivative data saved (138 records). [2025-10-27T22:10:06.166800] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-27T22:10:06.169852] [INFO ] [MAIN ] Derivative Progress: 806/1881 symbols completed. HGLB took 0.9s. Estimated remaining: 7m 17s. Rate: 147.5 symbols/min [2025-10-27T22:10:06.172475] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:06.172777] [INFO ] [MAIN ] Derivative Progress: 807/1881 symbols completed. HGTY took 0.8s. Estimated remaining: 7m 16s. Rate: 147.7 symbols/min [2025-10-27T22:10:06.185970] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:06.187164] [DEBUG] [LOCAL ] HGV: Loaded 45936 existing records from primary storage. [2025-10-27T22:10:06.187568] [INFO ] [MAIN ] HGV: Loaded 45936 primary data records. [2025-10-27T22:10:06.392462] [DEBUG] [LOCAL ] HHH: Loaded 32806 existing records from primary storage. [2025-10-27T22:10:06.507406] [INFO ] [MAIN ] HHH: Loaded 32806 primary data records. [2025-10-27T22:10:06.516121] [DEBUG] [LOCAL ] HI: Loaded 36099 existing records from primary storage. [2025-10-27T22:10:06.552780] [INFO ] [MAIN ] HI: Loaded 36099 primary data records. [2025-10-27T22:10:07.213749] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:07.256890] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:07.305697] [INFO ] [MAIN ] HGV: Generated 138 derivative records from 45936 primary records. [2025-10-27T22:10:07.307906] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-27T22:10:07.308214] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:07.335677] [DEBUG] [LOCAL ] HGV: Derivative data saved (138 records). [2025-10-27T22:10:07.338254] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-27T22:10:07.341478] [INFO ] [MAIN ] Derivative Progress: 808/1881 symbols completed. HGV took 1.2s. Estimated remaining: 7m 17s. Rate: 147.3 symbols/min [2025-10-27T22:10:07.367357] [INFO ] [MAIN ] HHH: Generated 138 derivative records from 32806 primary records. [2025-10-27T22:10:07.368771] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-27T22:10:07.386367] [INFO ] [MAIN ] HI: Generated 138 derivative records from 36099 primary records. [2025-10-27T22:10:07.387138] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-27T22:10:07.387221] [DEBUG] [LOCAL ] HHH: Derivative data saved (138 records). [2025-10-27T22:10:07.387623] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-27T22:10:07.390290] [INFO ] [MAIN ] Derivative Progress: 809/1881 symbols completed. HHH took 1.2s. Estimated remaining: 7m 16s. Rate: 147.5 symbols/min [2025-10-27T22:10:07.402093] [DEBUG] [LOCAL ] HI: Derivative data saved (138 records). [2025-10-27T22:10:07.402165] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-27T22:10:07.404736] [INFO ] [MAIN ] Derivative Progress: 810/1881 symbols completed. HI took 1.2s. Estimated remaining: 7m 15s. Rate: 147.7 symbols/min [2025-10-27T22:10:07.405245] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:07.405178] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:07.405479] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:07.464952] [DEBUG] [LOCAL ] HII: Loaded 33058 existing records from primary storage. [2025-10-27T22:10:07.465186] [INFO ] [MAIN ] HII: Loaded 33058 primary data records. [2025-10-27T22:10:07.601618] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-27T22:10:07.602954] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-27T22:10:07.602829] [DEBUG] [LOCAL ] HIG: Loaded 51028 existing records from primary storage. [2025-10-27T22:10:07.629166] [INFO ] [MAIN ] HIG: Loaded 51028 primary data records. [2025-10-27T22:10:08.516456] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:08.551564] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:08.586789] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:08.661232] [INFO ] [MAIN ] HII: Generated 138 derivative records from 33058 primary records. [2025-10-27T22:10:08.665079] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-27T22:10:08.682439] [INFO ] [MAIN ] HIMS: Generated 138 derivative records from 53817 primary records. [2025-10-27T22:10:08.685805] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-27T22:10:08.685616] [DEBUG] [LOCAL ] HII: Derivative data saved (138 records). [2025-10-27T22:10:08.689022] [INFO ] [MAIN ] HIG: Generated 138 derivative records from 51028 primary records. [2025-10-27T22:10:08.699040] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-27T22:10:08.704378] [DEBUG] [LOCAL ] HIMS: Derivative data saved (138 records). [2025-10-27T22:10:08.704515] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-27T22:10:08.704568] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-27T22:10:08.701867] [INFO ] [MAIN ] Derivative Progress: 811/1881 symbols completed. HII took 1.3s. Estimated remaining: 7m 16s. Rate: 147.3 symbols/min [2025-10-27T22:10:08.708500] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:08.708638] [INFO ] [MAIN ] Derivative Progress: 812/1881 symbols completed. HIMS took 1.3s. Estimated remaining: 7m 15s. Rate: 147.5 symbols/min [2025-10-27T22:10:08.709346] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:08.723903] [DEBUG] [LOCAL ] HIG: Derivative data saved (138 records). [2025-10-27T22:10:08.724032] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-27T22:10:08.727556] [INFO ] [MAIN ] Derivative Progress: 813/1881 symbols completed. HIG took 1.3s. Estimated remaining: 7m 14s. Rate: 147.6 symbols/min [2025-10-27T22:10:08.727850] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:08.761345] [DEBUG] [LOCAL ] HIPO: Loaded 21121 existing records from primary storage. [2025-10-27T22:10:08.762006] [DEBUG] [LOCAL ] HIO: Loaded 23581 existing records from primary storage. [2025-10-27T22:10:08.762359] [INFO ] [MAIN ] HIPO: Loaded 21121 primary data records. [2025-10-27T22:10:08.762487] [INFO ] [MAIN ] HIO: Loaded 23581 primary data records. [2025-10-27T22:10:09.190822] [DEBUG] [LOCAL ] HIW: Loaded 44271 existing records from primary storage. [2025-10-27T22:10:09.442422] [INFO ] [MAIN ] HIW: Loaded 44271 primary data records. [2025-10-27T22:10:09.879156] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:09.912293] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:09.968219] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:10.020840] [INFO ] [MAIN ] HIPO: Generated 138 derivative records from 21121 primary records. [2025-10-27T22:10:10.024283] [INFO ] [MAIN ] HIO: Generated 138 derivative records from 23581 primary records. [2025-10-27T22:10:10.024529] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-27T22:10:10.024585] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-27T22:10:10.051594] [DEBUG] [LOCAL ] HIPO: Derivative data saved (138 records). [2025-10-27T22:10:10.053894] [DEBUG] [LOCAL ] HIO: Derivative data saved (138 records). [2025-10-27T22:10:10.055565] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-27T22:10:10.055726] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-27T22:10:10.059024] [INFO ] [MAIN ] Derivative Progress: 814/1881 symbols completed. HIO took 1.4s. Estimated remaining: 7m 15s. Rate: 147.2 symbols/min [2025-10-27T22:10:10.061709] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:10.065391] [INFO ] [MAIN ] Derivative Progress: 815/1881 symbols completed. HIPO took 1.4s. Estimated remaining: 7m 14s. Rate: 147.4 symbols/min [2025-10-27T22:10:10.066178] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:10.074908] [INFO ] [MAIN ] HIW: Generated 138 derivative records from 44271 primary records. [2025-10-27T22:10:10.075140] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-27T22:10:10.098036] [DEBUG] [LOCAL ] HIW: Derivative data saved (138 records). [2025-10-27T22:10:10.098224] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-27T22:10:10.101675] [INFO ] [MAIN ] Derivative Progress: 816/1881 symbols completed. HIW took 1.4s. Estimated remaining: 7m 13s. Rate: 147.6 symbols/min [2025-10-27T22:10:10.116340] [DEBUG] [LOCAL ] HIX: Loaded 20160 existing records from primary storage. [2025-10-27T22:10:10.115967] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:10.117889] [DEBUG] [LOCAL ] HKD: Loaded 18741 existing records from primary storage. [2025-10-27T22:10:10.118467] [INFO ] [MAIN ] HKD: Loaded 18741 primary data records. [2025-10-27T22:10:10.118047] [INFO ] [MAIN ] HIX: Loaded 20160 primary data records. [2025-10-27T22:10:10.784543] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-27T22:10:10.786508] [INFO ] [MAIN ] HL: Loaded 53676 primary data records. [2025-10-27T22:10:11.157059] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:11.157318] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:11.242272] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:11.279742] [INFO ] [MAIN ] HKD: Generated 138 derivative records from 18741 primary records. [2025-10-27T22:10:11.281403] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-27T22:10:11.284002] [INFO ] [MAIN ] HIX: Generated 138 derivative records from 20160 primary records. [2025-10-27T22:10:11.284495] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-27T22:10:11.301996] [DEBUG] [LOCAL ] HKD: Derivative data saved (138 records). [2025-10-27T22:10:11.302337] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-27T22:10:11.318871] [DEBUG] [LOCAL ] HIX: Derivative data saved (138 records). [2025-10-27T22:10:11.313917] [INFO ] [MAIN ] Derivative Progress: 817/1881 symbols completed. HKD took 1.2s. Estimated remaining: 7m 14s. Rate: 147.2 symbols/min [2025-10-27T22:10:11.319445] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-27T22:10:11.319560] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:11.322281] [INFO ] [MAIN ] Derivative Progress: 818/1881 symbols completed. HIX took 1.3s. Estimated remaining: 7m 13s. Rate: 147.4 symbols/min [2025-10-27T22:10:11.324121] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:11.331280] [INFO ] [MAIN ] HL: Generated 138 derivative records from 53676 primary records. [2025-10-27T22:10:11.331423] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-27T22:10:11.344454] [DEBUG] [LOCAL ] HL: Derivative data saved (138 records). [2025-10-27T22:10:11.344586] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-27T22:10:11.347428] [INFO ] [MAIN ] Derivative Progress: 819/1881 symbols completed. HL took 1.2s. Estimated remaining: 7m 12s. Rate: 147.6 symbols/min [2025-10-27T22:10:11.347869] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:11.380217] [DEBUG] [LOCAL ] HLI: Loaded 30327 existing records from primary storage. [2025-10-27T22:10:11.380748] [INFO ] [MAIN ] HLI: Loaded 30327 primary data records. [2025-10-27T22:10:11.468324] [DEBUG] [LOCAL ] HLF: Loaded 48241 existing records from primary storage. [2025-10-27T22:10:11.490833] [INFO ] [MAIN ] HLF: Loaded 48241 primary data records. [2025-10-27T22:10:11.529989] [DEBUG] [LOCAL ] HLIO: Loaded 27820 existing records from primary storage. [2025-10-27T22:10:11.556916] [INFO ] [MAIN ] HLIO: Loaded 27820 primary data records. [2025-10-27T22:10:12.421604] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:12.455191] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:12.490087] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:12.522094] [INFO ] [MAIN ] HLI: Generated 138 derivative records from 30327 primary records. [2025-10-27T22:10:12.523170] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-27T22:10:12.540870] [DEBUG] [LOCAL ] HLI: Derivative data saved (138 records). [2025-10-27T22:10:12.540970] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-27T22:10:12.544971] [INFO ] [MAIN ] Derivative Progress: 820/1881 symbols completed. HLI took 1.2s. Estimated remaining: 7m 12s. Rate: 147.2 symbols/min [2025-10-27T22:10:12.545118] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:12.559071] [INFO ] [MAIN ] HLF: Generated 138 derivative records from 48241 primary records. [2025-10-27T22:10:12.559453] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-27T22:10:12.583713] [DEBUG] [LOCAL ] HLF: Derivative data saved (138 records). [2025-10-27T22:10:12.585116] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-27T22:10:12.588290] [INFO ] [MAIN ] Derivative Progress: 821/1881 symbols completed. HLF took 1.3s. Estimated remaining: 7m 12s. Rate: 147.4 symbols/min [2025-10-27T22:10:12.590669] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:12.591194] [INFO ] [MAIN ] HLIO: Generated 138 derivative records from 27820 primary records. [2025-10-27T22:10:12.599853] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-27T22:10:12.602569] [DEBUG] [LOCAL ] HLLY: Loaded 33098 existing records from primary storage. [2025-10-27T22:10:12.602878] [INFO ] [MAIN ] HLLY: Loaded 33098 primary data records. [2025-10-27T22:10:12.656635] [DEBUG] [LOCAL ] HLIO: Derivative data saved (138 records). [2025-10-27T22:10:12.689143] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-27T22:10:12.722479] [INFO ] [MAIN ] Derivative Progress: 822/1881 symbols completed. HLIO took 1.4s. Estimated remaining: 7m 11s. Rate: 147.5 symbols/min [2025-10-27T22:10:12.735676] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:12.964041] [DEBUG] [LOCAL ] HLN: Loaded 53110 existing records from primary storage. [2025-10-27T22:10:12.964609] [INFO ] [MAIN ] HLN: Loaded 53110 primary data records. [2025-10-27T22:10:13.099900] [DEBUG] [LOCAL ] HLT: Loaded 50413 existing records from primary storage. [2025-10-27T22:10:13.105598] [INFO ] [MAIN ] HLT: Loaded 50413 primary data records. [2025-10-27T22:10:13.225740] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:13.676627] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:13.696059] [INFO ] [MAIN ] HLLY: Generated 138 derivative records from 33098 primary records. [2025-10-27T22:10:13.697793] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-27T22:10:13.713757] [DEBUG] [LOCAL ] HLLY: Derivative data saved (138 records). [2025-10-27T22:10:13.714375] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-27T22:10:13.718222] [INFO ] [MAIN ] Derivative Progress: 823/1881 symbols completed. HLLY took 1.2s. Estimated remaining: 7m 11s. Rate: 147.2 symbols/min [2025-10-27T22:10:13.745083] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:13.771728] [INFO ] [MAIN ] HLN: Generated 138 derivative records from 53110 primary records. [2025-10-27T22:10:13.773007] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-27T22:10:13.790850] [DEBUG] [LOCAL ] HLN: Derivative data saved (138 records). [2025-10-27T22:10:13.791130] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-27T22:10:13.793435] [INFO ] [MAIN ] Derivative Progress: 824/1881 symbols completed. HLN took 1.2s. Estimated remaining: 7m 10s. Rate: 147.4 symbols/min [2025-10-27T22:10:13.799140] [INFO ] [MAIN ] HLT: Generated 138 derivative records from 50413 primary records. [2025-10-27T22:10:13.799210] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-27T22:10:13.810789] [DEBUG] [LOCAL ] HLT: Derivative data saved (138 records). [2025-10-27T22:10:13.810847] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-27T22:10:13.813444] [INFO ] [MAIN ] Derivative Progress: 825/1881 symbols completed. HLT took 1.1s. Estimated remaining: 7m 9s. Rate: 147.5 symbols/min [2025-10-27T22:10:13.814080] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:13.814213] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:13.814004] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:13.836863] [DEBUG] [LOCAL ] HMN: Loaded 22910 existing records from primary storage. [2025-10-27T22:10:13.837071] [INFO ] [MAIN ] HMN: Loaded 22910 primary data records. [2025-10-27T22:10:13.976319] [DEBUG] [LOCAL ] HLX: Loaded 47244 existing records from primary storage. [2025-10-27T22:10:13.982165] [INFO ] [MAIN ] HLX: Loaded 47244 primary data records. [2025-10-27T22:10:14.169629] [DEBUG] [LOCAL ] HMC: Loaded 46041 existing records from primary storage. [2025-10-27T22:10:14.169832] [INFO ] [MAIN ] HMC: Loaded 46041 primary data records. [2025-10-27T22:10:14.845671] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:14.882572] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:14.920949] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:14.980949] [INFO ] [MAIN ] HMN: Generated 138 derivative records from 22910 primary records. [2025-10-27T22:10:14.987773] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-27T22:10:15.005864] [DEBUG] [LOCAL ] HMN: Derivative data saved (138 records). [2025-10-27T22:10:15.012217] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-27T22:10:15.015639] [INFO ] [MAIN ] Derivative Progress: 826/1881 symbols completed. HMN took 1.2s. Estimated remaining: 7m 10s. Rate: 147.2 symbols/min [2025-10-27T22:10:15.017800] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:15.021804] [INFO ] [MAIN ] HLX: Generated 138 derivative records from 47244 primary records. [2025-10-27T22:10:15.025139] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-27T22:10:15.025046] [INFO ] [MAIN ] HMC: Generated 138 derivative records from 46041 primary records. [2025-10-27T22:10:15.026090] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-27T22:10:15.045630] [DEBUG] [LOCAL ] HLX: Derivative data saved (138 records). [2025-10-27T22:10:15.048798] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-27T22:10:15.050835] [DEBUG] [LOCAL ] HMC: Derivative data saved (138 records). [2025-10-27T22:10:15.053375] [INFO ] [MAIN ] Derivative Progress: 827/1881 symbols completed. HLX took 1.2s. Estimated remaining: 7m 9s. Rate: 147.4 symbols/min [2025-10-27T22:10:15.051094] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-27T22:10:15.053548] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:15.057152] [INFO ] [MAIN ] Derivative Progress: 828/1881 symbols completed. HMC took 1.2s. Estimated remaining: 7m 8s. Rate: 147.5 symbols/min [2025-10-27T22:10:15.057830] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:15.111476] [DEBUG] [LOCAL ] HNI: Loaded 29700 existing records from primary storage. [2025-10-27T22:10:15.111631] [INFO ] [MAIN ] HNI: Loaded 29700 primary data records. [2025-10-27T22:10:15.248584] [DEBUG] [LOCAL ] HOG: Loaded 50529 existing records from primary storage. [2025-10-27T22:10:15.249920] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-27T22:10:15.256076] [INFO ] [MAIN ] HMY: Loaded 53166 primary data records. [2025-10-27T22:10:15.250229] [INFO ] [MAIN ] HOG: Loaded 50529 primary data records. [2025-10-27T22:10:16.227169] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:16.244292] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:16.294383] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:10:16.357718] [INFO ] [MAIN ] HMY: Generated 138 derivative records from 53166 primary records. [2025-10-27T22:10:16.361020] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-27T22:10:16.360638] [INFO ] [MAIN ] HNI: Generated 138 derivative records from 29700 primary records. [2025-10-27T22:10:16.362303] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-27T22:10:16.378936] [DEBUG] [LOCAL ] HMY: Derivative data saved (138 records). [2025-10-27T22:10:16.393849] [DEBUG] [LOCAL ] HNI: Derivative data saved (138 records). [2025-10-27T22:10:16.397352] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-27T22:10:16.397595] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-27T22:10:16.399875] [INFO ] [MAIN ] Derivative Progress: 829/1881 symbols completed. HNI took 1.3s. Estimated remaining: 7m 9s. Rate: 147.1 symbols/min [2025-10-27T22:10:16.404688] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:16.404856] [INFO ] [MAIN ] Derivative Progress: 830/1881 symbols completed. HMY took 1.4s. Estimated remaining: 7m 8s. Rate: 147.3 symbols/min [2025-10-27T22:10:16.405729] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:16.409166] [INFO ] [MAIN ] HOG: Generated 138 derivative records from 50529 primary records. [2025-10-27T22:10:16.409552] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-27T22:10:16.423726] [DEBUG] [LOCAL ] HOG: Derivative data saved (138 records). [2025-10-27T22:10:16.424036] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-27T22:10:16.428074] [INFO ] [MAIN ] Derivative Progress: 831/1881 symbols completed. HOG took 1.4s. Estimated remaining: 7m 7s. Rate: 147.5 symbols/min [2025-10-27T22:10:16.428367] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:16.463886] [DEBUG] [LOCAL ] HOV: Loaded 13651 existing records from primary storage. [2025-10-27T22:10:16.464078] [INFO ] [MAIN ] HOV: Loaded 13651 primary data records. [2025-10-27T22:10:16.575235] [DEBUG] [LOCAL ] HOUS: Loaded 45802 existing records from primary storage. [2025-10-27T22:10:16.599814] [INFO ] [MAIN ] HOUS: Loaded 45802 primary data records. [2025-10-27T22:10:16.609959] [DEBUG] [LOCAL ] HOMB: Loaded 43589 existing records from primary storage. [2025-10-27T22:10:16.657111] [INFO ] [MAIN ] HOMB: Loaded 43589 primary data records. [2025-10-27T22:10:17.563844] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:10:17.594637] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:17.643827] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:17.711851] [INFO ] [MAIN ] HOV: Generated 138 derivative records from 13651 primary records. [2025-10-27T22:10:17.715940] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-27T22:10:17.731158] [DEBUG] [LOCAL ] HOV: Derivative data saved (138 records). [2025-10-27T22:10:17.733969] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-27T22:10:17.736218] [INFO ] [MAIN ] Derivative Progress: 832/1881 symbols completed. HOV took 1.3s. Estimated remaining: 7m 8s. Rate: 147.1 symbols/min [2025-10-27T22:10:17.742807] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:17.743846] [INFO ] [MAIN ] HOUS: Generated 138 derivative records from 45802 primary records. [2025-10-27T22:10:17.745857] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-27T22:10:17.749989] [INFO ] [MAIN ] HOMB: Generated 138 derivative records from 43589 primary records. [2025-10-27T22:10:17.762247] [DEBUG] [LOCAL ] HOUS: Derivative data saved (138 records). [2025-10-27T22:10:17.759808] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-27T22:10:17.763456] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-27T22:10:17.767393] [INFO ] [MAIN ] Derivative Progress: 833/1881 symbols completed. HOUS took 1.4s. Estimated remaining: 7m 7s. Rate: 147.2 symbols/min [2025-10-27T22:10:17.775394] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:17.782475] [DEBUG] [LOCAL ] HOMB: Derivative data saved (138 records). [2025-10-27T22:10:17.782943] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-27T22:10:17.786965] [INFO ] [MAIN ] Derivative Progress: 834/1881 symbols completed. HOMB took 1.4s. Estimated remaining: 7m 6s. Rate: 147.4 symbols/min [2025-10-27T22:10:17.787313] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:17.810575] [DEBUG] [LOCAL ] HPF: Loaded 7315 existing records from primary storage. [2025-10-27T22:10:17.810772] [INFO ] [MAIN ] HPF: Loaded 7315 primary data records. [2025-10-27T22:10:17.903409] [DEBUG] [LOCAL ] HP: Loaded 51297 existing records from primary storage. [2025-10-27T22:10:17.922557] [INFO ] [MAIN ] HP: Loaded 51297 primary data records. [2025-10-27T22:10:18.360584] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-27T22:10:18.368356] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-27T22:10:18.972960] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:19.016053] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:19.084348] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:19.121384] [INFO ] [MAIN ] HPF: Generated 138 derivative records from 7315 primary records. [2025-10-27T22:10:19.125737] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-27T22:10:19.144370] [INFO ] [MAIN ] HP: Generated 138 derivative records from 51297 primary records. [2025-10-27T22:10:19.141007] [DEBUG] [LOCAL ] HPF: Derivative data saved (138 records). [2025-10-27T22:10:19.148232] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-27T22:10:19.148316] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-27T22:10:19.152879] [INFO ] [MAIN ] Derivative Progress: 835/1881 symbols completed. HPF took 1.4s. Estimated remaining: 7m 7s. Rate: 147.0 symbols/min [2025-10-27T22:10:19.153219] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:19.178255] [DEBUG] [LOCAL ] HP: Derivative data saved (138 records). [2025-10-27T22:10:19.181104] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-27T22:10:19.185516] [INFO ] [MAIN ] Derivative Progress: 836/1881 symbols completed. HP took 1.4s. Estimated remaining: 7m 6s. Rate: 147.1 symbols/min [2025-10-27T22:10:19.186404] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:19.196106] [DEBUG] [LOCAL ] HPI: Loaded 10526 existing records from primary storage. [2025-10-27T22:10:19.195740] [INFO ] [MAIN ] HPE: Generated 138 derivative records from 53697 primary records. [2025-10-27T22:10:19.196298] [INFO ] [MAIN ] HPI: Loaded 10526 primary data records. [2025-10-27T22:10:19.196374] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-27T22:10:19.320560] [DEBUG] [LOCAL ] HPE: Derivative data saved (138 records). [2025-10-27T22:10:19.321252] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-27T22:10:19.335538] [INFO ] [MAIN ] Derivative Progress: 837/1881 symbols completed. HPE took 1.6s. Estimated remaining: 7m 5s. Rate: 147.3 symbols/min [2025-10-27T22:10:19.346443] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:19.589574] [DEBUG] [LOCAL ] HPP: Loaded 51188 existing records from primary storage. [2025-10-27T22:10:19.590051] [INFO ] [MAIN ] HPP: Loaded 51188 primary data records. [2025-10-27T22:10:19.938741] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-27T22:10:19.940116] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-27T22:10:20.090043] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:20.297120] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:20.357551] [INFO ] [MAIN ] HPI: Generated 138 derivative records from 10526 primary records. [2025-10-27T22:10:20.357925] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:20.361668] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-27T22:10:20.388849] [DEBUG] [LOCAL ] HPI: Derivative data saved (138 records). [2025-10-27T22:10:20.388952] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-27T22:10:20.391192] [INFO ] [MAIN ] Derivative Progress: 838/1881 symbols completed. HPI took 1.2s. Estimated remaining: 7m 6s. Rate: 147.0 symbols/min [2025-10-27T22:10:20.401934] [INFO ] [MAIN ] HPP: Generated 138 derivative records from 51188 primary records. [2025-10-27T22:10:20.404276] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-27T22:10:20.420033] [DEBUG] [LOCAL ] HPP: Derivative data saved (138 records). [2025-10-27T22:10:20.420206] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-27T22:10:20.424104] [INFO ] [MAIN ] Derivative Progress: 839/1881 symbols completed. HPP took 1.2s. Estimated remaining: 7m 5s. Rate: 147.1 symbols/min [2025-10-27T22:10:20.428660] [INFO ] [MAIN ] HPQ: Generated 138 derivative records from 53669 primary records. [2025-10-27T22:10:20.428734] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-27T22:10:20.440308] [DEBUG] [LOCAL ] HPQ: Derivative data saved (138 records). [2025-10-27T22:10:20.440367] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-27T22:10:20.443171] [INFO ] [MAIN ] Derivative Progress: 840/1881 symbols completed. HPQ took 1.1s. Estimated remaining: 7m 4s. Rate: 147.3 symbols/min [2025-10-27T22:10:20.443675] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:20.443789] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:20.443911] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:20.455372] [DEBUG] [LOCAL ] HPS: Loaded 10175 existing records from primary storage. [2025-10-27T22:10:20.455569] [INFO ] [MAIN ] HPS: Loaded 10175 primary data records. [2025-10-27T22:10:20.579122] [DEBUG] [LOCAL ] HQL: Loaded 17143 existing records from primary storage. [2025-10-27T22:10:20.596432] [DEBUG] [LOCAL ] HQH: Loaded 25547 existing records from primary storage. [2025-10-27T22:10:20.606932] [INFO ] [MAIN ] HQH: Loaded 25547 primary data records. [2025-10-27T22:10:20.596554] [INFO ] [MAIN ] HQL: Loaded 17143 primary data records. [2025-10-27T22:10:21.427917] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:21.460200] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:21.497801] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:21.536765] [INFO ] [MAIN ] HPS: Generated 138 derivative records from 10175 primary records. [2025-10-27T22:10:21.537389] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-27T22:10:21.554589] [DEBUG] [LOCAL ] HPS: Derivative data saved (138 records). [2025-10-27T22:10:21.558243] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-27T22:10:21.561460] [INFO ] [MAIN ] Derivative Progress: 841/1881 symbols completed. HPS took 1.1s. Estimated remaining: 7m 4s. Rate: 147.0 symbols/min [2025-10-27T22:10:21.563695] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:21.566403] [INFO ] [MAIN ] HQH: Generated 138 derivative records from 25547 primary records. [2025-10-27T22:10:21.566636] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-27T22:10:21.580174] [DEBUG] [LOCAL ] HQH: Derivative data saved (138 records). [2025-10-27T22:10:21.580420] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-27T22:10:21.582956] [INFO ] [MAIN ] Derivative Progress: 842/1881 symbols completed. HQH took 1.1s. Estimated remaining: 7m 4s. Rate: 147.2 symbols/min [2025-10-27T22:10:21.583122] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:21.589813] [INFO ] [MAIN ] HQL: Generated 138 derivative records from 17143 primary records. [2025-10-27T22:10:21.589992] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-27T22:10:21.602384] [DEBUG] [LOCAL ] HQL: Derivative data saved (138 records). [2025-10-27T22:10:21.602601] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-27T22:10:21.605394] [INFO ] [MAIN ] Derivative Progress: 843/1881 symbols completed. HQL took 1.2s. Estimated remaining: 7m 3s. Rate: 147.3 symbols/min [2025-10-27T22:10:21.605739] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:21.672945] [DEBUG] [LOCAL ] HRB: Loaded 48064 existing records from primary storage. [2025-10-27T22:10:21.674254] [DEBUG] [LOCAL ] HR: Loaded 52096 existing records from primary storage. [2025-10-27T22:10:21.673116] [INFO ] [MAIN ] HRB: Loaded 48064 primary data records. [2025-10-27T22:10:21.674556] [INFO ] [MAIN ] HR: Loaded 52096 primary data records. [2025-10-27T22:10:21.796818] [DEBUG] [LOCAL ] HRI: Loaded 31983 existing records from primary storage. [2025-10-27T22:10:21.849977] [INFO ] [MAIN ] HRI: Loaded 31983 primary data records. [2025-10-27T22:10:22.659085] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:22.700608] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:22.736804] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:22.781408] [INFO ] [MAIN ] HRB: Generated 138 derivative records from 48064 primary records. [2025-10-27T22:10:22.783246] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-27T22:10:22.803053] [DEBUG] [LOCAL ] HRB: Derivative data saved (138 records). [2025-10-27T22:10:22.803463] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-27T22:10:22.806743] [INFO ] [MAIN ] Derivative Progress: 844/1881 symbols completed. HRB took 1.2s. Estimated remaining: 7m 3s. Rate: 147.0 symbols/min [2025-10-27T22:10:22.807592] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:22.830446] [INFO ] [MAIN ] HR: Generated 138 derivative records from 52096 primary records. [2025-10-27T22:10:22.833484] [INFO ] [MAIN ] HRI: Generated 138 derivative records from 31983 primary records. [2025-10-27T22:10:22.833762] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-27T22:10:22.834565] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-27T22:10:22.859088] [DEBUG] [LOCAL ] HRI: Derivative data saved (138 records). [2025-10-27T22:10:22.859780] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-27T22:10:22.864005] [INFO ] [MAIN ] Derivative Progress: 845/1881 symbols completed. HRI took 1.3s. Estimated remaining: 7m 2s. Rate: 147.1 symbols/min [2025-10-27T22:10:22.864967] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:22.881510] [DEBUG] [LOCAL ] HR: Derivative data saved (138 records). [2025-10-27T22:10:22.881794] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-27T22:10:22.885561] [INFO ] [MAIN ] Derivative Progress: 846/1881 symbols completed. HR took 1.3s. Estimated remaining: 7m 2s. Rate: 147.3 symbols/min [2025-10-27T22:10:22.885865] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:22.905535] [DEBUG] [LOCAL ] HRL: Loaded 53115 existing records from primary storage. [2025-10-27T22:10:22.905858] [INFO ] [MAIN ] HRL: Loaded 53115 primary data records. [2025-10-27T22:10:23.028747] [DEBUG] [LOCAL ] HRTG: Loaded 34356 existing records from primary storage. [2025-10-27T22:10:23.029306] [INFO ] [MAIN ] HRTG: Loaded 34356 primary data records. [2025-10-27T22:10:23.431021] [DEBUG] [LOCAL ] HSBC: Loaded 50955 existing records from primary storage. [2025-10-27T22:10:23.431822] [INFO ] [MAIN ] HSBC: Loaded 50955 primary data records. [2025-10-27T22:10:23.860189] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:23.896006] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:23.941952] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:23.967070] [INFO ] [MAIN ] HRL: Generated 138 derivative records from 53115 primary records. [2025-10-27T22:10:23.967272] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-27T22:10:23.993083] [DEBUG] [LOCAL ] HRL: Derivative data saved (138 records). [2025-10-27T22:10:23.995363] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-27T22:10:24.001315] [INFO ] [MAIN ] HRTG: Generated 138 derivative records from 34356 primary records. [2025-10-27T22:10:23.997610] [INFO ] [MAIN ] Derivative Progress: 847/1881 symbols completed. HRL took 1.2s. Estimated remaining: 7m 2s. Rate: 147.0 symbols/min [2025-10-27T22:10:24.001697] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-27T22:10:24.002560] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:24.017636] [DEBUG] [LOCAL ] HRTG: Derivative data saved (138 records). [2025-10-27T22:10:24.018014] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-27T22:10:24.020359] [INFO ] [MAIN ] Derivative Progress: 848/1881 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 1s. Rate: 147.2 symbols/min [2025-10-27T22:10:24.022390] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:24.025334] [INFO ] [MAIN ] HSBC: Generated 138 derivative records from 50955 primary records. [2025-10-27T22:10:24.025569] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-27T22:10:24.042297] [DEBUG] [LOCAL ] HSBC: Derivative data saved (138 records). [2025-10-27T22:10:24.042441] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-27T22:10:24.045160] [INFO ] [MAIN ] Derivative Progress: 849/1881 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 0s. Rate: 147.3 symbols/min [2025-10-27T22:10:24.045479] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:24.052359] [DEBUG] [LOCAL ] HSHP: Loaded 14105 existing records from primary storage. [2025-10-27T22:10:24.052572] [INFO ] [MAIN ] HSHP: Loaded 14105 primary data records. [2025-10-27T22:10:24.171265] [DEBUG] [LOCAL ] HTD: Loaded 14025 existing records from primary storage. [2025-10-27T22:10:24.181991] [INFO ] [MAIN ] HTD: Loaded 14025 primary data records. [2025-10-27T22:10:24.496193] [DEBUG] [LOCAL ] HSY: Loaded 50292 existing records from primary storage. [2025-10-27T22:10:24.500098] [INFO ] [MAIN ] HSY: Loaded 50292 primary data records. [2025-10-27T22:10:25.060271] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:25.096497] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:25.140221] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:25.172913] [INFO ] [MAIN ] HSHP: Generated 138 derivative records from 14105 primary records. [2025-10-27T22:10:25.178335] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-27T22:10:25.193594] [INFO ] [MAIN ] HTD: Generated 138 derivative records from 14025 primary records. [2025-10-27T22:10:25.195440] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-27T22:10:25.198384] [DEBUG] [LOCAL ] HSHP: Derivative data saved (138 records). [2025-10-27T22:10:25.199145] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-27T22:10:25.204102] [INFO ] [MAIN ] Derivative Progress: 850/1881 symbols completed. HSHP took 1.2s. Estimated remaining: 7m 1s. Rate: 147.0 symbols/min [2025-10-27T22:10:25.211158] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:25.216027] [DEBUG] [LOCAL ] HTD: Derivative data saved (138 records). [2025-10-27T22:10:25.216188] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-27T22:10:25.219671] [INFO ] [MAIN ] Derivative Progress: 851/1881 symbols completed. HTD took 1.2s. Estimated remaining: 6m 60s. Rate: 147.2 symbols/min [2025-10-27T22:10:25.221220] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:25.228111] [INFO ] [MAIN ] HSY: Generated 138 derivative records from 50292 primary records. [2025-10-27T22:10:25.228537] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-27T22:10:25.241750] [DEBUG] [LOCAL ] HSY: Derivative data saved (138 records). [2025-10-27T22:10:25.242370] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-27T22:10:25.245385] [INFO ] [MAIN ] Derivative Progress: 852/1881 symbols completed. HSY took 1.2s. Estimated remaining: 6m 59s. Rate: 147.3 symbols/min [2025-10-27T22:10:25.245688] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:25.276729] [DEBUG] [LOCAL ] HTH: Loaded 32247 existing records from primary storage. [2025-10-27T22:10:25.276857] [INFO ] [MAIN ] HTH: Loaded 32247 primary data records. [2025-10-27T22:10:25.406931] [DEBUG] [LOCAL ] HTGC: Loaded 47529 existing records from primary storage. [2025-10-27T22:10:25.407144] [INFO ] [MAIN ] HTGC: Loaded 47529 primary data records. [2025-10-27T22:10:25.544889] [DEBUG] [LOCAL ] HUBB: Loaded 35660 existing records from primary storage. [2025-10-27T22:10:25.567703] [INFO ] [MAIN ] HUBB: Loaded 35660 primary data records. [2025-10-27T22:10:26.253820] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:26.289338] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:26.328544] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:26.382361] [INFO ] [MAIN ] HTH: Generated 138 derivative records from 32247 primary records. [2025-10-27T22:10:26.383690] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-27T22:10:26.396895] [INFO ] [MAIN ] HTGC: Generated 138 derivative records from 47529 primary records. [2025-10-27T22:10:26.403009] [DEBUG] [LOCAL ] HTH: Derivative data saved (138 records). [2025-10-27T22:10:26.403109] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-27T22:10:26.403997] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-27T22:10:26.414854] [INFO ] [MAIN ] Derivative Progress: 853/1881 symbols completed. HTH took 1.2s. Estimated remaining: 6m 60s. Rate: 147.0 symbols/min [2025-10-27T22:10:26.419733] [DEBUG] [LOCAL ] HTGC: Derivative data saved (138 records). [2025-10-27T22:10:26.420178] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-27T22:10:26.425791] [INFO ] [MAIN ] Derivative Progress: 854/1881 symbols completed. HTGC took 1.2s. Estimated remaining: 6m 59s. Rate: 147.2 symbols/min [2025-10-27T22:10:26.428513] [INFO ] [MAIN ] HUBB: Generated 138 derivative records from 35660 primary records. [2025-10-27T22:10:26.428590] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-27T22:10:26.439990] [DEBUG] [LOCAL ] HUBB: Derivative data saved (138 records). [2025-10-27T22:10:26.440045] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-27T22:10:26.442725] [INFO ] [MAIN ] Derivative Progress: 855/1881 symbols completed. HUBB took 1.2s. Estimated remaining: 6m 58s. Rate: 147.4 symbols/min [2025-10-27T22:10:26.443328] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:26.443478] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:26.443257] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:26.499419] [DEBUG] [LOCAL ] HUBS: Loaded 39652 existing records from primary storage. [2025-10-27T22:10:26.499550] [INFO ] [MAIN ] HUBS: Loaded 39652 primary data records. [2025-10-27T22:10:26.639502] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-27T22:10:26.632609] [DEBUG] [LOCAL ] HUM: Loaded 49027 existing records from primary storage. [2025-10-27T22:10:26.655360] [INFO ] [MAIN ] HUN: Loaded 53210 primary data records. [2025-10-27T22:10:26.665774] [INFO ] [MAIN ] HUM: Loaded 49027 primary data records. [2025-10-27T22:10:27.523801] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:27.576369] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:27.604093] [INFO ] [MAIN ] HUBS: Generated 138 derivative records from 39652 primary records. [2025-10-27T22:10:27.606243] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:27.617373] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-27T22:10:27.635733] [DEBUG] [LOCAL ] HUBS: Derivative data saved (138 records). [2025-10-27T22:10:27.640995] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-27T22:10:27.642993] [INFO ] [MAIN ] Derivative Progress: 856/1881 symbols completed. HUBS took 1.2s. Estimated remaining: 6m 58s. Rate: 147.0 symbols/min [2025-10-27T22:10:27.643234] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:27.669164] [INFO ] [MAIN ] HUN: Generated 138 derivative records from 53210 primary records. [2025-10-27T22:10:27.679868] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-27T22:10:27.695673] [DEBUG] [LOCAL ] HUN: Derivative data saved (138 records). [2025-10-27T22:10:27.697733] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-27T22:10:27.704181] [INFO ] [MAIN ] HUM: Generated 138 derivative records from 49027 primary records. [2025-10-27T22:10:27.704456] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-27T22:10:27.703637] [INFO ] [MAIN ] Derivative Progress: 857/1881 symbols completed. HUN took 1.3s. Estimated remaining: 6m 57s. Rate: 147.2 symbols/min [2025-10-27T22:10:27.717890] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:27.729918] [DEBUG] [LOCAL ] HUM: Derivative data saved (138 records). [2025-10-27T22:10:27.730069] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-27T22:10:27.733994] [DEBUG] [LOCAL ] HUYA: Loaded 43516 existing records from primary storage. [2025-10-27T22:10:27.734440] [INFO ] [MAIN ] HUYA: Loaded 43516 primary data records. [2025-10-27T22:10:27.732796] [INFO ] [MAIN ] Derivative Progress: 858/1881 symbols completed. HUM took 1.3s. Estimated remaining: 6m 57s. Rate: 147.3 symbols/min [2025-10-27T22:10:27.734776] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:27.855021] [DEBUG] [LOCAL ] HVT: Loaded 14524 existing records from primary storage. [2025-10-27T22:10:27.871239] [INFO ] [MAIN ] HVT: Loaded 14524 primary data records. [2025-10-27T22:10:28.382751] [DEBUG] [LOCAL ] HWM: Loaded 52655 existing records from primary storage. [2025-10-27T22:10:28.383264] [INFO ] [MAIN ] HWM: Loaded 52655 primary data records. [2025-10-27T22:10:28.694014] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:28.734699] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:28.787687] [INFO ] [MAIN ] HUYA: Generated 138 derivative records from 43516 primary records. [2025-10-27T22:10:28.787344] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:28.801161] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-27T22:10:28.818700] [DEBUG] [LOCAL ] HUYA: Derivative data saved (138 records). [2025-10-27T22:10:28.819142] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-27T22:10:28.824900] [INFO ] [MAIN ] Derivative Progress: 859/1881 symbols completed. HUYA took 1.2s. Estimated remaining: 6m 57s. Rate: 147.0 symbols/min [2025-10-27T22:10:28.828122] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:28.833455] [INFO ] [MAIN ] HVT: Generated 138 derivative records from 14524 primary records. [2025-10-27T22:10:28.835865] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-27T22:10:28.852290] [DEBUG] [LOCAL ] HVT: Derivative data saved (138 records). [2025-10-27T22:10:28.853020] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-27T22:10:28.857275] [INFO ] [MAIN ] Derivative Progress: 860/1881 symbols completed. HVT took 1.1s. Estimated remaining: 6m 56s. Rate: 147.2 symbols/min [2025-10-27T22:10:28.861070] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:28.864969] [INFO ] [MAIN ] HWM: Generated 138 derivative records from 52655 primary records. [2025-10-27T22:10:28.865275] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-27T22:10:28.896965] [DEBUG] [LOCAL ] HY: Loaded 9594 existing records from primary storage. [2025-10-27T22:10:28.897785] [INFO ] [MAIN ] HY: Loaded 9594 primary data records. [2025-10-27T22:10:28.896632] [DEBUG] [LOCAL ] HWM: Derivative data saved (138 records). [2025-10-27T22:10:28.897944] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-27T22:10:28.912439] [INFO ] [MAIN ] Derivative Progress: 861/1881 symbols completed. HWM took 1.2s. Estimated remaining: 6m 55s. Rate: 147.3 symbols/min [2025-10-27T22:10:28.951472] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:28.991178] [DEBUG] [LOCAL ] HXL: Loaded 45823 existing records from primary storage. [2025-10-27T22:10:28.996594] [INFO ] [MAIN ] HXL: Loaded 45823 primary data records. [2025-10-27T22:10:29.126031] [DEBUG] [LOCAL ] HYI: Loaded 9485 existing records from primary storage. [2025-10-27T22:10:29.173368] [INFO ] [MAIN ] HYI: Loaded 9485 primary data records. [2025-10-27T22:10:29.912448] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:29.957870] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:29.985307] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:30.009588] [INFO ] [MAIN ] HY: Generated 138 derivative records from 9594 primary records. [2025-10-27T22:10:30.012243] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-27T22:10:30.030424] [DEBUG] [LOCAL ] HY: Derivative data saved (138 records). [2025-10-27T22:10:30.031029] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-27T22:10:30.033283] [INFO ] [MAIN ] Derivative Progress: 862/1881 symbols completed. HY took 1.2s. Estimated remaining: 6m 56s. Rate: 147.0 symbols/min [2025-10-27T22:10:30.035284] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:30.063251] [INFO ] [MAIN ] HXL: Generated 138 derivative records from 45823 primary records. [2025-10-27T22:10:30.071347] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-27T22:10:30.074981] [INFO ] [MAIN ] HYI: Generated 138 derivative records from 9485 primary records. [2025-10-27T22:10:30.094348] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-27T22:10:30.097864] [DEBUG] [LOCAL ] HYT: Loaded 33156 existing records from primary storage. [2025-10-27T22:10:30.098001] [INFO ] [MAIN ] HYT: Loaded 33156 primary data records. [2025-10-27T22:10:30.098077] [DEBUG] [LOCAL ] HXL: Derivative data saved (138 records). [2025-10-27T22:10:30.098177] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-27T22:10:30.112134] [INFO ] [MAIN ] Derivative Progress: 863/1881 symbols completed. HXL took 1.3s. Estimated remaining: 6m 55s. Rate: 147.2 symbols/min [2025-10-27T22:10:30.142070] [DEBUG] [LOCAL ] HYI: Derivative data saved (138 records). [2025-10-27T22:10:30.139561] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:30.165470] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-27T22:10:30.181576] [INFO ] [MAIN ] Derivative Progress: 864/1881 symbols completed. HYI took 1.2s. Estimated remaining: 6m 54s. Rate: 147.3 symbols/min [2025-10-27T22:10:30.193193] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:30.244951] [DEBUG] [LOCAL ] HYTR: Loaded 3094 existing records from primary storage. [2025-10-27T22:10:30.265982] [INFO ] [MAIN ] HYTR: Loaded 3094 primary data records. [2025-10-27T22:10:30.525083] [DEBUG] [LOCAL ] HZO: Loaded 28097 existing records from primary storage. [2025-10-27T22:10:30.531040] [INFO ] [MAIN ] HZO: Loaded 28097 primary data records. [2025-10-27T22:10:31.075836] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:31.115309] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:10:31.163568] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:31.188936] [INFO ] [MAIN ] HYT: Generated 138 derivative records from 33156 primary records. [2025-10-27T22:10:31.194844] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-27T22:10:31.211194] [DEBUG] [LOCAL ] HYT: Derivative data saved (138 records). [2025-10-27T22:10:31.212962] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-27T22:10:31.215293] [INFO ] [MAIN ] Derivative Progress: 865/1881 symbols completed. HYT took 1.2s. Estimated remaining: 6m 55s. Rate: 147.1 symbols/min [2025-10-27T22:10:31.219972] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:31.227635] [INFO ] [MAIN ] HYTR: Generated 138 derivative records from 3094 primary records. [2025-10-27T22:10:31.229100] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-27T22:10:31.249574] [DEBUG] [LOCAL ] IAE: Loaded 6415 existing records from primary storage. [2025-10-27T22:10:31.249365] [DEBUG] [LOCAL ] HYTR: Derivative data saved (138 records). [2025-10-27T22:10:31.249841] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-27T22:10:31.252553] [INFO ] [MAIN ] Derivative Progress: 866/1881 symbols completed. HYTR took 1.1s. Estimated remaining: 6m 54s. Rate: 147.2 symbols/min [2025-10-27T22:10:31.252926] [INFO ] [MAIN ] IAE: Loaded 6415 primary data records. [2025-10-27T22:10:31.275385] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:31.297621] [INFO ] [MAIN ] HZO: Generated 138 derivative records from 28097 primary records. [2025-10-27T22:10:31.309606] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-27T22:10:31.368437] [DEBUG] [LOCAL ] HZO: Derivative data saved (138 records). [2025-10-27T22:10:31.368578] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-27T22:10:31.371269] [INFO ] [MAIN ] Derivative Progress: 867/1881 symbols completed. HZO took 1.2s. Estimated remaining: 6m 53s. Rate: 147.3 symbols/min [2025-10-27T22:10:31.371532] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:31.599816] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-27T22:10:31.600248] [INFO ] [MAIN ] IAG: Loaded 53492 primary data records. [2025-10-27T22:10:31.748257] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-27T22:10:31.771506] [INFO ] [MAIN ] IBM: Loaded 53628 primary data records. [2025-10-27T22:10:31.923865] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:32.299372] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:32.299573] [INFO ] [MAIN ] IAE: Generated 138 derivative records from 6415 primary records. [2025-10-27T22:10:32.300095] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-27T22:10:32.330056] [DEBUG] [LOCAL ] IAE: Derivative data saved (138 records). [2025-10-27T22:10:32.330323] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-27T22:10:32.342175] [INFO ] [MAIN ] Derivative Progress: 868/1881 symbols completed. IAE took 1.1s. Estimated remaining: 6m 53s. Rate: 147.1 symbols/min [2025-10-27T22:10:32.350941] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:32.386381] [INFO ] [MAIN ] IAG: Generated 138 derivative records from 53492 primary records. [2025-10-27T22:10:32.386732] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-27T22:10:32.402984] [DEBUG] [LOCAL ] IAG: Derivative data saved (138 records). [2025-10-27T22:10:32.405308] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-27T22:10:32.407692] [INFO ] [MAIN ] Derivative Progress: 869/1881 symbols completed. IAG took 1.1s. Estimated remaining: 6m 52s. Rate: 147.2 symbols/min [2025-10-27T22:10:32.410049] [INFO ] [MAIN ] IBM: Generated 138 derivative records from 53628 primary records. [2025-10-27T22:10:32.410141] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-27T22:10:32.421833] [DEBUG] [LOCAL ] IBM: Derivative data saved (138 records). [2025-10-27T22:10:32.421888] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-27T22:10:32.424894] [INFO ] [MAIN ] Derivative Progress: 870/1881 symbols completed. IBM took 1.1s. Estimated remaining: 6m 52s. Rate: 147.4 symbols/min [2025-10-27T22:10:32.425344] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:32.425278] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:32.425780] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:32.459998] [DEBUG] [LOCAL ] IBP: Loaded 28251 existing records from primary storage. [2025-10-27T22:10:32.472378] [INFO ] [MAIN ] IBP: Loaded 28251 primary data records. [2025-10-27T22:10:32.607382] [DEBUG] [LOCAL ] IBTA: Loaded 35583 existing records from primary storage. [2025-10-27T22:10:32.623036] [INFO ] [MAIN ] IBTA: Loaded 35583 primary data records. [2025-10-27T22:10:32.645536] [DEBUG] [LOCAL ] IBN: Loaded 52799 existing records from primary storage. [2025-10-27T22:10:32.674229] [INFO ] [MAIN ] IBN: Loaded 52799 primary data records. [2025-10-27T22:10:33.440332] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:33.476066] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:33.522509] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:33.553125] [INFO ] [MAIN ] IBP: Generated 138 derivative records from 28251 primary records. [2025-10-27T22:10:33.553409] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-27T22:10:33.570057] [DEBUG] [LOCAL ] IBP: Derivative data saved (138 records). [2025-10-27T22:10:33.573903] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-27T22:10:33.577086] [INFO ] [MAIN ] Derivative Progress: 871/1881 symbols completed. IBP took 1.2s. Estimated remaining: 6m 52s. Rate: 147.1 symbols/min [2025-10-27T22:10:33.577566] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:33.590430] [INFO ] [MAIN ] IBN: Generated 138 derivative records from 52799 primary records. [2025-10-27T22:10:33.590701] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-27T22:10:33.594304] [INFO ] [MAIN ] IBTA: Generated 138 derivative records from 35583 primary records. [2025-10-27T22:10:33.602999] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-27T22:10:33.616824] [DEBUG] [LOCAL ] IBTA: Derivative data saved (138 records). [2025-10-27T22:10:33.617497] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-27T22:10:33.621313] [INFO ] [MAIN ] Derivative Progress: 872/1881 symbols completed. IBTA took 1.2s. Estimated remaining: 6m 51s. Rate: 147.3 symbols/min [2025-10-27T22:10:33.621992] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:33.622062] [DEBUG] [LOCAL ] IBN: Derivative data saved (138 records). [2025-10-27T22:10:33.622632] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-27T22:10:33.626016] [INFO ] [MAIN ] Derivative Progress: 873/1881 symbols completed. IBN took 1.2s. Estimated remaining: 6m 50s. Rate: 147.4 symbols/min [2025-10-27T22:10:33.626484] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:33.684217] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-27T22:10:33.702669] [INFO ] [MAIN ] ICE: Loaded 53009 primary data records. [2025-10-27T22:10:33.742254] [DEBUG] [LOCAL ] ICL: Loaded 37737 existing records from primary storage. [2025-10-27T22:10:33.717285] [DEBUG] [LOCAL ] IDA: Loaded 32500 existing records from primary storage. [2025-10-27T22:10:33.747658] [INFO ] [MAIN ] ICL: Loaded 37737 primary data records. [2025-10-27T22:10:33.762403] [INFO ] [MAIN ] IDA: Loaded 32500 primary data records. [2025-10-27T22:10:34.700184] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:34.743673] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:34.758564] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:34.814855] [INFO ] [MAIN ] ICE: Generated 138 derivative records from 53009 primary records. [2025-10-27T22:10:34.815231] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-27T22:10:34.836473] [DEBUG] [LOCAL ] ICE: Derivative data saved (138 records). [2025-10-27T22:10:34.842852] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-27T22:10:34.844822] [INFO ] [MAIN ] Derivative Progress: 874/1881 symbols completed. ICE took 1.3s. Estimated remaining: 6m 51s. Rate: 147.1 symbols/min [2025-10-27T22:10:34.845325] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:34.850830] [INFO ] [MAIN ] ICL: Generated 138 derivative records from 37737 primary records. [2025-10-27T22:10:34.850962] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-27T22:10:34.869898] [DEBUG] [LOCAL ] ICL: Derivative data saved (138 records). [2025-10-27T22:10:34.871857] [INFO ] [MAIN ] IDA: Generated 138 derivative records from 32500 primary records. [2025-10-27T22:10:34.875750] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-27T22:10:34.875697] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-27T22:10:34.875989] [DEBUG] [LOCAL ] IDE: Loaded 9081 existing records from primary storage. [2025-10-27T22:10:34.879226] [INFO ] [MAIN ] Derivative Progress: 875/1881 symbols completed. ICL took 1.3s. Estimated remaining: 6m 50s. Rate: 147.2 symbols/min [2025-10-27T22:10:34.879322] [INFO ] [MAIN ] IDE: Loaded 9081 primary data records. [2025-10-27T22:10:34.879725] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:34.982873] [DEBUG] [LOCAL ] IDA: Derivative data saved (138 records). [2025-10-27T22:10:35.011297] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-27T22:10:35.012598] [DEBUG] [LOCAL ] IDT: Loaded 18504 existing records from primary storage. [2025-10-27T22:10:35.020968] [INFO ] [MAIN ] Derivative Progress: 876/1881 symbols completed. IDA took 1.4s. Estimated remaining: 6m 49s. Rate: 147.3 symbols/min [2025-10-27T22:10:35.018474] [INFO ] [MAIN ] IDT: Loaded 18504 primary data records. [2025-10-27T22:10:35.037016] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:35.567077] [DEBUG] [LOCAL ] IEX: Loaded 37995 existing records from primary storage. [2025-10-27T22:10:35.567784] [INFO ] [MAIN ] IEX: Loaded 37995 primary data records. [2025-10-27T22:10:35.889980] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:35.925931] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:35.975112] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:36.002553] [INFO ] [MAIN ] IDE: Generated 138 derivative records from 9081 primary records. [2025-10-27T22:10:36.005146] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-27T22:10:36.022568] [DEBUG] [LOCAL ] IDE: Derivative data saved (138 records). [2025-10-27T22:10:36.024821] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-27T22:10:36.028321] [INFO ] [MAIN ] Derivative Progress: 877/1881 symbols completed. IDE took 1.2s. Estimated remaining: 6m 50s. Rate: 147.1 symbols/min [2025-10-27T22:10:36.029081] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:36.038066] [INFO ] [MAIN ] IDT: Generated 138 derivative records from 18504 primary records. [2025-10-27T22:10:36.038482] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-27T22:10:36.054187] [DEBUG] [LOCAL ] IDT: Derivative data saved (138 records). [2025-10-27T22:10:36.054402] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-27T22:10:36.058340] [INFO ] [MAIN ] Derivative Progress: 878/1881 symbols completed. IDT took 1.2s. Estimated remaining: 6m 49s. Rate: 147.3 symbols/min [2025-10-27T22:10:36.059019] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:36.065401] [INFO ] [MAIN ] IEX: Generated 138 derivative records from 37995 primary records. [2025-10-27T22:10:36.065669] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-27T22:10:36.078083] [DEBUG] [LOCAL ] IEX: Derivative data saved (138 records). [2025-10-27T22:10:36.095096] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-27T22:10:36.097566] [INFO ] [MAIN ] Derivative Progress: 879/1881 symbols completed. IEX took 1.1s. Estimated remaining: 6m 48s. Rate: 147.4 symbols/min [2025-10-27T22:10:36.097836] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:36.108196] [DEBUG] [LOCAL ] IFN: Loaded 18180 existing records from primary storage. [2025-10-27T22:10:36.108355] [INFO ] [MAIN ] IFN: Loaded 18180 primary data records. [2025-10-27T22:10:36.195048] [DEBUG] [LOCAL ] IFF: Loaded 51193 existing records from primary storage. [2025-10-27T22:10:36.215983] [INFO ] [MAIN ] IFF: Loaded 51193 primary data records. [2025-10-27T22:10:36.275108] [DEBUG] [LOCAL ] IFS: Loaded 21676 existing records from primary storage. [2025-10-27T22:10:36.315770] [INFO ] [MAIN ] IFS: Loaded 21676 primary data records. [2025-10-27T22:10:37.039708] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:37.066884] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:37.103774] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:37.209392] [INFO ] [MAIN ] IFN: Generated 138 derivative records from 18180 primary records. [2025-10-27T22:10:37.215914] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-27T22:10:37.213413] [INFO ] [MAIN ] IFF: Generated 138 derivative records from 51193 primary records. [2025-10-27T22:10:37.216727] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-27T22:10:37.242053] [DEBUG] [LOCAL ] IFF: Derivative data saved (138 records). [2025-10-27T22:10:37.239115] [DEBUG] [LOCAL ] IFN: Derivative data saved (138 records). [2025-10-27T22:10:37.242275] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-27T22:10:37.242454] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-27T22:10:37.244809] [INFO ] [MAIN ] IFS: Generated 138 derivative records from 21676 primary records. [2025-10-27T22:10:37.247203] [INFO ] [MAIN ] Derivative Progress: 880/1881 symbols completed. IFF took 1.2s. Estimated remaining: 6m 48s. Rate: 147.1 symbols/min [2025-10-27T22:10:37.249449] [INFO ] [MAIN ] Derivative Progress: 881/1881 symbols completed. IFN took 1.2s. Estimated remaining: 6m 47s. Rate: 147.3 symbols/min [2025-10-27T22:10:37.249403] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-27T22:10:37.249291] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:37.249781] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:37.263789] [DEBUG] [LOCAL ] IFS: Derivative data saved (138 records). [2025-10-27T22:10:37.266164] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-27T22:10:37.268885] [INFO ] [MAIN ] Derivative Progress: 882/1881 symbols completed. IFS took 1.2s. Estimated remaining: 6m 47s. Rate: 147.4 symbols/min [2025-10-27T22:10:37.269054] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:37.280459] [DEBUG] [LOCAL ] IGA: Loaded 9709 existing records from primary storage. [2025-10-27T22:10:37.280749] [INFO ] [MAIN ] IGA: Loaded 9709 primary data records. [2025-10-27T22:10:37.346139] [DEBUG] [LOCAL ] IGD: Loaded 19075 existing records from primary storage. [2025-10-27T22:10:37.345825] [DEBUG] [LOCAL ] IGI: Loaded 4108 existing records from primary storage. [2025-10-27T22:10:37.346274] [INFO ] [MAIN ] IGD: Loaded 19075 primary data records. [2025-10-27T22:10:37.365192] [INFO ] [MAIN ] IGI: Loaded 4108 primary data records. [2025-10-27T22:10:38.200551] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:38.228430] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:38.257558] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:38.308880] [INFO ] [MAIN ] IGD: Generated 138 derivative records from 19075 primary records. [2025-10-27T22:10:38.310158] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-27T22:10:38.326137] [DEBUG] [LOCAL ] IGD: Derivative data saved (138 records). [2025-10-27T22:10:38.326672] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-27T22:10:38.328988] [INFO ] [MAIN ] Derivative Progress: 883/1881 symbols completed. IGD took 1.1s. Estimated remaining: 6m 47s. Rate: 147.2 symbols/min [2025-10-27T22:10:38.334010] [INFO ] [MAIN ] IGI: Generated 138 derivative records from 4108 primary records. [2025-10-27T22:10:38.334286] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-27T22:10:38.343266] [INFO ] [MAIN ] IGA: Generated 138 derivative records from 9709 primary records. [2025-10-27T22:10:38.344844] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-27T22:10:38.346996] [DEBUG] [LOCAL ] IGI: Derivative data saved (138 records). [2025-10-27T22:10:38.347456] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-27T22:10:38.350324] [INFO ] [MAIN ] Derivative Progress: 884/1881 symbols completed. IGI took 1.1s. Estimated remaining: 6m 46s. Rate: 147.3 symbols/min [2025-10-27T22:10:38.361062] [DEBUG] [LOCAL ] IGA: Derivative data saved (138 records). [2025-10-27T22:10:38.361123] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-27T22:10:38.363030] [INFO ] [MAIN ] Derivative Progress: 885/1881 symbols completed. IGA took 1.1s. Estimated remaining: 6m 45s. Rate: 147.5 symbols/min [2025-10-27T22:10:38.363523] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:38.363581] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:38.363773] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:38.372458] [DEBUG] [LOCAL ] IH: Loaded 2674 existing records from primary storage. [2025-10-27T22:10:38.372739] [INFO ] [MAIN ] IH: Loaded 2674 primary data records. [2025-10-27T22:10:38.388216] [DEBUG] [LOCAL ] IHD: Loaded 7348 existing records from primary storage. [2025-10-27T22:10:38.388313] [INFO ] [MAIN ] IHD: Loaded 7348 primary data records. [2025-10-27T22:10:38.643931] [DEBUG] [LOCAL ] IGR: Loaded 30163 existing records from primary storage. [2025-10-27T22:10:38.654571] [INFO ] [MAIN ] IGR: Loaded 30163 primary data records. [2025-10-27T22:10:39.430588] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:10:39.463325] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:39.507143] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:39.554941] [INFO ] [MAIN ] IH: Generated 138 derivative records from 2674 primary records. [2025-10-27T22:10:39.560614] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-27T22:10:39.574776] [DEBUG] [LOCAL ] IH: Derivative data saved (138 records). [2025-10-27T22:10:39.577115] [INFO ] [MAIN ] IHD: Generated 138 derivative records from 7348 primary records. [2025-10-27T22:10:39.577706] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-27T22:10:39.577610] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-27T22:10:39.579911] [INFO ] [MAIN ] Derivative Progress: 886/1881 symbols completed. IH took 1.2s. Estimated remaining: 6m 46s. Rate: 147.1 symbols/min [2025-10-27T22:10:39.595827] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:39.595635] [DEBUG] [LOCAL ] IHD: Derivative data saved (138 records). [2025-10-27T22:10:39.598365] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-27T22:10:39.601459] [INFO ] [MAIN ] Derivative Progress: 887/1881 symbols completed. IHD took 1.2s. Estimated remaining: 6m 45s. Rate: 147.3 symbols/min [2025-10-27T22:10:39.601871] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:39.608665] [INFO ] [MAIN ] IGR: Generated 138 derivative records from 30163 primary records. [2025-10-27T22:10:39.608827] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-27T22:10:39.626385] [DEBUG] [LOCAL ] IGR: Derivative data saved (138 records). [2025-10-27T22:10:39.626559] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-27T22:10:39.628974] [INFO ] [MAIN ] Derivative Progress: 888/1881 symbols completed. IGR took 1.3s. Estimated remaining: 6m 44s. Rate: 147.5 symbols/min [2025-10-27T22:10:39.629230] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:39.647100] [DEBUG] [LOCAL ] IHG: Loaded 23569 existing records from primary storage. [2025-10-27T22:10:39.647294] [INFO ] [MAIN ] IHG: Loaded 23569 primary data records. [2025-10-27T22:10:39.681118] [DEBUG] [LOCAL ] IIF: Loaded 5028 existing records from primary storage. [2025-10-27T22:10:39.731004] [INFO ] [MAIN ] IIF: Loaded 5028 primary data records. [2025-10-27T22:10:39.716997] [DEBUG] [LOCAL ] IHS: Loaded 36888 existing records from primary storage. [2025-10-27T22:10:39.837215] [INFO ] [MAIN ] IHS: Loaded 36888 primary data records. [2025-10-27T22:10:40.628846] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:40.660165] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:40.657808] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:40.746844] [INFO ] [MAIN ] IIF: Generated 138 derivative records from 5028 primary records. [2025-10-27T22:10:40.748982] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-27T22:10:40.750074] [INFO ] [MAIN ] IHG: Generated 138 derivative records from 23569 primary records. [2025-10-27T22:10:40.762052] [DEBUG] [LOCAL ] IIF: Derivative data saved (138 records). [2025-10-27T22:10:40.762181] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-27T22:10:40.762349] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-27T22:10:40.765363] [INFO ] [MAIN ] Derivative Progress: 889/1881 symbols completed. IIF took 1.1s. Estimated remaining: 6m 44s. Rate: 147.2 symbols/min [2025-10-27T22:10:40.768273] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:40.778421] [INFO ] [MAIN ] IHS: Generated 138 derivative records from 36888 primary records. [2025-10-27T22:10:40.781757] [DEBUG] [LOCAL ] IHG: Derivative data saved (138 records). [2025-10-27T22:10:40.783112] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-27T22:10:40.785534] [INFO ] [MAIN ] Derivative Progress: 890/1881 symbols completed. IHG took 1.2s. Estimated remaining: 6m 44s. Rate: 147.3 symbols/min [2025-10-27T22:10:40.785886] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:40.786003] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-27T22:10:40.803516] [DEBUG] [LOCAL ] IHS: Derivative data saved (138 records). [2025-10-27T22:10:40.803687] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-27T22:10:40.806181] [INFO ] [MAIN ] Derivative Progress: 891/1881 symbols completed. IHS took 1.2s. Estimated remaining: 6m 43s. Rate: 147.5 symbols/min [2025-10-27T22:10:40.806395] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:40.817159] [DEBUG] [LOCAL ] IIIN: Loaded 16087 existing records from primary storage. [2025-10-27T22:10:40.817443] [INFO ] [MAIN ] IIIN: Loaded 16087 primary data records. [2025-10-27T22:10:40.866315] [DEBUG] [LOCAL ] IIM: Loaded 15363 existing records from primary storage. [2025-10-27T22:10:40.893372] [INFO ] [MAIN ] IIM: Loaded 15363 primary data records. [2025-10-27T22:10:41.039727] [DEBUG] [LOCAL ] IIPR: Loaded 28414 existing records from primary storage. [2025-10-27T22:10:41.057325] [INFO ] [MAIN ] IIPR: Loaded 28414 primary data records. [2025-10-27T22:10:41.871821] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:41.896166] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:41.942174] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:41.991673] [INFO ] [MAIN ] IIIN: Generated 138 derivative records from 16087 primary records. [2025-10-27T22:10:41.995045] [INFO ] [MAIN ] IIM: Generated 138 derivative records from 15363 primary records. [2025-10-27T22:10:41.995224] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-27T22:10:41.995409] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-27T22:10:42.011000] [DEBUG] [LOCAL ] IIM: Derivative data saved (138 records). [2025-10-27T22:10:42.011156] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-27T22:10:42.021969] [INFO ] [MAIN ] Derivative Progress: 892/1881 symbols completed. IIM took 1.2s. Estimated remaining: 6m 43s. Rate: 147.1 symbols/min [2025-10-27T22:10:42.022746] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:42.025686] [DEBUG] [LOCAL ] IIIN: Derivative data saved (138 records). [2025-10-27T22:10:42.027439] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-27T22:10:42.029877] [INFO ] [MAIN ] Derivative Progress: 893/1881 symbols completed. IIIN took 1.3s. Estimated remaining: 6m 42s. Rate: 147.3 symbols/min [2025-10-27T22:10:42.032597] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:42.035978] [INFO ] [MAIN ] IIPR: Generated 138 derivative records from 28414 primary records. [2025-10-27T22:10:42.036223] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-27T22:10:42.048491] [DEBUG] [LOCAL ] IIPR: Derivative data saved (138 records). [2025-10-27T22:10:42.048680] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-27T22:10:42.051258] [INFO ] [MAIN ] Derivative Progress: 894/1881 symbols completed. IIPR took 1.2s. Estimated remaining: 6m 42s. Rate: 147.5 symbols/min [2025-10-27T22:10:42.051599] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:42.108193] [DEBUG] [LOCAL ] IMAX: Loaded 43361 existing records from primary storage. [2025-10-27T22:10:42.121339] [INFO ] [MAIN ] IMAX: Loaded 43361 primary data records. [2025-10-27T22:10:42.142884] [DEBUG] [LOCAL ] INFA: Loaded 48355 existing records from primary storage. [2025-10-27T22:10:42.158439] [INFO ] [MAIN ] INFA: Loaded 48355 primary data records. [2025-10-27T22:10:42.247865] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-27T22:10:42.279751] [INFO ] [MAIN ] INFY: Loaded 53595 primary data records. [2025-10-27T22:10:43.037570] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:43.086023] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:43.086591] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:43.149969] [INFO ] [MAIN ] IMAX: Generated 138 derivative records from 43361 primary records. [2025-10-27T22:10:43.150491] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-27T22:10:43.170100] [DEBUG] [LOCAL ] IMAX: Derivative data saved (138 records). [2025-10-27T22:10:43.171600] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-27T22:10:43.175508] [INFO ] [MAIN ] Derivative Progress: 895/1881 symbols completed. IMAX took 1.2s. Estimated remaining: 6m 42s. Rate: 147.2 symbols/min [2025-10-27T22:10:43.176080] [INFO ] [MAIN ] INFA: Generated 138 derivative records from 48355 primary records. [2025-10-27T22:10:43.176211] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:43.176280] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-27T22:10:43.178606] [INFO ] [MAIN ] INFY: Generated 138 derivative records from 53595 primary records. [2025-10-27T22:10:43.179283] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-27T22:10:43.203532] [DEBUG] [LOCAL ] INFY: Derivative data saved (138 records). [2025-10-27T22:10:43.203086] [DEBUG] [LOCAL ] INFA: Derivative data saved (138 records). [2025-10-27T22:10:43.203666] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-27T22:10:43.206407] [INFO ] [MAIN ] Derivative Progress: 896/1881 symbols completed. INFY took 1.2s. Estimated remaining: 6m 41s. Rate: 147.3 symbols/min [2025-10-27T22:10:43.206714] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-27T22:10:43.209445] [INFO ] [MAIN ] Derivative Progress: 897/1881 symbols completed. INFA took 1.2s. Estimated remaining: 6m 40s. Rate: 147.5 symbols/min [2025-10-27T22:10:43.209687] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:43.206555] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:43.257188] [DEBUG] [LOCAL ] INGM: Loaded 27728 existing records from primary storage. [2025-10-27T22:10:43.257419] [INFO ] [MAIN ] INGM: Loaded 27728 primary data records. [2025-10-27T22:10:43.382743] [DEBUG] [LOCAL ] ING: Loaded 50616 existing records from primary storage. [2025-10-27T22:10:43.383734] [INFO ] [MAIN ] ING: Loaded 50616 primary data records. [2025-10-27T22:10:43.383356] [DEBUG] [LOCAL ] INGR: Loaded 33584 existing records from primary storage. [2025-10-27T22:10:43.416707] [INFO ] [MAIN ] INGR: Loaded 33584 primary data records. [2025-10-27T22:10:44.269392] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:44.305859] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:44.350668] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:44.402792] [INFO ] [MAIN ] INGM: Generated 138 derivative records from 27728 primary records. [2025-10-27T22:10:44.404156] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-27T22:10:44.424460] [DEBUG] [LOCAL ] INGM: Derivative data saved (138 records). [2025-10-27T22:10:44.425214] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-27T22:10:44.424802] [INFO ] [MAIN ] ING: Generated 138 derivative records from 50616 primary records. [2025-10-27T22:10:44.425676] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-27T22:10:44.431379] [INFO ] [MAIN ] Derivative Progress: 898/1881 symbols completed. INGM took 1.2s. Estimated remaining: 6m 41s. Rate: 147.2 symbols/min [2025-10-27T22:10:44.445379] [INFO ] [MAIN ] INGR: Generated 138 derivative records from 33584 primary records. [2025-10-27T22:10:44.445481] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-27T22:10:44.460074] [DEBUG] [LOCAL ] ING: Derivative data saved (138 records). [2025-10-27T22:10:44.460180] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-27T22:10:44.463479] [INFO ] [MAIN ] Derivative Progress: 899/1881 symbols completed. ING took 1.3s. Estimated remaining: 6m 40s. Rate: 147.3 symbols/min [2025-10-27T22:10:44.465903] [DEBUG] [LOCAL ] INGR: Derivative data saved (138 records). [2025-10-27T22:10:44.465968] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-27T22:10:44.468537] [INFO ] [MAIN ] Derivative Progress: 900/1881 symbols completed. INGR took 1.3s. Estimated remaining: 6m 39s. Rate: 147.5 symbols/min [2025-10-27T22:10:44.468917] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:44.469137] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:44.469095] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:44.536729] [DEBUG] [LOCAL ] INN: Loaded 41159 existing records from primary storage. [2025-10-27T22:10:44.547401] [INFO ] [MAIN ] INN: Loaded 41159 primary data records. [2025-10-27T22:10:44.548137] [DEBUG] [LOCAL ] INSP: Loaded 38599 existing records from primary storage. [2025-10-27T22:10:44.567621] [INFO ] [MAIN ] INSP: Loaded 38599 primary data records. [2025-10-27T22:10:44.562222] [DEBUG] [LOCAL ] INSW: Loaded 38828 existing records from primary storage. [2025-10-27T22:10:44.620515] [INFO ] [MAIN ] INSW: Loaded 38828 primary data records. [2025-10-27T22:10:45.560975] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:45.548078] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:45.613153] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:45.676413] [INFO ] [MAIN ] INSP: Generated 138 derivative records from 38599 primary records. [2025-10-27T22:10:45.679928] [INFO ] [MAIN ] INN: Generated 138 derivative records from 41159 primary records. [2025-10-27T22:10:45.680069] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-27T22:10:45.680348] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-27T22:10:45.703943] [DEBUG] [LOCAL ] INSP: Derivative data saved (138 records). [2025-10-27T22:10:45.709140] [DEBUG] [LOCAL ] INN: Derivative data saved (138 records). [2025-10-27T22:10:45.706097] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-27T22:10:45.712326] [INFO ] [MAIN ] Derivative Progress: 901/1881 symbols completed. INSP took 1.2s. Estimated remaining: 6m 40s. Rate: 147.1 symbols/min [2025-10-27T22:10:45.712580] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:45.712477] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-27T22:10:45.717077] [INFO ] [MAIN ] INSW: Generated 138 derivative records from 38828 primary records. [2025-10-27T22:10:45.716443] [INFO ] [MAIN ] Derivative Progress: 902/1881 symbols completed. INN took 1.2s. Estimated remaining: 6m 39s. Rate: 147.3 symbols/min [2025-10-27T22:10:45.717277] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-27T22:10:45.717408] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:45.730939] [DEBUG] [LOCAL ] INSW: Derivative data saved (138 records). [2025-10-27T22:10:45.731202] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-27T22:10:45.733784] [INFO ] [MAIN ] Derivative Progress: 903/1881 symbols completed. INSW took 1.3s. Estimated remaining: 6m 38s. Rate: 147.5 symbols/min [2025-10-27T22:10:45.733999] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:45.776769] [DEBUG] [LOCAL ] INVX: Loaded 28642 existing records from primary storage. [2025-10-27T22:10:45.777085] [INFO ] [MAIN ] INVX: Loaded 28642 primary data records. [2025-10-27T22:10:45.935006] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-27T22:10:45.981026] [INFO ] [MAIN ] INVH: Loaded 53185 primary data records. [2025-10-27T22:10:45.977007] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-27T22:10:46.037216] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-27T22:10:46.743815] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:46.791900] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:46.807942] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:46.873254] [INFO ] [MAIN ] INVX: Generated 138 derivative records from 28642 primary records. [2025-10-27T22:10:46.877466] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-27T22:10:46.894553] [DEBUG] [LOCAL ] INVX: Derivative data saved (138 records). [2025-10-27T22:10:46.896992] [INFO ] [MAIN ] IONQ: Generated 138 derivative records from 53788 primary records. [2025-10-27T22:10:46.897139] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-27T22:10:46.899204] [INFO ] [MAIN ] Derivative Progress: 904/1881 symbols completed. INVX took 1.2s. Estimated remaining: 6m 38s. Rate: 147.2 symbols/min [2025-10-27T22:10:46.899351] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-27T22:10:46.899566] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:46.903815] [INFO ] [MAIN ] INVH: Generated 138 derivative records from 53185 primary records. [2025-10-27T22:10:46.913124] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-27T22:10:46.916064] [DEBUG] [LOCAL ] IONQ: Derivative data saved (138 records). [2025-10-27T22:10:46.916637] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-27T22:10:46.919844] [INFO ] [MAIN ] Derivative Progress: 905/1881 symbols completed. IONQ took 1.2s. Estimated remaining: 6m 38s. Rate: 147.3 symbols/min [2025-10-27T22:10:46.927045] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:46.932474] [DEBUG] [LOCAL ] INVH: Derivative data saved (138 records). [2025-10-27T22:10:46.932549] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-27T22:10:46.934793] [INFO ] [MAIN ] Derivative Progress: 906/1881 symbols completed. INVH took 1.2s. Estimated remaining: 6m 37s. Rate: 147.5 symbols/min [2025-10-27T22:10:46.935004] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:46.990791] [DEBUG] [LOCAL ] IOT: Loaded 53443 existing records from primary storage. [2025-10-27T22:10:47.005177] [INFO ] [MAIN ] IOT: Loaded 53443 primary data records. [2025-10-27T22:10:47.130341] [DEBUG] [LOCAL ] IP: Loaded 53297 existing records from primary storage. [2025-10-27T22:10:47.155065] [INFO ] [MAIN ] IP: Loaded 53297 primary data records. [2025-10-27T22:10:47.171855] [DEBUG] [LOCAL ] IPG: Loaded 53328 existing records from primary storage. [2025-10-27T22:10:47.195736] [INFO ] [MAIN ] IPG: Loaded 53328 primary data records. [2025-10-27T22:10:48.042271] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:48.083972] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:48.109175] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:48.146287] [INFO ] [MAIN ] IOT: Generated 138 derivative records from 53443 primary records. [2025-10-27T22:10:48.148375] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-27T22:10:48.168581] [DEBUG] [LOCAL ] IOT: Derivative data saved (138 records). [2025-10-27T22:10:48.168838] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-27T22:10:48.175844] [INFO ] [MAIN ] Derivative Progress: 907/1881 symbols completed. IOT took 1.3s. Estimated remaining: 6m 37s. Rate: 147.1 symbols/min [2025-10-27T22:10:48.176457] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:48.182280] [INFO ] [MAIN ] IPG: Generated 138 derivative records from 53328 primary records. [2025-10-27T22:10:48.185517] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-27T22:10:48.200667] [DEBUG] [LOCAL ] IPG: Derivative data saved (138 records). [2025-10-27T22:10:48.200901] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-27T22:10:48.204135] [INFO ] [MAIN ] Derivative Progress: 908/1881 symbols completed. IPG took 1.3s. Estimated remaining: 6m 36s. Rate: 147.3 symbols/min [2025-10-27T22:10:48.211443] [INFO ] [MAIN ] IP: Generated 138 derivative records from 53297 primary records. [2025-10-27T22:10:48.211569] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:48.211782] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-27T22:10:48.232380] [DEBUG] [LOCAL ] IPI: Loaded 21303 existing records from primary storage. [2025-10-27T22:10:48.232532] [INFO ] [MAIN ] IPI: Loaded 21303 primary data records. [2025-10-27T22:10:48.232680] [DEBUG] [LOCAL ] IP: Derivative data saved (138 records). [2025-10-27T22:10:48.232853] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-27T22:10:48.244942] [INFO ] [MAIN ] Derivative Progress: 909/1881 symbols completed. IP took 1.3s. Estimated remaining: 6m 36s. Rate: 147.4 symbols/min [2025-10-27T22:10:48.251625] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:48.340717] [DEBUG] [LOCAL ] IQI: Loaded 17496 existing records from primary storage. [2025-10-27T22:10:48.359840] [INFO ] [MAIN ] IQI: Loaded 17496 primary data records. [2025-10-27T22:10:48.905688] [DEBUG] [LOCAL ] IQV: Loaded 49937 existing records from primary storage. [2025-10-27T22:10:48.906701] [INFO ] [MAIN ] IQV: Loaded 49937 primary data records. [2025-10-27T22:10:49.226707] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:49.260864] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:49.317438] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:10:49.344304] [INFO ] [MAIN ] IPI: Generated 138 derivative records from 21303 primary records. [2025-10-27T22:10:49.347539] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-27T22:10:49.361100] [DEBUG] [LOCAL ] IPI: Derivative data saved (138 records). [2025-10-27T22:10:49.362526] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-27T22:10:49.364366] [INFO ] [MAIN ] Derivative Progress: 910/1881 symbols completed. IPI took 1.2s. Estimated remaining: 6m 36s. Rate: 147.1 symbols/min [2025-10-27T22:10:49.367167] [INFO ] [MAIN ] IQI: Generated 138 derivative records from 17496 primary records. [2025-10-27T22:10:49.367311] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:49.367830] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-27T22:10:49.384075] [DEBUG] [LOCAL ] IQI: Derivative data saved (138 records). [2025-10-27T22:10:49.384509] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-27T22:10:49.387371] [INFO ] [MAIN ] Derivative Progress: 911/1881 symbols completed. IQI took 1.2s. Estimated remaining: 6m 35s. Rate: 147.3 symbols/min [2025-10-27T22:10:49.389967] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:49.397082] [INFO ] [MAIN ] IQV: Generated 138 derivative records from 49937 primary records. [2025-10-27T22:10:49.397294] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-27T22:10:49.409728] [DEBUG] [LOCAL ] IQV: Derivative data saved (138 records). [2025-10-27T22:10:49.409848] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-27T22:10:49.414219] [INFO ] [MAIN ] Derivative Progress: 912/1881 symbols completed. IQV took 1.2s. Estimated remaining: 6m 34s. Rate: 147.5 symbols/min [2025-10-27T22:10:49.414432] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:49.461563] [DEBUG] [LOCAL ] IR: Loaded 52720 existing records from primary storage. [2025-10-27T22:10:49.462109] [INFO ] [MAIN ] IR: Loaded 52720 primary data records. [2025-10-27T22:10:49.490066] [DEBUG] [LOCAL ] IRS: Loaded 23461 existing records from primary storage. [2025-10-27T22:10:49.505699] [INFO ] [MAIN ] IRS: Loaded 23461 primary data records. [2025-10-27T22:10:49.669905] [DEBUG] [LOCAL ] IRM: Loaded 48673 existing records from primary storage. [2025-10-27T22:10:49.680336] [INFO ] [MAIN ] IRM: Loaded 48673 primary data records. [2025-10-27T22:10:50.444267] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:50.497540] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:50.510746] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:50.571666] [INFO ] [MAIN ] IR: Generated 138 derivative records from 52720 primary records. [2025-10-27T22:10:50.573546] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-27T22:10:50.591804] [DEBUG] [LOCAL ] IR: Derivative data saved (138 records). [2025-10-27T22:10:50.592049] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-27T22:10:50.593916] [INFO ] [MAIN ] Derivative Progress: 913/1881 symbols completed. IR took 1.2s. Estimated remaining: 6m 35s. Rate: 147.1 symbols/min [2025-10-27T22:10:50.597890] [INFO ] [MAIN ] IRS: Generated 138 derivative records from 23461 primary records. [2025-10-27T22:10:50.599373] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-27T22:10:50.602053] [INFO ] [MAIN ] IRM: Generated 138 derivative records from 48673 primary records. [2025-10-27T22:10:50.611012] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-27T22:10:50.614275] [DEBUG] [LOCAL ] IRS: Derivative data saved (138 records). [2025-10-27T22:10:50.614370] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-27T22:10:50.617070] [INFO ] [MAIN ] Derivative Progress: 914/1881 symbols completed. IRS took 1.2s. Estimated remaining: 6m 34s. Rate: 147.3 symbols/min [2025-10-27T22:10:50.628393] [DEBUG] [LOCAL ] IRM: Derivative data saved (138 records). [2025-10-27T22:10:50.628461] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-27T22:10:50.631560] [INFO ] [MAIN ] Derivative Progress: 915/1881 symbols completed. IRM took 1.2s. Estimated remaining: 6m 33s. Rate: 147.5 symbols/min [2025-10-27T22:10:50.631931] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:50.632028] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:50.632091] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:50.651162] [DEBUG] [LOCAL ] ISD: Loaded 15420 existing records from primary storage. [2025-10-27T22:10:50.651420] [INFO ] [MAIN ] ISD: Loaded 15420 primary data records. [2025-10-27T22:10:50.847923] [DEBUG] [LOCAL ] IT: Loaded 42087 existing records from primary storage. [2025-10-27T22:10:50.838575] [DEBUG] [LOCAL ] IRT: Loaded 50309 existing records from primary storage. [2025-10-27T22:10:50.981887] [INFO ] [MAIN ] IRT: Loaded 50309 primary data records. [2025-10-27T22:10:50.981770] [INFO ] [MAIN ] IT: Loaded 42087 primary data records. [2025-10-27T22:10:51.615156] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:51.675142] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:51.677945] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:51.780556] [INFO ] [MAIN ] ISD: Generated 138 derivative records from 15420 primary records. [2025-10-27T22:10:51.785165] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-27T22:10:51.807077] [DEBUG] [LOCAL ] ISD: Derivative data saved (138 records). [2025-10-27T22:10:51.808191] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-27T22:10:51.811575] [INFO ] [MAIN ] Derivative Progress: 916/1881 symbols completed. ISD took 1.2s. Estimated remaining: 6m 33s. Rate: 147.1 symbols/min [2025-10-27T22:10:51.811807] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:51.847808] [INFO ] [MAIN ] IRT: Generated 138 derivative records from 50309 primary records. [2025-10-27T22:10:51.849920] [INFO ] [MAIN ] IT: Generated 138 derivative records from 42087 primary records. [2025-10-27T22:10:51.850019] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-27T22:10:51.850104] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-27T22:10:51.880145] [DEBUG] [LOCAL ] IT: Derivative data saved (138 records). [2025-10-27T22:10:51.884181] [DEBUG] [LOCAL ] IRT: Derivative data saved (138 records). [2025-10-27T22:10:51.884306] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-27T22:10:51.885093] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-27T22:10:51.884914] [DEBUG] [LOCAL ] ITGR: Loaded 31163 existing records from primary storage. [2025-10-27T22:10:51.885281] [INFO ] [MAIN ] ITGR: Loaded 31163 primary data records. [2025-10-27T22:10:51.888367] [INFO ] [MAIN ] Derivative Progress: 917/1881 symbols completed. IRT took 1.3s. Estimated remaining: 6m 33s. Rate: 147.3 symbols/min [2025-10-27T22:10:51.891263] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:51.896478] [INFO ] [MAIN ] Derivative Progress: 918/1881 symbols completed. IT took 1.3s. Estimated remaining: 6m 32s. Rate: 147.4 symbols/min [2025-10-27T22:10:51.922142] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:52.231471] [DEBUG] [LOCAL ] ITT: Loaded 31974 existing records from primary storage. [2025-10-27T22:10:52.232183] [INFO ] [MAIN ] ITT: Loaded 31974 primary data records. [2025-10-27T22:10:52.348303] [DEBUG] [LOCAL ] ITUB: Loaded 53305 existing records from primary storage. [2025-10-27T22:10:52.387143] [INFO ] [MAIN ] ITUB: Loaded 53305 primary data records. [2025-10-27T22:10:52.677436] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:52.900532] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:52.923605] [INFO ] [MAIN ] ITGR: Generated 138 derivative records from 31163 primary records. [2025-10-27T22:10:52.932740] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-27T22:10:52.940616] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:52.966580] [DEBUG] [LOCAL ] ITGR: Derivative data saved (138 records). [2025-10-27T22:10:52.969385] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-27T22:10:52.971572] [INFO ] [MAIN ] Derivative Progress: 919/1881 symbols completed. ITGR took 1.2s. Estimated remaining: 6m 32s. Rate: 147.2 symbols/min [2025-10-27T22:10:52.971989] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:52.992522] [INFO ] [MAIN ] ITT: Generated 138 derivative records from 31974 primary records. [2025-10-27T22:10:52.995611] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-27T22:10:53.011609] [DEBUG] [LOCAL ] ITT: Derivative data saved (138 records). [2025-10-27T22:10:53.012012] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-27T22:10:53.014220] [INFO ] [MAIN ] Derivative Progress: 920/1881 symbols completed. ITT took 1.1s. Estimated remaining: 6m 31s. Rate: 147.3 symbols/min [2025-10-27T22:10:53.025227] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:53.028007] [INFO ] [MAIN ] ITUB: Generated 138 derivative records from 53305 primary records. [2025-10-27T22:10:53.028125] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-27T22:10:53.041007] [DEBUG] [LOCAL ] ITUB: Derivative data saved (138 records). [2025-10-27T22:10:53.052494] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-27T22:10:53.056066] [INFO ] [MAIN ] Derivative Progress: 921/1881 symbols completed. ITUB took 1.1s. Estimated remaining: 6m 31s. Rate: 147.5 symbols/min [2025-10-27T22:10:53.056383] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:53.057706] [DEBUG] [LOCAL ] ITW: Loaded 45560 existing records from primary storage. [2025-10-27T22:10:53.057866] [INFO ] [MAIN ] ITW: Loaded 45560 primary data records. [2025-10-27T22:10:53.387418] [DEBUG] [LOCAL ] IVT: Loaded 31135 existing records from primary storage. [2025-10-27T22:10:53.386921] [DEBUG] [LOCAL ] IVR: Loaded 47696 existing records from primary storage. [2025-10-27T22:10:53.387561] [INFO ] [MAIN ] IVR: Loaded 47696 primary data records. [2025-10-27T22:10:53.387622] [INFO ] [MAIN ] IVT: Loaded 31135 primary data records. [2025-10-27T22:10:54.035457] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:54.074780] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:54.107562] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:54.141021] [INFO ] [MAIN ] ITW: Generated 138 derivative records from 45560 primary records. [2025-10-27T22:10:54.144201] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-27T22:10:54.161179] [DEBUG] [LOCAL ] ITW: Derivative data saved (138 records). [2025-10-27T22:10:54.163673] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-27T22:10:54.168390] [INFO ] [MAIN ] Derivative Progress: 922/1881 symbols completed. ITW took 1.2s. Estimated remaining: 6m 31s. Rate: 147.2 symbols/min [2025-10-27T22:10:54.169796] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:54.174079] [INFO ] [MAIN ] IVR: Generated 138 derivative records from 47696 primary records. [2025-10-27T22:10:54.176826] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-27T22:10:54.189762] [DEBUG] [LOCAL ] IVR: Derivative data saved (138 records). [2025-10-27T22:10:54.189911] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-27T22:10:54.193466] [INFO ] [MAIN ] Derivative Progress: 923/1881 symbols completed. IVR took 1.2s. Estimated remaining: 6m 30s. Rate: 147.3 symbols/min [2025-10-27T22:10:54.193713] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:54.194434] [INFO ] [MAIN ] IVT: Generated 138 derivative records from 31135 primary records. [2025-10-27T22:10:54.194588] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-27T22:10:54.207468] [DEBUG] [LOCAL ] IVT: Derivative data saved (138 records). [2025-10-27T22:10:54.207733] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-27T22:10:54.210322] [INFO ] [MAIN ] Derivative Progress: 924/1881 symbols completed. IVT took 1.2s. Estimated remaining: 6m 29s. Rate: 147.5 symbols/min [2025-10-27T22:10:54.210591] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:54.237992] [DEBUG] [LOCAL ] IX: Loaded 21695 existing records from primary storage. [2025-10-27T22:10:54.238220] [INFO ] [MAIN ] IX: Loaded 21695 primary data records. [2025-10-27T22:10:54.364591] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-27T22:10:54.380969] [INFO ] [MAIN ] IVZ: Loaded 53128 primary data records. [2025-10-27T22:10:54.654122] [DEBUG] [LOCAL ] J: Loaded 40512 existing records from primary storage. [2025-10-27T22:10:54.665299] [INFO ] [MAIN ] J: Loaded 40512 primary data records. [2025-10-27T22:10:55.178316] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:55.214185] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:55.253416] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:55.308106] [INFO ] [MAIN ] IX: Generated 138 derivative records from 21695 primary records. [2025-10-27T22:10:55.311541] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-27T22:10:55.334978] [DEBUG] [LOCAL ] IX: Derivative data saved (138 records). [2025-10-27T22:10:55.335130] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-27T22:10:55.337837] [INFO ] [MAIN ] Derivative Progress: 925/1881 symbols completed. IX took 1.1s. Estimated remaining: 6m 30s. Rate: 147.2 symbols/min [2025-10-27T22:10:55.341371] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:55.350462] [INFO ] [MAIN ] J: Generated 138 derivative records from 40512 primary records. [2025-10-27T22:10:55.350827] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-27T22:10:55.353509] [INFO ] [MAIN ] IVZ: Generated 138 derivative records from 53128 primary records. [2025-10-27T22:10:55.363040] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-27T22:10:55.366001] [DEBUG] [LOCAL ] J: Derivative data saved (138 records). [2025-10-27T22:10:55.367035] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-27T22:10:55.369893] [INFO ] [MAIN ] Derivative Progress: 926/1881 symbols completed. J took 1.2s. Estimated remaining: 6m 29s. Rate: 147.3 symbols/min [2025-10-27T22:10:55.377101] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:55.382611] [DEBUG] [LOCAL ] IVZ: Derivative data saved (138 records). [2025-10-27T22:10:55.382865] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-27T22:10:55.385125] [INFO ] [MAIN ] Derivative Progress: 927/1881 symbols completed. IVZ took 1.2s. Estimated remaining: 6m 28s. Rate: 147.5 symbols/min [2025-10-27T22:10:55.385467] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:55.414631] [DEBUG] [LOCAL ] JBGS: Loaded 41297 existing records from primary storage. [2025-10-27T22:10:55.414874] [INFO ] [MAIN ] JBGS: Loaded 41297 primary data records. [2025-10-27T22:10:55.561845] [DEBUG] [LOCAL ] JBI: Loaded 42114 existing records from primary storage. [2025-10-27T22:10:55.572279] [INFO ] [MAIN ] JBI: Loaded 42114 primary data records. [2025-10-27T22:10:55.718571] [DEBUG] [LOCAL ] JBL: Loaded 48193 existing records from primary storage. [2025-10-27T22:10:55.855496] [INFO ] [MAIN ] JBL: Loaded 48193 primary data records. [2025-10-27T22:10:56.435960] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:56.473419] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:56.519686] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:56.554493] [INFO ] [MAIN ] JBGS: Generated 138 derivative records from 41297 primary records. [2025-10-27T22:10:56.557864] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-27T22:10:56.574004] [DEBUG] [LOCAL ] JBGS: Derivative data saved (138 records). [2025-10-27T22:10:56.583041] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-27T22:10:56.585710] [INFO ] [MAIN ] Derivative Progress: 928/1881 symbols completed. JBGS took 1.2s. Estimated remaining: 6m 28s. Rate: 147.2 symbols/min [2025-10-27T22:10:56.589999] [INFO ] [MAIN ] JBI: Generated 138 derivative records from 42114 primary records. [2025-10-27T22:10:56.593283] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-27T22:10:56.611443] [DEBUG] [LOCAL ] JBI: Derivative data saved (138 records). [2025-10-27T22:10:56.611791] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-27T22:10:56.615242] [INFO ] [MAIN ] Derivative Progress: 929/1881 symbols completed. JBI took 1.2s. Estimated remaining: 6m 28s. Rate: 147.3 symbols/min [2025-10-27T22:10:56.617178] [INFO ] [MAIN ] JBL: Generated 138 derivative records from 48193 primary records. [2025-10-27T22:10:56.617335] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-27T22:10:56.629470] [DEBUG] [LOCAL ] JBL: Derivative data saved (138 records). [2025-10-27T22:10:56.629597] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-27T22:10:56.632578] [INFO ] [MAIN ] Derivative Progress: 930/1881 symbols completed. JBL took 1.2s. Estimated remaining: 6m 27s. Rate: 147.5 symbols/min [2025-10-27T22:10:56.633078] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:56.633161] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:56.633345] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:56.643623] [DEBUG] [LOCAL ] JCE: Loaded 7116 existing records from primary storage. [2025-10-27T22:10:56.643847] [INFO ] [MAIN ] JCE: Loaded 7116 primary data records. [2025-10-27T22:10:56.775216] [DEBUG] [LOCAL ] JBND: Loaded 27459 existing records from primary storage. [2025-10-27T22:10:56.781032] [INFO ] [MAIN ] JBND: Loaded 27459 primary data records. [2025-10-27T22:10:56.897979] [DEBUG] [LOCAL ] JBTM: Loaded 33232 existing records from primary storage. [2025-10-27T22:10:56.935630] [INFO ] [MAIN ] JBTM: Loaded 33232 primary data records. [2025-10-27T22:10:57.648071] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:57.690743] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:57.710469] [DEBUG] [MAIN ] JBTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:57.773452] [INFO ] [MAIN ] JCE: Generated 138 derivative records from 7116 primary records. [2025-10-27T22:10:57.774022] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-27T22:10:57.788480] [DEBUG] [LOCAL ] JCE: Derivative data saved (138 records). [2025-10-27T22:10:57.791346] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-27T22:10:57.794215] [INFO ] [MAIN ] JBND: Generated 138 derivative records from 27459 primary records. [2025-10-27T22:10:57.796965] [INFO ] [MAIN ] Derivative Progress: 931/1881 symbols completed. JCE took 1.2s. Estimated remaining: 6m 27s. Rate: 147.2 symbols/min [2025-10-27T22:10:57.797137] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-27T22:10:57.797234] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:57.810893] [DEBUG] [LOCAL ] JBND: Derivative data saved (138 records). [2025-10-27T22:10:57.812830] [INFO ] [MAIN ] JBTM: Generated 138 derivative records from 33232 primary records. [2025-10-27T22:10:57.813108] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-27T22:10:57.813031] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-27T22:10:57.815458] [INFO ] [MAIN ] Derivative Progress: 932/1881 symbols completed. JBND took 1.2s. Estimated remaining: 6m 26s. Rate: 147.3 symbols/min [2025-10-27T22:10:57.816237] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:57.828335] [DEBUG] [LOCAL ] JBTM: Derivative data saved (138 records). [2025-10-27T22:10:57.828535] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-10-27T22:10:57.831174] [INFO ] [MAIN ] Derivative Progress: 933/1881 symbols completed. JBTM took 1.2s. Estimated remaining: 6m 26s. Rate: 147.5 symbols/min [2025-10-27T22:10:57.831392] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:57.905331] [DEBUG] [LOCAL ] JCI: Loaded 53513 existing records from primary storage. [2025-10-27T22:10:57.905667] [INFO ] [MAIN ] JCI: Loaded 53513 primary data records. [2025-10-27T22:10:57.929781] [DEBUG] [LOCAL ] JELD: Loaded 45579 existing records from primary storage. [2025-10-27T22:10:57.955633] [INFO ] [MAIN ] JELD: Loaded 45579 primary data records. [2025-10-27T22:10:58.032769] [DEBUG] [LOCAL ] JEF: Loaded 50159 existing records from primary storage. [2025-10-27T22:10:58.101072] [INFO ] [MAIN ] JEF: Loaded 50159 primary data records. [2025-10-27T22:10:58.900177] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:58.900509] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:58.950166] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:10:59.007363] [INFO ] [MAIN ] JELD: Generated 138 derivative records from 45579 primary records. [2025-10-27T22:10:59.010906] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-27T22:10:59.011116] [INFO ] [MAIN ] JCI: Generated 138 derivative records from 53513 primary records. [2025-10-27T22:10:59.012217] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-27T22:10:59.034496] [DEBUG] [LOCAL ] JELD: Derivative data saved (138 records). [2025-10-27T22:10:59.037558] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-27T22:10:59.040590] [DEBUG] [LOCAL ] JCI: Derivative data saved (138 records). [2025-10-27T22:10:59.046090] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-27T22:10:59.043199] [INFO ] [MAIN ] Derivative Progress: 934/1881 symbols completed. JELD took 1.2s. Estimated remaining: 6m 26s. Rate: 147.2 symbols/min [2025-10-27T22:10:59.046293] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:59.048551] [INFO ] [MAIN ] Derivative Progress: 935/1881 symbols completed. JCI took 1.3s. Estimated remaining: 6m 25s. Rate: 147.3 symbols/min [2025-10-27T22:10:59.049129] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:59.053442] [INFO ] [MAIN ] JEF: Generated 138 derivative records from 50159 primary records. [2025-10-27T22:10:59.053675] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-27T22:10:59.068999] [DEBUG] [LOCAL ] JEF: Derivative data saved (138 records). [2025-10-27T22:10:59.069294] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-27T22:10:59.073269] [INFO ] [MAIN ] Derivative Progress: 936/1881 symbols completed. JEF took 1.3s. Estimated remaining: 6m 24s. Rate: 147.5 symbols/min [2025-10-27T22:10:59.073639] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:10:59.087183] [DEBUG] [LOCAL ] JGH: Loaded 12378 existing records from primary storage. [2025-10-27T22:10:59.087313] [INFO ] [MAIN ] JGH: Loaded 12378 primary data records. [2025-10-27T22:10:59.216737] [DEBUG] [LOCAL ] JFR: Loaded 30827 existing records from primary storage. [2025-10-27T22:10:59.227970] [INFO ] [MAIN ] JFR: Loaded 30827 primary data records. [2025-10-27T22:10:59.559015] [DEBUG] [LOCAL ] JHG: Loaded 47426 existing records from primary storage. [2025-10-27T22:10:59.565692] [INFO ] [MAIN ] JHG: Loaded 47426 primary data records. [2025-10-27T22:11:00.117007] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:00.167255] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:00.210899] [INFO ] [MAIN ] JGH: Generated 138 derivative records from 12378 primary records. [2025-10-27T22:11:00.211385] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-27T22:11:00.208197] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:00.248871] [DEBUG] [LOCAL ] JGH: Derivative data saved (138 records). [2025-10-27T22:11:00.249192] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-27T22:11:00.251063] [INFO ] [MAIN ] Derivative Progress: 937/1881 symbols completed. JGH took 1.2s. Estimated remaining: 6m 25s. Rate: 147.2 symbols/min [2025-10-27T22:11:00.251615] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:00.269395] [DEBUG] [LOCAL ] JHI: Loaded 4048 existing records from primary storage. [2025-10-27T22:11:00.272243] [INFO ] [MAIN ] JHI: Loaded 4048 primary data records. [2025-10-27T22:11:00.379812] [INFO ] [MAIN ] JFR: Generated 138 derivative records from 30827 primary records. [2025-10-27T22:11:00.400997] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-27T22:11:00.437263] [DEBUG] [LOCAL ] JFR: Derivative data saved (138 records). [2025-10-27T22:11:00.447786] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-27T22:11:00.464997] [INFO ] [MAIN ] Derivative Progress: 938/1881 symbols completed. JFR took 1.4s. Estimated remaining: 6m 24s. Rate: 147.3 symbols/min [2025-10-27T22:11:00.479707] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:00.623412] [INFO ] [MAIN ] JHG: Generated 138 derivative records from 47426 primary records. [2025-10-27T22:11:00.623781] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-27T22:11:00.627274] [DEBUG] [LOCAL ] JHS: Loaded 2985 existing records from primary storage. [2025-10-27T22:11:00.634628] [INFO ] [MAIN ] JHS: Loaded 2985 primary data records. [2025-10-27T22:11:00.639141] [DEBUG] [LOCAL ] JHG: Derivative data saved (138 records). [2025-10-27T22:11:00.660958] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-27T22:11:00.673812] [INFO ] [MAIN ] Derivative Progress: 939/1881 symbols completed. JHG took 1.6s. Estimated remaining: 6m 24s. Rate: 147.3 symbols/min [2025-10-27T22:11:00.698481] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:00.976688] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:01.020683] [DEBUG] [LOCAL ] JHX: Loaded 53186 existing records from primary storage. [2025-10-27T22:11:01.029630] [INFO ] [MAIN ] JHX: Loaded 53186 primary data records. [2025-10-27T22:11:01.045866] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:01.345578] [INFO ] [MAIN ] JHI: Generated 138 derivative records from 4048 primary records. [2025-10-27T22:11:01.356708] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-27T22:11:01.374585] [DEBUG] [LOCAL ] JHI: Derivative data saved (138 records). [2025-10-27T22:11:01.379016] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-27T22:11:01.381088] [INFO ] [MAIN ] Derivative Progress: 940/1881 symbols completed. JHI took 1.1s. Estimated remaining: 6m 23s. Rate: 147.2 symbols/min [2025-10-27T22:11:01.381887] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:01.386888] [INFO ] [MAIN ] JHS: Generated 138 derivative records from 2985 primary records. [2025-10-27T22:11:01.387177] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-27T22:11:01.401819] [DEBUG] [LOCAL ] JHS: Derivative data saved (138 records). [2025-10-27T22:11:01.402008] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-27T22:11:01.404089] [INFO ] [MAIN ] Derivative Progress: 941/1881 symbols completed. JHS took 0.9s. Estimated remaining: 6m 23s. Rate: 147.4 symbols/min [2025-10-27T22:11:01.404392] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:01.414359] [DEBUG] [LOCAL ] JILL: Loaded 15011 existing records from primary storage. [2025-10-27T22:11:01.414779] [INFO ] [MAIN ] JILL: Loaded 15011 primary data records. [2025-10-27T22:11:01.492169] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:01.608127] [DEBUG] [LOCAL ] JKS: Loaded 38863 existing records from primary storage. [2025-10-27T22:11:01.610856] [INFO ] [MAIN ] JKS: Loaded 38863 primary data records. [2025-10-27T22:11:02.195179] [INFO ] [MAIN ] JHX: Generated 138 derivative records from 53186 primary records. [2025-10-27T22:11:02.195510] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-27T22:11:02.211163] [DEBUG] [LOCAL ] JHX: Derivative data saved (138 records). [2025-10-27T22:11:02.212077] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-27T22:11:02.214901] [INFO ] [MAIN ] Derivative Progress: 942/1881 symbols completed. JHX took 1.5s. Estimated remaining: 6m 23s. Rate: 147.2 symbols/min [2025-10-27T22:11:02.215427] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:02.235379] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:02.290128] [DEBUG] [LOCAL ] JLL: Loaded 31094 existing records from primary storage. [2025-10-27T22:11:02.290799] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:02.290877] [INFO ] [MAIN ] JLL: Loaded 31094 primary data records. [2025-10-27T22:11:02.630705] [INFO ] [MAIN ] JILL: Generated 138 derivative records from 15011 primary records. [2025-10-27T22:11:02.631113] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-27T22:11:02.645729] [DEBUG] [LOCAL ] JILL: Derivative data saved (138 records). [2025-10-27T22:11:02.646147] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-27T22:11:02.649266] [INFO ] [MAIN ] Derivative Progress: 943/1881 symbols completed. JILL took 1.3s. Estimated remaining: 6m 22s. Rate: 147.2 symbols/min [2025-10-27T22:11:02.656555] [INFO ] [MAIN ] JKS: Generated 138 derivative records from 38863 primary records. [2025-10-27T22:11:02.656632] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-27T22:11:02.675687] [DEBUG] [LOCAL ] JKS: Derivative data saved (138 records). [2025-10-27T22:11:02.675938] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-27T22:11:02.678767] [INFO ] [MAIN ] Derivative Progress: 944/1881 symbols completed. JKS took 1.3s. Estimated remaining: 6m 22s. Rate: 147.4 symbols/min [2025-10-27T22:11:02.694350] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:02.724165] [INFO ] [MAIN ] JLL: Generated 138 derivative records from 31094 primary records. [2025-10-27T22:11:02.724280] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-27T22:11:02.736745] [DEBUG] [LOCAL ] JLL: Derivative data saved (138 records). [2025-10-27T22:11:02.736810] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-27T22:11:02.739521] [INFO ] [MAIN ] Derivative Progress: 945/1881 symbols completed. JLL took 0.5s. Estimated remaining: 6m 21s. Rate: 147.5 symbols/min [2025-10-27T22:11:02.740133] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:02.740064] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:02.739991] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:02.747476] [DEBUG] [LOCAL ] JLS: Loaded 3941 existing records from primary storage. [2025-10-27T22:11:02.747705] [INFO ] [MAIN ] JLS: Loaded 3941 primary data records. [2025-10-27T22:11:03.085257] [DEBUG] [LOCAL ] JMIA: Loaded 51192 existing records from primary storage. [2025-10-27T22:11:03.085455] [INFO ] [MAIN ] JMIA: Loaded 51192 primary data records. [2025-10-27T22:11:03.209696] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-27T22:11:03.225581] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-27T22:11:03.718607] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:03.768434] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:03.801381] [INFO ] [MAIN ] JLS: Generated 138 derivative records from 3941 primary records. [2025-10-27T22:11:03.814093] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-27T22:11:03.816017] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:03.845442] [DEBUG] [LOCAL ] JLS: Derivative data saved (138 records). [2025-10-27T22:11:03.845638] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-27T22:11:03.849278] [INFO ] [MAIN ] Derivative Progress: 946/1881 symbols completed. JLS took 1.1s. Estimated remaining: 6m 21s. Rate: 147.2 symbols/min [2025-10-27T22:11:03.850286] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:03.869120] [INFO ] [MAIN ] JMIA: Generated 138 derivative records from 51192 primary records. [2025-10-27T22:11:03.869474] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-27T22:11:03.886248] [DEBUG] [LOCAL ] JMIA: Derivative data saved (138 records). [2025-10-27T22:11:03.886696] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-27T22:11:03.889454] [INFO ] [MAIN ] Derivative Progress: 947/1881 symbols completed. JMIA took 1.1s. Estimated remaining: 6m 20s. Rate: 147.4 symbols/min [2025-10-27T22:11:03.889953] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:03.909846] [INFO ] [MAIN ] JNJ: Generated 138 derivative records from 53753 primary records. [2025-10-27T22:11:03.910045] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-27T22:11:03.926585] [DEBUG] [LOCAL ] JNJ: Derivative data saved (138 records). [2025-10-27T22:11:03.926821] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-27T22:11:03.929385] [INFO ] [MAIN ] Derivative Progress: 948/1881 symbols completed. JNJ took 1.2s. Estimated remaining: 6m 20s. Rate: 147.5 symbols/min [2025-10-27T22:11:03.929614] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:03.955611] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-27T22:11:03.956197] [DEBUG] [LOCAL ] JOE: Loaded 23241 existing records from primary storage. [2025-10-27T22:11:03.956330] [INFO ] [MAIN ] JOBY: Loaded 53809 primary data records. [2025-10-27T22:11:03.956690] [INFO ] [MAIN ] JOE: Loaded 23241 primary data records. [2025-10-27T22:11:04.059501] [DEBUG] [LOCAL ] JOF: Loaded 6868 existing records from primary storage. [2025-10-27T22:11:04.118551] [INFO ] [MAIN ] JOF: Loaded 6868 primary data records. [2025-10-27T22:11:04.925989] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:04.955090] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:04.981894] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:05.047136] [INFO ] [MAIN ] JOE: Generated 138 derivative records from 23241 primary records. [2025-10-27T22:11:05.052565] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-27T22:11:05.066868] [INFO ] [MAIN ] JOBY: Generated 138 derivative records from 53809 primary records. [2025-10-27T22:11:05.069796] [DEBUG] [LOCAL ] JOE: Derivative data saved (138 records). [2025-10-27T22:11:05.069943] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-27T22:11:05.069894] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-27T22:11:05.073460] [INFO ] [MAIN ] Derivative Progress: 949/1881 symbols completed. JOE took 1.2s. Estimated remaining: 6m 20s. Rate: 147.2 symbols/min [2025-10-27T22:11:05.074397] [INFO ] [MAIN ] JOF: Generated 138 derivative records from 6868 primary records. [2025-10-27T22:11:05.074507] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-27T22:11:05.074809] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:05.087078] [DEBUG] [LOCAL ] JOBY: Derivative data saved (138 records). [2025-10-27T22:11:05.087409] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-27T22:11:05.095963] [INFO ] [MAIN ] Derivative Progress: 950/1881 symbols completed. JOBY took 1.2s. Estimated remaining: 6m 19s. Rate: 147.4 symbols/min [2025-10-27T22:11:05.098763] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:05.100777] [DEBUG] [LOCAL ] JOF: Derivative data saved (138 records). [2025-10-27T22:11:05.101120] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-27T22:11:05.103846] [INFO ] [MAIN ] Derivative Progress: 951/1881 symbols completed. JOF took 1.2s. Estimated remaining: 6m 18s. Rate: 147.5 symbols/min [2025-10-27T22:11:05.104028] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:05.163550] [DEBUG] [LOCAL ] JPC: Loaded 36745 existing records from primary storage. [2025-10-27T22:11:05.164208] [DEBUG] [LOCAL ] JQC: Loaded 33597 existing records from primary storage. [2025-10-27T22:11:05.164552] [INFO ] [MAIN ] JQC: Loaded 33597 primary data records. [2025-10-27T22:11:05.164670] [INFO ] [MAIN ] JPC: Loaded 36745 primary data records. [2025-10-27T22:11:05.401531] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-27T22:11:05.435576] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-27T22:11:06.100849] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:06.129689] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:06.162022] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:06.216502] [INFO ] [MAIN ] JQC: Generated 138 derivative records from 33597 primary records. [2025-10-27T22:11:06.219605] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-27T22:11:06.235993] [DEBUG] [LOCAL ] JQC: Derivative data saved (138 records). [2025-10-27T22:11:06.237952] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-27T22:11:06.238189] [INFO ] [MAIN ] JPC: Generated 138 derivative records from 36745 primary records. [2025-10-27T22:11:06.240049] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-27T22:11:06.239990] [INFO ] [MAIN ] Derivative Progress: 952/1881 symbols completed. JQC took 1.1s. Estimated remaining: 6m 19s. Rate: 147.2 symbols/min [2025-10-27T22:11:06.249707] [INFO ] [MAIN ] JPM: Generated 138 derivative records from 53794 primary records. [2025-10-27T22:11:06.242536] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:06.251329] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-27T22:11:06.253945] [DEBUG] [LOCAL ] JPC: Derivative data saved (138 records). [2025-10-27T22:11:06.254788] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-27T22:11:06.257033] [INFO ] [MAIN ] Derivative Progress: 953/1881 symbols completed. JPC took 1.2s. Estimated remaining: 6m 18s. Rate: 147.4 symbols/min [2025-10-27T22:11:06.264289] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:06.269371] [DEBUG] [LOCAL ] JPM: Derivative data saved (138 records). [2025-10-27T22:11:06.269596] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-27T22:11:06.272863] [INFO ] [MAIN ] Derivative Progress: 954/1881 symbols completed. JPM took 1.2s. Estimated remaining: 6m 17s. Rate: 147.5 symbols/min [2025-10-27T22:11:06.273157] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:06.286315] [DEBUG] [LOCAL ] JRS: Loaded 11423 existing records from primary storage. [2025-10-27T22:11:06.286901] [INFO ] [MAIN ] JRS: Loaded 11423 primary data records. [2025-10-27T22:11:06.334892] [DEBUG] [LOCAL ] JRI: Loaded 15041 existing records from primary storage. [2025-10-27T22:11:06.360400] [INFO ] [MAIN ] JRI: Loaded 15041 primary data records. [2025-10-27T22:11:06.805245] [DEBUG] [LOCAL ] JXN: Loaded 43924 existing records from primary storage. [2025-10-27T22:11:06.925491] [INFO ] [MAIN ] JXN: Loaded 43924 primary data records. [2025-10-27T22:11:07.270417] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:07.270671] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:07.347597] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:07.371006] [INFO ] [MAIN ] JRI: Generated 138 derivative records from 15041 primary records. [2025-10-27T22:11:07.371272] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-27T22:11:07.393101] [DEBUG] [LOCAL ] JRI: Derivative data saved (138 records). [2025-10-27T22:11:07.394987] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-27T22:11:07.400115] [INFO ] [MAIN ] Derivative Progress: 955/1881 symbols completed. JRI took 1.2s. Estimated remaining: 6m 17s. Rate: 147.3 symbols/min [2025-10-27T22:11:07.402865] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:07.402749] [INFO ] [MAIN ] JRS: Generated 138 derivative records from 11423 primary records. [2025-10-27T22:11:07.405503] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-27T22:11:07.421665] [DEBUG] [LOCAL ] JRS: Derivative data saved (138 records). [2025-10-27T22:11:07.422143] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-27T22:11:07.423923] [INFO ] [MAIN ] Derivative Progress: 956/1881 symbols completed. JRS took 1.2s. Estimated remaining: 6m 16s. Rate: 147.4 symbols/min [2025-10-27T22:11:07.427337] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:07.432436] [INFO ] [MAIN ] JXN: Generated 138 derivative records from 43924 primary records. [2025-10-27T22:11:07.432704] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-27T22:11:07.445471] [DEBUG] [LOCAL ] JXN: Derivative data saved (138 records). [2025-10-27T22:11:07.445612] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-27T22:11:07.451833] [INFO ] [MAIN ] Derivative Progress: 957/1881 symbols completed. JXN took 1.2s. Estimated remaining: 6m 16s. Rate: 147.6 symbols/min [2025-10-27T22:11:07.452139] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:07.458774] [DEBUG] [LOCAL ] KAI: Loaded 13227 existing records from primary storage. [2025-10-27T22:11:07.458880] [INFO ] [MAIN ] KAI: Loaded 13227 primary data records. [2025-10-27T22:11:07.676163] [DEBUG] [LOCAL ] K: Loaded 50265 existing records from primary storage. [2025-10-27T22:11:07.676330] [INFO ] [MAIN ] K: Loaded 50265 primary data records. [2025-10-27T22:11:07.910254] [DEBUG] [LOCAL ] KAR: Loaded 39580 existing records from primary storage. [2025-10-27T22:11:07.910915] [INFO ] [MAIN ] KAR: Loaded 39580 primary data records. [2025-10-27T22:11:08.465057] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:08.510123] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:08.543748] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:08.547008] [INFO ] [MAIN ] KAI: Generated 138 derivative records from 13227 primary records. [2025-10-27T22:11:08.558112] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-27T22:11:08.587738] [DEBUG] [LOCAL ] KAI: Derivative data saved (138 records). [2025-10-27T22:11:08.591059] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-27T22:11:08.593494] [INFO ] [MAIN ] Derivative Progress: 958/1881 symbols completed. KAI took 1.2s. Estimated remaining: 6m 16s. Rate: 147.3 symbols/min [2025-10-27T22:11:08.610591] [INFO ] [MAIN ] K: Generated 138 derivative records from 50265 primary records. [2025-10-27T22:11:08.608878] [INFO ] [MAIN ] KAR: Generated 138 derivative records from 39580 primary records. [2025-10-27T22:11:08.610747] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-27T22:11:08.610814] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-27T22:11:08.633079] [DEBUG] [LOCAL ] KAR: Derivative data saved (138 records). [2025-10-27T22:11:08.633338] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-27T22:11:08.636156] [INFO ] [MAIN ] Derivative Progress: 959/1881 symbols completed. KAR took 1.2s. Estimated remaining: 6m 15s. Rate: 147.4 symbols/min [2025-10-27T22:11:08.637320] [DEBUG] [LOCAL ] K: Derivative data saved (138 records). [2025-10-27T22:11:08.637557] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-27T22:11:08.639703] [INFO ] [MAIN ] Derivative Progress: 960/1881 symbols completed. K took 1.2s. Estimated remaining: 6m 14s. Rate: 147.6 symbols/min [2025-10-27T22:11:08.640070] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:08.640016] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:08.640194] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:08.667295] [DEBUG] [LOCAL ] KB: Loaded 22731 existing records from primary storage. [2025-10-27T22:11:08.667726] [INFO ] [MAIN ] KB: Loaded 22731 primary data records. [2025-10-27T22:11:08.686199] [DEBUG] [LOCAL ] KBDC: Loaded 22512 existing records from primary storage. [2025-10-27T22:11:08.738665] [INFO ] [MAIN ] KBDC: Loaded 22512 primary data records. [2025-10-27T22:11:08.950736] [DEBUG] [LOCAL ] KBH: Loaded 48545 existing records from primary storage. [2025-10-27T22:11:08.981752] [INFO ] [MAIN ] KBH: Loaded 48545 primary data records. [2025-10-27T22:11:09.639101] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:09.671279] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:09.712971] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:09.752958] [INFO ] [MAIN ] KB: Generated 138 derivative records from 22731 primary records. [2025-10-27T22:11:09.754554] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-27T22:11:09.772026] [DEBUG] [LOCAL ] KB: Derivative data saved (138 records). [2025-10-27T22:11:09.772217] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-27T22:11:09.775626] [INFO ] [MAIN ] Derivative Progress: 961/1881 symbols completed. KB took 1.1s. Estimated remaining: 6m 15s. Rate: 147.3 symbols/min [2025-10-27T22:11:09.776916] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:09.779670] [INFO ] [MAIN ] KBDC: Generated 138 derivative records from 22512 primary records. [2025-10-27T22:11:09.779802] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-27T22:11:09.795107] [DEBUG] [LOCAL ] KBDC: Derivative data saved (138 records). [2025-10-27T22:11:09.796715] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-27T22:11:09.799141] [INFO ] [MAIN ] Derivative Progress: 962/1881 symbols completed. KBDC took 1.2s. Estimated remaining: 6m 14s. Rate: 147.4 symbols/min [2025-10-27T22:11:09.801126] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:09.801610] [INFO ] [MAIN ] KBH: Generated 138 derivative records from 48545 primary records. [2025-10-27T22:11:09.801744] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-27T22:11:09.814917] [DEBUG] [LOCAL ] KBH: Derivative data saved (138 records). [2025-10-27T22:11:09.815056] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-27T22:11:09.817832] [INFO ] [MAIN ] Derivative Progress: 963/1881 symbols completed. KBH took 1.2s. Estimated remaining: 6m 13s. Rate: 147.6 symbols/min [2025-10-27T22:11:09.818078] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:09.834123] [DEBUG] [LOCAL ] KEN: Loaded 4395 existing records from primary storage. [2025-10-27T22:11:09.834324] [INFO ] [MAIN ] KEN: Loaded 4395 primary data records. [2025-10-27T22:11:09.981953] [DEBUG] [LOCAL ] KBR: Loaded 47929 existing records from primary storage. [2025-10-27T22:11:09.992937] [INFO ] [MAIN ] KBR: Loaded 47929 primary data records. [2025-10-27T22:11:10.261177] [DEBUG] [LOCAL ] KD: Loaded 52295 existing records from primary storage. [2025-10-27T22:11:10.274692] [INFO ] [MAIN ] KD: Loaded 52295 primary data records. [2025-10-27T22:11:10.828036] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:10.863237] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:10.903881] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:10.950342] [INFO ] [MAIN ] KBR: Generated 138 derivative records from 47929 primary records. [2025-10-27T22:11:10.948495] [INFO ] [MAIN ] KEN: Generated 138 derivative records from 4395 primary records. [2025-10-27T22:11:10.950633] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-27T22:11:10.950920] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-27T22:11:10.976107] [DEBUG] [LOCAL ] KEN: Derivative data saved (138 records). [2025-10-27T22:11:10.983325] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-27T22:11:10.987837] [INFO ] [MAIN ] Derivative Progress: 964/1881 symbols completed. KEN took 1.2s. Estimated remaining: 6m 14s. Rate: 147.3 symbols/min [2025-10-27T22:11:10.988362] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:10.988057] [DEBUG] [LOCAL ] KBR: Derivative data saved (138 records). [2025-10-27T22:11:10.988936] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-27T22:11:10.993866] [INFO ] [MAIN ] Derivative Progress: 965/1881 symbols completed. KBR took 1.2s. Estimated remaining: 6m 13s. Rate: 147.4 symbols/min [2025-10-27T22:11:10.994959] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:11.000431] [INFO ] [MAIN ] KD: Generated 138 derivative records from 52295 primary records. [2025-10-27T22:11:11.000746] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-27T22:11:11.012790] [DEBUG] [LOCAL ] KD: Derivative data saved (138 records). [2025-10-27T22:11:11.013048] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-27T22:11:11.016126] [INFO ] [MAIN ] Derivative Progress: 966/1881 symbols completed. KD took 1.2s. Estimated remaining: 6m 12s. Rate: 147.6 symbols/min [2025-10-27T22:11:11.016345] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:11.049715] [DEBUG] [LOCAL ] KEP: Loaded 32538 existing records from primary storage. [2025-10-27T22:11:11.049855] [INFO ] [MAIN ] KEP: Loaded 32538 primary data records. [2025-10-27T22:11:11.162898] [DEBUG] [LOCAL ] KEX: Loaded 38625 existing records from primary storage. [2025-10-27T22:11:11.172529] [INFO ] [MAIN ] KEX: Loaded 38625 primary data records. [2025-10-27T22:11:11.507512] [DEBUG] [LOCAL ] KEYS: Loaded 42921 existing records from primary storage. [2025-10-27T22:11:11.523745] [INFO ] [MAIN ] KEYS: Loaded 42921 primary data records. [2025-10-27T22:11:12.056300] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:12.056689] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:12.121413] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:12.170996] [INFO ] [MAIN ] KEX: Generated 138 derivative records from 38625 primary records. [2025-10-27T22:11:12.173731] [INFO ] [MAIN ] KEP: Generated 138 derivative records from 32538 primary records. [2025-10-27T22:11:12.174409] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-27T22:11:12.174306] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-27T22:11:12.200609] [DEBUG] [LOCAL ] KEP: Derivative data saved (138 records). [2025-10-27T22:11:12.200310] [DEBUG] [LOCAL ] KEX: Derivative data saved (138 records). [2025-10-27T22:11:12.201017] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-27T22:11:12.203168] [INFO ] [MAIN ] Derivative Progress: 967/1881 symbols completed. KEX took 1.2s. Estimated remaining: 6m 12s. Rate: 147.3 symbols/min [2025-10-27T22:11:12.203406] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-27T22:11:12.205292] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:12.207563] [INFO ] [MAIN ] Derivative Progress: 968/1881 symbols completed. KEP took 1.2s. Estimated remaining: 6m 12s. Rate: 147.4 symbols/min [2025-10-27T22:11:12.208171] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:12.214185] [INFO ] [MAIN ] KEYS: Generated 138 derivative records from 42921 primary records. [2025-10-27T22:11:12.214352] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-27T22:11:12.216632] [DEBUG] [LOCAL ] KF: Loaded 2320 existing records from primary storage. [2025-10-27T22:11:12.217050] [INFO ] [MAIN ] KF: Loaded 2320 primary data records. [2025-10-27T22:11:12.264252] [DEBUG] [LOCAL ] KEYS: Derivative data saved (138 records). [2025-10-27T22:11:12.276527] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-27T22:11:12.291116] [INFO ] [MAIN ] Derivative Progress: 969/1881 symbols completed. KEYS took 1.3s. Estimated remaining: 6m 11s. Rate: 147.6 symbols/min [2025-10-27T22:11:12.305571] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:12.347437] [DEBUG] [LOCAL ] KFRC: Loaded 20906 existing records from primary storage. [2025-10-27T22:11:12.376168] [INFO ] [MAIN ] KFRC: Loaded 20906 primary data records. [2025-10-27T22:11:12.676024] [DEBUG] [LOCAL ] KFS: Loaded 8681 existing records from primary storage. [2025-10-27T22:11:12.702915] [INFO ] [MAIN ] KFS: Loaded 8681 primary data records. [2025-10-27T22:11:13.223031] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:13.268181] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:13.302829] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:13.330558] [INFO ] [MAIN ] KF: Generated 138 derivative records from 2320 primary records. [2025-10-27T22:11:13.333193] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-27T22:11:13.349359] [DEBUG] [LOCAL ] KF: Derivative data saved (138 records). [2025-10-27T22:11:13.350405] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-27T22:11:13.352542] [INFO ] [MAIN ] Derivative Progress: 970/1881 symbols completed. KF took 1.1s. Estimated remaining: 6m 11s. Rate: 147.3 symbols/min [2025-10-27T22:11:13.352721] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:13.374724] [INFO ] [MAIN ] KFRC: Generated 138 derivative records from 20906 primary records. [2025-10-27T22:11:13.376370] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-27T22:11:13.378441] [INFO ] [MAIN ] KFS: Generated 138 derivative records from 8681 primary records. [2025-10-27T22:11:13.378760] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-27T22:11:13.401559] [DEBUG] [LOCAL ] KFS: Derivative data saved (138 records). [2025-10-27T22:11:13.402056] [DEBUG] [LOCAL ] KFRC: Derivative data saved (138 records). [2025-10-27T22:11:13.402205] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-27T22:11:13.404845] [INFO ] [MAIN ] Derivative Progress: 971/1881 symbols completed. KFRC took 1.2s. Estimated remaining: 6m 10s. Rate: 147.5 symbols/min [2025-10-27T22:11:13.402273] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-27T22:11:13.418934] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:13.421540] [INFO ] [MAIN ] Derivative Progress: 972/1881 symbols completed. KFS took 1.1s. Estimated remaining: 6m 10s. Rate: 147.6 symbols/min [2025-10-27T22:11:13.421972] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:13.444232] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-27T22:11:13.444370] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-27T22:11:13.654320] [DEBUG] [LOCAL ] KGS: Loaded 45875 existing records from primary storage. [2025-10-27T22:11:13.654616] [INFO ] [MAIN ] KGS: Loaded 45875 primary data records. [2025-10-27T22:11:13.841179] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-27T22:11:13.868033] [INFO ] [MAIN ] KIM: Loaded 52988 primary data records. [2025-10-27T22:11:14.446125] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:14.486456] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:14.515323] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:14.560713] [INFO ] [MAIN ] KGC: Generated 138 derivative records from 53699 primary records. [2025-10-27T22:11:14.564716] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-27T22:11:14.581320] [DEBUG] [LOCAL ] KGC: Derivative data saved (138 records). [2025-10-27T22:11:14.583931] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-27T22:11:14.587082] [INFO ] [MAIN ] Derivative Progress: 973/1881 symbols completed. KGC took 1.2s. Estimated remaining: 6m 10s. Rate: 147.3 symbols/min [2025-10-27T22:11:14.590878] [INFO ] [MAIN ] KGS: Generated 138 derivative records from 45875 primary records. [2025-10-27T22:11:14.591068] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-27T22:11:14.605600] [DEBUG] [LOCAL ] KGS: Derivative data saved (138 records). [2025-10-27T22:11:14.605902] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-27T22:11:14.609153] [INFO ] [MAIN ] Derivative Progress: 974/1881 symbols completed. KGS took 1.2s. Estimated remaining: 6m 9s. Rate: 147.5 symbols/min [2025-10-27T22:11:14.610759] [INFO ] [MAIN ] KIM: Generated 138 derivative records from 52988 primary records. [2025-10-27T22:11:14.610892] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-27T22:11:14.622861] [DEBUG] [LOCAL ] KIM: Derivative data saved (138 records). [2025-10-27T22:11:14.622927] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-27T22:11:14.625530] [INFO ] [MAIN ] Derivative Progress: 975/1881 symbols completed. KIM took 1.2s. Estimated remaining: 6m 8s. Rate: 147.6 symbols/min [2025-10-27T22:11:14.626005] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:14.626078] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:14.626201] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:14.635809] [DEBUG] [LOCAL ] KKRS: Loaded 5455 existing records from primary storage. [2025-10-27T22:11:14.636009] [INFO ] [MAIN ] KKRS: Loaded 5455 primary data records. [2025-10-27T22:11:14.749525] [DEBUG] [LOCAL ] KIO: Loaded 21584 existing records from primary storage. [2025-10-27T22:11:14.755221] [INFO ] [MAIN ] KIO: Loaded 21584 primary data records. [2025-10-27T22:11:15.104795] [DEBUG] [LOCAL ] KKR: Loaded 53494 existing records from primary storage. [2025-10-27T22:11:15.118417] [INFO ] [MAIN ] KKR: Loaded 53494 primary data records. [2025-10-27T22:11:15.602715] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:15.642051] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:15.687746] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:15.715278] [INFO ] [MAIN ] KKRS: Generated 138 derivative records from 5455 primary records. [2025-10-27T22:11:15.717420] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-27T22:11:15.738324] [DEBUG] [LOCAL ] KKRS: Derivative data saved (138 records). [2025-10-27T22:11:15.738477] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-27T22:11:15.741134] [INFO ] [MAIN ] Derivative Progress: 976/1881 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 9s. Rate: 147.3 symbols/min [2025-10-27T22:11:15.741355] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:15.754407] [INFO ] [MAIN ] KIO: Generated 138 derivative records from 21584 primary records. [2025-10-27T22:11:15.757177] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-27T22:11:15.791870] [INFO ] [MAIN ] KKR: Generated 138 derivative records from 53494 primary records. [2025-10-27T22:11:15.789260] [DEBUG] [LOCAL ] KIO: Derivative data saved (138 records). [2025-10-27T22:11:15.792072] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-27T22:11:15.792683] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-27T22:11:15.794924] [INFO ] [MAIN ] Derivative Progress: 977/1881 symbols completed. KIO took 1.2s. Estimated remaining: 6m 8s. Rate: 147.5 symbols/min [2025-10-27T22:11:15.803377] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:15.818748] [DEBUG] [LOCAL ] KKR: Derivative data saved (138 records). [2025-10-27T22:11:15.819077] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-27T22:11:15.821620] [INFO ] [MAIN ] Derivative Progress: 978/1881 symbols completed. KKR took 1.2s. Estimated remaining: 6m 7s. Rate: 147.6 symbols/min [2025-10-27T22:11:15.822457] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:15.822182] [DEBUG] [LOCAL ] KLC: Loaded 35861 existing records from primary storage. [2025-10-27T22:11:15.822772] [INFO ] [MAIN ] KLC: Loaded 35861 primary data records. [2025-10-27T22:11:15.927329] [DEBUG] [LOCAL ] KMPB: Loaded 3417 existing records from primary storage. [2025-10-27T22:11:15.943836] [INFO ] [MAIN ] KMPB: Loaded 3417 primary data records. [2025-10-27T22:11:16.526862] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-27T22:11:16.542205] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-27T22:11:16.876692] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:16.918250] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:16.978350] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:17.004952] [INFO ] [MAIN ] KLC: Generated 138 derivative records from 35861 primary records. [2025-10-27T22:11:17.007003] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-27T22:11:17.028073] [DEBUG] [LOCAL ] KLC: Derivative data saved (138 records). [2025-10-27T22:11:17.028328] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-27T22:11:17.030353] [INFO ] [MAIN ] Derivative Progress: 979/1881 symbols completed. KLC took 1.3s. Estimated remaining: 6m 7s. Rate: 147.3 symbols/min [2025-10-27T22:11:17.032676] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:17.035360] [INFO ] [MAIN ] KMPB: Generated 138 derivative records from 3417 primary records. [2025-10-27T22:11:17.036113] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-27T22:11:17.050524] [DEBUG] [LOCAL ] KMPB: Derivative data saved (138 records). [2025-10-27T22:11:17.050735] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-27T22:11:17.053777] [INFO ] [MAIN ] Derivative Progress: 980/1881 symbols completed. KMPB took 1.2s. Estimated remaining: 6m 7s. Rate: 147.5 symbols/min [2025-10-27T22:11:17.054007] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:17.065736] [INFO ] [MAIN ] KMI: Generated 138 derivative records from 53693 primary records. [2025-10-27T22:11:17.066059] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-27T22:11:17.089957] [DEBUG] [LOCAL ] KMI: Derivative data saved (138 records). [2025-10-27T22:11:17.090179] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-27T22:11:17.093398] [INFO ] [MAIN ] Derivative Progress: 981/1881 symbols completed. KMI took 1.3s. Estimated remaining: 6m 6s. Rate: 147.6 symbols/min [2025-10-27T22:11:17.093702] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:17.117623] [DEBUG] [LOCAL ] KMPR: Loaded 40466 existing records from primary storage. [2025-10-27T22:11:17.118032] [INFO ] [MAIN ] KMPR: Loaded 40466 primary data records. [2025-10-27T22:11:17.204484] [DEBUG] [LOCAL ] KMT: Loaded 42540 existing records from primary storage. [2025-10-27T22:11:17.228094] [INFO ] [MAIN ] KMT: Loaded 42540 primary data records. [2025-10-27T22:11:17.609667] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-27T22:11:17.623823] [INFO ] [MAIN ] KMX: Loaded 53284 primary data records. [2025-10-27T22:11:18.114594] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:18.152788] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:18.196850] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:18.239698] [INFO ] [MAIN ] KMPR: Generated 138 derivative records from 40466 primary records. [2025-10-27T22:11:18.242989] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-27T22:11:18.260557] [DEBUG] [LOCAL ] KMPR: Derivative data saved (138 records). [2025-10-27T22:11:18.261188] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-27T22:11:18.265898] [INFO ] [MAIN ] KMT: Generated 138 derivative records from 42540 primary records. [2025-10-27T22:11:18.266061] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-27T22:11:18.265296] [INFO ] [MAIN ] Derivative Progress: 982/1881 symbols completed. KMPR took 1.2s. Estimated remaining: 6m 6s. Rate: 147.3 symbols/min [2025-10-27T22:11:18.266504] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:18.283303] [DEBUG] [LOCAL ] KMT: Derivative data saved (138 records). [2025-10-27T22:11:18.283920] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-27T22:11:18.286510] [INFO ] [MAIN ] Derivative Progress: 983/1881 symbols completed. KMT took 1.2s. Estimated remaining: 6m 5s. Rate: 147.5 symbols/min [2025-10-27T22:11:18.287573] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:18.290900] [INFO ] [MAIN ] KMX: Generated 138 derivative records from 53284 primary records. [2025-10-27T22:11:18.291163] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-27T22:11:18.305292] [DEBUG] [LOCAL ] KMX: Derivative data saved (138 records). [2025-10-27T22:11:18.305365] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-27T22:11:18.308189] [INFO ] [MAIN ] Derivative Progress: 984/1881 symbols completed. KMX took 1.2s. Estimated remaining: 6m 5s. Rate: 147.6 symbols/min [2025-10-27T22:11:18.308598] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:18.365173] [DEBUG] [LOCAL ] KN: Loaded 38260 existing records from primary storage. [2025-10-27T22:11:18.366270] [INFO ] [MAIN ] KN: Loaded 38260 primary data records. [2025-10-27T22:11:18.366163] [DEBUG] [LOCAL ] KNSL: Loaded 18472 existing records from primary storage. [2025-10-27T22:11:18.365854] [DEBUG] [LOCAL ] KNF: Loaded 36587 existing records from primary storage. [2025-10-27T22:11:18.366704] [INFO ] [MAIN ] KNF: Loaded 36587 primary data records. [2025-10-27T22:11:18.366455] [INFO ] [MAIN ] KNSL: Loaded 18472 primary data records. [2025-10-27T22:11:19.453393] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:19.459028] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:19.458762] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:19.562931] [INFO ] [MAIN ] KNSL: Generated 138 derivative records from 18472 primary records. [2025-10-27T22:11:19.567119] [INFO ] [MAIN ] KNF: Generated 138 derivative records from 36587 primary records. [2025-10-27T22:11:19.565325] [INFO ] [MAIN ] KN: Generated 138 derivative records from 38260 primary records. [2025-10-27T22:11:19.567274] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-27T22:11:19.567360] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-27T22:11:19.570317] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-27T22:11:19.592035] [DEBUG] [LOCAL ] KN: Derivative data saved (138 records). [2025-10-27T22:11:19.594421] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-27T22:11:19.597145] [INFO ] [MAIN ] Derivative Progress: 985/1881 symbols completed. KN took 1.3s. Estimated remaining: 6m 5s. Rate: 147.3 symbols/min [2025-10-27T22:11:19.594354] [DEBUG] [LOCAL ] KNF: Derivative data saved (138 records). [2025-10-27T22:11:19.597799] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-27T22:11:19.597340] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:19.607473] [INFO ] [MAIN ] Derivative Progress: 986/1881 symbols completed. KNF took 1.3s. Estimated remaining: 6m 4s. Rate: 147.4 symbols/min [2025-10-27T22:11:19.612592] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:19.612432] [DEBUG] [LOCAL ] KNSL: Derivative data saved (138 records). [2025-10-27T22:11:19.613342] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-27T22:11:19.616361] [INFO ] [MAIN ] Derivative Progress: 987/1881 symbols completed. KNSL took 1.3s. Estimated remaining: 6m 3s. Rate: 147.6 symbols/min [2025-10-27T22:11:19.616625] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:19.687692] [DEBUG] [LOCAL ] KNTK: Loaded 47192 existing records from primary storage. [2025-10-27T22:11:19.687943] [INFO ] [MAIN ] KNTK: Loaded 47192 primary data records. [2025-10-27T22:11:19.752034] [DEBUG] [LOCAL ] KODK: Loaded 43487 existing records from primary storage. [2025-10-27T22:11:19.772628] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-27T22:11:19.799471] [INFO ] [MAIN ] KODK: Loaded 43487 primary data records. [2025-10-27T22:11:19.810251] [INFO ] [MAIN ] KNX: Loaded 52645 primary data records. [2025-10-27T22:11:20.643017] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:20.686186] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:20.717877] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:20.778516] [INFO ] [MAIN ] KNTK: Generated 138 derivative records from 47192 primary records. [2025-10-27T22:11:20.783591] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-27T22:11:20.800425] [DEBUG] [LOCAL ] KNTK: Derivative data saved (138 records). [2025-10-27T22:11:20.802926] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-27T22:11:20.806484] [INFO ] [MAIN ] Derivative Progress: 988/1881 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 4s. Rate: 147.3 symbols/min [2025-10-27T22:11:20.809745] [INFO ] [MAIN ] KNX: Generated 138 derivative records from 52645 primary records. [2025-10-27T22:11:20.809860] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-27T22:11:20.823445] [INFO ] [MAIN ] KODK: Generated 138 derivative records from 43487 primary records. [2025-10-27T22:11:20.825093] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-27T22:11:20.825037] [DEBUG] [LOCAL ] KNX: Derivative data saved (138 records). [2025-10-27T22:11:20.825190] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-27T22:11:20.828264] [INFO ] [MAIN ] Derivative Progress: 989/1881 symbols completed. KNX took 1.2s. Estimated remaining: 6m 3s. Rate: 147.4 symbols/min [2025-10-27T22:11:20.839320] [DEBUG] [LOCAL ] KODK: Derivative data saved (138 records). [2025-10-27T22:11:20.839379] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-27T22:11:20.842462] [INFO ] [MAIN ] Derivative Progress: 990/1881 symbols completed. KODK took 1.2s. Estimated remaining: 6m 2s. Rate: 147.6 symbols/min [2025-10-27T22:11:20.842903] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:20.843367] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:20.843307] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:20.870931] [DEBUG] [LOCAL ] KOP: Loaded 17144 existing records from primary storage. [2025-10-27T22:11:20.871147] [INFO ] [MAIN ] KOP: Loaded 17144 primary data records. [2025-10-27T22:11:20.946125] [DEBUG] [LOCAL ] KOF: Loaded 26160 existing records from primary storage. [2025-10-27T22:11:20.951500] [INFO ] [MAIN ] KOF: Loaded 26160 primary data records. [2025-10-27T22:11:21.332565] [DEBUG] [LOCAL ] KOS: Loaded 53087 existing records from primary storage. [2025-10-27T22:11:21.338950] [INFO ] [MAIN ] KOS: Loaded 53087 primary data records. [2025-10-27T22:11:21.852974] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:21.886485] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:21.940400] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:21.975065] [INFO ] [MAIN ] KOP: Generated 138 derivative records from 17144 primary records. [2025-10-27T22:11:21.978386] [INFO ] [MAIN ] KOF: Generated 138 derivative records from 26160 primary records. [2025-10-27T22:11:21.978530] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-27T22:11:21.978758] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-27T22:11:22.000986] [DEBUG] [LOCAL ] KOP: Derivative data saved (138 records). [2025-10-27T22:11:22.005203] [DEBUG] [LOCAL ] KOF: Derivative data saved (138 records). [2025-10-27T22:11:22.005364] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-27T22:11:22.005635] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-27T22:11:22.008639] [INFO ] [MAIN ] Derivative Progress: 991/1881 symbols completed. KOP took 1.2s. Estimated remaining: 6m 3s. Rate: 147.3 symbols/min [2025-10-27T22:11:22.011509] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:22.011581] [INFO ] [MAIN ] Derivative Progress: 992/1881 symbols completed. KOF took 1.2s. Estimated remaining: 6m 2s. Rate: 147.4 symbols/min [2025-10-27T22:11:22.014879] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:22.022225] [INFO ] [MAIN ] KOS: Generated 138 derivative records from 53087 primary records. [2025-10-27T22:11:22.022500] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-27T22:11:22.035890] [DEBUG] [LOCAL ] KOS: Derivative data saved (138 records). [2025-10-27T22:11:22.036085] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-27T22:11:22.040913] [INFO ] [MAIN ] Derivative Progress: 993/1881 symbols completed. KOS took 1.2s. Estimated remaining: 6m 1s. Rate: 147.6 symbols/min [2025-10-27T22:11:22.041359] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:22.110994] [DEBUG] [LOCAL ] KRC: Loaded 47927 existing records from primary storage. [2025-10-27T22:11:22.111153] [INFO ] [MAIN ] KRC: Loaded 47927 primary data records. [2025-10-27T22:11:22.110339] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-27T22:11:22.111294] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-27T22:11:22.305776] [DEBUG] [LOCAL ] KREF: Loaded 37851 existing records from primary storage. [2025-10-27T22:11:22.319351] [INFO ] [MAIN ] KREF: Loaded 37851 primary data records. [2025-10-27T22:11:23.107091] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:23.130555] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:23.177741] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:23.233886] [INFO ] [MAIN ] KRC: Generated 138 derivative records from 47927 primary records. [2025-10-27T22:11:23.235381] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-27T22:11:23.256343] [INFO ] [MAIN ] KR: Generated 138 derivative records from 53681 primary records. [2025-10-27T22:11:23.260835] [DEBUG] [LOCAL ] KRC: Derivative data saved (138 records). [2025-10-27T22:11:23.260903] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-27T22:11:23.261003] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-27T22:11:23.264608] [INFO ] [MAIN ] Derivative Progress: 994/1881 symbols completed. KRC took 1.2s. Estimated remaining: 6m 1s. Rate: 147.3 symbols/min [2025-10-27T22:11:23.278534] [DEBUG] [LOCAL ] KR: Derivative data saved (138 records). [2025-10-27T22:11:23.278797] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-27T22:11:23.281254] [INFO ] [MAIN ] Derivative Progress: 995/1881 symbols completed. KR took 1.3s. Estimated remaining: 6m 1s. Rate: 147.4 symbols/min [2025-10-27T22:11:23.274215] [INFO ] [MAIN ] KREF: Generated 138 derivative records from 37851 primary records. [2025-10-27T22:11:23.281411] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-27T22:11:23.278670] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:23.281638] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:23.295545] [DEBUG] [LOCAL ] KREF: Derivative data saved (138 records). [2025-10-27T22:11:23.295790] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-27T22:11:23.298501] [INFO ] [MAIN ] Derivative Progress: 996/1881 symbols completed. KREF took 1.3s. Estimated remaining: 5m 60s. Rate: 147.6 symbols/min [2025-10-27T22:11:23.298832] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:23.333583] [DEBUG] [LOCAL ] KRO: Loaded 26446 existing records from primary storage. [2025-10-27T22:11:23.333812] [INFO ] [MAIN ] KRO: Loaded 26446 primary data records. [2025-10-27T22:11:23.468170] [DEBUG] [LOCAL ] KRP: Loaded 35495 existing records from primary storage. [2025-10-27T22:11:23.474469] [DEBUG] [LOCAL ] KRG: Loaded 49194 existing records from primary storage. [2025-10-27T22:11:23.479713] [INFO ] [MAIN ] KRP: Loaded 35495 primary data records. [2025-10-27T22:11:23.490152] [INFO ] [MAIN ] KRG: Loaded 49194 primary data records. [2025-10-27T22:11:24.292599] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:24.369363] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:24.369208] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:24.407126] [INFO ] [MAIN ] KRO: Generated 138 derivative records from 26446 primary records. [2025-10-27T22:11:24.411011] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-27T22:11:24.436604] [DEBUG] [LOCAL ] KRO: Derivative data saved (138 records). [2025-10-27T22:11:24.436950] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-27T22:11:24.443005] [INFO ] [MAIN ] Derivative Progress: 997/1881 symbols completed. KRO took 1.2s. Estimated remaining: 6m 0s. Rate: 147.3 symbols/min [2025-10-27T22:11:24.443397] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:24.457292] [INFO ] [MAIN ] KRP: Generated 138 derivative records from 35495 primary records. [2025-10-27T22:11:24.458520] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-27T22:11:24.468799] [INFO ] [MAIN ] KRG: Generated 138 derivative records from 49194 primary records. [2025-10-27T22:11:24.468948] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-27T22:11:24.485911] [DEBUG] [LOCAL ] KRP: Derivative data saved (138 records). [2025-10-27T22:11:24.486364] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-27T22:11:24.486311] [DEBUG] [LOCAL ] KRG: Derivative data saved (138 records). [2025-10-27T22:11:24.501035] [INFO ] [MAIN ] Derivative Progress: 998/1881 symbols completed. KRP took 1.2s. Estimated remaining: 5m 59s. Rate: 147.4 symbols/min [2025-10-27T22:11:24.501404] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-27T22:11:24.501616] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:24.505268] [INFO ] [MAIN ] Derivative Progress: 999/1881 symbols completed. KRG took 1.2s. Estimated remaining: 5m 59s. Rate: 147.6 symbols/min [2025-10-27T22:11:24.505594] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:24.526121] [DEBUG] [LOCAL ] KSS: Loaded 53574 existing records from primary storage. [2025-10-27T22:11:24.526426] [INFO ] [MAIN ] KSS: Loaded 53574 primary data records. [2025-10-27T22:11:24.746293] [DEBUG] [LOCAL ] KTB: Loaded 39895 existing records from primary storage. [2025-10-27T22:11:24.851581] [INFO ] [MAIN ] KTB: Loaded 39895 primary data records. [2025-10-27T22:11:24.881369] [DEBUG] [LOCAL ] KT: Loaded 45188 existing records from primary storage. [2025-10-27T22:11:24.897573] [INFO ] [MAIN ] KT: Loaded 45188 primary data records. [2025-10-27T22:11:25.507168] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:25.554048] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:25.580108] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:25.616417] [INFO ] [MAIN ] KSS: Generated 138 derivative records from 53574 primary records. [2025-10-27T22:11:25.619865] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-27T22:11:25.639603] [DEBUG] [LOCAL ] KSS: Derivative data saved (138 records). [2025-10-27T22:11:25.639758] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-27T22:11:25.641846] [INFO ] [MAIN ] Derivative Progress: 1000/1881 symbols completed. KSS took 1.2s. Estimated remaining: 5m 59s. Rate: 147.3 symbols/min [2025-10-27T22:11:25.644674] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:25.658845] [INFO ] [MAIN ] KT: Generated 138 derivative records from 45188 primary records. [2025-10-27T22:11:25.659206] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-27T22:11:25.666839] [DEBUG] [LOCAL ] KTF: Loaded 11395 existing records from primary storage. [2025-10-27T22:11:25.667314] [INFO ] [MAIN ] KTF: Loaded 11395 primary data records. [2025-10-27T22:11:25.754254] [DEBUG] [LOCAL ] KT: Derivative data saved (138 records). [2025-10-27T22:11:25.778339] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-27T22:11:25.786247] [INFO ] [MAIN ] Derivative Progress: 1001/1881 symbols completed. KT took 1.3s. Estimated remaining: 5m 58s. Rate: 147.4 symbols/min [2025-10-27T22:11:25.786420] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:25.783140] [INFO ] [MAIN ] KTB: Generated 138 derivative records from 39895 primary records. [2025-10-27T22:11:25.797721] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-27T22:11:25.991820] [DEBUG] [LOCAL ] KTB: Derivative data saved (138 records). [2025-10-27T22:11:25.992238] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-27T22:11:25.994756] [INFO ] [MAIN ] Derivative Progress: 1002/1881 symbols completed. KTB took 1.5s. Estimated remaining: 5m 58s. Rate: 147.5 symbols/min [2025-10-27T22:11:25.995027] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:26.033872] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:26.075050] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-27T22:11:26.076716] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-27T22:11:26.203836] [DEBUG] [LOCAL ] KVYO: Loaded 50902 existing records from primary storage. [2025-10-27T22:11:26.205601] [INFO ] [MAIN ] KVYO: Loaded 50902 primary data records. [2025-10-27T22:11:26.596823] [INFO ] [MAIN ] KTF: Generated 138 derivative records from 11395 primary records. [2025-10-27T22:11:26.703703] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-27T22:11:26.733849] [DEBUG] [LOCAL ] KTF: Derivative data saved (138 records). [2025-10-27T22:11:26.734135] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-27T22:11:26.736959] [INFO ] [MAIN ] Derivative Progress: 1003/1881 symbols completed. KTF took 1.1s. Estimated remaining: 5m 58s. Rate: 147.3 symbols/min [2025-10-27T22:11:26.754746] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:26.787328] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:11:26.819110] [INFO ] [MAIN ] KVUE: Generated 138 derivative records from 53667 primary records. [2025-10-27T22:11:26.821666] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-27T22:11:26.838421] [DEBUG] [LOCAL ] KVUE: Derivative data saved (138 records). [2025-10-27T22:11:26.838808] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-27T22:11:26.843142] [INFO ] [MAIN ] Derivative Progress: 1004/1881 symbols completed. KVUE took 1.1s. Estimated remaining: 5m 57s. Rate: 147.5 symbols/min [2025-10-27T22:11:26.846028] [INFO ] [MAIN ] KVYO: Generated 138 derivative records from 50902 primary records. [2025-10-27T22:11:26.846117] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-27T22:11:26.857450] [DEBUG] [LOCAL ] KVYO: Derivative data saved (138 records). [2025-10-27T22:11:26.857504] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-27T22:11:26.860099] [INFO ] [MAIN ] Derivative Progress: 1005/1881 symbols completed. KVYO took 0.9s. Estimated remaining: 5m 56s. Rate: 147.6 symbols/min [2025-10-27T22:11:26.860517] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:26.860598] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:26.860430] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:26.878589] [DEBUG] [LOCAL ] KWR: Loaded 15417 existing records from primary storage. [2025-10-27T22:11:26.878832] [INFO ] [MAIN ] KWR: Loaded 15417 primary data records. [2025-10-27T22:11:27.092879] [DEBUG] [LOCAL ] KYN: Loaded 29810 existing records from primary storage. [2025-10-27T22:11:27.220710] [INFO ] [MAIN ] KYN: Loaded 29810 primary data records. [2025-10-27T22:11:27.220579] [DEBUG] [LOCAL ] KW: Loaded 40000 existing records from primary storage. [2025-10-27T22:11:27.220887] [INFO ] [MAIN ] KW: Loaded 40000 primary data records. [2025-10-27T22:11:27.839025] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:27.878449] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:27.913426] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:27.940442] [INFO ] [MAIN ] KWR: Generated 138 derivative records from 15417 primary records. [2025-10-27T22:11:27.942938] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-27T22:11:27.958601] [DEBUG] [LOCAL ] KWR: Derivative data saved (138 records). [2025-10-27T22:11:27.959834] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-27T22:11:27.962463] [INFO ] [MAIN ] Derivative Progress: 1006/1881 symbols completed. KWR took 1.1s. Estimated remaining: 5m 56s. Rate: 147.3 symbols/min [2025-10-27T22:11:27.963776] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:27.983970] [INFO ] [MAIN ] KW: Generated 138 derivative records from 40000 primary records. [2025-10-27T22:11:27.983811] [INFO ] [MAIN ] KYN: Generated 138 derivative records from 29810 primary records. [2025-10-27T22:11:27.984097] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-27T22:11:27.984152] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-27T22:11:28.008164] [DEBUG] [LOCAL ] KW: Derivative data saved (138 records). [2025-10-27T22:11:28.008237] [DEBUG] [LOCAL ] KYN: Derivative data saved (138 records). [2025-10-27T22:11:28.008466] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-27T22:11:28.008527] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-27T22:11:28.011329] [INFO ] [MAIN ] Derivative Progress: 1007/1881 symbols completed. KW took 1.2s. Estimated remaining: 5m 56s. Rate: 147.5 symbols/min [2025-10-27T22:11:28.022230] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:28.022484] [INFO ] [MAIN ] Derivative Progress: 1008/1881 symbols completed. KYN took 1.2s. Estimated remaining: 5m 55s. Rate: 147.6 symbols/min [2025-10-27T22:11:28.022867] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:28.039755] [DEBUG] [LOCAL ] L: Loaded 40785 existing records from primary storage. [2025-10-27T22:11:28.039976] [INFO ] [MAIN ] L: Loaded 40785 primary data records. [2025-10-27T22:11:28.162757] [DEBUG] [LOCAL ] LAD: Loaded 23328 existing records from primary storage. [2025-10-27T22:11:28.174767] [INFO ] [MAIN ] LAD: Loaded 23328 primary data records. [2025-10-27T22:11:28.498221] [DEBUG] [LOCAL ] LAC: Loaded 52585 existing records from primary storage. [2025-10-27T22:11:28.511146] [INFO ] [MAIN ] LAC: Loaded 52585 primary data records. [2025-10-27T22:11:29.329998] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:29.373067] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:11:29.428799] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:29.478053] [INFO ] [MAIN ] L: Generated 138 derivative records from 40785 primary records. [2025-10-27T22:11:29.480253] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-27T22:11:29.481217] [INFO ] [MAIN ] LAD: Generated 138 derivative records from 23328 primary records. [2025-10-27T22:11:29.484295] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-27T22:11:29.503889] [DEBUG] [LOCAL ] L: Derivative data saved (138 records). [2025-10-27T22:11:29.504411] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-27T22:11:29.524907] [INFO ] [MAIN ] Derivative Progress: 1009/1881 symbols completed. L took 1.6s. Estimated remaining: 5m 55s. Rate: 147.2 symbols/min [2025-10-27T22:11:29.526130] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:29.532632] [DEBUG] [LOCAL ] LAD: Derivative data saved (138 records). [2025-10-27T22:11:29.535568] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-27T22:11:29.535481] [INFO ] [MAIN ] LAC: Generated 138 derivative records from 52585 primary records. [2025-10-27T22:11:29.538605] [INFO ] [MAIN ] Derivative Progress: 1010/1881 symbols completed. LAD took 1.5s. Estimated remaining: 5m 55s. Rate: 147.4 symbols/min [2025-10-27T22:11:29.539251] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:29.539312] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-27T22:11:29.559184] [DEBUG] [LOCAL ] LANV: Loaded 2761 existing records from primary storage. [2025-10-27T22:11:29.559804] [DEBUG] [LOCAL ] LAC: Derivative data saved (138 records). [2025-10-27T22:11:29.560032] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-27T22:11:29.563422] [INFO ] [MAIN ] Derivative Progress: 1011/1881 symbols completed. LAC took 1.5s. Estimated remaining: 5m 54s. Rate: 147.5 symbols/min [2025-10-27T22:11:29.563627] [INFO ] [MAIN ] LANV: Loaded 2761 primary data records. [2025-10-27T22:11:29.563877] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:29.703569] [DEBUG] [LOCAL ] LAW: Loaded 15098 existing records from primary storage. [2025-10-27T22:11:29.745269] [INFO ] [MAIN ] LAW: Loaded 15098 primary data records. [2025-10-27T22:11:29.745182] [DEBUG] [LOCAL ] LADR: Loaded 39131 existing records from primary storage. [2025-10-27T22:11:29.787101] [INFO ] [MAIN ] LADR: Loaded 39131 primary data records. [2025-10-27T22:11:30.582604] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7825 incomplete bins [2025-10-27T22:11:30.621882] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:30.656059] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:30.695067] [INFO ] [MAIN ] LANV: Generated 138 derivative records from 2761 primary records. [2025-10-27T22:11:30.695777] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-27T22:11:30.714274] [DEBUG] [LOCAL ] LANV: Derivative data saved (138 records). [2025-10-27T22:11:30.715497] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-27T22:11:30.721207] [INFO ] [MAIN ] Derivative Progress: 1012/1881 symbols completed. LANV took 1.2s. Estimated remaining: 5m 54s. Rate: 147.2 symbols/min [2025-10-27T22:11:30.721712] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:30.732452] [INFO ] [MAIN ] LAW: Generated 138 derivative records from 15098 primary records. [2025-10-27T22:11:30.735845] [INFO ] [MAIN ] LADR: Generated 138 derivative records from 39131 primary records. [2025-10-27T22:11:30.735986] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-27T22:11:30.736109] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-27T22:11:30.760257] [DEBUG] [LOCAL ] LADR: Derivative data saved (138 records). [2025-10-27T22:11:30.760189] [DEBUG] [LOCAL ] LAW: Derivative data saved (138 records). [2025-10-27T22:11:30.760600] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-27T22:11:30.760412] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-27T22:11:30.765586] [INFO ] [MAIN ] Derivative Progress: 1013/1881 symbols completed. LADR took 1.2s. Estimated remaining: 5m 53s. Rate: 147.4 symbols/min [2025-10-27T22:11:30.768158] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:30.768262] [INFO ] [MAIN ] Derivative Progress: 1014/1881 symbols completed. LAW took 1.2s. Estimated remaining: 5m 53s. Rate: 147.5 symbols/min [2025-10-27T22:11:30.768868] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:30.804967] [DEBUG] [LOCAL ] LAZ: Loaded 44276 existing records from primary storage. [2025-10-27T22:11:30.813231] [INFO ] [MAIN ] LAZ: Loaded 44276 primary data records. [2025-10-27T22:11:30.953191] [DEBUG] [LOCAL ] LB: Loaded 36633 existing records from primary storage. [2025-10-27T22:11:30.968417] [INFO ] [MAIN ] LB: Loaded 36633 primary data records. [2025-10-27T22:11:30.996906] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-27T22:11:31.042723] [INFO ] [MAIN ] LBRT: Loaded 53003 primary data records. [2025-10-27T22:11:31.893266] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:31.967661] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:31.983897] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:32.001592] [INFO ] [MAIN ] LAZ: Generated 138 derivative records from 44276 primary records. [2025-10-27T22:11:32.003770] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-27T22:11:32.031137] [DEBUG] [LOCAL ] LAZ: Derivative data saved (138 records). [2025-10-27T22:11:32.032445] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-27T22:11:32.036236] [INFO ] [MAIN ] Derivative Progress: 1015/1881 symbols completed. LAZ took 1.3s. Estimated remaining: 5m 53s. Rate: 147.2 symbols/min [2025-10-27T22:11:32.036422] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:32.057058] [INFO ] [MAIN ] LBRT: Generated 138 derivative records from 53003 primary records. [2025-10-27T22:11:32.054875] [INFO ] [MAIN ] LB: Generated 138 derivative records from 36633 primary records. [2025-10-27T22:11:32.057298] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-27T22:11:32.057471] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-27T22:11:32.079440] [DEBUG] [LOCAL ] LB: Derivative data saved (138 records). [2025-10-27T22:11:32.082767] [DEBUG] [LOCAL ] LBRT: Derivative data saved (138 records). [2025-10-27T22:11:32.082979] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-27T22:11:32.085815] [INFO ] [MAIN ] Derivative Progress: 1016/1881 symbols completed. LBRT took 1.3s. Estimated remaining: 5m 52s. Rate: 147.3 symbols/min [2025-10-27T22:11:32.085952] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-27T22:11:32.086102] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:32.088503] [INFO ] [MAIN ] Derivative Progress: 1017/1881 symbols completed. LB took 1.3s. Estimated remaining: 5m 52s. Rate: 147.5 symbols/min [2025-10-27T22:11:32.089696] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:32.149098] [DEBUG] [LOCAL ] LCII: Loaded 26354 existing records from primary storage. [2025-10-27T22:11:32.149337] [INFO ] [MAIN ] LCII: Loaded 26354 primary data records. [2025-10-27T22:11:32.150216] [DEBUG] [LOCAL ] LC: Loaded 48250 existing records from primary storage. [2025-10-27T22:11:32.150515] [INFO ] [MAIN ] LC: Loaded 48250 primary data records. [2025-10-27T22:11:32.323167] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-27T22:11:32.351458] [INFO ] [MAIN ] LDI: Loaded 45259 primary data records. [2025-10-27T22:11:33.139087] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:33.138847] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:33.205976] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:33.248730] [INFO ] [MAIN ] LCII: Generated 138 derivative records from 26354 primary records. [2025-10-27T22:11:33.249769] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-27T22:11:33.248477] [INFO ] [MAIN ] LC: Generated 138 derivative records from 48250 primary records. [2025-10-27T22:11:33.252819] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-27T22:11:33.265071] [DEBUG] [LOCAL ] LCII: Derivative data saved (138 records). [2025-10-27T22:11:33.267071] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-27T22:11:33.269815] [INFO ] [MAIN ] Derivative Progress: 1018/1881 symbols completed. LCII took 1.2s. Estimated remaining: 5m 52s. Rate: 147.2 symbols/min [2025-10-27T22:11:33.282314] [DEBUG] [LOCAL ] LC: Derivative data saved (138 records). [2025-10-27T22:11:33.285278] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-27T22:11:33.287408] [INFO ] [MAIN ] Derivative Progress: 1019/1881 symbols completed. LC took 1.3s. Estimated remaining: 5m 51s. Rate: 147.3 symbols/min [2025-10-27T22:11:33.292929] [INFO ] [MAIN ] LDI: Generated 138 derivative records from 45259 primary records. [2025-10-27T22:11:33.293040] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-27T22:11:33.304569] [DEBUG] [LOCAL ] LDI: Derivative data saved (138 records). [2025-10-27T22:11:33.304635] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-27T22:11:33.307984] [INFO ] [MAIN ] Derivative Progress: 1020/1881 symbols completed. LDI took 1.2s. Estimated remaining: 5m 50s. Rate: 147.5 symbols/min [2025-10-27T22:11:33.308448] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:33.308562] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:33.308668] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:33.325055] [DEBUG] [LOCAL ] LDP: Loaded 12250 existing records from primary storage. [2025-10-27T22:11:33.325287] [INFO ] [MAIN ] LDP: Loaded 12250 primary data records. [2025-10-27T22:11:33.542629] [DEBUG] [LOCAL ] LDOS: Loaded 44312 existing records from primary storage. [2025-10-27T22:11:33.673248] [INFO ] [MAIN ] LDOS: Loaded 44312 primary data records. [2025-10-27T22:11:33.720285] [DEBUG] [LOCAL ] LEA: Loaded 40872 existing records from primary storage. [2025-10-27T22:11:33.736476] [INFO ] [MAIN ] LEA: Loaded 40872 primary data records. [2025-10-27T22:11:34.315197] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:34.373973] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:34.405890] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:34.443243] [INFO ] [MAIN ] LDP: Generated 138 derivative records from 12250 primary records. [2025-10-27T22:11:34.443770] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-27T22:11:34.463897] [DEBUG] [LOCAL ] LDP: Derivative data saved (138 records). [2025-10-27T22:11:34.464108] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-27T22:11:34.466255] [INFO ] [MAIN ] Derivative Progress: 1021/1881 symbols completed. LDP took 1.2s. Estimated remaining: 5m 51s. Rate: 147.2 symbols/min [2025-10-27T22:11:34.468815] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:34.479420] [INFO ] [MAIN ] LDOS: Generated 138 derivative records from 44312 primary records. [2025-10-27T22:11:34.480976] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-27T22:11:34.498310] [DEBUG] [LOCAL ] LDOS: Derivative data saved (138 records). [2025-10-27T22:11:34.500836] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-27T22:11:34.501158] [INFO ] [MAIN ] LEA: Generated 138 derivative records from 40872 primary records. [2025-10-27T22:11:34.503558] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-27T22:11:34.503487] [INFO ] [MAIN ] Derivative Progress: 1022/1881 symbols completed. LDOS took 1.2s. Estimated remaining: 5m 50s. Rate: 147.3 symbols/min [2025-10-27T22:11:34.503854] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:34.517975] [DEBUG] [LOCAL ] LEA: Derivative data saved (138 records). [2025-10-27T22:11:34.518227] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-27T22:11:34.521714] [INFO ] [MAIN ] Derivative Progress: 1023/1881 symbols completed. LEA took 1.2s. Estimated remaining: 5m 49s. Rate: 147.5 symbols/min [2025-10-27T22:11:34.522126] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:34.576354] [DEBUG] [LOCAL ] LEG: Loaded 49847 existing records from primary storage. [2025-10-27T22:11:34.582322] [INFO ] [MAIN ] LEG: Loaded 49847 primary data records. [2025-10-27T22:11:34.582691] [DEBUG] [LOCAL ] LEO: Loaded 16427 existing records from primary storage. [2025-10-27T22:11:34.582877] [INFO ] [MAIN ] LEO: Loaded 16427 primary data records. [2025-10-27T22:11:34.795538] [DEBUG] [LOCAL ] LEN: Loaded 53194 existing records from primary storage. [2025-10-27T22:11:34.827607] [INFO ] [MAIN ] LEN: Loaded 53194 primary data records. [2025-10-27T22:11:35.544008] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:35.575769] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:35.663853] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:35.724505] [INFO ] [MAIN ] LEG: Generated 138 derivative records from 49847 primary records. [2025-10-27T22:11:35.726355] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-27T22:11:35.744912] [DEBUG] [LOCAL ] LEG: Derivative data saved (138 records). [2025-10-27T22:11:35.745268] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-27T22:11:35.747843] [INFO ] [MAIN ] Derivative Progress: 1024/1881 symbols completed. LEG took 1.3s. Estimated remaining: 5m 49s. Rate: 147.2 symbols/min [2025-10-27T22:11:35.745522] [INFO ] [MAIN ] LEO: Generated 138 derivative records from 16427 primary records. [2025-10-27T22:11:35.749222] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-27T22:11:35.750699] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:35.762158] [DEBUG] [LOCAL ] LEO: Derivative data saved (138 records). [2025-10-27T22:11:35.762417] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-27T22:11:35.771178] [INFO ] [MAIN ] Derivative Progress: 1025/1881 symbols completed. LEO took 1.2s. Estimated remaining: 5m 49s. Rate: 147.3 symbols/min [2025-10-27T22:11:35.771510] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:35.779765] [INFO ] [MAIN ] LEN: Generated 138 derivative records from 53194 primary records. [2025-10-27T22:11:35.780000] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-27T22:11:35.806482] [DEBUG] [LOCAL ] LEN: Derivative data saved (138 records). [2025-10-27T22:11:35.806600] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-27T22:11:35.809284] [INFO ] [MAIN ] Derivative Progress: 1026/1881 symbols completed. LEN took 1.3s. Estimated remaining: 5m 48s. Rate: 147.4 symbols/min [2025-10-27T22:11:35.809691] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:35.821126] [DEBUG] [LOCAL ] LFT: Loaded 18012 existing records from primary storage. [2025-10-27T22:11:35.821281] [INFO ] [MAIN ] LFT: Loaded 18012 primary data records. [2025-10-27T22:11:35.912461] [DEBUG] [LOCAL ] LGI: Loaded 9859 existing records from primary storage. [2025-10-27T22:11:35.947023] [INFO ] [MAIN ] LGI: Loaded 9859 primary data records. [2025-10-27T22:11:36.069518] [DEBUG] [LOCAL ] LEVI: Loaded 51807 existing records from primary storage. [2025-10-27T22:11:36.252232] [INFO ] [MAIN ] LEVI: Loaded 51807 primary data records. [2025-10-27T22:11:36.815883] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:36.857320] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:36.911433] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:36.968436] [INFO ] [MAIN ] LFT: Generated 138 derivative records from 18012 primary records. [2025-10-27T22:11:36.970208] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-27T22:11:36.986249] [DEBUG] [LOCAL ] LFT: Derivative data saved (138 records). [2025-10-27T22:11:36.990313] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-27T22:11:36.993764] [INFO ] [MAIN ] Derivative Progress: 1027/1881 symbols completed. LFT took 1.2s. Estimated remaining: 5m 48s. Rate: 147.2 symbols/min [2025-10-27T22:11:36.994475] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:37.000081] [INFO ] [MAIN ] LGI: Generated 138 derivative records from 9859 primary records. [2025-10-27T22:11:37.000556] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-27T22:11:37.012882] [INFO ] [MAIN ] LEVI: Generated 138 derivative records from 51807 primary records. [2025-10-27T22:11:37.017776] [DEBUG] [LOCAL ] LGI: Derivative data saved (138 records). [2025-10-27T22:11:37.017946] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-27T22:11:37.018027] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-27T22:11:37.021285] [INFO ] [MAIN ] Derivative Progress: 1028/1881 symbols completed. LGI took 1.2s. Estimated remaining: 5m 47s. Rate: 147.3 symbols/min [2025-10-27T22:11:37.021932] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:37.037363] [DEBUG] [LOCAL ] LEVI: Derivative data saved (138 records). [2025-10-27T22:11:37.037876] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-27T22:11:37.041308] [INFO ] [MAIN ] Derivative Progress: 1029/1881 symbols completed. LEVI took 1.3s. Estimated remaining: 5m 47s. Rate: 147.4 symbols/min [2025-10-27T22:11:37.041964] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:37.081333] [DEBUG] [LOCAL ] LH: Loaded 36776 existing records from primary storage. [2025-10-27T22:11:37.081773] [INFO ] [MAIN ] LH: Loaded 36776 primary data records. [2025-10-27T22:11:37.162691] [DEBUG] [LOCAL ] LII: Loaded 27586 existing records from primary storage. [2025-10-27T22:11:37.186454] [INFO ] [MAIN ] LII: Loaded 27586 primary data records. [2025-10-27T22:11:37.409159] [DEBUG] [LOCAL ] LHX: Loaded 48276 existing records from primary storage. [2025-10-27T22:11:37.420936] [INFO ] [MAIN ] LHX: Loaded 48276 primary data records. [2025-10-27T22:11:38.157512] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:38.190496] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:38.229153] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:38.303084] [INFO ] [MAIN ] LII: Generated 138 derivative records from 27586 primary records. [2025-10-27T22:11:38.300967] [INFO ] [MAIN ] LH: Generated 138 derivative records from 36776 primary records. [2025-10-27T22:11:38.303377] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-27T22:11:38.303632] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-27T22:11:38.327734] [DEBUG] [LOCAL ] LH: Derivative data saved (138 records). [2025-10-27T22:11:38.331790] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-27T22:11:38.332335] [INFO ] [MAIN ] LHX: Generated 138 derivative records from 48276 primary records. [2025-10-27T22:11:38.334635] [INFO ] [MAIN ] Derivative Progress: 1030/1881 symbols completed. LH took 1.3s. Estimated remaining: 5m 47s. Rate: 147.1 symbols/min [2025-10-27T22:11:38.334874] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:38.334991] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-27T22:11:38.338080] [DEBUG] [LOCAL ] LII: Derivative data saved (138 records). [2025-10-27T22:11:38.338439] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-27T22:11:38.341407] [INFO ] [MAIN ] Derivative Progress: 1031/1881 symbols completed. LII took 1.3s. Estimated remaining: 5m 46s. Rate: 147.3 symbols/min [2025-10-27T22:11:38.341678] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:38.355531] [DEBUG] [LOCAL ] LHX: Derivative data saved (138 records). [2025-10-27T22:11:38.357061] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-27T22:11:38.360186] [INFO ] [MAIN ] Derivative Progress: 1032/1881 symbols completed. LHX took 1.3s. Estimated remaining: 5m 46s. Rate: 147.4 symbols/min [2025-10-27T22:11:38.360490] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:38.364237] [DEBUG] [LOCAL ] LITB: Loaded 3695 existing records from primary storage. [2025-10-27T22:11:38.364390] [INFO ] [MAIN ] LITB: Loaded 3695 primary data records. [2025-10-27T22:11:38.763992] [DEBUG] [LOCAL ] LION: Loaded 47270 existing records from primary storage. [2025-10-27T22:11:38.764823] [INFO ] [MAIN ] LION: Loaded 47270 primary data records. [2025-10-27T22:11:38.887508] [DEBUG] [LOCAL ] LLY: Loaded 53169 existing records from primary storage. [2025-10-27T22:11:38.888017] [INFO ] [MAIN ] LLY: Loaded 53169 primary data records. [2025-10-27T22:11:39.301958] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:39.502231] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:39.519234] [INFO ] [MAIN ] LITB: Generated 138 derivative records from 3695 primary records. [2025-10-27T22:11:39.522280] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-27T22:11:39.551092] [DEBUG] [LOCAL ] LITB: Derivative data saved (138 records). [2025-10-27T22:11:39.551684] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-27T22:11:39.553891] [INFO ] [MAIN ] Derivative Progress: 1033/1881 symbols completed. LITB took 1.2s. Estimated remaining: 5m 46s. Rate: 147.1 symbols/min [2025-10-27T22:11:39.551537] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:39.602995] [INFO ] [MAIN ] LION: Generated 138 derivative records from 47270 primary records. [2025-10-27T22:11:39.604596] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-27T22:11:39.620324] [DEBUG] [LOCAL ] LION: Derivative data saved (138 records). [2025-10-27T22:11:39.620497] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-27T22:11:39.623037] [INFO ] [MAIN ] Derivative Progress: 1034/1881 symbols completed. LION took 1.3s. Estimated remaining: 5m 45s. Rate: 147.3 symbols/min [2025-10-27T22:11:39.626442] [INFO ] [MAIN ] LLY: Generated 138 derivative records from 53169 primary records. [2025-10-27T22:11:39.626513] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-27T22:11:39.639726] [DEBUG] [LOCAL ] LLY: Derivative data saved (138 records). [2025-10-27T22:11:39.639813] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-27T22:11:39.642836] [INFO ] [MAIN ] Derivative Progress: 1035/1881 symbols completed. LLY took 1.3s. Estimated remaining: 5m 44s. Rate: 147.4 symbols/min [2025-10-27T22:11:39.643412] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:39.643345] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:39.643265] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:39.650963] [DEBUG] [LOCAL ] LND: Loaded 4869 existing records from primary storage. [2025-10-27T22:11:39.651267] [INFO ] [MAIN ] LND: Loaded 4869 primary data records. [2025-10-27T22:11:40.008204] [DEBUG] [LOCAL ] LMT: Loaded 49543 existing records from primary storage. [2025-10-27T22:11:40.022933] [INFO ] [MAIN ] LMT: Loaded 49543 primary data records. [2025-10-27T22:11:40.023706] [DEBUG] [LOCAL ] LNC: Loaded 51328 existing records from primary storage. [2025-10-27T22:11:40.023920] [INFO ] [MAIN ] LNC: Loaded 51328 primary data records. [2025-10-27T22:11:40.681234] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:40.736143] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:40.761309] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:40.777424] [INFO ] [MAIN ] LND: Generated 138 derivative records from 4869 primary records. [2025-10-27T22:11:40.777785] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-27T22:11:40.797200] [DEBUG] [LOCAL ] LND: Derivative data saved (138 records). [2025-10-27T22:11:40.801353] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-27T22:11:40.803891] [INFO ] [MAIN ] Derivative Progress: 1036/1881 symbols completed. LND took 1.2s. Estimated remaining: 5m 45s. Rate: 147.1 symbols/min [2025-10-27T22:11:40.804036] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:40.831162] [INFO ] [MAIN ] LMT: Generated 138 derivative records from 49543 primary records. [2025-10-27T22:11:40.832088] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-27T22:11:40.843816] [INFO ] [MAIN ] LNC: Generated 138 derivative records from 51328 primary records. [2025-10-27T22:11:40.846540] [DEBUG] [LOCAL ] LMT: Derivative data saved (138 records). [2025-10-27T22:11:40.846729] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-27T22:11:40.846816] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-27T22:11:40.848960] [INFO ] [MAIN ] Derivative Progress: 1037/1881 symbols completed. LMT took 1.2s. Estimated remaining: 5m 44s. Rate: 147.3 symbols/min [2025-10-27T22:11:40.849563] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:40.877732] [DEBUG] [LOCAL ] LNC: Derivative data saved (138 records). [2025-10-27T22:11:40.878028] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-27T22:11:40.880407] [INFO ] [MAIN ] Derivative Progress: 1038/1881 symbols completed. LNC took 1.2s. Estimated remaining: 5m 43s. Rate: 147.4 symbols/min [2025-10-27T22:11:40.882931] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:40.889430] [DEBUG] [LOCAL ] LNN: Loaded 11526 existing records from primary storage. [2025-10-27T22:11:40.889547] [INFO ] [MAIN ] LNN: Loaded 11526 primary data records. [2025-10-27T22:11:41.015859] [DEBUG] [LOCAL ] LNG: Loaded 50980 existing records from primary storage. [2025-10-27T22:11:41.016447] [INFO ] [MAIN ] LNG: Loaded 50980 primary data records. [2025-10-27T22:11:41.347507] [DEBUG] [LOCAL ] LOAR: Loaded 41789 existing records from primary storage. [2025-10-27T22:11:41.351755] [INFO ] [MAIN ] LOAR: Loaded 41789 primary data records. [2025-10-27T22:11:41.873839] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:41.908192] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:41.952795] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:41.986095] [INFO ] [MAIN ] LNN: Generated 138 derivative records from 11526 primary records. [2025-10-27T22:11:41.989115] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-27T22:11:42.006900] [DEBUG] [LOCAL ] LNN: Derivative data saved (138 records). [2025-10-27T22:11:42.007281] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-27T22:11:42.011989] [INFO ] [MAIN ] Derivative Progress: 1039/1881 symbols completed. LNN took 1.2s. Estimated remaining: 5m 43s. Rate: 147.1 symbols/min [2025-10-27T22:11:42.014830] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:42.023910] [INFO ] [MAIN ] LNG: Generated 138 derivative records from 50980 primary records. [2025-10-27T22:11:42.024115] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-27T22:11:42.047312] [DEBUG] [LOCAL ] LNG: Derivative data saved (138 records). [2025-10-27T22:11:42.047450] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-27T22:11:42.051449] [INFO ] [MAIN ] Derivative Progress: 1040/1881 symbols completed. LNG took 1.2s. Estimated remaining: 5m 43s. Rate: 147.3 symbols/min [2025-10-27T22:11:42.051843] [INFO ] [MAIN ] LOAR: Generated 138 derivative records from 41789 primary records. [2025-10-27T22:11:42.051957] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:42.052085] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-27T22:11:42.074098] [DEBUG] [LOCAL ] LOAR: Derivative data saved (138 records). [2025-10-27T22:11:42.074238] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-27T22:11:42.070693] [DEBUG] [LOCAL ] LOB: Loaded 26452 existing records from primary storage. [2025-10-27T22:11:42.077107] [INFO ] [MAIN ] Derivative Progress: 1041/1881 symbols completed. LOAR took 1.2s. Estimated remaining: 5m 42s. Rate: 147.4 symbols/min [2025-10-27T22:11:42.077448] [INFO ] [MAIN ] LOB: Loaded 26452 primary data records. [2025-10-27T22:11:42.077302] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:42.085599] [DEBUG] [LOCAL ] LOCL: Loaded 3246 existing records from primary storage. [2025-10-27T22:11:42.101693] [INFO ] [MAIN ] LOCL: Loaded 3246 primary data records. [2025-10-27T22:11:42.711451] [DEBUG] [LOCAL ] LOMA: Loaded 32945 existing records from primary storage. [2025-10-27T22:11:42.712466] [INFO ] [MAIN ] LOMA: Loaded 32945 primary data records. [2025-10-27T22:11:43.040769] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:43.066023] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:43.111050] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:43.165188] [INFO ] [MAIN ] LOCL: Generated 138 derivative records from 3246 primary records. [2025-10-27T22:11:43.168548] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-27T22:11:43.184771] [INFO ] [MAIN ] LOB: Generated 138 derivative records from 26452 primary records. [2025-10-27T22:11:43.184968] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-27T22:11:43.187344] [DEBUG] [LOCAL ] LOCL: Derivative data saved (138 records). [2025-10-27T22:11:43.198968] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-27T22:11:43.200013] [DEBUG] [LOCAL ] LOB: Derivative data saved (138 records). [2025-10-27T22:11:43.202353] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-27T22:11:43.202270] [INFO ] [MAIN ] Derivative Progress: 1042/1881 symbols completed. LOCL took 1.2s. Estimated remaining: 5m 42s. Rate: 147.1 symbols/min [2025-10-27T22:11:43.204855] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:43.205033] [INFO ] [MAIN ] Derivative Progress: 1043/1881 symbols completed. LOB took 1.2s. Estimated remaining: 5m 41s. Rate: 147.3 symbols/min [2025-10-27T22:11:43.206583] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:43.208903] [INFO ] [MAIN ] LOMA: Generated 138 derivative records from 32945 primary records. [2025-10-27T22:11:43.209129] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-27T22:11:43.221391] [DEBUG] [LOCAL ] LOMA: Derivative data saved (138 records). [2025-10-27T22:11:43.221605] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-27T22:11:43.224146] [INFO ] [MAIN ] Derivative Progress: 1044/1881 symbols completed. LOMA took 1.1s. Estimated remaining: 5m 41s. Rate: 147.4 symbols/min [2025-10-27T22:11:43.224469] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:43.273138] [DEBUG] [LOCAL ] LPG: Loaded 38804 existing records from primary storage. [2025-10-27T22:11:43.281975] [INFO ] [MAIN ] LPG: Loaded 38804 primary data records. [2025-10-27T22:11:43.282558] [DEBUG] [LOCAL ] LPL: Loaded 29165 existing records from primary storage. [2025-10-27T22:11:43.288461] [INFO ] [MAIN ] LPL: Loaded 29165 primary data records. [2025-10-27T22:11:43.463003] [DEBUG] [LOCAL ] LOW: Loaded 52939 existing records from primary storage. [2025-10-27T22:11:43.478989] [INFO ] [MAIN ] LOW: Loaded 52939 primary data records. [2025-10-27T22:11:44.263511] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:44.292695] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:44.329221] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:44.390077] [INFO ] [MAIN ] LPG: Generated 138 derivative records from 38804 primary records. [2025-10-27T22:11:44.392358] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-27T22:11:44.392279] [INFO ] [MAIN ] LPL: Generated 138 derivative records from 29165 primary records. [2025-10-27T22:11:44.395433] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-27T22:11:44.415198] [DEBUG] [LOCAL ] LPG: Derivative data saved (138 records). [2025-10-27T22:11:44.417706] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-27T22:11:44.421352] [INFO ] [MAIN ] Derivative Progress: 1045/1881 symbols completed. LPG took 1.2s. Estimated remaining: 5m 41s. Rate: 147.1 symbols/min [2025-10-27T22:11:44.419320] [DEBUG] [LOCAL ] LPL: Derivative data saved (138 records). [2025-10-27T22:11:44.421542] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:44.421637] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-27T22:11:44.424093] [INFO ] [MAIN ] Derivative Progress: 1046/1881 symbols completed. LPL took 1.2s. Estimated remaining: 5m 40s. Rate: 147.3 symbols/min [2025-10-27T22:11:44.425259] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:44.432245] [INFO ] [MAIN ] LOW: Generated 138 derivative records from 52939 primary records. [2025-10-27T22:11:44.432535] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-27T22:11:44.444956] [DEBUG] [LOCAL ] LOW: Derivative data saved (138 records). [2025-10-27T22:11:44.445166] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-27T22:11:44.447780] [INFO ] [MAIN ] Derivative Progress: 1047/1881 symbols completed. LOW took 1.2s. Estimated remaining: 5m 39s. Rate: 147.4 symbols/min [2025-10-27T22:11:44.448031] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:44.505522] [DEBUG] [LOCAL ] LPX: Loaded 39955 existing records from primary storage. [2025-10-27T22:11:44.506675] [INFO ] [MAIN ] LPX: Loaded 39955 primary data records. [2025-10-27T22:11:44.539032] [DEBUG] [LOCAL ] LRN: Loaded 39074 existing records from primary storage. [2025-10-27T22:11:44.602689] [DEBUG] [LOCAL ] LSPD: Loaded 42066 existing records from primary storage. [2025-10-27T22:11:44.614600] [INFO ] [MAIN ] LSPD: Loaded 42066 primary data records. [2025-10-27T22:11:44.614691] [INFO ] [MAIN ] LRN: Loaded 39074 primary data records. [2025-10-27T22:11:45.453441] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:45.480416] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:45.518867] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:45.568473] [INFO ] [MAIN ] LPX: Generated 138 derivative records from 39955 primary records. [2025-10-27T22:11:45.571218] [INFO ] [MAIN ] LSPD: Generated 138 derivative records from 42066 primary records. [2025-10-27T22:11:45.569312] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-27T22:11:45.572117] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-27T22:11:45.586935] [DEBUG] [LOCAL ] LPX: Derivative data saved (138 records). [2025-10-27T22:11:45.595727] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-27T22:11:45.598468] [DEBUG] [LOCAL ] LSPD: Derivative data saved (138 records). [2025-10-27T22:11:45.601322] [INFO ] [MAIN ] Derivative Progress: 1048/1881 symbols completed. LPX took 1.2s. Estimated remaining: 5m 40s. Rate: 147.2 symbols/min [2025-10-27T22:11:45.601864] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-27T22:11:45.605221] [INFO ] [MAIN ] Derivative Progress: 1049/1881 symbols completed. LSPD took 1.2s. Estimated remaining: 5m 39s. Rate: 147.3 symbols/min [2025-10-27T22:11:45.612788] [INFO ] [MAIN ] LRN: Generated 138 derivative records from 39074 primary records. [2025-10-27T22:11:45.612870] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-27T22:11:45.624482] [DEBUG] [LOCAL ] LRN: Derivative data saved (138 records). [2025-10-27T22:11:45.624536] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-27T22:11:45.626914] [INFO ] [MAIN ] Derivative Progress: 1050/1881 symbols completed. LRN took 1.2s. Estimated remaining: 5m 38s. Rate: 147.4 symbols/min [2025-10-27T22:11:45.627293] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:45.627390] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:45.627477] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:45.664532] [DEBUG] [LOCAL ] LTC: Loaded 30481 existing records from primary storage. [2025-10-27T22:11:45.678100] [INFO ] [MAIN ] LTC: Loaded 30481 primary data records. [2025-10-27T22:11:45.757904] [DEBUG] [LOCAL ] LTM: Loaded 39414 existing records from primary storage. [2025-10-27T22:11:45.790665] [INFO ] [MAIN ] LTM: Loaded 39414 primary data records. [2025-10-27T22:11:45.837041] [DEBUG] [LOCAL ] LTH: Loaded 51546 existing records from primary storage. [2025-10-27T22:11:45.864985] [INFO ] [MAIN ] LTH: Loaded 51546 primary data records. [2025-10-27T22:11:46.668223] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:46.704136] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:46.730542] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:46.789908] [INFO ] [MAIN ] LTC: Generated 138 derivative records from 30481 primary records. [2025-10-27T22:11:46.790281] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-27T22:11:46.795368] [INFO ] [MAIN ] LTM: Generated 138 derivative records from 39414 primary records. [2025-10-27T22:11:46.795462] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-27T22:11:46.819742] [DEBUG] [LOCAL ] LTM: Derivative data saved (138 records). [2025-10-27T22:11:46.819908] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-27T22:11:46.819960] [DEBUG] [LOCAL ] LTC: Derivative data saved (138 records). [2025-10-27T22:11:46.822332] [INFO ] [MAIN ] Derivative Progress: 1051/1881 symbols completed. LTM took 1.2s. Estimated remaining: 5m 38s. Rate: 147.2 symbols/min [2025-10-27T22:11:46.822848] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:46.823365] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-27T22:11:46.828499] [INFO ] [MAIN ] LTH: Generated 138 derivative records from 51546 primary records. [2025-10-27T22:11:46.825728] [INFO ] [MAIN ] Derivative Progress: 1052/1881 symbols completed. LTC took 1.2s. Estimated remaining: 5m 38s. Rate: 147.3 symbols/min [2025-10-27T22:11:46.828850] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-27T22:11:46.828783] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:46.841957] [DEBUG] [LOCAL ] LTH: Derivative data saved (138 records). [2025-10-27T22:11:46.842565] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-27T22:11:46.845389] [INFO ] [MAIN ] Derivative Progress: 1053/1881 symbols completed. LTH took 1.2s. Estimated remaining: 5m 37s. Rate: 147.4 symbols/min [2025-10-27T22:11:46.846494] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:46.872963] [DEBUG] [LOCAL ] LUCK: Loaded 23228 existing records from primary storage. [2025-10-27T22:11:46.873148] [INFO ] [MAIN ] LUCK: Loaded 23228 primary data records. [2025-10-27T22:11:46.988756] [DEBUG] [LOCAL ] LU: Loaded 49197 existing records from primary storage. [2025-10-27T22:11:47.007469] [INFO ] [MAIN ] LU: Loaded 49197 primary data records. [2025-10-27T22:11:47.318675] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-27T22:11:47.329691] [INFO ] [MAIN ] LUMN: Loaded 53646 primary data records. [2025-10-27T22:11:47.833529] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:47.873268] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:47.912680] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:47.954092] [INFO ] [MAIN ] LUCK: Generated 138 derivative records from 23228 primary records. [2025-10-27T22:11:47.956812] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-27T22:11:47.975571] [DEBUG] [LOCAL ] LUCK: Derivative data saved (138 records). [2025-10-27T22:11:47.975828] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-27T22:11:47.977950] [INFO ] [MAIN ] Derivative Progress: 1054/1881 symbols completed. LUCK took 1.1s. Estimated remaining: 5m 37s. Rate: 147.2 symbols/min [2025-10-27T22:11:47.978281] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:47.992841] [INFO ] [MAIN ] LU: Generated 138 derivative records from 49197 primary records. [2025-10-27T22:11:47.994610] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-27T22:11:48.008110] [INFO ] [MAIN ] LUMN: Generated 138 derivative records from 53646 primary records. [2025-10-27T22:11:48.011186] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-27T22:11:48.011086] [DEBUG] [LOCAL ] LU: Derivative data saved (138 records). [2025-10-27T22:11:48.012124] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-27T22:11:48.023277] [DEBUG] [LOCAL ] LUMN: Derivative data saved (138 records). [2025-10-27T22:11:48.023366] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-27T22:11:48.025840] [INFO ] [MAIN ] Derivative Progress: 1055/1881 symbols completed. LU took 1.2s. Estimated remaining: 5m 36s. Rate: 147.3 symbols/min [2025-10-27T22:11:48.041813] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:48.041978] [INFO ] [MAIN ] Derivative Progress: 1056/1881 symbols completed. LUMN took 1.2s. Estimated remaining: 5m 36s. Rate: 147.4 symbols/min [2025-10-27T22:11:48.042850] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:48.067537] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-27T22:11:48.067864] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-27T22:11:48.137141] [DEBUG] [LOCAL ] LVWR: Loaded 18668 existing records from primary storage. [2025-10-27T22:11:48.148721] [INFO ] [MAIN ] LVWR: Loaded 18668 primary data records. [2025-10-27T22:11:48.576328] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-27T22:11:48.594318] [INFO ] [MAIN ] LVS: Loaded 53569 primary data records. [2025-10-27T22:11:49.053091] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:49.065896] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:49.134616] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:49.176827] [INFO ] [MAIN ] LVWR: Generated 138 derivative records from 18668 primary records. [2025-10-27T22:11:49.179629] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-27T22:11:49.182321] [INFO ] [MAIN ] LUV: Generated 138 derivative records from 53689 primary records. [2025-10-27T22:11:49.195567] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-27T22:11:49.196067] [DEBUG] [LOCAL ] LVWR: Derivative data saved (138 records). [2025-10-27T22:11:49.205849] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-27T22:11:49.209990] [INFO ] [MAIN ] Derivative Progress: 1057/1881 symbols completed. LVWR took 1.2s. Estimated remaining: 5m 36s. Rate: 147.2 symbols/min [2025-10-27T22:11:49.212770] [DEBUG] [LOCAL ] LUV: Derivative data saved (138 records). [2025-10-27T22:11:49.213454] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-27T22:11:49.215932] [INFO ] [MAIN ] Derivative Progress: 1058/1881 symbols completed. LUV took 1.2s. Estimated remaining: 5m 35s. Rate: 147.3 symbols/min [2025-10-27T22:11:49.216104] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:49.213350] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:49.225638] [INFO ] [MAIN ] LVS: Generated 138 derivative records from 53569 primary records. [2025-10-27T22:11:49.225856] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-27T22:11:49.248294] [DEBUG] [LOCAL ] LVS: Derivative data saved (138 records). [2025-10-27T22:11:49.248751] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-27T22:11:49.249082] [DEBUG] [LOCAL ] LXFR: Loaded 16176 existing records from primary storage. [2025-10-27T22:11:49.251631] [INFO ] [MAIN ] Derivative Progress: 1059/1881 symbols completed. LVS took 1.2s. Estimated remaining: 5m 35s. Rate: 147.4 symbols/min [2025-10-27T22:11:49.251799] [INFO ] [MAIN ] LXFR: Loaded 16176 primary data records. [2025-10-27T22:11:49.251907] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:49.580308] [DEBUG] [LOCAL ] LW: Loaded 51116 existing records from primary storage. [2025-10-27T22:11:49.580709] [INFO ] [MAIN ] LW: Loaded 51116 primary data records. [2025-10-27T22:11:49.708072] [DEBUG] [LOCAL ] LXP: Loaded 50671 existing records from primary storage. [2025-10-27T22:11:49.714113] [INFO ] [MAIN ] LXP: Loaded 50671 primary data records. [2025-10-27T22:11:50.228498] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:50.332200] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:50.366571] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:50.370833] [INFO ] [MAIN ] LXFR: Generated 138 derivative records from 16176 primary records. [2025-10-27T22:11:50.381879] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-27T22:11:50.401580] [DEBUG] [LOCAL ] LXFR: Derivative data saved (138 records). [2025-10-27T22:11:50.402182] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-27T22:11:50.405855] [INFO ] [MAIN ] Derivative Progress: 1060/1881 symbols completed. LXFR took 1.2s. Estimated remaining: 5m 35s. Rate: 147.2 symbols/min [2025-10-27T22:11:50.406037] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:50.457395] [INFO ] [MAIN ] LW: Generated 138 derivative records from 51116 primary records. [2025-10-27T22:11:50.459539] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-27T22:11:50.458119] [DEBUG] [LOCAL ] LXU: Loaded 31131 existing records from primary storage. [2025-10-27T22:11:50.460970] [INFO ] [MAIN ] LXU: Loaded 31131 primary data records. [2025-10-27T22:11:50.474957] [DEBUG] [LOCAL ] LW: Derivative data saved (138 records). [2025-10-27T22:11:50.486563] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-27T22:11:50.498242] [INFO ] [MAIN ] Derivative Progress: 1061/1881 symbols completed. LW took 1.3s. Estimated remaining: 5m 34s. Rate: 147.3 symbols/min [2025-10-27T22:11:50.532914] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:50.595705] [INFO ] [MAIN ] LXP: Generated 138 derivative records from 50671 primary records. [2025-10-27T22:11:50.607039] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-27T22:11:50.660482] [DEBUG] [LOCAL ] LXP: Derivative data saved (138 records). [2025-10-27T22:11:50.686524] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-27T22:11:50.709726] [INFO ] [MAIN ] Derivative Progress: 1062/1881 symbols completed. LXP took 1.5s. Estimated remaining: 5m 33s. Rate: 147.4 symbols/min [2025-10-27T22:11:50.811842] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:50.852705] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-27T22:11:50.853167] [INFO ] [MAIN ] LYB: Loaded 53621 primary data records. [2025-10-27T22:11:51.003276] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:51.208966] [DEBUG] [LOCAL ] LYG: Loaded 52640 existing records from primary storage. [2025-10-27T22:11:51.210500] [INFO ] [MAIN ] LYG: Loaded 52640 primary data records. [2025-10-27T22:11:51.549867] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:51.571149] [INFO ] [MAIN ] LXU: Generated 138 derivative records from 31131 primary records. [2025-10-27T22:11:51.571451] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-27T22:11:51.590460] [DEBUG] [LOCAL ] LXU: Derivative data saved (138 records). [2025-10-27T22:11:51.591103] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-27T22:11:51.593517] [INFO ] [MAIN ] Derivative Progress: 1063/1881 symbols completed. LXU took 1.2s. Estimated remaining: 5m 33s. Rate: 147.2 symbols/min [2025-10-27T22:11:51.613486] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:51.649159] [INFO ] [MAIN ] LYB: Generated 138 derivative records from 53621 primary records. [2025-10-27T22:11:51.649559] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-27T22:11:51.666023] [DEBUG] [LOCAL ] LYB: Derivative data saved (138 records). [2025-10-27T22:11:51.667493] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-27T22:11:51.667619] [INFO ] [MAIN ] LYG: Generated 138 derivative records from 52640 primary records. [2025-10-27T22:11:51.670091] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-27T22:11:51.670012] [INFO ] [MAIN ] Derivative Progress: 1064/1881 symbols completed. LYB took 1.1s. Estimated remaining: 5m 33s. Rate: 147.3 symbols/min [2025-10-27T22:11:51.681430] [DEBUG] [LOCAL ] LYG: Derivative data saved (138 records). [2025-10-27T22:11:51.681492] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-27T22:11:51.683878] [INFO ] [MAIN ] Derivative Progress: 1065/1881 symbols completed. LYG took 0.9s. Estimated remaining: 5m 32s. Rate: 147.4 symbols/min [2025-10-27T22:11:51.684356] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:51.684300] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:51.684503] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:51.701684] [DEBUG] [LOCAL ] LZM: Loaded 14897 existing records from primary storage. [2025-10-27T22:11:51.710541] [INFO ] [MAIN ] LZM: Loaded 14897 primary data records. [2025-10-27T22:11:51.832574] [DEBUG] [LOCAL ] LZB: Loaded 34783 existing records from primary storage. [2025-10-27T22:11:51.844979] [INFO ] [MAIN ] LZB: Loaded 34783 primary data records. [2025-10-27T22:11:52.036038] [DEBUG] [LOCAL ] LYV: Loaded 50904 existing records from primary storage. [2025-10-27T22:11:52.164406] [INFO ] [MAIN ] LYV: Loaded 50904 primary data records. [2025-10-27T22:11:52.724043] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:52.760965] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:52.811854] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:52.826488] [INFO ] [MAIN ] LZM: Generated 138 derivative records from 14897 primary records. [2025-10-27T22:11:52.832252] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-27T22:11:52.849026] [DEBUG] [LOCAL ] LZM: Derivative data saved (138 records). [2025-10-27T22:11:52.849581] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-27T22:11:52.851854] [INFO ] [MAIN ] Derivative Progress: 1066/1881 symbols completed. LZM took 1.2s. Estimated remaining: 5m 32s. Rate: 147.2 symbols/min [2025-10-27T22:11:52.854510] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:52.861941] [INFO ] [MAIN ] LZB: Generated 138 derivative records from 34783 primary records. [2025-10-27T22:11:52.862526] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-27T22:11:52.878082] [DEBUG] [LOCAL ] LZB: Derivative data saved (138 records). [2025-10-27T22:11:52.879672] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-27T22:11:52.883481] [INFO ] [MAIN ] Derivative Progress: 1067/1881 symbols completed. LZB took 1.2s. Estimated remaining: 5m 32s. Rate: 147.3 symbols/min [2025-10-27T22:11:52.887279] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:52.891378] [INFO ] [MAIN ] LYV: Generated 138 derivative records from 50904 primary records. [2025-10-27T22:11:52.891537] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-27T22:11:52.916975] [DEBUG] [LOCAL ] LYV: Derivative data saved (138 records). [2025-10-27T22:11:52.917094] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-27T22:11:52.919615] [INFO ] [MAIN ] Derivative Progress: 1068/1881 symbols completed. LYV took 1.2s. Estimated remaining: 5m 31s. Rate: 147.4 symbols/min [2025-10-27T22:11:52.919909] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:52.954124] [DEBUG] [LOCAL ] M: Loaded 53543 existing records from primary storage. [2025-10-27T22:11:52.954339] [INFO ] [MAIN ] M: Loaded 53543 primary data records. [2025-10-27T22:11:53.096419] [DEBUG] [LOCAL ] MA: Loaded 52417 existing records from primary storage. [2025-10-27T22:11:53.106878] [INFO ] [MAIN ] MA: Loaded 52417 primary data records. [2025-10-27T22:11:53.112832] [DEBUG] [LOCAL ] MAA: Loaded 42844 existing records from primary storage. [2025-10-27T22:11:53.112936] [INFO ] [MAIN ] MAA: Loaded 42844 primary data records. [2025-10-27T22:11:53.884915] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:53.930317] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:53.954435] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:54.009247] [INFO ] [MAIN ] M: Generated 138 derivative records from 53543 primary records. [2025-10-27T22:11:54.011862] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-27T22:11:54.031809] [DEBUG] [LOCAL ] M: Derivative data saved (138 records). [2025-10-27T22:11:54.036499] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-27T22:11:54.039143] [INFO ] [MAIN ] Derivative Progress: 1069/1881 symbols completed. M took 1.2s. Estimated remaining: 5m 31s. Rate: 147.2 symbols/min [2025-10-27T22:11:54.039795] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:54.044115] [INFO ] [MAIN ] MAA: Generated 138 derivative records from 42844 primary records. [2025-10-27T22:11:54.044350] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-27T22:11:54.047253] [INFO ] [MAIN ] MA: Generated 138 derivative records from 52417 primary records. [2025-10-27T22:11:54.055122] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-27T22:11:54.060115] [DEBUG] [LOCAL ] MAA: Derivative data saved (138 records). [2025-10-27T22:11:54.060500] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-27T22:11:54.062895] [INFO ] [MAIN ] Derivative Progress: 1070/1881 symbols completed. MAA took 1.1s. Estimated remaining: 5m 30s. Rate: 147.3 symbols/min [2025-10-27T22:11:54.063140] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:54.075503] [DEBUG] [LOCAL ] MA: Derivative data saved (138 records). [2025-10-27T22:11:54.075724] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-27T22:11:54.077875] [INFO ] [MAIN ] Derivative Progress: 1071/1881 symbols completed. MA took 1.2s. Estimated remaining: 5m 30s. Rate: 147.5 symbols/min [2025-10-27T22:11:54.078106] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:54.125185] [DEBUG] [LOCAL ] MAGN: Loaded 35837 existing records from primary storage. [2025-10-27T22:11:54.125339] [INFO ] [MAIN ] MAGN: Loaded 35837 primary data records. [2025-10-27T22:11:54.185199] [DEBUG] [LOCAL ] MAIN: Loaded 41726 existing records from primary storage. [2025-10-27T22:11:54.219072] [INFO ] [MAIN ] MAIN: Loaded 41726 primary data records. [2025-10-27T22:11:54.231425] [DEBUG] [LOCAL ] MAC: Loaded 49449 existing records from primary storage. [2025-10-27T22:11:54.296795] [INFO ] [MAIN ] MAC: Loaded 49449 primary data records. [2025-10-27T22:11:55.164175] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:55.190871] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:55.234808] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:55.281812] [INFO ] [MAIN ] MAGN: Generated 138 derivative records from 35837 primary records. [2025-10-27T22:11:55.285950] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-27T22:11:55.296700] [INFO ] [MAIN ] MAIN: Generated 138 derivative records from 41726 primary records. [2025-10-27T22:11:55.301170] [DEBUG] [LOCAL ] MAGN: Derivative data saved (138 records). [2025-10-27T22:11:55.301400] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-27T22:11:55.301524] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-27T22:11:55.306097] [INFO ] [MAIN ] Derivative Progress: 1072/1881 symbols completed. MAGN took 1.2s. Estimated remaining: 5m 30s. Rate: 147.2 symbols/min [2025-10-27T22:11:55.306244] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:55.319824] [DEBUG] [LOCAL ] MAIN: Derivative data saved (138 records). [2025-10-27T22:11:55.321757] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-27T22:11:55.324487] [INFO ] [MAIN ] MAC: Generated 138 derivative records from 49449 primary records. [2025-10-27T22:11:55.324282] [INFO ] [MAIN ] Derivative Progress: 1073/1881 symbols completed. MAIN took 1.2s. Estimated remaining: 5m 29s. Rate: 147.3 symbols/min [2025-10-27T22:11:55.324661] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-27T22:11:55.324739] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:55.337610] [DEBUG] [LOCAL ] MAC: Derivative data saved (138 records). [2025-10-27T22:11:55.337729] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-27T22:11:55.340380] [INFO ] [MAIN ] Derivative Progress: 1074/1881 symbols completed. MAC took 1.3s. Estimated remaining: 5m 28s. Rate: 147.4 symbols/min [2025-10-27T22:11:55.340701] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:55.385538] [DEBUG] [LOCAL ] MANU: Loaded 26885 existing records from primary storage. [2025-10-27T22:11:55.386395] [DEBUG] [LOCAL ] MAN: Loaded 44314 existing records from primary storage. [2025-10-27T22:11:55.386539] [INFO ] [MAIN ] MANU: Loaded 26885 primary data records. [2025-10-27T22:11:55.386744] [INFO ] [MAIN ] MAN: Loaded 44314 primary data records. [2025-10-27T22:11:55.775202] [DEBUG] [LOCAL ] MAS: Loaded 52162 existing records from primary storage. [2025-10-27T22:11:55.775449] [INFO ] [MAIN ] MAS: Loaded 52162 primary data records. [2025-10-27T22:11:56.333191] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:56.364555] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:56.401057] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:56.451683] [INFO ] [MAIN ] MAN: Generated 138 derivative records from 44314 primary records. [2025-10-27T22:11:56.456841] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-27T22:11:56.471777] [DEBUG] [LOCAL ] MAN: Derivative data saved (138 records). [2025-10-27T22:11:56.473495] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-27T22:11:56.473859] [INFO ] [MAIN ] MANU: Generated 138 derivative records from 26885 primary records. [2025-10-27T22:11:56.478121] [INFO ] [MAIN ] Derivative Progress: 1075/1881 symbols completed. MAN took 1.2s. Estimated remaining: 5m 29s. Rate: 147.2 symbols/min [2025-10-27T22:11:56.478344] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-27T22:11:56.478762] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:56.482888] [INFO ] [MAIN ] MAS: Generated 138 derivative records from 52162 primary records. [2025-10-27T22:11:56.494439] [DEBUG] [LOCAL ] MANU: Derivative data saved (138 records). [2025-10-27T22:11:56.491750] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-27T22:11:56.494862] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-27T22:11:56.497756] [INFO ] [MAIN ] Derivative Progress: 1076/1881 symbols completed. MANU took 1.2s. Estimated remaining: 5m 28s. Rate: 147.3 symbols/min [2025-10-27T22:11:56.505040] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:56.509772] [DEBUG] [LOCAL ] MAS: Derivative data saved (138 records). [2025-10-27T22:11:56.510067] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-27T22:11:56.513229] [INFO ] [MAIN ] Derivative Progress: 1077/1881 symbols completed. MAS took 1.2s. Estimated remaining: 5m 27s. Rate: 147.5 symbols/min [2025-10-27T22:11:56.513496] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:56.551084] [DEBUG] [LOCAL ] MATV: Loaded 34605 existing records from primary storage. [2025-10-27T22:11:56.551239] [INFO ] [MAIN ] MATV: Loaded 34605 primary data records. [2025-10-27T22:11:56.654695] [DEBUG] [LOCAL ] MATX: Loaded 31546 existing records from primary storage. [2025-10-27T22:11:56.671012] [INFO ] [MAIN ] MATX: Loaded 31546 primary data records. [2025-10-27T22:11:56.667804] [DEBUG] [LOCAL ] MAX: Loaded 30512 existing records from primary storage. [2025-10-27T22:11:56.671607] [INFO ] [MAIN ] MAX: Loaded 30512 primary data records. [2025-10-27T22:11:57.523422] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:57.568535] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:57.596944] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:57.627092] [INFO ] [MAIN ] MATV: Generated 138 derivative records from 34605 primary records. [2025-10-27T22:11:57.630293] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-27T22:11:57.648090] [DEBUG] [LOCAL ] MATV: Derivative data saved (138 records). [2025-10-27T22:11:57.651071] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-27T22:11:57.652979] [INFO ] [MAIN ] Derivative Progress: 1078/1881 symbols completed. MATV took 1.2s. Estimated remaining: 5m 27s. Rate: 147.2 symbols/min [2025-10-27T22:11:57.671817] [INFO ] [MAIN ] MAX: Generated 138 derivative records from 30512 primary records. [2025-10-27T22:11:57.673300] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-27T22:11:57.675447] [INFO ] [MAIN ] MATX: Generated 138 derivative records from 31546 primary records. [2025-10-27T22:11:57.675827] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-27T22:11:57.698567] [DEBUG] [LOCAL ] MATX: Derivative data saved (138 records). [2025-10-27T22:11:57.700135] [DEBUG] [LOCAL ] MAX: Derivative data saved (138 records). [2025-10-27T22:11:57.699708] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-27T22:11:57.700231] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-27T22:11:57.702701] [INFO ] [MAIN ] Derivative Progress: 1079/1881 symbols completed. MATX took 1.2s. Estimated remaining: 5m 27s. Rate: 147.3 symbols/min [2025-10-27T22:11:57.705380] [INFO ] [MAIN ] Derivative Progress: 1080/1881 symbols completed. MAX took 1.2s. Estimated remaining: 5m 26s. Rate: 147.5 symbols/min [2025-10-27T22:11:57.705789] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:57.705895] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:57.706321] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:57.737978] [DEBUG] [LOCAL ] MBI: Loaded 23562 existing records from primary storage. [2025-10-27T22:11:57.748036] [INFO ] [MAIN ] MBI: Loaded 23562 primary data records. [2025-10-27T22:11:57.875669] [DEBUG] [LOCAL ] MC: Loaded 43384 existing records from primary storage. [2025-10-27T22:11:57.866695] [DEBUG] [LOCAL ] MBC: Loaded 43734 existing records from primary storage. [2025-10-27T22:11:57.879572] [INFO ] [MAIN ] MC: Loaded 43384 primary data records. [2025-10-27T22:11:57.879464] [INFO ] [MAIN ] MBC: Loaded 43734 primary data records. [2025-10-27T22:11:58.744169] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:58.794667] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:58.824029] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:58.845031] [INFO ] [MAIN ] MBI: Generated 138 derivative records from 23562 primary records. [2025-10-27T22:11:58.850690] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-27T22:11:58.865403] [DEBUG] [LOCAL ] MBI: Derivative data saved (138 records). [2025-10-27T22:11:58.867885] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-27T22:11:58.871436] [INFO ] [MAIN ] Derivative Progress: 1081/1881 symbols completed. MBI took 1.2s. Estimated remaining: 5m 26s. Rate: 147.2 symbols/min [2025-10-27T22:11:58.871678] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:58.901838] [DEBUG] [LOCAL ] MCB: Loaded 11290 existing records from primary storage. [2025-10-27T22:11:58.904873] [INFO ] [MAIN ] MCB: Loaded 11290 primary data records. [2025-10-27T22:11:58.907726] [INFO ] [MAIN ] MBC: Generated 138 derivative records from 43734 primary records. [2025-10-27T22:11:58.928602] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-27T22:11:59.022430] [DEBUG] [LOCAL ] MBC: Derivative data saved (138 records). [2025-10-27T22:11:59.025929] [INFO ] [MAIN ] MC: Generated 138 derivative records from 43384 primary records. [2025-10-27T22:11:59.026493] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-27T22:11:59.037825] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-27T22:11:59.077588] [INFO ] [MAIN ] Derivative Progress: 1082/1881 symbols completed. MBC took 1.4s. Estimated remaining: 5m 25s. Rate: 147.3 symbols/min [2025-10-27T22:11:59.096399] [DEBUG] [LOCAL ] MC: Derivative data saved (138 records). [2025-10-27T22:11:59.117836] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-27T22:11:59.120510] [INFO ] [MAIN ] Derivative Progress: 1083/1881 symbols completed. MC took 1.4s. Estimated remaining: 5m 25s. Rate: 147.4 symbols/min [2025-10-27T22:11:59.117767] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:59.225618] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:11:59.248586] [DEBUG] [LOCAL ] MCI: Loaded 6120 existing records from primary storage. [2025-10-27T22:11:59.248971] [INFO ] [MAIN ] MCI: Loaded 6120 primary data records. [2025-10-27T22:11:59.567162] [DEBUG] [LOCAL ] MCK: Loaded 37561 existing records from primary storage. [2025-10-27T22:11:59.568509] [INFO ] [MAIN ] MCK: Loaded 37561 primary data records. [2025-10-27T22:11:59.714243] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:59.941533] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:11:59.980768] [INFO ] [MAIN ] MCB: Generated 138 derivative records from 11290 primary records. [2025-10-27T22:11:59.981174] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-27T22:11:59.996834] [DEBUG] [LOCAL ] MCB: Derivative data saved (138 records). [2025-10-27T22:12:00.008550] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-27T22:12:00.017490] [INFO ] [MAIN ] Derivative Progress: 1084/1881 symbols completed. MCB took 1.1s. Estimated remaining: 5m 25s. Rate: 147.2 symbols/min [2025-10-27T22:12:00.015189] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:00.017743] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:00.050123] [INFO ] [MAIN ] MCI: Generated 138 derivative records from 6120 primary records. [2025-10-27T22:12:00.049916] [DEBUG] [LOCAL ] MCN: Loaded 7854 existing records from primary storage. [2025-10-27T22:12:00.050364] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-27T22:12:00.050456] [INFO ] [MAIN ] MCN: Loaded 7854 primary data records. [2025-10-27T22:12:00.121877] [DEBUG] [LOCAL ] MCI: Derivative data saved (138 records). [2025-10-27T22:12:00.122010] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-27T22:12:00.135053] [INFO ] [MAIN ] Derivative Progress: 1085/1881 symbols completed. MCI took 1.0s. Estimated remaining: 5m 24s. Rate: 147.3 symbols/min [2025-10-27T22:12:00.140620] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:00.391309] [INFO ] [MAIN ] MCK: Generated 138 derivative records from 37561 primary records. [2025-10-27T22:12:00.392125] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-27T22:12:00.405142] [DEBUG] [LOCAL ] MCK: Derivative data saved (138 records). [2025-10-27T22:12:00.405285] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-27T22:12:00.408189] [INFO ] [MAIN ] Derivative Progress: 1086/1881 symbols completed. MCK took 1.2s. Estimated remaining: 5m 24s. Rate: 147.4 symbols/min [2025-10-27T22:12:00.419635] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:00.420915] [DEBUG] [LOCAL ] MCO: Loaded 39288 existing records from primary storage. [2025-10-27T22:12:00.421465] [INFO ] [MAIN ] MCO: Loaded 39288 primary data records. [2025-10-27T22:12:00.509735] [DEBUG] [LOCAL ] MCR: Loaded 8810 existing records from primary storage. [2025-10-27T22:12:00.520856] [INFO ] [MAIN ] MCR: Loaded 8810 primary data records. [2025-10-27T22:12:00.939822] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:01.174275] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:01.194326] [INFO ] [MAIN ] MCN: Generated 138 derivative records from 7854 primary records. [2025-10-27T22:12:01.195049] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-27T22:12:01.209172] [DEBUG] [LOCAL ] MCN: Derivative data saved (138 records). [2025-10-27T22:12:01.210989] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-27T22:12:01.213219] [INFO ] [MAIN ] Derivative Progress: 1087/1881 symbols completed. MCN took 1.2s. Estimated remaining: 5m 24s. Rate: 147.3 symbols/min [2025-10-27T22:12:01.213463] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:01.228943] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:01.271388] [DEBUG] [LOCAL ] MCS: Loaded 21024 existing records from primary storage. [2025-10-27T22:12:01.271806] [INFO ] [MAIN ] MCS: Loaded 21024 primary data records. [2025-10-27T22:12:01.312358] [INFO ] [MAIN ] MCO: Generated 138 derivative records from 39288 primary records. [2025-10-27T22:12:01.345584] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-27T22:12:01.397260] [DEBUG] [LOCAL ] MCO: Derivative data saved (138 records). [2025-10-27T22:12:01.416017] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-27T22:12:01.418611] [INFO ] [MAIN ] Derivative Progress: 1088/1881 symbols completed. MCO took 1.3s. Estimated remaining: 5m 23s. Rate: 147.3 symbols/min [2025-10-27T22:12:01.424154] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:01.607628] [INFO ] [MAIN ] MCR: Generated 138 derivative records from 8810 primary records. [2025-10-27T22:12:01.608963] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-27T22:12:01.623110] [DEBUG] [LOCAL ] MCR: Derivative data saved (138 records). [2025-10-27T22:12:01.632433] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-27T22:12:01.635316] [INFO ] [MAIN ] Derivative Progress: 1089/1881 symbols completed. MCR took 1.2s. Estimated remaining: 5m 22s. Rate: 147.4 symbols/min [2025-10-27T22:12:01.635585] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:01.645865] [DEBUG] [LOCAL ] MDST: Loaded 6157 existing records from primary storage. [2025-10-27T22:12:01.646359] [INFO ] [MAIN ] MDST: Loaded 6157 primary data records. [2025-10-27T22:12:01.708494] [DEBUG] [LOCAL ] MD: Loaded 38402 existing records from primary storage. [2025-10-27T22:12:01.742797] [INFO ] [MAIN ] MD: Loaded 38402 primary data records. [2025-10-27T22:12:01.833976] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:02.429477] [INFO ] [MAIN ] MCS: Generated 138 derivative records from 21024 primary records. [2025-10-27T22:12:02.430192] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-27T22:12:02.446156] [DEBUG] [LOCAL ] MCS: Derivative data saved (138 records). [2025-10-27T22:12:02.446470] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-27T22:12:02.449046] [INFO ] [MAIN ] Derivative Progress: 1090/1881 symbols completed. MCS took 1.2s. Estimated remaining: 5m 22s. Rate: 147.3 symbols/min [2025-10-27T22:12:02.449215] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:02.467165] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:02.502918] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:02.578448] [INFO ] [MAIN ] MDST: Generated 138 derivative records from 6157 primary records. [2025-10-27T22:12:02.579401] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-27T22:12:02.582622] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-27T22:12:02.582776] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-27T22:12:02.680177] [DEBUG] [LOCAL ] MDST: Derivative data saved (138 records). [2025-10-27T22:12:02.683389] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-27T22:12:02.685717] [INFO ] [MAIN ] Derivative Progress: 1091/1881 symbols completed. MDST took 1.1s. Estimated remaining: 5m 22s. Rate: 147.3 symbols/min [2025-10-27T22:12:02.691066] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:02.752342] [INFO ] [MAIN ] MD: Generated 138 derivative records from 38402 primary records. [2025-10-27T22:12:02.757757] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-27T22:12:02.983333] [DEBUG] [LOCAL ] MD: Derivative data saved (138 records). [2025-10-27T22:12:02.983451] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-27T22:12:02.986220] [INFO ] [MAIN ] Derivative Progress: 1092/1881 symbols completed. MD took 1.6s. Estimated remaining: 5m 21s. Rate: 147.3 symbols/min [2025-10-27T22:12:02.986426] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:03.010374] [DEBUG] [LOCAL ] MDV: Loaded 8221 existing records from primary storage. [2025-10-27T22:12:03.010800] [INFO ] [MAIN ] MDV: Loaded 8221 primary data records. [2025-10-27T22:12:03.131434] [DEBUG] [LOCAL ] MDU: Loaded 47956 existing records from primary storage. [2025-10-27T22:12:03.135553] [INFO ] [MAIN ] MDU: Loaded 47956 primary data records. [2025-10-27T22:12:03.490474] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:03.737065] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:03.755073] [INFO ] [MAIN ] MDT: Generated 138 derivative records from 53678 primary records. [2025-10-27T22:12:03.756913] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-27T22:12:03.772241] [DEBUG] [LOCAL ] MDT: Derivative data saved (138 records). [2025-10-27T22:12:03.772554] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-27T22:12:03.776727] [INFO ] [MAIN ] Derivative Progress: 1093/1881 symbols completed. MDT took 1.3s. Estimated remaining: 5m 21s. Rate: 147.2 symbols/min [2025-10-27T22:12:03.797159] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:03.825619] [INFO ] [MAIN ] MDV: Generated 138 derivative records from 8221 primary records. [2025-10-27T22:12:03.828222] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-27T22:12:03.844471] [DEBUG] [LOCAL ] MDV: Derivative data saved (138 records). [2025-10-27T22:12:03.844743] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-27T22:12:03.847252] [INFO ] [MAIN ] Derivative Progress: 1094/1881 symbols completed. MDV took 0.9s. Estimated remaining: 5m 21s. Rate: 147.3 symbols/min [2025-10-27T22:12:03.852410] [INFO ] [MAIN ] MDU: Generated 138 derivative records from 47956 primary records. [2025-10-27T22:12:03.852562] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-27T22:12:03.864139] [DEBUG] [LOCAL ] MDU: Derivative data saved (138 records). [2025-10-27T22:12:03.864212] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-27T22:12:03.866955] [INFO ] [MAIN ] Derivative Progress: 1095/1881 symbols completed. MDU took 1.2s. Estimated remaining: 5m 20s. Rate: 147.5 symbols/min [2025-10-27T22:12:03.867496] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:03.867703] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:03.867605] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:03.889769] [DEBUG] [LOCAL ] MEC: Loaded 16889 existing records from primary storage. [2025-10-27T22:12:03.898082] [INFO ] [MAIN ] MEC: Loaded 16889 primary data records. [2025-10-27T22:12:03.965627] [DEBUG] [LOCAL ] MED: Loaded 20766 existing records from primary storage. [2025-10-27T22:12:03.994264] [INFO ] [MAIN ] MED: Loaded 20766 primary data records. [2025-10-27T22:12:04.010603] [DEBUG] [LOCAL ] MEG: Loaded 31233 existing records from primary storage. [2025-10-27T22:12:04.029981] [INFO ] [MAIN ] MEG: Loaded 31233 primary data records. [2025-10-27T22:12:04.865029] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:04.902185] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:04.938727] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:04.975498] [INFO ] [MAIN ] MEC: Generated 138 derivative records from 16889 primary records. [2025-10-27T22:12:04.976493] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-27T22:12:04.996118] [DEBUG] [LOCAL ] MEC: Derivative data saved (138 records). [2025-10-27T22:12:05.002566] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-27T22:12:05.006232] [INFO ] [MAIN ] Derivative Progress: 1096/1881 symbols completed. MEC took 1.1s. Estimated remaining: 5m 20s. Rate: 147.2 symbols/min [2025-10-27T22:12:05.007889] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:05.012909] [INFO ] [MAIN ] MED: Generated 138 derivative records from 20766 primary records. [2025-10-27T22:12:05.016092] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-27T22:12:05.030142] [DEBUG] [LOCAL ] MED: Derivative data saved (138 records). [2025-10-27T22:12:05.035132] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-27T22:12:05.037752] [INFO ] [MAIN ] Derivative Progress: 1097/1881 symbols completed. MED took 1.2s. Estimated remaining: 5m 19s. Rate: 147.3 symbols/min [2025-10-27T22:12:05.040146] [INFO ] [MAIN ] MEG: Generated 138 derivative records from 31233 primary records. [2025-10-27T22:12:05.040353] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:05.040463] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-27T22:12:05.060055] [DEBUG] [LOCAL ] MEG: Derivative data saved (138 records). [2025-10-27T22:12:05.057510] [DEBUG] [LOCAL ] MEGI: Loaded 19596 existing records from primary storage. [2025-10-27T22:12:05.060185] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-27T22:12:05.062889] [INFO ] [MAIN ] Derivative Progress: 1098/1881 symbols completed. MEG took 1.2s. Estimated remaining: 5m 19s. Rate: 147.5 symbols/min [2025-10-27T22:12:05.063081] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:05.063180] [INFO ] [MAIN ] MEGI: Loaded 19596 primary data records. [2025-10-27T22:12:05.204630] [DEBUG] [LOCAL ] MEI: Loaded 31111 existing records from primary storage. [2025-10-27T22:12:05.241517] [INFO ] [MAIN ] MEI: Loaded 31111 primary data records. [2025-10-27T22:12:05.536463] [DEBUG] [LOCAL ] MET: Loaded 53279 existing records from primary storage. [2025-10-27T22:12:05.557251] [INFO ] [MAIN ] MET: Loaded 53279 primary data records. [2025-10-27T22:12:06.051195] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:06.092961] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:06.122202] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:06.160213] [INFO ] [MAIN ] MEGI: Generated 138 derivative records from 19596 primary records. [2025-10-27T22:12:06.163199] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-27T22:12:06.179179] [DEBUG] [LOCAL ] MEGI: Derivative data saved (138 records). [2025-10-27T22:12:06.179351] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-27T22:12:06.181713] [INFO ] [MAIN ] Derivative Progress: 1099/1881 symbols completed. MEGI took 1.2s. Estimated remaining: 5m 19s. Rate: 147.2 symbols/min [2025-10-27T22:12:06.187604] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:06.202510] [INFO ] [MAIN ] MEI: Generated 138 derivative records from 31111 primary records. [2025-10-27T22:12:06.202213] [INFO ] [MAIN ] MET: Generated 138 derivative records from 53279 primary records. [2025-10-27T22:12:06.202757] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-27T22:12:06.202862] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-27T22:12:06.222189] [DEBUG] [LOCAL ] MET: Derivative data saved (138 records). [2025-10-27T22:12:06.223726] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-27T22:12:06.226689] [INFO ] [MAIN ] Derivative Progress: 1100/1881 symbols completed. MET took 1.2s. Estimated remaining: 5m 18s. Rate: 147.3 symbols/min [2025-10-27T22:12:06.239278] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:06.229481] [DEBUG] [LOCAL ] MEI: Derivative data saved (138 records). [2025-10-27T22:12:06.239914] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-27T22:12:06.242426] [INFO ] [MAIN ] Derivative Progress: 1101/1881 symbols completed. MEI took 1.2s. Estimated remaining: 5m 17s. Rate: 147.5 symbols/min [2025-10-27T22:12:06.242838] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:06.247689] [DEBUG] [LOCAL ] MFAN: Loaded 4192 existing records from primary storage. [2025-10-27T22:12:06.248613] [INFO ] [MAIN ] MFAN: Loaded 4192 primary data records. [2025-10-27T22:12:06.337361] [DEBUG] [LOCAL ] MFA: Loaded 45266 existing records from primary storage. [2025-10-27T22:12:06.337601] [DEBUG] [LOCAL ] MFAO: Loaded 3768 existing records from primary storage. [2025-10-27T22:12:06.337787] [INFO ] [MAIN ] MFA: Loaded 45266 primary data records. [2025-10-27T22:12:06.360507] [INFO ] [MAIN ] MFAO: Loaded 3768 primary data records. [2025-10-27T22:12:07.209225] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:07.244410] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:07.288021] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:07.330401] [INFO ] [MAIN ] MFAN: Generated 138 derivative records from 4192 primary records. [2025-10-27T22:12:07.337455] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-27T22:12:07.353614] [DEBUG] [LOCAL ] MFAN: Derivative data saved (138 records). [2025-10-27T22:12:07.355506] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-27T22:12:07.359116] [INFO ] [MAIN ] Derivative Progress: 1102/1881 symbols completed. MFAN took 1.1s. Estimated remaining: 5m 17s. Rate: 147.2 symbols/min [2025-10-27T22:12:07.359810] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:07.360257] [INFO ] [MAIN ] MFAO: Generated 138 derivative records from 3768 primary records. [2025-10-27T22:12:07.363375] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-27T22:12:07.376941] [DEBUG] [LOCAL ] MFAO: Derivative data saved (138 records). [2025-10-27T22:12:07.377189] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-27T22:12:07.379767] [INFO ] [MAIN ] Derivative Progress: 1103/1881 symbols completed. MFAO took 1.1s. Estimated remaining: 5m 17s. Rate: 147.4 symbols/min [2025-10-27T22:12:07.380131] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:07.383229] [INFO ] [MAIN ] MFA: Generated 138 derivative records from 45266 primary records. [2025-10-27T22:12:07.383404] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-27T22:12:07.397997] [DEBUG] [LOCAL ] MFA: Derivative data saved (138 records). [2025-10-27T22:12:07.398330] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-27T22:12:07.401209] [INFO ] [MAIN ] Derivative Progress: 1104/1881 symbols completed. MFA took 1.2s. Estimated remaining: 5m 16s. Rate: 147.5 symbols/min [2025-10-27T22:12:07.401553] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:07.428317] [DEBUG] [LOCAL ] MFM: Loaded 13557 existing records from primary storage. [2025-10-27T22:12:07.428553] [INFO ] [MAIN ] MFM: Loaded 13557 primary data records. [2025-10-27T22:12:07.605971] [DEBUG] [LOCAL ] MFC: Loaded 50900 existing records from primary storage. [2025-10-27T22:12:07.612431] [DEBUG] [LOCAL ] MFG: Loaded 49410 existing records from primary storage. [2025-10-27T22:12:07.612545] [INFO ] [MAIN ] MFC: Loaded 50900 primary data records. [2025-10-27T22:12:07.633172] [INFO ] [MAIN ] MFG: Loaded 49410 primary data records. [2025-10-27T22:12:08.445706] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:08.504249] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:08.504802] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:08.556209] [INFO ] [MAIN ] MFM: Generated 138 derivative records from 13557 primary records. [2025-10-27T22:12:08.561617] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-27T22:12:08.579655] [DEBUG] [LOCAL ] MFM: Derivative data saved (138 records). [2025-10-27T22:12:08.579978] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-27T22:12:08.582076] [INFO ] [MAIN ] Derivative Progress: 1105/1881 symbols completed. MFM took 1.2s. Estimated remaining: 5m 16s. Rate: 147.2 symbols/min [2025-10-27T22:12:08.582238] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:08.599418] [DEBUG] [LOCAL ] MFSG: Loaded 5908 existing records from primary storage. [2025-10-27T22:12:08.600044] [INFO ] [MAIN ] MFSG: Loaded 5908 primary data records. [2025-10-27T22:12:08.684529] [INFO ] [MAIN ] MFG: Generated 138 derivative records from 49410 primary records. [2025-10-27T22:12:08.705671] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-27T22:12:08.713607] [INFO ] [MAIN ] MFC: Generated 138 derivative records from 50900 primary records. [2025-10-27T22:12:08.724419] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-27T22:12:08.805809] [DEBUG] [LOCAL ] MFG: Derivative data saved (138 records). [2025-10-27T22:12:08.923038] [DEBUG] [LOCAL ] MFC: Derivative data saved (138 records). [2025-10-27T22:12:08.912588] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-27T22:12:08.925843] [INFO ] [MAIN ] Derivative Progress: 1106/1881 symbols completed. MFG took 1.5s. Estimated remaining: 5m 16s. Rate: 147.3 symbols/min [2025-10-27T22:12:08.926112] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:08.923193] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-27T22:12:08.929374] [INFO ] [MAIN ] Derivative Progress: 1107/1881 symbols completed. MFC took 1.6s. Estimated remaining: 5m 15s. Rate: 147.4 symbols/min [2025-10-27T22:12:08.930433] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:08.936328] [DEBUG] [LOCAL ] MFSV: Loaded 2986 existing records from primary storage. [2025-10-27T22:12:08.936639] [INFO ] [MAIN ] MFSV: Loaded 2986 primary data records. [2025-10-27T22:12:09.051324] [DEBUG] [LOCAL ] MFSI: Loaded 12866 existing records from primary storage. [2025-10-27T22:12:09.059033] [INFO ] [MAIN ] MFSI: Loaded 12866 primary data records. [2025-10-27T22:12:09.476630] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:09.658982] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:09.686984] [INFO ] [MAIN ] MFSG: Generated 138 derivative records from 5908 primary records. [2025-10-27T22:12:09.675284] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:09.688087] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-27T22:12:09.715949] [DEBUG] [LOCAL ] MFSG: Derivative data saved (138 records). [2025-10-27T22:12:09.717209] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-27T22:12:09.719849] [INFO ] [MAIN ] Derivative Progress: 1108/1881 symbols completed. MFSG took 1.1s. Estimated remaining: 5m 15s. Rate: 147.3 symbols/min [2025-10-27T22:12:09.756969] [INFO ] [MAIN ] MFSI: Generated 138 derivative records from 12866 primary records. [2025-10-27T22:12:09.759059] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-27T22:12:09.758975] [INFO ] [MAIN ] MFSV: Generated 138 derivative records from 2986 primary records. [2025-10-27T22:12:09.759177] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-27T22:12:09.779766] [DEBUG] [LOCAL ] MFSI: Derivative data saved (138 records). [2025-10-27T22:12:09.782099] [DEBUG] [LOCAL ] MFSV: Derivative data saved (138 records). [2025-10-27T22:12:09.782173] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-27T22:12:09.782309] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-27T22:12:09.784637] [INFO ] [MAIN ] Derivative Progress: 1109/1881 symbols completed. MFSV took 0.9s. Estimated remaining: 5m 14s. Rate: 147.4 symbols/min [2025-10-27T22:12:09.787538] [INFO ] [MAIN ] Derivative Progress: 1110/1881 symbols completed. MFSI took 0.9s. Estimated remaining: 5m 14s. Rate: 147.5 symbols/min [2025-10-27T22:12:09.788016] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:09.787884] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:09.787939] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:09.800397] [DEBUG] [LOCAL ] MGF: Loaded 4095 existing records from primary storage. [2025-10-27T22:12:09.800724] [INFO ] [MAIN ] MGF: Loaded 4095 primary data records. [2025-10-27T22:12:09.871877] [DEBUG] [LOCAL ] MG: Loaded 15016 existing records from primary storage. [2025-10-27T22:12:09.909668] [INFO ] [MAIN ] MG: Loaded 15016 primary data records. [2025-10-27T22:12:10.284192] [DEBUG] [LOCAL ] MGA: Loaded 50302 existing records from primary storage. [2025-10-27T22:12:10.424973] [INFO ] [MAIN ] MGA: Loaded 50302 primary data records. [2025-10-27T22:12:10.754792] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:10.785871] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:10.833743] [INFO ] [MAIN ] MGF: Generated 138 derivative records from 4095 primary records. [2025-10-27T22:12:10.836703] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-27T22:12:10.857309] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:10.873216] [DEBUG] [LOCAL ] MGF: Derivative data saved (138 records). [2025-10-27T22:12:10.873732] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-27T22:12:10.877689] [INFO ] [MAIN ] Derivative Progress: 1111/1881 symbols completed. MGF took 1.1s. Estimated remaining: 5m 14s. Rate: 147.3 symbols/min [2025-10-27T22:12:10.878142] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:10.888016] [INFO ] [MAIN ] MG: Generated 138 derivative records from 15016 primary records. [2025-10-27T22:12:10.890984] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-27T22:12:10.904679] [DEBUG] [LOCAL ] MG: Derivative data saved (138 records). [2025-10-27T22:12:10.904990] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-27T22:12:10.907415] [INFO ] [MAIN ] Derivative Progress: 1112/1881 symbols completed. MG took 1.1s. Estimated remaining: 5m 13s. Rate: 147.4 symbols/min [2025-10-27T22:12:10.907702] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:10.921517] [DEBUG] [LOCAL ] MGR: Loaded 5451 existing records from primary storage. [2025-10-27T22:12:10.927561] [INFO ] [MAIN ] MGR: Loaded 5451 primary data records. [2025-10-27T22:12:10.999402] [INFO ] [MAIN ] MGA: Generated 138 derivative records from 50302 primary records. [2025-10-27T22:12:11.047826] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-27T22:12:11.125601] [DEBUG] [LOCAL ] MGM: Loaded 53601 existing records from primary storage. [2025-10-27T22:12:11.127734] [INFO ] [MAIN ] MGM: Loaded 53601 primary data records. [2025-10-27T22:12:11.380184] [DEBUG] [LOCAL ] MGA: Derivative data saved (138 records). [2025-10-27T22:12:11.402171] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-27T22:12:11.415319] [INFO ] [MAIN ] Derivative Progress: 1113/1881 symbols completed. MGA took 1.6s. Estimated remaining: 5m 13s. Rate: 147.4 symbols/min [2025-10-27T22:12:11.416409] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:11.498557] [DEBUG] [LOCAL ] MGRB: Loaded 3906 existing records from primary storage. [2025-10-27T22:12:11.611317] [INFO ] [MAIN ] MGRB: Loaded 3906 primary data records. [2025-10-27T22:12:11.937091] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:11.972287] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:12.027902] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:12.054587] [INFO ] [MAIN ] MGR: Generated 138 derivative records from 5451 primary records. [2025-10-27T22:12:12.055036] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-27T22:12:12.078368] [DEBUG] [LOCAL ] MGR: Derivative data saved (138 records). [2025-10-27T22:12:12.079023] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-27T22:12:12.081029] [INFO ] [MAIN ] Derivative Progress: 1114/1881 symbols completed. MGR took 1.2s. Estimated remaining: 5m 12s. Rate: 147.3 symbols/min [2025-10-27T22:12:12.083617] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:12.092017] [INFO ] [MAIN ] MGM: Generated 138 derivative records from 53601 primary records. [2025-10-27T22:12:12.093156] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-27T22:12:12.094963] [DEBUG] [LOCAL ] MGRD: Loaded 2159 existing records from primary storage. [2025-10-27T22:12:12.095370] [INFO ] [MAIN ] MGRD: Loaded 2159 primary data records. [2025-10-27T22:12:12.142993] [DEBUG] [LOCAL ] MGM: Derivative data saved (138 records). [2025-10-27T22:12:12.152237] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-27T22:12:12.181867] [INFO ] [MAIN ] Derivative Progress: 1115/1881 symbols completed. MGM took 1.3s. Estimated remaining: 5m 12s. Rate: 147.4 symbols/min [2025-10-27T22:12:12.182089] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:12.233350] [INFO ] [MAIN ] MGRB: Generated 138 derivative records from 3906 primary records. [2025-10-27T22:12:12.265891] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-27T22:12:12.406493] [DEBUG] [LOCAL ] MGRE: Loaded 6310 existing records from primary storage. [2025-10-27T22:12:12.425865] [INFO ] [MAIN ] MGRE: Loaded 6310 primary data records. [2025-10-27T22:12:12.467537] [DEBUG] [LOCAL ] MGRB: Derivative data saved (138 records). [2025-10-27T22:12:12.500610] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-27T22:12:12.525827] [INFO ] [MAIN ] Derivative Progress: 1116/1881 symbols completed. MGRB took 1.1s. Estimated remaining: 5m 11s. Rate: 147.4 symbols/min [2025-10-27T22:12:12.536428] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:12.748746] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:12.819287] [DEBUG] [LOCAL ] MGY: Loaded 52406 existing records from primary storage. [2025-10-27T22:12:12.820811] [INFO ] [MAIN ] MGY: Loaded 52406 primary data records. [2025-10-27T22:12:12.820589] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:12.970403] [INFO ] [MAIN ] MGRD: Generated 138 derivative records from 2159 primary records. [2025-10-27T22:12:13.152222] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-27T22:12:13.199902] [DEBUG] [LOCAL ] MGRD: Derivative data saved (138 records). [2025-10-27T22:12:13.200339] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-27T22:12:13.202718] [INFO ] [MAIN ] Derivative Progress: 1117/1881 symbols completed. MGRD took 1.1s. Estimated remaining: 5m 11s. Rate: 147.3 symbols/min [2025-10-27T22:12:13.204099] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:13.219632] [INFO ] [MAIN ] MGRE: Generated 138 derivative records from 6310 primary records. [2025-10-27T22:12:13.220013] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-27T22:12:13.233841] [DEBUG] [LOCAL ] MHD: Loaded 11584 existing records from primary storage. [2025-10-27T22:12:13.234103] [INFO ] [MAIN ] MHD: Loaded 11584 primary data records. [2025-10-27T22:12:13.257390] [DEBUG] [LOCAL ] MGRE: Derivative data saved (138 records). [2025-10-27T22:12:13.273272] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-27T22:12:13.282457] [INFO ] [MAIN ] Derivative Progress: 1118/1881 symbols completed. MGRE took 1.1s. Estimated remaining: 5m 11s. Rate: 147.4 symbols/min [2025-10-27T22:12:13.308468] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:13.372095] [DEBUG] [LOCAL ] MHF: Loaded 9097 existing records from primary storage. [2025-10-27T22:12:13.439270] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:13.439387] [INFO ] [MAIN ] MHF: Loaded 9097 primary data records. [2025-10-27T22:12:13.891409] [INFO ] [MAIN ] MGY: Generated 138 derivative records from 52406 primary records. [2025-10-27T22:12:13.892416] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-27T22:12:13.907494] [DEBUG] [LOCAL ] MGY: Derivative data saved (138 records). [2025-10-27T22:12:13.907636] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-27T22:12:13.910636] [INFO ] [MAIN ] Derivative Progress: 1119/1881 symbols completed. MGY took 1.4s. Estimated remaining: 5m 10s. Rate: 147.4 symbols/min [2025-10-27T22:12:13.911069] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:13.928527] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:13.959272] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:14.026794] [DEBUG] [LOCAL ] MHK: Loaded 42038 existing records from primary storage. [2025-10-27T22:12:14.027132] [INFO ] [MAIN ] MHK: Loaded 42038 primary data records. [2025-10-27T22:12:14.087634] [INFO ] [MAIN ] MHD: Generated 138 derivative records from 11584 primary records. [2025-10-27T22:12:14.124315] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-27T22:12:14.175079] [DEBUG] [LOCAL ] MHD: Derivative data saved (138 records). [2025-10-27T22:12:14.188738] [INFO ] [MAIN ] MHF: Generated 138 derivative records from 9097 primary records. [2025-10-27T22:12:14.188505] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-27T22:12:14.205021] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-27T22:12:14.199271] [INFO ] [MAIN ] Derivative Progress: 1120/1881 symbols completed. MHD took 1.0s. Estimated remaining: 5m 10s. Rate: 147.4 symbols/min [2025-10-27T22:12:14.227718] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:14.355017] [DEBUG] [LOCAL ] MHF: Derivative data saved (138 records). [2025-10-27T22:12:14.355590] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-27T22:12:14.358213] [INFO ] [MAIN ] Derivative Progress: 1121/1881 symbols completed. MHF took 1.0s. Estimated remaining: 5m 9s. Rate: 147.5 symbols/min [2025-10-27T22:12:14.358456] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:14.363033] [DEBUG] [LOCAL ] MHN: Loaded 7019 existing records from primary storage. [2025-10-27T22:12:14.363831] [INFO ] [MAIN ] MHN: Loaded 7019 primary data records. [2025-10-27T22:12:14.540276] [DEBUG] [LOCAL ] MHO: Loaded 23488 existing records from primary storage. [2025-10-27T22:12:14.549556] [INFO ] [MAIN ] MHO: Loaded 23488 primary data records. [2025-10-27T22:12:14.884712] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:15.051611] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:15.073592] [INFO ] [MAIN ] MHK: Generated 138 derivative records from 42038 primary records. [2025-10-27T22:12:15.074960] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-27T22:12:15.099985] [DEBUG] [LOCAL ] MHK: Derivative data saved (138 records). [2025-10-27T22:12:15.101139] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-27T22:12:15.103604] [INFO ] [MAIN ] Derivative Progress: 1122/1881 symbols completed. MHK took 1.2s. Estimated remaining: 5m 9s. Rate: 147.4 symbols/min [2025-10-27T22:12:15.104481] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:15.121554] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:15.153930] [DEBUG] [LOCAL ] MIN: Loaded 13805 existing records from primary storage. [2025-10-27T22:12:15.155244] [INFO ] [MAIN ] MIN: Loaded 13805 primary data records. [2025-10-27T22:12:15.157220] [INFO ] [MAIN ] MHN: Generated 138 derivative records from 7019 primary records. [2025-10-27T22:12:15.157392] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-27T22:12:15.211688] [DEBUG] [LOCAL ] MHN: Derivative data saved (138 records). [2025-10-27T22:12:15.247940] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-27T22:12:15.250446] [INFO ] [MAIN ] Derivative Progress: 1123/1881 symbols completed. MHN took 1.0s. Estimated remaining: 5m 8s. Rate: 147.5 symbols/min [2025-10-27T22:12:15.509852] [INFO ] [MAIN ] MHO: Generated 138 derivative records from 23488 primary records. [2025-10-27T22:12:15.510035] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-27T22:12:15.523765] [DEBUG] [LOCAL ] MHO: Derivative data saved (138 records). [2025-10-27T22:12:15.524249] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-27T22:12:15.527053] [INFO ] [MAIN ] Derivative Progress: 1124/1881 symbols completed. MHO took 1.2s. Estimated remaining: 5m 8s. Rate: 147.5 symbols/min [2025-10-27T22:12:15.546813] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:15.571987] [INFO ] [MAIN ] MIN: Generated 138 derivative records from 13805 primary records. [2025-10-27T22:12:15.572108] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-27T22:12:15.582739] [DEBUG] [LOCAL ] MIN: Derivative data saved (138 records). [2025-10-27T22:12:15.582796] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-27T22:12:15.585096] [INFO ] [MAIN ] Derivative Progress: 1125/1881 symbols completed. MIN took 0.5s. Estimated remaining: 5m 7s. Rate: 147.6 symbols/min [2025-10-27T22:12:15.585795] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:15.585870] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:15.585721] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:15.590821] [DEBUG] [LOCAL ] MITP: Loaded 2087 existing records from primary storage. [2025-10-27T22:12:15.590938] [INFO ] [MAIN ] MITP: Loaded 2087 primary data records. [2025-10-27T22:12:15.707136] [DEBUG] [LOCAL ] MITT: Loaded 21643 existing records from primary storage. [2025-10-27T22:12:15.718114] [INFO ] [MAIN ] MITT: Loaded 21643 primary data records. [2025-10-27T22:12:16.125092] [DEBUG] [LOCAL ] MIR: Loaded 51414 existing records from primary storage. [2025-10-27T22:12:16.267055] [INFO ] [MAIN ] MIR: Loaded 51414 primary data records. [2025-10-27T22:12:16.731814] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:16.766995] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:16.853629] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:16.875595] [INFO ] [MAIN ] MITP: Generated 138 derivative records from 2087 primary records. [2025-10-27T22:12:16.880025] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-27T22:12:16.900287] [DEBUG] [LOCAL ] MITP: Derivative data saved (138 records). [2025-10-27T22:12:16.902515] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-27T22:12:16.907070] [INFO ] [MAIN ] Derivative Progress: 1126/1881 symbols completed. MITP took 1.3s. Estimated remaining: 5m 7s. Rate: 147.3 symbols/min [2025-10-27T22:12:16.910100] [INFO ] [MAIN ] MITT: Generated 138 derivative records from 21643 primary records. [2025-10-27T22:12:16.913694] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:16.913523] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-27T22:12:16.942420] [DEBUG] [LOCAL ] MITT: Derivative data saved (138 records). [2025-10-27T22:12:16.944631] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-27T22:12:16.955275] [DEBUG] [LOCAL ] MIY: Loaded 6145 existing records from primary storage. [2025-10-27T22:12:16.954719] [INFO ] [MAIN ] Derivative Progress: 1127/1881 symbols completed. MITT took 1.4s. Estimated remaining: 5m 7s. Rate: 147.4 symbols/min [2025-10-27T22:12:16.955526] [INFO ] [MAIN ] MIY: Loaded 6145 primary data records. [2025-10-27T22:12:16.955761] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:16.973109] [INFO ] [MAIN ] MIR: Generated 138 derivative records from 51414 primary records. [2025-10-27T22:12:16.984093] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-27T22:12:17.131336] [DEBUG] [LOCAL ] MIR: Derivative data saved (138 records). [2025-10-27T22:12:17.131515] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-27T22:12:17.134176] [INFO ] [MAIN ] Derivative Progress: 1128/1881 symbols completed. MIR took 1.5s. Estimated remaining: 5m 6s. Rate: 147.5 symbols/min [2025-10-27T22:12:17.135014] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:17.423961] [DEBUG] [LOCAL ] MKC: Loaded 52496 existing records from primary storage. [2025-10-27T22:12:17.425186] [INFO ] [MAIN ] MKC: Loaded 52496 primary data records. [2025-10-27T22:12:17.520483] [DEBUG] [LOCAL ] MKL: Loaded 33390 existing records from primary storage. [2025-10-27T22:12:17.546372] [INFO ] [MAIN ] MKL: Loaded 33390 primary data records. [2025-10-27T22:12:18.132098] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:18.201710] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:18.237804] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:18.242734] [INFO ] [MAIN ] MIY: Generated 138 derivative records from 6145 primary records. [2025-10-27T22:12:18.256441] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-27T22:12:18.270630] [DEBUG] [LOCAL ] MIY: Derivative data saved (138 records). [2025-10-27T22:12:18.270812] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-27T22:12:18.278011] [INFO ] [MAIN ] Derivative Progress: 1129/1881 symbols completed. MIY took 1.4s. Estimated remaining: 5m 6s. Rate: 147.3 symbols/min [2025-10-27T22:12:18.278553] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:18.298206] [INFO ] [MAIN ] MKC: Generated 138 derivative records from 52496 primary records. [2025-10-27T22:12:18.299582] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-27T22:12:18.327563] [INFO ] [MAIN ] MKL: Generated 138 derivative records from 33390 primary records. [2025-10-27T22:12:18.325395] [DEBUG] [LOCAL ] MKC: Derivative data saved (138 records). [2025-10-27T22:12:18.327732] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-27T22:12:18.330288] [INFO ] [MAIN ] Derivative Progress: 1130/1881 symbols completed. MKC took 1.4s. Estimated remaining: 5m 6s. Rate: 147.4 symbols/min [2025-10-27T22:12:18.330483] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-27T22:12:18.330590] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:18.344211] [DEBUG] [LOCAL ] MKL: Derivative data saved (138 records). [2025-10-27T22:12:18.355940] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-27T22:12:18.358946] [INFO ] [MAIN ] Derivative Progress: 1131/1881 symbols completed. MKL took 1.2s. Estimated remaining: 5m 5s. Rate: 147.5 symbols/min [2025-10-27T22:12:18.360261] [DEBUG] [LOCAL ] MLI: Loaded 43225 existing records from primary storage. [2025-10-27T22:12:18.359308] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:18.360511] [INFO ] [MAIN ] MLI: Loaded 43225 primary data records. [2025-10-27T22:12:18.434977] [DEBUG] [LOCAL ] MLP: Loaded 2938 existing records from primary storage. [2025-10-27T22:12:18.451231] [INFO ] [MAIN ] MLP: Loaded 2938 primary data records. [2025-10-27T22:12:18.562528] [DEBUG] [LOCAL ] MLM: Loaded 28252 existing records from primary storage. [2025-10-27T22:12:18.606237] [INFO ] [MAIN ] MLM: Loaded 28252 primary data records. [2025-10-27T22:12:19.292599] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:19.321243] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:19.359554] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:19.419041] [INFO ] [MAIN ] MLP: Generated 138 derivative records from 2938 primary records. [2025-10-27T22:12:19.420133] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-27T22:12:19.424042] [INFO ] [MAIN ] MLI: Generated 138 derivative records from 43225 primary records. [2025-10-27T22:12:19.432530] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-27T22:12:19.437058] [DEBUG] [LOCAL ] MLP: Derivative data saved (138 records). [2025-10-27T22:12:19.438843] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-27T22:12:19.441744] [INFO ] [MAIN ] Derivative Progress: 1132/1881 symbols completed. MLP took 1.1s. Estimated remaining: 5m 5s. Rate: 147.3 symbols/min [2025-10-27T22:12:19.449402] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:19.454293] [DEBUG] [LOCAL ] MLI: Derivative data saved (138 records). [2025-10-27T22:12:19.454575] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-27T22:12:19.459178] [INFO ] [MAIN ] Derivative Progress: 1133/1881 symbols completed. MLI took 1.2s. Estimated remaining: 5m 4s. Rate: 147.4 symbols/min [2025-10-27T22:12:19.459389] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:19.466097] [INFO ] [MAIN ] MLM: Generated 138 derivative records from 28252 primary records. [2025-10-27T22:12:19.466328] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-27T22:12:19.482864] [DEBUG] [LOCAL ] MLM: Derivative data saved (138 records). [2025-10-27T22:12:19.480486] [DEBUG] [LOCAL ] MLR: Loaded 11858 existing records from primary storage. [2025-10-27T22:12:19.483062] [INFO ] [MAIN ] MLR: Loaded 11858 primary data records. [2025-10-27T22:12:19.483146] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-27T22:12:19.485366] [INFO ] [MAIN ] Derivative Progress: 1134/1881 symbols completed. MLM took 1.2s. Estimated remaining: 5m 4s. Rate: 147.5 symbols/min [2025-10-27T22:12:19.490704] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:19.683082] [DEBUG] [LOCAL ] MMD: Loaded 10594 existing records from primary storage. [2025-10-27T22:12:19.749341] [INFO ] [MAIN ] MMD: Loaded 10594 primary data records. [2025-10-27T22:12:19.939796] [DEBUG] [LOCAL ] MMC: Loaded 51895 existing records from primary storage. [2025-10-27T22:12:19.948350] [INFO ] [MAIN ] MMC: Loaded 51895 primary data records. [2025-10-27T22:12:20.452335] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:20.499366] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:20.529383] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:20.532166] [INFO ] [MAIN ] MLR: Generated 138 derivative records from 11858 primary records. [2025-10-27T22:12:20.543440] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-27T22:12:20.561379] [DEBUG] [LOCAL ] MLR: Derivative data saved (138 records). [2025-10-27T22:12:20.564586] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-27T22:12:20.570926] [INFO ] [MAIN ] Derivative Progress: 1135/1881 symbols completed. MLR took 1.1s. Estimated remaining: 5m 4s. Rate: 147.3 symbols/min [2025-10-27T22:12:20.571100] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:20.598231] [DEBUG] [LOCAL ] MMI: Loaded 15152 existing records from primary storage. [2025-10-27T22:12:20.601084] [INFO ] [MAIN ] MMI: Loaded 15152 primary data records. [2025-10-27T22:12:20.690194] [INFO ] [MAIN ] MMD: Generated 138 derivative records from 10594 primary records. [2025-10-27T22:12:20.695934] [INFO ] [MAIN ] MMC: Generated 138 derivative records from 51895 primary records. [2025-10-27T22:12:20.696104] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-27T22:12:20.707391] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-27T22:12:20.734867] [DEBUG] [LOCAL ] MMD: Derivative data saved (138 records). [2025-10-27T22:12:20.742158] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-27T22:12:20.757637] [INFO ] [MAIN ] Derivative Progress: 1136/1881 symbols completed. MMD took 1.3s. Estimated remaining: 5m 3s. Rate: 147.4 symbols/min [2025-10-27T22:12:20.770941] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:20.809490] [DEBUG] [LOCAL ] MMC: Derivative data saved (138 records). [2025-10-27T22:12:20.809638] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-27T22:12:20.915965] [INFO ] [MAIN ] Derivative Progress: 1137/1881 symbols completed. MMC took 1.5s. Estimated remaining: 5m 3s. Rate: 147.5 symbols/min [2025-10-27T22:12:20.924524] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:20.972535] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:20.996715] [DEBUG] [LOCAL ] MMS: Loaded 33129 existing records from primary storage. [2025-10-27T22:12:20.998300] [INFO ] [MAIN ] MMS: Loaded 33129 primary data records. [2025-10-27T22:12:21.094674] [DEBUG] [LOCAL ] MMM: Loaded 53110 existing records from primary storage. [2025-10-27T22:12:21.126208] [INFO ] [MAIN ] MMM: Loaded 53110 primary data records. [2025-10-27T22:12:21.670050] [INFO ] [MAIN ] MMI: Generated 138 derivative records from 15152 primary records. [2025-10-27T22:12:21.670231] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-27T22:12:21.683633] [DEBUG] [LOCAL ] MMI: Derivative data saved (138 records). [2025-10-27T22:12:21.683862] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-27T22:12:21.686040] [INFO ] [MAIN ] Derivative Progress: 1138/1881 symbols completed. MMI took 1.1s. Estimated remaining: 5m 3s. Rate: 147.4 symbols/min [2025-10-27T22:12:21.705885] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:21.738624] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:21.771287] [INFO ] [MAIN ] MMS: Generated 138 derivative records from 33129 primary records. [2025-10-27T22:12:21.774448] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-27T22:12:21.787370] [DEBUG] [LOCAL ] MMS: Derivative data saved (138 records). [2025-10-27T22:12:21.787702] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-27T22:12:21.791446] [INFO ] [MAIN ] Derivative Progress: 1139/1881 symbols completed. MMS took 0.9s. Estimated remaining: 5m 2s. Rate: 147.4 symbols/min [2025-10-27T22:12:21.794450] [INFO ] [MAIN ] MMM: Generated 138 derivative records from 53110 primary records. [2025-10-27T22:12:21.794516] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-27T22:12:21.806274] [DEBUG] [LOCAL ] MMM: Derivative data saved (138 records). [2025-10-27T22:12:21.806328] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-27T22:12:21.808916] [INFO ] [MAIN ] Derivative Progress: 1140/1881 symbols completed. MMM took 1.0s. Estimated remaining: 5m 1s. Rate: 147.6 symbols/min [2025-10-27T22:12:21.809501] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:21.809452] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:21.809681] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:21.820960] [DEBUG] [LOCAL ] MMT: Loaded 9961 existing records from primary storage. [2025-10-27T22:12:21.825143] [INFO ] [MAIN ] MMT: Loaded 9961 primary data records. [2025-10-27T22:12:21.910526] [DEBUG] [LOCAL ] MMU: Loaded 16573 existing records from primary storage. [2025-10-27T22:12:21.927703] [INFO ] [MAIN ] MMU: Loaded 16573 primary data records. [2025-10-27T22:12:21.966031] [DEBUG] [LOCAL ] MNR: Loaded 24744 existing records from primary storage. [2025-10-27T22:12:21.991468] [INFO ] [MAIN ] MNR: Loaded 24744 primary data records. [2025-10-27T22:12:22.749218] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:22.800753] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:22.800291] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:22.853591] [INFO ] [MAIN ] MMT: Generated 138 derivative records from 9961 primary records. [2025-10-27T22:12:22.854478] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-27T22:12:22.869281] [DEBUG] [LOCAL ] MMT: Derivative data saved (138 records). [2025-10-27T22:12:22.870354] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-27T22:12:22.873106] [INFO ] [MAIN ] Derivative Progress: 1141/1881 symbols completed. MMT took 1.1s. Estimated remaining: 5m 1s. Rate: 147.4 symbols/min [2025-10-27T22:12:22.873503] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:22.889410] [INFO ] [MAIN ] MNR: Generated 138 derivative records from 24744 primary records. [2025-10-27T22:12:22.889163] [INFO ] [MAIN ] MMU: Generated 138 derivative records from 16573 primary records. [2025-10-27T22:12:22.889530] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-27T22:12:22.889605] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-27T22:12:22.913572] [DEBUG] [LOCAL ] MMU: Derivative data saved (138 records). [2025-10-27T22:12:22.913285] [DEBUG] [LOCAL ] MNR: Derivative data saved (138 records). [2025-10-27T22:12:22.913872] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-27T22:12:22.913759] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-27T22:12:22.916337] [INFO ] [MAIN ] Derivative Progress: 1142/1881 symbols completed. MMU took 1.1s. Estimated remaining: 5m 1s. Rate: 147.5 symbols/min [2025-10-27T22:12:22.919003] [INFO ] [MAIN ] Derivative Progress: 1143/1881 symbols completed. MNR took 1.1s. Estimated remaining: 4m 60s. Rate: 147.6 symbols/min [2025-10-27T22:12:22.918931] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:22.928356] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:22.951445] [DEBUG] [LOCAL ] MNSO: Loaded 43635 existing records from primary storage. [2025-10-27T22:12:22.952171] [INFO ] [MAIN ] MNSO: Loaded 43635 primary data records. [2025-10-27T22:12:23.183101] [DEBUG] [LOCAL ] MOD: Loaded 44245 existing records from primary storage. [2025-10-27T22:12:23.184194] [INFO ] [MAIN ] MOD: Loaded 44245 primary data records. [2025-10-27T22:12:23.330074] [DEBUG] [LOCAL ] MODG: Loaded 51468 existing records from primary storage. [2025-10-27T22:12:23.355340] [INFO ] [MAIN ] MODG: Loaded 51468 primary data records. [2025-10-27T22:12:23.961404] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:24.023341] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:24.024148] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:24.069544] [INFO ] [MAIN ] MNSO: Generated 138 derivative records from 43635 primary records. [2025-10-27T22:12:24.072924] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-27T22:12:24.093886] [DEBUG] [LOCAL ] MNSO: Derivative data saved (138 records). [2025-10-27T22:12:24.094241] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-27T22:12:24.098690] [INFO ] [MAIN ] Derivative Progress: 1144/1881 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 0s. Rate: 147.4 symbols/min [2025-10-27T22:12:24.099815] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:24.120935] [INFO ] [MAIN ] MOD: Generated 138 derivative records from 44245 primary records. [2025-10-27T22:12:24.123932] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-27T22:12:24.124764] [INFO ] [MAIN ] MODG: Generated 138 derivative records from 51468 primary records. [2025-10-27T22:12:24.132134] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-27T22:12:24.136536] [DEBUG] [LOCAL ] MOD: Derivative data saved (138 records). [2025-10-27T22:12:24.144145] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-27T22:12:24.146388] [INFO ] [MAIN ] Derivative Progress: 1145/1881 symbols completed. MOD took 1.2s. Estimated remaining: 4m 59s. Rate: 147.5 symbols/min [2025-10-27T22:12:24.146513] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:24.163726] [DEBUG] [LOCAL ] MODG: Derivative data saved (138 records). [2025-10-27T22:12:24.163858] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-27T22:12:24.166987] [INFO ] [MAIN ] Derivative Progress: 1146/1881 symbols completed. MODG took 1.2s. Estimated remaining: 4m 59s. Rate: 147.6 symbols/min [2025-10-27T22:12:24.168404] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:24.185003] [DEBUG] [LOCAL ] MOH: Loaded 43173 existing records from primary storage. [2025-10-27T22:12:24.185335] [INFO ] [MAIN ] MOH: Loaded 43173 primary data records. [2025-10-27T22:12:24.324822] [DEBUG] [LOCAL ] MOV: Loaded 20617 existing records from primary storage. [2025-10-27T22:12:24.356242] [INFO ] [MAIN ] MOV: Loaded 20617 primary data records. [2025-10-27T22:12:24.607415] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-27T22:12:24.625083] [INFO ] [MAIN ] MOS: Loaded 53511 primary data records. [2025-10-27T22:12:25.238876] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:25.274755] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:25.320470] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:25.363080] [INFO ] [MAIN ] MOH: Generated 138 derivative records from 43173 primary records. [2025-10-27T22:12:25.366001] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-27T22:12:25.386759] [DEBUG] [LOCAL ] MOH: Derivative data saved (138 records). [2025-10-27T22:12:25.388407] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-27T22:12:25.394180] [INFO ] [MAIN ] Derivative Progress: 1147/1881 symbols completed. MOH took 1.3s. Estimated remaining: 4m 59s. Rate: 147.3 symbols/min [2025-10-27T22:12:25.395696] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:25.399503] [INFO ] [MAIN ] MOV: Generated 138 derivative records from 20617 primary records. [2025-10-27T22:12:25.399714] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-27T22:12:25.414225] [DEBUG] [LOCAL ] MOV: Derivative data saved (138 records). [2025-10-27T22:12:25.414361] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-27T22:12:25.416840] [INFO ] [MAIN ] Derivative Progress: 1148/1881 symbols completed. MOV took 1.2s. Estimated remaining: 4m 58s. Rate: 147.5 symbols/min [2025-10-27T22:12:25.419270] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:25.423266] [INFO ] [MAIN ] MOS: Generated 138 derivative records from 53511 primary records. [2025-10-27T22:12:25.423497] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-27T22:12:25.439362] [DEBUG] [LOCAL ] MOS: Derivative data saved (138 records). [2025-10-27T22:12:25.442617] [DEBUG] [LOCAL ] MPA: Loaded 5098 existing records from primary storage. [2025-10-27T22:12:25.442824] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-27T22:12:25.442915] [INFO ] [MAIN ] MPA: Loaded 5098 primary data records. [2025-10-27T22:12:25.446211] [INFO ] [MAIN ] Derivative Progress: 1149/1881 symbols completed. MOS took 1.3s. Estimated remaining: 4m 58s. Rate: 147.6 symbols/min [2025-10-27T22:12:25.451561] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:25.630789] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-27T22:12:25.660857] [INFO ] [MAIN ] MP: Loaded 53744 primary data records. [2025-10-27T22:12:25.991081] [DEBUG] [LOCAL ] MPC: Loaded 51791 existing records from primary storage. [2025-10-27T22:12:26.041671] [INFO ] [MAIN ] MPC: Loaded 51791 primary data records. [2025-10-27T22:12:26.464898] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:26.503819] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:26.556908] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:26.575459] [INFO ] [MAIN ] MPA: Generated 138 derivative records from 5098 primary records. [2025-10-27T22:12:26.577831] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-27T22:12:26.595789] [DEBUG] [LOCAL ] MPA: Derivative data saved (138 records). [2025-10-27T22:12:26.598350] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-27T22:12:26.601292] [INFO ] [MAIN ] Derivative Progress: 1150/1881 symbols completed. MPA took 1.2s. Estimated remaining: 4m 58s. Rate: 147.3 symbols/min [2025-10-27T22:12:26.602278] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:26.614437] [INFO ] [MAIN ] MP: Generated 138 derivative records from 53744 primary records. [2025-10-27T22:12:26.617401] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-27T22:12:26.633882] [DEBUG] [LOCAL ] MP: Derivative data saved (138 records). [2025-10-27T22:12:26.634906] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-27T22:12:26.637304] [INFO ] [MAIN ] Derivative Progress: 1151/1881 symbols completed. MP took 1.2s. Estimated remaining: 4m 57s. Rate: 147.5 symbols/min [2025-10-27T22:12:26.638784] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:26.641701] [INFO ] [MAIN ] MPC: Generated 138 derivative records from 51791 primary records. [2025-10-27T22:12:26.655535] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-27T22:12:26.671593] [DEBUG] [LOCAL ] MPC: Derivative data saved (138 records). [2025-10-27T22:12:26.671814] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-27T22:12:26.674319] [INFO ] [MAIN ] Derivative Progress: 1152/1881 symbols completed. MPC took 1.2s. Estimated remaining: 4m 56s. Rate: 147.6 symbols/min [2025-10-27T22:12:26.674460] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:26.678250] [DEBUG] [LOCAL ] MPV: Loaded 4296 existing records from primary storage. [2025-10-27T22:12:26.678543] [INFO ] [MAIN ] MPV: Loaded 4296 primary data records. [2025-10-27T22:12:26.835814] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-10-27T22:12:26.873447] [INFO ] [MAIN ] MPLX: Loaded 50731 primary data records. [2025-10-27T22:12:27.140390] [DEBUG] [LOCAL ] MPW: Loaded 53481 existing records from primary storage. [2025-10-27T22:12:27.145706] [INFO ] [MAIN ] MPW: Loaded 53481 primary data records. [2025-10-27T22:12:27.624389] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:27.668083] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:27.711354] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:27.713486] [INFO ] [MAIN ] MPV: Generated 138 derivative records from 4296 primary records. [2025-10-27T22:12:27.723723] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-27T22:12:27.741285] [DEBUG] [LOCAL ] MPV: Derivative data saved (138 records). [2025-10-27T22:12:27.743825] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-27T22:12:27.746462] [INFO ] [MAIN ] Derivative Progress: 1153/1881 symbols completed. MPV took 1.1s. Estimated remaining: 4m 56s. Rate: 147.4 symbols/min [2025-10-27T22:12:27.762898] [INFO ] [MAIN ] MPLX: Generated 138 derivative records from 50731 primary records. [2025-10-27T22:12:27.763182] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-27T22:12:27.779969] [DEBUG] [LOCAL ] MPLX: Derivative data saved (138 records). [2025-10-27T22:12:27.782465] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-27T22:12:27.784751] [INFO ] [MAIN ] Derivative Progress: 1154/1881 symbols completed. MPLX took 1.2s. Estimated remaining: 4m 56s. Rate: 147.5 symbols/min [2025-10-27T22:12:27.787333] [INFO ] [MAIN ] MPW: Generated 138 derivative records from 53481 primary records. [2025-10-27T22:12:27.787409] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-27T22:12:27.798631] [DEBUG] [LOCAL ] MPW: Derivative data saved (138 records). [2025-10-27T22:12:27.798712] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-27T22:12:27.801918] [INFO ] [MAIN ] Derivative Progress: 1155/1881 symbols completed. MPW took 1.1s. Estimated remaining: 4m 55s. Rate: 147.6 symbols/min [2025-10-27T22:12:27.802449] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:27.802559] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:27.802698] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:27.812063] [DEBUG] [LOCAL ] MPX: Loaded 3742 existing records from primary storage. [2025-10-27T22:12:27.815985] [INFO ] [MAIN ] MPX: Loaded 3742 primary data records. [2025-10-27T22:12:27.815890] [DEBUG] [LOCAL ] MQT: Loaded 7883 existing records from primary storage. [2025-10-27T22:12:27.846483] [INFO ] [MAIN ] MQT: Loaded 7883 primary data records. [2025-10-27T22:12:28.015085] [DEBUG] [LOCAL ] MQY: Loaded 16443 existing records from primary storage. [2025-10-27T22:12:28.026682] [INFO ] [MAIN ] MQY: Loaded 16443 primary data records. [2025-10-27T22:12:28.847424] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:28.872388] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:28.907418] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:28.977262] [INFO ] [MAIN ] MPX: Generated 138 derivative records from 3742 primary records. [2025-10-27T22:12:28.977702] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-27T22:12:28.980578] [INFO ] [MAIN ] MQT: Generated 138 derivative records from 7883 primary records. [2025-10-27T22:12:28.991480] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-27T22:12:28.994055] [DEBUG] [LOCAL ] MPX: Derivative data saved (138 records). [2025-10-27T22:12:28.994662] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-27T22:12:28.996827] [INFO ] [MAIN ] Derivative Progress: 1156/1881 symbols completed. MPX took 1.2s. Estimated remaining: 4m 55s. Rate: 147.4 symbols/min [2025-10-27T22:12:28.997226] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:29.010060] [DEBUG] [LOCAL ] MQT: Derivative data saved (138 records). [2025-10-27T22:12:29.010663] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-27T22:12:29.013112] [INFO ] [MAIN ] Derivative Progress: 1157/1881 symbols completed. MQT took 1.2s. Estimated remaining: 4m 55s. Rate: 147.5 symbols/min [2025-10-27T22:12:29.015095] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:29.015403] [INFO ] [MAIN ] MQY: Generated 138 derivative records from 16443 primary records. [2025-10-27T22:12:29.016090] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-27T22:12:29.028457] [DEBUG] [LOCAL ] MQY: Derivative data saved (138 records). [2025-10-27T22:12:29.028683] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-27T22:12:29.031206] [INFO ] [MAIN ] Derivative Progress: 1158/1881 symbols completed. MQY took 1.2s. Estimated remaining: 4m 54s. Rate: 147.6 symbols/min [2025-10-27T22:12:29.031467] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:29.058064] [DEBUG] [LOCAL ] MSA: Loaded 18569 existing records from primary storage. [2025-10-27T22:12:29.080036] [INFO ] [MAIN ] MSA: Loaded 18569 primary data records. [2025-10-27T22:12:29.117999] [DEBUG] [LOCAL ] MRC: Loaded 36785 existing records from primary storage. [2025-10-27T22:12:29.137826] [INFO ] [MAIN ] MRC: Loaded 36785 primary data records. [2025-10-27T22:12:29.238797] [DEBUG] [LOCAL ] MS: Loaded 53686 existing records from primary storage. [2025-10-27T22:12:29.272135] [INFO ] [MAIN ] MS: Loaded 53686 primary data records. [2025-10-27T22:12:30.099950] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:30.135479] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:30.165801] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:30.229342] [INFO ] [MAIN ] MSA: Generated 138 derivative records from 18569 primary records. [2025-10-27T22:12:30.231544] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-27T22:12:30.243581] [INFO ] [MAIN ] MRC: Generated 138 derivative records from 36785 primary records. [2025-10-27T22:12:30.246349] [DEBUG] [LOCAL ] MSA: Derivative data saved (138 records). [2025-10-27T22:12:30.246424] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-27T22:12:30.246796] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-27T22:12:30.249129] [INFO ] [MAIN ] Derivative Progress: 1159/1881 symbols completed. MSA took 1.2s. Estimated remaining: 4m 54s. Rate: 147.3 symbols/min [2025-10-27T22:12:30.252182] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:30.263965] [DEBUG] [LOCAL ] MRC: Derivative data saved (138 records). [2025-10-27T22:12:30.266131] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-27T22:12:30.271254] [INFO ] [MAIN ] Derivative Progress: 1160/1881 symbols completed. MRC took 1.3s. Estimated remaining: 4m 53s. Rate: 147.5 symbols/min [2025-10-27T22:12:30.271665] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:30.277963] [INFO ] [MAIN ] MS: Generated 138 derivative records from 53686 primary records. [2025-10-27T22:12:30.278091] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-27T22:12:30.282328] [DEBUG] [LOCAL ] MSB: Loaded 7959 existing records from primary storage. [2025-10-27T22:12:30.282490] [INFO ] [MAIN ] MSB: Loaded 7959 primary data records. [2025-10-27T22:12:30.329233] [DEBUG] [LOCAL ] MS: Derivative data saved (138 records). [2025-10-27T22:12:30.329431] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-27T22:12:30.340382] [INFO ] [MAIN ] Derivative Progress: 1161/1881 symbols completed. MS took 1.3s. Estimated remaining: 4m 53s. Rate: 147.6 symbols/min [2025-10-27T22:12:30.361915] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:30.618945] [DEBUG] [LOCAL ] MSCI: Loaded 33730 existing records from primary storage. [2025-10-27T22:12:30.627850] [INFO ] [MAIN ] MSCI: Loaded 33730 primary data records. [2025-10-27T22:12:30.627582] [DEBUG] [LOCAL ] MSD: Loaded 16589 existing records from primary storage. [2025-10-27T22:12:30.628012] [INFO ] [MAIN ] MSD: Loaded 16589 primary data records. [2025-10-27T22:12:31.254043] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:31.299878] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:31.339235] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:31.369886] [INFO ] [MAIN ] MSB: Generated 138 derivative records from 7959 primary records. [2025-10-27T22:12:31.373347] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-27T22:12:31.390810] [DEBUG] [LOCAL ] MSB: Derivative data saved (138 records). [2025-10-27T22:12:31.391416] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-27T22:12:31.396328] [INFO ] [MAIN ] Derivative Progress: 1162/1881 symbols completed. MSB took 1.1s. Estimated remaining: 4m 53s. Rate: 147.4 symbols/min [2025-10-27T22:12:31.396464] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:31.403927] [INFO ] [MAIN ] MSD: Generated 138 derivative records from 16589 primary records. [2025-10-27T22:12:31.404296] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-27T22:12:31.417236] [DEBUG] [LOCAL ] MSD: Derivative data saved (138 records). [2025-10-27T22:12:31.417406] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-27T22:12:31.422423] [INFO ] [MAIN ] Derivative Progress: 1163/1881 symbols completed. MSD took 1.1s. Estimated remaining: 4m 52s. Rate: 147.5 symbols/min [2025-10-27T22:12:31.422739] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:31.426408] [INFO ] [MAIN ] MSCI: Generated 138 derivative records from 33730 primary records. [2025-10-27T22:12:31.426636] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-27T22:12:31.439070] [DEBUG] [LOCAL ] MSCI: Derivative data saved (138 records). [2025-10-27T22:12:31.448448] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-27T22:12:31.450868] [INFO ] [MAIN ] Derivative Progress: 1164/1881 symbols completed. MSCI took 1.2s. Estimated remaining: 4m 51s. Rate: 147.6 symbols/min [2025-10-27T22:12:31.451122] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:31.479685] [DEBUG] [LOCAL ] MSGE: Loaded 26790 existing records from primary storage. [2025-10-27T22:12:31.484432] [INFO ] [MAIN ] MSGE: Loaded 26790 primary data records. [2025-10-27T22:12:31.497039] [DEBUG] [LOCAL ] MSDL: Loaded 38515 existing records from primary storage. [2025-10-27T22:12:31.517013] [INFO ] [MAIN ] MSDL: Loaded 38515 primary data records. [2025-10-27T22:12:31.589025] [DEBUG] [LOCAL ] MSGS: Loaded 17192 existing records from primary storage. [2025-10-27T22:12:31.602393] [INFO ] [MAIN ] MSGS: Loaded 17192 primary data records. [2025-10-27T22:12:32.513997] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:32.550355] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:32.596150] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:32.646465] [INFO ] [MAIN ] MSGE: Generated 138 derivative records from 26790 primary records. [2025-10-27T22:12:32.650550] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-27T22:12:32.670373] [DEBUG] [LOCAL ] MSGE: Derivative data saved (138 records). [2025-10-27T22:12:32.673955] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-27T22:12:32.678257] [INFO ] [MAIN ] Derivative Progress: 1165/1881 symbols completed. MSGE took 1.3s. Estimated remaining: 4m 52s. Rate: 147.4 symbols/min [2025-10-27T22:12:32.679998] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:32.683592] [INFO ] [MAIN ] MSDL: Generated 138 derivative records from 38515 primary records. [2025-10-27T22:12:32.686998] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-27T22:12:32.699538] [INFO ] [MAIN ] MSGS: Generated 138 derivative records from 17192 primary records. [2025-10-27T22:12:32.705101] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-27T22:12:32.705703] [DEBUG] [LOCAL ] MSDL: Derivative data saved (138 records). [2025-10-27T22:12:32.706111] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-27T22:12:32.710751] [INFO ] [MAIN ] Derivative Progress: 1166/1881 symbols completed. MSDL took 1.3s. Estimated remaining: 4m 51s. Rate: 147.5 symbols/min [2025-10-27T22:12:32.718321] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:32.724903] [DEBUG] [LOCAL ] MSGS: Derivative data saved (138 records). [2025-10-27T22:12:32.725946] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-27T22:12:32.729970] [INFO ] [MAIN ] Derivative Progress: 1167/1881 symbols completed. MSGS took 1.3s. Estimated remaining: 4m 50s. Rate: 147.6 symbols/min [2025-10-27T22:12:32.740264] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:32.757620] [DEBUG] [LOCAL ] MSI: Loaded 39347 existing records from primary storage. [2025-10-27T22:12:32.757826] [INFO ] [MAIN ] MSI: Loaded 39347 primary data records. [2025-10-27T22:12:32.949204] [DEBUG] [LOCAL ] MSM: Loaded 35329 existing records from primary storage. [2025-10-27T22:12:32.989665] [INFO ] [MAIN ] MSM: Loaded 35329 primary data records. [2025-10-27T22:12:33.138898] [DEBUG] [LOCAL ] MT: Loaded 50285 existing records from primary storage. [2025-10-27T22:12:33.164063] [INFO ] [MAIN ] MT: Loaded 50285 primary data records. [2025-10-27T22:12:33.778484] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:33.844152] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:33.879018] [INFO ] [MAIN ] MSI: Generated 138 derivative records from 39347 primary records. [2025-10-27T22:12:33.879439] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-27T22:12:33.879820] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:33.910759] [DEBUG] [LOCAL ] MSI: Derivative data saved (138 records). [2025-10-27T22:12:33.914677] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-27T22:12:33.917780] [INFO ] [MAIN ] Derivative Progress: 1168/1881 symbols completed. MSI took 1.2s. Estimated remaining: 4m 50s. Rate: 147.3 symbols/min [2025-10-27T22:12:33.956975] [INFO ] [MAIN ] MT: Generated 138 derivative records from 50285 primary records. [2025-10-27T22:12:33.959406] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-27T22:12:33.959605] [INFO ] [MAIN ] MSM: Generated 138 derivative records from 35329 primary records. [2025-10-27T22:12:33.960546] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-27T22:12:33.983195] [DEBUG] [LOCAL ] MT: Derivative data saved (138 records). [2025-10-27T22:12:33.984164] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-27T22:12:33.988660] [INFO ] [MAIN ] Derivative Progress: 1169/1881 symbols completed. MT took 1.2s. Estimated remaining: 4m 50s. Rate: 147.5 symbols/min [2025-10-27T22:12:33.990562] [DEBUG] [LOCAL ] MSM: Derivative data saved (138 records). [2025-10-27T22:12:33.990900] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-27T22:12:33.992922] [INFO ] [MAIN ] Derivative Progress: 1170/1881 symbols completed. MSM took 1.3s. Estimated remaining: 4m 49s. Rate: 147.6 symbols/min [2025-10-27T22:12:33.993327] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:33.993722] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:33.993857] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:34.013707] [DEBUG] [LOCAL ] MTD: Loaded 14742 existing records from primary storage. [2025-10-27T22:12:34.013963] [INFO ] [MAIN ] MTD: Loaded 14742 primary data records. [2025-10-27T22:12:34.262857] [DEBUG] [LOCAL ] MTB: Loaded 46518 existing records from primary storage. [2025-10-27T22:12:34.371174] [INFO ] [MAIN ] MTB: Loaded 46518 primary data records. [2025-10-27T22:12:34.372942] [DEBUG] [LOCAL ] MTDR: Loaded 51754 existing records from primary storage. [2025-10-27T22:12:34.426453] [INFO ] [MAIN ] MTDR: Loaded 51754 primary data records. [2025-10-27T22:12:35.091905] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:35.142084] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:35.172213] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:35.229123] [INFO ] [MAIN ] MTD: Generated 138 derivative records from 14742 primary records. [2025-10-27T22:12:35.229915] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-27T22:12:35.260543] [DEBUG] [LOCAL ] MTD: Derivative data saved (138 records). [2025-10-27T22:12:35.262471] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-27T22:12:35.264846] [INFO ] [MAIN ] Derivative Progress: 1171/1881 symbols completed. MTD took 1.3s. Estimated remaining: 4m 49s. Rate: 147.3 symbols/min [2025-10-27T22:12:35.270582] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:35.287312] [INFO ] [MAIN ] MTB: Generated 138 derivative records from 46518 primary records. [2025-10-27T22:12:35.290277] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-27T22:12:35.290098] [INFO ] [MAIN ] MTDR: Generated 138 derivative records from 51754 primary records. [2025-10-27T22:12:35.291289] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-27T22:12:35.304638] [DEBUG] [LOCAL ] MTB: Derivative data saved (138 records). [2025-10-27T22:12:35.315788] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-27T22:12:35.320727] [INFO ] [MAIN ] Derivative Progress: 1172/1881 symbols completed. MTB took 1.3s. Estimated remaining: 4m 49s. Rate: 147.4 symbols/min [2025-10-27T22:12:35.323616] [DEBUG] [LOCAL ] MTDR: Derivative data saved (138 records). [2025-10-27T22:12:35.323782] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:35.324035] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-27T22:12:35.326964] [INFO ] [MAIN ] Derivative Progress: 1173/1881 symbols completed. MTDR took 1.3s. Estimated remaining: 4m 48s. Rate: 147.5 symbols/min [2025-10-27T22:12:35.327625] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:35.362872] [DEBUG] [LOCAL ] MTG: Loaded 51005 existing records from primary storage. [2025-10-27T22:12:35.363203] [INFO ] [MAIN ] MTG: Loaded 51005 primary data records. [2025-10-27T22:12:35.569194] [DEBUG] [LOCAL ] MTN: Loaded 39043 existing records from primary storage. [2025-10-27T22:12:35.589024] [DEBUG] [LOCAL ] MTH: Loaded 43619 existing records from primary storage. [2025-10-27T22:12:35.589796] [INFO ] [MAIN ] MTN: Loaded 39043 primary data records. [2025-10-27T22:12:35.656876] [INFO ] [MAIN ] MTH: Loaded 43619 primary data records. [2025-10-27T22:12:36.410051] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:36.454537] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:36.490427] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:36.513178] [INFO ] [MAIN ] MTG: Generated 138 derivative records from 51005 primary records. [2025-10-27T22:12:36.513491] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-27T22:12:36.531926] [DEBUG] [LOCAL ] MTG: Derivative data saved (138 records). [2025-10-27T22:12:36.533207] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-27T22:12:36.536692] [INFO ] [MAIN ] Derivative Progress: 1174/1881 symbols completed. MTG took 1.3s. Estimated remaining: 4m 48s. Rate: 147.3 symbols/min [2025-10-27T22:12:36.537200] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:36.571286] [DEBUG] [LOCAL ] MTRN: Loaded 17959 existing records from primary storage. [2025-10-27T22:12:36.573672] [INFO ] [MAIN ] MTH: Generated 138 derivative records from 43619 primary records. [2025-10-27T22:12:36.575160] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-27T22:12:36.575237] [INFO ] [MAIN ] MTRN: Loaded 17959 primary data records. [2025-10-27T22:12:36.622018] [DEBUG] [LOCAL ] MTH: Derivative data saved (138 records). [2025-10-27T22:12:36.647151] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-27T22:12:36.650425] [INFO ] [MAIN ] Derivative Progress: 1175/1881 symbols completed. MTH took 1.3s. Estimated remaining: 4m 47s. Rate: 147.4 symbols/min [2025-10-27T22:12:36.634603] [INFO ] [MAIN ] MTN: Generated 138 derivative records from 39043 primary records. [2025-10-27T22:12:36.660033] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:36.672417] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-27T22:12:36.713347] [DEBUG] [LOCAL ] MTN: Derivative data saved (138 records). [2025-10-27T22:12:36.713797] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-27T22:12:36.733252] [INFO ] [MAIN ] Derivative Progress: 1176/1881 symbols completed. MTN took 1.4s. Estimated remaining: 4m 47s. Rate: 147.5 symbols/min [2025-10-27T22:12:36.746196] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:36.933173] [DEBUG] [LOCAL ] MTUS: Loaded 27043 existing records from primary storage. [2025-10-27T22:12:36.941925] [INFO ] [MAIN ] MTUS: Loaded 27043 primary data records. [2025-10-27T22:12:37.062616] [DEBUG] [LOCAL ] MTW: Loaded 26142 existing records from primary storage. [2025-10-27T22:12:37.089193] [INFO ] [MAIN ] MTW: Loaded 26142 primary data records. [2025-10-27T22:12:37.624814] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:37.668855] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:37.708309] [INFO ] [MAIN ] MTRN: Generated 138 derivative records from 17959 primary records. [2025-10-27T22:12:37.722661] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-27T22:12:37.722949] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:37.753407] [DEBUG] [LOCAL ] MTRN: Derivative data saved (138 records). [2025-10-27T22:12:37.754841] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-27T22:12:37.761632] [INFO ] [MAIN ] Derivative Progress: 1177/1881 symbols completed. MTRN took 1.2s. Estimated remaining: 4m 47s. Rate: 147.3 symbols/min [2025-10-27T22:12:37.763759] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:37.775264] [INFO ] [MAIN ] MTUS: Generated 138 derivative records from 27043 primary records. [2025-10-27T22:12:37.775763] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-27T22:12:37.791048] [DEBUG] [LOCAL ] MTUS: Derivative data saved (138 records). [2025-10-27T22:12:37.799485] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-27T22:12:37.803310] [INFO ] [MAIN ] Derivative Progress: 1178/1881 symbols completed. MTUS took 1.1s. Estimated remaining: 4m 46s. Rate: 147.4 symbols/min [2025-10-27T22:12:37.803784] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:37.818432] [INFO ] [MAIN ] MTW: Generated 138 derivative records from 26142 primary records. [2025-10-27T22:12:37.818918] [DEBUG] [LOCAL ] MTX: Loaded 22279 existing records from primary storage. [2025-10-27T22:12:37.819326] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-27T22:12:37.819255] [INFO ] [MAIN ] MTX: Loaded 22279 primary data records. [2025-10-27T22:12:37.900223] [DEBUG] [LOCAL ] MTW: Derivative data saved (138 records). [2025-10-27T22:12:37.906974] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-27T22:12:37.914600] [INFO ] [MAIN ] Derivative Progress: 1179/1881 symbols completed. MTW took 1.2s. Estimated remaining: 4m 46s. Rate: 147.5 symbols/min [2025-10-27T22:12:37.936346] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:38.036415] [DEBUG] [LOCAL ] MTZ: Loaded 42571 existing records from primary storage. [2025-10-27T22:12:38.157516] [INFO ] [MAIN ] MTZ: Loaded 42571 primary data records. [2025-10-27T22:12:38.158513] [DEBUG] [LOCAL ] MUA: Loaded 11426 existing records from primary storage. [2025-10-27T22:12:38.189974] [INFO ] [MAIN ] MUA: Loaded 11426 primary data records. [2025-10-27T22:12:38.845961] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:38.910856] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:38.916198] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:38.970757] [INFO ] [MAIN ] MTX: Generated 138 derivative records from 22279 primary records. [2025-10-27T22:12:38.971546] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-27T22:12:38.987990] [DEBUG] [LOCAL ] MTX: Derivative data saved (138 records). [2025-10-27T22:12:38.994261] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-27T22:12:38.996698] [INFO ] [MAIN ] Derivative Progress: 1180/1881 symbols completed. MTX took 1.2s. Estimated remaining: 4m 46s. Rate: 147.3 symbols/min [2025-10-27T22:12:38.997010] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:39.018375] [INFO ] [MAIN ] MUA: Generated 138 derivative records from 11426 primary records. [2025-10-27T22:12:39.020909] [INFO ] [MAIN ] MTZ: Generated 138 derivative records from 42571 primary records. [2025-10-27T22:12:39.021112] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-27T22:12:39.021892] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-27T22:12:39.050236] [DEBUG] [LOCAL ] MUA: Derivative data saved (138 records). [2025-10-27T22:12:39.053356] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-27T22:12:39.053254] [DEBUG] [LOCAL ] MTZ: Derivative data saved (138 records). [2025-10-27T22:12:39.056349] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-27T22:12:39.056152] [INFO ] [MAIN ] Derivative Progress: 1181/1881 symbols completed. MUA took 1.1s. Estimated remaining: 4m 45s. Rate: 147.4 symbols/min [2025-10-27T22:12:39.059731] [INFO ] [MAIN ] Derivative Progress: 1182/1881 symbols completed. MTZ took 1.3s. Estimated remaining: 4m 44s. Rate: 147.5 symbols/min [2025-10-27T22:12:39.059548] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:39.060018] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:39.060891] [DEBUG] [LOCAL ] MUC: Loaded 20369 existing records from primary storage. [2025-10-27T22:12:39.061840] [INFO ] [MAIN ] MUC: Loaded 20369 primary data records. [2025-10-27T22:12:39.178799] [DEBUG] [LOCAL ] MUE: Loaded 11990 existing records from primary storage. [2025-10-27T22:12:39.179050] [INFO ] [MAIN ] MUE: Loaded 11990 primary data records. [2025-10-27T22:12:39.702899] [DEBUG] [LOCAL ] MUFG: Loaded 52387 existing records from primary storage. [2025-10-27T22:12:39.712484] [INFO ] [MAIN ] MUFG: Loaded 52387 primary data records. [2025-10-27T22:12:40.041798] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:40.094086] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:40.128551] [INFO ] [MAIN ] MUC: Generated 138 derivative records from 20369 primary records. [2025-10-27T22:12:40.135415] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:40.147546] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-27T22:12:40.165365] [DEBUG] [LOCAL ] MUC: Derivative data saved (138 records). [2025-10-27T22:12:40.167927] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-27T22:12:40.170970] [INFO ] [MAIN ] Derivative Progress: 1183/1881 symbols completed. MUC took 1.2s. Estimated remaining: 4m 44s. Rate: 147.3 symbols/min [2025-10-27T22:12:40.197979] [INFO ] [MAIN ] MUE: Generated 138 derivative records from 11990 primary records. [2025-10-27T22:12:40.200381] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-27T22:12:40.215985] [INFO ] [MAIN ] MUFG: Generated 138 derivative records from 52387 primary records. [2025-10-27T22:12:40.216075] [DEBUG] [LOCAL ] MUE: Derivative data saved (138 records). [2025-10-27T22:12:40.216289] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-27T22:12:40.216396] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-27T22:12:40.219967] [INFO ] [MAIN ] Derivative Progress: 1184/1881 symbols completed. MUE took 1.2s. Estimated remaining: 4m 44s. Rate: 147.4 symbols/min [2025-10-27T22:12:40.231749] [DEBUG] [LOCAL ] MUFG: Derivative data saved (138 records). [2025-10-27T22:12:40.231866] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-27T22:12:40.234589] [INFO ] [MAIN ] Derivative Progress: 1185/1881 symbols completed. MUFG took 1.2s. Estimated remaining: 4m 43s. Rate: 147.5 symbols/min [2025-10-27T22:12:40.235008] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:40.235126] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:40.235276] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:40.250478] [DEBUG] [LOCAL ] MUJ: Loaded 13614 existing records from primary storage. [2025-10-27T22:12:40.250730] [INFO ] [MAIN ] MUJ: Loaded 13614 primary data records. [2025-10-27T22:12:40.377571] [DEBUG] [LOCAL ] MUSA: Loaded 24530 existing records from primary storage. [2025-10-27T22:12:40.383411] [INFO ] [MAIN ] MUSA: Loaded 24530 primary data records. [2025-10-27T22:12:40.686258] [DEBUG] [LOCAL ] MUR: Loaded 52812 existing records from primary storage. [2025-10-27T22:12:40.711712] [INFO ] [MAIN ] MUR: Loaded 52812 primary data records. [2025-10-27T22:12:41.278933] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:41.321371] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:41.363376] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:41.416412] [INFO ] [MAIN ] MUJ: Generated 138 derivative records from 13614 primary records. [2025-10-27T22:12:41.418199] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-27T22:12:41.438034] [DEBUG] [LOCAL ] MUJ: Derivative data saved (138 records). [2025-10-27T22:12:41.438268] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-27T22:12:41.443035] [INFO ] [MAIN ] Derivative Progress: 1186/1881 symbols completed. MUJ took 1.2s. Estimated remaining: 4m 43s. Rate: 147.3 symbols/min [2025-10-27T22:12:41.443584] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:41.443372] [INFO ] [MAIN ] MUSA: Generated 138 derivative records from 24530 primary records. [2025-10-27T22:12:41.446227] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-27T22:12:41.462190] [DEBUG] [LOCAL ] MUSA: Derivative data saved (138 records). [2025-10-27T22:12:41.463697] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-27T22:12:41.465903] [INFO ] [MAIN ] Derivative Progress: 1187/1881 symbols completed. MUSA took 1.2s. Estimated remaining: 4m 42s. Rate: 147.4 symbols/min [2025-10-27T22:12:41.468394] [INFO ] [MAIN ] MUR: Generated 138 derivative records from 52812 primary records. [2025-10-27T22:12:41.468625] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:41.469036] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-27T22:12:41.481907] [DEBUG] [LOCAL ] MUR: Derivative data saved (138 records). [2025-10-27T22:12:41.484738] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-27T22:12:41.488120] [INFO ] [MAIN ] Derivative Progress: 1188/1881 symbols completed. MUR took 1.3s. Estimated remaining: 4m 42s. Rate: 147.5 symbols/min [2025-10-27T22:12:41.488392] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:41.503627] [DEBUG] [LOCAL ] MVF: Loaded 12539 existing records from primary storage. [2025-10-27T22:12:41.503787] [INFO ] [MAIN ] MVF: Loaded 12539 primary data records. [2025-10-27T22:12:41.609460] [DEBUG] [LOCAL ] MUX: Loaded 43909 existing records from primary storage. [2025-10-27T22:12:41.598445] [DEBUG] [LOCAL ] MVO: Loaded 8935 existing records from primary storage. [2025-10-27T22:12:41.622603] [INFO ] [MAIN ] MUX: Loaded 43909 primary data records. [2025-10-27T22:12:41.626553] [INFO ] [MAIN ] MVO: Loaded 8935 primary data records. [2025-10-27T22:12:42.489194] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:42.534218] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:42.565960] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:42.668278] [INFO ] [MAIN ] MVF: Generated 138 derivative records from 12539 primary records. [2025-10-27T22:12:42.673135] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-27T22:12:42.688375] [DEBUG] [LOCAL ] MVF: Derivative data saved (138 records). [2025-10-27T22:12:42.689114] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-27T22:12:42.694979] [INFO ] [MAIN ] Derivative Progress: 1189/1881 symbols completed. MVF took 1.2s. Estimated remaining: 4m 42s. Rate: 147.3 symbols/min [2025-10-27T22:12:42.695429] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:42.720089] [DEBUG] [LOCAL ] MVT: Loaded 9507 existing records from primary storage. [2025-10-27T22:12:42.720469] [INFO ] [MAIN ] MVT: Loaded 9507 primary data records. [2025-10-27T22:12:42.724510] [INFO ] [MAIN ] MUX: Generated 138 derivative records from 43909 primary records. [2025-10-27T22:12:42.757253] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-27T22:12:42.830023] [DEBUG] [LOCAL ] MUX: Derivative data saved (138 records). [2025-10-27T22:12:42.836633] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-27T22:12:42.830479] [INFO ] [MAIN ] MVO: Generated 138 derivative records from 8935 primary records. [2025-10-27T22:12:42.850751] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-27T22:12:42.850605] [INFO ] [MAIN ] Derivative Progress: 1190/1881 symbols completed. MUX took 1.4s. Estimated remaining: 4m 41s. Rate: 147.4 symbols/min [2025-10-27T22:12:42.851734] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:42.879944] [DEBUG] [LOCAL ] MVO: Derivative data saved (138 records). [2025-10-27T22:12:42.904238] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-27T22:12:43.048776] [INFO ] [MAIN ] Derivative Progress: 1191/1881 symbols completed. MVO took 1.6s. Estimated remaining: 4m 41s. Rate: 147.4 symbols/min [2025-10-27T22:12:43.062422] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:43.095099] [DEBUG] [LOCAL ] MX: Loaded 22033 existing records from primary storage. [2025-10-27T22:12:43.113374] [DEBUG] [LOCAL ] MWA: Loaded 45519 existing records from primary storage. [2025-10-27T22:12:43.113575] [INFO ] [MAIN ] MX: Loaded 22033 primary data records. [2025-10-27T22:12:43.113980] [INFO ] [MAIN ] MWA: Loaded 45519 primary data records. [2025-10-27T22:12:43.217700] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:43.797824] [INFO ] [MAIN ] MVT: Generated 138 derivative records from 9507 primary records. [2025-10-27T22:12:43.798279] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-27T22:12:43.810850] [DEBUG] [LOCAL ] MVT: Derivative data saved (138 records). [2025-10-27T22:12:43.811297] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-27T22:12:43.814603] [INFO ] [MAIN ] Derivative Progress: 1192/1881 symbols completed. MVT took 1.1s. Estimated remaining: 4m 41s. Rate: 147.3 symbols/min [2025-10-27T22:12:43.815727] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:43.832868] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:43.860114] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:43.877733] [DEBUG] [LOCAL ] MXF: Loaded 5454 existing records from primary storage. [2025-10-27T22:12:43.879393] [INFO ] [MAIN ] MXF: Loaded 5454 primary data records. [2025-10-27T22:12:44.220802] [INFO ] [MAIN ] MX: Generated 138 derivative records from 22033 primary records. [2025-10-27T22:12:44.221000] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-27T22:12:44.238816] [DEBUG] [LOCAL ] MX: Derivative data saved (138 records). [2025-10-27T22:12:44.239282] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-27T22:12:44.242310] [INFO ] [MAIN ] Derivative Progress: 1193/1881 symbols completed. MX took 1.2s. Estimated remaining: 4m 40s. Rate: 147.3 symbols/min [2025-10-27T22:12:44.242683] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:44.245052] [INFO ] [MAIN ] MWA: Generated 138 derivative records from 45519 primary records. [2025-10-27T22:12:44.245935] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-27T22:12:44.258763] [DEBUG] [LOCAL ] MWA: Derivative data saved (138 records). [2025-10-27T22:12:44.258978] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-27T22:12:44.261888] [INFO ] [MAIN ] Derivative Progress: 1194/1881 symbols completed. MWA took 1.4s. Estimated remaining: 4m 40s. Rate: 147.4 symbols/min [2025-10-27T22:12:44.262097] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:44.275277] [DEBUG] [LOCAL ] MYD: Loaded 13008 existing records from primary storage. [2025-10-27T22:12:44.275570] [INFO ] [MAIN ] MYD: Loaded 13008 primary data records. [2025-10-27T22:12:44.327156] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:44.454820] [DEBUG] [LOCAL ] MYE: Loaded 23771 existing records from primary storage. [2025-10-27T22:12:44.505225] [INFO ] [MAIN ] MYE: Loaded 23771 primary data records. [2025-10-27T22:12:45.018400] [INFO ] [MAIN ] MXF: Generated 138 derivative records from 5454 primary records. [2025-10-27T22:12:45.019854] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-27T22:12:45.032002] [DEBUG] [LOCAL ] MXF: Derivative data saved (138 records). [2025-10-27T22:12:45.032257] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-27T22:12:45.035407] [INFO ] [MAIN ] Derivative Progress: 1195/1881 symbols completed. MXF took 1.2s. Estimated remaining: 4m 39s. Rate: 147.3 symbols/min [2025-10-27T22:12:45.036066] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:45.053597] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:45.087955] [DEBUG] [LOCAL ] MYI: Loaded 19169 existing records from primary storage. [2025-10-27T22:12:45.089885] [INFO ] [MAIN ] MYI: Loaded 19169 primary data records. [2025-10-27T22:12:45.105378] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:45.307036] [INFO ] [MAIN ] MYD: Generated 138 derivative records from 13008 primary records. [2025-10-27T22:12:45.334594] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-27T22:12:45.469195] [DEBUG] [LOCAL ] MYD: Derivative data saved (138 records). [2025-10-27T22:12:45.469927] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-27T22:12:45.472267] [INFO ] [MAIN ] Derivative Progress: 1196/1881 symbols completed. MYD took 1.2s. Estimated remaining: 4m 39s. Rate: 147.3 symbols/min [2025-10-27T22:12:45.474710] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:45.479364] [INFO ] [MAIN ] MYE: Generated 138 derivative records from 23771 primary records. [2025-10-27T22:12:45.480146] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-27T22:12:45.497214] [DEBUG] [LOCAL ] MYE: Derivative data saved (138 records). [2025-10-27T22:12:45.502061] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-27T22:12:45.501872] [DEBUG] [LOCAL ] MYN: Loaded 9807 existing records from primary storage. [2025-10-27T22:12:45.505357] [INFO ] [MAIN ] Derivative Progress: 1197/1881 symbols completed. MYE took 1.2s. Estimated remaining: 4m 38s. Rate: 147.4 symbols/min [2025-10-27T22:12:45.505708] [INFO ] [MAIN ] MYN: Loaded 9807 primary data records. [2025-10-27T22:12:45.505557] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:45.834536] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:45.858599] [DEBUG] [LOCAL ] NABL: Loaded 38498 existing records from primary storage. [2025-10-27T22:12:45.861747] [INFO ] [MAIN ] NABL: Loaded 38498 primary data records. [2025-10-27T22:12:46.180580] [INFO ] [MAIN ] MYI: Generated 138 derivative records from 19169 primary records. [2025-10-27T22:12:46.189300] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-27T22:12:46.195144] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:46.221615] [DEBUG] [LOCAL ] MYI: Derivative data saved (138 records). [2025-10-27T22:12:46.223716] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-27T22:12:46.226095] [INFO ] [MAIN ] Derivative Progress: 1198/1881 symbols completed. MYI took 1.2s. Estimated remaining: 4m 38s. Rate: 147.3 symbols/min [2025-10-27T22:12:46.246170] [INFO ] [MAIN ] MYN: Generated 138 derivative records from 9807 primary records. [2025-10-27T22:12:46.246496] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-27T22:12:46.261445] [DEBUG] [LOCAL ] MYN: Derivative data saved (138 records). [2025-10-27T22:12:46.275236] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-27T22:12:46.280191] [INFO ] [MAIN ] Derivative Progress: 1199/1881 symbols completed. MYN took 0.8s. Estimated remaining: 4m 38s. Rate: 147.4 symbols/min [2025-10-27T22:12:46.275160] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:46.307714] [INFO ] [MAIN ] NABL: Generated 138 derivative records from 38498 primary records. [2025-10-27T22:12:46.307804] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-27T22:12:46.319064] [DEBUG] [LOCAL ] NABL: Derivative data saved (138 records). [2025-10-27T22:12:46.319122] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-27T22:12:46.321444] [INFO ] [MAIN ] Derivative Progress: 1200/1881 symbols completed. NABL took 0.8s. Estimated remaining: 4m 37s. Rate: 147.5 symbols/min [2025-10-27T22:12:46.322019] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:46.322116] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:46.322925] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:46.332737] [DEBUG] [LOCAL ] NAN: Loaded 8376 existing records from primary storage. [2025-10-27T22:12:46.332917] [INFO ] [MAIN ] NAN: Loaded 8376 primary data records. [2025-10-27T22:12:46.465621] [DEBUG] [LOCAL ] NAC: Loaded 24309 existing records from primary storage. [2025-10-27T22:12:46.465863] [INFO ] [MAIN ] NAC: Loaded 24309 primary data records. [2025-10-27T22:12:46.466322] [DEBUG] [LOCAL ] NAD: Loaded 33119 existing records from primary storage. [2025-10-27T22:12:46.478117] [INFO ] [MAIN ] NAD: Loaded 33119 primary data records. [2025-10-27T22:12:47.362778] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:47.410550] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:47.444762] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:47.472708] [INFO ] [MAIN ] NAN: Generated 138 derivative records from 8376 primary records. [2025-10-27T22:12:47.475818] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-27T22:12:47.501590] [DEBUG] [LOCAL ] NAN: Derivative data saved (138 records). [2025-10-27T22:12:47.501777] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-27T22:12:47.507486] [INFO ] [MAIN ] Derivative Progress: 1201/1881 symbols completed. NAN took 1.2s. Estimated remaining: 4m 37s. Rate: 147.3 symbols/min [2025-10-27T22:12:47.507885] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:47.523879] [INFO ] [MAIN ] NAD: Generated 138 derivative records from 33119 primary records. [2025-10-27T22:12:47.524166] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-27T22:12:47.540344] [DEBUG] [LOCAL ] NAD: Derivative data saved (138 records). [2025-10-27T22:12:47.540589] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-27T22:12:47.543384] [INFO ] [MAIN ] Derivative Progress: 1202/1881 symbols completed. NAD took 1.2s. Estimated remaining: 4m 36s. Rate: 147.4 symbols/min [2025-10-27T22:12:47.543575] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:47.560348] [INFO ] [MAIN ] NAC: Generated 138 derivative records from 24309 primary records. [2025-10-27T22:12:47.560582] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-27T22:12:47.574056] [DEBUG] [LOCAL ] NAC: Derivative data saved (138 records). [2025-10-27T22:12:47.588592] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-27T22:12:47.593232] [INFO ] [MAIN ] Derivative Progress: 1203/1881 symbols completed. NAC took 1.3s. Estimated remaining: 4m 36s. Rate: 147.5 symbols/min [2025-10-27T22:12:47.593718] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:47.595284] [DEBUG] [LOCAL ] NAT: Loaded 49154 existing records from primary storage. [2025-10-27T22:12:47.595564] [INFO ] [MAIN ] NAT: Loaded 49154 primary data records. [2025-10-27T22:12:47.653976] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-27T22:12:47.687109] [INFO ] [MAIN ] NAZ: Loaded 2646 primary data records. [2025-10-27T22:12:47.774924] [DEBUG] [LOCAL ] NATL: Loaded 31608 existing records from primary storage. [2025-10-27T22:12:47.793131] [INFO ] [MAIN ] NATL: Loaded 31608 primary data records. [2025-10-27T22:12:48.565764] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:48.607313] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:48.634562] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:48.691622] [INFO ] [MAIN ] NAT: Generated 138 derivative records from 49154 primary records. [2025-10-27T22:12:48.696895] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-27T22:12:48.712664] [DEBUG] [LOCAL ] NAT: Derivative data saved (138 records). [2025-10-27T22:12:48.715094] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-27T22:12:48.718023] [INFO ] [MAIN ] Derivative Progress: 1204/1881 symbols completed. NAT took 1.2s. Estimated remaining: 4m 36s. Rate: 147.3 symbols/min [2025-10-27T22:12:48.718176] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:48.724438] [INFO ] [MAIN ] NAZ: Generated 138 derivative records from 2646 primary records. [2025-10-27T22:12:48.727064] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-27T22:12:48.744066] [DEBUG] [LOCAL ] NBB: Loaded 8889 existing records from primary storage. [2025-10-27T22:12:48.743676] [DEBUG] [LOCAL ] NAZ: Derivative data saved (138 records). [2025-10-27T22:12:48.744282] [INFO ] [MAIN ] NBB: Loaded 8889 primary data records. [2025-10-27T22:12:48.744428] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-27T22:12:48.749384] [INFO ] [MAIN ] Derivative Progress: 1205/1881 symbols completed. NAZ took 1.2s. Estimated remaining: 4m 35s. Rate: 147.4 symbols/min [2025-10-27T22:12:48.749803] [INFO ] [MAIN ] NATL: Generated 138 derivative records from 31608 primary records. [2025-10-27T22:12:48.755774] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-27T22:12:48.761909] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:48.831338] [DEBUG] [LOCAL ] NATL: Derivative data saved (138 records). [2025-10-27T22:12:48.831471] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-27T22:12:48.845295] [INFO ] [MAIN ] Derivative Progress: 1206/1881 symbols completed. NATL took 1.3s. Estimated remaining: 4m 35s. Rate: 147.5 symbols/min [2025-10-27T22:12:48.866373] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:49.105491] [DEBUG] [LOCAL ] NBHC: Loaded 23555 existing records from primary storage. [2025-10-27T22:12:49.105638] [INFO ] [MAIN ] NBHC: Loaded 23555 primary data records. [2025-10-27T22:12:49.221590] [DEBUG] [LOCAL ] NBR: Loaded 34163 existing records from primary storage. [2025-10-27T22:12:49.222597] [INFO ] [MAIN ] NBR: Loaded 34163 primary data records. [2025-10-27T22:12:49.752199] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:49.801420] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:49.847058] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:49.849429] [INFO ] [MAIN ] NBB: Generated 138 derivative records from 8889 primary records. [2025-10-27T22:12:49.849534] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-27T22:12:49.879732] [DEBUG] [LOCAL ] NBB: Derivative data saved (138 records). [2025-10-27T22:12:49.882529] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-27T22:12:49.885400] [INFO ] [MAIN ] Derivative Progress: 1207/1881 symbols completed. NBB took 1.2s. Estimated remaining: 4m 35s. Rate: 147.3 symbols/min [2025-10-27T22:12:49.887491] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:49.927290] [DEBUG] [LOCAL ] NBXG: Loaded 21220 existing records from primary storage. [2025-10-27T22:12:49.928028] [INFO ] [MAIN ] NBHC: Generated 138 derivative records from 23555 primary records. [2025-10-27T22:12:49.928734] [INFO ] [MAIN ] NBXG: Loaded 21220 primary data records. [2025-10-27T22:12:49.928392] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-27T22:12:50.011425] [DEBUG] [LOCAL ] NBHC: Derivative data saved (138 records). [2025-10-27T22:12:50.011597] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-27T22:12:50.030378] [INFO ] [MAIN ] Derivative Progress: 1208/1881 symbols completed. NBHC took 1.3s. Estimated remaining: 4m 34s. Rate: 147.4 symbols/min [2025-10-27T22:12:50.036238] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:50.128794] [DEBUG] [LOCAL ] NC: Loaded 1839 existing records from primary storage. [2025-10-27T22:12:50.122363] [INFO ] [MAIN ] NBR: Generated 138 derivative records from 34163 primary records. [2025-10-27T22:12:50.234829] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-27T22:12:50.234770] [INFO ] [MAIN ] NC: Loaded 1839 primary data records. [2025-10-27T22:12:50.336673] [DEBUG] [LOCAL ] NBR: Derivative data saved (138 records). [2025-10-27T22:12:50.337985] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-27T22:12:50.363302] [INFO ] [MAIN ] Derivative Progress: 1209/1881 symbols completed. NBR took 1.5s. Estimated remaining: 4m 33s. Rate: 147.4 symbols/min [2025-10-27T22:12:50.366985] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:50.565523] [DEBUG] [LOCAL ] NCA: Loaded 9447 existing records from primary storage. [2025-10-27T22:12:50.565941] [INFO ] [MAIN ] NCA: Loaded 9447 primary data records. [2025-10-27T22:12:50.731700] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:50.967744] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:50.992857] [INFO ] [MAIN ] NBXG: Generated 138 derivative records from 21220 primary records. [2025-10-27T22:12:50.994439] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-27T22:12:51.012150] [DEBUG] [LOCAL ] NBXG: Derivative data saved (138 records). [2025-10-27T22:12:51.012455] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-27T22:12:51.014769] [INFO ] [MAIN ] Derivative Progress: 1210/1881 symbols completed. NBXG took 1.1s. Estimated remaining: 4m 33s. Rate: 147.3 symbols/min [2025-10-27T22:12:51.014988] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:51.031670] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:51.063162] [INFO ] [MAIN ] NC: Generated 138 derivative records from 1839 primary records. [2025-10-27T22:12:51.063767] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-27T22:12:51.071792] [DEBUG] [LOCAL ] NCDL: Loaded 21391 existing records from primary storage. [2025-10-27T22:12:51.084470] [DEBUG] [LOCAL ] NC: Derivative data saved (138 records). [2025-10-27T22:12:51.084586] [INFO ] [MAIN ] NCDL: Loaded 21391 primary data records. [2025-10-27T22:12:51.084777] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-27T22:12:51.099474] [INFO ] [MAIN ] Derivative Progress: 1211/1881 symbols completed. NC took 1.1s. Estimated remaining: 4m 33s. Rate: 147.4 symbols/min [2025-10-27T22:12:51.124823] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:51.243308] [INFO ] [MAIN ] NCA: Generated 138 derivative records from 9447 primary records. [2025-10-27T22:12:51.286808] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-27T22:12:51.412428] [DEBUG] [LOCAL ] NCV: Loaded 13799 existing records from primary storage. [2025-10-27T22:12:51.413822] [INFO ] [MAIN ] NCV: Loaded 13799 primary data records. [2025-10-27T22:12:51.447473] [DEBUG] [LOCAL ] NCA: Derivative data saved (138 records). [2025-10-27T22:12:51.447623] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-27T22:12:51.450954] [INFO ] [MAIN ] Derivative Progress: 1212/1881 symbols completed. NCA took 1.1s. Estimated remaining: 4m 32s. Rate: 147.5 symbols/min [2025-10-27T22:12:51.463862] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:51.556543] [DEBUG] [LOCAL ] NCZ: Loaded 12075 existing records from primary storage. [2025-10-27T22:12:51.556810] [INFO ] [MAIN ] NCZ: Loaded 12075 primary data records. [2025-10-27T22:12:52.089063] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:52.142421] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:52.167502] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:52.187695] [INFO ] [MAIN ] NCDL: Generated 138 derivative records from 21391 primary records. [2025-10-27T22:12:52.188163] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-27T22:12:52.206036] [DEBUG] [LOCAL ] NCDL: Derivative data saved (138 records). [2025-10-27T22:12:52.207710] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-27T22:12:52.211127] [INFO ] [MAIN ] Derivative Progress: 1213/1881 symbols completed. NCDL took 1.2s. Estimated remaining: 4m 32s. Rate: 147.4 symbols/min [2025-10-27T22:12:52.238070] [INFO ] [MAIN ] NCZ: Generated 138 derivative records from 12075 primary records. [2025-10-27T22:12:52.240913] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-27T22:12:52.255243] [DEBUG] [LOCAL ] NCZ: Derivative data saved (138 records). [2025-10-27T22:12:52.257167] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-27T22:12:52.260030] [INFO ] [MAIN ] Derivative Progress: 1214/1881 symbols completed. NCZ took 0.8s. Estimated remaining: 4m 31s. Rate: 147.5 symbols/min [2025-10-27T22:12:52.260854] [INFO ] [MAIN ] NCV: Generated 138 derivative records from 13799 primary records. [2025-10-27T22:12:52.261067] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-27T22:12:52.273963] [DEBUG] [LOCAL ] NCV: Derivative data saved (138 records). [2025-10-27T22:12:52.274081] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-27T22:12:52.278609] [INFO ] [MAIN ] Derivative Progress: 1215/1881 symbols completed. NCV took 1.2s. Estimated remaining: 4m 31s. Rate: 147.6 symbols/min [2025-10-27T22:12:52.279311] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:52.279175] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:52.279440] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:52.298574] [DEBUG] [LOCAL ] NDMO: Loaded 16721 existing records from primary storage. [2025-10-27T22:12:52.298744] [INFO ] [MAIN ] NDMO: Loaded 16721 primary data records. [2025-10-27T22:12:52.461579] [DEBUG] [LOCAL ] NEA: Loaded 34773 existing records from primary storage. [2025-10-27T22:12:52.482227] [INFO ] [MAIN ] NEA: Loaded 34773 primary data records. [2025-10-27T22:12:52.726017] [DEBUG] [LOCAL ] NE: Loaded 52277 existing records from primary storage. [2025-10-27T22:12:52.738283] [INFO ] [MAIN ] NE: Loaded 52277 primary data records. [2025-10-27T22:12:53.327193] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:53.371117] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:53.403315] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:53.450314] [INFO ] [MAIN ] NDMO: Generated 138 derivative records from 16721 primary records. [2025-10-27T22:12:53.452690] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-27T22:12:53.475033] [DEBUG] [LOCAL ] NDMO: Derivative data saved (138 records). [2025-10-27T22:12:53.475186] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-27T22:12:53.477787] [INFO ] [MAIN ] Derivative Progress: 1216/1881 symbols completed. NDMO took 1.2s. Estimated remaining: 4m 31s. Rate: 147.3 symbols/min [2025-10-27T22:12:53.483533] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:53.499761] [INFO ] [MAIN ] NE: Generated 138 derivative records from 52277 primary records. [2025-10-27T22:12:53.503198] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-27T22:12:53.520903] [DEBUG] [LOCAL ] NE: Derivative data saved (138 records). [2025-10-27T22:12:53.515900] [INFO ] [MAIN ] NEA: Generated 138 derivative records from 34773 primary records. [2025-10-27T22:12:53.521161] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-27T22:12:53.524214] [INFO ] [MAIN ] Derivative Progress: 1217/1881 symbols completed. NE took 1.2s. Estimated remaining: 4m 30s. Rate: 147.5 symbols/min [2025-10-27T22:12:53.524687] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:53.524341] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-27T22:12:53.553349] [DEBUG] [LOCAL ] NEA: Derivative data saved (138 records). [2025-10-27T22:12:53.553589] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-27T22:12:53.557337] [INFO ] [MAIN ] Derivative Progress: 1218/1881 symbols completed. NEA took 1.3s. Estimated remaining: 4m 30s. Rate: 147.6 symbols/min [2025-10-27T22:12:53.557863] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:53.579956] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-27T22:12:53.580406] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-10-27T22:12:53.918796] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-27T22:12:53.928557] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-10-27T22:12:54.012504] [DEBUG] [LOCAL ] NET: Loaded 52707 existing records from primary storage. [2025-10-27T22:12:54.035406] [INFO ] [MAIN ] NET: Loaded 52707 primary data records. [2025-10-27T22:12:54.555289] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:54.609553] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:54.645201] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:54.660223] [INFO ] [MAIN ] NEE: Generated 138 derivative records from 53707 primary records. [2025-10-27T22:12:54.665404] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-27T22:12:54.680247] [DEBUG] [LOCAL ] NEE: Derivative data saved (138 records). [2025-10-27T22:12:54.681714] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-27T22:12:54.688143] [INFO ] [MAIN ] Derivative Progress: 1219/1881 symbols completed. NEE took 1.2s. Estimated remaining: 4m 30s. Rate: 147.3 symbols/min [2025-10-27T22:12:54.691567] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:54.716609] [DEBUG] [LOCAL ] NEU: Loaded 8561 existing records from primary storage. [2025-10-27T22:12:54.718675] [INFO ] [MAIN ] NEU: Loaded 8561 primary data records. [2025-10-27T22:12:54.814048] [INFO ] [MAIN ] NEM: Generated 138 derivative records from 53708 primary records. [2025-10-27T22:12:54.819828] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-27T22:12:54.839886] [INFO ] [MAIN ] NET: Generated 138 derivative records from 52707 primary records. [2025-10-27T22:12:54.862794] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-27T22:12:54.924448] [DEBUG] [LOCAL ] NEM: Derivative data saved (138 records). [2025-10-27T22:12:54.927099] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-27T22:12:54.933386] [INFO ] [MAIN ] Derivative Progress: 1220/1881 symbols completed. NEM took 1.4s. Estimated remaining: 4m 29s. Rate: 147.4 symbols/min [2025-10-27T22:12:55.045031] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:55.061932] [DEBUG] [LOCAL ] NET: Derivative data saved (138 records). [2025-10-27T22:12:55.062365] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-27T22:12:55.066760] [INFO ] [MAIN ] Derivative Progress: 1221/1881 symbols completed. NET took 1.5s. Estimated remaining: 4m 29s. Rate: 147.5 symbols/min [2025-10-27T22:12:55.067773] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:55.075037] [DEBUG] [LOCAL ] NEXA: Loaded 5888 existing records from primary storage. [2025-10-27T22:12:55.075358] [INFO ] [MAIN ] NEXA: Loaded 5888 primary data records. [2025-10-27T22:12:55.468824] [DEBUG] [LOCAL ] NFG: Loaded 38029 existing records from primary storage. [2025-10-27T22:12:55.470184] [INFO ] [MAIN ] NFG: Loaded 38029 primary data records. [2025-10-27T22:12:55.547545] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:55.872052] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:55.896583] [INFO ] [MAIN ] NEU: Generated 138 derivative records from 8561 primary records. [2025-10-27T22:12:55.897031] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-27T22:12:55.912975] [DEBUG] [LOCAL ] NEU: Derivative data saved (138 records). [2025-10-27T22:12:55.914359] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-27T22:12:55.916510] [INFO ] [MAIN ] Derivative Progress: 1222/1881 symbols completed. NEU took 1.2s. Estimated remaining: 4m 28s. Rate: 147.3 symbols/min [2025-10-27T22:12:55.920365] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:55.939330] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:55.969905] [INFO ] [MAIN ] NEXA: Generated 138 derivative records from 5888 primary records. [2025-10-27T22:12:55.976801] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-27T22:12:55.982549] [DEBUG] [LOCAL ] NFJ: Loaded 19477 existing records from primary storage. [2025-10-27T22:12:55.997581] [DEBUG] [LOCAL ] NEXA: Derivative data saved (138 records). [2025-10-27T22:12:55.999226] [INFO ] [MAIN ] NFJ: Loaded 19477 primary data records. [2025-10-27T22:12:56.020508] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-27T22:12:56.039159] [INFO ] [MAIN ] Derivative Progress: 1223/1881 symbols completed. NEXA took 1.0s. Estimated remaining: 4m 28s. Rate: 147.4 symbols/min [2025-10-27T22:12:56.092447] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:56.339887] [INFO ] [MAIN ] NFG: Generated 138 derivative records from 38029 primary records. [2025-10-27T22:12:56.340167] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-27T22:12:56.354111] [DEBUG] [LOCAL ] NFG: Derivative data saved (138 records). [2025-10-27T22:12:56.365957] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-27T22:12:56.368957] [INFO ] [MAIN ] Derivative Progress: 1224/1881 symbols completed. NFG took 1.3s. Estimated remaining: 4m 27s. Rate: 147.5 symbols/min [2025-10-27T22:12:56.369558] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:56.389839] [DEBUG] [LOCAL ] NGG: Loaded 46547 existing records from primary storage. [2025-10-27T22:12:56.390332] [INFO ] [MAIN ] NGG: Loaded 46547 primary data records. [2025-10-27T22:12:56.524402] [DEBUG] [LOCAL ] NGL: Loaded 29498 existing records from primary storage. [2025-10-27T22:12:56.525109] [INFO ] [MAIN ] NGL: Loaded 29498 primary data records. [2025-10-27T22:12:56.603464] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:57.123694] [INFO ] [MAIN ] NFJ: Generated 138 derivative records from 19477 primary records. [2025-10-27T22:12:57.124222] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-27T22:12:57.141866] [DEBUG] [LOCAL ] NFJ: Derivative data saved (138 records). [2025-10-27T22:12:57.142202] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-27T22:12:57.144766] [INFO ] [MAIN ] Derivative Progress: 1225/1881 symbols completed. NFJ took 1.2s. Estimated remaining: 4m 27s. Rate: 147.3 symbols/min [2025-10-27T22:12:57.145213] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:57.160715] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:57.188478] [DEBUG] [LOCAL ] NGS: Loaded 10558 existing records from primary storage. [2025-10-27T22:12:57.197496] [INFO ] [MAIN ] NGS: Loaded 10558 primary data records. [2025-10-27T22:12:57.211352] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:57.630720] [INFO ] [MAIN ] NGG: Generated 138 derivative records from 46547 primary records. [2025-10-27T22:12:57.634004] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-27T22:12:57.651067] [DEBUG] [LOCAL ] NGG: Derivative data saved (138 records). [2025-10-27T22:12:57.652833] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-27T22:12:57.654987] [INFO ] [MAIN ] NGL: Generated 138 derivative records from 29498 primary records. [2025-10-27T22:12:57.657412] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-27T22:12:57.657321] [INFO ] [MAIN ] Derivative Progress: 1226/1881 symbols completed. NGG took 1.6s. Estimated remaining: 4m 27s. Rate: 147.3 symbols/min [2025-10-27T22:12:57.659548] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:57.674183] [DEBUG] [LOCAL ] NGL: Derivative data saved (138 records). [2025-10-27T22:12:57.674445] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-27T22:12:57.677324] [INFO ] [MAIN ] Derivative Progress: 1227/1881 symbols completed. NGL took 1.3s. Estimated remaining: 4m 26s. Rate: 147.4 symbols/min [2025-10-27T22:12:57.677555] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:57.691367] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:57.737404] [DEBUG] [LOCAL ] NGVC: Loaded 22651 existing records from primary storage. [2025-10-27T22:12:57.747280] [DEBUG] [LOCAL ] NGVT: Loaded 23282 existing records from primary storage. [2025-10-27T22:12:57.747563] [INFO ] [MAIN ] NGVT: Loaded 23282 primary data records. [2025-10-27T22:12:57.746433] [INFO ] [MAIN ] NGVC: Loaded 22651 primary data records. [2025-10-27T22:12:57.947601] [INFO ] [MAIN ] NGS: Generated 138 derivative records from 10558 primary records. [2025-10-27T22:12:57.961288] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-27T22:12:58.266346] [DEBUG] [LOCAL ] NGS: Derivative data saved (138 records). [2025-10-27T22:12:58.279427] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-27T22:12:58.382776] [INFO ] [MAIN ] Derivative Progress: 1228/1881 symbols completed. NGS took 1.2s. Estimated remaining: 4m 26s. Rate: 147.3 symbols/min [2025-10-27T22:12:58.429276] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:58.453174] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:58.507573] [INFO ] [MAIN ] NGVC: Generated 138 derivative records from 22651 primary records. [2025-10-27T22:12:58.509546] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-27T22:12:58.509453] [INFO ] [MAIN ] NGVT: Generated 138 derivative records from 23282 primary records. [2025-10-27T22:12:58.510283] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-27T22:12:58.533754] [DEBUG] [LOCAL ] NGVC: Derivative data saved (138 records). [2025-10-27T22:12:58.535530] [DEBUG] [LOCAL ] NGVT: Derivative data saved (138 records). [2025-10-27T22:12:58.535707] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-27T22:12:58.538410] [INFO ] [MAIN ] Derivative Progress: 1229/1881 symbols completed. NGVC took 0.9s. Estimated remaining: 4m 25s. Rate: 147.4 symbols/min [2025-10-27T22:12:58.538502] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-27T22:12:58.541074] [INFO ] [MAIN ] Derivative Progress: 1230/1881 symbols completed. NGVT took 0.9s. Estimated remaining: 4m 25s. Rate: 147.5 symbols/min [2025-10-27T22:12:58.541555] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:58.541489] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:58.542222] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:58.553298] [DEBUG] [LOCAL ] NIC: Loaded 9015 existing records from primary storage. [2025-10-27T22:12:58.553423] [INFO ] [MAIN ] NIC: Loaded 9015 primary data records. [2025-10-27T22:12:58.686600] [DEBUG] [LOCAL ] NHI: Loaded 21545 existing records from primary storage. [2025-10-27T22:12:58.721055] [INFO ] [MAIN ] NHI: Loaded 21545 primary data records. [2025-10-27T22:12:58.933308] [DEBUG] [LOCAL ] NI: Loaded 53401 existing records from primary storage. [2025-10-27T22:12:58.955051] [INFO ] [MAIN ] NI: Loaded 53401 primary data records. [2025-10-27T22:12:59.579883] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:59.625078] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:12:59.662921] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:12:59.682098] [INFO ] [MAIN ] NIC: Generated 138 derivative records from 9015 primary records. [2025-10-27T22:12:59.684153] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-27T22:12:59.703581] [DEBUG] [LOCAL ] NIC: Derivative data saved (138 records). [2025-10-27T22:12:59.703699] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-27T22:12:59.707673] [INFO ] [MAIN ] Derivative Progress: 1231/1881 symbols completed. NIC took 1.2s. Estimated remaining: 4m 25s. Rate: 147.3 symbols/min [2025-10-27T22:12:59.709562] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:12:59.737056] [DEBUG] [LOCAL ] NIE: Loaded 11698 existing records from primary storage. [2025-10-27T22:12:59.738080] [INFO ] [MAIN ] NIE: Loaded 11698 primary data records. [2025-10-27T22:12:59.751549] [INFO ] [MAIN ] NHI: Generated 138 derivative records from 21545 primary records. [2025-10-27T22:12:59.751702] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-27T22:12:59.870025] [INFO ] [MAIN ] NI: Generated 138 derivative records from 53401 primary records. [2025-10-27T22:12:59.862808] [DEBUG] [LOCAL ] NHI: Derivative data saved (138 records). [2025-10-27T22:12:59.885634] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-27T22:12:59.909683] [INFO ] [MAIN ] Derivative Progress: 1232/1881 symbols completed. NHI took 1.4s. Estimated remaining: 4m 24s. Rate: 147.4 symbols/min [2025-10-27T22:12:59.907471] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-27T22:12:59.934264] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:00.063944] [DEBUG] [LOCAL ] NI: Derivative data saved (138 records). [2025-10-27T22:13:00.064297] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-27T22:13:00.067628] [INFO ] [MAIN ] Derivative Progress: 1233/1881 symbols completed. NI took 1.5s. Estimated remaining: 4m 24s. Rate: 147.4 symbols/min [2025-10-27T22:13:00.067903] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:00.071266] [DEBUG] [LOCAL ] NIM: Loaded 3486 existing records from primary storage. [2025-10-27T22:13:00.071530] [INFO ] [MAIN ] NIM: Loaded 3486 primary data records. [2025-10-27T22:13:00.398761] [DEBUG] [LOCAL ] NINE: Loaded 28917 existing records from primary storage. [2025-10-27T22:13:00.400472] [INFO ] [MAIN ] NINE: Loaded 28917 primary data records. [2025-10-27T22:13:00.562967] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:00.838540] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:00.874903] [INFO ] [MAIN ] NIE: Generated 138 derivative records from 11698 primary records. [2025-10-27T22:13:00.878145] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-27T22:13:00.902903] [DEBUG] [LOCAL ] NIE: Derivative data saved (138 records). [2025-10-27T22:13:00.903548] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-27T22:13:00.906030] [INFO ] [MAIN ] Derivative Progress: 1234/1881 symbols completed. NIE took 1.2s. Estimated remaining: 4m 24s. Rate: 147.3 symbols/min [2025-10-27T22:13:00.906394] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:00.927757] [INFO ] [MAIN ] NIM: Generated 138 derivative records from 3486 primary records. [2025-10-27T22:13:00.927995] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:00.939100] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-27T22:13:00.956574] [DEBUG] [LOCAL ] NIM: Derivative data saved (138 records). [2025-10-27T22:13:00.960061] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-27T22:13:00.962858] [INFO ] [MAIN ] Derivative Progress: 1235/1881 symbols completed. NIM took 1.0s. Estimated remaining: 4m 23s. Rate: 147.4 symbols/min [2025-10-27T22:13:00.964437] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:00.994107] [INFO ] [MAIN ] NINE: Generated 138 derivative records from 28917 primary records. [2025-10-27T22:13:00.994427] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-27T22:13:01.007214] [DEBUG] [LOCAL ] NINE: Derivative data saved (138 records). [2025-10-27T22:13:01.022779] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-27T22:13:01.033749] [INFO ] [MAIN ] Derivative Progress: 1236/1881 symbols completed. NINE took 1.0s. Estimated remaining: 4m 22s. Rate: 147.5 symbols/min [2025-10-27T22:13:01.035184] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-27T22:13:01.035402] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:01.035852] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-27T22:13:01.150136] [DEBUG] [LOCAL ] NJR: Loaded 37537 existing records from primary storage. [2025-10-27T22:13:01.177506] [INFO ] [MAIN ] NJR: Loaded 37537 primary data records. [2025-10-27T22:13:01.194132] [DEBUG] [LOCAL ] NKX: Loaded 13566 existing records from primary storage. [2025-10-27T22:13:01.243850] [INFO ] [MAIN ] NKX: Loaded 13566 primary data records. [2025-10-27T22:13:02.139494] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:02.188897] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:02.207973] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:02.264287] [INFO ] [MAIN ] NIO: Generated 138 derivative records from 53802 primary records. [2025-10-27T22:13:02.264749] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-27T22:13:02.282494] [DEBUG] [LOCAL ] NIO: Derivative data saved (138 records). [2025-10-27T22:13:02.283124] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-27T22:13:02.288261] [INFO ] [MAIN ] Derivative Progress: 1237/1881 symbols completed. NIO took 1.4s. Estimated remaining: 4m 22s. Rate: 147.3 symbols/min [2025-10-27T22:13:02.289673] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:02.293013] [INFO ] [MAIN ] NJR: Generated 138 derivative records from 37537 primary records. [2025-10-27T22:13:02.294686] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-27T22:13:02.309935] [DEBUG] [LOCAL ] NJR: Derivative data saved (138 records). [2025-10-27T22:13:02.310258] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-27T22:13:02.313000] [INFO ] [MAIN ] Derivative Progress: 1238/1881 symbols completed. NJR took 1.3s. Estimated remaining: 4m 22s. Rate: 147.4 symbols/min [2025-10-27T22:13:02.316255] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:02.320395] [INFO ] [MAIN ] NKX: Generated 138 derivative records from 13566 primary records. [2025-10-27T22:13:02.324949] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-27T22:13:02.325940] [DEBUG] [LOCAL ] NLOP: Loaded 11254 existing records from primary storage. [2025-10-27T22:13:02.333235] [INFO ] [MAIN ] NLOP: Loaded 11254 primary data records. [2025-10-27T22:13:02.349018] [DEBUG] [LOCAL ] NKX: Derivative data saved (138 records). [2025-10-27T22:13:02.374107] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-27T22:13:02.394270] [INFO ] [MAIN ] Derivative Progress: 1239/1881 symbols completed. NKX took 1.4s. Estimated remaining: 4m 21s. Rate: 147.5 symbols/min [2025-10-27T22:13:02.394530] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:02.541681] [DEBUG] [LOCAL ] NMAI: Loaded 12392 existing records from primary storage. [2025-10-27T22:13:02.642834] [INFO ] [MAIN ] NMAI: Loaded 12392 primary data records. [2025-10-27T22:13:02.778178] [DEBUG] [LOCAL ] NLY: Loaded 53563 existing records from primary storage. [2025-10-27T22:13:02.778536] [INFO ] [MAIN ] NLY: Loaded 53563 primary data records. [2025-10-27T22:13:03.316215] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:03.361386] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:03.408478] [INFO ] [MAIN ] NLOP: Generated 138 derivative records from 11254 primary records. [2025-10-27T22:13:03.409728] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-27T22:13:03.409308] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:03.439691] [DEBUG] [LOCAL ] NLOP: Derivative data saved (138 records). [2025-10-27T22:13:03.442699] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-27T22:13:03.446168] [INFO ] [MAIN ] Derivative Progress: 1240/1881 symbols completed. NLOP took 1.2s. Estimated remaining: 4m 21s. Rate: 147.3 symbols/min [2025-10-27T22:13:03.446569] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:03.475992] [INFO ] [MAIN ] NMAI: Generated 138 derivative records from 12392 primary records. [2025-10-27T22:13:03.477861] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-27T22:13:03.477577] [DEBUG] [LOCAL ] NMCO: Loaded 16170 existing records from primary storage. [2025-10-27T22:13:03.478883] [INFO ] [MAIN ] NMCO: Loaded 16170 primary data records. [2025-10-27T22:13:03.556410] [DEBUG] [LOCAL ] NMAI: Derivative data saved (138 records). [2025-10-27T22:13:03.561826] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-27T22:13:03.565742] [INFO ] [MAIN ] Derivative Progress: 1241/1881 symbols completed. NMAI took 1.2s. Estimated remaining: 4m 21s. Rate: 147.4 symbols/min [2025-10-27T22:13:03.577441] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:03.716734] [DEBUG] [LOCAL ] NMG: Loaded 12703 existing records from primary storage. [2025-10-27T22:13:03.833953] [INFO ] [MAIN ] NLY: Generated 138 derivative records from 53563 primary records. [2025-10-27T22:13:03.847063] [INFO ] [MAIN ] NMG: Loaded 12703 primary data records. [2025-10-27T22:13:03.847170] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-27T22:13:03.952085] [DEBUG] [LOCAL ] NLY: Derivative data saved (138 records). [2025-10-27T22:13:03.962887] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-27T22:13:03.981687] [INFO ] [MAIN ] Derivative Progress: 1242/1881 symbols completed. NLY took 1.7s. Estimated remaining: 4m 20s. Rate: 147.4 symbols/min [2025-10-27T22:13:04.005903] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:04.182137] [DEBUG] [LOCAL ] NMI: Loaded 3954 existing records from primary storage. [2025-10-27T22:13:04.183081] [INFO ] [MAIN ] NMI: Loaded 3954 primary data records. [2025-10-27T22:13:04.351382] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:04.545965] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:04.589895] [INFO ] [MAIN ] NMCO: Generated 138 derivative records from 16170 primary records. [2025-10-27T22:13:04.590338] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:04.590767] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-27T22:13:04.622529] [DEBUG] [LOCAL ] NMCO: Derivative data saved (138 records). [2025-10-27T22:13:04.622818] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-27T22:13:04.625052] [INFO ] [MAIN ] Derivative Progress: 1243/1881 symbols completed. NMCO took 1.2s. Estimated remaining: 4m 20s. Rate: 147.3 symbols/min [2025-10-27T22:13:04.650377] [INFO ] [MAIN ] NMG: Generated 138 derivative records from 12703 primary records. [2025-10-27T22:13:04.650639] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-27T22:13:04.663549] [DEBUG] [LOCAL ] NMG: Derivative data saved (138 records). [2025-10-27T22:13:04.663779] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-27T22:13:04.668537] [INFO ] [MAIN ] Derivative Progress: 1244/1881 symbols completed. NMG took 1.1s. Estimated remaining: 4m 19s. Rate: 147.4 symbols/min [2025-10-27T22:13:04.672008] [INFO ] [MAIN ] NMI: Generated 138 derivative records from 3954 primary records. [2025-10-27T22:13:04.672192] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-27T22:13:04.683623] [DEBUG] [LOCAL ] NMI: Derivative data saved (138 records). [2025-10-27T22:13:04.683714] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-27T22:13:04.686407] [INFO ] [MAIN ] Derivative Progress: 1245/1881 symbols completed. NMI took 0.7s. Estimated remaining: 4m 19s. Rate: 147.5 symbols/min [2025-10-27T22:13:04.686856] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:04.686988] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:04.686914] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:04.692749] [DEBUG] [LOCAL ] NMS: Loaded 2909 existing records from primary storage. [2025-10-27T22:13:04.692952] [INFO ] [MAIN ] NMS: Loaded 2909 primary data records. [2025-10-27T22:13:04.829079] [DEBUG] [LOCAL ] NMM: Loaded 13796 existing records from primary storage. [2025-10-27T22:13:04.829274] [INFO ] [MAIN ] NMM: Loaded 13796 primary data records. [2025-10-27T22:13:05.035919] [DEBUG] [LOCAL ] NMR: Loaded 35173 existing records from primary storage. [2025-10-27T22:13:05.194443] [INFO ] [MAIN ] NMR: Loaded 35173 primary data records. [2025-10-27T22:13:05.696006] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:05.737514] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:05.773222] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:05.801597] [INFO ] [MAIN ] NMS: Generated 138 derivative records from 2909 primary records. [2025-10-27T22:13:05.807033] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-27T22:13:05.818374] [DEBUG] [LOCAL ] NMS: Derivative data saved (138 records). [2025-10-27T22:13:05.820365] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-27T22:13:05.825377] [INFO ] [MAIN ] Derivative Progress: 1246/1881 symbols completed. NMS took 1.1s. Estimated remaining: 4m 19s. Rate: 147.3 symbols/min [2025-10-27T22:13:05.826206] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:05.836107] [DEBUG] [LOCAL ] NMT: Loaded 2779 existing records from primary storage. [2025-10-27T22:13:05.838694] [INFO ] [MAIN ] NMT: Loaded 2779 primary data records. [2025-10-27T22:13:05.953080] [INFO ] [MAIN ] NMM: Generated 138 derivative records from 13796 primary records. [2025-10-27T22:13:05.953805] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-27T22:13:06.026109] [INFO ] [MAIN ] NMR: Generated 138 derivative records from 35173 primary records. [2025-10-27T22:13:06.048864] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-27T22:13:06.205700] [DEBUG] [LOCAL ] NMM: Derivative data saved (138 records). [2025-10-27T22:13:06.225911] [DEBUG] [LOCAL ] NMR: Derivative data saved (138 records). [2025-10-27T22:13:06.224325] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-27T22:13:06.226026] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-27T22:13:06.228972] [INFO ] [MAIN ] Derivative Progress: 1247/1881 symbols completed. NMR took 1.5s. Estimated remaining: 4m 18s. Rate: 147.3 symbols/min [2025-10-27T22:13:06.231820] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:06.232013] [INFO ] [MAIN ] Derivative Progress: 1248/1881 symbols completed. NMM took 1.5s. Estimated remaining: 4m 18s. Rate: 147.4 symbols/min [2025-10-27T22:13:06.232628] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:06.252454] [DEBUG] [LOCAL ] NNI: Loaded 10437 existing records from primary storage. [2025-10-27T22:13:06.253013] [INFO ] [MAIN ] NNI: Loaded 10437 primary data records. [2025-10-27T22:13:06.332922] [DEBUG] [LOCAL ] NMZ: Loaded 20790 existing records from primary storage. [2025-10-27T22:13:06.340115] [INFO ] [MAIN ] NMZ: Loaded 20790 primary data records. [2025-10-27T22:13:06.397120] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:13:06.923934] [INFO ] [MAIN ] NMT: Generated 138 derivative records from 2779 primary records. [2025-10-27T22:13:06.925543] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-27T22:13:06.949319] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:06.949048] [DEBUG] [LOCAL ] NMT: Derivative data saved (138 records). [2025-10-27T22:13:06.961485] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-27T22:13:06.966600] [INFO ] [MAIN ] Derivative Progress: 1249/1881 symbols completed. NMT took 1.1s. Estimated remaining: 4m 17s. Rate: 147.3 symbols/min [2025-10-27T22:13:06.968695] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:06.988460] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:07.035991] [INFO ] [MAIN ] NNI: Generated 138 derivative records from 10437 primary records. [2025-10-27T22:13:07.036371] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-27T22:13:07.052602] [DEBUG] [LOCAL ] NNN: Loaded 47984 existing records from primary storage. [2025-10-27T22:13:07.060083] [INFO ] [MAIN ] NNN: Loaded 47984 primary data records. [2025-10-27T22:13:07.076108] [DEBUG] [LOCAL ] NNI: Derivative data saved (138 records). [2025-10-27T22:13:07.120351] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-27T22:13:07.138302] [INFO ] [MAIN ] Derivative Progress: 1250/1881 symbols completed. NNI took 0.9s. Estimated remaining: 4m 17s. Rate: 147.4 symbols/min [2025-10-27T22:13:07.169915] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:07.250279] [INFO ] [MAIN ] NMZ: Generated 138 derivative records from 20790 primary records. [2025-10-27T22:13:07.258466] [DEBUG] [LOCAL ] NNY: Loaded 5772 existing records from primary storage. [2025-10-27T22:13:07.355720] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-27T22:13:07.363318] [INFO ] [MAIN ] NNY: Loaded 5772 primary data records. [2025-10-27T22:13:07.420592] [DEBUG] [LOCAL ] NMZ: Derivative data saved (138 records). [2025-10-27T22:13:07.455003] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-27T22:13:07.480727] [INFO ] [MAIN ] Derivative Progress: 1251/1881 symbols completed. NMZ took 1.2s. Estimated remaining: 4m 16s. Rate: 147.4 symbols/min [2025-10-27T22:13:07.486912] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:07.709456] [DEBUG] [LOCAL ] NOA: Loaded 15472 existing records from primary storage. [2025-10-27T22:13:07.710345] [INFO ] [MAIN ] NOA: Loaded 15472 primary data records. [2025-10-27T22:13:07.832088] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:08.126306] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:08.155758] [INFO ] [MAIN ] NNN: Generated 138 derivative records from 47984 primary records. [2025-10-27T22:13:08.157251] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-27T22:13:08.175356] [DEBUG] [LOCAL ] NNN: Derivative data saved (138 records). [2025-10-27T22:13:08.183557] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-27T22:13:08.190907] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:08.190506] [INFO ] [MAIN ] Derivative Progress: 1252/1881 symbols completed. NNN took 1.2s. Estimated remaining: 4m 16s. Rate: 147.3 symbols/min [2025-10-27T22:13:08.202908] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:08.238239] [DEBUG] [LOCAL ] NOAH: Loaded 19278 existing records from primary storage. [2025-10-27T22:13:08.244865] [INFO ] [MAIN ] NOAH: Loaded 19278 primary data records. [2025-10-27T22:13:08.243900] [INFO ] [MAIN ] NNY: Generated 138 derivative records from 5772 primary records. [2025-10-27T22:13:08.245053] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-27T22:13:08.349367] [DEBUG] [LOCAL ] NNY: Derivative data saved (138 records). [2025-10-27T22:13:08.360473] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-27T22:13:08.371305] [INFO ] [MAIN ] NOA: Generated 138 derivative records from 15472 primary records. [2025-10-27T22:13:08.363391] [INFO ] [MAIN ] Derivative Progress: 1253/1881 symbols completed. NNY took 1.2s. Estimated remaining: 4m 16s. Rate: 147.4 symbols/min [2025-10-27T22:13:08.376599] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-27T22:13:08.387291] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:08.421980] [DEBUG] [LOCAL ] NOA: Derivative data saved (138 records). [2025-10-27T22:13:08.434861] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-27T22:13:08.454074] [INFO ] [MAIN ] Derivative Progress: 1254/1881 symbols completed. NOA took 1.0s. Estimated remaining: 4m 15s. Rate: 147.5 symbols/min [2025-10-27T22:13:08.454264] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:08.622279] [DEBUG] [LOCAL ] NOC: Loaded 41335 existing records from primary storage. [2025-10-27T22:13:08.622701] [INFO ] [MAIN ] NOC: Loaded 41335 primary data records. [2025-10-27T22:13:08.661018] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:08.776234] [DEBUG] [LOCAL ] NOG: Loaded 51328 existing records from primary storage. [2025-10-27T22:13:08.805237] [INFO ] [MAIN ] NOG: Loaded 51328 primary data records. [2025-10-27T22:13:09.480638] [INFO ] [MAIN ] NOAH: Generated 138 derivative records from 19278 primary records. [2025-10-27T22:13:09.499539] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-27T22:13:09.544815] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:09.569606] [DEBUG] [LOCAL ] NOAH: Derivative data saved (138 records). [2025-10-27T22:13:09.571576] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-27T22:13:09.578250] [INFO ] [MAIN ] Derivative Progress: 1255/1881 symbols completed. NOAH took 1.4s. Estimated remaining: 4m 15s. Rate: 147.3 symbols/min [2025-10-27T22:13:09.585570] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:09.616462] [INFO ] [MAIN ] NOC: Generated 138 derivative records from 41335 primary records. [2025-10-27T22:13:09.618516] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-27T22:13:09.680879] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:09.680071] [DEBUG] [LOCAL ] NOC: Derivative data saved (138 records). [2025-10-27T22:13:09.702079] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-27T22:13:09.708763] [INFO ] [MAIN ] Derivative Progress: 1256/1881 symbols completed. NOC took 1.3s. Estimated remaining: 4m 14s. Rate: 147.4 symbols/min [2025-10-27T22:13:09.709341] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:09.742329] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-27T22:13:09.744880] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-27T22:13:09.911699] [INFO ] [MAIN ] NOG: Generated 138 derivative records from 51328 primary records. [2025-10-27T22:13:09.912242] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-27T22:13:09.977751] [DEBUG] [LOCAL ] NOG: Derivative data saved (138 records). [2025-10-27T22:13:10.142732] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-27T22:13:10.158779] [DEBUG] [LOCAL ] NOMD: Loaded 43215 existing records from primary storage. [2025-10-27T22:13:10.159193] [INFO ] [MAIN ] NOMD: Loaded 43215 primary data records. [2025-10-27T22:13:10.187851] [INFO ] [MAIN ] Derivative Progress: 1257/1881 symbols completed. NOG took 1.7s. Estimated remaining: 4m 14s. Rate: 147.3 symbols/min [2025-10-27T22:13:10.224717] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:10.547186] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:10.547891] [DEBUG] [LOCAL ] NOTE: Loaded 39249 existing records from primary storage. [2025-10-27T22:13:10.558847] [INFO ] [MAIN ] NOTE: Loaded 39249 primary data records. [2025-10-27T22:13:10.885376] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:10.923032] [INFO ] [MAIN ] NOK: Generated 138 derivative records from 53622 primary records. [2025-10-27T22:13:10.923702] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-27T22:13:10.938183] [DEBUG] [LOCAL ] NOK: Derivative data saved (138 records). [2025-10-27T22:13:10.938534] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-27T22:13:10.940746] [INFO ] [MAIN ] Derivative Progress: 1258/1881 symbols completed. NOK took 1.4s. Estimated remaining: 4m 14s. Rate: 147.2 symbols/min [2025-10-27T22:13:10.952359] [INFO ] [MAIN ] NOMD: Generated 138 derivative records from 43215 primary records. [2025-10-27T22:13:10.952625] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-27T22:13:10.965551] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:10.990315] [DEBUG] [LOCAL ] NOMD: Derivative data saved (138 records). [2025-10-27T22:13:10.991497] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-27T22:13:10.996353] [INFO ] [MAIN ] Derivative Progress: 1259/1881 symbols completed. NOMD took 1.3s. Estimated remaining: 4m 13s. Rate: 147.3 symbols/min [2025-10-27T22:13:11.007309] [INFO ] [MAIN ] NOTE: Generated 138 derivative records from 39249 primary records. [2025-10-27T22:13:11.007421] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-27T22:13:11.017624] [DEBUG] [LOCAL ] NOTE: Derivative data saved (138 records). [2025-10-27T22:13:11.017763] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-27T22:13:11.020473] [INFO ] [MAIN ] Derivative Progress: 1260/1881 symbols completed. NOTE took 0.8s. Estimated remaining: 4m 13s. Rate: 147.5 symbols/min [2025-10-27T22:13:11.021075] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:11.021267] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:11.021206] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:11.046566] [DEBUG] [LOCAL ] NPCT: Loaded 16200 existing records from primary storage. [2025-10-27T22:13:11.046871] [INFO ] [MAIN ] NPCT: Loaded 16200 primary data records. [2025-10-27T22:13:11.393496] [DEBUG] [LOCAL ] NOW: Loaded 47604 existing records from primary storage. [2025-10-27T22:13:11.407445] [INFO ] [MAIN ] NOW: Loaded 47604 primary data records. [2025-10-27T22:13:11.408610] [DEBUG] [LOCAL ] NOV: Loaded 53159 existing records from primary storage. [2025-10-27T22:13:11.442911] [INFO ] [MAIN ] NOV: Loaded 53159 primary data records. [2025-10-27T22:13:12.062788] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:12.112322] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:12.140762] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:12.171126] [INFO ] [MAIN ] NPCT: Generated 138 derivative records from 16200 primary records. [2025-10-27T22:13:12.173919] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-27T22:13:12.190022] [DEBUG] [LOCAL ] NPCT: Derivative data saved (138 records). [2025-10-27T22:13:12.192906] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-27T22:13:12.195250] [INFO ] [MAIN ] Derivative Progress: 1261/1881 symbols completed. NPCT took 1.2s. Estimated remaining: 4m 13s. Rate: 147.2 symbols/min [2025-10-27T22:13:12.196573] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:12.212513] [INFO ] [MAIN ] NOW: Generated 138 derivative records from 47604 primary records. [2025-10-27T22:13:12.212693] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-27T22:13:12.229269] [DEBUG] [LOCAL ] NOW: Derivative data saved (138 records). [2025-10-27T22:13:12.224889] [DEBUG] [LOCAL ] NPFD: Loaded 9868 existing records from primary storage. [2025-10-27T22:13:12.232008] [INFO ] [MAIN ] NPFD: Loaded 9868 primary data records. [2025-10-27T22:13:12.231906] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-27T22:13:12.234421] [INFO ] [MAIN ] Derivative Progress: 1262/1881 symbols completed. NOW took 1.2s. Estimated remaining: 4m 12s. Rate: 147.3 symbols/min [2025-10-27T22:13:12.254791] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:12.359350] [DEBUG] [LOCAL ] NPK: Loaded 8398 existing records from primary storage. [2025-10-27T22:13:12.364694] [INFO ] [MAIN ] NPK: Loaded 8398 primary data records. [2025-10-27T22:13:12.350364] [INFO ] [MAIN ] NOV: Generated 138 derivative records from 53159 primary records. [2025-10-27T22:13:12.375115] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-27T22:13:12.716330] [DEBUG] [LOCAL ] NOV: Derivative data saved (138 records). [2025-10-27T22:13:12.716900] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-27T22:13:12.723514] [INFO ] [MAIN ] Derivative Progress: 1263/1881 symbols completed. NOV took 1.7s. Estimated remaining: 4m 12s. Rate: 147.3 symbols/min [2025-10-27T22:13:12.723949] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:12.958906] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:12.970277] [DEBUG] [LOCAL ] NPKI: Loaded 40227 existing records from primary storage. [2025-10-27T22:13:12.971912] [INFO ] [MAIN ] NPKI: Loaded 40227 primary data records. [2025-10-27T22:13:13.292311] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:13.324389] [INFO ] [MAIN ] NPFD: Generated 138 derivative records from 9868 primary records. [2025-10-27T22:13:13.324746] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-27T22:13:13.341018] [DEBUG] [LOCAL ] NPFD: Derivative data saved (138 records). [2025-10-27T22:13:13.341181] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-27T22:13:13.343060] [INFO ] [MAIN ] Derivative Progress: 1264/1881 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 11s. Rate: 147.3 symbols/min [2025-10-27T22:13:13.343742] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:13.352367] [INFO ] [MAIN ] NPK: Generated 138 derivative records from 8398 primary records. [2025-10-27T22:13:13.352637] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-27T22:13:13.369819] [DEBUG] [LOCAL ] NPK: Derivative data saved (138 records). [2025-10-27T22:13:13.370055] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-27T22:13:13.372363] [INFO ] [MAIN ] Derivative Progress: 1265/1881 symbols completed. NPK took 1.1s. Estimated remaining: 4m 11s. Rate: 147.4 symbols/min [2025-10-27T22:13:13.372746] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:13.390793] [DEBUG] [MAIN ] NPKI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:13.391216] [DEBUG] [LOCAL ] NPO: Loaded 13385 existing records from primary storage. [2025-10-27T22:13:13.402481] [INFO ] [MAIN ] NPO: Loaded 13385 primary data records. [2025-10-27T22:13:13.510702] [DEBUG] [LOCAL ] NPV: Loaded 5319 existing records from primary storage. [2025-10-27T22:13:13.514723] [INFO ] [MAIN ] NPV: Loaded 5319 primary data records. [2025-10-27T22:13:14.028021] [INFO ] [MAIN ] NPKI: Generated 138 derivative records from 40227 primary records. [2025-10-27T22:13:14.029030] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-27T22:13:14.043257] [DEBUG] [LOCAL ] NPKI: Derivative data saved (138 records). [2025-10-27T22:13:14.043536] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-27T22:13:14.046780] [INFO ] [MAIN ] Derivative Progress: 1266/1881 symbols completed. NPKI took 1.3s. Estimated remaining: 4m 11s. Rate: 147.3 symbols/min [2025-10-27T22:13:14.046922] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:14.071369] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:14.131916] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:14.166310] [DEBUG] [LOCAL ] NPWR: Loaded 43554 existing records from primary storage. [2025-10-27T22:13:14.166774] [INFO ] [MAIN ] NPWR: Loaded 43554 primary data records. [2025-10-27T22:13:14.239533] [INFO ] [MAIN ] NPO: Generated 138 derivative records from 13385 primary records. [2025-10-27T22:13:14.257953] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-27T22:13:14.337280] [DEBUG] [LOCAL ] NPO: Derivative data saved (138 records). [2025-10-27T22:13:14.349974] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-27T22:13:14.473627] [INFO ] [MAIN ] Derivative Progress: 1267/1881 symbols completed. NPO took 1.1s. Estimated remaining: 4m 10s. Rate: 147.3 symbols/min [2025-10-27T22:13:14.487820] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:14.505670] [DEBUG] [LOCAL ] NQP: Loaded 8934 existing records from primary storage. [2025-10-27T22:13:14.506053] [INFO ] [MAIN ] NQP: Loaded 8934 primary data records. [2025-10-27T22:13:14.544596] [INFO ] [MAIN ] NPV: Generated 138 derivative records from 5319 primary records. [2025-10-27T22:13:14.595772] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-27T22:13:14.626938] [DEBUG] [LOCAL ] NPV: Derivative data saved (138 records). [2025-10-27T22:13:14.632873] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-27T22:13:14.646935] [INFO ] [MAIN ] Derivative Progress: 1268/1881 symbols completed. NPV took 1.3s. Estimated remaining: 4m 10s. Rate: 147.3 symbols/min [2025-10-27T22:13:14.657689] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:14.876876] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:14.917676] [DEBUG] [LOCAL ] NRDY: Loaded 32049 existing records from primary storage. [2025-10-27T22:13:14.920866] [INFO ] [MAIN ] NRDY: Loaded 32049 primary data records. [2025-10-27T22:13:15.116004] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:15.256224] [INFO ] [MAIN ] NPWR: Generated 138 derivative records from 43554 primary records. [2025-10-27T22:13:15.257487] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-27T22:13:15.277114] [DEBUG] [LOCAL ] NPWR: Derivative data saved (138 records). [2025-10-27T22:13:15.278078] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-27T22:13:15.280860] [INFO ] [MAIN ] Derivative Progress: 1269/1881 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 9s. Rate: 147.3 symbols/min [2025-10-27T22:13:15.282317] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:15.298990] [DEBUG] [LOCAL ] NREF: Loaded 7696 existing records from primary storage. [2025-10-27T22:13:15.299280] [INFO ] [MAIN ] NREF: Loaded 7696 primary data records. [2025-10-27T22:13:15.435027] [INFO ] [MAIN ] NQP: Generated 138 derivative records from 8934 primary records. [2025-10-27T22:13:15.435602] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:15.446469] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-27T22:13:15.559372] [DEBUG] [LOCAL ] NQP: Derivative data saved (138 records). [2025-10-27T22:13:15.559539] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-27T22:13:15.562000] [INFO ] [MAIN ] Derivative Progress: 1270/1881 symbols completed. NQP took 1.1s. Estimated remaining: 4m 9s. Rate: 147.3 symbols/min [2025-10-27T22:13:15.672756] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:15.710857] [INFO ] [MAIN ] NRDY: Generated 138 derivative records from 32049 primary records. [2025-10-27T22:13:15.711050] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-27T22:13:15.734522] [DEBUG] [LOCAL ] NRDY: Derivative data saved (138 records). [2025-10-27T22:13:15.734791] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-27T22:13:15.737417] [INFO ] [MAIN ] Derivative Progress: 1271/1881 symbols completed. NRDY took 1.1s. Estimated remaining: 4m 8s. Rate: 147.4 symbols/min [2025-10-27T22:13:15.737808] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:15.751952] [DEBUG] [LOCAL ] NRGV: Loaded 44049 existing records from primary storage. [2025-10-27T22:13:15.752391] [INFO ] [MAIN ] NRGV: Loaded 44049 primary data records. [2025-10-27T22:13:15.927032] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:15.935724] [DEBUG] [LOCAL ] NRK: Loaded 20288 existing records from primary storage. [2025-10-27T22:13:15.966889] [INFO ] [MAIN ] NRK: Loaded 20288 primary data records. [2025-10-27T22:13:16.418494] [INFO ] [MAIN ] NREF: Generated 138 derivative records from 7696 primary records. [2025-10-27T22:13:16.419146] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-27T22:13:16.432078] [DEBUG] [LOCAL ] NREF: Derivative data saved (138 records). [2025-10-27T22:13:16.432297] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-27T22:13:16.435245] [INFO ] [MAIN ] Derivative Progress: 1272/1881 symbols completed. NREF took 1.2s. Estimated remaining: 4m 8s. Rate: 147.3 symbols/min [2025-10-27T22:13:16.436244] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:16.456374] [DEBUG] [LOCAL ] NRP: Loaded 4026 existing records from primary storage. [2025-10-27T22:13:16.456599] [INFO ] [MAIN ] NRP: Loaded 4026 primary data records. [2025-10-27T22:13:16.493959] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:16.620989] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:16.884048] [INFO ] [MAIN ] NRGV: Generated 138 derivative records from 44049 primary records. [2025-10-27T22:13:16.885903] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-27T22:13:16.904823] [DEBUG] [LOCAL ] NRGV: Derivative data saved (138 records). [2025-10-27T22:13:16.906441] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-27T22:13:16.909034] [INFO ] [MAIN ] Derivative Progress: 1273/1881 symbols completed. NRGV took 1.2s. Estimated remaining: 4m 8s. Rate: 147.3 symbols/min [2025-10-27T22:13:16.906800] [INFO ] [MAIN ] NRK: Generated 138 derivative records from 20288 primary records. [2025-10-27T22:13:16.909186] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-27T22:13:16.934060] [DEBUG] [LOCAL ] NRK: Derivative data saved (138 records). [2025-10-27T22:13:16.934153] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-27T22:13:16.936892] [INFO ] [MAIN ] Derivative Progress: 1274/1881 symbols completed. NRK took 1.2s. Estimated remaining: 4m 7s. Rate: 147.4 symbols/min [2025-10-27T22:13:16.932497] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:16.962962] [INFO ] [MAIN ] NRP: Generated 138 derivative records from 4026 primary records. [2025-10-27T22:13:16.963057] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-27T22:13:16.973419] [DEBUG] [LOCAL ] NRP: Derivative data saved (138 records). [2025-10-27T22:13:16.973475] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-27T22:13:16.975712] [INFO ] [MAIN ] Derivative Progress: 1275/1881 symbols completed. NRP took 0.5s. Estimated remaining: 4m 7s. Rate: 147.5 symbols/min [2025-10-27T22:13:16.976296] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:16.976415] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:16.976555] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:16.986410] [DEBUG] [LOCAL ] NRT: Loaded 4846 existing records from primary storage. [2025-10-27T22:13:16.986228] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-10-27T22:13:16.986705] [INFO ] [MAIN ] NRUC: Loaded 3083 primary data records. [2025-10-27T22:13:16.986792] [INFO ] [MAIN ] NRT: Loaded 4846 primary data records. [2025-10-27T22:13:17.194578] [DEBUG] [LOCAL ] NTB: Loaded 19938 existing records from primary storage. [2025-10-27T22:13:17.215046] [INFO ] [MAIN ] NTB: Loaded 19938 primary data records. [2025-10-27T22:13:17.920625] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:17.955788] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:17.985797] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:13:18.040082] [INFO ] [MAIN ] NRUC: Generated 138 derivative records from 3083 primary records. [2025-10-27T22:13:18.042364] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-27T22:13:18.059524] [DEBUG] [LOCAL ] NRUC: Derivative data saved (138 records). [2025-10-27T22:13:18.059829] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-27T22:13:18.064928] [INFO ] [MAIN ] Derivative Progress: 1276/1881 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 6s. Rate: 147.3 symbols/min [2025-10-27T22:13:18.065483] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:18.071848] [INFO ] [MAIN ] NTB: Generated 138 derivative records from 19938 primary records. [2025-10-27T22:13:18.072076] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-27T22:13:18.086097] [DEBUG] [LOCAL ] NTB: Derivative data saved (138 records). [2025-10-27T22:13:18.086273] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-27T22:13:18.090583] [INFO ] [MAIN ] NRT: Generated 138 derivative records from 4846 primary records. [2025-10-27T22:13:18.090830] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-27T22:13:18.093504] [INFO ] [MAIN ] Derivative Progress: 1277/1881 symbols completed. NTB took 1.1s. Estimated remaining: 4m 6s. Rate: 147.4 symbols/min [2025-10-27T22:13:18.094545] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:18.107163] [DEBUG] [LOCAL ] NRT: Derivative data saved (138 records). [2025-10-27T22:13:18.107543] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-27T22:13:18.110389] [INFO ] [MAIN ] Derivative Progress: 1278/1881 symbols completed. NRT took 1.1s. Estimated remaining: 4m 5s. Rate: 147.5 symbols/min [2025-10-27T22:13:18.110794] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:18.157336] [DEBUG] [LOCAL ] NTST: Loaded 43955 existing records from primary storage. [2025-10-27T22:13:18.157973] [INFO ] [MAIN ] NTST: Loaded 43955 primary data records. [2025-10-27T22:13:18.260829] [DEBUG] [LOCAL ] NTR: Loaded 52577 existing records from primary storage. [2025-10-27T22:13:18.284664] [INFO ] [MAIN ] NTR: Loaded 52577 primary data records. [2025-10-27T22:13:18.474224] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-27T22:13:18.584476] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-10-27T22:13:19.161478] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:19.200023] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:19.247343] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:19.283737] [INFO ] [MAIN ] NTST: Generated 138 derivative records from 43955 primary records. [2025-10-27T22:13:19.286993] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-27T22:13:19.302805] [DEBUG] [LOCAL ] NTST: Derivative data saved (138 records). [2025-10-27T22:13:19.302963] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-27T22:13:19.306598] [INFO ] [MAIN ] Derivative Progress: 1279/1881 symbols completed. NTST took 1.2s. Estimated remaining: 4m 5s. Rate: 147.3 symbols/min [2025-10-27T22:13:19.308337] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:19.324390] [INFO ] [MAIN ] NTR: Generated 138 derivative records from 52577 primary records. [2025-10-27T22:13:19.325124] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-27T22:13:19.346382] [DEBUG] [LOCAL ] NTR: Derivative data saved (138 records). [2025-10-27T22:13:19.348443] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-27T22:13:19.359635] [INFO ] [MAIN ] Derivative Progress: 1280/1881 symbols completed. NTR took 1.3s. Estimated remaining: 4m 5s. Rate: 147.4 symbols/min [2025-10-27T22:13:19.356323] [INFO ] [MAIN ] NU: Generated 138 derivative records from 53746 primary records. [2025-10-27T22:13:19.359958] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:19.360182] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-27T22:13:19.362359] [DEBUG] [LOCAL ] NUV: Loaded 22918 existing records from primary storage. [2025-10-27T22:13:19.362744] [INFO ] [MAIN ] NUV: Loaded 22918 primary data records. [2025-10-27T22:13:19.379625] [DEBUG] [LOCAL ] NU: Derivative data saved (138 records). [2025-10-27T22:13:19.381731] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-27T22:13:19.385075] [INFO ] [MAIN ] Derivative Progress: 1281/1881 symbols completed. NU took 1.3s. Estimated remaining: 4m 4s. Rate: 147.5 symbols/min [2025-10-27T22:13:19.412570] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:19.539145] [DEBUG] [LOCAL ] NUW: Loaded 6428 existing records from primary storage. [2025-10-27T22:13:19.549620] [INFO ] [MAIN ] NUW: Loaded 6428 primary data records. [2025-10-27T22:13:19.687002] [DEBUG] [LOCAL ] NUVB: Loaded 51742 existing records from primary storage. [2025-10-27T22:13:19.703922] [INFO ] [MAIN ] NUVB: Loaded 51742 primary data records. [2025-10-27T22:13:20.387632] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:20.430804] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:20.439344] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:20.501613] [INFO ] [MAIN ] NUV: Generated 138 derivative records from 22918 primary records. [2025-10-27T22:13:20.504620] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-27T22:13:20.525993] [DEBUG] [LOCAL ] NUV: Derivative data saved (138 records). [2025-10-27T22:13:20.527081] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-27T22:13:20.529510] [INFO ] [MAIN ] Derivative Progress: 1282/1881 symbols completed. NUV took 1.2s. Estimated remaining: 4m 4s. Rate: 147.3 symbols/min [2025-10-27T22:13:20.529787] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:20.546311] [INFO ] [MAIN ] NUW: Generated 138 derivative records from 6428 primary records. [2025-10-27T22:13:20.548827] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-27T22:13:20.549084] [INFO ] [MAIN ] NUVB: Generated 138 derivative records from 51742 primary records. [2025-10-27T22:13:20.557880] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-27T22:13:20.580271] [DEBUG] [LOCAL ] NUVB: Derivative data saved (138 records). [2025-10-27T22:13:20.590264] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-27T22:13:20.593323] [INFO ] [MAIN ] Derivative Progress: 1283/1881 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 3s. Rate: 147.4 symbols/min [2025-10-27T22:13:20.594528] [DEBUG] [LOCAL ] NUW: Derivative data saved (138 records). [2025-10-27T22:13:20.595466] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-27T22:13:20.595631] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:20.595202] [DEBUG] [LOCAL ] NVG: Loaded 26970 existing records from primary storage. [2025-10-27T22:13:20.598939] [INFO ] [MAIN ] Derivative Progress: 1284/1881 symbols completed. NUW took 1.2s. Estimated remaining: 4m 3s. Rate: 147.5 symbols/min [2025-10-27T22:13:20.596221] [INFO ] [MAIN ] NVG: Loaded 26970 primary data records. [2025-10-27T22:13:20.599182] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:20.769598] [DEBUG] [LOCAL ] NVGS: Loaded 29490 existing records from primary storage. [2025-10-27T22:13:20.812314] [INFO ] [MAIN ] NVGS: Loaded 29490 primary data records. [2025-10-27T22:13:21.096307] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-27T22:13:21.102591] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-10-27T22:13:21.607125] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:21.650249] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:21.693662] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:21.717162] [INFO ] [MAIN ] NVG: Generated 138 derivative records from 26970 primary records. [2025-10-27T22:13:21.719892] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-27T22:13:21.739597] [DEBUG] [LOCAL ] NVG: Derivative data saved (138 records). [2025-10-27T22:13:21.744922] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-27T22:13:21.749989] [INFO ] [MAIN ] Derivative Progress: 1285/1881 symbols completed. NVG took 1.2s. Estimated remaining: 4m 3s. Rate: 147.3 symbols/min [2025-10-27T22:13:21.750405] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:21.756888] [INFO ] [MAIN ] NVGS: Generated 138 derivative records from 29490 primary records. [2025-10-27T22:13:21.757508] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-27T22:13:21.776967] [DEBUG] [LOCAL ] NVGS: Derivative data saved (138 records). [2025-10-27T22:13:21.779296] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-27T22:13:21.781790] [INFO ] [MAIN ] Derivative Progress: 1286/1881 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 2s. Rate: 147.4 symbols/min [2025-10-27T22:13:21.779210] [INFO ] [MAIN ] NVO: Generated 138 derivative records from 53784 primary records. [2025-10-27T22:13:21.782041] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:21.782268] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-27T22:13:21.795718] [DEBUG] [LOCAL ] NVO: Derivative data saved (138 records). [2025-10-27T22:13:21.795799] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-27T22:13:21.798431] [INFO ] [MAIN ] Derivative Progress: 1287/1881 symbols completed. NVO took 1.2s. Estimated remaining: 4m 2s. Rate: 147.5 symbols/min [2025-10-27T22:13:21.798742] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:21.817437] [DEBUG] [LOCAL ] NXC: Loaded 4001 existing records from primary storage. [2025-10-27T22:13:21.817692] [INFO ] [MAIN ] NXC: Loaded 4001 primary data records. [2025-10-27T22:13:21.938071] [DEBUG] [LOCAL ] NVS: Loaded 51268 existing records from primary storage. [2025-10-27T22:13:21.949147] [INFO ] [MAIN ] NVS: Loaded 51268 primary data records. [2025-10-27T22:13:22.279918] [DEBUG] [LOCAL ] NWG: Loaded 51366 existing records from primary storage. [2025-10-27T22:13:22.308840] [INFO ] [MAIN ] NWG: Loaded 51366 primary data records. [2025-10-27T22:13:22.880007] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:22.916373] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:22.975244] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:22.993331] [INFO ] [MAIN ] NXC: Generated 138 derivative records from 4001 primary records. [2025-10-27T22:13:22.995250] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-27T22:13:23.013306] [DEBUG] [LOCAL ] NXC: Derivative data saved (138 records). [2025-10-27T22:13:23.015014] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-27T22:13:23.020885] [INFO ] [MAIN ] Derivative Progress: 1288/1881 symbols completed. NXC took 1.2s. Estimated remaining: 4m 2s. Rate: 147.3 symbols/min [2025-10-27T22:13:23.028031] [INFO ] [MAIN ] NVS: Generated 138 derivative records from 51268 primary records. [2025-10-27T22:13:23.029370] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-27T22:13:23.055171] [DEBUG] [LOCAL ] NVS: Derivative data saved (138 records). [2025-10-27T22:13:23.057569] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-27T22:13:23.061491] [INFO ] [MAIN ] Derivative Progress: 1289/1881 symbols completed. NVS took 1.3s. Estimated remaining: 4m 1s. Rate: 147.4 symbols/min [2025-10-27T22:13:23.064082] [INFO ] [MAIN ] NWG: Generated 138 derivative records from 51366 primary records. [2025-10-27T22:13:23.064212] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-27T22:13:23.076082] [DEBUG] [LOCAL ] NWG: Derivative data saved (138 records). [2025-10-27T22:13:23.076145] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-27T22:13:23.079186] [INFO ] [MAIN ] Derivative Progress: 1290/1881 symbols completed. NWG took 1.3s. Estimated remaining: 4m 0s. Rate: 147.5 symbols/min [2025-10-27T22:13:23.079908] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:23.079814] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:23.080115] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:23.102315] [DEBUG] [LOCAL ] NXG: Loaded 10298 existing records from primary storage. [2025-10-27T22:13:23.102913] [DEBUG] [LOCAL ] NXDT: Loaded 14255 existing records from primary storage. [2025-10-27T22:13:23.103057] [INFO ] [MAIN ] NXG: Loaded 10298 primary data records. [2025-10-27T22:13:23.115206] [INFO ] [MAIN ] NXDT: Loaded 14255 primary data records. [2025-10-27T22:13:23.501372] [DEBUG] [LOCAL ] NXE: Loaded 53066 existing records from primary storage. [2025-10-27T22:13:23.629313] [INFO ] [MAIN ] NXE: Loaded 53066 primary data records. [2025-10-27T22:13:24.102640] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:24.132810] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:24.194676] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:24.218772] [INFO ] [MAIN ] NXDT: Generated 138 derivative records from 14255 primary records. [2025-10-27T22:13:24.224945] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-27T22:13:24.240445] [INFO ] [MAIN ] NXG: Generated 138 derivative records from 10298 primary records. [2025-10-27T22:13:24.242685] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-27T22:13:24.243255] [DEBUG] [LOCAL ] NXDT: Derivative data saved (138 records). [2025-10-27T22:13:24.259332] [DEBUG] [LOCAL ] NXG: Derivative data saved (138 records). [2025-10-27T22:13:24.259528] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-27T22:13:24.256197] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-27T22:13:24.263178] [INFO ] [MAIN ] Derivative Progress: 1291/1881 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 0s. Rate: 147.3 symbols/min [2025-10-27T22:13:24.269234] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:24.269549] [INFO ] [MAIN ] Derivative Progress: 1292/1881 symbols completed. NXG took 1.2s. Estimated remaining: 3m 60s. Rate: 147.4 symbols/min [2025-10-27T22:13:24.270318] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:24.285850] [DEBUG] [LOCAL ] NXN: Loaded 2281 existing records from primary storage. [2025-10-27T22:13:24.286215] [INFO ] [MAIN ] NXN: Loaded 2281 primary data records. [2025-10-27T22:13:24.286114] [INFO ] [MAIN ] NXE: Generated 138 derivative records from 53066 primary records. [2025-10-27T22:13:24.316469] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-27T22:13:24.401068] [DEBUG] [LOCAL ] NXE: Derivative data saved (138 records). [2025-10-27T22:13:24.398302] [DEBUG] [LOCAL ] NXJ: Loaded 14487 existing records from primary storage. [2025-10-27T22:13:24.404455] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-27T22:13:24.404605] [INFO ] [MAIN ] NXJ: Loaded 14487 primary data records. [2025-10-27T22:13:24.418094] [INFO ] [MAIN ] Derivative Progress: 1293/1881 symbols completed. NXE took 1.3s. Estimated remaining: 3m 59s. Rate: 147.5 symbols/min [2025-10-27T22:13:24.467685] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:24.789484] [DEBUG] [LOCAL ] NXP: Loaded 12044 existing records from primary storage. [2025-10-27T22:13:24.931842] [INFO ] [MAIN ] NXP: Loaded 12044 primary data records. [2025-10-27T22:13:25.280946] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:25.298448] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:25.363351] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:25.406747] [INFO ] [MAIN ] NXN: Generated 138 derivative records from 2281 primary records. [2025-10-27T22:13:25.409383] [INFO ] [MAIN ] NXJ: Generated 138 derivative records from 14487 primary records. [2025-10-27T22:13:25.412262] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-27T22:13:25.412193] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-27T22:13:25.425310] [DEBUG] [LOCAL ] NXN: Derivative data saved (138 records). [2025-10-27T22:13:25.425853] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-27T22:13:25.436338] [INFO ] [MAIN ] Derivative Progress: 1294/1881 symbols completed. NXN took 1.2s. Estimated remaining: 3m 59s. Rate: 147.3 symbols/min [2025-10-27T22:13:25.442563] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:25.447750] [DEBUG] [LOCAL ] NXJ: Derivative data saved (138 records). [2025-10-27T22:13:25.448004] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-27T22:13:25.450817] [INFO ] [MAIN ] Derivative Progress: 1295/1881 symbols completed. NXJ took 1.2s. Estimated remaining: 3m 59s. Rate: 147.4 symbols/min [2025-10-27T22:13:25.453324] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:25.457343] [INFO ] [MAIN ] NXP: Generated 138 derivative records from 12044 primary records. [2025-10-27T22:13:25.457794] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-27T22:13:25.477836] [DEBUG] [LOCAL ] NXP: Derivative data saved (138 records). [2025-10-27T22:13:25.478018] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-27T22:13:25.480685] [INFO ] [MAIN ] Derivative Progress: 1296/1881 symbols completed. NXP took 1.0s. Estimated remaining: 3m 58s. Rate: 147.5 symbols/min [2025-10-27T22:13:25.480945] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:25.492133] [DEBUG] [LOCAL ] NZF: Loaded 28333 existing records from primary storage. [2025-10-27T22:13:25.492267] [INFO ] [MAIN ] NZF: Loaded 28333 primary data records. [2025-10-27T22:13:25.624606] [DEBUG] [LOCAL ] OBK: Loaded 16241 existing records from primary storage. [2025-10-27T22:13:25.641469] [INFO ] [MAIN ] OBK: Loaded 16241 primary data records. [2025-10-27T22:13:25.933338] [DEBUG] [LOCAL ] OBDC: Loaded 51713 existing records from primary storage. [2025-10-27T22:13:25.936950] [INFO ] [MAIN ] OBDC: Loaded 51713 primary data records. [2025-10-27T22:13:26.466017] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:26.504271] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:26.549767] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:26.582057] [INFO ] [MAIN ] NZF: Generated 138 derivative records from 28333 primary records. [2025-10-27T22:13:26.585046] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-27T22:13:26.603070] [DEBUG] [LOCAL ] NZF: Derivative data saved (138 records). [2025-10-27T22:13:26.606371] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-27T22:13:26.612291] [INFO ] [MAIN ] Derivative Progress: 1297/1881 symbols completed. NZF took 1.2s. Estimated remaining: 3m 58s. Rate: 147.3 symbols/min [2025-10-27T22:13:26.612710] [INFO ] [MAIN ] OBK: Generated 138 derivative records from 16241 primary records. [2025-10-27T22:13:26.613136] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-27T22:13:26.612940] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:26.633277] [DEBUG] [LOCAL ] OBK: Derivative data saved (138 records). [2025-10-27T22:13:26.634720] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-27T22:13:26.637162] [INFO ] [MAIN ] Derivative Progress: 1298/1881 symbols completed. OBK took 1.2s. Estimated remaining: 3m 57s. Rate: 147.4 symbols/min [2025-10-27T22:13:26.640300] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:26.644464] [DEBUG] [LOCAL ] OCFT: Loaded 6857 existing records from primary storage. [2025-10-27T22:13:26.645343] [INFO ] [MAIN ] OCFT: Loaded 6857 primary data records. [2025-10-27T22:13:26.741918] [DEBUG] [LOCAL ] ODC: Loaded 8637 existing records from primary storage. [2025-10-27T22:13:26.737921] [INFO ] [MAIN ] OBDC: Generated 138 derivative records from 51713 primary records. [2025-10-27T22:13:26.747984] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-27T22:13:26.747805] [INFO ] [MAIN ] ODC: Loaded 8637 primary data records. [2025-10-27T22:13:26.882864] [DEBUG] [LOCAL ] OBDC: Derivative data saved (138 records). [2025-10-27T22:13:26.888172] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-27T22:13:26.974563] [INFO ] [MAIN ] Derivative Progress: 1299/1881 symbols completed. OBDC took 1.5s. Estimated remaining: 3m 57s. Rate: 147.4 symbols/min [2025-10-27T22:13:27.095013] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:27.328514] [DEBUG] [LOCAL ] ODV: Loaded 30457 existing records from primary storage. [2025-10-27T22:13:27.329620] [INFO ] [MAIN ] ODV: Loaded 30457 primary data records. [2025-10-27T22:13:27.487089] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:27.673601] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:27.745572] [INFO ] [MAIN ] OCFT: Generated 138 derivative records from 6857 primary records. [2025-10-27T22:13:27.746950] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:27.759248] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-27T22:13:27.774115] [DEBUG] [LOCAL ] OCFT: Derivative data saved (138 records). [2025-10-27T22:13:27.774632] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-27T22:13:27.777120] [INFO ] [MAIN ] Derivative Progress: 1300/1881 symbols completed. OCFT took 1.2s. Estimated remaining: 3m 57s. Rate: 147.3 symbols/min [2025-10-27T22:13:27.777343] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:27.783111] [INFO ] [MAIN ] ODC: Generated 138 derivative records from 8637 primary records. [2025-10-27T22:13:27.783806] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-27T22:13:27.801474] [DEBUG] [LOCAL ] ODC: Derivative data saved (138 records). [2025-10-27T22:13:27.801889] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-27T22:13:27.806901] [INFO ] [MAIN ] Derivative Progress: 1301/1881 symbols completed. ODC took 1.2s. Estimated remaining: 3m 56s. Rate: 147.4 symbols/min [2025-10-27T22:13:27.809380] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:27.846933] [INFO ] [MAIN ] ODV: Generated 138 derivative records from 30457 primary records. [2025-10-27T22:13:27.848238] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-27T22:13:27.855566] [DEBUG] [LOCAL ] OEC: Loaded 36893 existing records from primary storage. [2025-10-27T22:13:27.854696] [DEBUG] [LOCAL ] OIA: Loaded 12749 existing records from primary storage. [2025-10-27T22:13:27.856229] [INFO ] [MAIN ] OEC: Loaded 36893 primary data records. [2025-10-27T22:13:27.856815] [INFO ] [MAIN ] OIA: Loaded 12749 primary data records. [2025-10-27T22:13:27.928241] [DEBUG] [LOCAL ] ODV: Derivative data saved (138 records). [2025-10-27T22:13:27.944354] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-27T22:13:27.958755] [INFO ] [MAIN ] Derivative Progress: 1302/1881 symbols completed. ODV took 0.9s. Estimated remaining: 3m 56s. Rate: 147.5 symbols/min [2025-10-27T22:13:27.965914] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:28.528045] [DEBUG] [LOCAL ] OIS: Loaded 39608 existing records from primary storage. [2025-10-27T22:13:28.529983] [INFO ] [MAIN ] OIS: Loaded 39608 primary data records. [2025-10-27T22:13:28.863028] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:28.901884] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:28.966050] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:28.988764] [INFO ] [MAIN ] OIA: Generated 138 derivative records from 12749 primary records. [2025-10-27T22:13:28.989998] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-27T22:13:29.006583] [DEBUG] [LOCAL ] OIA: Derivative data saved (138 records). [2025-10-27T22:13:29.013272] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-27T22:13:29.015871] [INFO ] [MAIN ] Derivative Progress: 1303/1881 symbols completed. OIA took 1.2s. Estimated remaining: 3m 55s. Rate: 147.3 symbols/min [2025-10-27T22:13:29.022991] [INFO ] [MAIN ] OEC: Generated 138 derivative records from 36893 primary records. [2025-10-27T22:13:29.026230] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-27T22:13:29.043758] [DEBUG] [LOCAL ] OEC: Derivative data saved (138 records). [2025-10-27T22:13:29.044009] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-27T22:13:29.049012] [INFO ] [MAIN ] Derivative Progress: 1304/1881 symbols completed. OEC took 1.3s. Estimated remaining: 3m 55s. Rate: 147.4 symbols/min [2025-10-27T22:13:29.056787] [INFO ] [MAIN ] OIS: Generated 138 derivative records from 39608 primary records. [2025-10-27T22:13:29.056915] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-27T22:13:29.068474] [DEBUG] [LOCAL ] OIS: Derivative data saved (138 records). [2025-10-27T22:13:29.068574] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-27T22:13:29.071076] [INFO ] [MAIN ] Derivative Progress: 1305/1881 symbols completed. OIS took 1.1s. Estimated remaining: 3m 54s. Rate: 147.5 symbols/min [2025-10-27T22:13:29.071579] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:29.071716] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:29.071861] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:29.086402] [DEBUG] [LOCAL ] OLP: Loaded 9975 existing records from primary storage. [2025-10-27T22:13:29.086706] [INFO ] [MAIN ] OLP: Loaded 9975 primary data records. [2025-10-27T22:13:29.309244] [DEBUG] [LOCAL ] OMF: Loaded 46368 existing records from primary storage. [2025-10-27T22:13:29.309943] [INFO ] [MAIN ] OMF: Loaded 46368 primary data records. [2025-10-27T22:13:29.474951] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-10-27T22:13:29.618757] [INFO ] [MAIN ] OKLO: Loaded 53819 primary data records. [2025-10-27T22:13:30.222229] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:30.256801] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:30.308851] [DEBUG] [MAIN ] OKLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:30.366131] [INFO ] [MAIN ] OLP: Generated 138 derivative records from 9975 primary records. [2025-10-27T22:13:30.366423] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-27T22:13:30.370227] [INFO ] [MAIN ] OMF: Generated 138 derivative records from 46368 primary records. [2025-10-27T22:13:30.372225] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-27T22:13:30.402703] [DEBUG] [LOCAL ] OMF: Derivative data saved (138 records). [2025-10-27T22:13:30.404116] [DEBUG] [LOCAL ] OLP: Derivative data saved (138 records). [2025-10-27T22:13:30.405585] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-27T22:13:30.402907] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-27T22:13:30.408615] [INFO ] [MAIN ] Derivative Progress: 1306/1881 symbols completed. OLP took 1.3s. Estimated remaining: 3m 54s. Rate: 147.3 symbols/min [2025-10-27T22:13:30.414166] [INFO ] [MAIN ] Derivative Progress: 1307/1881 symbols completed. OMF took 1.3s. Estimated remaining: 3m 54s. Rate: 147.4 symbols/min [2025-10-27T22:13:30.413880] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:30.417624] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:30.422736] [INFO ] [MAIN ] OKLO: Generated 138 derivative records from 53819 primary records. [2025-10-27T22:13:30.425668] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-10-27T22:13:30.442989] [DEBUG] [LOCAL ] OKLO: Derivative data saved (138 records). [2025-10-27T22:13:30.443297] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-10-27T22:13:30.446424] [INFO ] [MAIN ] Derivative Progress: 1308/1881 symbols completed. OKLO took 1.4s. Estimated remaining: 3m 53s. Rate: 147.5 symbols/min [2025-10-27T22:13:30.446684] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:30.443622] [DEBUG] [LOCAL ] ONIT: Loaded 7239 existing records from primary storage. [2025-10-27T22:13:30.447490] [INFO ] [MAIN ] ONIT: Loaded 7239 primary data records. [2025-10-27T22:13:30.603711] [DEBUG] [LOCAL ] ONL: Loaded 28280 existing records from primary storage. [2025-10-27T22:13:30.609157] [INFO ] [MAIN ] ONL: Loaded 28280 primary data records. [2025-10-27T22:13:31.012103] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-27T22:13:31.050727] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-10-27T22:13:31.634279] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:31.704813] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:31.743726] [INFO ] [MAIN ] ONIT: Generated 138 derivative records from 7239 primary records. [2025-10-27T22:13:31.744188] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-27T22:13:31.761313] [DEBUG] [LOCAL ] ONIT: Derivative data saved (138 records). [2025-10-27T22:13:31.764366] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-27T22:13:31.767204] [INFO ] [MAIN ] Derivative Progress: 1309/1881 symbols completed. ONIT took 1.4s. Estimated remaining: 3m 53s. Rate: 147.2 symbols/min [2025-10-27T22:13:31.767448] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:31.789830] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:31.823040] [INFO ] [MAIN ] ONL: Generated 138 derivative records from 28280 primary records. [2025-10-27T22:13:31.835327] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-27T22:13:31.836073] [DEBUG] [LOCAL ] ONTF: Loaded 22513 existing records from primary storage. [2025-10-27T22:13:31.839242] [INFO ] [MAIN ] ONTF: Loaded 22513 primary data records. [2025-10-27T22:13:31.873621] [DEBUG] [LOCAL ] ONL: Derivative data saved (138 records). [2025-10-27T22:13:31.887422] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-27T22:13:31.910172] [INFO ] [MAIN ] Derivative Progress: 1310/1881 symbols completed. ONL took 1.5s. Estimated remaining: 3m 53s. Rate: 147.3 symbols/min [2025-10-27T22:13:31.918566] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:32.239627] [DEBUG] [LOCAL ] OOMA: Loaded 18122 existing records from primary storage. [2025-10-27T22:13:32.238764] [INFO ] [MAIN ] ONON: Generated 138 derivative records from 53613 primary records. [2025-10-27T22:13:32.240148] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-27T22:13:32.240263] [INFO ] [MAIN ] OOMA: Loaded 18122 primary data records. [2025-10-27T22:13:32.316019] [DEBUG] [LOCAL ] ONON: Derivative data saved (138 records). [2025-10-27T22:13:32.331366] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-27T22:13:32.343861] [INFO ] [MAIN ] Derivative Progress: 1311/1881 symbols completed. ONON took 1.9s. Estimated remaining: 3m 52s. Rate: 147.3 symbols/min [2025-10-27T22:13:32.372292] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:32.618029] [DEBUG] [LOCAL ] OPAD: Loaded 27226 existing records from primary storage. [2025-10-27T22:13:32.619399] [INFO ] [MAIN ] OPAD: Loaded 27226 primary data records. [2025-10-27T22:13:32.656292] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:33.011485] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:33.067858] [INFO ] [MAIN ] ONTF: Generated 138 derivative records from 22513 primary records. [2025-10-27T22:13:33.077811] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-27T22:13:33.084484] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:33.116568] [DEBUG] [LOCAL ] ONTF: Derivative data saved (138 records). [2025-10-27T22:13:33.117084] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-27T22:13:33.122315] [INFO ] [MAIN ] Derivative Progress: 1312/1881 symbols completed. ONTF took 1.4s. Estimated remaining: 3m 52s. Rate: 147.2 symbols/min [2025-10-27T22:13:33.122889] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:33.132131] [INFO ] [MAIN ] OOMA: Generated 138 derivative records from 18122 primary records. [2025-10-27T22:13:33.132801] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-27T22:13:33.149756] [DEBUG] [LOCAL ] OOMA: Derivative data saved (138 records). [2025-10-27T22:13:33.149965] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-27T22:13:33.152868] [INFO ] [MAIN ] Derivative Progress: 1313/1881 symbols completed. OOMA took 1.2s. Estimated remaining: 3m 51s. Rate: 147.3 symbols/min [2025-10-27T22:13:33.153787] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:33.183167] [INFO ] [MAIN ] OPAD: Generated 138 derivative records from 27226 primary records. [2025-10-27T22:13:33.183456] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-27T22:13:33.190440] [DEBUG] [LOCAL ] OPP: Loaded 12295 existing records from primary storage. [2025-10-27T22:13:33.202201] [INFO ] [MAIN ] OPP: Loaded 12295 primary data records. [2025-10-27T22:13:33.202075] [DEBUG] [LOCAL ] OPAD: Derivative data saved (138 records). [2025-10-27T22:13:33.222954] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-27T22:13:33.227634] [INFO ] [MAIN ] Derivative Progress: 1314/1881 symbols completed. OPAD took 0.9s. Estimated remaining: 3m 51s. Rate: 147.4 symbols/min [2025-10-27T22:13:33.262565] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:33.302296] [DEBUG] [LOCAL ] OPFI: Loaded 45789 existing records from primary storage. [2025-10-27T22:13:33.320618] [INFO ] [MAIN ] OPFI: Loaded 45789 primary data records. [2025-10-27T22:13:33.949303] [DEBUG] [LOCAL ] OR: Loaded 46888 existing records from primary storage. [2025-10-27T22:13:33.950260] [INFO ] [MAIN ] OR: Loaded 46888 primary data records. [2025-10-27T22:13:34.272553] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:34.313397] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:34.375837] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:34.417926] [INFO ] [MAIN ] OPP: Generated 138 derivative records from 12295 primary records. [2025-10-27T22:13:34.420304] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-27T22:13:34.439215] [DEBUG] [LOCAL ] OPP: Derivative data saved (138 records). [2025-10-27T22:13:34.439830] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-27T22:13:34.447829] [INFO ] [MAIN ] OPFI: Generated 138 derivative records from 45789 primary records. [2025-10-27T22:13:34.447512] [INFO ] [MAIN ] Derivative Progress: 1315/1881 symbols completed. OPP took 1.3s. Estimated remaining: 3m 51s. Rate: 147.2 symbols/min [2025-10-27T22:13:34.448318] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-27T22:13:34.449003] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:34.463536] [DEBUG] [LOCAL ] OPFI: Derivative data saved (138 records). [2025-10-27T22:13:34.463834] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-27T22:13:34.467449] [INFO ] [MAIN ] Derivative Progress: 1316/1881 symbols completed. OPFI took 1.3s. Estimated remaining: 3m 50s. Rate: 147.3 symbols/min [2025-10-27T22:13:34.467671] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:34.476912] [INFO ] [MAIN ] OR: Generated 138 derivative records from 46888 primary records. [2025-10-27T22:13:34.477406] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-27T22:13:34.490849] [DEBUG] [LOCAL ] OR: Derivative data saved (138 records). [2025-10-27T22:13:34.490962] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-27T22:13:34.494601] [INFO ] [MAIN ] Derivative Progress: 1317/1881 symbols completed. OR took 1.2s. Estimated remaining: 3m 50s. Rate: 147.4 symbols/min [2025-10-27T22:13:34.495084] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:34.531131] [DEBUG] [LOCAL ] ORN: Loaded 30520 existing records from primary storage. [2025-10-27T22:13:34.545196] [INFO ] [MAIN ] ORN: Loaded 30520 primary data records. [2025-10-27T22:13:34.558097] [DEBUG] [LOCAL ] ORC: Loaded 52471 existing records from primary storage. [2025-10-27T22:13:34.597616] [INFO ] [MAIN ] ORC: Loaded 52471 primary data records. [2025-10-27T22:13:35.216577] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-27T22:13:35.220959] [INFO ] [MAIN ] OSCR: Loaded 53769 primary data records. [2025-10-27T22:13:35.572670] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:35.604745] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:35.660983] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:35.709146] [INFO ] [MAIN ] ORC: Generated 138 derivative records from 52471 primary records. [2025-10-27T22:13:35.710815] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-27T22:13:35.739200] [INFO ] [MAIN ] ORN: Generated 138 derivative records from 30520 primary records. [2025-10-27T22:13:35.738897] [DEBUG] [LOCAL ] ORC: Derivative data saved (138 records). [2025-10-27T22:13:35.740855] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-27T22:13:35.741065] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-27T22:13:35.747266] [INFO ] [MAIN ] Derivative Progress: 1318/1881 symbols completed. ORC took 1.3s. Estimated remaining: 3m 50s. Rate: 147.1 symbols/min [2025-10-27T22:13:35.765885] [DEBUG] [LOCAL ] ORN: Derivative data saved (138 records). [2025-10-27T22:13:35.766198] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-27T22:13:35.770925] [INFO ] [MAIN ] Derivative Progress: 1319/1881 symbols completed. ORN took 1.3s. Estimated remaining: 3m 49s. Rate: 147.2 symbols/min [2025-10-27T22:13:35.771613] [INFO ] [MAIN ] OSCR: Generated 138 derivative records from 53769 primary records. [2025-10-27T22:13:35.772030] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-27T22:13:35.785281] [DEBUG] [LOCAL ] OSCR: Derivative data saved (138 records). [2025-10-27T22:13:35.785351] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-27T22:13:35.789689] [INFO ] [MAIN ] Derivative Progress: 1320/1881 symbols completed. OSCR took 1.3s. Estimated remaining: 3m 48s. Rate: 147.4 symbols/min [2025-10-27T22:13:35.790284] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:35.790199] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:35.790535] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:35.803835] [DEBUG] [LOCAL ] OWLT: Loaded 10143 existing records from primary storage. [2025-10-27T22:13:35.804120] [INFO ] [MAIN ] OWLT: Loaded 10143 primary data records. [2025-10-27T22:13:36.194862] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-27T22:13:36.195206] [INFO ] [MAIN ] OWL: Loaded 53560 primary data records. [2025-10-27T22:13:36.201569] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-27T22:13:36.219614] [INFO ] [MAIN ] PAAS: Loaded 53625 primary data records. [2025-10-27T22:13:36.863318] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:36.911808] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:36.949573] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:36.971468] [INFO ] [MAIN ] OWLT: Generated 138 derivative records from 10143 primary records. [2025-10-27T22:13:36.973496] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-27T22:13:36.990527] [DEBUG] [LOCAL ] OWLT: Derivative data saved (138 records). [2025-10-27T22:13:36.991107] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-27T22:13:36.993939] [INFO ] [MAIN ] Derivative Progress: 1321/1881 symbols completed. OWLT took 1.2s. Estimated remaining: 3m 48s. Rate: 147.1 symbols/min [2025-10-27T22:13:36.996527] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:37.026126] [INFO ] [MAIN ] PAAS: Generated 138 derivative records from 53625 primary records. [2025-10-27T22:13:37.039881] [DEBUG] [LOCAL ] PACK: Loaded 31687 existing records from primary storage. [2025-10-27T22:13:37.039181] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-27T22:13:37.040296] [INFO ] [MAIN ] PACK: Loaded 31687 primary data records. [2025-10-27T22:13:37.083327] [DEBUG] [LOCAL ] PAAS: Derivative data saved (138 records). [2025-10-27T22:13:37.107244] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-27T22:13:37.145111] [INFO ] [MAIN ] Derivative Progress: 1322/1881 symbols completed. PAAS took 1.4s. Estimated remaining: 3m 48s. Rate: 147.2 symbols/min [2025-10-27T22:13:37.157978] [INFO ] [MAIN ] OWL: Generated 138 derivative records from 53560 primary records. [2025-10-27T22:13:37.158160] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:37.164474] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-27T22:13:37.236510] [DEBUG] [LOCAL ] OWL: Derivative data saved (138 records). [2025-10-27T22:13:37.251666] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-27T22:13:37.260514] [INFO ] [MAIN ] Derivative Progress: 1323/1881 symbols completed. OWL took 1.5s. Estimated remaining: 3m 47s. Rate: 147.3 symbols/min [2025-10-27T22:13:37.260719] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:37.416830] [DEBUG] [LOCAL ] PACS: Loaded 34458 existing records from primary storage. [2025-10-27T22:13:37.417360] [INFO ] [MAIN ] PACS: Loaded 34458 primary data records. [2025-10-27T22:13:37.579926] [DEBUG] [LOCAL ] PAGS: Loaded 52778 existing records from primary storage. [2025-10-27T22:13:37.629303] [INFO ] [MAIN ] PAGS: Loaded 52778 primary data records. [2025-10-27T22:13:37.892594] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:38.168226] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:38.203867] [INFO ] [MAIN ] PACK: Generated 138 derivative records from 31687 primary records. [2025-10-27T22:13:38.206409] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-27T22:13:38.229345] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:38.251105] [DEBUG] [LOCAL ] PACK: Derivative data saved (138 records). [2025-10-27T22:13:38.252837] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-27T22:13:38.260940] [INFO ] [MAIN ] Derivative Progress: 1324/1881 symbols completed. PACK took 1.3s. Estimated remaining: 3m 47s. Rate: 147.1 symbols/min [2025-10-27T22:13:38.261439] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:38.271630] [INFO ] [MAIN ] PACS: Generated 138 derivative records from 34458 primary records. [2025-10-27T22:13:38.273815] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-27T22:13:38.273750] [DEBUG] [LOCAL ] PAI: Loaded 2933 existing records from primary storage. [2025-10-27T22:13:38.274815] [INFO ] [MAIN ] PAI: Loaded 2933 primary data records. [2025-10-27T22:13:38.320129] [DEBUG] [LOCAL ] PACS: Derivative data saved (138 records). [2025-10-27T22:13:38.347216] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-27T22:13:38.380297] [INFO ] [MAIN ] Derivative Progress: 1325/1881 symbols completed. PACS took 1.2s. Estimated remaining: 3m 47s. Rate: 147.2 symbols/min [2025-10-27T22:13:38.396402] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:38.439143] [INFO ] [MAIN ] PAGS: Generated 138 derivative records from 52778 primary records. [2025-10-27T22:13:38.439376] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-27T22:13:38.607690] [DEBUG] [LOCAL ] PAGS: Derivative data saved (138 records). [2025-10-27T22:13:38.616021] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-27T22:13:38.619285] [INFO ] [MAIN ] Derivative Progress: 1326/1881 symbols completed. PAGS took 1.4s. Estimated remaining: 3m 46s. Rate: 147.2 symbols/min [2025-10-27T22:13:38.619569] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:38.633909] [DEBUG] [LOCAL ] PAM: Loaded 29099 existing records from primary storage. [2025-10-27T22:13:38.634061] [INFO ] [MAIN ] PAM: Loaded 29099 primary data records. [2025-10-27T22:13:38.842311] [DEBUG] [LOCAL ] PAR: Loaded 34182 existing records from primary storage. [2025-10-27T22:13:38.849252] [INFO ] [MAIN ] PAR: Loaded 34182 primary data records. [2025-10-27T22:13:39.119458] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:39.446099] [INFO ] [MAIN ] PAI: Generated 138 derivative records from 2933 primary records. [2025-10-27T22:13:39.446883] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-27T22:13:39.447158] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:39.474003] [DEBUG] [LOCAL ] PAI: Derivative data saved (138 records). [2025-10-27T22:13:39.474387] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-27T22:13:39.478816] [INFO ] [MAIN ] Derivative Progress: 1327/1881 symbols completed. PAI took 1.2s. Estimated remaining: 3m 46s. Rate: 147.1 symbols/min [2025-10-27T22:13:39.479041] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:39.499962] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:39.565717] [INFO ] [MAIN ] PAM: Generated 138 derivative records from 29099 primary records. [2025-10-27T22:13:39.566207] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-27T22:13:39.581620] [DEBUG] [LOCAL ] PAM: Derivative data saved (138 records). [2025-10-27T22:13:39.581826] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-27T22:13:39.584120] [INFO ] [MAIN ] Derivative Progress: 1328/1881 symbols completed. PAM took 1.2s. Estimated remaining: 3m 45s. Rate: 147.2 symbols/min [2025-10-27T22:13:39.579037] [INFO ] [MAIN ] PAR: Generated 138 derivative records from 34182 primary records. [2025-10-27T22:13:39.584381] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:39.584537] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-27T22:13:39.615840] [DEBUG] [LOCAL ] PAR: Derivative data saved (138 records). [2025-10-27T22:13:39.616026] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-27T22:13:39.619436] [INFO ] [MAIN ] Derivative Progress: 1329/1881 symbols completed. PAR took 1.0s. Estimated remaining: 3m 45s. Rate: 147.3 symbols/min [2025-10-27T22:13:39.619723] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:39.627987] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-27T22:13:39.628377] [INFO ] [MAIN ] PATH: Loaded 53680 primary data records. [2025-10-27T22:13:39.683367] [DEBUG] [LOCAL ] PAXS: Loaded 20549 existing records from primary storage. [2025-10-27T22:13:39.683570] [INFO ] [MAIN ] PAXS: Loaded 20549 primary data records. [2025-10-27T22:13:39.978286] [DEBUG] [LOCAL ] PAY: Loaded 38313 existing records from primary storage. [2025-10-27T22:13:40.021584] [INFO ] [MAIN ] PAY: Loaded 38313 primary data records. [2025-10-27T22:13:40.676888] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:40.711848] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:40.767466] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:40.786890] [INFO ] [MAIN ] PAXS: Generated 138 derivative records from 20549 primary records. [2025-10-27T22:13:40.787141] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-27T22:13:40.807310] [DEBUG] [LOCAL ] PAXS: Derivative data saved (138 records). [2025-10-27T22:13:40.810145] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-27T22:13:40.812842] [INFO ] [MAIN ] Derivative Progress: 1330/1881 symbols completed. PAXS took 1.2s. Estimated remaining: 3m 45s. Rate: 147.1 symbols/min [2025-10-27T22:13:40.813417] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:40.839516] [INFO ] [MAIN ] PATH: Generated 138 derivative records from 53680 primary records. [2025-10-27T22:13:40.841546] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-27T22:13:40.852040] [INFO ] [MAIN ] PAY: Generated 138 derivative records from 38313 primary records. [2025-10-27T22:13:40.852273] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-27T22:13:40.857758] [DEBUG] [LOCAL ] PATH: Derivative data saved (138 records). [2025-10-27T22:13:40.858054] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-27T22:13:40.860025] [INFO ] [MAIN ] Derivative Progress: 1331/1881 symbols completed. PATH took 1.4s. Estimated remaining: 3m 44s. Rate: 147.2 symbols/min [2025-10-27T22:13:40.869150] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:40.872043] [DEBUG] [LOCAL ] PAY: Derivative data saved (138 records). [2025-10-27T22:13:40.872133] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-27T22:13:40.875747] [INFO ] [MAIN ] Derivative Progress: 1332/1881 symbols completed. PAY took 1.3s. Estimated remaining: 3m 44s. Rate: 147.3 symbols/min [2025-10-27T22:13:40.876041] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:40.913609] [DEBUG] [LOCAL ] PBA: Loaded 49049 existing records from primary storage. [2025-10-27T22:13:40.914023] [INFO ] [MAIN ] PBA: Loaded 49049 primary data records. [2025-10-27T22:13:40.952997] [DEBUG] [LOCAL ] PBT: Loaded 17086 existing records from primary storage. [2025-10-27T22:13:40.966000] [INFO ] [MAIN ] PBT: Loaded 17086 primary data records. [2025-10-27T22:13:41.220559] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-27T22:13:41.221274] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-10-27T22:13:41.921747] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:41.952155] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:41.996230] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:42.048705] [INFO ] [MAIN ] PBA: Generated 138 derivative records from 49049 primary records. [2025-10-27T22:13:42.052138] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-27T22:13:42.072796] [DEBUG] [LOCAL ] PBA: Derivative data saved (138 records). [2025-10-27T22:13:42.077707] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-27T22:13:42.079850] [INFO ] [MAIN ] Derivative Progress: 1333/1881 symbols completed. PBA took 1.3s. Estimated remaining: 3m 44s. Rate: 147.1 symbols/min [2025-10-27T22:13:42.082601] [INFO ] [MAIN ] PBT: Generated 138 derivative records from 17086 primary records. [2025-10-27T22:13:42.084388] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-27T22:13:42.095144] [INFO ] [MAIN ] PBR: Generated 138 derivative records from 53713 primary records. [2025-10-27T22:13:42.097541] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-27T22:13:42.101046] [DEBUG] [LOCAL ] PBT: Derivative data saved (138 records). [2025-10-27T22:13:42.101466] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-27T22:13:42.112977] [INFO ] [MAIN ] Derivative Progress: 1334/1881 symbols completed. PBT took 1.2s. Estimated remaining: 3m 43s. Rate: 147.2 symbols/min [2025-10-27T22:13:42.118088] [DEBUG] [LOCAL ] PBR: Derivative data saved (138 records). [2025-10-27T22:13:42.118163] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-27T22:13:42.122313] [INFO ] [MAIN ] Derivative Progress: 1335/1881 symbols completed. PBR took 1.3s. Estimated remaining: 3m 42s. Rate: 147.3 symbols/min [2025-10-27T22:13:42.122866] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:42.123009] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:42.123181] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:42.140224] [DEBUG] [LOCAL ] PCM: Loaded 6775 existing records from primary storage. [2025-10-27T22:13:42.137122] [DEBUG] [LOCAL ] PCF: Loaded 8934 existing records from primary storage. [2025-10-27T22:13:42.140373] [INFO ] [MAIN ] PCF: Loaded 8934 primary data records. [2025-10-27T22:13:42.151839] [INFO ] [MAIN ] PCM: Loaded 6775 primary data records. [2025-10-27T22:13:42.471111] [DEBUG] [LOCAL ] PCN: Loaded 25100 existing records from primary storage. [2025-10-27T22:13:42.624709] [INFO ] [MAIN ] PCN: Loaded 25100 primary data records. [2025-10-27T22:13:43.150586] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:43.179296] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:43.237373] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:43.274039] [INFO ] [MAIN ] PCF: Generated 138 derivative records from 8934 primary records. [2025-10-27T22:13:43.275575] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-27T22:13:43.293191] [DEBUG] [LOCAL ] PCF: Derivative data saved (138 records). [2025-10-27T22:13:43.293764] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-27T22:13:43.295763] [INFO ] [MAIN ] Derivative Progress: 1336/1881 symbols completed. PCF took 1.2s. Estimated remaining: 3m 42s. Rate: 147.1 symbols/min [2025-10-27T22:13:43.293576] [INFO ] [MAIN ] PCM: Generated 138 derivative records from 6775 primary records. [2025-10-27T22:13:43.297523] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:43.297812] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-27T22:13:43.313946] [DEBUG] [LOCAL ] PCM: Derivative data saved (138 records). [2025-10-27T22:13:43.315937] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-27T22:13:43.321541] [INFO ] [MAIN ] Derivative Progress: 1337/1881 symbols completed. PCM took 1.2s. Estimated remaining: 3m 42s. Rate: 147.2 symbols/min [2025-10-27T22:13:43.321844] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:43.327160] [INFO ] [MAIN ] PCN: Generated 138 derivative records from 25100 primary records. [2025-10-27T22:13:43.328513] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-27T22:13:43.344556] [DEBUG] [LOCAL ] PCN: Derivative data saved (138 records). [2025-10-27T22:13:43.344893] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-27T22:13:43.357977] [INFO ] [MAIN ] Derivative Progress: 1338/1881 symbols completed. PCN took 1.2s. Estimated remaining: 3m 41s. Rate: 147.3 symbols/min [2025-10-27T22:13:43.358282] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:43.363549] [DEBUG] [LOCAL ] PCQ: Loaded 12003 existing records from primary storage. [2025-10-27T22:13:43.363765] [INFO ] [MAIN ] PCQ: Loaded 12003 primary data records. [2025-10-27T22:13:43.488092] [DEBUG] [LOCAL ] PCOR: Loaded 47151 existing records from primary storage. [2025-10-27T22:13:43.500152] [INFO ] [MAIN ] PCOR: Loaded 47151 primary data records. [2025-10-27T22:13:43.879574] [DEBUG] [LOCAL ] PD: Loaded 48212 existing records from primary storage. [2025-10-27T22:13:43.880516] [INFO ] [MAIN ] PD: Loaded 48212 primary data records. [2025-10-27T22:13:44.361694] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:44.418794] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:44.464971] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:44.483503] [INFO ] [MAIN ] PCQ: Generated 138 derivative records from 12003 primary records. [2025-10-27T22:13:44.484292] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-27T22:13:44.503185] [DEBUG] [LOCAL ] PCQ: Derivative data saved (138 records). [2025-10-27T22:13:44.503520] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-27T22:13:44.507234] [INFO ] [MAIN ] Derivative Progress: 1339/1881 symbols completed. PCQ took 1.2s. Estimated remaining: 3m 41s. Rate: 147.1 symbols/min [2025-10-27T22:13:44.508762] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:44.534017] [INFO ] [MAIN ] PCOR: Generated 138 derivative records from 47151 primary records. [2025-10-27T22:13:44.536923] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-27T22:13:44.550711] [DEBUG] [LOCAL ] PCOR: Derivative data saved (138 records). [2025-10-27T22:13:44.552582] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-27T22:13:44.552775] [INFO ] [MAIN ] PD: Generated 138 derivative records from 48212 primary records. [2025-10-27T22:13:44.555486] [INFO ] [MAIN ] Derivative Progress: 1340/1881 symbols completed. PCOR took 1.3s. Estimated remaining: 3m 41s. Rate: 147.2 symbols/min [2025-10-27T22:13:44.555686] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:44.555769] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-27T22:13:44.569442] [DEBUG] [LOCAL ] PD: Derivative data saved (138 records). [2025-10-27T22:13:44.582251] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-27T22:13:44.585317] [INFO ] [MAIN ] Derivative Progress: 1341/1881 symbols completed. PD took 1.2s. Estimated remaining: 3m 40s. Rate: 147.3 symbols/min [2025-10-27T22:13:44.585688] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:44.617558] [DEBUG] [LOCAL ] PDI: Loaded 50169 existing records from primary storage. [2025-10-27T22:13:44.625352] [INFO ] [MAIN ] PDI: Loaded 50169 primary data records. [2025-10-27T22:13:44.714521] [DEBUG] [LOCAL ] PDM: Loaded 39478 existing records from primary storage. [2025-10-27T22:13:44.744453] [INFO ] [MAIN ] PDM: Loaded 39478 primary data records. [2025-10-27T22:13:44.762223] [DEBUG] [LOCAL ] PDO: Loaded 30959 existing records from primary storage. [2025-10-27T22:13:44.805073] [INFO ] [MAIN ] PDO: Loaded 30959 primary data records. [2025-10-27T22:13:45.688420] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:45.717627] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:45.765288] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:45.820627] [INFO ] [MAIN ] PDM: Generated 138 derivative records from 39478 primary records. [2025-10-27T22:13:45.824404] [INFO ] [MAIN ] PDI: Generated 138 derivative records from 50169 primary records. [2025-10-27T22:13:45.824466] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-27T22:13:45.827234] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-27T22:13:45.853464] [DEBUG] [LOCAL ] PDI: Derivative data saved (138 records). [2025-10-27T22:13:45.850782] [DEBUG] [LOCAL ] PDM: Derivative data saved (138 records). [2025-10-27T22:13:45.853577] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-27T22:13:45.855697] [INFO ] [MAIN ] Derivative Progress: 1342/1881 symbols completed. PDI took 1.3s. Estimated remaining: 3m 40s. Rate: 147.1 symbols/min [2025-10-27T22:13:45.857947] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-27T22:13:45.858331] [INFO ] [MAIN ] PDO: Generated 138 derivative records from 30959 primary records. [2025-10-27T22:13:45.858436] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-27T22:13:45.861400] [INFO ] [MAIN ] Derivative Progress: 1343/1881 symbols completed. PDM took 1.3s. Estimated remaining: 3m 39s. Rate: 147.2 symbols/min [2025-10-27T22:13:45.858541] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:45.861941] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:45.875077] [DEBUG] [LOCAL ] PDO: Derivative data saved (138 records). [2025-10-27T22:13:45.875189] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-27T22:13:45.877982] [INFO ] [MAIN ] Derivative Progress: 1344/1881 symbols completed. PDO took 1.3s. Estimated remaining: 3m 39s. Rate: 147.3 symbols/min [2025-10-27T22:13:45.878171] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:45.895959] [DEBUG] [LOCAL ] PDS: Loaded 16191 existing records from primary storage. [2025-10-27T22:13:45.899231] [INFO ] [MAIN ] PDS: Loaded 16191 primary data records. [2025-10-27T22:13:45.948500] [DEBUG] [LOCAL ] PDT: Loaded 17343 existing records from primary storage. [2025-10-27T22:13:45.974844] [INFO ] [MAIN ] PDT: Loaded 17343 primary data records. [2025-10-27T22:13:46.056752] [DEBUG] [LOCAL ] PDX: Loaded 13856 existing records from primary storage. [2025-10-27T22:13:46.077361] [INFO ] [MAIN ] PDX: Loaded 13856 primary data records. [2025-10-27T22:13:46.906043] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:46.948794] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:46.949780] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:47.039811] [INFO ] [MAIN ] PDX: Generated 138 derivative records from 13856 primary records. [2025-10-27T22:13:47.042096] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-27T22:13:47.064053] [DEBUG] [LOCAL ] PDX: Derivative data saved (138 records). [2025-10-27T22:13:47.064217] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-27T22:13:47.067548] [INFO ] [MAIN ] Derivative Progress: 1345/1881 symbols completed. PDX took 1.2s. Estimated remaining: 3m 39s. Rate: 147.1 symbols/min [2025-10-27T22:13:47.069912] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:47.075872] [INFO ] [MAIN ] PDS: Generated 138 derivative records from 16191 primary records. [2025-10-27T22:13:47.076087] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-27T22:13:47.075448] [INFO ] [MAIN ] PDT: Generated 138 derivative records from 17343 primary records. [2025-10-27T22:13:47.076969] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-27T22:13:47.092615] [DEBUG] [LOCAL ] PDS: Derivative data saved (138 records). [2025-10-27T22:13:47.093179] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-27T22:13:47.102670] [INFO ] [MAIN ] Derivative Progress: 1346/1881 symbols completed. PDS took 1.2s. Estimated remaining: 3m 38s. Rate: 147.2 symbols/min [2025-10-27T22:13:47.102994] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:47.114368] [DEBUG] [LOCAL ] PDT: Derivative data saved (138 records). [2025-10-27T22:13:47.115143] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-27T22:13:47.114964] [DEBUG] [LOCAL ] PEO: Loaded 10939 existing records from primary storage. [2025-10-27T22:13:47.120011] [INFO ] [MAIN ] Derivative Progress: 1347/1881 symbols completed. PDT took 1.3s. Estimated remaining: 3m 38s. Rate: 147.3 symbols/min [2025-10-27T22:13:47.120274] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:47.120549] [INFO ] [MAIN ] PEO: Loaded 10939 primary data records. [2025-10-27T22:13:47.243866] [DEBUG] [LOCAL ] PFD: Loaded 5255 existing records from primary storage. [2025-10-27T22:13:47.244610] [INFO ] [MAIN ] PFD: Loaded 5255 primary data records. [2025-10-27T22:13:47.244352] [DEBUG] [LOCAL ] PERF: Loaded 14553 existing records from primary storage. [2025-10-27T22:13:47.275722] [INFO ] [MAIN ] PERF: Loaded 14553 primary data records. [2025-10-27T22:13:48.143399] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:48.197501] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:48.197834] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:48.279129] [INFO ] [MAIN ] PEO: Generated 138 derivative records from 10939 primary records. [2025-10-27T22:13:48.280897] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-27T22:13:48.301588] [DEBUG] [LOCAL ] PEO: Derivative data saved (138 records). [2025-10-27T22:13:48.304878] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-27T22:13:48.308459] [INFO ] [MAIN ] Derivative Progress: 1348/1881 symbols completed. PEO took 1.2s. Estimated remaining: 3m 37s. Rate: 147.1 symbols/min [2025-10-27T22:13:48.312177] [INFO ] [MAIN ] PFD: Generated 138 derivative records from 5255 primary records. [2025-10-27T22:13:48.313781] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-27T22:13:48.316729] [INFO ] [MAIN ] PERF: Generated 138 derivative records from 14553 primary records. [2025-10-27T22:13:48.323798] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-27T22:13:48.329734] [DEBUG] [LOCAL ] PFD: Derivative data saved (138 records). [2025-10-27T22:13:48.330144] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-27T22:13:48.341941] [INFO ] [MAIN ] Derivative Progress: 1349/1881 symbols completed. PFD took 1.2s. Estimated remaining: 3m 37s. Rate: 147.2 symbols/min [2025-10-27T22:13:48.344722] [DEBUG] [LOCAL ] PERF: Derivative data saved (138 records). [2025-10-27T22:13:48.344811] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-27T22:13:48.349533] [INFO ] [MAIN ] Derivative Progress: 1350/1881 symbols completed. PERF took 1.2s. Estimated remaining: 3m 36s. Rate: 147.3 symbols/min [2025-10-27T22:13:48.350277] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:48.351063] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:48.350934] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:48.367254] [DEBUG] [LOCAL ] PFH: Loaded 6340 existing records from primary storage. [2025-10-27T22:13:48.367674] [INFO ] [MAIN ] PFH: Loaded 6340 primary data records. [2025-10-27T22:13:48.413207] [DEBUG] [LOCAL ] PFL: Loaded 14163 existing records from primary storage. [2025-10-27T22:13:48.426963] [INFO ] [MAIN ] PFL: Loaded 14163 primary data records. [2025-10-27T22:13:48.732714] [DEBUG] [LOCAL ] PFLT: Loaded 44070 existing records from primary storage. [2025-10-27T22:13:48.738139] [INFO ] [MAIN ] PFLT: Loaded 44070 primary data records. [2025-10-27T22:13:49.469342] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:49.496614] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:49.537334] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:49.602081] [INFO ] [MAIN ] PFL: Generated 138 derivative records from 14163 primary records. [2025-10-27T22:13:49.603294] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-27T22:13:49.601808] [INFO ] [MAIN ] PFH: Generated 138 derivative records from 6340 primary records. [2025-10-27T22:13:49.603675] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-27T22:13:49.630147] [DEBUG] [LOCAL ] PFH: Derivative data saved (138 records). [2025-10-27T22:13:49.631525] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-27T22:13:49.634933] [DEBUG] [LOCAL ] PFL: Derivative data saved (138 records). [2025-10-27T22:13:49.637498] [INFO ] [MAIN ] Derivative Progress: 1351/1881 symbols completed. PFH took 1.3s. Estimated remaining: 3m 36s. Rate: 147.0 symbols/min [2025-10-27T22:13:49.637707] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-27T22:13:49.643746] [INFO ] [MAIN ] PFLT: Generated 138 derivative records from 44070 primary records. [2025-10-27T22:13:49.641639] [INFO ] [MAIN ] Derivative Progress: 1352/1881 symbols completed. PFL took 1.3s. Estimated remaining: 3m 36s. Rate: 147.1 symbols/min [2025-10-27T22:13:49.638104] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:49.644579] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:49.644906] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-27T22:13:49.660316] [DEBUG] [LOCAL ] PFLT: Derivative data saved (138 records). [2025-10-27T22:13:49.660489] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-27T22:13:49.663746] [INFO ] [MAIN ] Derivative Progress: 1353/1881 symbols completed. PFLT took 1.3s. Estimated remaining: 3m 35s. Rate: 147.2 symbols/min [2025-10-27T22:13:49.664208] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:49.670438] [DEBUG] [LOCAL ] PFO: Loaded 6017 existing records from primary storage. [2025-10-27T22:13:49.670835] [INFO ] [MAIN ] PFO: Loaded 6017 primary data records. [2025-10-27T22:13:49.822514] [DEBUG] [LOCAL ] PFN: Loaded 21859 existing records from primary storage. [2025-10-27T22:13:49.823561] [INFO ] [MAIN ] PFN: Loaded 21859 primary data records. [2025-10-27T22:13:49.848345] [DEBUG] [LOCAL ] PFSI: Loaded 28901 existing records from primary storage. [2025-10-27T22:13:49.864220] [INFO ] [MAIN ] PFSI: Loaded 28901 primary data records. [2025-10-27T22:13:50.690340] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:50.754037] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:50.758299] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:50.812612] [INFO ] [MAIN ] PFO: Generated 138 derivative records from 6017 primary records. [2025-10-27T22:13:50.818547] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-27T22:13:50.841571] [DEBUG] [LOCAL ] PFO: Derivative data saved (138 records). [2025-10-27T22:13:50.843299] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-27T22:13:50.847026] [INFO ] [MAIN ] Derivative Progress: 1354/1881 symbols completed. PFO took 1.2s. Estimated remaining: 3m 35s. Rate: 147.0 symbols/min [2025-10-27T22:13:50.849161] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:50.866571] [DEBUG] [LOCAL ] PGP: Loaded 5599 existing records from primary storage. [2025-10-27T22:13:50.867113] [INFO ] [MAIN ] PFSI: Generated 138 derivative records from 28901 primary records. [2025-10-27T22:13:50.864754] [INFO ] [MAIN ] PFN: Generated 138 derivative records from 21859 primary records. [2025-10-27T22:13:50.867437] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-27T22:13:50.867378] [INFO ] [MAIN ] PGP: Loaded 5599 primary data records. [2025-10-27T22:13:50.867573] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-27T22:13:50.970704] [DEBUG] [LOCAL ] PFN: Derivative data saved (138 records). [2025-10-27T22:13:50.970857] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-27T22:13:50.973866] [INFO ] [MAIN ] Derivative Progress: 1355/1881 symbols completed. PFN took 1.3s. Estimated remaining: 3m 35s. Rate: 147.1 symbols/min [2025-10-27T22:13:50.974010] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:50.997459] [DEBUG] [LOCAL ] PFSI: Derivative data saved (138 records). [2025-10-27T22:13:51.000920] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-27T22:13:51.004190] [INFO ] [MAIN ] Derivative Progress: 1356/1881 symbols completed. PFSI took 1.3s. Estimated remaining: 3m 34s. Rate: 147.2 symbols/min [2025-10-27T22:13:51.014966] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:51.243445] [DEBUG] [LOCAL ] PGZ: Loaded 5422 existing records from primary storage. [2025-10-27T22:13:51.244239] [INFO ] [MAIN ] PGZ: Loaded 5422 primary data records. [2025-10-27T22:13:51.400967] [DEBUG] [LOCAL ] PGRE: Loaded 46857 existing records from primary storage. [2025-10-27T22:13:51.424770] [INFO ] [MAIN ] PGRE: Loaded 46857 primary data records. [2025-10-27T22:13:51.895167] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:51.942468] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:51.996257] [INFO ] [MAIN ] PGP: Generated 138 derivative records from 5599 primary records. [2025-10-27T22:13:51.996745] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-27T22:13:51.995923] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:52.024874] [DEBUG] [LOCAL ] PGP: Derivative data saved (138 records). [2025-10-27T22:13:52.025555] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-27T22:13:52.029283] [INFO ] [MAIN ] Derivative Progress: 1357/1881 symbols completed. PGP took 1.2s. Estimated remaining: 3m 34s. Rate: 147.0 symbols/min [2025-10-27T22:13:52.030917] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:52.046456] [INFO ] [MAIN ] PGZ: Generated 138 derivative records from 5422 primary records. [2025-10-27T22:13:52.046949] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-27T22:13:52.064061] [DEBUG] [LOCAL ] PGZ: Derivative data saved (138 records). [2025-10-27T22:13:52.067185] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-27T22:13:52.070284] [INFO ] [MAIN ] Derivative Progress: 1358/1881 symbols completed. PGZ took 1.1s. Estimated remaining: 3m 33s. Rate: 147.1 symbols/min [2025-10-27T22:13:52.070575] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:52.084299] [INFO ] [MAIN ] PGRE: Generated 138 derivative records from 46857 primary records. [2025-10-27T22:13:52.084537] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-27T22:13:52.096406] [DEBUG] [LOCAL ] PGRE: Derivative data saved (138 records). [2025-10-27T22:13:52.097278] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-27T22:13:52.100261] [INFO ] [MAIN ] Derivative Progress: 1359/1881 symbols completed. PGRE took 1.1s. Estimated remaining: 3m 33s. Rate: 147.2 symbols/min [2025-10-27T22:13:52.100571] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:52.118624] [DEBUG] [LOCAL ] PHG: Loaded 45242 existing records from primary storage. [2025-10-27T22:13:52.118970] [INFO ] [MAIN ] PHG: Loaded 45242 primary data records. [2025-10-27T22:13:52.185916] [DEBUG] [LOCAL ] PHI: Loaded 15075 existing records from primary storage. [2025-10-27T22:13:52.209258] [INFO ] [MAIN ] PHI: Loaded 15075 primary data records. [2025-10-27T22:13:52.398199] [DEBUG] [LOCAL ] PHK: Loaded 26352 existing records from primary storage. [2025-10-27T22:13:52.450584] [INFO ] [MAIN ] PHK: Loaded 26352 primary data records. [2025-10-27T22:13:53.181551] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:53.215262] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:53.262848] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:53.311485] [INFO ] [MAIN ] PHG: Generated 138 derivative records from 45242 primary records. [2025-10-27T22:13:53.311672] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-27T22:13:53.319430] [INFO ] [MAIN ] PHI: Generated 138 derivative records from 15075 primary records. [2025-10-27T22:13:53.328143] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-27T22:13:53.333148] [DEBUG] [LOCAL ] PHG: Derivative data saved (138 records). [2025-10-27T22:13:53.333564] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-27T22:13:53.342221] [INFO ] [MAIN ] Derivative Progress: 1360/1881 symbols completed. PHG took 1.3s. Estimated remaining: 3m 33s. Rate: 147.0 symbols/min [2025-10-27T22:13:53.347059] [DEBUG] [LOCAL ] PHI: Derivative data saved (138 records). [2025-10-27T22:13:53.349536] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-27T22:13:53.344732] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:53.352893] [INFO ] [MAIN ] Derivative Progress: 1361/1881 symbols completed. PHI took 1.3s. Estimated remaining: 3m 32s. Rate: 147.1 symbols/min [2025-10-27T22:13:53.353420] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:53.363673] [DEBUG] [LOCAL ] PIM: Loaded 4814 existing records from primary storage. [2025-10-27T22:13:53.363855] [INFO ] [MAIN ] PIM: Loaded 4814 primary data records. [2025-10-27T22:13:53.443619] [INFO ] [MAIN ] PHK: Generated 138 derivative records from 26352 primary records. [2025-10-27T22:13:53.465399] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-27T22:13:53.487810] [DEBUG] [LOCAL ] PHK: Derivative data saved (138 records). [2025-10-27T22:13:53.497925] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-27T22:13:53.501692] [INFO ] [MAIN ] Derivative Progress: 1362/1881 symbols completed. PHK took 1.4s. Estimated remaining: 3m 32s. Rate: 147.2 symbols/min [2025-10-27T22:13:53.512220] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:53.550715] [DEBUG] [LOCAL ] PHR: Loaded 37683 existing records from primary storage. [2025-10-27T22:13:53.574677] [INFO ] [MAIN ] PHR: Loaded 37683 primary data records. [2025-10-27T22:13:53.797390] [DEBUG] [LOCAL ] PINE: Loaded 14362 existing records from primary storage. [2025-10-27T22:13:53.805625] [INFO ] [MAIN ] PINE: Loaded 14362 primary data records. [2025-10-27T22:13:54.346909] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:54.404112] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:54.425442] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:54.451753] [INFO ] [MAIN ] PIM: Generated 138 derivative records from 4814 primary records. [2025-10-27T22:13:54.452327] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-27T22:13:54.468768] [DEBUG] [LOCAL ] PIM: Derivative data saved (138 records). [2025-10-27T22:13:54.471742] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-27T22:13:54.478316] [INFO ] [MAIN ] Derivative Progress: 1363/1881 symbols completed. PIM took 1.1s. Estimated remaining: 3m 31s. Rate: 147.0 symbols/min [2025-10-27T22:13:54.500639] [INFO ] [MAIN ] PINE: Generated 138 derivative records from 14362 primary records. [2025-10-27T22:13:54.498726] [INFO ] [MAIN ] PHR: Generated 138 derivative records from 37683 primary records. [2025-10-27T22:13:54.500814] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-27T22:13:54.500914] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-27T22:13:54.523763] [DEBUG] [LOCAL ] PINE: Derivative data saved (138 records). [2025-10-27T22:13:54.523854] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-27T22:13:54.526700] [INFO ] [MAIN ] Derivative Progress: 1364/1881 symbols completed. PINE took 1.0s. Estimated remaining: 3m 31s. Rate: 147.1 symbols/min [2025-10-27T22:13:54.528326] [DEBUG] [LOCAL ] PHR: Derivative data saved (138 records). [2025-10-27T22:13:54.528412] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-27T22:13:54.530965] [INFO ] [MAIN ] Derivative Progress: 1365/1881 symbols completed. PHR took 1.2s. Estimated remaining: 3m 30s. Rate: 147.2 symbols/min [2025-10-27T22:13:54.531321] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:54.531424] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:54.531797] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:54.559123] [DEBUG] [LOCAL ] PKE: Loaded 14213 existing records from primary storage. [2025-10-27T22:13:54.559713] [INFO ] [MAIN ] PKE: Loaded 14213 primary data records. [2025-10-27T22:13:54.559490] [DEBUG] [LOCAL ] PKST: Loaded 17944 existing records from primary storage. [2025-10-27T22:13:54.571913] [INFO ] [MAIN ] PKST: Loaded 17944 primary data records. [2025-10-27T22:13:55.217114] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-27T22:13:55.232639] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-10-27T22:13:55.567734] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:55.568074] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:55.635061] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:55.666274] [INFO ] [MAIN ] PKST: Generated 138 derivative records from 17944 primary records. [2025-10-27T22:13:55.668354] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-27T22:13:55.670706] [INFO ] [MAIN ] PKE: Generated 138 derivative records from 14213 primary records. [2025-10-27T22:13:55.670816] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-27T22:13:55.694338] [DEBUG] [LOCAL ] PKE: Derivative data saved (138 records). [2025-10-27T22:13:55.697358] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-27T22:13:55.698416] [DEBUG] [LOCAL ] PKST: Derivative data saved (138 records). [2025-10-27T22:13:55.701270] [INFO ] [MAIN ] Derivative Progress: 1366/1881 symbols completed. PKE took 1.2s. Estimated remaining: 3m 30s. Rate: 147.0 symbols/min [2025-10-27T22:13:55.698908] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-27T22:13:55.704333] [INFO ] [MAIN ] Derivative Progress: 1367/1881 symbols completed. PKST took 1.2s. Estimated remaining: 3m 30s. Rate: 147.1 symbols/min [2025-10-27T22:13:55.704205] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:55.705793] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:55.712714] [INFO ] [MAIN ] PINS: Generated 138 derivative records from 53693 primary records. [2025-10-27T22:13:55.712922] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-27T22:13:55.730033] [DEBUG] [LOCAL ] PINS: Derivative data saved (138 records). [2025-10-27T22:13:55.730128] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-27T22:13:55.733197] [INFO ] [MAIN ] Derivative Progress: 1368/1881 symbols completed. PINS took 1.2s. Estimated remaining: 3m 29s. Rate: 147.2 symbols/min [2025-10-27T22:13:55.733462] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:55.742548] [DEBUG] [LOCAL ] PKX: Loaded 22152 existing records from primary storage. [2025-10-27T22:13:55.742704] [INFO ] [MAIN ] PKX: Loaded 22152 primary data records. [2025-10-27T22:13:55.893223] [DEBUG] [LOCAL ] PLOW: Loaded 19211 existing records from primary storage. [2025-10-27T22:13:55.956340] [INFO ] [MAIN ] PLOW: Loaded 19211 primary data records. [2025-10-27T22:13:56.090082] [DEBUG] [LOCAL ] PL: Loaded 53218 existing records from primary storage. [2025-10-27T22:13:56.112275] [INFO ] [MAIN ] PL: Loaded 53218 primary data records. [2025-10-27T22:13:56.815985] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:56.891636] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:56.933359] [INFO ] [MAIN ] PKX: Generated 138 derivative records from 22152 primary records. [2025-10-27T22:13:56.942354] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:56.942475] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-27T22:13:56.979952] [DEBUG] [LOCAL ] PKX: Derivative data saved (138 records). [2025-10-27T22:13:56.984853] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-27T22:13:56.989013] [INFO ] [MAIN ] Derivative Progress: 1369/1881 symbols completed. PKX took 1.3s. Estimated remaining: 3m 29s. Rate: 147.0 symbols/min [2025-10-27T22:13:56.991058] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:57.024482] [INFO ] [MAIN ] PLOW: Generated 138 derivative records from 19211 primary records. [2025-10-27T22:13:57.024998] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-27T22:13:57.060612] [DEBUG] [LOCAL ] PLOW: Derivative data saved (138 records). [2025-10-27T22:13:57.061287] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-27T22:13:57.065167] [INFO ] [MAIN ] Derivative Progress: 1370/1881 symbols completed. PLOW took 1.3s. Estimated remaining: 3m 28s. Rate: 147.1 symbols/min [2025-10-27T22:13:57.067383] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:57.071195] [INFO ] [MAIN ] PL: Generated 138 derivative records from 53218 primary records. [2025-10-27T22:13:57.071521] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-27T22:13:57.094212] [DEBUG] [LOCAL ] PL: Derivative data saved (138 records). [2025-10-27T22:13:57.114926] [DEBUG] [LOCAL ] PLYM: Loaded 34355 existing records from primary storage. [2025-10-27T22:13:57.113518] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-27T22:13:57.119764] [INFO ] [MAIN ] Derivative Progress: 1371/1881 symbols completed. PL took 1.4s. Estimated remaining: 3m 28s. Rate: 147.2 symbols/min [2025-10-27T22:13:57.115250] [INFO ] [MAIN ] PLYM: Loaded 34355 primary data records. [2025-10-27T22:13:57.120428] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:57.265068] [DEBUG] [LOCAL ] PML: Loaded 21682 existing records from primary storage. [2025-10-27T22:13:57.286540] [INFO ] [MAIN ] PML: Loaded 21682 primary data records. [2025-10-27T22:13:57.301006] [DEBUG] [LOCAL ] PMM: Loaded 9732 existing records from primary storage. [2025-10-27T22:13:57.371958] [INFO ] [MAIN ] PMM: Loaded 9732 primary data records. [2025-10-27T22:13:58.273236] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:58.321728] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:58.322251] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:58.387359] [INFO ] [MAIN ] PLYM: Generated 138 derivative records from 34355 primary records. [2025-10-27T22:13:58.388350] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-27T22:13:58.404934] [DEBUG] [LOCAL ] PLYM: Derivative data saved (138 records). [2025-10-27T22:13:58.407749] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-27T22:13:58.410079] [INFO ] [MAIN ] Derivative Progress: 1372/1881 symbols completed. PLYM took 1.4s. Estimated remaining: 3m 28s. Rate: 147.0 symbols/min [2025-10-27T22:13:58.412844] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:58.419544] [INFO ] [MAIN ] PMM: Generated 138 derivative records from 9732 primary records. [2025-10-27T22:13:58.423318] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-27T22:13:58.423981] [INFO ] [MAIN ] PML: Generated 138 derivative records from 21682 primary records. [2025-10-27T22:13:58.424465] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-27T22:13:58.438213] [DEBUG] [LOCAL ] PMM: Derivative data saved (138 records). [2025-10-27T22:13:58.438475] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-27T22:13:58.441424] [INFO ] [MAIN ] Derivative Progress: 1373/1881 symbols completed. PMM took 1.3s. Estimated remaining: 3m 27s. Rate: 147.1 symbols/min [2025-10-27T22:13:58.448222] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:58.452713] [DEBUG] [LOCAL ] PMO: Loaded 8998 existing records from primary storage. [2025-10-27T22:13:58.452370] [DEBUG] [LOCAL ] PML: Derivative data saved (138 records). [2025-10-27T22:13:58.452894] [INFO ] [MAIN ] PMO: Loaded 8998 primary data records. [2025-10-27T22:13:58.452839] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-27T22:13:58.467267] [INFO ] [MAIN ] Derivative Progress: 1374/1881 symbols completed. PML took 1.4s. Estimated remaining: 3m 27s. Rate: 147.2 symbols/min [2025-10-27T22:13:58.511739] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:58.561546] [DEBUG] [LOCAL ] PNI: Loaded 6656 existing records from primary storage. [2025-10-27T22:13:58.567198] [INFO ] [MAIN ] PNI: Loaded 6656 primary data records. [2025-10-27T22:13:59.060336] [DEBUG] [LOCAL ] PNNT: Loaded 32889 existing records from primary storage. [2025-10-27T22:13:59.060638] [INFO ] [MAIN ] PNNT: Loaded 32889 primary data records. [2025-10-27T22:13:59.372210] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:59.409283] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:59.452758] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:13:59.473019] [INFO ] [MAIN ] PMO: Generated 138 derivative records from 8998 primary records. [2025-10-27T22:13:59.475168] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-27T22:13:59.493877] [DEBUG] [LOCAL ] PMO: Derivative data saved (138 records). [2025-10-27T22:13:59.494218] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-27T22:13:59.497240] [INFO ] [MAIN ] Derivative Progress: 1375/1881 symbols completed. PMO took 1.1s. Estimated remaining: 3m 27s. Rate: 147.0 symbols/min [2025-10-27T22:13:59.497990] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:59.510717] [INFO ] [MAIN ] PNI: Generated 138 derivative records from 6656 primary records. [2025-10-27T22:13:59.514032] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-27T22:13:59.530493] [DEBUG] [LOCAL ] PNI: Derivative data saved (138 records). [2025-10-27T22:13:59.531762] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-27T22:13:59.539763] [INFO ] [MAIN ] Derivative Progress: 1376/1881 symbols completed. PNI took 1.1s. Estimated remaining: 3m 26s. Rate: 147.1 symbols/min [2025-10-27T22:13:59.540542] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:13:59.541556] [DEBUG] [LOCAL ] PPT: Loaded 19331 existing records from primary storage. [2025-10-27T22:13:59.541684] [INFO ] [MAIN ] PPT: Loaded 19331 primary data records. [2025-10-27T22:13:59.599351] [INFO ] [MAIN ] PNNT: Generated 138 derivative records from 32889 primary records. [2025-10-27T22:13:59.619317] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-27T22:13:59.626550] [DEBUG] [LOCAL ] PRCS: Loaded 2724 existing records from primary storage. [2025-10-27T22:13:59.632105] [INFO ] [MAIN ] PRCS: Loaded 2724 primary data records. [2025-10-27T22:13:59.754394] [DEBUG] [LOCAL ] PNNT: Derivative data saved (138 records). [2025-10-27T22:13:59.779363] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-27T22:13:59.797883] [INFO ] [MAIN ] Derivative Progress: 1377/1881 symbols completed. PNNT took 1.3s. Estimated remaining: 3m 26s. Rate: 147.1 symbols/min [2025-10-27T22:13:59.840331] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:00.181677] [DEBUG] [LOCAL ] PRH: Loaded 4565 existing records from primary storage. [2025-10-27T22:14:00.182539] [INFO ] [MAIN ] PRH: Loaded 4565 primary data records. [2025-10-27T22:14:00.499534] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:00.544345] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:00.584908] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:00.610943] [INFO ] [MAIN ] PPT: Generated 138 derivative records from 19331 primary records. [2025-10-27T22:14:00.612501] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-27T22:14:00.629399] [DEBUG] [LOCAL ] PPT: Derivative data saved (138 records). [2025-10-27T22:14:00.630889] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-27T22:14:00.634534] [INFO ] [MAIN ] Derivative Progress: 1378/1881 symbols completed. PPT took 1.1s. Estimated remaining: 3m 25s. Rate: 147.0 symbols/min [2025-10-27T22:14:00.644858] [INFO ] [MAIN ] PRCS: Generated 138 derivative records from 2724 primary records. [2025-10-27T22:14:00.644989] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-27T22:14:00.659152] [DEBUG] [LOCAL ] PRCS: Derivative data saved (138 records). [2025-10-27T22:14:00.662457] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-27T22:14:00.665211] [INFO ] [MAIN ] Derivative Progress: 1379/1881 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 25s. Rate: 147.1 symbols/min [2025-10-27T22:14:00.667858] [INFO ] [MAIN ] PRH: Generated 138 derivative records from 4565 primary records. [2025-10-27T22:14:00.667932] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-27T22:14:00.678316] [DEBUG] [LOCAL ] PRH: Derivative data saved (138 records). [2025-10-27T22:14:00.678370] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-27T22:14:00.681170] [INFO ] [MAIN ] Derivative Progress: 1380/1881 symbols completed. PRH took 0.8s. Estimated remaining: 3m 24s. Rate: 147.2 symbols/min [2025-10-27T22:14:00.681632] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:00.681835] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:00.681761] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:00.733969] [DEBUG] [LOCAL ] PRKS: Loaded 42027 existing records from primary storage. [2025-10-27T22:14:00.734165] [INFO ] [MAIN ] PRKS: Loaded 42027 primary data records. [2025-10-27T22:14:00.857392] [DEBUG] [LOCAL ] PRM: Loaded 44124 existing records from primary storage. [2025-10-27T22:14:00.857556] [INFO ] [MAIN ] PRM: Loaded 44124 primary data records. [2025-10-27T22:14:00.880479] [DEBUG] [LOCAL ] PRIM: Loaded 43973 existing records from primary storage. [2025-10-27T22:14:00.906554] [INFO ] [MAIN ] PRIM: Loaded 43973 primary data records. [2025-10-27T22:14:01.757506] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:01.816753] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:01.817551] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:01.892521] [INFO ] [MAIN ] PRKS: Generated 138 derivative records from 42027 primary records. [2025-10-27T22:14:01.893935] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-27T22:14:01.914531] [DEBUG] [LOCAL ] PRKS: Derivative data saved (138 records). [2025-10-27T22:14:01.917859] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-27T22:14:01.920103] [INFO ] [MAIN ] Derivative Progress: 1381/1881 symbols completed. PRKS took 1.2s. Estimated remaining: 3m 24s. Rate: 147.0 symbols/min [2025-10-27T22:14:01.922258] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:01.920820] [INFO ] [MAIN ] PRIM: Generated 138 derivative records from 43973 primary records. [2025-10-27T22:14:01.923270] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-27T22:14:01.923527] [INFO ] [MAIN ] PRM: Generated 138 derivative records from 44124 primary records. [2025-10-27T22:14:01.924224] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-27T22:14:01.945105] [DEBUG] [LOCAL ] PRIM: Derivative data saved (138 records). [2025-10-27T22:14:01.946471] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-27T22:14:01.949101] [INFO ] [MAIN ] Derivative Progress: 1382/1881 symbols completed. PRIM took 1.3s. Estimated remaining: 3m 24s. Rate: 147.1 symbols/min [2025-10-27T22:14:01.950404] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:01.951052] [DEBUG] [LOCAL ] PRM: Derivative data saved (138 records). [2025-10-27T22:14:01.951152] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-27T22:14:01.954456] [INFO ] [MAIN ] Derivative Progress: 1383/1881 symbols completed. PRM took 1.3s. Estimated remaining: 3m 23s. Rate: 147.2 symbols/min [2025-10-27T22:14:01.954672] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:01.962890] [DEBUG] [LOCAL ] PRT: Loaded 4957 existing records from primary storage. [2025-10-27T22:14:01.963291] [INFO ] [MAIN ] PRT: Loaded 4957 primary data records. [2025-10-27T22:14:02.285342] [DEBUG] [LOCAL ] PRMB: Loaded 53066 existing records from primary storage. [2025-10-27T22:14:02.286330] [DEBUG] [LOCAL ] PRO: Loaded 39989 existing records from primary storage. [2025-10-27T22:14:02.301732] [INFO ] [MAIN ] PRO: Loaded 39989 primary data records. [2025-10-27T22:14:02.336773] [INFO ] [MAIN ] PRMB: Loaded 53066 primary data records. [2025-10-27T22:14:02.980468] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:03.028112] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:03.064785] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:03.111338] [INFO ] [MAIN ] PRT: Generated 138 derivative records from 4957 primary records. [2025-10-27T22:14:03.115368] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-27T22:14:03.134637] [DEBUG] [LOCAL ] PRT: Derivative data saved (138 records). [2025-10-27T22:14:03.138184] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-27T22:14:03.140962] [INFO ] [MAIN ] Derivative Progress: 1384/1881 symbols completed. PRT took 1.2s. Estimated remaining: 3m 23s. Rate: 147.0 symbols/min [2025-10-27T22:14:03.141704] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:03.156083] [INFO ] [MAIN ] PRO: Generated 138 derivative records from 39989 primary records. [2025-10-27T22:14:03.159180] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-27T22:14:03.172204] [DEBUG] [LOCAL ] PSBD: Loaded 8254 existing records from primary storage. [2025-10-27T22:14:03.175213] [INFO ] [MAIN ] PSBD: Loaded 8254 primary data records. [2025-10-27T22:14:03.199122] [DEBUG] [LOCAL ] PRO: Derivative data saved (138 records). [2025-10-27T22:14:03.199492] [INFO ] [MAIN ] PRMB: Generated 138 derivative records from 53066 primary records. [2025-10-27T22:14:03.215201] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-27T22:14:03.209974] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-27T22:14:03.244813] [INFO ] [MAIN ] Derivative Progress: 1385/1881 symbols completed. PRO took 1.3s. Estimated remaining: 3m 22s. Rate: 147.1 symbols/min [2025-10-27T22:14:03.256545] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:03.294737] [DEBUG] [LOCAL ] PRMB: Derivative data saved (138 records). [2025-10-27T22:14:03.294934] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-27T22:14:03.298349] [INFO ] [MAIN ] Derivative Progress: 1386/1881 symbols completed. PRMB took 1.4s. Estimated remaining: 3m 22s. Rate: 147.2 symbols/min [2025-10-27T22:14:03.299069] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:03.360554] [DEBUG] [LOCAL ] PSF: Loaded 6791 existing records from primary storage. [2025-10-27T22:14:03.382255] [INFO ] [MAIN ] PSF: Loaded 6791 primary data records. [2025-10-27T22:14:03.658447] [DEBUG] [LOCAL ] PSFE: Loaded 29157 existing records from primary storage. [2025-10-27T22:14:03.677541] [INFO ] [MAIN ] PSFE: Loaded 29157 primary data records. [2025-10-27T22:14:04.201072] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:04.235518] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:04.291132] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:04.329628] [INFO ] [MAIN ] PSBD: Generated 138 derivative records from 8254 primary records. [2025-10-27T22:14:04.329967] [INFO ] [MAIN ] PSF: Generated 138 derivative records from 6791 primary records. [2025-10-27T22:14:04.332549] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-27T22:14:04.333168] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-27T22:14:04.355179] [DEBUG] [LOCAL ] PSF: Derivative data saved (138 records). [2025-10-27T22:14:04.357460] [DEBUG] [LOCAL ] PSBD: Derivative data saved (138 records). [2025-10-27T22:14:04.357703] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-27T22:14:04.357992] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-27T22:14:04.360185] [INFO ] [MAIN ] Derivative Progress: 1387/1881 symbols completed. PSBD took 1.2s. Estimated remaining: 3m 22s. Rate: 147.0 symbols/min [2025-10-27T22:14:04.365336] [INFO ] [MAIN ] Derivative Progress: 1388/1881 symbols completed. PSF took 1.1s. Estimated remaining: 3m 21s. Rate: 147.1 symbols/min [2025-10-27T22:14:04.365891] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:04.365020] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:04.374766] [INFO ] [MAIN ] PSFE: Generated 138 derivative records from 29157 primary records. [2025-10-27T22:14:04.374952] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-27T22:14:04.387466] [DEBUG] [LOCAL ] PSFE: Derivative data saved (138 records). [2025-10-27T22:14:04.387773] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-27T22:14:04.391158] [INFO ] [MAIN ] Derivative Progress: 1389/1881 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 21s. Rate: 147.2 symbols/min [2025-10-27T22:14:04.391354] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:04.439355] [DEBUG] [LOCAL ] PSO: Loaded 36199 existing records from primary storage. [2025-10-27T22:14:04.440137] [INFO ] [MAIN ] PSO: Loaded 36199 primary data records. [2025-10-27T22:14:04.440023] [DEBUG] [LOCAL ] PSQH: Loaded 35315 existing records from primary storage. [2025-10-27T22:14:04.440328] [INFO ] [MAIN ] PSQH: Loaded 35315 primary data records. [2025-10-27T22:14:04.523064] [DEBUG] [LOCAL ] PSTL: Loaded 19704 existing records from primary storage. [2025-10-27T22:14:04.542591] [INFO ] [MAIN ] PSTL: Loaded 19704 primary data records. [2025-10-27T22:14:05.386968] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:05.412430] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:05.435104] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:05.507502] [INFO ] [MAIN ] PSTL: Generated 138 derivative records from 19704 primary records. [2025-10-27T22:14:05.511288] [INFO ] [MAIN ] PSO: Generated 138 derivative records from 36199 primary records. [2025-10-27T22:14:05.511668] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-27T22:14:05.511613] [INFO ] [MAIN ] PSQH: Generated 138 derivative records from 35315 primary records. [2025-10-27T22:14:05.512312] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-27T22:14:05.509739] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-27T22:14:05.534020] [DEBUG] [LOCAL ] PSO: Derivative data saved (138 records). [2025-10-27T22:14:05.543295] [DEBUG] [LOCAL ] PSQH: Derivative data saved (138 records). [2025-10-27T22:14:05.547428] [DEBUG] [LOCAL ] PSTL: Derivative data saved (138 records). [2025-10-27T22:14:05.547679] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-27T22:14:05.543386] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-27T22:14:05.550803] [INFO ] [MAIN ] Derivative Progress: 1390/1881 symbols completed. PSO took 1.2s. Estimated remaining: 3m 20s. Rate: 147.0 symbols/min [2025-10-27T22:14:05.550990] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:05.553503] [INFO ] [MAIN ] Derivative Progress: 1391/1881 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 20s. Rate: 147.1 symbols/min [2025-10-27T22:14:05.553980] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:05.547571] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-27T22:14:05.556613] [INFO ] [MAIN ] Derivative Progress: 1392/1881 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 19s. Rate: 147.2 symbols/min [2025-10-27T22:14:05.557032] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:05.575253] [DEBUG] [LOCAL ] PTA: Loaded 15268 existing records from primary storage. [2025-10-27T22:14:05.575567] [INFO ] [MAIN ] PTA: Loaded 15268 primary data records. [2025-10-27T22:14:05.735223] [DEBUG] [LOCAL ] PUK: Loaded 44209 existing records from primary storage. [2025-10-27T22:14:05.796681] [INFO ] [MAIN ] PUK: Loaded 44209 primary data records. [2025-10-27T22:14:05.797183] [DEBUG] [LOCAL ] PTY: Loaded 37696 existing records from primary storage. [2025-10-27T22:14:05.859364] [INFO ] [MAIN ] PTY: Loaded 37696 primary data records. [2025-10-27T22:14:06.566330] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:06.620578] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:06.620290] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:06.683062] [INFO ] [MAIN ] PTA: Generated 138 derivative records from 15268 primary records. [2025-10-27T22:14:06.683292] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-27T22:14:06.703313] [DEBUG] [LOCAL ] PTA: Derivative data saved (138 records). [2025-10-27T22:14:06.704222] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-27T22:14:06.706814] [INFO ] [MAIN ] Derivative Progress: 1393/1881 symbols completed. PTA took 1.2s. Estimated remaining: 3m 19s. Rate: 147.0 symbols/min [2025-10-27T22:14:06.720978] [INFO ] [MAIN ] PTY: Generated 138 derivative records from 37696 primary records. [2025-10-27T22:14:06.718952] [INFO ] [MAIN ] PUK: Generated 138 derivative records from 44209 primary records. [2025-10-27T22:14:06.721124] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-27T22:14:06.721265] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-27T22:14:06.743168] [DEBUG] [LOCAL ] PTY: Derivative data saved (138 records). [2025-10-27T22:14:06.743261] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-27T22:14:06.746822] [INFO ] [MAIN ] Derivative Progress: 1394/1881 symbols completed. PTY took 1.2s. Estimated remaining: 3m 19s. Rate: 147.1 symbols/min [2025-10-27T22:14:06.749513] [DEBUG] [LOCAL ] PUK: Derivative data saved (138 records). [2025-10-27T22:14:06.749601] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-27T22:14:06.752192] [INFO ] [MAIN ] Derivative Progress: 1395/1881 symbols completed. PUK took 1.2s. Estimated remaining: 3m 18s. Rate: 147.2 symbols/min [2025-10-27T22:14:06.752813] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:06.752934] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:06.753271] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:06.760460] [DEBUG] [LOCAL ] PVL: Loaded 4761 existing records from primary storage. [2025-10-27T22:14:06.760676] [INFO ] [MAIN ] PVL: Loaded 4761 primary data records. [2025-10-27T22:14:06.877147] [DEBUG] [LOCAL ] QD: Loaded 27303 existing records from primary storage. [2025-10-27T22:14:06.888821] [INFO ] [MAIN ] QD: Loaded 27303 primary data records. [2025-10-27T22:14:07.098067] [DEBUG] [LOCAL ] PX: Loaded 33364 existing records from primary storage. [2025-10-27T22:14:07.142889] [INFO ] [MAIN ] PX: Loaded 33364 primary data records. [2025-10-27T22:14:07.780951] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:07.829786] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:07.845149] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:07.878807] [INFO ] [MAIN ] PVL: Generated 138 derivative records from 4761 primary records. [2025-10-27T22:14:07.881585] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-27T22:14:07.899252] [DEBUG] [LOCAL ] PVL: Derivative data saved (138 records). [2025-10-27T22:14:07.899396] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-27T22:14:07.901424] [INFO ] [MAIN ] Derivative Progress: 1396/1881 symbols completed. PVL took 1.1s. Estimated remaining: 3m 18s. Rate: 147.1 symbols/min [2025-10-27T22:14:07.901629] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:07.946922] [INFO ] [MAIN ] QD: Generated 138 derivative records from 27303 primary records. [2025-10-27T22:14:07.949245] [INFO ] [MAIN ] PX: Generated 138 derivative records from 33364 primary records. [2025-10-27T22:14:07.949337] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-27T22:14:07.949873] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-27T22:14:07.970833] [DEBUG] [LOCAL ] QD: Derivative data saved (138 records). [2025-10-27T22:14:07.974380] [DEBUG] [LOCAL ] PX: Derivative data saved (138 records). [2025-10-27T22:14:07.974722] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-27T22:14:07.974559] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-27T22:14:07.977517] [INFO ] [MAIN ] Derivative Progress: 1397/1881 symbols completed. QD took 1.2s. Estimated remaining: 3m 17s. Rate: 147.1 symbols/min [2025-10-27T22:14:07.977790] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:07.980757] [INFO ] [MAIN ] Derivative Progress: 1398/1881 symbols completed. PX took 1.2s. Estimated remaining: 3m 17s. Rate: 147.2 symbols/min [2025-10-27T22:14:07.994247] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:07.995863] [DEBUG] [LOCAL ] QGEN: Loaded 48922 existing records from primary storage. [2025-10-27T22:14:07.996382] [INFO ] [MAIN ] QGEN: Loaded 48922 primary data records. [2025-10-27T22:14:08.367950] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-27T22:14:08.369153] [INFO ] [MAIN ] QS: Loaded 53760 primary data records. [2025-10-27T22:14:08.382071] [DEBUG] [LOCAL ] QSR: Loaded 52372 existing records from primary storage. [2025-10-27T22:14:08.382477] [INFO ] [MAIN ] QSR: Loaded 52372 primary data records. [2025-10-27T22:14:08.983034] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:09.051050] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:09.051407] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:09.088271] [INFO ] [MAIN ] QGEN: Generated 138 derivative records from 48922 primary records. [2025-10-27T22:14:09.088864] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-27T22:14:09.105985] [DEBUG] [LOCAL ] QGEN: Derivative data saved (138 records). [2025-10-27T22:14:09.110127] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-27T22:14:09.113511] [INFO ] [MAIN ] Derivative Progress: 1399/1881 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 17s. Rate: 147.1 symbols/min [2025-10-27T22:14:09.113870] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:09.153557] [INFO ] [MAIN ] QS: Generated 138 derivative records from 53760 primary records. [2025-10-27T22:14:09.155730] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-27T22:14:09.156293] [INFO ] [MAIN ] QSR: Generated 138 derivative records from 52372 primary records. [2025-10-27T22:14:09.156777] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-27T22:14:09.169171] [DEBUG] [LOCAL ] QS: Derivative data saved (138 records). [2025-10-27T22:14:09.192287] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-27T22:14:09.195051] [INFO ] [MAIN ] Derivative Progress: 1400/1881 symbols completed. QS took 1.2s. Estimated remaining: 3m 16s. Rate: 147.1 symbols/min [2025-10-27T22:14:09.195269] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:09.192428] [DEBUG] [LOCAL ] QSR: Derivative data saved (138 records). [2025-10-27T22:14:09.195549] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-27T22:14:09.199471] [INFO ] [MAIN ] Derivative Progress: 1401/1881 symbols completed. QSR took 1.2s. Estimated remaining: 3m 16s. Rate: 147.2 symbols/min [2025-10-27T22:14:09.199734] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:09.200989] [DEBUG] [LOCAL ] QTWO: Loaded 39260 existing records from primary storage. [2025-10-27T22:14:09.201472] [INFO ] [MAIN ] QTWO: Loaded 39260 primary data records. [2025-10-27T22:14:09.314283] [DEBUG] [LOCAL ] QVCC: Loaded 8554 existing records from primary storage. [2025-10-27T22:14:09.325415] [INFO ] [MAIN ] QVCC: Loaded 8554 primary data records. [2025-10-27T22:14:09.409615] [DEBUG] [LOCAL ] QUAD: Loaded 22857 existing records from primary storage. [2025-10-27T22:14:09.441845] [INFO ] [MAIN ] QUAD: Loaded 22857 primary data records. [2025-10-27T22:14:10.206105] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:10.244268] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:10.273018] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:10.322027] [INFO ] [MAIN ] QTWO: Generated 138 derivative records from 39260 primary records. [2025-10-27T22:14:10.324914] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-27T22:14:10.341121] [DEBUG] [LOCAL ] QTWO: Derivative data saved (138 records). [2025-10-27T22:14:10.341501] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-27T22:14:10.343576] [INFO ] [MAIN ] Derivative Progress: 1402/1881 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 15s. Rate: 147.1 symbols/min [2025-10-27T22:14:10.344967] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:10.357417] [DEBUG] [LOCAL ] QVCD: Loaded 4443 existing records from primary storage. [2025-10-27T22:14:10.359628] [INFO ] [MAIN ] QUAD: Generated 138 derivative records from 22857 primary records. [2025-10-27T22:14:10.360976] [INFO ] [MAIN ] QVCD: Loaded 4443 primary data records. [2025-10-27T22:14:10.361467] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-27T22:14:10.363427] [INFO ] [MAIN ] QVCC: Generated 138 derivative records from 8554 primary records. [2025-10-27T22:14:10.384167] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-27T22:14:10.418727] [DEBUG] [LOCAL ] QUAD: Derivative data saved (138 records). [2025-10-27T22:14:10.464428] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-27T22:14:10.474771] [INFO ] [MAIN ] Derivative Progress: 1403/1881 symbols completed. QUAD took 1.3s. Estimated remaining: 3m 15s. Rate: 147.1 symbols/min [2025-10-27T22:14:10.480438] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:10.472049] [DEBUG] [LOCAL ] QVCC: Derivative data saved (138 records). [2025-10-27T22:14:10.491233] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-27T22:14:10.505126] [INFO ] [MAIN ] Derivative Progress: 1404/1881 symbols completed. QVCC took 1.3s. Estimated remaining: 3m 14s. Rate: 147.2 symbols/min [2025-10-27T22:14:10.515751] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:10.707807] [DEBUG] [LOCAL ] RA: Loaded 21637 existing records from primary storage. [2025-10-27T22:14:10.708094] [INFO ] [MAIN ] RA: Loaded 21637 primary data records. [2025-10-27T22:14:10.869774] [DEBUG] [LOCAL ] QXO: Loaded 53489 existing records from primary storage. [2025-10-27T22:14:10.903688] [INFO ] [MAIN ] QXO: Loaded 53489 primary data records. [2025-10-27T22:14:11.143021] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:11.412855] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:11.425168] [INFO ] [MAIN ] QVCD: Generated 138 derivative records from 4443 primary records. [2025-10-27T22:14:11.426302] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-27T22:14:11.443670] [DEBUG] [LOCAL ] QVCD: Derivative data saved (138 records). [2025-10-27T22:14:11.443849] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-27T22:14:11.448930] [INFO ] [MAIN ] Derivative Progress: 1405/1881 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 14s. Rate: 147.1 symbols/min [2025-10-27T22:14:11.449737] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:11.466886] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:11.508446] [INFO ] [MAIN ] RA: Generated 138 derivative records from 21637 primary records. [2025-10-27T22:14:11.510027] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-27T22:14:11.525543] [DEBUG] [LOCAL ] RA: Derivative data saved (138 records). [2025-10-27T22:14:11.535683] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-27T22:14:11.539121] [INFO ] [MAIN ] Derivative Progress: 1406/1881 symbols completed. RA took 1.0s. Estimated remaining: 3m 14s. Rate: 147.2 symbols/min [2025-10-27T22:14:11.539436] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:11.540225] [DEBUG] [LOCAL ] RACE: Loaded 32773 existing records from primary storage. [2025-10-27T22:14:11.540333] [INFO ] [MAIN ] RACE: Loaded 32773 primary data records. [2025-10-27T22:14:11.648428] [INFO ] [MAIN ] QXO: Generated 138 derivative records from 53489 primary records. [2025-10-27T22:14:11.659402] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-27T22:14:11.868513] [DEBUG] [LOCAL ] QXO: Derivative data saved (138 records). [2025-10-27T22:14:11.868691] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-27T22:14:11.871440] [INFO ] [MAIN ] Derivative Progress: 1407/1881 symbols completed. QXO took 1.4s. Estimated remaining: 3m 13s. Rate: 147.2 symbols/min [2025-10-27T22:14:11.872632] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:11.891785] [DEBUG] [LOCAL ] RBLX: Loaded 53717 existing records from primary storage. [2025-10-27T22:14:11.892038] [INFO ] [MAIN ] RBLX: Loaded 53717 primary data records. [2025-10-27T22:14:11.972311] [DEBUG] [LOCAL ] RBOT: Loaded 6283 existing records from primary storage. [2025-10-27T22:14:11.997989] [INFO ] [MAIN ] RBOT: Loaded 6283 primary data records. [2025-10-27T22:14:12.526582] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:12.571993] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:12.610238] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:12.633278] [INFO ] [MAIN ] RACE: Generated 138 derivative records from 32773 primary records. [2025-10-27T22:14:12.635900] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-27T22:14:12.650776] [DEBUG] [LOCAL ] RACE: Derivative data saved (138 records). [2025-10-27T22:14:12.653389] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-27T22:14:12.660714] [INFO ] [MAIN ] Derivative Progress: 1408/1881 symbols completed. RACE took 1.2s. Estimated remaining: 3m 13s. Rate: 147.1 symbols/min [2025-10-27T22:14:12.669233] [INFO ] [MAIN ] RBLX: Generated 138 derivative records from 53717 primary records. [2025-10-27T22:14:12.669510] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-27T22:14:12.686266] [DEBUG] [LOCAL ] RBLX: Derivative data saved (138 records). [2025-10-27T22:14:12.689917] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-27T22:14:12.693977] [INFO ] [MAIN ] Derivative Progress: 1409/1881 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 12s. Rate: 147.2 symbols/min [2025-10-27T22:14:12.695458] [INFO ] [MAIN ] RBOT: Generated 138 derivative records from 6283 primary records. [2025-10-27T22:14:12.695526] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-27T22:14:12.705718] [DEBUG] [LOCAL ] RBOT: Derivative data saved (138 records). [2025-10-27T22:14:12.705774] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-27T22:14:12.708397] [INFO ] [MAIN ] Derivative Progress: 1410/1881 symbols completed. RBOT took 0.8s. Estimated remaining: 3m 12s. Rate: 147.3 symbols/min [2025-10-27T22:14:12.709112] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:12.709160] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:12.709029] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:12.715870] [DEBUG] [LOCAL ] RCD: Loaded 3252 existing records from primary storage. [2025-10-27T22:14:12.716148] [INFO ] [MAIN ] RCD: Loaded 3252 primary data records. [2025-10-27T22:14:13.052454] [DEBUG] [LOCAL ] RBRK: Loaded 53161 existing records from primary storage. [2025-10-27T22:14:13.053308] [INFO ] [MAIN ] RBRK: Loaded 53161 primary data records. [2025-10-27T22:14:13.110776] [DEBUG] [LOCAL ] RCI: Loaded 48551 existing records from primary storage. [2025-10-27T22:14:13.123045] [INFO ] [MAIN ] RCI: Loaded 48551 primary data records. [2025-10-27T22:14:13.684923] [DEBUG] [MAIN ] RCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:13.733536] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:13.766449] [INFO ] [MAIN ] RCD: Generated 138 derivative records from 3252 primary records. [2025-10-27T22:14:13.764633] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:13.766838] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-27T22:14:13.792920] [DEBUG] [LOCAL ] RCD: Derivative data saved (138 records). [2025-10-27T22:14:13.793027] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-27T22:14:13.797070] [INFO ] [MAIN ] Derivative Progress: 1411/1881 symbols completed. RCD took 1.1s. Estimated remaining: 3m 12s. Rate: 147.1 symbols/min [2025-10-27T22:14:13.798054] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:13.828636] [DEBUG] [LOCAL ] RCS: Loaded 12263 existing records from primary storage. [2025-10-27T22:14:13.829844] [INFO ] [MAIN ] RCS: Loaded 12263 primary data records. [2025-10-27T22:14:13.834303] [INFO ] [MAIN ] RBRK: Generated 138 derivative records from 53161 primary records. [2025-10-27T22:14:13.845469] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-27T22:14:13.930241] [DEBUG] [LOCAL ] RBRK: Derivative data saved (138 records). [2025-10-27T22:14:13.942542] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-27T22:14:13.944542] [INFO ] [MAIN ] Derivative Progress: 1412/1881 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 11s. Rate: 147.2 symbols/min [2025-10-27T22:14:13.942480] [INFO ] [MAIN ] RCI: Generated 138 derivative records from 48551 primary records. [2025-10-27T22:14:13.954992] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-27T22:14:13.961125] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:13.993989] [DEBUG] [LOCAL ] RCI: Derivative data saved (138 records). [2025-10-27T22:14:13.999331] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-27T22:14:14.012852] [INFO ] [MAIN ] Derivative Progress: 1413/1881 symbols completed. RCI took 1.3s. Estimated remaining: 3m 11s. Rate: 147.3 symbols/min [2025-10-27T22:14:14.031043] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:14.273130] [DEBUG] [LOCAL ] RDDT: Loaded 53769 existing records from primary storage. [2025-10-27T22:14:14.272088] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:14.273346] [INFO ] [MAIN ] RDDT: Loaded 53769 primary data records. [2025-10-27T22:14:14.423219] [DEBUG] [LOCAL ] RDW: Loaded 52316 existing records from primary storage. [2025-10-27T22:14:14.481282] [INFO ] [MAIN ] RDW: Loaded 52316 primary data records. [2025-10-27T22:14:14.906618] [INFO ] [MAIN ] RCS: Generated 138 derivative records from 12263 primary records. [2025-10-27T22:14:14.907582] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-27T22:14:14.921755] [DEBUG] [LOCAL ] RCS: Derivative data saved (138 records). [2025-10-27T22:14:14.922042] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-27T22:14:14.924554] [INFO ] [MAIN ] Derivative Progress: 1414/1881 symbols completed. RCS took 1.1s. Estimated remaining: 3m 10s. Rate: 147.1 symbols/min [2025-10-27T22:14:14.924796] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:14.939357] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:14.995776] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:15.012254] [INFO ] [MAIN ] RDDT: Generated 138 derivative records from 53769 primary records. [2025-10-27T22:14:15.013934] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-27T22:14:15.036947] [DEBUG] [LOCAL ] RDY: Loaded 46035 existing records from primary storage. [2025-10-27T22:14:15.037238] [INFO ] [MAIN ] RDY: Loaded 46035 primary data records. [2025-10-27T22:14:15.105031] [DEBUG] [LOCAL ] RDDT: Derivative data saved (138 records). [2025-10-27T22:14:15.116616] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-27T22:14:15.131315] [INFO ] [MAIN ] Derivative Progress: 1415/1881 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 10s. Rate: 147.2 symbols/min [2025-10-27T22:14:15.136809] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:15.351269] [INFO ] [MAIN ] RDW: Generated 138 derivative records from 52316 primary records. [2025-10-27T22:14:15.352189] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-27T22:14:15.378068] [DEBUG] [LOCAL ] RDW: Derivative data saved (138 records). [2025-10-27T22:14:15.378186] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-27T22:14:15.381509] [INFO ] [MAIN ] Derivative Progress: 1416/1881 symbols completed. RDW took 1.4s. Estimated remaining: 3m 10s. Rate: 147.2 symbols/min [2025-10-27T22:14:15.381797] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:15.397376] [DEBUG] [LOCAL ] RELX: Loaded 48478 existing records from primary storage. [2025-10-27T22:14:15.397947] [INFO ] [MAIN ] RELX: Loaded 48478 primary data records. [2025-10-27T22:14:15.710692] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:15.736255] [DEBUG] [LOCAL ] RERE: Loaded 41754 existing records from primary storage. [2025-10-27T22:14:15.738790] [INFO ] [MAIN ] RERE: Loaded 41754 primary data records. [2025-10-27T22:14:16.095087] [INFO ] [MAIN ] RDY: Generated 138 derivative records from 46035 primary records. [2025-10-27T22:14:16.096466] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-27T22:14:16.121946] [DEBUG] [LOCAL ] RDY: Derivative data saved (138 records). [2025-10-27T22:14:16.122083] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-27T22:14:16.121664] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:16.124536] [INFO ] [MAIN ] Derivative Progress: 1417/1881 symbols completed. RDY took 1.2s. Estimated remaining: 3m 9s. Rate: 147.1 symbols/min [2025-10-27T22:14:16.137520] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:16.182819] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:16.202040] [INFO ] [MAIN ] RELX: Generated 138 derivative records from 48478 primary records. [2025-10-27T22:14:16.216914] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-27T22:14:16.218045] [DEBUG] [LOCAL ] REVG: Loaded 39843 existing records from primary storage. [2025-10-27T22:14:16.220612] [INFO ] [MAIN ] REVG: Loaded 39843 primary data records. [2025-10-27T22:14:16.316979] [DEBUG] [LOCAL ] RELX: Derivative data saved (138 records). [2025-10-27T22:14:16.327587] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-27T22:14:16.343002] [INFO ] [MAIN ] Derivative Progress: 1418/1881 symbols completed. RELX took 1.2s. Estimated remaining: 3m 9s. Rate: 147.2 symbols/min [2025-10-27T22:14:16.348688] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:16.554118] [INFO ] [MAIN ] RERE: Generated 138 derivative records from 41754 primary records. [2025-10-27T22:14:16.554328] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-27T22:14:16.572286] [DEBUG] [LOCAL ] RFI: Loaded 9914 existing records from primary storage. [2025-10-27T22:14:16.578237] [INFO ] [MAIN ] RFI: Loaded 9914 primary data records. [2025-10-27T22:14:16.578959] [DEBUG] [LOCAL ] RERE: Derivative data saved (138 records). [2025-10-27T22:14:16.609842] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-27T22:14:16.613542] [INFO ] [MAIN ] Derivative Progress: 1419/1881 symbols completed. RERE took 1.2s. Estimated remaining: 3m 8s. Rate: 147.2 symbols/min [2025-10-27T22:14:16.637311] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:16.770811] [DEBUG] [LOCAL ] RFL: Loaded 11378 existing records from primary storage. [2025-10-27T22:14:16.884706] [INFO ] [MAIN ] RFL: Loaded 11378 primary data records. [2025-10-27T22:14:17.000439] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:17.237322] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:17.255193] [INFO ] [MAIN ] REVG: Generated 138 derivative records from 39843 primary records. [2025-10-27T22:14:17.257366] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-27T22:14:17.279773] [DEBUG] [LOCAL ] REVG: Derivative data saved (138 records). [2025-10-27T22:14:17.284353] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-27T22:14:17.284915] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:17.297927] [INFO ] [MAIN ] Derivative Progress: 1420/1881 symbols completed. REVG took 1.2s. Estimated remaining: 3m 8s. Rate: 147.2 symbols/min [2025-10-27T22:14:17.301048] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:17.312324] [DEBUG] [LOCAL ] RFM: Loaded 4090 existing records from primary storage. [2025-10-27T22:14:17.313639] [INFO ] [MAIN ] RFM: Loaded 4090 primary data records. [2025-10-27T22:14:17.512958] [INFO ] [MAIN ] RFI: Generated 138 derivative records from 9914 primary records. [2025-10-27T22:14:17.624593] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-27T22:14:17.640875] [DEBUG] [LOCAL ] RFI: Derivative data saved (138 records). [2025-10-27T22:14:17.641831] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-27T22:14:17.644930] [INFO ] [MAIN ] Derivative Progress: 1421/1881 symbols completed. RFI took 1.3s. Estimated remaining: 3m 8s. Rate: 147.2 symbols/min [2025-10-27T22:14:17.647606] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:17.648010] [INFO ] [MAIN ] RFL: Generated 138 derivative records from 11378 primary records. [2025-10-27T22:14:17.648418] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-27T22:14:17.667208] [DEBUG] [LOCAL ] RFMZ: Loaded 8929 existing records from primary storage. [2025-10-27T22:14:17.668244] [INFO ] [MAIN ] RFMZ: Loaded 8929 primary data records. [2025-10-27T22:14:17.668623] [DEBUG] [LOCAL ] RFL: Derivative data saved (138 records). [2025-10-27T22:14:17.698680] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-27T22:14:17.706303] [INFO ] [MAIN ] Derivative Progress: 1422/1881 symbols completed. RFL took 1.1s. Estimated remaining: 3m 7s. Rate: 147.3 symbols/min [2025-10-27T22:14:17.724673] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:17.826802] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:17.813938] [DEBUG] [LOCAL ] RGT: Loaded 2623 existing records from primary storage. [2025-10-27T22:14:17.870637] [INFO ] [MAIN ] RGT: Loaded 2623 primary data records. [2025-10-27T22:14:18.350870] [INFO ] [MAIN ] RFM: Generated 138 derivative records from 4090 primary records. [2025-10-27T22:14:18.351610] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-27T22:14:18.377989] [DEBUG] [LOCAL ] RFM: Derivative data saved (138 records). [2025-10-27T22:14:18.378960] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:18.379071] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-27T22:14:18.381116] [INFO ] [MAIN ] Derivative Progress: 1423/1881 symbols completed. RFM took 1.1s. Estimated remaining: 3m 7s. Rate: 147.2 symbols/min [2025-10-27T22:14:18.421181] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:18.447466] [INFO ] [MAIN ] RFMZ: Generated 138 derivative records from 8929 primary records. [2025-10-27T22:14:18.447631] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-27T22:14:18.464796] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (138 records). [2025-10-27T22:14:18.465921] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-27T22:14:18.468267] [INFO ] [MAIN ] Derivative Progress: 1424/1881 symbols completed. RFMZ took 0.8s. Estimated remaining: 3m 6s. Rate: 147.3 symbols/min [2025-10-27T22:14:18.472522] [INFO ] [MAIN ] RGT: Generated 138 derivative records from 2623 primary records. [2025-10-27T22:14:18.472589] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-27T22:14:18.482611] [DEBUG] [LOCAL ] RGT: Derivative data saved (138 records). [2025-10-27T22:14:18.482696] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-27T22:14:18.485209] [INFO ] [MAIN ] Derivative Progress: 1425/1881 symbols completed. RGT took 0.8s. Estimated remaining: 3m 6s. Rate: 147.4 symbols/min [2025-10-27T22:14:18.485538] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:18.485807] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:18.485925] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:18.586529] [DEBUG] [LOCAL ] RITM: Loaded 52932 existing records from primary storage. [2025-10-27T22:14:18.585397] [DEBUG] [LOCAL ] RIO: Loaded 53401 existing records from primary storage. [2025-10-27T22:14:18.586690] [INFO ] [MAIN ] RITM: Loaded 52932 primary data records. [2025-10-27T22:14:18.586760] [INFO ] [MAIN ] RIO: Loaded 53401 primary data records. [2025-10-27T22:14:18.587621] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-27T22:14:18.649607] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-27T22:14:19.495054] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:19.534625] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:19.535086] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:19.626275] [INFO ] [MAIN ] RIO: Generated 138 derivative records from 53401 primary records. [2025-10-27T22:14:19.629580] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-27T22:14:19.632043] [INFO ] [MAIN ] RIG: Generated 138 derivative records from 53675 primary records. [2025-10-27T22:14:19.632361] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-27T22:14:19.655938] [DEBUG] [LOCAL ] RIO: Derivative data saved (138 records). [2025-10-27T22:14:19.657349] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-27T22:14:19.659957] [INFO ] [MAIN ] Derivative Progress: 1426/1881 symbols completed. RIO took 1.2s. Estimated remaining: 3m 5s. Rate: 147.2 symbols/min [2025-10-27T22:14:19.660799] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:19.662248] [DEBUG] [LOCAL ] RIG: Derivative data saved (138 records). [2025-10-27T22:14:19.665279] [INFO ] [MAIN ] RITM: Generated 138 derivative records from 52932 primary records. [2025-10-27T22:14:19.665588] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-27T22:14:19.665680] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-27T22:14:19.669828] [INFO ] [MAIN ] Derivative Progress: 1427/1881 symbols completed. RIG took 1.2s. Estimated remaining: 3m 5s. Rate: 147.3 symbols/min [2025-10-27T22:14:19.670231] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:19.688153] [DEBUG] [LOCAL ] RITM: Derivative data saved (138 records). [2025-10-27T22:14:19.688422] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-27T22:14:19.690575] [INFO ] [MAIN ] Derivative Progress: 1428/1881 symbols completed. RITM took 1.2s. Estimated remaining: 3m 4s. Rate: 147.4 symbols/min [2025-10-27T22:14:19.690808] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:19.696816] [DEBUG] [LOCAL ] RIV: Loaded 12453 existing records from primary storage. [2025-10-27T22:14:19.696942] [INFO ] [MAIN ] RIV: Loaded 12453 primary data records. [2025-10-27T22:14:20.089356] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-27T22:14:20.089694] [INFO ] [MAIN ] RKT: Loaded 53729 primary data records. [2025-10-27T22:14:20.102089] [DEBUG] [LOCAL ] RLJ: Loaded 47747 existing records from primary storage. [2025-10-27T22:14:20.126807] [INFO ] [MAIN ] RLJ: Loaded 47747 primary data records. [2025-10-27T22:14:20.737252] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:20.796617] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:20.823716] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:20.840162] [INFO ] [MAIN ] RIV: Generated 138 derivative records from 12453 primary records. [2025-10-27T22:14:20.844400] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-27T22:14:20.866975] [DEBUG] [LOCAL ] RIV: Derivative data saved (138 records). [2025-10-27T22:14:20.868586] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-27T22:14:20.871219] [INFO ] [MAIN ] Derivative Progress: 1429/1881 symbols completed. RIV took 1.2s. Estimated remaining: 3m 4s. Rate: 147.2 symbols/min [2025-10-27T22:14:20.871718] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:20.904684] [DEBUG] [LOCAL ] RLTY: Loaded 10808 existing records from primary storage. [2025-10-27T22:14:20.907366] [INFO ] [MAIN ] RLTY: Loaded 10808 primary data records. [2025-10-27T22:14:20.907544] [INFO ] [MAIN ] RLJ: Generated 138 derivative records from 47747 primary records. [2025-10-27T22:14:20.928982] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-27T22:14:21.016215] [DEBUG] [LOCAL ] RLJ: Derivative data saved (138 records). [2025-10-27T22:14:21.027603] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-27T22:14:21.052224] [INFO ] [MAIN ] Derivative Progress: 1430/1881 symbols completed. RLJ took 1.4s. Estimated remaining: 3m 4s. Rate: 147.2 symbols/min [2025-10-27T22:14:21.106518] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:21.114788] [INFO ] [MAIN ] RKT: Generated 138 derivative records from 53729 primary records. [2025-10-27T22:14:21.220375] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-27T22:14:21.252159] [DEBUG] [LOCAL ] RKT: Derivative data saved (138 records). [2025-10-27T22:14:21.252767] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-27T22:14:21.259083] [INFO ] [MAIN ] Derivative Progress: 1431/1881 symbols completed. RKT took 1.6s. Estimated remaining: 3m 3s. Rate: 147.3 symbols/min [2025-10-27T22:14:21.259424] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:21.283133] [DEBUG] [LOCAL ] RM: Loaded 7343 existing records from primary storage. [2025-10-27T22:14:21.283292] [INFO ] [MAIN ] RM: Loaded 7343 primary data records. [2025-10-27T22:14:21.425158] [DEBUG] [LOCAL ] RLX: Loaded 47964 existing records from primary storage. [2025-10-27T22:14:21.436212] [INFO ] [MAIN ] RLX: Loaded 47964 primary data records. [2025-10-27T22:14:21.554980] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:22.021499] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:22.044418] [INFO ] [MAIN ] RLTY: Generated 138 derivative records from 10808 primary records. [2025-10-27T22:14:22.047524] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-27T22:14:22.066556] [DEBUG] [LOCAL ] RLTY: Derivative data saved (138 records). [2025-10-27T22:14:22.069696] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-27T22:14:22.074225] [INFO ] [MAIN ] Derivative Progress: 1432/1881 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 3s. Rate: 147.2 symbols/min [2025-10-27T22:14:22.074783] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:22.090465] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:22.119093] [INFO ] [MAIN ] RM: Generated 138 derivative records from 7343 primary records. [2025-10-27T22:14:22.129803] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-27T22:14:22.130606] [DEBUG] [LOCAL ] RMAX: Loaded 21402 existing records from primary storage. [2025-10-27T22:14:22.131910] [INFO ] [MAIN ] RMAX: Loaded 21402 primary data records. [2025-10-27T22:14:22.144292] [DEBUG] [LOCAL ] RM: Derivative data saved (138 records). [2025-10-27T22:14:22.149913] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-27T22:14:22.168303] [INFO ] [MAIN ] Derivative Progress: 1433/1881 symbols completed. RM took 0.9s. Estimated remaining: 3m 3s. Rate: 147.3 symbols/min [2025-10-27T22:14:22.180316] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:22.269428] [DEBUG] [LOCAL ] RMI: Loaded 4737 existing records from primary storage. [2025-10-27T22:14:22.274945] [INFO ] [MAIN ] RMI: Loaded 4737 primary data records. [2025-10-27T22:14:22.724999] [INFO ] [MAIN ] RLX: Generated 138 derivative records from 47964 primary records. [2025-10-27T22:14:22.870926] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-27T22:14:22.900900] [DEBUG] [LOCAL ] RLX: Derivative data saved (138 records). [2025-10-27T22:14:22.902582] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-27T22:14:22.907179] [INFO ] [MAIN ] Derivative Progress: 1434/1881 symbols completed. RLX took 1.8s. Estimated remaining: 3m 2s. Rate: 147.2 symbols/min [2025-10-27T22:14:22.907523] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:22.926354] [DEBUG] [LOCAL ] RMM: Loaded 10696 existing records from primary storage. [2025-10-27T22:14:22.926927] [INFO ] [MAIN ] RMM: Loaded 10696 primary data records. [2025-10-27T22:14:22.955610] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:23.039994] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:23.343872] [INFO ] [MAIN ] RMI: Generated 138 derivative records from 4737 primary records. [2025-10-27T22:14:23.346580] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-27T22:14:23.346504] [INFO ] [MAIN ] RMAX: Generated 138 derivative records from 21402 primary records. [2025-10-27T22:14:23.347276] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-27T22:14:23.367962] [DEBUG] [LOCAL ] RMI: Derivative data saved (138 records). [2025-10-27T22:14:23.369775] [DEBUG] [LOCAL ] RMAX: Derivative data saved (138 records). [2025-10-27T22:14:23.369914] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-27T22:14:23.371966] [INFO ] [MAIN ] Derivative Progress: 1435/1881 symbols completed. RMI took 1.2s. Estimated remaining: 3m 2s. Rate: 147.2 symbols/min [2025-10-27T22:14:23.372293] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:23.369998] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-27T22:14:23.374551] [INFO ] [MAIN ] Derivative Progress: 1436/1881 symbols completed. RMAX took 1.3s. Estimated remaining: 3m 1s. Rate: 147.3 symbols/min [2025-10-27T22:14:23.374875] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:23.383877] [DEBUG] [LOCAL ] RMMZ: Loaded 4722 existing records from primary storage. [2025-10-27T22:14:23.384094] [INFO ] [MAIN ] RMMZ: Loaded 4722 primary data records. [2025-10-27T22:14:23.453162] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:23.548202] [DEBUG] [LOCAL ] RMT: Loaded 17005 existing records from primary storage. [2025-10-27T22:14:23.548715] [INFO ] [MAIN ] RMT: Loaded 17005 primary data records. [2025-10-27T22:14:24.121961] [INFO ] [MAIN ] RMM: Generated 138 derivative records from 10696 primary records. [2025-10-27T22:14:24.122164] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-27T22:14:24.136035] [DEBUG] [LOCAL ] RMM: Derivative data saved (138 records). [2025-10-27T22:14:24.137889] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-27T22:14:24.140950] [INFO ] [MAIN ] Derivative Progress: 1437/1881 symbols completed. RMM took 1.2s. Estimated remaining: 3m 1s. Rate: 147.2 symbols/min [2025-10-27T22:14:24.141365] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:24.163849] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:24.219353] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:24.258328] [DEBUG] [LOCAL ] RNG: Loaded 47862 existing records from primary storage. [2025-10-27T22:14:24.264283] [INFO ] [MAIN ] RNG: Loaded 47862 primary data records. [2025-10-27T22:14:24.341844] [INFO ] [MAIN ] RMMZ: Generated 138 derivative records from 4722 primary records. [2025-10-27T22:14:24.376569] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-27T22:14:24.424674] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (138 records). [2025-10-27T22:14:24.461463] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-27T22:14:24.489828] [INFO ] [MAIN ] Derivative Progress: 1438/1881 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 1s. Rate: 147.2 symbols/min [2025-10-27T22:14:24.645535] [INFO ] [MAIN ] RMT: Generated 138 derivative records from 17005 primary records. [2025-10-27T22:14:24.645838] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-27T22:14:24.659173] [DEBUG] [LOCAL ] RMT: Derivative data saved (138 records). [2025-10-27T22:14:24.659444] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-27T22:14:24.661773] [INFO ] [MAIN ] Derivative Progress: 1439/1881 symbols completed. RMT took 1.3s. Estimated remaining: 3m 0s. Rate: 147.2 symbols/min [2025-10-27T22:14:24.681440] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:24.706504] [INFO ] [MAIN ] RNG: Generated 138 derivative records from 47862 primary records. [2025-10-27T22:14:24.706589] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-27T22:14:24.718477] [DEBUG] [LOCAL ] RNG: Derivative data saved (138 records). [2025-10-27T22:14:24.718580] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-27T22:14:24.720638] [INFO ] [MAIN ] Derivative Progress: 1440/1881 symbols completed. RNG took 0.6s. Estimated remaining: 2m 60s. Rate: 147.3 symbols/min [2025-10-27T22:14:24.721377] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:24.721473] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:24.721546] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:24.746906] [DEBUG] [LOCAL ] RNP: Loaded 15772 existing records from primary storage. [2025-10-27T22:14:24.747071] [INFO ] [MAIN ] RNP: Loaded 15772 primary data records. [2025-10-27T22:14:24.795807] [DEBUG] [LOCAL ] RPT: Loaded 18695 existing records from primary storage. [2025-10-27T22:14:24.816305] [INFO ] [MAIN ] RPT: Loaded 18695 primary data records. [2025-10-27T22:14:24.825321] [DEBUG] [LOCAL ] RNGR: Loaded 20643 existing records from primary storage. [2025-10-27T22:14:24.895430] [INFO ] [MAIN ] RNGR: Loaded 20643 primary data records. [2025-10-27T22:14:25.706424] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:25.733998] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:25.773191] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:25.831385] [INFO ] [MAIN ] RNP: Generated 138 derivative records from 15772 primary records. [2025-10-27T22:14:25.831895] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-27T22:14:25.835843] [INFO ] [MAIN ] RPT: Generated 138 derivative records from 18695 primary records. [2025-10-27T22:14:25.839276] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-27T22:14:25.861884] [DEBUG] [LOCAL ] RNP: Derivative data saved (138 records). [2025-10-27T22:14:25.862101] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-27T22:14:25.864928] [INFO ] [MAIN ] Derivative Progress: 1441/1881 symbols completed. RNP took 1.1s. Estimated remaining: 2m 59s. Rate: 147.2 symbols/min [2025-10-27T22:14:25.868045] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:25.867921] [INFO ] [MAIN ] RNGR: Generated 138 derivative records from 20643 primary records. [2025-10-27T22:14:25.869857] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-27T22:14:25.869606] [DEBUG] [LOCAL ] RPT: Derivative data saved (138 records). [2025-10-27T22:14:25.870954] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-27T22:14:25.873400] [INFO ] [MAIN ] Derivative Progress: 1442/1881 symbols completed. RPT took 1.2s. Estimated remaining: 2m 59s. Rate: 147.3 symbols/min [2025-10-27T22:14:25.873895] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:25.890424] [DEBUG] [LOCAL ] RNGR: Derivative data saved (138 records). [2025-10-27T22:14:25.892507] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-27T22:14:25.898326] [INFO ] [MAIN ] Derivative Progress: 1443/1881 symbols completed. RNGR took 1.2s. Estimated remaining: 2m 58s. Rate: 147.3 symbols/min [2025-10-27T22:14:25.898524] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:25.895571] [DEBUG] [LOCAL ] RSF: Loaded 4184 existing records from primary storage. [2025-10-27T22:14:25.907392] [INFO ] [MAIN ] RSF: Loaded 4184 primary data records. [2025-10-27T22:14:26.018305] [DEBUG] [LOCAL ] RQI: Loaded 28409 existing records from primary storage. [2025-10-27T22:14:26.024246] [INFO ] [MAIN ] RQI: Loaded 28409 primary data records. [2025-10-27T22:14:26.431370] [DEBUG] [LOCAL ] RSI: Loaded 46926 existing records from primary storage. [2025-10-27T22:14:26.587467] [INFO ] [MAIN ] RSI: Loaded 46926 primary data records. [2025-10-27T22:14:26.930558] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:26.944543] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:27.026513] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:27.072853] [INFO ] [MAIN ] RSF: Generated 138 derivative records from 4184 primary records. [2025-10-27T22:14:27.079022] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-27T22:14:27.078886] [INFO ] [MAIN ] RQI: Generated 138 derivative records from 28409 primary records. [2025-10-27T22:14:27.080187] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-27T22:14:27.093738] [DEBUG] [LOCAL ] RSF: Derivative data saved (138 records). [2025-10-27T22:14:27.094159] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-27T22:14:27.097395] [INFO ] [MAIN ] Derivative Progress: 1444/1881 symbols completed. RSF took 1.2s. Estimated remaining: 2m 58s. Rate: 147.1 symbols/min [2025-10-27T22:14:27.112964] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:27.113965] [DEBUG] [LOCAL ] RQI: Derivative data saved (138 records). [2025-10-27T22:14:27.114120] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-27T22:14:27.116734] [INFO ] [MAIN ] Derivative Progress: 1445/1881 symbols completed. RQI took 1.2s. Estimated remaining: 2m 58s. Rate: 147.2 symbols/min [2025-10-27T22:14:27.117168] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:27.127276] [INFO ] [MAIN ] RSI: Generated 138 derivative records from 46926 primary records. [2025-10-27T22:14:27.127517] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-27T22:14:27.152774] [DEBUG] [LOCAL ] RSI: Derivative data saved (138 records). [2025-10-27T22:14:27.153101] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-27T22:14:27.156766] [INFO ] [MAIN ] Derivative Progress: 1446/1881 symbols completed. RSI took 1.3s. Estimated remaining: 2m 57s. Rate: 147.3 symbols/min [2025-10-27T22:14:27.157160] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:27.178992] [DEBUG] [LOCAL ] RSKD: Loaded 33127 existing records from primary storage. [2025-10-27T22:14:27.179308] [INFO ] [MAIN ] RSKD: Loaded 33127 primary data records. [2025-10-27T22:14:27.296185] [DEBUG] [LOCAL ] RTO: Loaded 39710 existing records from primary storage. [2025-10-27T22:14:27.299878] [INFO ] [MAIN ] RTO: Loaded 39710 primary data records. [2025-10-27T22:14:27.520677] [DEBUG] [LOCAL ] RVLV: Loaded 47137 existing records from primary storage. [2025-10-27T22:14:27.568777] [INFO ] [MAIN ] RVLV: Loaded 47137 primary data records. [2025-10-27T22:14:28.194125] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:28.224005] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:28.269549] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:28.307360] [INFO ] [MAIN ] RTO: Generated 138 derivative records from 39710 primary records. [2025-10-27T22:14:28.308942] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-27T22:14:28.329024] [DEBUG] [LOCAL ] RTO: Derivative data saved (138 records). [2025-10-27T22:14:28.331992] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-27T22:14:28.336459] [INFO ] [MAIN ] Derivative Progress: 1447/1881 symbols completed. RTO took 1.2s. Estimated remaining: 2m 57s. Rate: 147.1 symbols/min [2025-10-27T22:14:28.337458] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:28.345140] [INFO ] [MAIN ] RSKD: Generated 138 derivative records from 33127 primary records. [2025-10-27T22:14:28.346444] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-27T22:14:28.359833] [INFO ] [MAIN ] RVLV: Generated 138 derivative records from 47137 primary records. [2025-10-27T22:14:28.359949] [DEBUG] [LOCAL ] RSKD: Derivative data saved (138 records). [2025-10-27T22:14:28.360001] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-27T22:14:28.360678] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-27T22:14:28.362993] [INFO ] [MAIN ] Derivative Progress: 1448/1881 symbols completed. RSKD took 1.3s. Estimated remaining: 2m 56s. Rate: 147.2 symbols/min [2025-10-27T22:14:28.370317] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:28.382696] [DEBUG] [LOCAL ] RVLV: Derivative data saved (138 records). [2025-10-27T22:14:28.382880] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-27T22:14:28.385832] [INFO ] [MAIN ] Derivative Progress: 1449/1881 symbols completed. RVLV took 1.2s. Estimated remaining: 2m 56s. Rate: 147.3 symbols/min [2025-10-27T22:14:28.386041] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:28.396893] [DEBUG] [LOCAL ] RVT: Loaded 25758 existing records from primary storage. [2025-10-27T22:14:28.397064] [INFO ] [MAIN ] RVT: Loaded 25758 primary data records. [2025-10-27T22:14:28.630483] [DEBUG] [LOCAL ] RY: Loaded 47292 existing records from primary storage. [2025-10-27T22:14:28.631293] [DEBUG] [LOCAL ] RYAM: Loaded 34795 existing records from primary storage. [2025-10-27T22:14:28.788458] [INFO ] [MAIN ] RY: Loaded 47292 primary data records. [2025-10-27T22:14:28.793881] [INFO ] [MAIN ] RYAM: Loaded 34795 primary data records. [2025-10-27T22:14:29.431117] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:29.494779] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:29.495119] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:29.536811] [INFO ] [MAIN ] RVT: Generated 138 derivative records from 25758 primary records. [2025-10-27T22:14:29.539136] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-27T22:14:29.559456] [DEBUG] [LOCAL ] RVT: Derivative data saved (138 records). [2025-10-27T22:14:29.559631] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-27T22:14:29.562020] [INFO ] [MAIN ] Derivative Progress: 1450/1881 symbols completed. RVT took 1.2s. Estimated remaining: 2m 56s. Rate: 147.1 symbols/min [2025-10-27T22:14:29.563603] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:29.595191] [INFO ] [MAIN ] RYAM: Generated 138 derivative records from 34795 primary records. [2025-10-27T22:14:29.597373] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-27T22:14:29.612358] [INFO ] [MAIN ] RY: Generated 138 derivative records from 47292 primary records. [2025-10-27T22:14:29.618184] [DEBUG] [LOCAL ] RYAM: Derivative data saved (138 records). [2025-10-27T22:14:29.618317] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-27T22:14:29.618902] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-27T22:14:29.621700] [INFO ] [MAIN ] Derivative Progress: 1451/1881 symbols completed. RYAM took 1.2s. Estimated remaining: 2m 55s. Rate: 147.2 symbols/min [2025-10-27T22:14:29.622100] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:29.622955] [DEBUG] [LOCAL ] RYI: Loaded 21465 existing records from primary storage. [2025-10-27T22:14:29.632630] [INFO ] [MAIN ] RYI: Loaded 21465 primary data records. [2025-10-27T22:14:29.635669] [DEBUG] [LOCAL ] RY: Derivative data saved (138 records). [2025-10-27T22:14:29.648726] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-27T22:14:29.651161] [INFO ] [MAIN ] Derivative Progress: 1452/1881 symbols completed. RY took 1.3s. Estimated remaining: 2m 55s. Rate: 147.3 symbols/min [2025-10-27T22:14:29.665341] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:29.688943] [DEBUG] [LOCAL ] RZB: Loaded 5780 existing records from primary storage. [2025-10-27T22:14:29.754488] [DEBUG] [LOCAL ] RZC: Loaded 6300 existing records from primary storage. [2025-10-27T22:14:29.740973] [INFO ] [MAIN ] RZB: Loaded 5780 primary data records. [2025-10-27T22:14:29.765494] [INFO ] [MAIN ] RZC: Loaded 6300 primary data records. [2025-10-27T22:14:30.704431] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:30.797627] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:30.838883] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:30.901702] [INFO ] [MAIN ] RYI: Generated 138 derivative records from 21465 primary records. [2025-10-27T22:14:30.907429] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-27T22:14:30.909524] [INFO ] [MAIN ] RZC: Generated 138 derivative records from 6300 primary records. [2025-10-27T22:14:30.912781] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-27T22:14:30.924986] [DEBUG] [LOCAL ] RYI: Derivative data saved (138 records). [2025-10-27T22:14:30.925794] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-27T22:14:30.931931] [INFO ] [MAIN ] Derivative Progress: 1453/1881 symbols completed. RYI took 1.4s. Estimated remaining: 2m 55s. Rate: 147.1 symbols/min [2025-10-27T22:14:30.945066] [DEBUG] [LOCAL ] RZC: Derivative data saved (138 records). [2025-10-27T22:14:30.945493] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-27T22:14:30.950335] [INFO ] [MAIN ] Derivative Progress: 1454/1881 symbols completed. RZC took 1.3s. Estimated remaining: 2m 54s. Rate: 147.2 symbols/min [2025-10-27T22:14:30.947784] [INFO ] [MAIN ] RZB: Generated 138 derivative records from 5780 primary records. [2025-10-27T22:14:30.950629] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-27T22:14:30.962613] [DEBUG] [LOCAL ] RZB: Derivative data saved (138 records). [2025-10-27T22:14:30.962702] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-27T22:14:30.965251] [INFO ] [MAIN ] Derivative Progress: 1455/1881 symbols completed. RZB took 1.3s. Estimated remaining: 2m 54s. Rate: 147.3 symbols/min [2025-10-27T22:14:30.965849] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:30.966320] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:30.965959] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:30.980538] [DEBUG] [LOCAL ] SABA: Loaded 9051 existing records from primary storage. [2025-10-27T22:14:30.980788] [INFO ] [MAIN ] SABA: Loaded 9051 primary data records. [2025-10-27T22:14:31.228444] [DEBUG] [LOCAL ] SA: Loaded 44537 existing records from primary storage. [2025-10-27T22:14:31.336749] [INFO ] [MAIN ] SA: Loaded 44537 primary data records. [2025-10-27T22:14:31.363794] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-27T22:14:31.384077] [INFO ] [MAIN ] S: Loaded 53536 primary data records. [2025-10-27T22:14:31.986301] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:32.032560] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:32.067044] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:32.087914] [INFO ] [MAIN ] SABA: Generated 138 derivative records from 9051 primary records. [2025-10-27T22:14:32.091088] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-27T22:14:32.108688] [DEBUG] [LOCAL ] SABA: Derivative data saved (138 records). [2025-10-27T22:14:32.109170] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-27T22:14:32.111741] [INFO ] [MAIN ] Derivative Progress: 1456/1881 symbols completed. SABA took 1.1s. Estimated remaining: 2m 53s. Rate: 147.1 symbols/min [2025-10-27T22:14:32.114025] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:32.145557] [INFO ] [MAIN ] SA: Generated 138 derivative records from 44537 primary records. [2025-10-27T22:14:32.145827] [INFO ] [MAIN ] S: Generated 138 derivative records from 53536 primary records. [2025-10-27T22:14:32.146049] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-27T22:14:32.146150] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-27T22:14:32.181688] [DEBUG] [LOCAL ] SA: Derivative data saved (138 records). [2025-10-27T22:14:32.183410] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-27T22:14:32.188782] [DEBUG] [LOCAL ] S: Derivative data saved (138 records). [2025-10-27T22:14:32.188903] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-27T22:14:32.187730] [INFO ] [MAIN ] Derivative Progress: 1457/1881 symbols completed. SA took 1.2s. Estimated remaining: 2m 53s. Rate: 147.2 symbols/min [2025-10-27T22:14:32.192936] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:32.193067] [INFO ] [MAIN ] Derivative Progress: 1458/1881 symbols completed. S took 1.2s. Estimated remaining: 2m 52s. Rate: 147.3 symbols/min [2025-10-27T22:14:32.193513] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:32.212469] [DEBUG] [LOCAL ] SAN: Loaded 52944 existing records from primary storage. [2025-10-27T22:14:32.212758] [INFO ] [MAIN ] SAN: Loaded 52944 primary data records. [2025-10-27T22:14:32.348015] [DEBUG] [LOCAL ] SAR: Loaded 16865 existing records from primary storage. [2025-10-27T22:14:32.416880] [INFO ] [MAIN ] SAR: Loaded 16865 primary data records. [2025-10-27T22:14:32.655910] [DEBUG] [LOCAL ] SAP: Loaded 49830 existing records from primary storage. [2025-10-27T22:14:32.662537] [INFO ] [MAIN ] SAP: Loaded 49830 primary data records. [2025-10-27T22:14:33.266737] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:33.311557] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:33.361297] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:33.397504] [INFO ] [MAIN ] SAN: Generated 138 derivative records from 52944 primary records. [2025-10-27T22:14:33.398774] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-27T22:14:33.419947] [DEBUG] [LOCAL ] SAN: Derivative data saved (138 records). [2025-10-27T22:14:33.420183] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-27T22:14:33.422966] [INFO ] [MAIN ] Derivative Progress: 1459/1881 symbols completed. SAN took 1.3s. Estimated remaining: 2m 52s. Rate: 147.1 symbols/min [2025-10-27T22:14:33.423700] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:33.432950] [INFO ] [MAIN ] SAR: Generated 138 derivative records from 16865 primary records. [2025-10-27T22:14:33.433312] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-27T22:14:33.451110] [DEBUG] [LOCAL ] SAR: Derivative data saved (138 records). [2025-10-27T22:14:33.451291] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-27T22:14:33.453892] [INFO ] [MAIN ] Derivative Progress: 1460/1881 symbols completed. SAR took 1.3s. Estimated remaining: 2m 52s. Rate: 147.2 symbols/min [2025-10-27T22:14:33.457379] [INFO ] [MAIN ] SAP: Generated 138 derivative records from 49830 primary records. [2025-10-27T22:14:33.454927] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:33.457587] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-27T22:14:33.474050] [DEBUG] [LOCAL ] SAP: Derivative data saved (138 records). [2025-10-27T22:14:33.474240] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-27T22:14:33.477414] [INFO ] [MAIN ] Derivative Progress: 1461/1881 symbols completed. SAP took 1.3s. Estimated remaining: 2m 51s. Rate: 147.3 symbols/min [2025-10-27T22:14:33.477708] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:33.498541] [DEBUG] [LOCAL ] SBI: Loaded 7458 existing records from primary storage. [2025-10-27T22:14:33.498695] [INFO ] [MAIN ] SBI: Loaded 7458 primary data records. [2025-10-27T22:14:33.654388] [DEBUG] [LOCAL ] SARO: Loaded 48144 existing records from primary storage. [2025-10-27T22:14:33.654694] [INFO ] [MAIN ] SARO: Loaded 48144 primary data records. [2025-10-27T22:14:33.666322] [DEBUG] [LOCAL ] SB: Loaded 32237 existing records from primary storage. [2025-10-27T22:14:33.689771] [INFO ] [MAIN ] SB: Loaded 32237 primary data records. [2025-10-27T22:14:34.502499] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:34.546581] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:34.563477] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:34.618445] [INFO ] [MAIN ] SBI: Generated 138 derivative records from 7458 primary records. [2025-10-27T22:14:34.619731] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-27T22:14:34.635638] [DEBUG] [LOCAL ] SBI: Derivative data saved (138 records). [2025-10-27T22:14:34.635963] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-27T22:14:34.638153] [INFO ] [MAIN ] Derivative Progress: 1462/1881 symbols completed. SBI took 1.2s. Estimated remaining: 2m 51s. Rate: 147.1 symbols/min [2025-10-27T22:14:34.639497] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:34.645127] [INFO ] [MAIN ] SB: Generated 138 derivative records from 32237 primary records. [2025-10-27T22:14:34.645309] [INFO ] [MAIN ] SARO: Generated 138 derivative records from 48144 primary records. [2025-10-27T22:14:34.645398] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-27T22:14:34.645491] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-27T22:14:34.666725] [DEBUG] [LOCAL ] SB: Derivative data saved (138 records). [2025-10-27T22:14:34.668222] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-27T22:14:34.671233] [INFO ] [MAIN ] Derivative Progress: 1463/1881 symbols completed. SB took 1.2s. Estimated remaining: 2m 50s. Rate: 147.2 symbols/min [2025-10-27T22:14:34.671800] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:34.677533] [DEBUG] [LOCAL ] SBR: Loaded 7713 existing records from primary storage. [2025-10-27T22:14:34.677329] [DEBUG] [LOCAL ] SARO: Derivative data saved (138 records). [2025-10-27T22:14:34.677668] [INFO ] [MAIN ] SBR: Loaded 7713 primary data records. [2025-10-27T22:14:34.677905] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-27T22:14:34.710557] [INFO ] [MAIN ] Derivative Progress: 1464/1881 symbols completed. SARO took 1.3s. Estimated remaining: 2m 50s. Rate: 147.3 symbols/min [2025-10-27T22:14:34.742739] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:35.020207] [DEBUG] [LOCAL ] SBS: Loaded 49193 existing records from primary storage. [2025-10-27T22:14:35.021257] [INFO ] [MAIN ] SBS: Loaded 49193 primary data records. [2025-10-27T22:14:35.072459] [DEBUG] [LOCAL ] SBSW: Loaded 53183 existing records from primary storage. [2025-10-27T22:14:35.091037] [INFO ] [MAIN ] SBSW: Loaded 53183 primary data records. [2025-10-27T22:14:35.269098] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:35.732047] [INFO ] [MAIN ] SBR: Generated 138 derivative records from 7713 primary records. [2025-10-27T22:14:35.732466] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-27T22:14:35.744862] [DEBUG] [LOCAL ] SBR: Derivative data saved (138 records). [2025-10-27T22:14:35.745025] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-27T22:14:35.747019] [INFO ] [MAIN ] Derivative Progress: 1465/1881 symbols completed. SBR took 1.1s. Estimated remaining: 2m 50s. Rate: 147.1 symbols/min [2025-10-27T22:14:35.747323] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:35.766011] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:35.796692] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:35.862736] [DEBUG] [LOCAL ] SCCO: Loaded 49479 existing records from primary storage. [2025-10-27T22:14:35.865109] [INFO ] [MAIN ] SCCO: Loaded 49479 primary data records. [2025-10-27T22:14:35.984238] [INFO ] [MAIN ] SBS: Generated 138 derivative records from 49193 primary records. [2025-10-27T22:14:35.989969] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-27T22:14:36.180319] [DEBUG] [LOCAL ] SBS: Derivative data saved (138 records). [2025-10-27T22:14:36.183336] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-27T22:14:36.186081] [INFO ] [MAIN ] Derivative Progress: 1466/1881 symbols completed. SBS took 1.5s. Estimated remaining: 2m 49s. Rate: 147.1 symbols/min [2025-10-27T22:14:36.186355] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:36.183230] [INFO ] [MAIN ] SBSW: Generated 138 derivative records from 53183 primary records. [2025-10-27T22:14:36.186950] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-27T22:14:36.201965] [DEBUG] [LOCAL ] SBSW: Derivative data saved (138 records). [2025-10-27T22:14:36.206176] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-27T22:14:36.208945] [INFO ] [MAIN ] Derivative Progress: 1467/1881 symbols completed. SBSW took 1.5s. Estimated remaining: 2m 49s. Rate: 147.2 symbols/min [2025-10-27T22:14:36.209329] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:36.217584] [DEBUG] [LOCAL ] SCD: Loaded 13576 existing records from primary storage. [2025-10-27T22:14:36.217790] [INFO ] [MAIN ] SCD: Loaded 13576 primary data records. [2025-10-27T22:14:36.334044] [DEBUG] [LOCAL ] SCM: Loaded 19935 existing records from primary storage. [2025-10-27T22:14:36.335468] [INFO ] [MAIN ] SCM: Loaded 19935 primary data records. [2025-10-27T22:14:36.529209] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:36.884758] [INFO ] [MAIN ] SCCO: Generated 138 derivative records from 49479 primary records. [2025-10-27T22:14:36.885211] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-27T22:14:36.900754] [DEBUG] [LOCAL ] SCCO: Derivative data saved (138 records). [2025-10-27T22:14:36.900869] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-27T22:14:36.915541] [INFO ] [MAIN ] Derivative Progress: 1468/1881 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 48s. Rate: 147.1 symbols/min [2025-10-27T22:14:36.915976] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:36.952110] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:36.988172] [INFO ] [MAIN ] SCD: Generated 138 derivative records from 13576 primary records. [2025-10-27T22:14:36.989581] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-27T22:14:37.008049] [DEBUG] [LOCAL ] SCD: Derivative data saved (138 records). [2025-10-27T22:14:37.008328] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-27T22:14:37.010371] [INFO ] [MAIN ] Derivative Progress: 1469/1881 symbols completed. SCD took 0.8s. Estimated remaining: 2m 48s. Rate: 147.2 symbols/min [2025-10-27T22:14:37.012923] [INFO ] [MAIN ] SCM: Generated 138 derivative records from 19935 primary records. [2025-10-27T22:14:37.013061] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-27T22:14:37.024729] [DEBUG] [LOCAL ] SCM: Derivative data saved (138 records). [2025-10-27T22:14:37.024789] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-27T22:14:37.027402] [INFO ] [MAIN ] Derivative Progress: 1470/1881 symbols completed. SCM took 0.8s. Estimated remaining: 2m 47s. Rate: 147.3 symbols/min [2025-10-27T22:14:37.027888] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:37.028010] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:37.027828] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:37.039907] [DEBUG] [LOCAL ] SDHC: Loaded 10241 existing records from primary storage. [2025-10-27T22:14:37.040022] [INFO ] [MAIN ] SDHC: Loaded 10241 primary data records. [2025-10-27T22:14:37.191969] [DEBUG] [LOCAL ] SD: Loaded 27795 existing records from primary storage. [2025-10-27T22:14:37.202452] [INFO ] [MAIN ] SD: Loaded 27795 primary data records. [2025-10-27T22:14:37.237284] [DEBUG] [LOCAL ] SCS: Loaded 43002 existing records from primary storage. [2025-10-27T22:14:37.270286] [INFO ] [MAIN ] SCS: Loaded 43002 primary data records. [2025-10-27T22:14:37.997549] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:38.034385] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:38.065797] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:38.104714] [INFO ] [MAIN ] SDHC: Generated 138 derivative records from 10241 primary records. [2025-10-27T22:14:38.107108] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-27T22:14:38.123893] [DEBUG] [LOCAL ] SDHC: Derivative data saved (138 records). [2025-10-27T22:14:38.124140] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-27T22:14:38.126242] [INFO ] [MAIN ] Derivative Progress: 1471/1881 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 47s. Rate: 147.1 symbols/min [2025-10-27T22:14:38.127501] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:38.141232] [INFO ] [MAIN ] SD: Generated 138 derivative records from 27795 primary records. [2025-10-27T22:14:38.141456] [INFO ] [MAIN ] SCS: Generated 138 derivative records from 43002 primary records. [2025-10-27T22:14:38.144331] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-27T22:14:38.145040] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-27T22:14:38.166997] [DEBUG] [LOCAL ] SD: Derivative data saved (138 records). [2025-10-27T22:14:38.172820] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-27T22:14:38.174320] [DEBUG] [LOCAL ] SCS: Derivative data saved (138 records). [2025-10-27T22:14:38.173874] [DEBUG] [LOCAL ] SDHY: Loaded 11160 existing records from primary storage. [2025-10-27T22:14:38.176578] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-27T22:14:38.176483] [INFO ] [MAIN ] Derivative Progress: 1472/1881 symbols completed. SD took 1.1s. Estimated remaining: 2m 47s. Rate: 147.2 symbols/min [2025-10-27T22:14:38.176714] [INFO ] [MAIN ] SDHY: Loaded 11160 primary data records. [2025-10-27T22:14:38.176976] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:38.179672] [INFO ] [MAIN ] Derivative Progress: 1473/1881 symbols completed. SCS took 1.2s. Estimated remaining: 2m 46s. Rate: 147.3 symbols/min [2025-10-27T22:14:38.179895] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:38.509756] [DEBUG] [LOCAL ] SDRL: Loaded 40933 existing records from primary storage. [2025-10-27T22:14:38.510047] [INFO ] [MAIN ] SDRL: Loaded 40933 primary data records. [2025-10-27T22:14:38.625126] [DEBUG] [LOCAL ] SE: Loaded 53300 existing records from primary storage. [2025-10-27T22:14:38.629120] [INFO ] [MAIN ] SE: Loaded 53300 primary data records. [2025-10-27T22:14:39.167541] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:39.210046] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:39.250561] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:39.264046] [INFO ] [MAIN ] SDHY: Generated 138 derivative records from 11160 primary records. [2025-10-27T22:14:39.265068] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-27T22:14:39.282751] [DEBUG] [LOCAL ] SDHY: Derivative data saved (138 records). [2025-10-27T22:14:39.283129] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-27T22:14:39.287345] [INFO ] [MAIN ] Derivative Progress: 1474/1881 symbols completed. SDHY took 1.2s. Estimated remaining: 2m 46s. Rate: 147.2 symbols/min [2025-10-27T22:14:39.289338] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:39.312621] [INFO ] [MAIN ] SDRL: Generated 138 derivative records from 40933 primary records. [2025-10-27T22:14:39.318244] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-27T22:14:39.318748] [DEBUG] [LOCAL ] SEG: Loaded 12236 existing records from primary storage. [2025-10-27T22:14:39.321855] [INFO ] [MAIN ] SEG: Loaded 12236 primary data records. [2025-10-27T22:14:39.388750] [DEBUG] [LOCAL ] SDRL: Derivative data saved (138 records). [2025-10-27T22:14:39.402548] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-27T22:14:39.442500] [INFO ] [MAIN ] Derivative Progress: 1475/1881 symbols completed. SDRL took 1.3s. Estimated remaining: 2m 45s. Rate: 147.2 symbols/min [2025-10-27T22:14:39.442688] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:39.440612] [INFO ] [MAIN ] SE: Generated 138 derivative records from 53300 primary records. [2025-10-27T22:14:39.449484] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-27T22:14:39.531900] [DEBUG] [LOCAL ] SE: Derivative data saved (138 records). [2025-10-27T22:14:39.532028] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-27T22:14:39.645170] [INFO ] [MAIN ] Derivative Progress: 1476/1881 symbols completed. SE took 1.5s. Estimated remaining: 2m 45s. Rate: 147.3 symbols/min [2025-10-27T22:14:39.646114] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:39.690306] [DEBUG] [LOCAL ] SEI: Loaded 50033 existing records from primary storage. [2025-10-27T22:14:39.690606] [INFO ] [MAIN ] SEI: Loaded 50033 primary data records. [2025-10-27T22:14:39.816101] [DEBUG] [LOCAL ] SEMR: Loaded 41931 existing records from primary storage. [2025-10-27T22:14:39.821299] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:39.841460] [INFO ] [MAIN ] SEMR: Loaded 41931 primary data records. [2025-10-27T22:14:40.344629] [INFO ] [MAIN ] SEG: Generated 138 derivative records from 12236 primary records. [2025-10-27T22:14:40.345092] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-27T22:14:40.357409] [DEBUG] [LOCAL ] SEG: Derivative data saved (138 records). [2025-10-27T22:14:40.357538] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-27T22:14:40.359820] [INFO ] [MAIN ] Derivative Progress: 1477/1881 symbols completed. SEG took 1.1s. Estimated remaining: 2m 45s. Rate: 147.2 symbols/min [2025-10-27T22:14:40.360138] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:40.378779] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:40.413262] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:40.472992] [DEBUG] [LOCAL ] SES: Loaded 51646 existing records from primary storage. [2025-10-27T22:14:40.475602] [INFO ] [MAIN ] SEI: Generated 138 derivative records from 50033 primary records. [2025-10-27T22:14:40.476160] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-27T22:14:40.477085] [INFO ] [MAIN ] SES: Loaded 51646 primary data records. [2025-10-27T22:14:40.566066] [DEBUG] [LOCAL ] SEI: Derivative data saved (138 records). [2025-10-27T22:14:40.566345] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-27T22:14:40.579854] [INFO ] [MAIN ] Derivative Progress: 1478/1881 symbols completed. SEI took 1.1s. Estimated remaining: 2m 44s. Rate: 147.2 symbols/min [2025-10-27T22:14:40.600372] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:40.678427] [DEBUG] [LOCAL ] SFB: Loaded 3585 existing records from primary storage. [2025-10-27T22:14:40.684913] [INFO ] [MAIN ] SEMR: Generated 138 derivative records from 41931 primary records. [2025-10-27T22:14:40.788150] [INFO ] [MAIN ] SFB: Loaded 3585 primary data records. [2025-10-27T22:14:40.788255] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-27T22:14:40.912518] [DEBUG] [LOCAL ] SEMR: Derivative data saved (138 records). [2025-10-27T22:14:40.923392] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-27T22:14:40.941248] [INFO ] [MAIN ] Derivative Progress: 1479/1881 symbols completed. SEMR took 1.3s. Estimated remaining: 2m 44s. Rate: 147.3 symbols/min [2025-10-27T22:14:40.971794] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:41.170839] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:41.228615] [DEBUG] [LOCAL ] SFL: Loaded 45033 existing records from primary storage. [2025-10-27T22:14:41.229223] [INFO ] [MAIN ] SFL: Loaded 45033 primary data records. [2025-10-27T22:14:41.313254] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:41.325095] [INFO ] [MAIN ] SES: Generated 138 derivative records from 51646 primary records. [2025-10-27T22:14:41.347634] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-27T22:14:41.414460] [DEBUG] [LOCAL ] SES: Derivative data saved (138 records). [2025-10-27T22:14:41.425729] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-27T22:14:41.449726] [INFO ] [MAIN ] Derivative Progress: 1480/1881 symbols completed. SES took 1.1s. Estimated remaining: 2m 43s. Rate: 147.2 symbols/min [2025-10-27T22:14:41.458517] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:41.596130] [INFO ] [MAIN ] SFB: Generated 138 derivative records from 3585 primary records. [2025-10-27T22:14:41.596803] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-27T22:14:41.609198] [DEBUG] [LOCAL ] SFB: Derivative data saved (138 records). [2025-10-27T22:14:41.609293] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-27T22:14:41.611521] [INFO ] [MAIN ] Derivative Progress: 1481/1881 symbols completed. SFB took 1.0s. Estimated remaining: 2m 43s. Rate: 147.3 symbols/min [2025-10-27T22:14:41.613061] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:41.644979] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:41.676111] [DEBUG] [LOCAL ] SG: Loaded 53500 existing records from primary storage. [2025-10-27T22:14:41.687566] [INFO ] [MAIN ] SG: Loaded 53500 primary data records. [2025-10-27T22:14:41.804173] [DEBUG] [LOCAL ] SGHC: Loaded 47273 existing records from primary storage. [2025-10-27T22:14:41.815796] [INFO ] [MAIN ] SGHC: Loaded 47273 primary data records. [2025-10-27T22:14:42.283760] [INFO ] [MAIN ] SFL: Generated 138 derivative records from 45033 primary records. [2025-10-27T22:14:42.296728] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-27T22:14:42.312738] [DEBUG] [LOCAL ] SFL: Derivative data saved (138 records). [2025-10-27T22:14:42.314078] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-27T22:14:42.316445] [INFO ] [MAIN ] Derivative Progress: 1482/1881 symbols completed. SFL took 1.3s. Estimated remaining: 2m 43s. Rate: 147.2 symbols/min [2025-10-27T22:14:42.317249] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:42.341819] [DEBUG] [LOCAL ] SGU: Loaded 6395 existing records from primary storage. [2025-10-27T22:14:42.342433] [INFO ] [MAIN ] SGU: Loaded 6395 primary data records. [2025-10-27T22:14:42.342256] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:42.559925] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:42.710952] [INFO ] [MAIN ] SG: Generated 138 derivative records from 53500 primary records. [2025-10-27T22:14:42.711356] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-27T22:14:42.727374] [DEBUG] [LOCAL ] SG: Derivative data saved (138 records). [2025-10-27T22:14:42.727537] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-27T22:14:42.731713] [INFO ] [MAIN ] Derivative Progress: 1483/1881 symbols completed. SG took 1.3s. Estimated remaining: 2m 42s. Rate: 147.2 symbols/min [2025-10-27T22:14:42.734119] [INFO ] [MAIN ] SGHC: Generated 138 derivative records from 47273 primary records. [2025-10-27T22:14:42.734203] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-27T22:14:42.756806] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:42.758466] [DEBUG] [LOCAL ] SGHC: Derivative data saved (138 records). [2025-10-27T22:14:42.768556] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-27T22:14:42.771441] [INFO ] [MAIN ] Derivative Progress: 1484/1881 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 42s. Rate: 147.3 symbols/min [2025-10-27T22:14:42.785955] [INFO ] [MAIN ] SGU: Generated 138 derivative records from 6395 primary records. [2025-10-27T22:14:42.786024] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-27T22:14:42.796769] [DEBUG] [LOCAL ] SGU: Derivative data saved (138 records). [2025-10-27T22:14:42.796831] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-27T22:14:42.798838] [INFO ] [MAIN ] Derivative Progress: 1485/1881 symbols completed. SGU took 0.5s. Estimated remaining: 2m 41s. Rate: 147.4 symbols/min [2025-10-27T22:14:42.799271] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:42.799217] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:42.799396] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:42.835500] [DEBUG] [LOCAL ] SHG: Loaded 26469 existing records from primary storage. [2025-10-27T22:14:42.836141] [DEBUG] [LOCAL ] SHCO: Loaded 24877 existing records from primary storage. [2025-10-27T22:14:42.836374] [INFO ] [MAIN ] SHCO: Loaded 24877 primary data records. [2025-10-27T22:14:42.836526] [INFO ] [MAIN ] SHG: Loaded 26469 primary data records. [2025-10-27T22:14:43.137670] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-27T22:14:43.304365] [INFO ] [MAIN ] SHEL: Loaded 53675 primary data records. [2025-10-27T22:14:43.810688] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:43.841862] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:43.889343] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:43.932610] [INFO ] [MAIN ] SHCO: Generated 138 derivative records from 24877 primary records. [2025-10-27T22:14:43.934088] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-27T22:14:43.947062] [INFO ] [MAIN ] SHG: Generated 138 derivative records from 26469 primary records. [2025-10-27T22:14:43.951597] [DEBUG] [LOCAL ] SHCO: Derivative data saved (138 records). [2025-10-27T22:14:43.951898] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-27T22:14:43.953952] [INFO ] [MAIN ] Derivative Progress: 1486/1881 symbols completed. SHCO took 1.2s. Estimated remaining: 2m 41s. Rate: 147.2 symbols/min [2025-10-27T22:14:43.954090] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:43.951743] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-27T22:14:43.968461] [DEBUG] [LOCAL ] SHOC: Loaded 2916 existing records from primary storage. [2025-10-27T22:14:43.971805] [INFO ] [MAIN ] SHOC: Loaded 2916 primary data records. [2025-10-27T22:14:43.974849] [DEBUG] [LOCAL ] SHG: Derivative data saved (138 records). [2025-10-27T22:14:43.986393] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-27T22:14:44.046115] [INFO ] [MAIN ] Derivative Progress: 1487/1881 symbols completed. SHG took 1.2s. Estimated remaining: 2m 40s. Rate: 147.3 symbols/min [2025-10-27T22:14:44.070803] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:44.111000] [INFO ] [MAIN ] SHEL: Generated 138 derivative records from 53675 primary records. [2025-10-27T22:14:44.123609] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-27T22:14:44.173281] [DEBUG] [LOCAL ] SHEL: Derivative data saved (138 records). [2025-10-27T22:14:44.173425] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-27T22:14:44.288715] [INFO ] [MAIN ] Derivative Progress: 1488/1881 symbols completed. SHEL took 1.5s. Estimated remaining: 2m 40s. Rate: 147.3 symbols/min [2025-10-27T22:14:44.289222] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:44.332393] [DEBUG] [LOCAL ] SII: Loaded 23928 existing records from primary storage. [2025-10-27T22:14:44.334133] [INFO ] [MAIN ] SII: Loaded 23928 primary data records. [2025-10-27T22:14:44.335179] [DEBUG] [LOCAL ] SID: Loaded 42838 existing records from primary storage. [2025-10-27T22:14:44.346276] [INFO ] [MAIN ] SID: Loaded 42838 primary data records. [2025-10-27T22:14:44.442884] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:44.960554] [INFO ] [MAIN ] SHOC: Generated 138 derivative records from 2916 primary records. [2025-10-27T22:14:44.960960] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-27T22:14:44.972187] [DEBUG] [LOCAL ] SHOC: Derivative data saved (138 records). [2025-10-27T22:14:44.972376] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-27T22:14:44.974852] [INFO ] [MAIN ] Derivative Progress: 1489/1881 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 40s. Rate: 147.3 symbols/min [2025-10-27T22:14:44.975238] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:44.993485] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:45.022302] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:45.060848] [DEBUG] [LOCAL ] SILA: Loaded 29508 existing records from primary storage. [2025-10-27T22:14:45.061909] [INFO ] [MAIN ] SILA: Loaded 29508 primary data records. [2025-10-27T22:14:45.436537] [INFO ] [MAIN ] SID: Generated 138 derivative records from 42838 primary records. [2025-10-27T22:14:45.439777] [INFO ] [MAIN ] SII: Generated 138 derivative records from 23928 primary records. [2025-10-27T22:14:45.440910] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-27T22:14:45.441190] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-27T22:14:45.462700] [DEBUG] [LOCAL ] SII: Derivative data saved (138 records). [2025-10-27T22:14:45.465391] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-27T22:14:45.467701] [INFO ] [MAIN ] Derivative Progress: 1490/1881 symbols completed. SII took 1.2s. Estimated remaining: 2m 39s. Rate: 147.2 symbols/min [2025-10-27T22:14:45.472556] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:45.472336] [DEBUG] [LOCAL ] SID: Derivative data saved (138 records). [2025-10-27T22:14:45.473246] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-27T22:14:45.476867] [INFO ] [MAIN ] Derivative Progress: 1491/1881 symbols completed. SID took 1.4s. Estimated remaining: 2m 39s. Rate: 147.3 symbols/min [2025-10-27T22:14:45.477267] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:45.504515] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:45.540531] [DEBUG] [LOCAL ] SJT: Loaded 22426 existing records from primary storage. [2025-10-27T22:14:45.551038] [INFO ] [MAIN ] SJT: Loaded 22426 primary data records. [2025-10-27T22:14:45.557049] [DEBUG] [LOCAL ] SITE: Loaded 35349 existing records from primary storage. [2025-10-27T22:14:45.572718] [INFO ] [MAIN ] SITE: Loaded 35349 primary data records. [2025-10-27T22:14:46.103305] [INFO ] [MAIN ] SILA: Generated 138 derivative records from 29508 primary records. [2025-10-27T22:14:46.147267] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-27T22:14:46.234593] [DEBUG] [LOCAL ] SILA: Derivative data saved (138 records). [2025-10-27T22:14:46.235893] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-27T22:14:46.238291] [INFO ] [MAIN ] Derivative Progress: 1492/1881 symbols completed. SILA took 1.3s. Estimated remaining: 2m 39s. Rate: 147.3 symbols/min [2025-10-27T22:14:46.239821] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:46.281402] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:46.319846] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:46.321861] [DEBUG] [LOCAL ] SKE: Loaded 37289 existing records from primary storage. [2025-10-27T22:14:46.334079] [INFO ] [MAIN ] SKE: Loaded 37289 primary data records. [2025-10-27T22:14:46.702962] [INFO ] [MAIN ] SJT: Generated 138 derivative records from 22426 primary records. [2025-10-27T22:14:46.705458] [INFO ] [MAIN ] SITE: Generated 138 derivative records from 35349 primary records. [2025-10-27T22:14:46.705281] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-27T22:14:46.706326] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-27T22:14:46.725918] [DEBUG] [LOCAL ] SJT: Derivative data saved (138 records). [2025-10-27T22:14:46.726413] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-27T22:14:46.730578] [DEBUG] [LOCAL ] SITE: Derivative data saved (138 records). [2025-10-27T22:14:46.732914] [INFO ] [MAIN ] Derivative Progress: 1493/1881 symbols completed. SJT took 1.3s. Estimated remaining: 2m 38s. Rate: 147.2 symbols/min [2025-10-27T22:14:46.733030] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-27T22:14:46.735450] [INFO ] [MAIN ] Derivative Progress: 1494/1881 symbols completed. SITE took 1.3s. Estimated remaining: 2m 38s. Rate: 147.3 symbols/min [2025-10-27T22:14:46.733157] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:46.735566] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:46.762231] [DEBUG] [LOCAL ] SKIL: Loaded 7006 existing records from primary storage. [2025-10-27T22:14:46.766698] [INFO ] [MAIN ] SKIL: Loaded 7006 primary data records. [2025-10-27T22:14:46.766609] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:46.787374] [DEBUG] [LOCAL ] SKLZ: Loaded 11398 existing records from primary storage. [2025-10-27T22:14:46.832383] [INFO ] [MAIN ] SKLZ: Loaded 11398 primary data records. [2025-10-27T22:14:47.498848] [INFO ] [MAIN ] SKE: Generated 138 derivative records from 37289 primary records. [2025-10-27T22:14:47.499175] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-27T22:14:47.517757] [DEBUG] [LOCAL ] SKE: Derivative data saved (138 records). [2025-10-27T22:14:47.518201] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-27T22:14:47.529634] [INFO ] [MAIN ] Derivative Progress: 1495/1881 symbols completed. SKE took 1.3s. Estimated remaining: 2m 37s. Rate: 147.2 symbols/min [2025-10-27T22:14:47.536090] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:47.535773] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:47.572056] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:47.657969] [INFO ] [MAIN ] SKIL: Generated 138 derivative records from 7006 primary records. [2025-10-27T22:14:47.658480] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-27T22:14:47.659756] [DEBUG] [LOCAL ] SKM: Loaded 35082 existing records from primary storage. [2025-10-27T22:14:47.660776] [INFO ] [MAIN ] SKM: Loaded 35082 primary data records. [2025-10-27T22:14:47.719916] [DEBUG] [LOCAL ] SKIL: Derivative data saved (138 records). [2025-10-27T22:14:47.743243] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-27T22:14:47.767059] [INFO ] [MAIN ] Derivative Progress: 1496/1881 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 37s. Rate: 147.3 symbols/min [2025-10-27T22:14:47.767474] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:47.816085] [INFO ] [MAIN ] SKLZ: Generated 138 derivative records from 11398 primary records. [2025-10-27T22:14:47.827507] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-27T22:14:47.896575] [DEBUG] [LOCAL ] SKYH: Loaded 15393 existing records from primary storage. [2025-10-27T22:14:47.899636] [INFO ] [MAIN ] SKYH: Loaded 15393 primary data records. [2025-10-27T22:14:47.899377] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (138 records). [2025-10-27T22:14:47.965900] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-27T22:14:48.091898] [INFO ] [MAIN ] Derivative Progress: 1497/1881 symbols completed. SKLZ took 1.4s. Estimated remaining: 2m 36s. Rate: 147.3 symbols/min [2025-10-27T22:14:48.114735] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:48.393988] [DEBUG] [LOCAL ] SLF: Loaded 37845 existing records from primary storage. [2025-10-27T22:14:48.394332] [INFO ] [MAIN ] SLF: Loaded 37845 primary data records. [2025-10-27T22:14:48.523576] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:48.758760] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:48.795741] [INFO ] [MAIN ] SKM: Generated 138 derivative records from 35082 primary records. [2025-10-27T22:14:48.798868] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-27T22:14:48.813599] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:48.841397] [DEBUG] [LOCAL ] SKM: Derivative data saved (138 records). [2025-10-27T22:14:48.843762] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-27T22:14:48.847392] [INFO ] [MAIN ] Derivative Progress: 1498/1881 symbols completed. SKM took 1.3s. Estimated remaining: 2m 36s. Rate: 147.2 symbols/min [2025-10-27T22:14:48.853566] [INFO ] [MAIN ] SKYH: Generated 138 derivative records from 15393 primary records. [2025-10-27T22:14:48.854737] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-27T22:14:48.872738] [DEBUG] [LOCAL ] SKYH: Derivative data saved (138 records). [2025-10-27T22:14:48.873932] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-27T22:14:48.876245] [INFO ] [MAIN ] Derivative Progress: 1499/1881 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 36s. Rate: 147.3 symbols/min [2025-10-27T22:14:48.880690] [INFO ] [MAIN ] SLF: Generated 138 derivative records from 37845 primary records. [2025-10-27T22:14:48.880760] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-27T22:14:48.894667] [DEBUG] [LOCAL ] SLF: Derivative data saved (138 records). [2025-10-27T22:14:48.894862] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-27T22:14:48.898412] [INFO ] [MAIN ] Derivative Progress: 1500/1881 symbols completed. SLF took 0.8s. Estimated remaining: 2m 35s. Rate: 147.4 symbols/min [2025-10-27T22:14:48.899088] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:48.899205] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:48.899411] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:48.913133] [DEBUG] [LOCAL ] SMBK: Loaded 8191 existing records from primary storage. [2025-10-27T22:14:48.913425] [INFO ] [MAIN ] SMBK: Loaded 8191 primary data records. [2025-10-27T22:14:48.976460] [DEBUG] [LOCAL ] SMC: Loaded 10460 existing records from primary storage. [2025-10-27T22:14:49.020728] [INFO ] [MAIN ] SMC: Loaded 10460 primary data records. [2025-10-27T22:14:49.376088] [DEBUG] [LOCAL ] SLQT: Loaded 43116 existing records from primary storage. [2025-10-27T22:14:49.376486] [INFO ] [MAIN ] SLQT: Loaded 43116 primary data records. [2025-10-27T22:14:50.001452] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:50.058902] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:50.091535] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:50.127696] [INFO ] [MAIN ] SMBK: Generated 138 derivative records from 8191 primary records. [2025-10-27T22:14:50.135613] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-27T22:14:50.158453] [DEBUG] [LOCAL ] SMBK: Derivative data saved (138 records). [2025-10-27T22:14:50.158976] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-27T22:14:50.161731] [INFO ] [MAIN ] Derivative Progress: 1501/1881 symbols completed. SMBK took 1.3s. Estimated remaining: 2m 35s. Rate: 147.2 symbols/min [2025-10-27T22:14:50.162836] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:50.179971] [INFO ] [MAIN ] SMC: Generated 138 derivative records from 10460 primary records. [2025-10-27T22:14:50.180364] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-27T22:14:50.182287] [INFO ] [MAIN ] SLQT: Generated 138 derivative records from 43116 primary records. [2025-10-27T22:14:50.182631] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-27T22:14:50.202464] [DEBUG] [LOCAL ] SMC: Derivative data saved (138 records). [2025-10-27T22:14:50.202668] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-27T22:14:50.217777] [INFO ] [MAIN ] Derivative Progress: 1502/1881 symbols completed. SMC took 1.3s. Estimated remaining: 2m 34s. Rate: 147.3 symbols/min [2025-10-27T22:14:50.221369] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:50.221223] [DEBUG] [LOCAL ] SLQT: Derivative data saved (138 records). [2025-10-27T22:14:50.221697] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-27T22:14:50.225832] [INFO ] [MAIN ] Derivative Progress: 1503/1881 symbols completed. SLQT took 1.3s. Estimated remaining: 2m 34s. Rate: 147.4 symbols/min [2025-10-27T22:14:50.226220] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:50.246903] [DEBUG] [LOCAL ] SMFG: Loaded 48106 existing records from primary storage. [2025-10-27T22:14:50.247109] [INFO ] [MAIN ] SMFG: Loaded 48106 primary data records. [2025-10-27T22:14:50.306303] [DEBUG] [LOCAL ] SMHI: Loaded 12130 existing records from primary storage. [2025-10-27T22:14:50.315252] [INFO ] [MAIN ] SMHI: Loaded 12130 primary data records. [2025-10-27T22:14:50.874949] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-27T22:14:50.883616] [INFO ] [MAIN ] SMR: Loaded 53799 primary data records. [2025-10-27T22:14:51.220624] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:51.253715] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:51.323639] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:51.348159] [INFO ] [MAIN ] SMFG: Generated 138 derivative records from 48106 primary records. [2025-10-27T22:14:51.348784] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-27T22:14:51.370394] [DEBUG] [LOCAL ] SMFG: Derivative data saved (138 records). [2025-10-27T22:14:51.372063] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-27T22:14:51.374671] [INFO ] [MAIN ] Derivative Progress: 1504/1881 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 34s. Rate: 147.2 symbols/min [2025-10-27T22:14:51.375202] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:51.384090] [INFO ] [MAIN ] SMHI: Generated 138 derivative records from 12130 primary records. [2025-10-27T22:14:51.386050] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-27T22:14:51.403945] [DEBUG] [LOCAL ] SMHI: Derivative data saved (138 records). [2025-10-27T22:14:51.404769] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-27T22:14:51.408388] [INFO ] [MAIN ] Derivative Progress: 1505/1881 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 33s. Rate: 147.3 symbols/min [2025-10-27T22:14:51.412083] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:51.416174] [INFO ] [MAIN ] SMR: Generated 138 derivative records from 53799 primary records. [2025-10-27T22:14:51.416561] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-27T22:14:51.439605] [DEBUG] [LOCAL ] SMR: Derivative data saved (138 records). [2025-10-27T22:14:51.439917] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-27T22:14:51.443048] [INFO ] [MAIN ] Derivative Progress: 1506/1881 symbols completed. SMR took 1.2s. Estimated remaining: 2m 33s. Rate: 147.4 symbols/min [2025-10-27T22:14:51.443307] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:51.459095] [DEBUG] [LOCAL ] SMRT: Loaded 43592 existing records from primary storage. [2025-10-27T22:14:51.470367] [INFO ] [MAIN ] SMRT: Loaded 43592 primary data records. [2025-10-27T22:14:51.587892] [DEBUG] [LOCAL ] SMWB: Loaded 31282 existing records from primary storage. [2025-10-27T22:14:51.609406] [INFO ] [MAIN ] SMWB: Loaded 31282 primary data records. [2025-10-27T22:14:51.944136] [DEBUG] [LOCAL ] SN: Loaded 49918 existing records from primary storage. [2025-10-27T22:14:51.955268] [INFO ] [MAIN ] SN: Loaded 49918 primary data records. [2025-10-27T22:14:52.456557] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:52.497771] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:52.540758] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:52.563318] [INFO ] [MAIN ] SMRT: Generated 138 derivative records from 43592 primary records. [2025-10-27T22:14:52.563539] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-27T22:14:52.579990] [DEBUG] [LOCAL ] SMRT: Derivative data saved (138 records). [2025-10-27T22:14:52.580094] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-27T22:14:52.582210] [INFO ] [MAIN ] Derivative Progress: 1507/1881 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 32s. Rate: 147.2 symbols/min [2025-10-27T22:14:52.582356] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:52.613553] [INFO ] [MAIN ] SMWB: Generated 138 derivative records from 31282 primary records. [2025-10-27T22:14:52.628507] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-27T22:14:52.631395] [INFO ] [MAIN ] SN: Generated 138 derivative records from 49918 primary records. [2025-10-27T22:14:52.638683] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-27T22:14:52.643569] [DEBUG] [LOCAL ] SMWB: Derivative data saved (138 records). [2025-10-27T22:14:52.644674] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-27T22:14:52.657006] [INFO ] [MAIN ] Derivative Progress: 1508/1881 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 32s. Rate: 147.3 symbols/min [2025-10-27T22:14:52.657211] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:52.659466] [DEBUG] [LOCAL ] SN: Derivative data saved (138 records). [2025-10-27T22:14:52.674775] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-27T22:14:52.677814] [INFO ] [MAIN ] Derivative Progress: 1509/1881 symbols completed. SN took 1.2s. Estimated remaining: 2m 31s. Rate: 147.4 symbols/min [2025-10-27T22:14:52.678161] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:52.679329] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-27T22:14:52.679422] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-27T22:14:52.760698] [DEBUG] [LOCAL ] SNDA: Loaded 4410 existing records from primary storage. [2025-10-27T22:14:52.776638] [INFO ] [MAIN ] SNDA: Loaded 4410 primary data records. [2025-10-27T22:14:53.307086] [DEBUG] [LOCAL ] SNN: Loaded 44156 existing records from primary storage. [2025-10-27T22:14:53.307524] [INFO ] [MAIN ] SNN: Loaded 44156 primary data records. [2025-10-27T22:14:53.699163] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:53.715063] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:53.815911] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:53.840434] [INFO ] [MAIN ] SNDA: Generated 138 derivative records from 4410 primary records. [2025-10-27T22:14:53.843921] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-27T22:14:53.844470] [INFO ] [MAIN ] SNAP: Generated 138 derivative records from 53796 primary records. [2025-10-27T22:14:53.857214] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-27T22:14:53.859680] [DEBUG] [LOCAL ] SNDA: Derivative data saved (138 records). [2025-10-27T22:14:53.863919] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-27T22:14:53.868252] [INFO ] [MAIN ] Derivative Progress: 1510/1881 symbols completed. SNDA took 1.2s. Estimated remaining: 2m 31s. Rate: 147.2 symbols/min [2025-10-27T22:14:53.881366] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:53.890963] [DEBUG] [LOCAL ] SNAP: Derivative data saved (138 records). [2025-10-27T22:14:53.891582] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-27T22:14:53.894261] [INFO ] [MAIN ] Derivative Progress: 1511/1881 symbols completed. SNAP took 1.3s. Estimated remaining: 2m 31s. Rate: 147.3 symbols/min [2025-10-27T22:14:53.895722] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:53.905517] [INFO ] [MAIN ] SNN: Generated 138 derivative records from 44156 primary records. [2025-10-27T22:14:53.905780] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-27T22:14:53.918583] [DEBUG] [LOCAL ] SNN: Derivative data saved (138 records). [2025-10-27T22:14:53.918861] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-27T22:14:53.921370] [INFO ] [MAIN ] Derivative Progress: 1512/1881 symbols completed. SNN took 1.2s. Estimated remaining: 2m 30s. Rate: 147.4 symbols/min [2025-10-27T22:14:53.921716] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:53.963930] [DEBUG] [LOCAL ] SOBO: Loaded 39066 existing records from primary storage. [2025-10-27T22:14:53.964263] [INFO ] [MAIN ] SOBO: Loaded 39066 primary data records. [2025-10-27T22:14:54.110395] [DEBUG] [LOCAL ] SNOW: Loaded 53575 existing records from primary storage. [2025-10-27T22:14:54.115004] [INFO ] [MAIN ] SNOW: Loaded 53575 primary data records. [2025-10-27T22:14:54.468858] [DEBUG] [LOCAL ] SOC: Loaded 51235 existing records from primary storage. [2025-10-27T22:14:54.485485] [INFO ] [MAIN ] SOC: Loaded 51235 primary data records. [2025-10-27T22:14:55.005792] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:55.006629] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:55.061932] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:55.120971] [INFO ] [MAIN ] SNOW: Generated 138 derivative records from 53575 primary records. [2025-10-27T22:14:55.122966] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-27T22:14:55.124842] [INFO ] [MAIN ] SOBO: Generated 138 derivative records from 39066 primary records. [2025-10-27T22:14:55.126122] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-27T22:14:55.150756] [DEBUG] [LOCAL ] SNOW: Derivative data saved (138 records). [2025-10-27T22:14:55.153887] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-27T22:14:55.153539] [DEBUG] [LOCAL ] SOBO: Derivative data saved (138 records). [2025-10-27T22:14:55.158112] [INFO ] [MAIN ] Derivative Progress: 1513/1881 symbols completed. SNOW took 1.3s. Estimated remaining: 2m 30s. Rate: 147.2 symbols/min [2025-10-27T22:14:55.158865] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-27T22:14:55.163398] [INFO ] [MAIN ] SOC: Generated 138 derivative records from 51235 primary records. [2025-10-27T22:14:55.161082] [INFO ] [MAIN ] Derivative Progress: 1514/1881 symbols completed. SOBO took 1.3s. Estimated remaining: 2m 30s. Rate: 147.3 symbols/min [2025-10-27T22:14:55.163623] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-27T22:14:55.175680] [DEBUG] [LOCAL ] SOC: Derivative data saved (138 records). [2025-10-27T22:14:55.175744] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-27T22:14:55.178806] [INFO ] [MAIN ] Derivative Progress: 1515/1881 symbols completed. SOC took 1.3s. Estimated remaining: 2m 29s. Rate: 147.4 symbols/min [2025-10-27T22:14:55.179355] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:55.179491] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:55.179282] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:55.197247] [DEBUG] [LOCAL ] SOJC: Loaded 4435 existing records from primary storage. [2025-10-27T22:14:55.197498] [INFO ] [MAIN ] SOJC: Loaded 4435 primary data records. [2025-10-27T22:14:55.236757] [DEBUG] [LOCAL ] SOJE: Loaded 8594 existing records from primary storage. [2025-10-27T22:14:55.295316] [DEBUG] [LOCAL ] SOJD: Loaded 12400 existing records from primary storage. [2025-10-27T22:14:55.295487] [INFO ] [MAIN ] SOJD: Loaded 12400 primary data records. [2025-10-27T22:14:55.289437] [INFO ] [MAIN ] SOJE: Loaded 8594 primary data records. [2025-10-27T22:14:56.232187] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:56.258843] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:56.296677] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:56.366801] [INFO ] [MAIN ] SOJC: Generated 138 derivative records from 4435 primary records. [2025-10-27T22:14:56.368427] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-27T22:14:56.382074] [DEBUG] [LOCAL ] SOJC: Derivative data saved (138 records). [2025-10-27T22:14:56.386491] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-27T22:14:56.388752] [INFO ] [MAIN ] Derivative Progress: 1516/1881 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 29s. Rate: 147.2 symbols/min [2025-10-27T22:14:56.389184] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:56.392049] [INFO ] [MAIN ] SOJE: Generated 138 derivative records from 8594 primary records. [2025-10-27T22:14:56.392246] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-27T22:14:56.412207] [DEBUG] [LOCAL ] SOJE: Derivative data saved (138 records). [2025-10-27T22:14:56.412701] [INFO ] [MAIN ] SOJD: Generated 138 derivative records from 12400 primary records. [2025-10-27T22:14:56.413119] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-27T22:14:56.413009] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-27T22:14:56.416286] [INFO ] [MAIN ] Derivative Progress: 1517/1881 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 28s. Rate: 147.3 symbols/min [2025-10-27T22:14:56.421146] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:56.434523] [DEBUG] [LOCAL ] SOJD: Derivative data saved (138 records). [2025-10-27T22:14:56.434893] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-27T22:14:56.438965] [INFO ] [MAIN ] Derivative Progress: 1518/1881 symbols completed. SOJD took 1.3s. Estimated remaining: 2m 28s. Rate: 147.3 symbols/min [2025-10-27T22:14:56.445146] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:56.444978] [DEBUG] [LOCAL ] SOL: Loaded 13500 existing records from primary storage. [2025-10-27T22:14:56.445425] [INFO ] [MAIN ] SOL: Loaded 13500 primary data records. [2025-10-27T22:14:56.530825] [DEBUG] [LOCAL ] SOR: Loaded 2796 existing records from primary storage. [2025-10-27T22:14:56.552132] [INFO ] [MAIN ] SOR: Loaded 2796 primary data records. [2025-10-27T22:14:56.907816] [DEBUG] [LOCAL ] SONY: Loaded 53367 existing records from primary storage. [2025-10-27T22:14:56.939515] [INFO ] [MAIN ] SONY: Loaded 53367 primary data records. [2025-10-27T22:14:57.442394] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:57.478068] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:57.529894] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:57.547512] [INFO ] [MAIN ] SOL: Generated 138 derivative records from 13500 primary records. [2025-10-27T22:14:57.548115] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-27T22:14:57.567442] [DEBUG] [LOCAL ] SOL: Derivative data saved (138 records). [2025-10-27T22:14:57.568928] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-27T22:14:57.571286] [INFO ] [MAIN ] Derivative Progress: 1519/1881 symbols completed. SOL took 1.2s. Estimated remaining: 2m 28s. Rate: 147.2 symbols/min [2025-10-27T22:14:57.571704] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:57.590802] [INFO ] [MAIN ] SOR: Generated 138 derivative records from 2796 primary records. [2025-10-27T22:14:57.591014] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-27T22:14:57.595054] [DEBUG] [LOCAL ] SOS: Loaded 9774 existing records from primary storage. [2025-10-27T22:14:57.595684] [INFO ] [MAIN ] SOS: Loaded 9774 primary data records. [2025-10-27T22:14:57.689455] [DEBUG] [LOCAL ] SOR: Derivative data saved (138 records). [2025-10-27T22:14:57.711244] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-27T22:14:57.714165] [INFO ] [MAIN ] Derivative Progress: 1520/1881 symbols completed. SOR took 1.3s. Estimated remaining: 2m 27s. Rate: 147.2 symbols/min [2025-10-27T22:14:57.722035] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:57.722203] [INFO ] [MAIN ] SONY: Generated 138 derivative records from 53367 primary records. [2025-10-27T22:14:57.743195] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-27T22:14:57.807134] [DEBUG] [LOCAL ] SONY: Derivative data saved (138 records). [2025-10-27T22:14:57.919274] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-27T22:14:57.922308] [INFO ] [MAIN ] Derivative Progress: 1521/1881 symbols completed. SONY took 1.5s. Estimated remaining: 2m 27s. Rate: 147.3 symbols/min [2025-10-27T22:14:57.922875] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:57.948917] [DEBUG] [LOCAL ] SPB: Loaded 33564 existing records from primary storage. [2025-10-27T22:14:57.949067] [INFO ] [MAIN ] SPB: Loaded 33564 primary data records. [2025-10-27T22:14:58.139858] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:14:58.340473] [DEBUG] [LOCAL ] SPCE: Loaded 50083 existing records from primary storage. [2025-10-27T22:14:58.343351] [INFO ] [MAIN ] SPCE: Loaded 50083 primary data records. [2025-10-27T22:14:58.690460] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:58.703213] [INFO ] [MAIN ] SOS: Generated 138 derivative records from 9774 primary records. [2025-10-27T22:14:58.706326] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-27T22:14:58.722130] [DEBUG] [LOCAL ] SOS: Derivative data saved (138 records). [2025-10-27T22:14:58.723683] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-27T22:14:58.726136] [INFO ] [MAIN ] Derivative Progress: 1522/1881 symbols completed. SOS took 1.2s. Estimated remaining: 2m 26s. Rate: 147.2 symbols/min [2025-10-27T22:14:58.726304] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:58.743680] [DEBUG] [LOCAL ] SPE: Loaded 6006 existing records from primary storage. [2025-10-27T22:14:58.760878] [INFO ] [MAIN ] SPE: Loaded 6006 primary data records. [2025-10-27T22:14:58.761481] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:58.861815] [INFO ] [MAIN ] SPB: Generated 138 derivative records from 33564 primary records. [2025-10-27T22:14:58.881664] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-27T22:14:58.931245] [DEBUG] [LOCAL ] SPB: Derivative data saved (138 records). [2025-10-27T22:14:58.937009] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-27T22:14:58.990091] [INFO ] [MAIN ] Derivative Progress: 1523/1881 symbols completed. SPB took 1.3s. Estimated remaining: 2m 26s. Rate: 147.2 symbols/min [2025-10-27T22:14:59.125625] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:59.142706] [INFO ] [MAIN ] SPCE: Generated 138 derivative records from 50083 primary records. [2025-10-27T22:14:59.143045] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-27T22:14:59.165343] [DEBUG] [LOCAL ] SPCE: Derivative data saved (138 records). [2025-10-27T22:14:59.165736] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-27T22:14:59.169279] [INFO ] [MAIN ] Derivative Progress: 1524/1881 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 25s. Rate: 147.3 symbols/min [2025-10-27T22:14:59.175285] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:14:59.177244] [DEBUG] [LOCAL ] SPH: Loaded 16274 existing records from primary storage. [2025-10-27T22:14:59.177615] [INFO ] [MAIN ] SPH: Loaded 16274 primary data records. [2025-10-27T22:14:59.562290] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:59.574528] [DEBUG] [LOCAL ] SPHR: Loaded 40518 existing records from primary storage. [2025-10-27T22:14:59.587791] [INFO ] [MAIN ] SPHR: Loaded 40518 primary data records. [2025-10-27T22:14:59.949564] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:14:59.963430] [INFO ] [MAIN ] SPE: Generated 138 derivative records from 6006 primary records. [2025-10-27T22:14:59.967862] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-27T22:14:59.986389] [DEBUG] [LOCAL ] SPE: Derivative data saved (138 records). [2025-10-27T22:14:59.986891] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-27T22:14:59.990409] [INFO ] [MAIN ] Derivative Progress: 1525/1881 symbols completed. SPE took 1.3s. Estimated remaining: 2m 25s. Rate: 147.2 symbols/min [2025-10-27T22:14:59.993545] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:00.033347] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:00.036498] [INFO ] [MAIN ] SPH: Generated 138 derivative records from 16274 primary records. [2025-10-27T22:15:00.049594] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-27T22:15:00.086897] [DEBUG] [LOCAL ] SPH: Derivative data saved (138 records). [2025-10-27T22:15:00.089510] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-27T22:15:00.103725] [INFO ] [MAIN ] Derivative Progress: 1526/1881 symbols completed. SPH took 1.0s. Estimated remaining: 2m 25s. Rate: 147.3 symbols/min [2025-10-27T22:15:00.104477] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:00.106209] [DEBUG] [LOCAL ] SPIR: Loaded 37107 existing records from primary storage. [2025-10-27T22:15:00.110331] [INFO ] [MAIN ] SPIR: Loaded 37107 primary data records. [2025-10-27T22:15:00.232298] [DEBUG] [LOCAL ] SPMC: Loaded 5211 existing records from primary storage. [2025-10-27T22:15:00.232952] [INFO ] [MAIN ] SPMC: Loaded 5211 primary data records. [2025-10-27T22:15:00.703621] [INFO ] [MAIN ] SPHR: Generated 138 derivative records from 40518 primary records. [2025-10-27T22:15:00.727985] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-27T22:15:00.875306] [DEBUG] [LOCAL ] SPHR: Derivative data saved (138 records). [2025-10-27T22:15:00.876692] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-27T22:15:00.882195] [INFO ] [MAIN ] Derivative Progress: 1527/1881 symbols completed. SPHR took 1.7s. Estimated remaining: 2m 24s. Rate: 147.2 symbols/min [2025-10-27T22:15:00.882610] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:00.910441] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:00.949984] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:01.012502] [DEBUG] [LOCAL ] SPOT: Loaded 50113 existing records from primary storage. [2025-10-27T22:15:01.013396] [INFO ] [MAIN ] SPOT: Loaded 50113 primary data records. [2025-10-27T22:15:01.247622] [INFO ] [MAIN ] SPIR: Generated 138 derivative records from 37107 primary records. [2025-10-27T22:15:01.256078] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-27T22:15:01.395443] [INFO ] [MAIN ] SPMC: Generated 138 derivative records from 5211 primary records. [2025-10-27T22:15:01.406334] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-27T22:15:01.414372] [DEBUG] [LOCAL ] SPIR: Derivative data saved (138 records). [2025-10-27T22:15:01.424242] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-27T22:15:01.430583] [DEBUG] [LOCAL ] SPMC: Derivative data saved (138 records). [2025-10-27T22:15:01.431152] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-27T22:15:01.428295] [INFO ] [MAIN ] Derivative Progress: 1528/1881 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 24s. Rate: 147.1 symbols/min [2025-10-27T22:15:01.434550] [INFO ] [MAIN ] Derivative Progress: 1529/1881 symbols completed. SPMC took 1.3s. Estimated remaining: 2m 23s. Rate: 147.2 symbols/min [2025-10-27T22:15:01.458366] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:01.499585] [INFO ] [MAIN ] SPOT: Generated 138 derivative records from 50113 primary records. [2025-10-27T22:15:01.499826] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-27T22:15:01.518221] [DEBUG] [LOCAL ] SPOT: Derivative data saved (138 records). [2025-10-27T22:15:01.518384] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-27T22:15:01.521345] [INFO ] [MAIN ] Derivative Progress: 1530/1881 symbols completed. SPOT took 0.6s. Estimated remaining: 2m 23s. Rate: 147.3 symbols/min [2025-10-27T22:15:01.521951] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:01.521891] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:01.522490] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:01.544747] [DEBUG] [LOCAL ] SPRU: Loaded 9926 existing records from primary storage. [2025-10-27T22:15:01.545389] [INFO ] [MAIN ] SPRU: Loaded 9926 primary data records. [2025-10-27T22:15:01.545201] [DEBUG] [LOCAL ] SPXX: Loaded 8945 existing records from primary storage. [2025-10-27T22:15:01.550920] [INFO ] [MAIN ] SPXX: Loaded 8945 primary data records. [2025-10-27T22:15:01.892284] [DEBUG] [LOCAL ] SPR: Loaded 40319 existing records from primary storage. [2025-10-27T22:15:02.038239] [INFO ] [MAIN ] SPR: Loaded 40319 primary data records. [2025-10-27T22:15:02.633045] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:02.669413] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:02.725114] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:02.752701] [INFO ] [MAIN ] SPRU: Generated 138 derivative records from 9926 primary records. [2025-10-27T22:15:02.756337] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-27T22:15:02.771732] [DEBUG] [LOCAL ] SPRU: Derivative data saved (138 records). [2025-10-27T22:15:02.773929] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-27T22:15:02.777669] [INFO ] [MAIN ] Derivative Progress: 1531/1881 symbols completed. SPRU took 1.3s. Estimated remaining: 2m 23s. Rate: 147.1 symbols/min [2025-10-27T22:15:02.777835] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:02.784832] [INFO ] [MAIN ] SPXX: Generated 138 derivative records from 8945 primary records. [2025-10-27T22:15:02.786085] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-27T22:15:02.802499] [DEBUG] [LOCAL ] SPXX: Derivative data saved (138 records). [2025-10-27T22:15:02.805115] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-27T22:15:02.805348] [INFO ] [MAIN ] SPR: Generated 138 derivative records from 40319 primary records. [2025-10-27T22:15:02.805636] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-27T22:15:02.808447] [INFO ] [MAIN ] Derivative Progress: 1532/1881 symbols completed. SPXX took 1.3s. Estimated remaining: 2m 22s. Rate: 147.2 symbols/min [2025-10-27T22:15:02.809042] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:02.831926] [DEBUG] [LOCAL ] SPR: Derivative data saved (138 records). [2025-10-27T22:15:02.832064] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-27T22:15:02.834727] [INFO ] [MAIN ] Derivative Progress: 1533/1881 symbols completed. SPR took 1.3s. Estimated remaining: 2m 22s. Rate: 147.3 symbols/min [2025-10-27T22:15:02.834985] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:02.861770] [DEBUG] [LOCAL ] SQM: Loaded 48867 existing records from primary storage. [2025-10-27T22:15:02.873758] [DEBUG] [LOCAL ] SREA: Loaded 9512 existing records from primary storage. [2025-10-27T22:15:02.873979] [INFO ] [MAIN ] SREA: Loaded 9512 primary data records. [2025-10-27T22:15:02.874099] [INFO ] [MAIN ] SQM: Loaded 48867 primary data records. [2025-10-27T22:15:02.905223] [DEBUG] [LOCAL ] SQNS: Loaded 28649 existing records from primary storage. [2025-10-27T22:15:02.905331] [INFO ] [MAIN ] SQNS: Loaded 28649 primary data records. [2025-10-27T22:15:03.798412] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:03.831788] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:03.864761] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:03.924873] [INFO ] [MAIN ] SQNS: Generated 138 derivative records from 28649 primary records. [2025-10-27T22:15:03.926977] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-27T22:15:03.948497] [DEBUG] [LOCAL ] SQNS: Derivative data saved (138 records). [2025-10-27T22:15:03.948901] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-27T22:15:03.953092] [INFO ] [MAIN ] Derivative Progress: 1534/1881 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 22s. Rate: 147.1 symbols/min [2025-10-27T22:15:03.954973] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:03.955192] [INFO ] [MAIN ] SREA: Generated 138 derivative records from 9512 primary records. [2025-10-27T22:15:03.956198] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-27T22:15:03.958729] [INFO ] [MAIN ] SQM: Generated 138 derivative records from 48867 primary records. [2025-10-27T22:15:03.965981] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-27T22:15:03.971014] [DEBUG] [LOCAL ] SREA: Derivative data saved (138 records). [2025-10-27T22:15:03.971459] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-27T22:15:03.973951] [INFO ] [MAIN ] Derivative Progress: 1535/1881 symbols completed. SREA took 1.1s. Estimated remaining: 2m 21s. Rate: 147.2 symbols/min [2025-10-27T22:15:03.983171] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:03.986359] [DEBUG] [LOCAL ] SQM: Derivative data saved (138 records). [2025-10-27T22:15:03.986451] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-27T22:15:03.989030] [INFO ] [MAIN ] Derivative Progress: 1536/1881 symbols completed. SQM took 1.2s. Estimated remaining: 2m 21s. Rate: 147.3 symbols/min [2025-10-27T22:15:03.989201] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:04.002490] [DEBUG] [LOCAL ] SRG: Loaded 14441 existing records from primary storage. [2025-10-27T22:15:04.002799] [INFO ] [MAIN ] SRG: Loaded 14441 primary data records. [2025-10-27T22:15:04.147262] [DEBUG] [LOCAL ] SRI: Loaded 25815 existing records from primary storage. [2025-10-27T22:15:04.168099] [INFO ] [MAIN ] SRI: Loaded 25815 primary data records. [2025-10-27T22:15:04.168688] [DEBUG] [LOCAL ] SRFM: Loaded 40662 existing records from primary storage. [2025-10-27T22:15:04.195419] [INFO ] [MAIN ] SRFM: Loaded 40662 primary data records. [2025-10-27T22:15:05.061337] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:05.127881] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:05.127492] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:05.162966] [INFO ] [MAIN ] SRG: Generated 138 derivative records from 14441 primary records. [2025-10-27T22:15:05.165680] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-27T22:15:05.184162] [DEBUG] [LOCAL ] SRG: Derivative data saved (138 records). [2025-10-27T22:15:05.184491] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-27T22:15:05.186794] [INFO ] [MAIN ] Derivative Progress: 1537/1881 symbols completed. SRG took 1.2s. Estimated remaining: 2m 20s. Rate: 147.1 symbols/min [2025-10-27T22:15:05.188260] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:05.211351] [DEBUG] [LOCAL ] SRV: Loaded 7153 existing records from primary storage. [2025-10-27T22:15:05.213232] [INFO ] [MAIN ] SRV: Loaded 7153 primary data records. [2025-10-27T22:15:05.260902] [INFO ] [MAIN ] SRI: Generated 138 derivative records from 25815 primary records. [2025-10-27T22:15:05.316329] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-27T22:15:05.326992] [INFO ] [MAIN ] SRFM: Generated 138 derivative records from 40662 primary records. [2025-10-27T22:15:05.337803] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-27T22:15:05.537616] [DEBUG] [LOCAL ] SRI: Derivative data saved (138 records). [2025-10-27T22:15:05.538297] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-27T22:15:05.541074] [INFO ] [MAIN ] Derivative Progress: 1538/1881 symbols completed. SRI took 1.6s. Estimated remaining: 2m 20s. Rate: 147.1 symbols/min [2025-10-27T22:15:05.541356] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:05.545969] [DEBUG] [LOCAL ] SRFM: Derivative data saved (138 records). [2025-10-27T22:15:05.546730] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-27T22:15:05.551189] [INFO ] [MAIN ] Derivative Progress: 1539/1881 symbols completed. SRFM took 1.6s. Estimated remaining: 2m 19s. Rate: 147.2 symbols/min [2025-10-27T22:15:05.551385] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:05.568725] [DEBUG] [LOCAL ] SST: Loaded 11226 existing records from primary storage. [2025-10-27T22:15:05.569259] [INFO ] [MAIN ] SST: Loaded 11226 primary data records. [2025-10-27T22:15:05.702709] [DEBUG] [LOCAL ] SSL: Loaded 41245 existing records from primary storage. [2025-10-27T22:15:05.714125] [INFO ] [MAIN ] SSL: Loaded 41245 primary data records. [2025-10-27T22:15:05.803897] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:06.294913] [INFO ] [MAIN ] SRV: Generated 138 derivative records from 7153 primary records. [2025-10-27T22:15:06.295449] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-27T22:15:06.309984] [DEBUG] [LOCAL ] SRV: Derivative data saved (138 records). [2025-10-27T22:15:06.312672] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-27T22:15:06.315015] [INFO ] [MAIN ] Derivative Progress: 1540/1881 symbols completed. SRV took 1.1s. Estimated remaining: 2m 19s. Rate: 147.1 symbols/min [2025-10-27T22:15:06.315385] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:06.343955] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:06.343689] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:06.409432] [DEBUG] [LOCAL ] STEM: Loaded 38072 existing records from primary storage. [2025-10-27T22:15:06.409988] [INFO ] [MAIN ] STEM: Loaded 38072 primary data records. [2025-10-27T22:15:06.595501] [INFO ] [MAIN ] SSL: Generated 138 derivative records from 41245 primary records. [2025-10-27T22:15:06.614260] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-27T22:15:06.625744] [INFO ] [MAIN ] SST: Generated 138 derivative records from 11226 primary records. [2025-10-27T22:15:06.626356] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-27T22:15:06.746432] [DEBUG] [LOCAL ] SSL: Derivative data saved (138 records). [2025-10-27T22:15:06.761247] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-27T22:15:06.766339] [INFO ] [MAIN ] Derivative Progress: 1541/1881 symbols completed. SSL took 1.2s. Estimated remaining: 2m 19s. Rate: 147.1 symbols/min [2025-10-27T22:15:06.767947] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:06.769345] [DEBUG] [LOCAL ] SST: Derivative data saved (138 records). [2025-10-27T22:15:06.770011] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-27T22:15:06.772721] [INFO ] [MAIN ] Derivative Progress: 1542/1881 symbols completed. SST took 1.2s. Estimated remaining: 2m 18s. Rate: 147.2 symbols/min [2025-10-27T22:15:06.773138] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:06.790290] [DEBUG] [LOCAL ] STK: Loaded 9509 existing records from primary storage. [2025-10-27T22:15:06.790766] [INFO ] [MAIN ] STK: Loaded 9509 primary data records. [2025-10-27T22:15:06.851098] [DEBUG] [LOCAL ] STEW: Loaded 14632 existing records from primary storage. [2025-10-27T22:15:06.871717] [INFO ] [MAIN ] STEW: Loaded 14632 primary data records. [2025-10-27T22:15:07.280212] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:07.517178] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:07.532869] [INFO ] [MAIN ] STEM: Generated 138 derivative records from 38072 primary records. [2025-10-27T22:15:07.534798] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-27T22:15:07.554620] [DEBUG] [LOCAL ] STEM: Derivative data saved (138 records). [2025-10-27T22:15:07.555055] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-27T22:15:07.571481] [INFO ] [MAIN ] Derivative Progress: 1543/1881 symbols completed. STEM took 1.3s. Estimated remaining: 2m 18s. Rate: 147.1 symbols/min [2025-10-27T22:15:07.572421] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:07.615016] [INFO ] [MAIN ] STK: Generated 138 derivative records from 9509 primary records. [2025-10-27T22:15:07.615503] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-27T22:15:07.635574] [DEBUG] [LOCAL ] STK: Derivative data saved (138 records). [2025-10-27T22:15:07.635931] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-27T22:15:07.638557] [INFO ] [MAIN ] Derivative Progress: 1544/1881 symbols completed. STK took 0.9s. Estimated remaining: 2m 17s. Rate: 147.2 symbols/min [2025-10-27T22:15:07.644798] [INFO ] [MAIN ] STEW: Generated 138 derivative records from 14632 primary records. [2025-10-27T22:15:07.644912] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-27T22:15:07.659863] [DEBUG] [LOCAL ] STEW: Derivative data saved (138 records). [2025-10-27T22:15:07.659997] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-27T22:15:07.663544] [INFO ] [MAIN ] Derivative Progress: 1545/1881 symbols completed. STEW took 0.9s. Estimated remaining: 2m 17s. Rate: 147.3 symbols/min [2025-10-27T22:15:07.664069] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:07.664006] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:07.664210] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:07.710201] [DEBUG] [LOCAL ] STN: Loaded 22127 existing records from primary storage. [2025-10-27T22:15:07.710530] [INFO ] [MAIN ] STN: Loaded 22127 primary data records. [2025-10-27T22:15:07.870156] [DEBUG] [LOCAL ] STM: Loaded 53572 existing records from primary storage. [2025-10-27T22:15:07.893205] [DEBUG] [LOCAL ] STLA: Loaded 53547 existing records from primary storage. [2025-10-27T22:15:07.922027] [INFO ] [MAIN ] STLA: Loaded 53547 primary data records. [2025-10-27T22:15:07.898455] [INFO ] [MAIN ] STM: Loaded 53572 primary data records. [2025-10-27T22:15:08.718748] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:08.772714] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:08.788018] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:08.831756] [INFO ] [MAIN ] STN: Generated 138 derivative records from 22127 primary records. [2025-10-27T22:15:08.836789] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-27T22:15:08.863037] [DEBUG] [LOCAL ] STN: Derivative data saved (138 records). [2025-10-27T22:15:08.866126] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-27T22:15:08.868119] [INFO ] [MAIN ] Derivative Progress: 1546/1881 symbols completed. STN took 1.2s. Estimated remaining: 2m 17s. Rate: 147.1 symbols/min [2025-10-27T22:15:08.869928] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:08.882895] [INFO ] [MAIN ] STLA: Generated 138 derivative records from 53547 primary records. [2025-10-27T22:15:08.885510] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-27T22:15:08.906413] [INFO ] [MAIN ] STM: Generated 138 derivative records from 53572 primary records. [2025-10-27T22:15:08.904060] [DEBUG] [LOCAL ] STLA: Derivative data saved (138 records). [2025-10-27T22:15:08.906522] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-27T22:15:08.907126] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-27T22:15:08.911028] [INFO ] [MAIN ] Derivative Progress: 1547/1881 symbols completed. STLA took 1.2s. Estimated remaining: 2m 16s. Rate: 147.2 symbols/min [2025-10-27T22:15:08.911450] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:08.927215] [DEBUG] [LOCAL ] STM: Derivative data saved (138 records). [2025-10-27T22:15:08.938956] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-27T22:15:08.942681] [INFO ] [MAIN ] Derivative Progress: 1548/1881 symbols completed. STM took 1.3s. Estimated remaining: 2m 16s. Rate: 147.3 symbols/min [2025-10-27T22:15:08.942936] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:08.951372] [DEBUG] [LOCAL ] STRV: Loaded 10323 existing records from primary storage. [2025-10-27T22:15:08.951577] [INFO ] [MAIN ] STRV: Loaded 10323 primary data records. [2025-10-27T22:15:09.062120] [DEBUG] [LOCAL ] STNG: Loaded 42971 existing records from primary storage. [2025-10-27T22:15:09.062461] [INFO ] [MAIN ] STNG: Loaded 42971 primary data records. [2025-10-27T22:15:09.259537] [DEBUG] [LOCAL ] STVN: Loaded 26459 existing records from primary storage. [2025-10-27T22:15:09.303610] [INFO ] [MAIN ] STVN: Loaded 26459 primary data records. [2025-10-27T22:15:10.291231] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:10.320762] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:10.386907] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:10.412324] [INFO ] [MAIN ] STRV: Generated 138 derivative records from 10323 primary records. [2025-10-27T22:15:10.412500] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-27T22:15:10.415913] [INFO ] [MAIN ] STNG: Generated 138 derivative records from 42971 primary records. [2025-10-27T22:15:10.416021] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-27T22:15:10.434966] [DEBUG] [LOCAL ] STRV: Derivative data saved (138 records). [2025-10-27T22:15:10.435061] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-27T22:15:10.441020] [INFO ] [MAIN ] Derivative Progress: 1549/1881 symbols completed. STRV took 1.5s. Estimated remaining: 2m 15s. Rate: 147.0 symbols/min [2025-10-27T22:15:10.439172] [DEBUG] [LOCAL ] STNG: Derivative data saved (138 records). [2025-10-27T22:15:10.441229] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:10.444039] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-27T22:15:10.447424] [INFO ] [MAIN ] Derivative Progress: 1550/1881 symbols completed. STNG took 1.6s. Estimated remaining: 2m 15s. Rate: 147.1 symbols/min [2025-10-27T22:15:10.449055] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:10.454579] [DEBUG] [LOCAL ] STXD: Loaded 1302 existing records from primary storage. [2025-10-27T22:15:10.454841] [INFO ] [MAIN ] STXD: Loaded 1302 primary data records. [2025-10-27T22:15:10.549389] [DEBUG] [LOCAL ] STXE: Loaded 2018 existing records from primary storage. [2025-10-27T22:15:10.560496] [INFO ] [MAIN ] STXE: Loaded 2018 primary data records. [2025-10-27T22:15:10.928925] [INFO ] [MAIN ] STVN: Generated 138 derivative records from 26459 primary records. [2025-10-27T22:15:10.957691] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-27T22:15:11.055639] [DEBUG] [LOCAL ] STVN: Derivative data saved (138 records). [2025-10-27T22:15:11.056175] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-27T22:15:11.059494] [INFO ] [MAIN ] Derivative Progress: 1551/1881 symbols completed. STVN took 2.1s. Estimated remaining: 2m 15s. Rate: 147.1 symbols/min [2025-10-27T22:15:11.059983] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:11.066118] [DEBUG] [LOCAL ] STXG: Loaded 2194 existing records from primary storage. [2025-10-27T22:15:11.067329] [INFO ] [MAIN ] STXG: Loaded 2194 primary data records. [2025-10-27T22:15:11.429357] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:11.429995] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:11.519114] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:11.523227] [INFO ] [MAIN ] STXE: Generated 138 derivative records from 2018 primary records. [2025-10-27T22:15:11.523592] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-27T22:15:11.526200] [INFO ] [MAIN ] STXD: Generated 138 derivative records from 1302 primary records. [2025-10-27T22:15:11.538127] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-27T22:15:11.558230] [DEBUG] [LOCAL ] STXE: Derivative data saved (138 records). [2025-10-27T22:15:11.560276] [DEBUG] [LOCAL ] STXD: Derivative data saved (138 records). [2025-10-27T22:15:11.558366] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-27T22:15:11.564087] [INFO ] [MAIN ] Derivative Progress: 1552/1881 symbols completed. STXE took 1.1s. Estimated remaining: 2m 14s. Rate: 147.0 symbols/min [2025-10-27T22:15:11.561445] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-27T22:15:11.567108] [INFO ] [MAIN ] Derivative Progress: 1553/1881 symbols completed. STXD took 1.1s. Estimated remaining: 2m 14s. Rate: 147.1 symbols/min [2025-10-27T22:15:11.567258] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:11.566839] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:11.576265] [DEBUG] [LOCAL ] STXK: Loaded 1440 existing records from primary storage. [2025-10-27T22:15:11.576473] [INFO ] [MAIN ] STXK: Loaded 1440 primary data records. [2025-10-27T22:15:11.609762] [DEBUG] [LOCAL ] STXT: Loaded 2504 existing records from primary storage. [2025-10-27T22:15:11.637555] [INFO ] [MAIN ] STXT: Loaded 2504 primary data records. [2025-10-27T22:15:12.195115] [INFO ] [MAIN ] STXG: Generated 138 derivative records from 2194 primary records. [2025-10-27T22:15:12.196270] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-27T22:15:12.215571] [DEBUG] [LOCAL ] STXG: Derivative data saved (138 records). [2025-10-27T22:15:12.216184] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-27T22:15:12.219081] [INFO ] [MAIN ] Derivative Progress: 1554/1881 symbols completed. STXG took 1.2s. Estimated remaining: 2m 13s. Rate: 147.1 symbols/min [2025-10-27T22:15:12.219411] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:12.224909] [DEBUG] [LOCAL ] STXV: Loaded 1426 existing records from primary storage. [2025-10-27T22:15:12.225574] [INFO ] [MAIN ] STXV: Loaded 1426 primary data records. [2025-10-27T22:15:12.360011] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:12.563558] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:12.643282] [INFO ] [MAIN ] STXT: Generated 138 derivative records from 2504 primary records. [2025-10-27T22:15:12.645426] [INFO ] [MAIN ] STXK: Generated 138 derivative records from 1440 primary records. [2025-10-27T22:15:12.643133] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:12.645130] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-27T22:15:12.657080] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-27T22:15:12.679558] [DEBUG] [LOCAL ] STXK: Derivative data saved (138 records). [2025-10-27T22:15:12.682327] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-27T22:15:12.682198] [DEBUG] [LOCAL ] STXT: Derivative data saved (138 records). [2025-10-27T22:15:12.684689] [INFO ] [MAIN ] Derivative Progress: 1555/1881 symbols completed. STXK took 1.1s. Estimated remaining: 2m 13s. Rate: 147.1 symbols/min [2025-10-27T22:15:12.686162] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-27T22:15:12.689738] [INFO ] [MAIN ] Derivative Progress: 1556/1881 symbols completed. STXT took 1.1s. Estimated remaining: 2m 13s. Rate: 147.2 symbols/min [2025-10-27T22:15:12.686369] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:12.689992] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:12.711542] [INFO ] [MAIN ] STXV: Generated 138 derivative records from 1426 primary records. [2025-10-27T22:15:12.711920] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-27T22:15:12.722797] [DEBUG] [LOCAL ] STXV: Derivative data saved (138 records). [2025-10-27T22:15:12.722983] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-27T22:15:12.725987] [INFO ] [MAIN ] Derivative Progress: 1557/1881 symbols completed. STXV took 0.5s. Estimated remaining: 2m 12s. Rate: 147.3 symbols/min [2025-10-27T22:15:12.726389] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:12.777208] [DEBUG] [LOCAL ] STZ: Loaded 52389 existing records from primary storage. [2025-10-27T22:15:12.790488] [INFO ] [MAIN ] STZ: Loaded 52389 primary data records. [2025-10-27T22:15:12.828949] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-27T22:15:12.858028] [INFO ] [MAIN ] SU: Loaded 53426 primary data records. [2025-10-27T22:15:13.105896] [DEBUG] [LOCAL ] SUI: Loaded 41573 existing records from primary storage. [2025-10-27T22:15:13.227113] [INFO ] [MAIN ] SUI: Loaded 41573 primary data records. [2025-10-27T22:15:13.806532] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:13.847333] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:13.883453] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:13.907492] [INFO ] [MAIN ] STZ: Generated 138 derivative records from 52389 primary records. [2025-10-27T22:15:13.908697] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-27T22:15:13.931345] [DEBUG] [LOCAL ] STZ: Derivative data saved (138 records). [2025-10-27T22:15:13.933842] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-27T22:15:13.936691] [INFO ] [MAIN ] Derivative Progress: 1558/1881 symbols completed. STZ took 1.3s. Estimated remaining: 2m 12s. Rate: 147.1 symbols/min [2025-10-27T22:15:13.949334] [INFO ] [MAIN ] SU: Generated 138 derivative records from 53426 primary records. [2025-10-27T22:15:13.951952] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-27T22:15:13.966116] [INFO ] [MAIN ] SUI: Generated 138 derivative records from 41573 primary records. [2025-10-27T22:15:13.967150] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-27T22:15:13.968919] [DEBUG] [LOCAL ] SU: Derivative data saved (138 records). [2025-10-27T22:15:13.969255] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-27T22:15:13.971876] [INFO ] [MAIN ] Derivative Progress: 1559/1881 symbols completed. SU took 1.3s. Estimated remaining: 2m 11s. Rate: 147.2 symbols/min [2025-10-27T22:15:13.983592] [DEBUG] [LOCAL ] SUI: Derivative data saved (138 records). [2025-10-27T22:15:13.983684] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-27T22:15:13.986974] [INFO ] [MAIN ] Derivative Progress: 1560/1881 symbols completed. SUI took 1.3s. Estimated remaining: 2m 11s. Rate: 147.2 symbols/min [2025-10-27T22:15:13.987375] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:13.987487] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:13.987606] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:14.041801] [DEBUG] [LOCAL ] SUN: Loaded 38670 existing records from primary storage. [2025-10-27T22:15:14.041939] [INFO ] [MAIN ] SUN: Loaded 38670 primary data records. [2025-10-27T22:15:14.172009] [DEBUG] [LOCAL ] SUZ: Loaded 45267 existing records from primary storage. [2025-10-27T22:15:14.173053] [DEBUG] [LOCAL ] SUPV: Loaded 48100 existing records from primary storage. [2025-10-27T22:15:14.194114] [INFO ] [MAIN ] SUZ: Loaded 45267 primary data records. [2025-10-27T22:15:14.194292] [INFO ] [MAIN ] SUPV: Loaded 48100 primary data records. [2025-10-27T22:15:15.012108] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:15.049879] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:15.097843] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:15.130164] [INFO ] [MAIN ] SUN: Generated 138 derivative records from 38670 primary records. [2025-10-27T22:15:15.132883] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-27T22:15:15.151372] [DEBUG] [LOCAL ] SUN: Derivative data saved (138 records). [2025-10-27T22:15:15.154146] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-27T22:15:15.155861] [INFO ] [MAIN ] Derivative Progress: 1561/1881 symbols completed. SUN took 1.2s. Estimated remaining: 2m 11s. Rate: 147.1 symbols/min [2025-10-27T22:15:15.156009] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:15.160139] [INFO ] [MAIN ] SUPV: Generated 138 derivative records from 48100 primary records. [2025-10-27T22:15:15.160962] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-27T22:15:15.178828] [DEBUG] [LOCAL ] SUPV: Derivative data saved (138 records). [2025-10-27T22:15:15.179009] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-27T22:15:15.181894] [INFO ] [MAIN ] Derivative Progress: 1562/1881 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 10s. Rate: 147.2 symbols/min [2025-10-27T22:15:15.182165] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:15.189733] [INFO ] [MAIN ] SUZ: Generated 138 derivative records from 45267 primary records. [2025-10-27T22:15:15.189902] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-27T22:15:15.211541] [DEBUG] [LOCAL ] SUZ: Derivative data saved (138 records). [2025-10-27T22:15:15.211710] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-27T22:15:15.214631] [INFO ] [MAIN ] Derivative Progress: 1563/1881 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 10s. Rate: 147.2 symbols/min [2025-10-27T22:15:15.214978] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:15.244267] [DEBUG] [LOCAL ] SVV: Loaded 40123 existing records from primary storage. [2025-10-27T22:15:15.244584] [INFO ] [MAIN ] SVV: Loaded 40123 primary data records. [2025-10-27T22:15:15.367357] [DEBUG] [LOCAL ] SW: Loaded 53172 existing records from primary storage. [2025-10-27T22:15:15.378019] [INFO ] [MAIN ] SW: Loaded 53172 primary data records. [2025-10-27T22:15:15.700034] [DEBUG] [LOCAL ] SWK: Loaded 52318 existing records from primary storage. [2025-10-27T22:15:15.719335] [INFO ] [MAIN ] SWK: Loaded 52318 primary data records. [2025-10-27T22:15:16.260178] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:16.312783] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:16.342525] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:16.393043] [INFO ] [MAIN ] SVV: Generated 138 derivative records from 40123 primary records. [2025-10-27T22:15:16.395685] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-27T22:15:16.422524] [DEBUG] [LOCAL ] SVV: Derivative data saved (138 records). [2025-10-27T22:15:16.424831] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-27T22:15:16.427554] [INFO ] [MAIN ] Derivative Progress: 1564/1881 symbols completed. SVV took 1.3s. Estimated remaining: 2m 9s. Rate: 147.1 symbols/min [2025-10-27T22:15:16.427970] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:16.437916] [INFO ] [MAIN ] SWK: Generated 138 derivative records from 52318 primary records. [2025-10-27T22:15:16.438095] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-27T22:15:16.436250] [INFO ] [MAIN ] SW: Generated 138 derivative records from 53172 primary records. [2025-10-27T22:15:16.438811] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-27T22:15:16.463193] [DEBUG] [LOCAL ] SW: Derivative data saved (138 records). [2025-10-27T22:15:16.472102] [DEBUG] [LOCAL ] SWK: Derivative data saved (138 records). [2025-10-27T22:15:16.472193] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-27T22:15:16.472266] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-27T22:15:16.475580] [INFO ] [MAIN ] Derivative Progress: 1565/1881 symbols completed. SWK took 1.3s. Estimated remaining: 2m 9s. Rate: 147.1 symbols/min [2025-10-27T22:15:16.478804] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:16.478998] [INFO ] [MAIN ] Derivative Progress: 1566/1881 symbols completed. SW took 1.3s. Estimated remaining: 2m 8s. Rate: 147.2 symbols/min [2025-10-27T22:15:16.479472] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:16.497239] [DEBUG] [LOCAL ] SWX: Loaded 30113 existing records from primary storage. [2025-10-27T22:15:16.497462] [INFO ] [MAIN ] SWX: Loaded 30113 primary data records. [2025-10-27T22:15:16.544876] [DEBUG] [LOCAL ] SWZ: Loaded 5900 existing records from primary storage. [2025-10-27T22:15:16.559082] [INFO ] [MAIN ] SWZ: Loaded 5900 primary data records. [2025-10-27T22:15:17.126889] [DEBUG] [LOCAL ] SXC: Loaded 41299 existing records from primary storage. [2025-10-27T22:15:17.128334] [INFO ] [MAIN ] SXC: Loaded 41299 primary data records. [2025-10-27T22:15:17.518436] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:17.548159] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:17.613860] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:17.634559] [INFO ] [MAIN ] SWX: Generated 138 derivative records from 30113 primary records. [2025-10-27T22:15:17.638471] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-27T22:15:17.658339] [DEBUG] [LOCAL ] SWX: Derivative data saved (138 records). [2025-10-27T22:15:17.658787] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-27T22:15:17.660869] [INFO ] [MAIN ] Derivative Progress: 1567/1881 symbols completed. SWX took 1.2s. Estimated remaining: 2m 8s. Rate: 147.1 symbols/min [2025-10-27T22:15:17.661048] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:17.656843] [INFO ] [MAIN ] SWZ: Generated 138 derivative records from 5900 primary records. [2025-10-27T22:15:17.663865] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-27T22:15:17.679517] [DEBUG] [LOCAL ] SWZ: Derivative data saved (138 records). [2025-10-27T22:15:17.685036] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-27T22:15:17.687752] [INFO ] [MAIN ] Derivative Progress: 1568/1881 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 8s. Rate: 147.1 symbols/min [2025-10-27T22:15:17.687971] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:17.698938] [DEBUG] [LOCAL ] SXI: Loaded 11922 existing records from primary storage. [2025-10-27T22:15:17.700526] [INFO ] [MAIN ] SXI: Loaded 11922 primary data records. [2025-10-27T22:15:17.762593] [INFO ] [MAIN ] SXC: Generated 138 derivative records from 41299 primary records. [2025-10-27T22:15:17.785233] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-27T22:15:17.841777] [DEBUG] [LOCAL ] SXC: Derivative data saved (138 records). [2025-10-27T22:15:17.863481] [DEBUG] [LOCAL ] SXT: Loaded 29243 existing records from primary storage. [2025-10-27T22:15:17.901723] [INFO ] [MAIN ] SXT: Loaded 29243 primary data records. [2025-10-27T22:15:17.899223] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-27T22:15:17.925318] [INFO ] [MAIN ] Derivative Progress: 1569/1881 symbols completed. SXC took 1.4s. Estimated remaining: 2m 7s. Rate: 147.2 symbols/min [2025-10-27T22:15:18.083782] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:18.394716] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:18.427482] [DEBUG] [LOCAL ] SYF: Loaded 53447 existing records from primary storage. [2025-10-27T22:15:18.429467] [INFO ] [MAIN ] SYF: Loaded 53447 primary data records. [2025-10-27T22:15:18.635107] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:18.779762] [INFO ] [MAIN ] SXI: Generated 138 derivative records from 11922 primary records. [2025-10-27T22:15:18.782220] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-27T22:15:18.798080] [DEBUG] [LOCAL ] SXI: Derivative data saved (138 records). [2025-10-27T22:15:18.799451] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-27T22:15:18.801414] [INFO ] [MAIN ] Derivative Progress: 1570/1881 symbols completed. SXI took 1.1s. Estimated remaining: 2m 7s. Rate: 147.1 symbols/min [2025-10-27T22:15:18.802489] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:18.813455] [INFO ] [MAIN ] SXT: Generated 138 derivative records from 29243 primary records. [2025-10-27T22:15:18.816231] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-27T22:15:18.842251] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:18.844300] [DEBUG] [LOCAL ] SXT: Derivative data saved (138 records). [2025-10-27T22:15:18.844578] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-27T22:15:18.847755] [INFO ] [MAIN ] Derivative Progress: 1571/1881 symbols completed. SXT took 1.2s. Estimated remaining: 2m 6s. Rate: 147.2 symbols/min [2025-10-27T22:15:18.859703] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:18.906578] [DEBUG] [LOCAL ] SYK: Loaded 46656 existing records from primary storage. [2025-10-27T22:15:18.907825] [INFO ] [MAIN ] SYK: Loaded 46656 primary data records. [2025-10-27T22:15:18.994349] [INFO ] [MAIN ] SYF: Generated 138 derivative records from 53447 primary records. [2025-10-27T22:15:19.064617] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-27T22:15:19.256157] [DEBUG] [LOCAL ] SYY: Loaded 53192 existing records from primary storage. [2025-10-27T22:15:19.266689] [DEBUG] [LOCAL ] SYF: Derivative data saved (138 records). [2025-10-27T22:15:19.267294] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-27T22:15:19.270058] [INFO ] [MAIN ] SYY: Loaded 53192 primary data records. [2025-10-27T22:15:19.269969] [INFO ] [MAIN ] Derivative Progress: 1572/1881 symbols completed. SYF took 1.2s. Estimated remaining: 2m 6s. Rate: 147.2 symbols/min [2025-10-27T22:15:19.270391] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:19.616377] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:19.645889] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-27T22:15:19.648303] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-27T22:15:20.024299] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:20.043369] [INFO ] [MAIN ] SYK: Generated 138 derivative records from 46656 primary records. [2025-10-27T22:15:20.045320] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-27T22:15:20.064666] [DEBUG] [LOCAL ] SYK: Derivative data saved (138 records). [2025-10-27T22:15:20.067524] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-27T22:15:20.070360] [INFO ] [MAIN ] Derivative Progress: 1573/1881 symbols completed. SYK took 1.3s. Estimated remaining: 2m 6s. Rate: 147.1 symbols/min [2025-10-27T22:15:20.096207] [INFO ] [MAIN ] SYY: Generated 138 derivative records from 53192 primary records. [2025-10-27T22:15:20.094474] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:20.096352] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-27T22:15:20.124846] [DEBUG] [LOCAL ] SYY: Derivative data saved (138 records). [2025-10-27T22:15:20.125034] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-27T22:15:20.128888] [INFO ] [MAIN ] Derivative Progress: 1574/1881 symbols completed. SYY took 1.3s. Estimated remaining: 2m 5s. Rate: 147.1 symbols/min [2025-10-27T22:15:20.139253] [INFO ] [MAIN ] T: Generated 138 derivative records from 53798 primary records. [2025-10-27T22:15:20.139323] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-27T22:15:20.150944] [DEBUG] [LOCAL ] T: Derivative data saved (138 records). [2025-10-27T22:15:20.150999] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-27T22:15:20.153424] [INFO ] [MAIN ] Derivative Progress: 1575/1881 symbols completed. T took 0.9s. Estimated remaining: 2m 5s. Rate: 147.2 symbols/min [2025-10-27T22:15:20.153886] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:20.153994] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:20.154090] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:20.214733] [DEBUG] [LOCAL ] TAC: Loaded 43453 existing records from primary storage. [2025-10-27T22:15:20.214941] [INFO ] [MAIN ] TAC: Loaded 43453 primary data records. [2025-10-27T22:15:20.343203] [DEBUG] [LOCAL ] TAL: Loaded 51657 existing records from primary storage. [2025-10-27T22:15:20.346414] [INFO ] [MAIN ] TAL: Loaded 51657 primary data records. [2025-10-27T22:15:20.372748] [DEBUG] [LOCAL ] TAK: Loaded 50158 existing records from primary storage. [2025-10-27T22:15:20.477677] [INFO ] [MAIN ] TAK: Loaded 50158 primary data records. [2025-10-27T22:15:21.167231] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:21.197911] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:21.237953] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:21.275247] [INFO ] [MAIN ] TAC: Generated 138 derivative records from 43453 primary records. [2025-10-27T22:15:21.278637] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-27T22:15:21.294243] [DEBUG] [LOCAL ] TAC: Derivative data saved (138 records). [2025-10-27T22:15:21.294382] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-27T22:15:21.296819] [INFO ] [MAIN ] Derivative Progress: 1576/1881 symbols completed. TAC took 1.1s. Estimated remaining: 2m 4s. Rate: 147.1 symbols/min [2025-10-27T22:15:21.298109] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:21.304709] [INFO ] [MAIN ] TAL: Generated 138 derivative records from 51657 primary records. [2025-10-27T22:15:21.305109] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-27T22:15:21.321423] [DEBUG] [LOCAL ] TAL: Derivative data saved (138 records). [2025-10-27T22:15:21.323557] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-27T22:15:21.326997] [INFO ] [MAIN ] TAK: Generated 138 derivative records from 50158 primary records. [2025-10-27T22:15:21.326695] [INFO ] [MAIN ] Derivative Progress: 1577/1881 symbols completed. TAL took 1.2s. Estimated remaining: 2m 4s. Rate: 147.1 symbols/min [2025-10-27T22:15:21.327302] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:21.327172] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-27T22:15:21.353628] [DEBUG] [LOCAL ] TAK: Derivative data saved (138 records). [2025-10-27T22:15:21.353779] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-27T22:15:21.356761] [INFO ] [MAIN ] Derivative Progress: 1578/1881 symbols completed. TAK took 1.2s. Estimated remaining: 2m 3s. Rate: 147.2 symbols/min [2025-10-27T22:15:21.357035] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:21.378207] [DEBUG] [LOCAL ] TALO: Loaded 50918 existing records from primary storage. [2025-10-27T22:15:21.378491] [INFO ] [MAIN ] TALO: Loaded 50918 primary data records. [2025-10-27T22:15:21.446955] [DEBUG] [LOCAL ] TBB: Loaded 11028 existing records from primary storage. [2025-10-27T22:15:21.471738] [INFO ] [MAIN ] TBB: Loaded 11028 primary data records. [2025-10-27T22:15:21.683495] [DEBUG] [LOCAL ] TAP: Loaded 52942 existing records from primary storage. [2025-10-27T22:15:21.719479] [INFO ] [MAIN ] TAP: Loaded 52942 primary data records. [2025-10-27T22:15:22.361452] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:22.386899] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:22.430366] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:22.471024] [INFO ] [MAIN ] TALO: Generated 138 derivative records from 50918 primary records. [2025-10-27T22:15:22.473578] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-27T22:15:22.496109] [INFO ] [MAIN ] TBB: Generated 138 derivative records from 11028 primary records. [2025-10-27T22:15:22.496771] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-27T22:15:22.499923] [DEBUG] [LOCAL ] TALO: Derivative data saved (138 records). [2025-10-27T22:15:22.507441] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-27T22:15:22.509495] [INFO ] [MAIN ] Derivative Progress: 1579/1881 symbols completed. TALO took 1.2s. Estimated remaining: 2m 3s. Rate: 147.1 symbols/min [2025-10-27T22:15:22.509633] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:22.516899] [DEBUG] [LOCAL ] TBB: Derivative data saved (138 records). [2025-10-27T22:15:22.517240] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-27T22:15:22.519563] [INFO ] [MAIN ] Derivative Progress: 1580/1881 symbols completed. TBB took 1.2s. Estimated remaining: 2m 3s. Rate: 147.2 symbols/min [2025-10-27T22:15:22.519824] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:22.523733] [INFO ] [MAIN ] TAP: Generated 138 derivative records from 52942 primary records. [2025-10-27T22:15:22.524087] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-27T22:15:22.536335] [DEBUG] [LOCAL ] TAP: Derivative data saved (138 records). [2025-10-27T22:15:22.536412] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-27T22:15:22.539153] [INFO ] [MAIN ] Derivative Progress: 1581/1881 symbols completed. TAP took 1.2s. Estimated remaining: 2m 2s. Rate: 147.2 symbols/min [2025-10-27T22:15:22.539486] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:22.558278] [DEBUG] [LOCAL ] TBN: Loaded 4471 existing records from primary storage. [2025-10-27T22:15:22.558444] [INFO ] [MAIN ] TBN: Loaded 4471 primary data records. [2025-10-27T22:15:22.612711] [DEBUG] [LOCAL ] TBI: Loaded 22549 existing records from primary storage. [2025-10-27T22:15:22.629902] [INFO ] [MAIN ] TBI: Loaded 22549 primary data records. [2025-10-27T22:15:22.650449] [DEBUG] [LOCAL ] TBBB: Loaded 35391 existing records from primary storage. [2025-10-27T22:15:22.720156] [INFO ] [MAIN ] TBBB: Loaded 35391 primary data records. [2025-10-27T22:15:23.500344] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:23.521173] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:23.549878] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:23.619301] [INFO ] [MAIN ] TBN: Generated 138 derivative records from 4471 primary records. [2025-10-27T22:15:23.623768] [INFO ] [MAIN ] TBI: Generated 138 derivative records from 22549 primary records. [2025-10-27T22:15:23.624008] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-27T22:15:23.623936] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-27T22:15:23.645293] [DEBUG] [LOCAL ] TBI: Derivative data saved (138 records). [2025-10-27T22:15:23.645442] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-27T22:15:23.647191] [DEBUG] [LOCAL ] TBN: Derivative data saved (138 records). [2025-10-27T22:15:23.651593] [INFO ] [MAIN ] TBBB: Generated 138 derivative records from 35391 primary records. [2025-10-27T22:15:23.651835] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-27T22:15:23.651749] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-27T22:15:23.649455] [INFO ] [MAIN ] Derivative Progress: 1582/1881 symbols completed. TBI took 1.1s. Estimated remaining: 2m 2s. Rate: 147.1 symbols/min [2025-10-27T22:15:23.652088] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:23.654734] [INFO ] [MAIN ] Derivative Progress: 1583/1881 symbols completed. TBN took 1.1s. Estimated remaining: 2m 1s. Rate: 147.2 symbols/min [2025-10-27T22:15:23.655681] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:23.668056] [DEBUG] [LOCAL ] TBBB: Derivative data saved (138 records). [2025-10-27T22:15:23.668390] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-27T22:15:23.671177] [INFO ] [MAIN ] Derivative Progress: 1584/1881 symbols completed. TBBB took 1.2s. Estimated remaining: 2m 1s. Rate: 147.3 symbols/min [2025-10-27T22:15:23.674058] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:23.679750] [DEBUG] [LOCAL ] TCBX: Loaded 10015 existing records from primary storage. [2025-10-27T22:15:23.679951] [INFO ] [MAIN ] TCBX: Loaded 10015 primary data records. [2025-10-27T22:15:24.045435] [DEBUG] [LOCAL ] TDC: Loaded 46307 existing records from primary storage. [2025-10-27T22:15:24.046614] [INFO ] [MAIN ] TDC: Loaded 46307 primary data records. [2025-10-27T22:15:24.078096] [DEBUG] [LOCAL ] TD: Loaded 52135 existing records from primary storage. [2025-10-27T22:15:24.102197] [INFO ] [MAIN ] TD: Loaded 52135 primary data records. [2025-10-27T22:15:24.667819] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:24.723941] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:24.754310] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:24.772693] [INFO ] [MAIN ] TCBX: Generated 138 derivative records from 10015 primary records. [2025-10-27T22:15:24.775502] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-27T22:15:24.793633] [DEBUG] [LOCAL ] TCBX: Derivative data saved (138 records). [2025-10-27T22:15:24.797827] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-27T22:15:24.805002] [INFO ] [MAIN ] Derivative Progress: 1585/1881 symbols completed. TCBX took 1.2s. Estimated remaining: 2m 1s. Rate: 147.1 symbols/min [2025-10-27T22:15:24.805707] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:24.820214] [DEBUG] [LOCAL ] TDF: Loaded 6033 existing records from primary storage. [2025-10-27T22:15:24.821493] [INFO ] [MAIN ] TDF: Loaded 6033 primary data records. [2025-10-27T22:15:24.961367] [INFO ] [MAIN ] TDC: Generated 138 derivative records from 46307 primary records. [2025-10-27T22:15:24.978701] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-27T22:15:24.998856] [INFO ] [MAIN ] TD: Generated 138 derivative records from 52135 primary records. [2025-10-27T22:15:25.047096] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-27T22:15:25.150874] [DEBUG] [LOCAL ] TDC: Derivative data saved (138 records). [2025-10-27T22:15:25.164713] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-27T22:15:25.166761] [INFO ] [MAIN ] Derivative Progress: 1586/1881 symbols completed. TDC took 1.5s. Estimated remaining: 2m 0s. Rate: 147.1 symbols/min [2025-10-27T22:15:25.167235] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:25.180493] [DEBUG] [LOCAL ] TD: Derivative data saved (138 records). [2025-10-27T22:15:25.181019] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-27T22:15:25.183880] [INFO ] [MAIN ] Derivative Progress: 1587/1881 symbols completed. TD took 1.5s. Estimated remaining: 1m 60s. Rate: 147.2 symbols/min [2025-10-27T22:15:25.184263] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:25.206565] [DEBUG] [LOCAL ] TDG: Loaded 21549 existing records from primary storage. [2025-10-27T22:15:25.207040] [INFO ] [MAIN ] TDG: Loaded 21549 primary data records. [2025-10-27T22:15:25.282003] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:25.559553] [DEBUG] [LOCAL ] TDOC: Loaded 53368 existing records from primary storage. [2025-10-27T22:15:25.562690] [INFO ] [MAIN ] TDOC: Loaded 53368 primary data records. [2025-10-27T22:15:25.957760] [INFO ] [MAIN ] TDF: Generated 138 derivative records from 6033 primary records. [2025-10-27T22:15:25.959470] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-27T22:15:25.959115] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:25.989703] [DEBUG] [LOCAL ] TDF: Derivative data saved (138 records). [2025-10-27T22:15:25.990337] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-27T22:15:25.995851] [INFO ] [MAIN ] Derivative Progress: 1588/1881 symbols completed. TDF took 1.2s. Estimated remaining: 1m 60s. Rate: 147.1 symbols/min [2025-10-27T22:15:26.028163] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:26.029969] [INFO ] [MAIN ] TDG: Generated 138 derivative records from 21549 primary records. [2025-10-27T22:15:26.041964] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-27T22:15:26.060101] [DEBUG] [LOCAL ] TDG: Derivative data saved (138 records). [2025-10-27T22:15:26.060187] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-27T22:15:26.062245] [INFO ] [MAIN ] Derivative Progress: 1589/1881 symbols completed. TDG took 0.9s. Estimated remaining: 1m 59s. Rate: 147.2 symbols/min [2025-10-27T22:15:26.073434] [INFO ] [MAIN ] TDOC: Generated 138 derivative records from 53368 primary records. [2025-10-27T22:15:26.073576] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-27T22:15:26.085375] [DEBUG] [LOCAL ] TDOC: Derivative data saved (138 records). [2025-10-27T22:15:26.085439] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-27T22:15:26.088519] [INFO ] [MAIN ] Derivative Progress: 1590/1881 symbols completed. TDOC took 0.9s. Estimated remaining: 1m 59s. Rate: 147.3 symbols/min [2025-10-27T22:15:26.089133] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:26.089051] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:26.089265] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:26.120760] [DEBUG] [LOCAL ] TDY: Loaded 21896 existing records from primary storage. [2025-10-27T22:15:26.120935] [INFO ] [MAIN ] TDY: Loaded 21896 primary data records. [2025-10-27T22:15:26.244369] [DEBUG] [LOCAL ] TDW: Loaded 44739 existing records from primary storage. [2025-10-27T22:15:26.256904] [INFO ] [MAIN ] TDW: Loaded 44739 primary data records. [2025-10-27T22:15:26.307587] [DEBUG] [LOCAL ] TDS: Loaded 41768 existing records from primary storage. [2025-10-27T22:15:26.360741] [INFO ] [MAIN ] TDS: Loaded 41768 primary data records. [2025-10-27T22:15:27.117846] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:27.159393] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:27.190748] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:27.228023] [INFO ] [MAIN ] TDY: Generated 138 derivative records from 21896 primary records. [2025-10-27T22:15:27.230960] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-27T22:15:27.252505] [DEBUG] [LOCAL ] TDY: Derivative data saved (138 records). [2025-10-27T22:15:27.252619] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-27T22:15:27.256816] [INFO ] [MAIN ] Derivative Progress: 1591/1881 symbols completed. TDY took 1.2s. Estimated remaining: 1m 58s. Rate: 147.1 symbols/min [2025-10-27T22:15:27.258445] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:27.264416] [INFO ] [MAIN ] TDW: Generated 138 derivative records from 44739 primary records. [2025-10-27T22:15:27.264807] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-27T22:15:27.284534] [DEBUG] [LOCAL ] TDW: Derivative data saved (138 records). [2025-10-27T22:15:27.284728] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-27T22:15:27.287613] [INFO ] [MAIN ] Derivative Progress: 1592/1881 symbols completed. TDW took 1.2s. Estimated remaining: 1m 58s. Rate: 147.2 symbols/min [2025-10-27T22:15:27.292967] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:27.293296] [DEBUG] [LOCAL ] TEAF: Loaded 7257 existing records from primary storage. [2025-10-27T22:15:27.295585] [INFO ] [MAIN ] TDS: Generated 138 derivative records from 41768 primary records. [2025-10-27T22:15:27.296032] [INFO ] [MAIN ] TEAF: Loaded 7257 primary data records. [2025-10-27T22:15:27.296199] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-27T22:15:27.388330] [DEBUG] [LOCAL ] TDS: Derivative data saved (138 records). [2025-10-27T22:15:27.412511] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-27T22:15:27.455765] [INFO ] [MAIN ] Derivative Progress: 1593/1881 symbols completed. TDS took 1.4s. Estimated remaining: 1m 57s. Rate: 147.2 symbols/min [2025-10-27T22:15:27.493307] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:27.666414] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:27.667618] [DEBUG] [LOCAL ] TECK: Loaded 53429 existing records from primary storage. [2025-10-27T22:15:27.678814] [INFO ] [MAIN ] TECK: Loaded 53429 primary data records. [2025-10-27T22:15:27.806332] [DEBUG] [LOCAL ] TEF: Loaded 36539 existing records from primary storage. [2025-10-27T22:15:27.834240] [INFO ] [MAIN ] TEF: Loaded 36539 primary data records. [2025-10-27T22:15:28.368738] [INFO ] [MAIN ] TEAF: Generated 138 derivative records from 7257 primary records. [2025-10-27T22:15:28.370079] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-27T22:15:28.385208] [DEBUG] [LOCAL ] TEAF: Derivative data saved (138 records). [2025-10-27T22:15:28.385502] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-27T22:15:28.387956] [INFO ] [MAIN ] Derivative Progress: 1594/1881 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 57s. Rate: 147.1 symbols/min [2025-10-27T22:15:28.388283] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:28.414591] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:28.455595] [DEBUG] [LOCAL ] TEI: Loaded 21032 existing records from primary storage. [2025-10-27T22:15:28.456739] [INFO ] [MAIN ] TEI: Loaded 21032 primary data records. [2025-10-27T22:15:28.456570] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:28.811158] [INFO ] [MAIN ] TECK: Generated 138 derivative records from 53429 primary records. [2025-10-27T22:15:28.812465] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-27T22:15:28.827145] [DEBUG] [LOCAL ] TECK: Derivative data saved (138 records). [2025-10-27T22:15:28.830515] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-27T22:15:28.832519] [INFO ] [MAIN ] Derivative Progress: 1595/1881 symbols completed. TECK took 1.5s. Estimated remaining: 1m 57s. Rate: 147.1 symbols/min [2025-10-27T22:15:28.832734] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:28.841038] [INFO ] [MAIN ] TEF: Generated 138 derivative records from 36539 primary records. [2025-10-27T22:15:28.841273] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-27T22:15:28.854940] [DEBUG] [LOCAL ] TEF: Derivative data saved (138 records). [2025-10-27T22:15:28.855120] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-27T22:15:28.858337] [INFO ] [MAIN ] Derivative Progress: 1596/1881 symbols completed. TEF took 1.4s. Estimated remaining: 1m 56s. Rate: 147.2 symbols/min [2025-10-27T22:15:28.859331] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:28.875634] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:28.926814] [INFO ] [MAIN ] TEI: Generated 138 derivative records from 21032 primary records. [2025-10-27T22:15:28.927066] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-27T22:15:28.948752] [DEBUG] [LOCAL ] TEN: Loaded 29787 existing records from primary storage. [2025-10-27T22:15:28.948168] [DEBUG] [LOCAL ] TEI: Derivative data saved (138 records). [2025-10-27T22:15:28.949080] [INFO ] [MAIN ] TEN: Loaded 29787 primary data records. [2025-10-27T22:15:28.961521] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-27T22:15:28.963585] [INFO ] [MAIN ] Derivative Progress: 1597/1881 symbols completed. TEI took 0.6s. Estimated remaining: 1m 56s. Rate: 147.3 symbols/min [2025-10-27T22:15:28.964978] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:28.996328] [DEBUG] [LOCAL ] TEL: Loaded 51002 existing records from primary storage. [2025-10-27T22:15:29.032857] [INFO ] [MAIN ] TEL: Loaded 51002 primary data records. [2025-10-27T22:15:29.406566] [DEBUG] [LOCAL ] TEO: Loaded 23080 existing records from primary storage. [2025-10-27T22:15:29.457137] [INFO ] [MAIN ] TEO: Loaded 23080 primary data records. [2025-10-27T22:15:29.925518] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:29.958346] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:30.061513] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:30.101271] [INFO ] [MAIN ] TEL: Generated 138 derivative records from 51002 primary records. [2025-10-27T22:15:30.102877] [INFO ] [MAIN ] TEN: Generated 138 derivative records from 29787 primary records. [2025-10-27T22:15:30.103026] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-27T22:15:30.103363] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-27T22:15:30.118772] [DEBUG] [LOCAL ] TEL: Derivative data saved (138 records). [2025-10-27T22:15:30.119291] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-27T22:15:30.128395] [INFO ] [MAIN ] Derivative Progress: 1598/1881 symbols completed. TEL took 1.3s. Estimated remaining: 1m 55s. Rate: 147.1 symbols/min [2025-10-27T22:15:30.132722] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:30.133035] [DEBUG] [LOCAL ] TEN: Derivative data saved (138 records). [2025-10-27T22:15:30.133275] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-27T22:15:30.136389] [INFO ] [MAIN ] Derivative Progress: 1599/1881 symbols completed. TEN took 1.3s. Estimated remaining: 1m 55s. Rate: 147.2 symbols/min [2025-10-27T22:15:30.137323] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:30.147638] [INFO ] [MAIN ] TEO: Generated 138 derivative records from 23080 primary records. [2025-10-27T22:15:30.147869] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-27T22:15:30.159798] [DEBUG] [LOCAL ] TEO: Derivative data saved (138 records). [2025-10-27T22:15:30.160167] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-27T22:15:30.162942] [INFO ] [MAIN ] Derivative Progress: 1600/1881 symbols completed. TEO took 1.2s. Estimated remaining: 1m 54s. Rate: 147.3 symbols/min [2025-10-27T22:15:30.163315] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:30.204117] [DEBUG] [LOCAL ] TEX: Loaded 43349 existing records from primary storage. [2025-10-27T22:15:30.204258] [INFO ] [MAIN ] TEX: Loaded 43349 primary data records. [2025-10-27T22:15:30.320124] [DEBUG] [LOCAL ] TEVA: Loaded 53616 existing records from primary storage. [2025-10-27T22:15:30.333674] [INFO ] [MAIN ] TEVA: Loaded 53616 primary data records. [2025-10-27T22:15:30.662556] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-27T22:15:30.663516] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-27T22:15:31.185637] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:31.232621] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:31.274126] [INFO ] [MAIN ] TEX: Generated 138 derivative records from 43349 primary records. [2025-10-27T22:15:31.274997] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:31.275187] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-27T22:15:31.305491] [DEBUG] [LOCAL ] TEX: Derivative data saved (138 records). [2025-10-27T22:15:31.306405] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-27T22:15:31.309026] [INFO ] [MAIN ] Derivative Progress: 1601/1881 symbols completed. TEX took 1.2s. Estimated remaining: 1m 54s. Rate: 147.1 symbols/min [2025-10-27T22:15:31.312304] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:31.347104] [INFO ] [MAIN ] TEVA: Generated 138 derivative records from 53616 primary records. [2025-10-27T22:15:31.347452] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-27T22:15:31.373834] [DEBUG] [LOCAL ] TEVA: Derivative data saved (138 records). [2025-10-27T22:15:31.374634] [DEBUG] [LOCAL ] TFII: Loaded 31877 existing records from primary storage. [2025-10-27T22:15:31.376261] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-27T22:15:31.378460] [INFO ] [MAIN ] Derivative Progress: 1602/1881 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 54s. Rate: 147.2 symbols/min [2025-10-27T22:15:31.378908] [INFO ] [MAIN ] TFC: Generated 138 derivative records from 53667 primary records. [2025-10-27T22:15:31.379014] [INFO ] [MAIN ] TFII: Loaded 31877 primary data records. [2025-10-27T22:15:31.379065] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-27T22:15:31.379580] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:31.481770] [DEBUG] [LOCAL ] TFC: Derivative data saved (138 records). [2025-10-27T22:15:31.489440] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-27T22:15:31.507294] [INFO ] [MAIN ] Derivative Progress: 1603/1881 symbols completed. TFC took 1.3s. Estimated remaining: 1m 53s. Rate: 147.2 symbols/min [2025-10-27T22:15:31.567678] [DEBUG] [LOCAL ] TFIN: Loaded 23283 existing records from primary storage. [2025-10-27T22:15:31.583035] [INFO ] [MAIN ] TFIN: Loaded 23283 primary data records. [2025-10-27T22:15:32.023850] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:32.063006] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:32.082685] [INFO ] [MAIN ] TFII: Generated 138 derivative records from 31877 primary records. [2025-10-27T22:15:32.083037] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-27T22:15:32.099182] [DEBUG] [LOCAL ] TFII: Derivative data saved (138 records). [2025-10-27T22:15:32.099416] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-27T22:15:32.103301] [INFO ] [MAIN ] Derivative Progress: 1604/1881 symbols completed. TFII took 0.8s. Estimated remaining: 1m 53s. Rate: 147.2 symbols/min [2025-10-27T22:15:32.111679] [INFO ] [MAIN ] TFIN: Generated 138 derivative records from 23283 primary records. [2025-10-27T22:15:32.111751] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-27T22:15:32.123095] [DEBUG] [LOCAL ] TFIN: Derivative data saved (138 records). [2025-10-27T22:15:32.123149] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-27T22:15:32.125273] [INFO ] [MAIN ] Derivative Progress: 1605/1881 symbols completed. TFIN took 0.7s. Estimated remaining: 1m 52s. Rate: 147.3 symbols/min [2025-10-27T22:15:32.125662] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:32.125785] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:32.125609] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:32.137329] [DEBUG] [LOCAL ] TG: Loaded 10529 existing records from primary storage. [2025-10-27T22:15:32.137531] [INFO ] [MAIN ] TG: Loaded 10529 primary data records. [2025-10-27T22:15:32.381491] [DEBUG] [LOCAL ] TFX: Loaded 35192 existing records from primary storage. [2025-10-27T22:15:32.487460] [INFO ] [MAIN ] TFX: Loaded 35192 primary data records. [2025-10-27T22:15:32.488052] [DEBUG] [LOCAL ] TFPM: Loaded 39904 existing records from primary storage. [2025-10-27T22:15:32.488256] [INFO ] [MAIN ] TFPM: Loaded 39904 primary data records. [2025-10-27T22:15:33.097373] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:33.143459] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:33.176986] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:33.194730] [INFO ] [MAIN ] TG: Generated 138 derivative records from 10529 primary records. [2025-10-27T22:15:33.194957] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-27T22:15:33.208859] [DEBUG] [LOCAL ] TG: Derivative data saved (138 records). [2025-10-27T22:15:33.213295] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-27T22:15:33.215594] [INFO ] [MAIN ] Derivative Progress: 1606/1881 symbols completed. TG took 1.1s. Estimated remaining: 1m 52s. Rate: 147.1 symbols/min [2025-10-27T22:15:33.216058] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:33.246849] [INFO ] [MAIN ] TFX: Generated 138 derivative records from 35192 primary records. [2025-10-27T22:15:33.255303] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-27T22:15:33.257322] [DEBUG] [LOCAL ] TGLS: Loaded 27281 existing records from primary storage. [2025-10-27T22:15:33.257683] [INFO ] [MAIN ] TGLS: Loaded 27281 primary data records. [2025-10-27T22:15:33.313020] [INFO ] [MAIN ] TFPM: Generated 138 derivative records from 39904 primary records. [2025-10-27T22:15:33.306202] [DEBUG] [LOCAL ] TFX: Derivative data saved (138 records). [2025-10-27T22:15:33.333623] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-27T22:15:33.333528] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-27T22:15:33.352718] [INFO ] [MAIN ] Derivative Progress: 1607/1881 symbols completed. TFX took 1.2s. Estimated remaining: 1m 52s. Rate: 147.2 symbols/min [2025-10-27T22:15:33.358003] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:33.397351] [DEBUG] [LOCAL ] TFPM: Derivative data saved (138 records). [2025-10-27T22:15:33.412929] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-27T22:15:33.427885] [INFO ] [MAIN ] Derivative Progress: 1608/1881 symbols completed. TFPM took 1.3s. Estimated remaining: 1m 51s. Rate: 147.3 symbols/min [2025-10-27T22:15:33.461735] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:33.622004] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:33.658208] [DEBUG] [LOCAL ] TGNA: Loaded 48284 existing records from primary storage. [2025-10-27T22:15:33.663553] [INFO ] [MAIN ] TGNA: Loaded 48284 primary data records. [2025-10-27T22:15:33.664242] [DEBUG] [LOCAL ] TGS: Loaded 33920 existing records from primary storage. [2025-10-27T22:15:33.669616] [INFO ] [MAIN ] TGS: Loaded 33920 primary data records. [2025-10-27T22:15:34.234054] [INFO ] [MAIN ] TGLS: Generated 138 derivative records from 27281 primary records. [2025-10-27T22:15:34.326124] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-27T22:15:34.348013] [DEBUG] [LOCAL ] TGLS: Derivative data saved (138 records). [2025-10-27T22:15:34.349460] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-27T22:15:34.352326] [INFO ] [MAIN ] Derivative Progress: 1609/1881 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 51s. Rate: 147.2 symbols/min [2025-10-27T22:15:34.354918] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:34.380235] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:34.408255] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:34.498706] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-27T22:15:34.502124] [INFO ] [MAIN ] TGT: Loaded 53777 primary data records. [2025-10-27T22:15:34.560015] [INFO ] [MAIN ] TGS: Generated 138 derivative records from 33920 primary records. [2025-10-27T22:15:34.560101] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-27T22:15:34.559798] [INFO ] [MAIN ] TGNA: Generated 138 derivative records from 48284 primary records. [2025-10-27T22:15:34.609288] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-27T22:15:34.619889] [DEBUG] [LOCAL ] TGS: Derivative data saved (138 records). [2025-10-27T22:15:34.648741] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-27T22:15:34.658838] [INFO ] [MAIN ] Derivative Progress: 1610/1881 symbols completed. TGS took 1.2s. Estimated remaining: 1m 50s. Rate: 147.2 symbols/min [2025-10-27T22:15:34.704780] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:34.710387] [DEBUG] [LOCAL ] TGNA: Derivative data saved (138 records). [2025-10-27T22:15:34.733169] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-27T22:15:34.739005] [INFO ] [MAIN ] Derivative Progress: 1611/1881 symbols completed. TGNA took 1.4s. Estimated remaining: 1m 50s. Rate: 147.3 symbols/min [2025-10-27T22:15:34.848363] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:34.883283] [DEBUG] [LOCAL ] THG: Loaded 21171 existing records from primary storage. [2025-10-27T22:15:34.895794] [INFO ] [MAIN ] THG: Loaded 21171 primary data records. [2025-10-27T22:15:34.895972] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:35.022802] [DEBUG] [LOCAL ] THC: Loaded 46584 existing records from primary storage. [2025-10-27T22:15:35.033091] [INFO ] [MAIN ] THC: Loaded 46584 primary data records. [2025-10-27T22:15:35.527878] [INFO ] [MAIN ] TGT: Generated 138 derivative records from 53777 primary records. [2025-10-27T22:15:35.528692] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-27T22:15:35.542363] [DEBUG] [LOCAL ] TGT: Derivative data saved (138 records). [2025-10-27T22:15:35.542555] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-27T22:15:35.545076] [INFO ] [MAIN ] Derivative Progress: 1612/1881 symbols completed. TGT took 1.2s. Estimated remaining: 1m 50s. Rate: 147.2 symbols/min [2025-10-27T22:15:35.545363] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:35.553318] [DEBUG] [LOCAL ] THIR: Loaded 2469 existing records from primary storage. [2025-10-27T22:15:35.561044] [INFO ] [MAIN ] THIR: Loaded 2469 primary data records. [2025-10-27T22:15:35.572040] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:35.785386] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:35.969989] [INFO ] [MAIN ] THG: Generated 138 derivative records from 21171 primary records. [2025-10-27T22:15:35.973109] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-27T22:15:35.991945] [DEBUG] [LOCAL ] THG: Derivative data saved (138 records). [2025-10-27T22:15:35.992247] [INFO ] [MAIN ] THC: Generated 138 derivative records from 46584 primary records. [2025-10-27T22:15:35.992514] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-27T22:15:35.994347] [INFO ] [MAIN ] Derivative Progress: 1613/1881 symbols completed. THG took 1.1s. Estimated remaining: 1m 49s. Rate: 147.2 symbols/min [2025-10-27T22:15:35.994543] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-27T22:15:35.994802] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:36.021265] [DEBUG] [LOCAL ] THC: Derivative data saved (138 records). [2025-10-27T22:15:36.022062] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-27T22:15:36.021928] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:15:36.024286] [DEBUG] [LOCAL ] THLV: Loaded 1464 existing records from primary storage. [2025-10-27T22:15:36.026624] [INFO ] [MAIN ] THLV: Loaded 1464 primary data records. [2025-10-27T22:15:36.026543] [INFO ] [MAIN ] Derivative Progress: 1614/1881 symbols completed. THC took 1.3s. Estimated remaining: 1m 49s. Rate: 147.2 symbols/min [2025-10-27T22:15:36.063984] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:36.403697] [INFO ] [MAIN ] THIR: Generated 138 derivative records from 2469 primary records. [2025-10-27T22:15:36.403912] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-27T22:15:36.426312] [DEBUG] [LOCAL ] THO: Loaded 40610 existing records from primary storage. [2025-10-27T22:15:36.429083] [INFO ] [MAIN ] THO: Loaded 40610 primary data records. [2025-10-27T22:15:36.428935] [DEBUG] [LOCAL ] THIR: Derivative data saved (138 records). [2025-10-27T22:15:36.429515] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-27T22:15:36.462525] [INFO ] [MAIN ] Derivative Progress: 1615/1881 symbols completed. THIR took 0.9s. Estimated remaining: 1m 48s. Rate: 147.2 symbols/min [2025-10-27T22:15:36.468186] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:36.633178] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-27T22:15:36.770511] [DEBUG] [LOCAL ] THQ: Loaded 25164 existing records from primary storage. [2025-10-27T22:15:36.774934] [INFO ] [MAIN ] THQ: Loaded 25164 primary data records. [2025-10-27T22:15:37.099385] [INFO ] [MAIN ] THLV: Generated 138 derivative records from 1464 primary records. [2025-10-27T22:15:37.111983] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-27T22:15:37.112494] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:37.137539] [DEBUG] [LOCAL ] THLV: Derivative data saved (138 records). [2025-10-27T22:15:37.139590] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-27T22:15:37.141971] [INFO ] [MAIN ] Derivative Progress: 1616/1881 symbols completed. THLV took 1.1s. Estimated remaining: 1m 48s. Rate: 147.2 symbols/min [2025-10-27T22:15:37.144142] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:37.175483] [DEBUG] [LOCAL ] THR: Loaded 19280 existing records from primary storage. [2025-10-27T22:15:37.177474] [INFO ] [MAIN ] THR: Loaded 19280 primary data records. [2025-10-27T22:15:37.179442] [INFO ] [MAIN ] THO: Generated 138 derivative records from 40610 primary records. [2025-10-27T22:15:37.190891] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-27T22:15:37.247304] [DEBUG] [LOCAL ] THO: Derivative data saved (138 records). [2025-10-27T22:15:37.259408] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-27T22:15:37.245232] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:37.270597] [INFO ] [MAIN ] Derivative Progress: 1617/1881 symbols completed. THO took 1.2s. Estimated remaining: 1m 48s. Rate: 147.2 symbols/min [2025-10-27T22:15:37.292680] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:37.572763] [DEBUG] [LOCAL ] THS: Loaded 38419 existing records from primary storage. [2025-10-27T22:15:37.575105] [INFO ] [MAIN ] THS: Loaded 38419 primary data records. [2025-10-27T22:15:37.583491] [INFO ] [MAIN ] THQ: Generated 138 derivative records from 25164 primary records. [2025-10-27T22:15:37.590938] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-27T22:15:37.672247] [DEBUG] [LOCAL ] THQ: Derivative data saved (138 records). [2025-10-27T22:15:37.677814] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-27T22:15:37.686540] [INFO ] [MAIN ] Derivative Progress: 1618/1881 symbols completed. THQ took 1.2s. Estimated remaining: 1m 47s. Rate: 147.2 symbols/min [2025-10-27T22:15:37.715855] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:37.941119] [INFO ] [MAIN ] THR: Generated 138 derivative records from 19280 primary records. [2025-10-27T22:15:37.941325] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-27T22:15:37.955354] [DEBUG] [LOCAL ] THR: Derivative data saved (138 records). [2025-10-27T22:15:37.955504] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-27T22:15:37.957790] [INFO ] [MAIN ] Derivative Progress: 1619/1881 symbols completed. THR took 0.8s. Estimated remaining: 1m 47s. Rate: 147.3 symbols/min [2025-10-27T22:15:37.974530] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:37.999528] [INFO ] [MAIN ] THS: Generated 138 derivative records from 38419 primary records. [2025-10-27T22:15:37.999621] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-27T22:15:38.011334] [DEBUG] [LOCAL ] THS: Derivative data saved (138 records). [2025-10-27T22:15:38.011389] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-27T22:15:38.013700] [INFO ] [MAIN ] Derivative Progress: 1620/1881 symbols completed. THS took 0.7s. Estimated remaining: 1m 46s. Rate: 147.3 symbols/min [2025-10-27T22:15:38.014073] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:38.014211] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:38.014426] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:38.020006] [DEBUG] [LOCAL ] TISI: Loaded 3125 existing records from primary storage. [2025-10-27T22:15:38.020235] [INFO ] [MAIN ] TISI: Loaded 3125 primary data records. [2025-10-27T22:15:38.357324] [DEBUG] [LOCAL ] THW: Loaded 19443 existing records from primary storage. [2025-10-27T22:15:38.368040] [INFO ] [MAIN ] THW: Loaded 19443 primary data records. [2025-10-27T22:15:38.368697] [DEBUG] [LOCAL ] TIMB: Loaded 34400 existing records from primary storage. [2025-10-27T22:15:38.381200] [INFO ] [MAIN ] TIMB: Loaded 34400 primary data records. [2025-10-27T22:15:38.998703] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:39.044972] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:39.083102] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:39.106469] [INFO ] [MAIN ] TISI: Generated 138 derivative records from 3125 primary records. [2025-10-27T22:15:39.111723] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-27T22:15:39.125187] [DEBUG] [LOCAL ] TISI: Derivative data saved (138 records). [2025-10-27T22:15:39.128221] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-27T22:15:39.132871] [INFO ] [MAIN ] Derivative Progress: 1621/1881 symbols completed. TISI took 1.1s. Estimated remaining: 1m 46s. Rate: 147.2 symbols/min [2025-10-27T22:15:39.133067] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:39.146975] [INFO ] [MAIN ] THW: Generated 138 derivative records from 19443 primary records. [2025-10-27T22:15:39.147397] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-27T22:15:39.164067] [DEBUG] [LOCAL ] THW: Derivative data saved (138 records). [2025-10-27T22:15:39.166209] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-27T22:15:39.166554] [INFO ] [MAIN ] TIMB: Generated 138 derivative records from 34400 primary records. [2025-10-27T22:15:39.169083] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-27T22:15:39.169006] [INFO ] [MAIN ] Derivative Progress: 1622/1881 symbols completed. THW took 1.2s. Estimated remaining: 1m 46s. Rate: 147.3 symbols/min [2025-10-27T22:15:39.177100] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:39.189948] [DEBUG] [LOCAL ] TIMB: Derivative data saved (138 records). [2025-10-27T22:15:39.190178] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-27T22:15:39.192542] [INFO ] [MAIN ] Derivative Progress: 1623/1881 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 45s. Rate: 147.3 symbols/min [2025-10-27T22:15:39.193270] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:39.203160] [DEBUG] [LOCAL ] TIXT: Loaded 32397 existing records from primary storage. [2025-10-27T22:15:39.203529] [INFO ] [MAIN ] TIXT: Loaded 32397 primary data records. [2025-10-27T22:15:39.543351] [DEBUG] [LOCAL ] TK: Loaded 38751 existing records from primary storage. [2025-10-27T22:15:39.556717] [INFO ] [MAIN ] TK: Loaded 38751 primary data records. [2025-10-27T22:15:39.596234] [DEBUG] [LOCAL ] TJX: Loaded 53660 existing records from primary storage. [2025-10-27T22:15:39.614976] [INFO ] [MAIN ] TJX: Loaded 53660 primary data records. [2025-10-27T22:15:40.246382] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:40.311788] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:40.311354] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:40.345529] [INFO ] [MAIN ] TIXT: Generated 138 derivative records from 32397 primary records. [2025-10-27T22:15:40.346616] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-27T22:15:40.364280] [DEBUG] [LOCAL ] TIXT: Derivative data saved (138 records). [2025-10-27T22:15:40.364890] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-27T22:15:40.369686] [INFO ] [MAIN ] Derivative Progress: 1624/1881 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 45s. Rate: 147.2 symbols/min [2025-10-27T22:15:40.369980] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:40.412365] [INFO ] [MAIN ] TK: Generated 138 derivative records from 38751 primary records. [2025-10-27T22:15:40.414582] [INFO ] [MAIN ] TJX: Generated 138 derivative records from 53660 primary records. [2025-10-27T22:15:40.414798] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-27T22:15:40.414882] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-27T22:15:40.437088] [DEBUG] [LOCAL ] TJX: Derivative data saved (138 records). [2025-10-27T22:15:40.448367] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-27T22:15:40.451012] [INFO ] [MAIN ] Derivative Progress: 1625/1881 symbols completed. TJX took 1.3s. Estimated remaining: 1m 44s. Rate: 147.2 symbols/min [2025-10-27T22:15:40.453416] [DEBUG] [LOCAL ] TK: Derivative data saved (138 records). [2025-10-27T22:15:40.453871] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-27T22:15:40.454701] [DEBUG] [LOCAL ] TKC: Loaded 40047 existing records from primary storage. [2025-10-27T22:15:40.453716] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:40.457036] [INFO ] [MAIN ] Derivative Progress: 1626/1881 symbols completed. TK took 1.3s. Estimated remaining: 1m 44s. Rate: 147.3 symbols/min [2025-10-27T22:15:40.454887] [INFO ] [MAIN ] TKC: Loaded 40047 primary data records. [2025-10-27T22:15:40.457310] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:40.783179] [DEBUG] [LOCAL ] TKR: Loaded 38886 existing records from primary storage. [2025-10-27T22:15:40.794379] [INFO ] [MAIN ] TKR: Loaded 38886 primary data records. [2025-10-27T22:15:40.795417] [DEBUG] [LOCAL ] TLK: Loaded 38557 existing records from primary storage. [2025-10-27T22:15:40.795586] [INFO ] [MAIN ] TLK: Loaded 38557 primary data records. [2025-10-27T22:15:41.427726] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:41.492920] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:41.492416] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:41.521045] [INFO ] [MAIN ] TKC: Generated 138 derivative records from 40047 primary records. [2025-10-27T22:15:41.524387] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-27T22:15:41.540886] [DEBUG] [LOCAL ] TKC: Derivative data saved (138 records). [2025-10-27T22:15:41.541041] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-27T22:15:41.543391] [INFO ] [MAIN ] Derivative Progress: 1627/1881 symbols completed. TKC took 1.2s. Estimated remaining: 1m 44s. Rate: 147.2 symbols/min [2025-10-27T22:15:41.547762] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:41.583078] [DEBUG] [LOCAL ] TLYS: Loaded 16493 existing records from primary storage. [2025-10-27T22:15:41.583688] [INFO ] [MAIN ] TLYS: Loaded 16493 primary data records. [2025-10-27T22:15:41.606847] [INFO ] [MAIN ] TLK: Generated 138 derivative records from 38557 primary records. [2025-10-27T22:15:41.629891] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-27T22:15:41.670952] [INFO ] [MAIN ] TKR: Generated 138 derivative records from 38886 primary records. [2025-10-27T22:15:41.698927] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-27T22:15:41.703625] [DEBUG] [LOCAL ] TLK: Derivative data saved (138 records). [2025-10-27T22:15:41.703746] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-27T22:15:41.711694] [INFO ] [MAIN ] Derivative Progress: 1628/1881 symbols completed. TLK took 1.3s. Estimated remaining: 1m 43s. Rate: 147.2 symbols/min [2025-10-27T22:15:41.712084] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:41.741171] [DEBUG] [LOCAL ] TKR: Derivative data saved (138 records). [2025-10-27T22:15:41.741295] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-27T22:15:41.778443] [INFO ] [MAIN ] Derivative Progress: 1629/1881 symbols completed. TKR took 1.3s. Estimated remaining: 1m 43s. Rate: 147.3 symbols/min [2025-10-27T22:15:41.868846] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:41.947306] [DEBUG] [LOCAL ] TM: Loaded 35626 existing records from primary storage. [2025-10-27T22:15:41.947769] [INFO ] [MAIN ] TM: Loaded 35626 primary data records. [2025-10-27T22:15:42.010984] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:42.112965] [DEBUG] [LOCAL ] TME: Loaded 53188 existing records from primary storage. [2025-10-27T22:15:42.130034] [INFO ] [MAIN ] TME: Loaded 53188 primary data records. [2025-10-27T22:15:42.677392] [INFO ] [MAIN ] TLYS: Generated 138 derivative records from 16493 primary records. [2025-10-27T22:15:42.678244] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-27T22:15:42.692011] [DEBUG] [LOCAL ] TLYS: Derivative data saved (138 records). [2025-10-27T22:15:42.692178] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-27T22:15:42.694328] [INFO ] [MAIN ] Derivative Progress: 1630/1881 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 42s. Rate: 147.2 symbols/min [2025-10-27T22:15:42.696116] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:42.715932] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:42.778566] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:42.814625] [DEBUG] [LOCAL ] TMHC: Loaded 45655 existing records from primary storage. [2025-10-27T22:15:42.816426] [INFO ] [MAIN ] TMHC: Loaded 45655 primary data records. [2025-10-27T22:15:42.819430] [INFO ] [MAIN ] TM: Generated 138 derivative records from 35626 primary records. [2025-10-27T22:15:42.850729] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-27T22:15:42.938747] [DEBUG] [LOCAL ] TM: Derivative data saved (138 records). [2025-10-27T22:15:42.939306] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-27T22:15:42.948901] [INFO ] [MAIN ] Derivative Progress: 1631/1881 symbols completed. TM took 1.2s. Estimated remaining: 1m 42s. Rate: 147.2 symbols/min [2025-10-27T22:15:42.984500] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:43.157904] [INFO ] [MAIN ] TME: Generated 138 derivative records from 53188 primary records. [2025-10-27T22:15:43.158402] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-27T22:15:43.173698] [DEBUG] [LOCAL ] TME: Derivative data saved (138 records). [2025-10-27T22:15:43.174110] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-27T22:15:43.176887] [INFO ] [MAIN ] Derivative Progress: 1632/1881 symbols completed. TME took 1.3s. Estimated remaining: 1m 41s. Rate: 147.3 symbols/min [2025-10-27T22:15:43.177218] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:43.205292] [DEBUG] [LOCAL ] TNC: Loaded 13730 existing records from primary storage. [2025-10-27T22:15:43.205448] [INFO ] [MAIN ] TNC: Loaded 13730 primary data records. [2025-10-27T22:15:43.331765] [DEBUG] [LOCAL ] TMO: Loaded 52347 existing records from primary storage. [2025-10-27T22:15:43.346304] [INFO ] [MAIN ] TMO: Loaded 52347 primary data records. [2025-10-27T22:15:43.345834] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:43.901778] [INFO ] [MAIN ] TMHC: Generated 138 derivative records from 45655 primary records. [2025-10-27T22:15:43.902349] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-27T22:15:43.917759] [DEBUG] [LOCAL ] TMHC: Derivative data saved (138 records). [2025-10-27T22:15:43.918974] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-27T22:15:43.921839] [INFO ] [MAIN ] Derivative Progress: 1633/1881 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 41s. Rate: 147.2 symbols/min [2025-10-27T22:15:43.935118] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:43.968876] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:44.009944] [INFO ] [MAIN ] TNC: Generated 138 derivative records from 13730 primary records. [2025-10-27T22:15:44.011471] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-27T22:15:44.028987] [DEBUG] [LOCAL ] TNC: Derivative data saved (138 records). [2025-10-27T22:15:44.029071] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-27T22:15:44.031077] [INFO ] [MAIN ] Derivative Progress: 1634/1881 symbols completed. TNC took 0.9s. Estimated remaining: 1m 41s. Rate: 147.3 symbols/min [2025-10-27T22:15:44.031334] [INFO ] [MAIN ] TMO: Generated 138 derivative records from 52347 primary records. [2025-10-27T22:15:44.031622] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-27T22:15:44.043657] [DEBUG] [LOCAL ] TMO: Derivative data saved (138 records). [2025-10-27T22:15:44.043725] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-27T22:15:44.046242] [INFO ] [MAIN ] Derivative Progress: 1635/1881 symbols completed. TMO took 1.1s. Estimated remaining: 1m 40s. Rate: 147.4 symbols/min [2025-10-27T22:15:44.046987] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:44.047092] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:44.046918] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:44.101031] [DEBUG] [LOCAL ] TNET: Loaded 28018 existing records from primary storage. [2025-10-27T22:15:44.101282] [INFO ] [MAIN ] TNET: Loaded 28018 primary data records. [2025-10-27T22:15:44.112975] [DEBUG] [LOCAL ] TNK: Loaded 35154 existing records from primary storage. [2025-10-27T22:15:44.144501] [INFO ] [MAIN ] TNK: Loaded 35154 primary data records. [2025-10-27T22:15:44.306016] [DEBUG] [LOCAL ] TNL: Loaded 41603 existing records from primary storage. [2025-10-27T22:15:44.316866] [INFO ] [MAIN ] TNL: Loaded 41603 primary data records. [2025-10-27T22:15:45.070350] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:45.075669] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:45.124763] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:45.189074] [INFO ] [MAIN ] TNET: Generated 138 derivative records from 28018 primary records. [2025-10-27T22:15:45.191762] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-27T22:15:45.194138] [INFO ] [MAIN ] TNK: Generated 138 derivative records from 35154 primary records. [2025-10-27T22:15:45.194670] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-27T22:15:45.210214] [INFO ] [MAIN ] TNL: Generated 138 derivative records from 41603 primary records. [2025-10-27T22:15:45.209944] [DEBUG] [LOCAL ] TNET: Derivative data saved (138 records). [2025-10-27T22:15:45.210331] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-27T22:15:45.210484] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-27T22:15:45.222441] [DEBUG] [LOCAL ] TNK: Derivative data saved (138 records). [2025-10-27T22:15:45.224234] [INFO ] [MAIN ] Derivative Progress: 1636/1881 symbols completed. TNET took 1.2s. Estimated remaining: 1m 40s. Rate: 147.2 symbols/min [2025-10-27T22:15:45.224728] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-27T22:15:45.225127] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:45.227395] [INFO ] [MAIN ] Derivative Progress: 1637/1881 symbols completed. TNK took 1.2s. Estimated remaining: 1m 39s. Rate: 147.3 symbols/min [2025-10-27T22:15:45.234850] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:45.240371] [DEBUG] [LOCAL ] TNL: Derivative data saved (138 records). [2025-10-27T22:15:45.240772] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-27T22:15:45.243387] [INFO ] [MAIN ] Derivative Progress: 1638/1881 symbols completed. TNL took 1.2s. Estimated remaining: 1m 39s. Rate: 147.4 symbols/min [2025-10-27T22:15:45.243567] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:45.267585] [DEBUG] [LOCAL ] TPB: Loaded 26157 existing records from primary storage. [2025-10-27T22:15:45.267939] [INFO ] [MAIN ] TPB: Loaded 26157 primary data records. [2025-10-27T22:15:45.434113] [DEBUG] [LOCAL ] TOL: Loaded 50340 existing records from primary storage. [2025-10-27T22:15:45.445539] [INFO ] [MAIN ] TOL: Loaded 50340 primary data records. [2025-10-27T22:15:45.445426] [DEBUG] [LOCAL ] TPC: Loaded 38966 existing records from primary storage. [2025-10-27T22:15:45.481115] [INFO ] [MAIN ] TPC: Loaded 38966 primary data records. [2025-10-27T22:15:46.298345] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:46.335208] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:46.366799] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:46.410430] [INFO ] [MAIN ] TPB: Generated 138 derivative records from 26157 primary records. [2025-10-27T22:15:46.414390] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-27T22:15:46.430479] [DEBUG] [LOCAL ] TPB: Derivative data saved (138 records). [2025-10-27T22:15:46.431225] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-27T22:15:46.433335] [INFO ] [MAIN ] Derivative Progress: 1639/1881 symbols completed. TPB took 1.2s. Estimated remaining: 1m 39s. Rate: 147.2 symbols/min [2025-10-27T22:15:46.433530] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:46.438585] [INFO ] [MAIN ] TOL: Generated 138 derivative records from 50340 primary records. [2025-10-27T22:15:46.439127] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-27T22:15:46.456441] [DEBUG] [LOCAL ] TOL: Derivative data saved (138 records). [2025-10-27T22:15:46.456985] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-27T22:15:46.459165] [INFO ] [MAIN ] Derivative Progress: 1640/1881 symbols completed. TOL took 1.2s. Estimated remaining: 1m 38s. Rate: 147.3 symbols/min [2025-10-27T22:15:46.461719] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:46.461594] [INFO ] [MAIN ] TPC: Generated 138 derivative records from 38966 primary records. [2025-10-27T22:15:46.461873] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-27T22:15:46.475426] [DEBUG] [LOCAL ] TPC: Derivative data saved (138 records). [2025-10-27T22:15:46.478103] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-27T22:15:46.480705] [INFO ] [MAIN ] Derivative Progress: 1641/1881 symbols completed. TPC took 1.2s. Estimated remaining: 1m 38s. Rate: 147.4 symbols/min [2025-10-27T22:15:46.489935] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:46.496259] [DEBUG] [LOCAL ] TPL: Loaded 11859 existing records from primary storage. [2025-10-27T22:15:46.496379] [INFO ] [MAIN ] TPL: Loaded 11859 primary data records. [2025-10-27T22:15:46.596728] [DEBUG] [LOCAL ] TPH: Loaded 44729 existing records from primary storage. [2025-10-27T22:15:46.614045] [INFO ] [MAIN ] TPH: Loaded 44729 primary data records. [2025-10-27T22:15:47.052058] [DEBUG] [LOCAL ] TPR: Loaded 53347 existing records from primary storage. [2025-10-27T22:15:47.157019] [INFO ] [MAIN ] TPR: Loaded 53347 primary data records. [2025-10-27T22:15:47.498610] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:47.528343] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:47.591255] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:47.611219] [INFO ] [MAIN ] TPL: Generated 138 derivative records from 11859 primary records. [2025-10-27T22:15:47.613727] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-27T22:15:47.628905] [DEBUG] [LOCAL ] TPL: Derivative data saved (138 records). [2025-10-27T22:15:47.629711] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-27T22:15:47.634154] [INFO ] [MAIN ] Derivative Progress: 1642/1881 symbols completed. TPL took 1.2s. Estimated remaining: 1m 37s. Rate: 147.2 symbols/min [2025-10-27T22:15:47.634702] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:47.638248] [INFO ] [MAIN ] TPH: Generated 138 derivative records from 44729 primary records. [2025-10-27T22:15:47.638439] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-27T22:15:47.653985] [DEBUG] [LOCAL ] TPH: Derivative data saved (138 records). [2025-10-27T22:15:47.654885] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-27T22:15:47.657081] [INFO ] [MAIN ] Derivative Progress: 1643/1881 symbols completed. TPH took 1.2s. Estimated remaining: 1m 37s. Rate: 147.3 symbols/min [2025-10-27T22:15:47.657913] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:47.678225] [INFO ] [MAIN ] TPR: Generated 138 derivative records from 53347 primary records. [2025-10-27T22:15:47.678498] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-27T22:15:47.682839] [DEBUG] [LOCAL ] TPYP: Loaded 7719 existing records from primary storage. [2025-10-27T22:15:47.691566] [DEBUG] [LOCAL ] TPVG: Loaded 26721 existing records from primary storage. [2025-10-27T22:15:47.700875] [INFO ] [MAIN ] TPYP: Loaded 7719 primary data records. [2025-10-27T22:15:47.700804] [INFO ] [MAIN ] TPVG: Loaded 26721 primary data records. [2025-10-27T22:15:47.709131] [DEBUG] [LOCAL ] TPR: Derivative data saved (138 records). [2025-10-27T22:15:47.715485] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-27T22:15:47.718006] [INFO ] [MAIN ] Derivative Progress: 1644/1881 symbols completed. TPR took 1.2s. Estimated remaining: 1m 37s. Rate: 147.4 symbols/min [2025-10-27T22:15:47.729259] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:47.903180] [DEBUG] [LOCAL ] TPZ: Loaded 4527 existing records from primary storage. [2025-10-27T22:15:47.924566] [INFO ] [MAIN ] TPZ: Loaded 4527 primary data records. [2025-10-27T22:15:48.685836] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:48.714523] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:48.744161] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:15:48.812155] [INFO ] [MAIN ] TPVG: Generated 138 derivative records from 26721 primary records. [2025-10-27T22:15:48.814818] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-27T22:15:48.816838] [INFO ] [MAIN ] TPYP: Generated 138 derivative records from 7719 primary records. [2025-10-27T22:15:48.817762] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-27T22:15:48.838243] [DEBUG] [LOCAL ] TPVG: Derivative data saved (138 records). [2025-10-27T22:15:48.840367] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-27T22:15:48.842968] [DEBUG] [LOCAL ] TPYP: Derivative data saved (138 records). [2025-10-27T22:15:48.846751] [INFO ] [MAIN ] Derivative Progress: 1645/1881 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 36s. Rate: 147.2 symbols/min [2025-10-27T22:15:48.847415] [INFO ] [MAIN ] TPZ: Generated 138 derivative records from 4527 primary records. [2025-10-27T22:15:48.847678] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:48.847878] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-27T22:15:48.847499] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-27T22:15:48.857205] [INFO ] [MAIN ] Derivative Progress: 1646/1881 symbols completed. TPYP took 1.2s. Estimated remaining: 1m 36s. Rate: 147.3 symbols/min [2025-10-27T22:15:48.857492] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:48.861848] [DEBUG] [LOCAL ] TPZ: Derivative data saved (138 records). [2025-10-27T22:15:48.862378] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-27T22:15:48.865412] [INFO ] [MAIN ] Derivative Progress: 1647/1881 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 35s. Rate: 147.4 symbols/min [2025-10-27T22:15:48.865756] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:48.882481] [DEBUG] [LOCAL ] TRAK: Loaded 9359 existing records from primary storage. [2025-10-27T22:15:48.882748] [INFO ] [MAIN ] TRAK: Loaded 9359 primary data records. [2025-10-27T22:15:48.920363] [DEBUG] [LOCAL ] TR: Loaded 19336 existing records from primary storage. [2025-10-27T22:15:48.937722] [INFO ] [MAIN ] TR: Loaded 19336 primary data records. [2025-10-27T22:15:48.930738] [DEBUG] [LOCAL ] TRC: Loaded 15063 existing records from primary storage. [2025-10-27T22:15:48.949900] [INFO ] [MAIN ] TRC: Loaded 15063 primary data records. [2025-10-27T22:15:49.826074] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:49.863151] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:49.894888] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:49.940814] [INFO ] [MAIN ] TRAK: Generated 138 derivative records from 9359 primary records. [2025-10-27T22:15:49.942475] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-27T22:15:49.961333] [DEBUG] [LOCAL ] TRAK: Derivative data saved (138 records). [2025-10-27T22:15:49.965297] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-27T22:15:49.967667] [INFO ] [MAIN ] Derivative Progress: 1648/1881 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 35s. Rate: 147.2 symbols/min [2025-10-27T22:15:49.972665] [INFO ] [MAIN ] TR: Generated 138 derivative records from 19336 primary records. [2025-10-27T22:15:49.972866] [INFO ] [MAIN ] TRC: Generated 138 derivative records from 15063 primary records. [2025-10-27T22:15:49.973011] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-27T22:15:49.972965] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-27T22:15:49.994330] [DEBUG] [LOCAL ] TRC: Derivative data saved (138 records). [2025-10-27T22:15:49.994591] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-27T22:15:49.997448] [INFO ] [MAIN ] Derivative Progress: 1649/1881 symbols completed. TRC took 1.1s. Estimated remaining: 1m 35s. Rate: 147.3 symbols/min [2025-10-27T22:15:49.999545] [DEBUG] [LOCAL ] TR: Derivative data saved (138 records). [2025-10-27T22:15:49.999623] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-27T22:15:50.002678] [INFO ] [MAIN ] Derivative Progress: 1650/1881 symbols completed. TR took 1.2s. Estimated remaining: 1m 34s. Rate: 147.4 symbols/min [2025-10-27T22:15:50.003200] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:50.003143] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:50.003626] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:50.061519] [DEBUG] [LOCAL ] TRN: Loaded 35831 existing records from primary storage. [2025-10-27T22:15:50.062304] [INFO ] [MAIN ] TRN: Loaded 35831 primary data records. [2025-10-27T22:15:50.153559] [DEBUG] [LOCAL ] TREX: Loaded 49725 existing records from primary storage. [2025-10-27T22:15:50.182638] [INFO ] [MAIN ] TREX: Loaded 49725 primary data records. [2025-10-27T22:15:50.214901] [DEBUG] [LOCAL ] TRGP: Loaded 50616 existing records from primary storage. [2025-10-27T22:15:50.235933] [INFO ] [MAIN ] TRGP: Loaded 50616 primary data records. [2025-10-27T22:15:51.046026] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:51.079718] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:51.112377] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:51.175039] [INFO ] [MAIN ] TRN: Generated 138 derivative records from 35831 primary records. [2025-10-27T22:15:51.178598] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-27T22:15:51.196431] [DEBUG] [LOCAL ] TRN: Derivative data saved (138 records). [2025-10-27T22:15:51.196852] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-27T22:15:51.199731] [INFO ] [MAIN ] Derivative Progress: 1651/1881 symbols completed. TRN took 1.2s. Estimated remaining: 1m 34s. Rate: 147.2 symbols/min [2025-10-27T22:15:51.201920] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:51.201782] [INFO ] [MAIN ] TREX: Generated 138 derivative records from 49725 primary records. [2025-10-27T22:15:51.203329] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-27T22:15:51.205348] [INFO ] [MAIN ] TRGP: Generated 138 derivative records from 50616 primary records. [2025-10-27T22:15:51.205673] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-27T22:15:51.218045] [DEBUG] [LOCAL ] TREX: Derivative data saved (138 records). [2025-10-27T22:15:51.227837] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-27T22:15:51.230539] [INFO ] [MAIN ] Derivative Progress: 1652/1881 symbols completed. TREX took 1.2s. Estimated remaining: 1m 33s. Rate: 147.3 symbols/min [2025-10-27T22:15:51.232012] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:51.233224] [DEBUG] [LOCAL ] TRGP: Derivative data saved (138 records). [2025-10-27T22:15:51.233449] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-27T22:15:51.236863] [INFO ] [MAIN ] Derivative Progress: 1653/1881 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 33s. Rate: 147.4 symbols/min [2025-10-27T22:15:51.237193] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:51.268618] [DEBUG] [LOCAL ] TRNO: Loaded 43285 existing records from primary storage. [2025-10-27T22:15:51.268965] [INFO ] [MAIN ] TRNO: Loaded 43285 primary data records. [2025-10-27T22:15:51.494987] [DEBUG] [LOCAL ] TROX: Loaded 52161 existing records from primary storage. [2025-10-27T22:15:51.614823] [INFO ] [MAIN ] TROX: Loaded 52161 primary data records. [2025-10-27T22:15:51.649683] [DEBUG] [LOCAL ] TRP: Loaded 52114 existing records from primary storage. [2025-10-27T22:15:51.672683] [INFO ] [MAIN ] TRP: Loaded 52114 primary data records. [2025-10-27T22:15:52.245623] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:52.287829] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:52.345880] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:52.348956] [INFO ] [MAIN ] TRNO: Generated 138 derivative records from 43285 primary records. [2025-10-27T22:15:52.362508] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-27T22:15:52.380809] [DEBUG] [LOCAL ] TRNO: Derivative data saved (138 records). [2025-10-27T22:15:52.382846] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-27T22:15:52.387759] [INFO ] [MAIN ] Derivative Progress: 1654/1881 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 33s. Rate: 147.2 symbols/min [2025-10-27T22:15:52.388428] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:52.396733] [INFO ] [MAIN ] TROX: Generated 138 derivative records from 52161 primary records. [2025-10-27T22:15:52.397351] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-27T22:15:52.414752] [DEBUG] [LOCAL ] TROX: Derivative data saved (138 records). [2025-10-27T22:15:52.415143] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-27T22:15:52.417324] [INFO ] [MAIN ] Derivative Progress: 1655/1881 symbols completed. TROX took 1.2s. Estimated remaining: 1m 32s. Rate: 147.3 symbols/min [2025-10-27T22:15:52.417553] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:52.438941] [INFO ] [MAIN ] TRP: Generated 138 derivative records from 52114 primary records. [2025-10-27T22:15:52.439170] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-27T22:15:52.463141] [DEBUG] [LOCAL ] TRP: Derivative data saved (138 records). [2025-10-27T22:15:52.463419] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-27T22:15:52.466043] [INFO ] [MAIN ] Derivative Progress: 1656/1881 symbols completed. TRP took 1.2s. Estimated remaining: 1m 32s. Rate: 147.4 symbols/min [2025-10-27T22:15:52.467147] [DEBUG] [LOCAL ] TRTX: Loaded 36394 existing records from primary storage. [2025-10-27T22:15:52.467557] [INFO ] [MAIN ] TRTX: Loaded 36394 primary data records. [2025-10-27T22:15:52.467373] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:52.801412] [DEBUG] [LOCAL ] TRU: Loaded 51446 existing records from primary storage. [2025-10-27T22:15:52.836816] [INFO ] [MAIN ] TRU: Loaded 51446 primary data records. [2025-10-27T22:15:52.944912] [DEBUG] [LOCAL ] TRV: Loaded 47439 existing records from primary storage. [2025-10-27T22:15:52.961200] [INFO ] [MAIN ] TRV: Loaded 47439 primary data records. [2025-10-27T22:15:53.488419] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:53.533103] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:53.580080] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:53.599048] [INFO ] [MAIN ] TRTX: Generated 138 derivative records from 36394 primary records. [2025-10-27T22:15:53.599935] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-27T22:15:53.624863] [DEBUG] [LOCAL ] TRTX: Derivative data saved (138 records). [2025-10-27T22:15:53.629892] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-27T22:15:53.634463] [INFO ] [MAIN ] Derivative Progress: 1657/1881 symbols completed. TRTX took 1.2s. Estimated remaining: 1m 31s. Rate: 147.2 symbols/min [2025-10-27T22:15:53.635169] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:53.648029] [INFO ] [MAIN ] TRU: Generated 138 derivative records from 51446 primary records. [2025-10-27T22:15:53.648354] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-27T22:15:53.665221] [DEBUG] [LOCAL ] TRU: Derivative data saved (138 records). [2025-10-27T22:15:53.667166] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-27T22:15:53.669971] [INFO ] [MAIN ] Derivative Progress: 1658/1881 symbols completed. TRU took 1.3s. Estimated remaining: 1m 31s. Rate: 147.3 symbols/min [2025-10-27T22:15:53.667325] [INFO ] [MAIN ] TRV: Generated 138 derivative records from 47439 primary records. [2025-10-27T22:15:53.670202] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:53.670511] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-27T22:15:53.698199] [DEBUG] [LOCAL ] TRV: Derivative data saved (138 records). [2025-10-27T22:15:53.698357] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-27T22:15:53.701717] [INFO ] [MAIN ] Derivative Progress: 1659/1881 symbols completed. TRV took 1.2s. Estimated remaining: 1m 30s. Rate: 147.4 symbols/min [2025-10-27T22:15:53.701975] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:53.717763] [DEBUG] [LOCAL ] TSI: Loaded 7984 existing records from primary storage. [2025-10-27T22:15:53.726844] [INFO ] [MAIN ] TSI: Loaded 7984 primary data records. [2025-10-27T22:15:53.748009] [DEBUG] [LOCAL ] TSE: Loaded 27721 existing records from primary storage. [2025-10-27T22:15:53.758423] [INFO ] [MAIN ] TSE: Loaded 27721 primary data records. [2025-10-27T22:15:53.862279] [DEBUG] [LOCAL ] TS: Loaded 51624 existing records from primary storage. [2025-10-27T22:15:53.925374] [INFO ] [MAIN ] TS: Loaded 51624 primary data records. [2025-10-27T22:15:54.717071] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:54.755421] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:54.774172] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:54.832507] [INFO ] [MAIN ] TSI: Generated 138 derivative records from 7984 primary records. [2025-10-27T22:15:54.832624] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-27T22:15:54.839717] [INFO ] [MAIN ] TS: Generated 138 derivative records from 51624 primary records. [2025-10-27T22:15:54.839822] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-27T22:15:54.849855] [DEBUG] [LOCAL ] TSI: Derivative data saved (138 records). [2025-10-27T22:15:54.849947] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-27T22:15:54.852132] [INFO ] [MAIN ] Derivative Progress: 1660/1881 symbols completed. TSI took 1.2s. Estimated remaining: 1m 30s. Rate: 147.2 symbols/min [2025-10-27T22:15:54.864806] [INFO ] [MAIN ] TSE: Generated 138 derivative records from 27721 primary records. [2025-10-27T22:15:54.865077] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-27T22:15:54.860710] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:54.866281] [DEBUG] [LOCAL ] TS: Derivative data saved (138 records). [2025-10-27T22:15:54.866441] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-27T22:15:54.869613] [INFO ] [MAIN ] Derivative Progress: 1661/1881 symbols completed. TS took 1.2s. Estimated remaining: 1m 30s. Rate: 147.3 symbols/min [2025-10-27T22:15:54.878550] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:54.882210] [DEBUG] [LOCAL ] TSE: Derivative data saved (138 records). [2025-10-27T22:15:54.882410] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-27T22:15:54.884960] [INFO ] [MAIN ] Derivative Progress: 1662/1881 symbols completed. TSE took 1.2s. Estimated remaining: 1m 29s. Rate: 147.4 symbols/min [2025-10-27T22:15:54.885138] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:54.926332] [DEBUG] [LOCAL ] TSLX: Loaded 35550 existing records from primary storage. [2025-10-27T22:15:54.926574] [INFO ] [MAIN ] TSLX: Loaded 35550 primary data records. [2025-10-27T22:15:55.110223] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-27T22:15:55.110378] [INFO ] [MAIN ] TSN: Loaded 53088 primary data records. [2025-10-27T22:15:55.081080] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-27T22:15:55.110498] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-27T22:15:55.868581] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:55.911419] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:55.939139] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:55.987175] [INFO ] [MAIN ] TSLX: Generated 138 derivative records from 35550 primary records. [2025-10-27T22:15:55.987618] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-27T22:15:56.008043] [DEBUG] [LOCAL ] TSLX: Derivative data saved (138 records). [2025-10-27T22:15:56.008627] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-27T22:15:56.010556] [INFO ] [MAIN ] Derivative Progress: 1663/1881 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 29s. Rate: 147.2 symbols/min [2025-10-27T22:15:56.016830] [INFO ] [MAIN ] TSN: Generated 138 derivative records from 53088 primary records. [2025-10-27T22:15:56.017664] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-27T22:15:56.029867] [INFO ] [MAIN ] TSM: Generated 138 derivative records from 53819 primary records. [2025-10-27T22:15:56.030569] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-27T22:15:56.031758] [DEBUG] [LOCAL ] TSN: Derivative data saved (138 records). [2025-10-27T22:15:56.031962] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-27T22:15:56.041535] [INFO ] [MAIN ] Derivative Progress: 1664/1881 symbols completed. TSN took 1.2s. Estimated remaining: 1m 28s. Rate: 147.3 symbols/min [2025-10-27T22:15:56.045591] [DEBUG] [LOCAL ] TSM: Derivative data saved (138 records). [2025-10-27T22:15:56.045668] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-27T22:15:56.049134] [INFO ] [MAIN ] Derivative Progress: 1665/1881 symbols completed. TSM took 1.2s. Estimated remaining: 1m 28s. Rate: 147.4 symbols/min [2025-10-27T22:15:56.049677] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:56.049611] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:56.049749] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:56.062945] [DEBUG] [LOCAL ] TSQ: Loaded 11751 existing records from primary storage. [2025-10-27T22:15:56.063217] [INFO ] [MAIN ] TSQ: Loaded 11751 primary data records. [2025-10-27T22:15:56.282965] [DEBUG] [LOCAL ] TT: Loaded 46868 existing records from primary storage. [2025-10-27T22:15:56.396034] [INFO ] [MAIN ] TT: Loaded 46868 primary data records. [2025-10-27T22:15:56.397570] [DEBUG] [LOCAL ] TTC: Loaded 41166 existing records from primary storage. [2025-10-27T22:15:56.398139] [INFO ] [MAIN ] TTC: Loaded 41166 primary data records. [2025-10-27T22:15:57.298267] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:57.372373] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:57.429694] [INFO ] [MAIN ] TSQ: Generated 138 derivative records from 11751 primary records. [2025-10-27T22:15:57.433464] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-27T22:15:57.434344] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:57.462777] [DEBUG] [LOCAL ] TSQ: Derivative data saved (138 records). [2025-10-27T22:15:57.467205] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-27T22:15:57.470872] [INFO ] [MAIN ] Derivative Progress: 1666/1881 symbols completed. TSQ took 1.4s. Estimated remaining: 1m 28s. Rate: 147.2 symbols/min [2025-10-27T22:15:57.473354] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:57.516995] [INFO ] [MAIN ] TT: Generated 138 derivative records from 46868 primary records. [2025-10-27T22:15:57.517594] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-27T22:15:57.521511] [INFO ] [MAIN ] TTC: Generated 138 derivative records from 41166 primary records. [2025-10-27T22:15:57.533670] [DEBUG] [LOCAL ] TT: Derivative data saved (138 records). [2025-10-27T22:15:57.534003] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-27T22:15:57.536561] [INFO ] [MAIN ] Derivative Progress: 1667/1881 symbols completed. TT took 1.5s. Estimated remaining: 1m 27s. Rate: 147.3 symbols/min [2025-10-27T22:15:57.533932] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-27T22:15:57.555854] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:57.571914] [DEBUG] [LOCAL ] TTC: Derivative data saved (138 records). [2025-10-27T22:15:57.572261] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-27T22:15:57.575429] [INFO ] [MAIN ] Derivative Progress: 1668/1881 symbols completed. TTC took 1.5s. Estimated remaining: 1m 27s. Rate: 147.3 symbols/min [2025-10-27T22:15:57.575861] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:57.602264] [DEBUG] [LOCAL ] TTE: Loaded 51464 existing records from primary storage. [2025-10-27T22:15:57.602705] [INFO ] [MAIN ] TTE: Loaded 51464 primary data records. [2025-10-27T22:15:57.812340] [DEBUG] [LOCAL ] TTI: Loaded 46694 existing records from primary storage. [2025-10-27T22:15:57.847538] [INFO ] [MAIN ] TTI: Loaded 46694 primary data records. [2025-10-27T22:15:58.062877] [DEBUG] [LOCAL ] TU: Loaded 49690 existing records from primary storage. [2025-10-27T22:15:58.084818] [INFO ] [MAIN ] TU: Loaded 49690 primary data records. [2025-10-27T22:15:58.657895] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:58.715540] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:58.749968] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:58.782418] [INFO ] [MAIN ] TTE: Generated 138 derivative records from 51464 primary records. [2025-10-27T22:15:58.787893] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-27T22:15:58.815371] [DEBUG] [LOCAL ] TTE: Derivative data saved (138 records). [2025-10-27T22:15:58.820906] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-27T22:15:58.823948] [INFO ] [MAIN ] Derivative Progress: 1669/1881 symbols completed. TTE took 1.4s. Estimated remaining: 1m 26s. Rate: 147.2 symbols/min [2025-10-27T22:15:58.826038] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:58.840352] [INFO ] [MAIN ] TTI: Generated 138 derivative records from 46694 primary records. [2025-10-27T22:15:58.842507] [INFO ] [MAIN ] TU: Generated 138 derivative records from 49690 primary records. [2025-10-27T22:15:58.842798] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-27T22:15:58.842899] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-27T22:15:58.869385] [DEBUG] [LOCAL ] TU: Derivative data saved (138 records). [2025-10-27T22:15:58.869917] [DEBUG] [LOCAL ] TTI: Derivative data saved (138 records). [2025-10-27T22:15:58.870196] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-27T22:15:58.870262] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-27T22:15:58.873802] [INFO ] [MAIN ] Derivative Progress: 1670/1881 symbols completed. TU took 1.3s. Estimated remaining: 1m 26s. Rate: 147.2 symbols/min [2025-10-27T22:15:58.885940] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:58.886320] [INFO ] [MAIN ] Derivative Progress: 1671/1881 symbols completed. TTI took 1.3s. Estimated remaining: 1m 26s. Rate: 147.3 symbols/min [2025-10-27T22:15:58.886828] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:15:58.894720] [DEBUG] [LOCAL ] TVC: Loaded 3032 existing records from primary storage. [2025-10-27T22:15:58.906705] [INFO ] [MAIN ] TVC: Loaded 3032 primary data records. [2025-10-27T22:15:58.931101] [DEBUG] [LOCAL ] TUYA: Loaded 45538 existing records from primary storage. [2025-10-27T22:15:58.947605] [INFO ] [MAIN ] TUYA: Loaded 45538 primary data records. [2025-10-27T22:15:59.252582] [DEBUG] [LOCAL ] TV: Loaded 41039 existing records from primary storage. [2025-10-27T22:15:59.373029] [INFO ] [MAIN ] TV: Loaded 41039 primary data records. [2025-10-27T22:15:59.936381] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:15:59.961092] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:00.012408] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:00.061943] [INFO ] [MAIN ] TVC: Generated 138 derivative records from 3032 primary records. [2025-10-27T22:16:00.063598] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-27T22:16:00.082077] [DEBUG] [LOCAL ] TVC: Derivative data saved (138 records). [2025-10-27T22:16:00.085491] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-27T22:16:00.087601] [INFO ] [MAIN ] Derivative Progress: 1672/1881 symbols completed. TVC took 1.2s. Estimated remaining: 1m 25s. Rate: 147.1 symbols/min [2025-10-27T22:16:00.090598] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:00.093953] [INFO ] [MAIN ] TUYA: Generated 138 derivative records from 45538 primary records. [2025-10-27T22:16:00.094927] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-27T22:16:00.110992] [INFO ] [MAIN ] TV: Generated 138 derivative records from 41039 primary records. [2025-10-27T22:16:00.112613] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-27T22:16:00.115105] [DEBUG] [LOCAL ] TVE: Loaded 2496 existing records from primary storage. [2025-10-27T22:16:00.117178] [INFO ] [MAIN ] TVE: Loaded 2496 primary data records. [2025-10-27T22:16:00.196082] [DEBUG] [LOCAL ] TV: Derivative data saved (138 records). [2025-10-27T22:16:00.209609] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-27T22:16:00.209495] [DEBUG] [LOCAL ] TUYA: Derivative data saved (138 records). [2025-10-27T22:16:00.220146] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-27T22:16:00.229277] [INFO ] [MAIN ] Derivative Progress: 1673/1881 symbols completed. TV took 1.3s. Estimated remaining: 1m 25s. Rate: 147.2 symbols/min [2025-10-27T22:16:00.249199] [INFO ] [MAIN ] Derivative Progress: 1674/1881 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 24s. Rate: 147.3 symbols/min [2025-10-27T22:16:00.243850] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:00.259805] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:00.478975] [DEBUG] [LOCAL ] TWI: Loaded 33404 existing records from primary storage. [2025-10-27T22:16:00.479316] [INFO ] [MAIN ] TWI: Loaded 33404 primary data records. [2025-10-27T22:16:00.639509] [DEBUG] [LOCAL ] TWLO: Loaded 52754 existing records from primary storage. [2025-10-27T22:16:00.674401] [INFO ] [MAIN ] TWLO: Loaded 52754 primary data records. [2025-10-27T22:16:00.674275] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:16:01.199138] [INFO ] [MAIN ] TVE: Generated 138 derivative records from 2496 primary records. [2025-10-27T22:16:01.199934] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-27T22:16:01.223805] [DEBUG] [LOCAL ] TVE: Derivative data saved (138 records). [2025-10-27T22:16:01.221531] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:01.224016] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-27T22:16:01.237909] [INFO ] [MAIN ] Derivative Progress: 1675/1881 symbols completed. TVE took 1.1s. Estimated remaining: 1m 24s. Rate: 147.2 symbols/min [2025-10-27T22:16:01.243023] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:01.264633] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:01.267145] [DEBUG] [LOCAL ] TWN: Loaded 3112 existing records from primary storage. [2025-10-27T22:16:01.283988] [INFO ] [MAIN ] TWN: Loaded 3112 primary data records. [2025-10-27T22:16:01.676902] [INFO ] [MAIN ] TWI: Generated 138 derivative records from 33404 primary records. [2025-10-27T22:16:01.679917] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-27T22:16:01.708392] [INFO ] [MAIN ] TWLO: Generated 138 derivative records from 52754 primary records. [2025-10-27T22:16:01.709470] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-27T22:16:01.710208] [DEBUG] [LOCAL ] TWI: Derivative data saved (138 records). [2025-10-27T22:16:01.710468] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-27T22:16:01.722237] [INFO ] [MAIN ] Derivative Progress: 1676/1881 symbols completed. TWI took 1.5s. Estimated remaining: 1m 24s. Rate: 147.1 symbols/min [2025-10-27T22:16:01.725661] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:01.725298] [DEBUG] [LOCAL ] TWLO: Derivative data saved (138 records). [2025-10-27T22:16:01.728949] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-27T22:16:01.731874] [INFO ] [MAIN ] Derivative Progress: 1677/1881 symbols completed. TWLO took 1.5s. Estimated remaining: 1m 23s. Rate: 147.2 symbols/min [2025-10-27T22:16:01.732680] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:01.752608] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:01.804115] [DEBUG] [LOCAL ] TX: Loaded 22740 existing records from primary storage. [2025-10-27T22:16:01.804693] [INFO ] [MAIN ] TX: Loaded 22740 primary data records. [2025-10-27T22:16:01.929750] [DEBUG] [LOCAL ] TWO: Loaded 48411 existing records from primary storage. [2025-10-27T22:16:01.930307] [INFO ] [MAIN ] TWO: Loaded 48411 primary data records. [2025-10-27T22:16:02.080410] [INFO ] [MAIN ] TWN: Generated 138 derivative records from 3112 primary records. [2025-10-27T22:16:02.227629] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-27T22:16:02.289297] [DEBUG] [LOCAL ] TWN: Derivative data saved (138 records). [2025-10-27T22:16:02.289493] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-27T22:16:02.291695] [INFO ] [MAIN ] Derivative Progress: 1678/1881 symbols completed. TWN took 1.0s. Estimated remaining: 1m 23s. Rate: 147.2 symbols/min [2025-10-27T22:16:02.535678] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:02.571841] [INFO ] [MAIN ] TX: Generated 138 derivative records from 22740 primary records. [2025-10-27T22:16:02.572769] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-27T22:16:02.597754] [DEBUG] [LOCAL ] TX: Derivative data saved (138 records). [2025-10-27T22:16:02.598029] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-27T22:16:02.600067] [INFO ] [MAIN ] Derivative Progress: 1679/1881 symbols completed. TX took 0.9s. Estimated remaining: 1m 22s. Rate: 147.2 symbols/min [2025-10-27T22:16:02.600575] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:02.629587] [INFO ] [MAIN ] TWO: Generated 138 derivative records from 48411 primary records. [2025-10-27T22:16:02.629760] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-27T22:16:02.642309] [DEBUG] [LOCAL ] TWO: Derivative data saved (138 records). [2025-10-27T22:16:02.642441] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-27T22:16:02.645119] [INFO ] [MAIN ] Derivative Progress: 1680/1881 symbols completed. TWO took 0.9s. Estimated remaining: 1m 22s. Rate: 147.3 symbols/min [2025-10-27T22:16:02.645521] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:02.645703] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:02.645942] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:02.667676] [DEBUG] [LOCAL ] TXO: Loaded 19924 existing records from primary storage. [2025-10-27T22:16:02.667958] [INFO ] [MAIN ] TXO: Loaded 19924 primary data records. [2025-10-27T22:16:02.835290] [DEBUG] [LOCAL ] TXNM: Loaded 42554 existing records from primary storage. [2025-10-27T22:16:02.888399] [INFO ] [MAIN ] TXNM: Loaded 42554 primary data records. [2025-10-27T22:16:03.068791] [DEBUG] [LOCAL ] TXT: Loaded 49510 existing records from primary storage. [2025-10-27T22:16:03.082163] [INFO ] [MAIN ] TXT: Loaded 49510 primary data records. [2025-10-27T22:16:03.753920] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:03.821611] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:03.823411] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:03.855141] [INFO ] [MAIN ] TXO: Generated 138 derivative records from 19924 primary records. [2025-10-27T22:16:03.856155] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-27T22:16:03.878837] [DEBUG] [LOCAL ] TXO: Derivative data saved (138 records). [2025-10-27T22:16:03.879141] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-27T22:16:03.881305] [INFO ] [MAIN ] Derivative Progress: 1681/1881 symbols completed. TXO took 1.2s. Estimated remaining: 1m 22s. Rate: 147.1 symbols/min [2025-10-27T22:16:03.882381] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:03.906134] [DEBUG] [LOCAL ] TY: Loaded 7414 existing records from primary storage. [2025-10-27T22:16:03.908125] [INFO ] [MAIN ] TY: Loaded 7414 primary data records. [2025-10-27T22:16:04.011836] [INFO ] [MAIN ] TXNM: Generated 138 derivative records from 42554 primary records. [2025-10-27T22:16:04.023694] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-27T22:16:04.042154] [INFO ] [MAIN ] TXT: Generated 138 derivative records from 49510 primary records. [2025-10-27T22:16:04.053021] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-27T22:16:04.087187] [DEBUG] [LOCAL ] TXNM: Derivative data saved (138 records). [2025-10-27T22:16:04.087509] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-27T22:16:04.237928] [INFO ] [MAIN ] Derivative Progress: 1682/1881 symbols completed. TXNM took 1.6s. Estimated remaining: 1m 21s. Rate: 147.1 symbols/min [2025-10-27T22:16:04.245395] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:04.259098] [DEBUG] [LOCAL ] TXT: Derivative data saved (138 records). [2025-10-27T22:16:04.259977] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-27T22:16:04.263055] [INFO ] [MAIN ] Derivative Progress: 1683/1881 symbols completed. TXT took 1.6s. Estimated remaining: 1m 21s. Rate: 147.2 symbols/min [2025-10-27T22:16:04.263390] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:04.279203] [DEBUG] [LOCAL ] TYG: Loaded 13708 existing records from primary storage. [2025-10-27T22:16:04.279440] [INFO ] [MAIN ] TYG: Loaded 13708 primary data records. [2025-10-27T22:16:04.396889] [DEBUG] [LOCAL ] TYL: Loaded 21800 existing records from primary storage. [2025-10-27T22:16:04.407735] [INFO ] [MAIN ] TYL: Loaded 21800 primary data records. [2025-10-27T22:16:04.693194] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:04.936192] [INFO ] [MAIN ] TY: Generated 138 derivative records from 7414 primary records. [2025-10-27T22:16:04.937000] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-27T22:16:04.962262] [DEBUG] [LOCAL ] TY: Derivative data saved (138 records). [2025-10-27T22:16:04.962487] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-27T22:16:04.962700] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:04.964983] [INFO ] [MAIN ] Derivative Progress: 1684/1881 symbols completed. TY took 1.1s. Estimated remaining: 1m 20s. Rate: 147.1 symbols/min [2025-10-27T22:16:04.975576] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:04.998262] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:05.069864] [INFO ] [MAIN ] TYG: Generated 138 derivative records from 13708 primary records. [2025-10-27T22:16:05.073783] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-27T22:16:05.075040] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-27T22:16:05.090825] [DEBUG] [LOCAL ] TYG: Derivative data saved (138 records). [2025-10-27T22:16:05.090930] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-27T22:16:05.095276] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-27T22:16:05.093168] [INFO ] [MAIN ] Derivative Progress: 1685/1881 symbols completed. TYG took 0.8s. Estimated remaining: 1m 20s. Rate: 147.2 symbols/min [2025-10-27T22:16:05.106987] [INFO ] [MAIN ] TYL: Generated 138 derivative records from 21800 primary records. [2025-10-27T22:16:05.132162] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-27T22:16:05.107071] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:05.210839] [DEBUG] [LOCAL ] TYL: Derivative data saved (138 records). [2025-10-27T22:16:05.211294] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-27T22:16:05.213802] [INFO ] [MAIN ] Derivative Progress: 1686/1881 symbols completed. TYL took 1.0s. Estimated remaining: 1m 19s. Rate: 147.3 symbols/min [2025-10-27T22:16:05.224431] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:05.441572] [DEBUG] [LOCAL ] UA: Loaded 50395 existing records from primary storage. [2025-10-27T22:16:05.441935] [INFO ] [MAIN ] UA: Loaded 50395 primary data records. [2025-10-27T22:16:05.650119] [DEBUG] [LOCAL ] UAA: Loaded 53496 existing records from primary storage. [2025-10-27T22:16:05.665714] [INFO ] [MAIN ] UAA: Loaded 53496 primary data records. [2025-10-27T22:16:05.825308] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:06.156627] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:06.159024] [INFO ] [MAIN ] U: Generated 138 derivative records from 53799 primary records. [2025-10-27T22:16:06.159141] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-27T22:16:06.185828] [DEBUG] [LOCAL ] U: Derivative data saved (138 records). [2025-10-27T22:16:06.187976] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-27T22:16:06.191959] [INFO ] [MAIN ] Derivative Progress: 1687/1881 symbols completed. U took 1.2s. Estimated remaining: 1m 19s. Rate: 147.1 symbols/min [2025-10-27T22:16:06.192197] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:06.211207] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:06.228056] [DEBUG] [LOCAL ] UAN: Loaded 5101 existing records from primary storage. [2025-10-27T22:16:06.230144] [INFO ] [MAIN ] UAN: Loaded 5101 primary data records. [2025-10-27T22:16:06.548234] [INFO ] [MAIN ] UA: Generated 138 derivative records from 50395 primary records. [2025-10-27T22:16:06.551377] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-27T22:16:06.571137] [DEBUG] [LOCAL ] UA: Derivative data saved (138 records). [2025-10-27T22:16:06.571542] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-27T22:16:06.573693] [INFO ] [MAIN ] Derivative Progress: 1688/1881 symbols completed. UA took 1.5s. Estimated remaining: 1m 19s. Rate: 147.2 symbols/min [2025-10-27T22:16:06.573836] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:06.576853] [INFO ] [MAIN ] UAA: Generated 138 derivative records from 53496 primary records. [2025-10-27T22:16:06.577025] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-27T22:16:06.589630] [DEBUG] [LOCAL ] UAA: Derivative data saved (138 records). [2025-10-27T22:16:06.589938] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-27T22:16:06.592508] [INFO ] [MAIN ] Derivative Progress: 1689/1881 symbols completed. UAA took 1.4s. Estimated remaining: 1m 18s. Rate: 147.2 symbols/min [2025-10-27T22:16:06.592929] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:06.611298] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:06.670668] [INFO ] [MAIN ] UAN: Generated 138 derivative records from 5101 primary records. [2025-10-27T22:16:06.670848] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-27T22:16:06.694759] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-27T22:16:06.696069] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-27T22:16:06.697957] [DEBUG] [LOCAL ] UAN: Derivative data saved (138 records). [2025-10-27T22:16:06.709303] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-27T22:16:06.711380] [INFO ] [MAIN ] Derivative Progress: 1690/1881 symbols completed. UAN took 0.5s. Estimated remaining: 1m 18s. Rate: 147.3 symbols/min [2025-10-27T22:16:06.732616] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:06.798101] [DEBUG] [LOCAL ] UBS: Loaded 52230 existing records from primary storage. [2025-10-27T22:16:06.809425] [INFO ] [MAIN ] UBS: Loaded 52230 primary data records. [2025-10-27T22:16:07.333063] [DEBUG] [LOCAL ] UCB: Loaded 37432 existing records from primary storage. [2025-10-27T22:16:07.333407] [INFO ] [MAIN ] UCB: Loaded 37432 primary data records. [2025-10-27T22:16:07.706208] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:07.737537] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:07.797893] [INFO ] [MAIN ] UBS: Generated 138 derivative records from 52230 primary records. [2025-10-27T22:16:07.798084] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-27T22:16:07.805895] [INFO ] [MAIN ] UBER: Generated 138 derivative records from 53806 primary records. [2025-10-27T22:16:07.811480] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:07.811558] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-27T22:16:07.842474] [DEBUG] [LOCAL ] UBS: Derivative data saved (138 records). [2025-10-27T22:16:07.844091] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-27T22:16:07.850949] [INFO ] [MAIN ] Derivative Progress: 1691/1881 symbols completed. UBS took 1.3s. Estimated remaining: 1m 17s. Rate: 147.1 symbols/min [2025-10-27T22:16:07.848448] [DEBUG] [LOCAL ] UBER: Derivative data saved (138 records). [2025-10-27T22:16:07.851113] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-27T22:16:07.854537] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:07.854603] [INFO ] [MAIN ] Derivative Progress: 1692/1881 symbols completed. UBER took 1.3s. Estimated remaining: 1m 17s. Rate: 147.2 symbols/min [2025-10-27T22:16:07.857468] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:07.873920] [INFO ] [MAIN ] UCB: Generated 138 derivative records from 37432 primary records. [2025-10-27T22:16:07.874227] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-27T22:16:07.886452] [DEBUG] [LOCAL ] UCB: Derivative data saved (138 records). [2025-10-27T22:16:07.886689] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-27T22:16:07.889539] [INFO ] [MAIN ] Derivative Progress: 1693/1881 symbols completed. UCB took 1.2s. Estimated remaining: 1m 17s. Rate: 147.3 symbols/min [2025-10-27T22:16:07.928777] [DEBUG] [LOCAL ] UE: Loaded 42208 existing records from primary storage. [2025-10-27T22:16:07.929312] [INFO ] [MAIN ] UE: Loaded 42208 primary data records. [2025-10-27T22:16:08.011282] [DEBUG] [LOCAL ] UDR: Loaded 52103 existing records from primary storage. [2025-10-27T22:16:08.032453] [INFO ] [MAIN ] UDR: Loaded 52103 primary data records. [2025-10-27T22:16:08.543844] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:08.574507] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:08.613229] [INFO ] [MAIN ] UE: Generated 138 derivative records from 42208 primary records. [2025-10-27T22:16:08.613559] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-27T22:16:08.629758] [INFO ] [MAIN ] UDR: Generated 138 derivative records from 52103 primary records. [2025-10-27T22:16:08.630526] [DEBUG] [LOCAL ] UE: Derivative data saved (138 records). [2025-10-27T22:16:08.630603] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-27T22:16:08.630667] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-27T22:16:08.632796] [INFO ] [MAIN ] Derivative Progress: 1694/1881 symbols completed. UE took 0.8s. Estimated remaining: 1m 16s. Rate: 147.2 symbols/min [2025-10-27T22:16:08.644166] [DEBUG] [LOCAL ] UDR: Derivative data saved (138 records). [2025-10-27T22:16:08.644241] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-27T22:16:08.646872] [INFO ] [MAIN ] Derivative Progress: 1695/1881 symbols completed. UDR took 0.8s. Estimated remaining: 1m 16s. Rate: 147.3 symbols/min [2025-10-27T22:16:08.647301] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:08.647397] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:08.647879] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:08.660003] [DEBUG] [LOCAL ] UFI: Loaded 8077 existing records from primary storage. [2025-10-27T22:16:08.660254] [INFO ] [MAIN ] UFI: Loaded 8077 primary data records. [2025-10-27T22:16:09.023023] [DEBUG] [LOCAL ] UGP: Loaded 43006 existing records from primary storage. [2025-10-27T22:16:09.021576] [DEBUG] [LOCAL ] UGI: Loaded 50326 existing records from primary storage. [2025-10-27T22:16:09.023312] [INFO ] [MAIN ] UGI: Loaded 50326 primary data records. [2025-10-27T22:16:09.023481] [INFO ] [MAIN ] UGP: Loaded 43006 primary data records. [2025-10-27T22:16:09.658125] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:09.758630] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:09.759131] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:09.818245] [INFO ] [MAIN ] UFI: Generated 138 derivative records from 8077 primary records. [2025-10-27T22:16:09.823425] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-27T22:16:09.836794] [DEBUG] [LOCAL ] UFI: Derivative data saved (138 records). [2025-10-27T22:16:09.839223] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-27T22:16:09.844307] [INFO ] [MAIN ] Derivative Progress: 1696/1881 symbols completed. UFI took 1.2s. Estimated remaining: 1m 15s. Rate: 147.2 symbols/min [2025-10-27T22:16:09.844715] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:09.849037] [INFO ] [MAIN ] UGP: Generated 138 derivative records from 43006 primary records. [2025-10-27T22:16:09.850305] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-27T22:16:09.852690] [INFO ] [MAIN ] UGI: Generated 138 derivative records from 50326 primary records. [2025-10-27T22:16:09.852972] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-27T22:16:09.864516] [DEBUG] [LOCAL ] UGP: Derivative data saved (138 records). [2025-10-27T22:16:09.864629] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-27T22:16:09.866761] [INFO ] [MAIN ] Derivative Progress: 1697/1881 symbols completed. UGP took 1.2s. Estimated remaining: 1m 15s. Rate: 147.2 symbols/min [2025-10-27T22:16:09.870965] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:09.888400] [DEBUG] [LOCAL ] UGI: Derivative data saved (138 records). [2025-10-27T22:16:09.888792] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-27T22:16:09.889087] [DEBUG] [LOCAL ] UHAL: Loaded 16733 existing records from primary storage. [2025-10-27T22:16:09.889195] [INFO ] [MAIN ] UHAL: Loaded 16733 primary data records. [2025-10-27T22:16:09.891789] [INFO ] [MAIN ] Derivative Progress: 1698/1881 symbols completed. UGI took 1.2s. Estimated remaining: 1m 15s. Rate: 147.3 symbols/min [2025-10-27T22:16:09.922396] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:10.084916] [DEBUG] [LOCAL ] UHT: Loaded 10135 existing records from primary storage. [2025-10-27T22:16:10.197213] [INFO ] [MAIN ] UHT: Loaded 10135 primary data records. [2025-10-27T22:16:10.271827] [DEBUG] [LOCAL ] UHS: Loaded 39489 existing records from primary storage. [2025-10-27T22:16:10.295160] [INFO ] [MAIN ] UHS: Loaded 39489 primary data records. [2025-10-27T22:16:10.862938] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:10.909374] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:10.932943] [INFO ] [MAIN ] UHAL: Generated 138 derivative records from 16733 primary records. [2025-10-27T22:16:10.933824] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-27T22:16:10.951135] [DEBUG] [LOCAL ] UHAL: Derivative data saved (138 records). [2025-10-27T22:16:10.952994] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-27T22:16:10.955322] [INFO ] [MAIN ] Derivative Progress: 1699/1881 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 14s. Rate: 147.2 symbols/min [2025-10-27T22:16:10.955578] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:10.972297] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:11.003526] [DEBUG] [LOCAL ] UI: Loaded 14183 existing records from primary storage. [2025-10-27T22:16:11.006452] [INFO ] [MAIN ] UI: Loaded 14183 primary data records. [2025-10-27T22:16:11.114855] [INFO ] [MAIN ] UHT: Generated 138 derivative records from 10135 primary records. [2025-10-27T22:16:11.134518] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-27T22:16:11.315513] [DEBUG] [LOCAL ] UHT: Derivative data saved (138 records). [2025-10-27T22:16:11.333253] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-27T22:16:11.335484] [INFO ] [MAIN ] Derivative Progress: 1700/1881 symbols completed. UHT took 1.4s. Estimated remaining: 1m 14s. Rate: 147.2 symbols/min [2025-10-27T22:16:11.337445] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:11.349613] [INFO ] [MAIN ] UHS: Generated 138 derivative records from 39489 primary records. [2025-10-27T22:16:11.349943] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-27T22:16:11.364824] [DEBUG] [LOCAL ] UHS: Derivative data saved (138 records). [2025-10-27T22:16:11.365195] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-27T22:16:11.370178] [INFO ] [MAIN ] Derivative Progress: 1701/1881 symbols completed. UHS took 1.5s. Estimated remaining: 1m 13s. Rate: 147.3 symbols/min [2025-10-27T22:16:11.370767] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:11.414191] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:11.428177] [DEBUG] [LOCAL ] UIS: Loaded 36276 existing records from primary storage. [2025-10-27T22:16:11.428774] [INFO ] [MAIN ] UIS: Loaded 36276 primary data records. [2025-10-27T22:16:11.647981] [DEBUG] [LOCAL ] UL: Loaded 53061 existing records from primary storage. [2025-10-27T22:16:11.653117] [INFO ] [MAIN ] UL: Loaded 53061 primary data records. [2025-10-27T22:16:12.208430] [INFO ] [MAIN ] UI: Generated 138 derivative records from 14183 primary records. [2025-10-27T22:16:12.211700] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-27T22:16:12.239853] [DEBUG] [LOCAL ] UI: Derivative data saved (138 records). [2025-10-27T22:16:12.239968] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-27T22:16:12.242626] [INFO ] [MAIN ] Derivative Progress: 1702/1881 symbols completed. UI took 1.3s. Estimated remaining: 1m 13s. Rate: 147.2 symbols/min [2025-10-27T22:16:12.243172] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:12.244508] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:12.289042] [INFO ] [MAIN ] UIS: Generated 138 derivative records from 36276 primary records. [2025-10-27T22:16:12.302139] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:12.302324] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-27T22:16:12.340578] [DEBUG] [LOCAL ] UIS: Derivative data saved (138 records). [2025-10-27T22:16:12.340872] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-27T22:16:12.343399] [INFO ] [MAIN ] Derivative Progress: 1703/1881 symbols completed. UIS took 1.0s. Estimated remaining: 1m 13s. Rate: 147.2 symbols/min [2025-10-27T22:16:12.343616] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:12.362685] [DEBUG] [LOCAL ] ULS: Loaded 38114 existing records from primary storage. [2025-10-27T22:16:12.363403] [INFO ] [MAIN ] ULS: Loaded 38114 primary data records. [2025-10-27T22:16:12.695624] [INFO ] [MAIN ] UL: Generated 138 derivative records from 53061 primary records. [2025-10-27T22:16:12.695843] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-27T22:16:12.711332] [DEBUG] [LOCAL ] UL: Derivative data saved (138 records). [2025-10-27T22:16:12.711948] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-27T22:16:12.715983] [INFO ] [MAIN ] Derivative Progress: 1704/1881 symbols completed. UL took 1.3s. Estimated remaining: 1m 12s. Rate: 147.2 symbols/min [2025-10-27T22:16:12.716726] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:12.738761] [DEBUG] [LOCAL ] UMC: Loaded 52657 existing records from primary storage. [2025-10-27T22:16:12.738950] [INFO ] [MAIN ] UMC: Loaded 52657 primary data records. [2025-10-27T22:16:13.066103] [DEBUG] [LOCAL ] UMH: Loaded 33938 existing records from primary storage. [2025-10-27T22:16:13.074548] [INFO ] [MAIN ] UMH: Loaded 33938 primary data records. [2025-10-27T22:16:13.101447] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:13.472318] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:13.496787] [INFO ] [MAIN ] ULS: Generated 138 derivative records from 38114 primary records. [2025-10-27T22:16:13.497858] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-27T22:16:13.517076] [DEBUG] [LOCAL ] ULS: Derivative data saved (138 records). [2025-10-27T22:16:13.518545] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-27T22:16:13.521837] [INFO ] [MAIN ] Derivative Progress: 1705/1881 symbols completed. ULS took 1.3s. Estimated remaining: 1m 12s. Rate: 147.1 symbols/min [2025-10-27T22:16:13.524870] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:13.560253] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:13.592828] [DEBUG] [LOCAL ] UNF: Loaded 11817 existing records from primary storage. [2025-10-27T22:16:13.595007] [INFO ] [MAIN ] UNF: Loaded 11817 primary data records. [2025-10-27T22:16:13.592263] [INFO ] [MAIN ] UMC: Generated 138 derivative records from 52657 primary records. [2025-10-27T22:16:13.608485] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-27T22:16:13.732541] [DEBUG] [LOCAL ] UMC: Derivative data saved (138 records). [2025-10-27T22:16:13.737569] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-27T22:16:13.740759] [INFO ] [MAIN ] Derivative Progress: 1706/1881 symbols completed. UMC took 1.4s. Estimated remaining: 1m 11s. Rate: 147.2 symbols/min [2025-10-27T22:16:13.741051] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:13.986366] [INFO ] [MAIN ] UMH: Generated 138 derivative records from 33938 primary records. [2025-10-27T22:16:13.986890] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-27T22:16:14.000187] [DEBUG] [LOCAL ] UMH: Derivative data saved (138 records). [2025-10-27T22:16:14.000625] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-27T22:16:14.014020] [INFO ] [MAIN ] Derivative Progress: 1707/1881 symbols completed. UMH took 1.3s. Estimated remaining: 1m 11s. Rate: 147.2 symbols/min [2025-10-27T22:16:14.015343] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:14.016710] [DEBUG] [LOCAL ] UNFI: Loaded 42417 existing records from primary storage. [2025-10-27T22:16:14.017391] [INFO ] [MAIN ] UNFI: Loaded 42417 primary data records. [2025-10-27T22:16:14.378889] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:14.417626] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-27T22:16:14.417965] [INFO ] [MAIN ] UNH: Loaded 53819 primary data records. [2025-10-27T22:16:14.741511] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:14.762040] [INFO ] [MAIN ] UNF: Generated 138 derivative records from 11817 primary records. [2025-10-27T22:16:14.763401] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-27T22:16:14.784830] [DEBUG] [LOCAL ] UNF: Derivative data saved (138 records). [2025-10-27T22:16:14.785162] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-27T22:16:14.789936] [INFO ] [MAIN ] Derivative Progress: 1708/1881 symbols completed. UNF took 1.3s. Estimated remaining: 1m 11s. Rate: 147.1 symbols/min [2025-10-27T22:16:14.817996] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:14.818273] [INFO ] [MAIN ] UNFI: Generated 138 derivative records from 42417 primary records. [2025-10-27T22:16:14.828675] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-27T22:16:14.844585] [DEBUG] [LOCAL ] UNFI: Derivative data saved (138 records). [2025-10-27T22:16:14.846765] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-27T22:16:14.849702] [INFO ] [MAIN ] Derivative Progress: 1709/1881 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 10s. Rate: 147.2 symbols/min [2025-10-27T22:16:14.860266] [INFO ] [MAIN ] UNH: Generated 138 derivative records from 53819 primary records. [2025-10-27T22:16:14.860339] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-27T22:16:14.872121] [DEBUG] [LOCAL ] UNH: Derivative data saved (138 records). [2025-10-27T22:16:14.872177] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-27T22:16:14.874746] [INFO ] [MAIN ] Derivative Progress: 1710/1881 symbols completed. UNH took 0.9s. Estimated remaining: 1m 10s. Rate: 147.3 symbols/min [2025-10-27T22:16:14.875097] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:14.875204] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:14.875361] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:14.882928] [DEBUG] [LOCAL ] UNMA: Loaded 3362 existing records from primary storage. [2025-10-27T22:16:14.883392] [INFO ] [MAIN ] UNMA: Loaded 3362 primary data records. [2025-10-27T22:16:15.215507] [DEBUG] [LOCAL ] UNM: Loaded 47761 existing records from primary storage. [2025-10-27T22:16:15.231809] [INFO ] [MAIN ] UNM: Loaded 47761 primary data records. [2025-10-27T22:16:15.269016] [DEBUG] [LOCAL ] UNP: Loaded 53359 existing records from primary storage. [2025-10-27T22:16:15.299775] [INFO ] [MAIN ] UNP: Loaded 53359 primary data records. [2025-10-27T22:16:15.561702] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:15.908761] [INFO ] [MAIN ] UNMA: Generated 138 derivative records from 3362 primary records. [2025-10-27T22:16:15.909894] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-27T22:16:15.933174] [DEBUG] [LOCAL ] UNMA: Derivative data saved (138 records). [2025-10-27T22:16:15.933450] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-27T22:16:15.933744] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:15.935989] [INFO ] [MAIN ] Derivative Progress: 1711/1881 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 9s. Rate: 147.2 symbols/min [2025-10-27T22:16:15.936354] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:15.970284] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:16.028851] [DEBUG] [LOCAL ] UP: Loaded 44705 existing records from primary storage. [2025-10-27T22:16:16.029859] [INFO ] [MAIN ] UP: Loaded 44705 primary data records. [2025-10-27T22:16:16.054095] [INFO ] [MAIN ] UNM: Generated 138 derivative records from 47761 primary records. [2025-10-27T22:16:16.054555] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-27T22:16:16.161049] [DEBUG] [LOCAL ] UNM: Derivative data saved (138 records). [2025-10-27T22:16:16.184148] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-27T22:16:16.217080] [INFO ] [MAIN ] UNP: Generated 138 derivative records from 53359 primary records. [2025-10-27T22:16:16.217251] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-27T22:16:16.216556] [INFO ] [MAIN ] Derivative Progress: 1712/1881 symbols completed. UNM took 1.3s. Estimated remaining: 1m 9s. Rate: 147.2 symbols/min [2025-10-27T22:16:16.244339] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:16.410668] [DEBUG] [LOCAL ] UNP: Derivative data saved (138 records). [2025-10-27T22:16:16.411437] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-27T22:16:16.413969] [INFO ] [MAIN ] Derivative Progress: 1713/1881 symbols completed. UNP took 1.5s. Estimated remaining: 1m 8s. Rate: 147.2 symbols/min [2025-10-27T22:16:16.414276] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:16.448253] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:16.486238] [DEBUG] [LOCAL ] URI: Loaded 34205 existing records from primary storage. [2025-10-27T22:16:16.489163] [INFO ] [MAIN ] URI: Loaded 34205 primary data records. [2025-10-27T22:16:16.608397] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-27T22:16:16.619622] [INFO ] [MAIN ] UPS: Loaded 53721 primary data records. [2025-10-27T22:16:17.098897] [INFO ] [MAIN ] UP: Generated 138 derivative records from 44705 primary records. [2025-10-27T22:16:17.121142] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-27T22:16:17.135689] [DEBUG] [LOCAL ] UP: Derivative data saved (138 records). [2025-10-27T22:16:17.136132] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-27T22:16:17.138347] [INFO ] [MAIN ] Derivative Progress: 1714/1881 symbols completed. UP took 1.2s. Estimated remaining: 1m 8s. Rate: 147.2 symbols/min [2025-10-27T22:16:17.138613] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:17.162418] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:17.227411] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:17.229448] [DEBUG] [LOCAL ] USA: Loaded 36172 existing records from primary storage. [2025-10-27T22:16:17.241678] [INFO ] [MAIN ] USA: Loaded 36172 primary data records. [2025-10-27T22:16:17.559510] [INFO ] [MAIN ] URI: Generated 138 derivative records from 34205 primary records. [2025-10-27T22:16:17.568392] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-27T22:16:17.591317] [DEBUG] [LOCAL ] URI: Derivative data saved (138 records). [2025-10-27T22:16:17.592066] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-27T22:16:17.596542] [INFO ] [MAIN ] Derivative Progress: 1715/1881 symbols completed. URI took 1.2s. Estimated remaining: 1m 8s. Rate: 147.1 symbols/min [2025-10-27T22:16:17.597062] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:17.603439] [INFO ] [MAIN ] UPS: Generated 138 derivative records from 53721 primary records. [2025-10-27T22:16:17.603635] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-27T22:16:17.617313] [DEBUG] [LOCAL ] UPS: Derivative data saved (138 records). [2025-10-27T22:16:17.617798] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-27T22:16:17.621726] [INFO ] [MAIN ] Derivative Progress: 1716/1881 symbols completed. UPS took 1.4s. Estimated remaining: 1m 7s. Rate: 147.2 symbols/min [2025-10-27T22:16:17.622554] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:17.640735] [DEBUG] [LOCAL ] USAC: Loaded 21460 existing records from primary storage. [2025-10-27T22:16:17.641045] [INFO ] [MAIN ] USAC: Loaded 21460 primary data records. [2025-10-27T22:16:17.666445] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:18.009075] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-27T22:16:18.011191] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-27T22:16:18.362208] [INFO ] [MAIN ] USA: Generated 138 derivative records from 36172 primary records. [2025-10-27T22:16:18.362367] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-27T22:16:18.375667] [DEBUG] [LOCAL ] USA: Derivative data saved (138 records). [2025-10-27T22:16:18.376417] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-27T22:16:18.378837] [INFO ] [MAIN ] Derivative Progress: 1717/1881 symbols completed. USA took 1.2s. Estimated remaining: 1m 7s. Rate: 147.2 symbols/min [2025-10-27T22:16:18.379402] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:18.397610] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:18.451366] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:18.486040] [DEBUG] [LOCAL ] USFD: Loaded 51030 existing records from primary storage. [2025-10-27T22:16:18.489494] [INFO ] [MAIN ] USFD: Loaded 51030 primary data records. [2025-10-27T22:16:18.503953] [INFO ] [MAIN ] USAC: Generated 138 derivative records from 21460 primary records. [2025-10-27T22:16:18.567917] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-27T22:16:18.612046] [DEBUG] [LOCAL ] USAC: Derivative data saved (138 records). [2025-10-27T22:16:18.625568] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-27T22:16:18.638128] [INFO ] [MAIN ] Derivative Progress: 1718/1881 symbols completed. USAC took 1.0s. Estimated remaining: 1m 6s. Rate: 147.2 symbols/min [2025-10-27T22:16:18.656410] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:18.828980] [INFO ] [MAIN ] USB: Generated 138 derivative records from 53688 primary records. [2025-10-27T22:16:18.829280] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-27T22:16:18.848004] [DEBUG] [LOCAL ] USB: Derivative data saved (138 records). [2025-10-27T22:16:18.848212] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-27T22:16:18.851171] [INFO ] [MAIN ] Derivative Progress: 1719/1881 symbols completed. USB took 1.2s. Estimated remaining: 1m 6s. Rate: 147.2 symbols/min [2025-10-27T22:16:18.860079] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:18.860696] [DEBUG] [LOCAL ] USNA: Loaded 17931 existing records from primary storage. [2025-10-27T22:16:18.861773] [INFO ] [MAIN ] USNA: Loaded 17931 primary data records. [2025-10-27T22:16:18.990506] [DEBUG] [LOCAL ] USPH: Loaded 16747 existing records from primary storage. [2025-10-27T22:16:19.009231] [INFO ] [MAIN ] USPH: Loaded 16747 primary data records. [2025-10-27T22:16:19.127856] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:19.579535] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:19.596370] [INFO ] [MAIN ] USFD: Generated 138 derivative records from 51030 primary records. [2025-10-27T22:16:19.597197] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-27T22:16:19.615251] [DEBUG] [LOCAL ] USFD: Derivative data saved (138 records). [2025-10-27T22:16:19.615790] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-27T22:16:19.618193] [INFO ] [MAIN ] Derivative Progress: 1720/1881 symbols completed. USFD took 1.2s. Estimated remaining: 1m 6s. Rate: 147.2 symbols/min [2025-10-27T22:16:19.618719] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:19.642205] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:19.690941] [DEBUG] [LOCAL ] UTF: Loaded 31007 existing records from primary storage. [2025-10-27T22:16:19.693859] [INFO ] [MAIN ] UTF: Loaded 31007 primary data records. [2025-10-27T22:16:19.694156] [INFO ] [MAIN ] USNA: Generated 138 derivative records from 17931 primary records. [2025-10-27T22:16:19.727517] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-27T22:16:19.838707] [DEBUG] [LOCAL ] USNA: Derivative data saved (138 records). [2025-10-27T22:16:19.844360] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-27T22:16:20.032196] [INFO ] [MAIN ] Derivative Progress: 1721/1881 symbols completed. USNA took 1.4s. Estimated remaining: 1m 5s. Rate: 147.2 symbols/min [2025-10-27T22:16:20.029838] [INFO ] [MAIN ] USPH: Generated 138 derivative records from 16747 primary records. [2025-10-27T22:16:20.033393] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:20.033602] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-27T22:16:20.047779] [DEBUG] [LOCAL ] USPH: Derivative data saved (138 records). [2025-10-27T22:16:20.048009] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-27T22:16:20.051428] [INFO ] [MAIN ] Derivative Progress: 1722/1881 symbols completed. USPH took 1.2s. Estimated remaining: 1m 5s. Rate: 147.2 symbols/min [2025-10-27T22:16:20.051862] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:20.067769] [DEBUG] [LOCAL ] UTL: Loaded 11797 existing records from primary storage. [2025-10-27T22:16:20.077157] [INFO ] [MAIN ] UTL: Loaded 11797 primary data records. [2025-10-27T22:16:20.218986] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:20.219856] [DEBUG] [LOCAL ] UTI: Loaded 40222 existing records from primary storage. [2025-10-27T22:16:20.253703] [INFO ] [MAIN ] UTI: Loaded 40222 primary data records. [2025-10-27T22:16:20.790449] [INFO ] [MAIN ] UTF: Generated 138 derivative records from 31007 primary records. [2025-10-27T22:16:20.792399] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-27T22:16:20.809293] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:20.833486] [DEBUG] [LOCAL ] UTF: Derivative data saved (138 records). [2025-10-27T22:16:20.835681] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-27T22:16:20.838297] [INFO ] [MAIN ] Derivative Progress: 1723/1881 symbols completed. UTF took 1.2s. Estimated remaining: 1m 4s. Rate: 147.2 symbols/min [2025-10-27T22:16:20.864819] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:20.888517] [INFO ] [MAIN ] UTL: Generated 138 derivative records from 11797 primary records. [2025-10-27T22:16:20.889767] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-27T22:16:20.903952] [DEBUG] [LOCAL ] UTL: Derivative data saved (138 records). [2025-10-27T22:16:20.905233] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-27T22:16:20.909605] [INFO ] [MAIN ] Derivative Progress: 1724/1881 symbols completed. UTL took 0.9s. Estimated remaining: 1m 4s. Rate: 147.2 symbols/min [2025-10-27T22:16:20.915367] [INFO ] [MAIN ] UTI: Generated 138 derivative records from 40222 primary records. [2025-10-27T22:16:20.915436] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-27T22:16:20.926891] [DEBUG] [LOCAL ] UTI: Derivative data saved (138 records). [2025-10-27T22:16:20.926954] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-27T22:16:20.929350] [INFO ] [MAIN ] Derivative Progress: 1725/1881 symbols completed. UTI took 0.9s. Estimated remaining: 1m 4s. Rate: 147.3 symbols/min [2025-10-27T22:16:20.929775] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:20.929882] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:20.929934] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:20.962699] [DEBUG] [LOCAL ] UVV: Loaded 22553 existing records from primary storage. [2025-10-27T22:16:20.962168] [DEBUG] [LOCAL ] UVE: Loaded 21970 existing records from primary storage. [2025-10-27T22:16:20.971412] [INFO ] [MAIN ] UVV: Loaded 22553 primary data records. [2025-10-27T22:16:20.971502] [INFO ] [MAIN ] UVE: Loaded 21970 primary data records. [2025-10-27T22:16:21.262744] [DEBUG] [LOCAL ] UTZ: Loaded 44017 existing records from primary storage. [2025-10-27T22:16:21.300889] [INFO ] [MAIN ] UTZ: Loaded 44017 primary data records. [2025-10-27T22:16:21.929019] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:21.958263] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:22.008137] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:22.055414] [INFO ] [MAIN ] UVV: Generated 138 derivative records from 22553 primary records. [2025-10-27T22:16:22.058142] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-27T22:16:22.075568] [DEBUG] [LOCAL ] UVV: Derivative data saved (138 records). [2025-10-27T22:16:22.075985] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-27T22:16:22.078255] [INFO ] [MAIN ] Derivative Progress: 1726/1881 symbols completed. UVV took 1.1s. Estimated remaining: 1m 3s. Rate: 147.2 symbols/min [2025-10-27T22:16:22.079077] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:22.078889] [INFO ] [MAIN ] UVE: Generated 138 derivative records from 21970 primary records. [2025-10-27T22:16:22.080722] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-27T22:16:22.103420] [DEBUG] [LOCAL ] UVE: Derivative data saved (138 records). [2025-10-27T22:16:22.104752] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-27T22:16:22.107897] [INFO ] [MAIN ] Derivative Progress: 1727/1881 symbols completed. UVE took 1.2s. Estimated remaining: 1m 3s. Rate: 147.2 symbols/min [2025-10-27T22:16:22.108338] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:22.110189] [INFO ] [MAIN ] UTZ: Generated 138 derivative records from 44017 primary records. [2025-10-27T22:16:22.110790] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-27T22:16:22.127554] [DEBUG] [LOCAL ] UTZ: Derivative data saved (138 records). [2025-10-27T22:16:22.127795] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-27T22:16:22.130175] [INFO ] [MAIN ] Derivative Progress: 1728/1881 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 2s. Rate: 147.3 symbols/min [2025-10-27T22:16:22.134956] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:22.134751] [DEBUG] [LOCAL ] UZD: Loaded 5613 existing records from primary storage. [2025-10-27T22:16:22.135572] [INFO ] [MAIN ] UZD: Loaded 5613 primary data records. [2025-10-27T22:16:22.276926] [DEBUG] [LOCAL ] UZE: Loaded 6778 existing records from primary storage. [2025-10-27T22:16:22.288670] [INFO ] [MAIN ] UZE: Loaded 6778 primary data records. [2025-10-27T22:16:22.300435] [DEBUG] [LOCAL ] UWMC: Loaded 52956 existing records from primary storage. [2025-10-27T22:16:22.331202] [INFO ] [MAIN ] UWMC: Loaded 52956 primary data records. [2025-10-27T22:16:23.164349] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-27T22:16:23.202082] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:23.218281] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:23.299199] [INFO ] [MAIN ] UZD: Generated 138 derivative records from 5613 primary records. [2025-10-27T22:16:23.304929] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-27T22:16:23.319390] [DEBUG] [LOCAL ] UZD: Derivative data saved (138 records). [2025-10-27T22:16:23.322157] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-27T22:16:23.324701] [INFO ] [MAIN ] Derivative Progress: 1729/1881 symbols completed. UZD took 1.2s. Estimated remaining: 1m 2s. Rate: 147.1 symbols/min [2025-10-27T22:16:23.325109] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:23.331368] [INFO ] [MAIN ] UWMC: Generated 138 derivative records from 52956 primary records. [2025-10-27T22:16:23.332743] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-27T22:16:23.342000] [INFO ] [MAIN ] UZE: Generated 138 derivative records from 6778 primary records. [2025-10-27T22:16:23.343665] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-27T22:16:23.353335] [DEBUG] [LOCAL ] UWMC: Derivative data saved (138 records). [2025-10-27T22:16:23.355912] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-27T22:16:23.357328] [DEBUG] [LOCAL ] UZE: Derivative data saved (138 records). [2025-10-27T22:16:23.359834] [INFO ] [MAIN ] Derivative Progress: 1730/1881 symbols completed. UWMC took 1.3s. Estimated remaining: 1m 2s. Rate: 147.2 symbols/min [2025-10-27T22:16:23.360059] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-27T22:16:23.362544] [INFO ] [MAIN ] Derivative Progress: 1731/1881 symbols completed. UZE took 1.2s. Estimated remaining: 1m 1s. Rate: 147.3 symbols/min [2025-10-27T22:16:23.360134] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:23.362715] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:23.430232] [DEBUG] [LOCAL ] V: Loaded 53745 existing records from primary storage. [2025-10-27T22:16:23.430795] [DEBUG] [LOCAL ] VAC: Loaded 33412 existing records from primary storage. [2025-10-27T22:16:23.431052] [INFO ] [MAIN ] V: Loaded 53745 primary data records. [2025-10-27T22:16:23.431164] [INFO ] [MAIN ] VAC: Loaded 33412 primary data records. [2025-10-27T22:16:23.631994] [DEBUG] [LOCAL ] VAL: Loaded 49768 existing records from primary storage. [2025-10-27T22:16:23.655797] [INFO ] [MAIN ] VAL: Loaded 49768 primary data records. [2025-10-27T22:16:24.413902] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:24.414162] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:24.459187] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:24.522023] [INFO ] [MAIN ] VAC: Generated 138 derivative records from 33412 primary records. [2025-10-27T22:16:24.522418] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-27T22:16:24.537073] [DEBUG] [LOCAL ] VAC: Derivative data saved (138 records). [2025-10-27T22:16:24.539368] [INFO ] [MAIN ] V: Generated 138 derivative records from 53745 primary records. [2025-10-27T22:16:24.539514] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-27T22:16:24.539111] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-27T22:16:24.544576] [INFO ] [MAIN ] Derivative Progress: 1732/1881 symbols completed. VAC took 1.2s. Estimated remaining: 1m 1s. Rate: 147.1 symbols/min [2025-10-27T22:16:24.545066] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:24.558537] [DEBUG] [LOCAL ] V: Derivative data saved (138 records). [2025-10-27T22:16:24.560709] [INFO ] [MAIN ] VAL: Generated 138 derivative records from 49768 primary records. [2025-10-27T22:16:24.560450] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-27T22:16:24.563029] [INFO ] [MAIN ] Derivative Progress: 1733/1881 symbols completed. V took 1.2s. Estimated remaining: 1m 0s. Rate: 147.2 symbols/min [2025-10-27T22:16:24.563231] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:24.560870] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-27T22:16:24.579264] [DEBUG] [LOCAL ] VAL: Derivative data saved (138 records). [2025-10-27T22:16:24.581196] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-27T22:16:24.586824] [DEBUG] [LOCAL ] VATE: Loaded 4965 existing records from primary storage. [2025-10-27T22:16:24.583911] [INFO ] [MAIN ] Derivative Progress: 1734/1881 symbols completed. VAL took 1.2s. Estimated remaining: 59.9s. Rate: 147.3 symbols/min [2025-10-27T22:16:24.587017] [INFO ] [MAIN ] VATE: Loaded 4965 primary data records. [2025-10-27T22:16:24.598157] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:24.716107] [DEBUG] [LOCAL ] VBF: Loaded 7091 existing records from primary storage. [2025-10-27T22:16:24.753490] [INFO ] [MAIN ] VBF: Loaded 7091 primary data records. [2025-10-27T22:16:24.953848] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-27T22:16:24.978222] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-27T22:16:25.564831] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:25.612387] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:25.642104] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:25.668477] [INFO ] [MAIN ] VATE: Generated 138 derivative records from 4965 primary records. [2025-10-27T22:16:25.672733] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-27T22:16:25.688687] [DEBUG] [LOCAL ] VATE: Derivative data saved (138 records). [2025-10-27T22:16:25.689253] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-27T22:16:25.691335] [INFO ] [MAIN ] Derivative Progress: 1735/1881 symbols completed. VATE took 1.1s. Estimated remaining: 59.5s. Rate: 147.2 symbols/min [2025-10-27T22:16:25.694347] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:25.714824] [INFO ] [MAIN ] VALE: Generated 138 derivative records from 53693 primary records. [2025-10-27T22:16:25.716970] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-27T22:16:25.717122] [INFO ] [MAIN ] VBF: Generated 138 derivative records from 7091 primary records. [2025-10-27T22:16:25.717235] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-27T22:16:25.749172] [DEBUG] [LOCAL ] VBF: Derivative data saved (138 records). [2025-10-27T22:16:25.749582] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-27T22:16:25.753091] [INFO ] [MAIN ] Derivative Progress: 1736/1881 symbols completed. VBF took 1.2s. Estimated remaining: 59.1s. Rate: 147.2 symbols/min [2025-10-27T22:16:25.753245] [DEBUG] [LOCAL ] VALE: Derivative data saved (138 records). [2025-10-27T22:16:25.753425] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-27T22:16:25.753360] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:25.756322] [INFO ] [MAIN ] Derivative Progress: 1737/1881 symbols completed. VALE took 1.2s. Estimated remaining: 58.6s. Rate: 147.3 symbols/min [2025-10-27T22:16:25.756570] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:25.775469] [DEBUG] [LOCAL ] VEEV: Loaded 46907 existing records from primary storage. [2025-10-27T22:16:25.775748] [INFO ] [MAIN ] VEEV: Loaded 46907 primary data records. [2025-10-27T22:16:25.801110] [DEBUG] [LOCAL ] VEL: Loaded 11745 existing records from primary storage. [2025-10-27T22:16:25.816997] [INFO ] [MAIN ] VEL: Loaded 11745 primary data records. [2025-10-27T22:16:26.259962] [DEBUG] [LOCAL ] VET: Loaded 43843 existing records from primary storage. [2025-10-27T22:16:26.276980] [INFO ] [MAIN ] VET: Loaded 43843 primary data records. [2025-10-27T22:16:26.750725] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:26.775711] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:26.831260] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:26.862779] [INFO ] [MAIN ] VEEV: Generated 138 derivative records from 46907 primary records. [2025-10-27T22:16:26.863664] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-27T22:16:26.866033] [INFO ] [MAIN ] VEL: Generated 138 derivative records from 11745 primary records. [2025-10-27T22:16:26.866444] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-27T22:16:26.882617] [DEBUG] [LOCAL ] VEEV: Derivative data saved (138 records). [2025-10-27T22:16:26.882762] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-27T22:16:26.884825] [INFO ] [MAIN ] Derivative Progress: 1738/1881 symbols completed. VEEV took 1.2s. Estimated remaining: 58.3s. Rate: 147.2 symbols/min [2025-10-27T22:16:26.902433] [DEBUG] [LOCAL ] VEL: Derivative data saved (138 records). [2025-10-27T22:16:26.902771] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-27T22:16:26.905672] [INFO ] [MAIN ] Derivative Progress: 1739/1881 symbols completed. VEL took 1.2s. Estimated remaining: 57.9s. Rate: 147.2 symbols/min [2025-10-27T22:16:26.910686] [INFO ] [MAIN ] VET: Generated 138 derivative records from 43843 primary records. [2025-10-27T22:16:26.910762] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-27T22:16:26.921882] [DEBUG] [LOCAL ] VET: Derivative data saved (138 records). [2025-10-27T22:16:26.921945] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-27T22:16:26.924472] [INFO ] [MAIN ] Derivative Progress: 1740/1881 symbols completed. VET took 1.2s. Estimated remaining: 57.4s. Rate: 147.3 symbols/min [2025-10-27T22:16:26.924855] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:26.925254] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:26.925302] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:26.934582] [DEBUG] [LOCAL ] VGI: Loaded 5101 existing records from primary storage. [2025-10-27T22:16:26.934834] [INFO ] [MAIN ] VGI: Loaded 5101 primary data records. [2025-10-27T22:16:27.032735] [DEBUG] [LOCAL ] VGM: Loaded 18374 existing records from primary storage. [2025-10-27T22:16:27.059331] [INFO ] [MAIN ] VGM: Loaded 18374 primary data records. [2025-10-27T22:16:27.413499] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-10-27T22:16:27.449943] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-10-27T22:16:27.896719] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:27.913577] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:27.974752] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:28.001990] [INFO ] [MAIN ] VGI: Generated 138 derivative records from 5101 primary records. [2025-10-27T22:16:28.003264] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-27T22:16:28.015539] [INFO ] [MAIN ] VGM: Generated 138 derivative records from 18374 primary records. [2025-10-27T22:16:28.017408] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-27T22:16:28.019780] [DEBUG] [LOCAL ] VGI: Derivative data saved (138 records). [2025-10-27T22:16:28.020276] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-27T22:16:28.025269] [INFO ] [MAIN ] Derivative Progress: 1741/1881 symbols completed. VGI took 1.1s. Estimated remaining: 57.1s. Rate: 147.2 symbols/min [2025-10-27T22:16:28.033259] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:28.037786] [DEBUG] [LOCAL ] VGM: Derivative data saved (138 records). [2025-10-27T22:16:28.037989] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-27T22:16:28.040789] [INFO ] [MAIN ] Derivative Progress: 1742/1881 symbols completed. VGM took 1.1s. Estimated remaining: 56.6s. Rate: 147.3 symbols/min [2025-10-27T22:16:28.043710] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:28.051099] [DEBUG] [LOCAL ] VHI: Loaded 2587 existing records from primary storage. [2025-10-27T22:16:28.052483] [INFO ] [MAIN ] VHI: Loaded 2587 primary data records. [2025-10-27T22:16:28.108384] [INFO ] [MAIN ] VFC: Generated 138 derivative records from 53610 primary records. [2025-10-27T22:16:28.108562] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-27T22:16:28.188360] [DEBUG] [LOCAL ] VFC: Derivative data saved (138 records). [2025-10-27T22:16:28.218830] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-27T22:16:28.258225] [INFO ] [MAIN ] Derivative Progress: 1743/1881 symbols completed. VFC took 1.3s. Estimated remaining: 56.2s. Rate: 147.3 symbols/min [2025-10-27T22:16:28.360922] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:28.388746] [DEBUG] [LOCAL ] VICI: Loaded 53650 existing records from primary storage. [2025-10-27T22:16:28.389133] [INFO ] [MAIN ] VICI: Loaded 53650 primary data records. [2025-10-27T22:16:28.741798] [DEBUG] [LOCAL ] VIK: Loaded 52242 existing records from primary storage. [2025-10-27T22:16:28.742141] [INFO ] [MAIN ] VIK: Loaded 52242 primary data records. [2025-10-27T22:16:28.858424] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:29.110402] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:29.138076] [INFO ] [MAIN ] VHI: Generated 138 derivative records from 2587 primary records. [2025-10-27T22:16:29.140515] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-27T22:16:29.158466] [DEBUG] [LOCAL ] VHI: Derivative data saved (138 records). [2025-10-27T22:16:29.159078] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-27T22:16:29.161502] [INFO ] [MAIN ] Derivative Progress: 1744/1881 symbols completed. VHI took 1.1s. Estimated remaining: 55.8s. Rate: 147.2 symbols/min [2025-10-27T22:16:29.164771] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:29.178555] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:29.199432] [INFO ] [MAIN ] VICI: Generated 138 derivative records from 53650 primary records. [2025-10-27T22:16:29.201545] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-27T22:16:29.218007] [DEBUG] [LOCAL ] VICI: Derivative data saved (138 records). [2025-10-27T22:16:29.218576] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-27T22:16:29.221142] [INFO ] [MAIN ] Derivative Progress: 1745/1881 symbols completed. VICI took 1.2s. Estimated remaining: 55.4s. Rate: 147.3 symbols/min [2025-10-27T22:16:29.221436] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:29.248244] [INFO ] [MAIN ] VIK: Generated 138 derivative records from 52242 primary records. [2025-10-27T22:16:29.249108] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-27T22:16:29.273887] [DEBUG] [LOCAL ] VIK: Derivative data saved (138 records). [2025-10-27T22:16:29.274126] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-27T22:16:29.277794] [INFO ] [MAIN ] Derivative Progress: 1746/1881 symbols completed. VIK took 0.9s. Estimated remaining: 55.0s. Rate: 147.3 symbols/min [2025-10-27T22:16:29.278070] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:29.274918] [DEBUG] [LOCAL ] VIPS: Loaded 51198 existing records from primary storage. [2025-10-27T22:16:29.278500] [INFO ] [MAIN ] VIPS: Loaded 51198 primary data records. [2025-10-27T22:16:29.446331] [DEBUG] [LOCAL ] VIRT: Loaded 46273 existing records from primary storage. [2025-10-27T22:16:29.472696] [INFO ] [MAIN ] VIRT: Loaded 46273 primary data records. [2025-10-27T22:16:29.745415] [DEBUG] [LOCAL ] VIST: Loaded 46664 existing records from primary storage. [2025-10-27T22:16:29.763512] [INFO ] [MAIN ] VIST: Loaded 46664 primary data records. [2025-10-27T22:16:30.235503] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:30.281358] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:30.330756] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:30.346615] [INFO ] [MAIN ] VIPS: Generated 138 derivative records from 51198 primary records. [2025-10-27T22:16:30.350559] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-27T22:16:30.366315] [DEBUG] [LOCAL ] VIPS: Derivative data saved (138 records). [2025-10-27T22:16:30.370123] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-27T22:16:30.374434] [INFO ] [MAIN ] Derivative Progress: 1747/1881 symbols completed. VIPS took 1.2s. Estimated remaining: 54.6s. Rate: 147.2 symbols/min [2025-10-27T22:16:30.376151] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:30.387970] [INFO ] [MAIN ] VIRT: Generated 138 derivative records from 46273 primary records. [2025-10-27T22:16:30.389876] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-27T22:16:30.407370] [DEBUG] [LOCAL ] VIRT: Derivative data saved (138 records). [2025-10-27T22:16:30.407679] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-27T22:16:30.410394] [INFO ] [MAIN ] Derivative Progress: 1748/1881 symbols completed. VIRT took 1.2s. Estimated remaining: 54.2s. Rate: 147.3 symbols/min [2025-10-27T22:16:30.410593] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:30.427834] [INFO ] [MAIN ] VIST: Generated 138 derivative records from 46664 primary records. [2025-10-27T22:16:30.428031] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-27T22:16:30.443616] [DEBUG] [LOCAL ] VIST: Derivative data saved (138 records). [2025-10-27T22:16:30.456687] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-27T22:16:30.459428] [INFO ] [MAIN ] Derivative Progress: 1749/1881 symbols completed. VIST took 1.2s. Estimated remaining: 53.7s. Rate: 147.4 symbols/min [2025-10-27T22:16:30.459633] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:30.461056] [DEBUG] [LOCAL ] VIV: Loaded 44440 existing records from primary storage. [2025-10-27T22:16:30.467300] [DEBUG] [LOCAL ] VKQ: Loaded 17638 existing records from primary storage. [2025-10-27T22:16:30.467461] [INFO ] [MAIN ] VIV: Loaded 44440 primary data records. [2025-10-27T22:16:30.467719] [INFO ] [MAIN ] VKQ: Loaded 17638 primary data records. [2025-10-27T22:16:30.812541] [DEBUG] [LOCAL ] VLN: Loaded 31215 existing records from primary storage. [2025-10-27T22:16:31.001953] [INFO ] [MAIN ] VLN: Loaded 31215 primary data records. [2025-10-27T22:16:31.445533] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:31.471907] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:31.524578] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:31.552853] [INFO ] [MAIN ] VIV: Generated 138 derivative records from 44440 primary records. [2025-10-27T22:16:31.555048] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-27T22:16:31.577577] [DEBUG] [LOCAL ] VIV: Derivative data saved (138 records). [2025-10-27T22:16:31.578173] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-27T22:16:31.583112] [INFO ] [MAIN ] Derivative Progress: 1750/1881 symbols completed. VIV took 1.2s. Estimated remaining: 53.4s. Rate: 147.2 symbols/min [2025-10-27T22:16:31.583308] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:31.586857] [INFO ] [MAIN ] VKQ: Generated 138 derivative records from 17638 primary records. [2025-10-27T22:16:31.587211] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-27T22:16:31.604383] [DEBUG] [LOCAL ] VKQ: Derivative data saved (138 records). [2025-10-27T22:16:31.604575] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-27T22:16:31.607319] [INFO ] [MAIN ] Derivative Progress: 1751/1881 symbols completed. VKQ took 1.2s. Estimated remaining: 53.0s. Rate: 147.3 symbols/min [2025-10-27T22:16:31.608148] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:31.612006] [INFO ] [MAIN ] VLN: Generated 138 derivative records from 31215 primary records. [2025-10-27T22:16:31.612244] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-27T22:16:31.624798] [DEBUG] [LOCAL ] VLN: Derivative data saved (138 records). [2025-10-27T22:16:31.625083] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-27T22:16:31.627780] [INFO ] [MAIN ] Derivative Progress: 1752/1881 symbols completed. VLN took 1.2s. Estimated remaining: 52.5s. Rate: 147.4 symbols/min [2025-10-27T22:16:31.628048] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:31.634234] [DEBUG] [LOCAL ] VLT: Loaded 4125 existing records from primary storage. [2025-10-27T22:16:31.634520] [INFO ] [MAIN ] VLT: Loaded 4125 primary data records. [2025-10-27T22:16:31.862211] [DEBUG] [LOCAL ] VLO: Loaded 52932 existing records from primary storage. [2025-10-27T22:16:31.860946] [DEBUG] [LOCAL ] VLRS: Loaded 39139 existing records from primary storage. [2025-10-27T22:16:31.903716] [INFO ] [MAIN ] VLRS: Loaded 39139 primary data records. [2025-10-27T22:16:31.975165] [INFO ] [MAIN ] VLO: Loaded 52932 primary data records. [2025-10-27T22:16:32.667007] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:32.711018] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:32.747596] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:32.770351] [INFO ] [MAIN ] VLT: Generated 138 derivative records from 4125 primary records. [2025-10-27T22:16:32.773443] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-27T22:16:32.789811] [DEBUG] [LOCAL ] VLT: Derivative data saved (138 records). [2025-10-27T22:16:32.789996] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-27T22:16:32.792608] [INFO ] [MAIN ] Derivative Progress: 1753/1881 symbols completed. VLT took 1.2s. Estimated remaining: 52.2s. Rate: 147.2 symbols/min [2025-10-27T22:16:32.808898] [INFO ] [MAIN ] VLRS: Generated 138 derivative records from 39139 primary records. [2025-10-27T22:16:32.811267] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-27T22:16:32.821146] [INFO ] [MAIN ] VLO: Generated 138 derivative records from 52932 primary records. [2025-10-27T22:16:32.822873] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-27T22:16:32.834926] [DEBUG] [LOCAL ] VLRS: Derivative data saved (138 records). [2025-10-27T22:16:32.834999] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-27T22:16:32.838471] [INFO ] [MAIN ] Derivative Progress: 1754/1881 symbols completed. VLRS took 1.2s. Estimated remaining: 51.7s. Rate: 147.3 symbols/min [2025-10-27T22:16:32.840807] [DEBUG] [LOCAL ] VLO: Derivative data saved (138 records). [2025-10-27T22:16:32.840870] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-27T22:16:32.843551] [INFO ] [MAIN ] Derivative Progress: 1755/1881 symbols completed. VLO took 1.3s. Estimated remaining: 51.3s. Rate: 147.4 symbols/min [2025-10-27T22:16:32.843905] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:32.844001] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:32.844574] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:32.864777] [DEBUG] [LOCAL ] VMI: Loaded 14745 existing records from primary storage. [2025-10-27T22:16:32.864914] [INFO ] [MAIN ] VMI: Loaded 14745 primary data records. [2025-10-27T22:16:33.196897] [DEBUG] [LOCAL ] VLTO: Loaded 45922 existing records from primary storage. [2025-10-27T22:16:33.085318] [DEBUG] [LOCAL ] VMC: Loaded 41857 existing records from primary storage. [2025-10-27T22:16:33.197558] [INFO ] [MAIN ] VMC: Loaded 41857 primary data records. [2025-10-27T22:16:33.197684] [INFO ] [MAIN ] VLTO: Loaded 45922 primary data records. [2025-10-27T22:16:33.835731] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:16:33.893139] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:33.923761] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:33.946507] [INFO ] [MAIN ] VMI: Generated 138 derivative records from 14745 primary records. [2025-10-27T22:16:33.947476] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-27T22:16:33.967418] [DEBUG] [LOCAL ] VMI: Derivative data saved (138 records). [2025-10-27T22:16:33.967882] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-27T22:16:33.972347] [INFO ] [MAIN ] Derivative Progress: 1756/1881 symbols completed. VMI took 1.1s. Estimated remaining: 50.9s. Rate: 147.2 symbols/min [2025-10-27T22:16:33.972513] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:34.003984] [INFO ] [MAIN ] VMC: Generated 138 derivative records from 41857 primary records. [2025-10-27T22:16:34.013240] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-27T22:16:34.013562] [DEBUG] [LOCAL ] VMO: Loaded 20312 existing records from primary storage. [2025-10-27T22:16:34.013134] [INFO ] [MAIN ] VLTO: Generated 138 derivative records from 45922 primary records. [2025-10-27T22:16:34.014141] [INFO ] [MAIN ] VMO: Loaded 20312 primary data records. [2025-10-27T22:16:34.014435] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-27T22:16:34.120471] [DEBUG] [LOCAL ] VLTO: Derivative data saved (138 records). [2025-10-27T22:16:34.130968] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-27T22:16:34.120579] [DEBUG] [LOCAL ] VMC: Derivative data saved (138 records). [2025-10-27T22:16:34.141837] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-27T22:16:34.141661] [INFO ] [MAIN ] Derivative Progress: 1757/1881 symbols completed. VLTO took 1.3s. Estimated remaining: 50.5s. Rate: 147.3 symbols/min [2025-10-27T22:16:34.148223] [INFO ] [MAIN ] Derivative Progress: 1758/1881 symbols completed. VMC took 1.3s. Estimated remaining: 50.1s. Rate: 147.4 symbols/min [2025-10-27T22:16:34.145632] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:34.164449] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:34.387380] [DEBUG] [LOCAL ] VNO: Loaded 48642 existing records from primary storage. [2025-10-27T22:16:34.387939] [INFO ] [MAIN ] VNO: Loaded 48642 primary data records. [2025-10-27T22:16:34.450402] [DEBUG] [LOCAL ] VNT: Loaded 43756 existing records from primary storage. [2025-10-27T22:16:34.476294] [INFO ] [MAIN ] VNT: Loaded 43756 primary data records. [2025-10-27T22:16:34.656558] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:35.198156] [INFO ] [MAIN ] VMO: Generated 138 derivative records from 20312 primary records. [2025-10-27T22:16:35.200076] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-27T22:16:35.214303] [DEBUG] [LOCAL ] VMO: Derivative data saved (138 records). [2025-10-27T22:16:35.214888] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-27T22:16:35.217222] [INFO ] [MAIN ] Derivative Progress: 1759/1881 symbols completed. VMO took 1.2s. Estimated remaining: 49.7s. Rate: 147.2 symbols/min [2025-10-27T22:16:35.230357] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:35.230704] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:35.272819] [DEBUG] [LOCAL ] VOC: Loaded 8990 existing records from primary storage. [2025-10-27T22:16:35.273504] [INFO ] [MAIN ] VOC: Loaded 8990 primary data records. [2025-10-27T22:16:35.273409] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:35.615903] [INFO ] [MAIN ] VNO: Generated 138 derivative records from 48642 primary records. [2025-10-27T22:16:35.616560] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-27T22:16:35.634386] [DEBUG] [LOCAL ] VNO: Derivative data saved (138 records). [2025-10-27T22:16:35.634562] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-27T22:16:35.636888] [INFO ] [MAIN ] Derivative Progress: 1760/1881 symbols completed. VNO took 1.5s. Estimated remaining: 49.3s. Rate: 147.2 symbols/min [2025-10-27T22:16:35.637199] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:35.640192] [INFO ] [MAIN ] VNT: Generated 138 derivative records from 43756 primary records. [2025-10-27T22:16:35.640348] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-27T22:16:35.652570] [DEBUG] [LOCAL ] VNT: Derivative data saved (138 records). [2025-10-27T22:16:35.652771] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-27T22:16:35.655560] [INFO ] [MAIN ] Derivative Progress: 1761/1881 symbols completed. VNT took 1.5s. Estimated remaining: 48.9s. Rate: 147.3 symbols/min [2025-10-27T22:16:35.655824] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:35.672919] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:35.711936] [DEBUG] [LOCAL ] VPG: Loaded 16571 existing records from primary storage. [2025-10-27T22:16:35.723913] [INFO ] [MAIN ] VPG: Loaded 16571 primary data records. [2025-10-27T22:16:35.745925] [DEBUG] [LOCAL ] VOYA: Loaded 41334 existing records from primary storage. [2025-10-27T22:16:35.770237] [INFO ] [MAIN ] VOYA: Loaded 41334 primary data records. [2025-10-27T22:16:36.326341] [INFO ] [MAIN ] VOC: Generated 138 derivative records from 8990 primary records. [2025-10-27T22:16:36.326533] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-27T22:16:36.342901] [DEBUG] [LOCAL ] VOC: Derivative data saved (138 records). [2025-10-27T22:16:36.345574] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-27T22:16:36.349092] [INFO ] [MAIN ] Derivative Progress: 1762/1881 symbols completed. VOC took 1.1s. Estimated remaining: 48.5s. Rate: 147.2 symbols/min [2025-10-27T22:16:36.350039] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:36.359816] [DEBUG] [LOCAL ] VPV: Loaded 5024 existing records from primary storage. [2025-10-27T22:16:36.360215] [INFO ] [MAIN ] VPV: Loaded 5024 primary data records. [2025-10-27T22:16:36.555122] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:36.580163] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:36.773177] [INFO ] [MAIN ] VOYA: Generated 138 derivative records from 41334 primary records. [2025-10-27T22:16:36.773454] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-27T22:16:36.799773] [DEBUG] [LOCAL ] VOYA: Derivative data saved (138 records). [2025-10-27T22:16:36.800347] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-27T22:16:36.800272] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:36.802615] [INFO ] [MAIN ] Derivative Progress: 1763/1881 symbols completed. VOYA took 1.2s. Estimated remaining: 48.1s. Rate: 147.2 symbols/min [2025-10-27T22:16:36.813483] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:36.817718] [INFO ] [MAIN ] VPG: Generated 138 derivative records from 16571 primary records. [2025-10-27T22:16:36.819864] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-27T22:16:36.834246] [DEBUG] [LOCAL ] VPG: Derivative data saved (138 records). [2025-10-27T22:16:36.836734] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-27T22:16:36.839582] [INFO ] [MAIN ] Derivative Progress: 1764/1881 symbols completed. VPG took 1.2s. Estimated remaining: 47.7s. Rate: 147.3 symbols/min [2025-10-27T22:16:36.840003] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:36.863882] [INFO ] [MAIN ] VPV: Generated 138 derivative records from 5024 primary records. [2025-10-27T22:16:36.864133] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-27T22:16:36.875601] [DEBUG] [LOCAL ] VPV: Derivative data saved (138 records). [2025-10-27T22:16:36.885523] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-27T22:16:36.888075] [INFO ] [MAIN ] Derivative Progress: 1765/1881 symbols completed. VPV took 0.5s. Estimated remaining: 47.2s. Rate: 147.4 symbols/min [2025-10-27T22:16:36.889218] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:36.888995] [DEBUG] [LOCAL ] VRE: Loaded 35022 existing records from primary storage. [2025-10-27T22:16:36.889385] [INFO ] [MAIN ] VRE: Loaded 35022 primary data records. [2025-10-27T22:16:37.065298] [DEBUG] [LOCAL ] VRTS: Loaded 9395 existing records from primary storage. [2025-10-27T22:16:37.102677] [INFO ] [MAIN ] VRTS: Loaded 9395 primary data records. [2025-10-27T22:16:37.077075] [DEBUG] [LOCAL ] VRT: Loaded 53754 existing records from primary storage. [2025-10-27T22:16:37.103898] [INFO ] [MAIN ] VRT: Loaded 53754 primary data records. [2025-10-27T22:16:37.864788] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:37.916389] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:37.935638] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:37.993881] [INFO ] [MAIN ] VRE: Generated 138 derivative records from 35022 primary records. [2025-10-27T22:16:37.994254] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-27T22:16:38.014434] [DEBUG] [LOCAL ] VRE: Derivative data saved (138 records). [2025-10-27T22:16:38.015150] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-27T22:16:38.018042] [INFO ] [MAIN ] Derivative Progress: 1766/1881 symbols completed. VRE took 1.2s. Estimated remaining: 46.9s. Rate: 147.2 symbols/min [2025-10-27T22:16:38.018527] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:38.033446] [INFO ] [MAIN ] VRTS: Generated 138 derivative records from 9395 primary records. [2025-10-27T22:16:38.035460] [INFO ] [MAIN ] VRT: Generated 138 derivative records from 53754 primary records. [2025-10-27T22:16:38.035552] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-27T22:16:38.035734] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-27T22:16:38.058559] [DEBUG] [LOCAL ] VRTS: Derivative data saved (138 records). [2025-10-27T22:16:38.059775] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-27T22:16:38.062747] [INFO ] [MAIN ] Derivative Progress: 1767/1881 symbols completed. VRTS took 1.2s. Estimated remaining: 46.4s. Rate: 147.3 symbols/min [2025-10-27T22:16:38.063163] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:38.066516] [DEBUG] [LOCAL ] VRT: Derivative data saved (138 records). [2025-10-27T22:16:38.066700] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-27T22:16:38.069418] [INFO ] [MAIN ] Derivative Progress: 1768/1881 symbols completed. VRT took 1.2s. Estimated remaining: 46.0s. Rate: 147.4 symbols/min [2025-10-27T22:16:38.114265] [DEBUG] [LOCAL ] VSCO: Loaded 52649 existing records from primary storage. [2025-10-27T22:16:38.114500] [INFO ] [MAIN ] VSCO: Loaded 52649 primary data records. [2025-10-27T22:16:38.252719] [DEBUG] [LOCAL ] VSH: Loaded 48222 existing records from primary storage. [2025-10-27T22:16:38.274698] [INFO ] [MAIN ] VSH: Loaded 48222 primary data records. [2025-10-27T22:16:38.723666] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:38.764129] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:38.796123] [INFO ] [MAIN ] VSCO: Generated 138 derivative records from 52649 primary records. [2025-10-27T22:16:38.798970] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-27T22:16:38.816107] [DEBUG] [LOCAL ] VSCO: Derivative data saved (138 records). [2025-10-27T22:16:38.817314] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-27T22:16:38.819847] [INFO ] [MAIN ] Derivative Progress: 1769/1881 symbols completed. VSCO took 0.8s. Estimated remaining: 45.6s. Rate: 147.3 symbols/min [2025-10-27T22:16:38.824330] [INFO ] [MAIN ] VSH: Generated 138 derivative records from 48222 primary records. [2025-10-27T22:16:38.824466] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-27T22:16:38.836255] [DEBUG] [LOCAL ] VSH: Derivative data saved (138 records). [2025-10-27T22:16:38.836319] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-27T22:16:38.838487] [INFO ] [MAIN ] Derivative Progress: 1770/1881 symbols completed. VSH took 0.8s. Estimated remaining: 45.2s. Rate: 147.4 symbols/min [2025-10-27T22:16:38.839011] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:38.838920] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:38.839163] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:38.899362] [DEBUG] [LOCAL ] VTEX: Loaded 42713 existing records from primary storage. [2025-10-27T22:16:38.899675] [INFO ] [MAIN ] VTEX: Loaded 42713 primary data records. [2025-10-27T22:16:38.987397] [DEBUG] [LOCAL ] VSTS: Loaded 48712 existing records from primary storage. [2025-10-27T22:16:38.993235] [INFO ] [MAIN ] VSTS: Loaded 48712 primary data records. [2025-10-27T22:16:39.117126] [DEBUG] [LOCAL ] VST: Loaded 53708 existing records from primary storage. [2025-10-27T22:16:39.161141] [INFO ] [MAIN ] VST: Loaded 53708 primary data records. [2025-10-27T22:16:39.886992] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:39.924819] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:39.962347] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:40.004090] [INFO ] [MAIN ] VTEX: Generated 138 derivative records from 42713 primary records. [2025-10-27T22:16:40.004515] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-27T22:16:40.024217] [DEBUG] [LOCAL ] VTEX: Derivative data saved (138 records). [2025-10-27T22:16:40.024675] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-27T22:16:40.027790] [INFO ] [MAIN ] Derivative Progress: 1771/1881 symbols completed. VTEX took 1.2s. Estimated remaining: 44.8s. Rate: 147.2 symbols/min [2025-10-27T22:16:40.028345] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:40.031172] [INFO ] [MAIN ] VSTS: Generated 138 derivative records from 48712 primary records. [2025-10-27T22:16:40.033936] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-27T22:16:40.050286] [DEBUG] [LOCAL ] VSTS: Derivative data saved (138 records). [2025-10-27T22:16:40.050518] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-27T22:16:40.053046] [INFO ] [MAIN ] Derivative Progress: 1772/1881 symbols completed. VSTS took 1.2s. Estimated remaining: 44.4s. Rate: 147.3 symbols/min [2025-10-27T22:16:40.053198] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:40.056840] [INFO ] [MAIN ] VST: Generated 138 derivative records from 53708 primary records. [2025-10-27T22:16:40.057080] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-27T22:16:40.069817] [DEBUG] [LOCAL ] VST: Derivative data saved (138 records). [2025-10-27T22:16:40.069989] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-27T22:16:40.073016] [INFO ] [MAIN ] Derivative Progress: 1773/1881 symbols completed. VST took 1.2s. Estimated remaining: 44.0s. Rate: 147.4 symbols/min [2025-10-27T22:16:40.073261] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:40.097100] [DEBUG] [LOCAL ] VTMX: Loaded 17601 existing records from primary storage. [2025-10-27T22:16:40.097272] [INFO ] [MAIN ] VTMX: Loaded 17601 primary data records. [2025-10-27T22:16:40.135950] [DEBUG] [LOCAL ] VTN: Loaded 7126 existing records from primary storage. [2025-10-27T22:16:40.168689] [INFO ] [MAIN ] VTN: Loaded 7126 primary data records. [2025-10-27T22:16:40.262289] [DEBUG] [LOCAL ] VTLE: Loaded 47226 existing records from primary storage. [2025-10-27T22:16:40.337671] [INFO ] [MAIN ] VTLE: Loaded 47226 primary data records. [2025-10-27T22:16:41.122579] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:41.122106] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:41.184074] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:41.236747] [INFO ] [MAIN ] VTMX: Generated 138 derivative records from 17601 primary records. [2025-10-27T22:16:41.239172] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-27T22:16:41.245173] [INFO ] [MAIN ] VTN: Generated 138 derivative records from 7126 primary records. [2025-10-27T22:16:41.259368] [DEBUG] [LOCAL ] VTMX: Derivative data saved (138 records). [2025-10-27T22:16:41.257984] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-27T22:16:41.260059] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-27T22:16:41.262211] [INFO ] [MAIN ] Derivative Progress: 1774/1881 symbols completed. VTMX took 1.2s. Estimated remaining: 43.6s. Rate: 147.2 symbols/min [2025-10-27T22:16:41.271979] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:41.278439] [DEBUG] [LOCAL ] VTN: Derivative data saved (138 records). [2025-10-27T22:16:41.278788] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-27T22:16:41.281319] [INFO ] [MAIN ] Derivative Progress: 1775/1881 symbols completed. VTN took 1.2s. Estimated remaining: 43.2s. Rate: 147.3 symbols/min [2025-10-27T22:16:41.283477] [INFO ] [MAIN ] VTLE: Generated 138 derivative records from 47226 primary records. [2025-10-27T22:16:41.283628] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:41.283839] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-27T22:16:41.307860] [DEBUG] [LOCAL ] VTLE: Derivative data saved (138 records). [2025-10-27T22:16:41.309413] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-27T22:16:41.309330] [DEBUG] [LOCAL ] VTOL: Loaded 19174 existing records from primary storage. [2025-10-27T22:16:41.309583] [INFO ] [MAIN ] VTOL: Loaded 19174 primary data records. [2025-10-27T22:16:41.312822] [INFO ] [MAIN ] Derivative Progress: 1776/1881 symbols completed. VTLE took 1.3s. Estimated remaining: 42.7s. Rate: 147.4 symbols/min [2025-10-27T22:16:41.325718] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:41.699422] [DEBUG] [LOCAL ] VTR: Loaded 52638 existing records from primary storage. [2025-10-27T22:16:41.699689] [INFO ] [MAIN ] VTR: Loaded 52638 primary data records. [2025-10-27T22:16:41.700157] [DEBUG] [LOCAL ] VTS: Loaded 29492 existing records from primary storage. [2025-10-27T22:16:41.700332] [INFO ] [MAIN ] VTS: Loaded 29492 primary data records. [2025-10-27T22:16:42.360572] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:42.419843] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:42.456145] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:42.481533] [INFO ] [MAIN ] VTOL: Generated 138 derivative records from 19174 primary records. [2025-10-27T22:16:42.485543] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-27T22:16:42.500786] [DEBUG] [LOCAL ] VTOL: Derivative data saved (138 records). [2025-10-27T22:16:42.501743] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-27T22:16:42.507818] [INFO ] [MAIN ] Derivative Progress: 1777/1881 symbols completed. VTOL took 1.2s. Estimated remaining: 42.4s. Rate: 147.2 symbols/min [2025-10-27T22:16:42.508984] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:42.543969] [INFO ] [MAIN ] VTS: Generated 138 derivative records from 29492 primary records. [2025-10-27T22:16:42.545999] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-27T22:16:42.575149] [DEBUG] [LOCAL ] VVR: Loaded 30814 existing records from primary storage. [2025-10-27T22:16:42.576223] [INFO ] [MAIN ] VVR: Loaded 30814 primary data records. [2025-10-27T22:16:42.578910] [INFO ] [MAIN ] VTR: Generated 138 derivative records from 52638 primary records. [2025-10-27T22:16:42.605281] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-27T22:16:42.673628] [DEBUG] [LOCAL ] VTR: Derivative data saved (138 records). [2025-10-27T22:16:42.693269] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-27T22:16:42.693376] [DEBUG] [LOCAL ] VTS: Derivative data saved (138 records). [2025-10-27T22:16:42.709966] [INFO ] [MAIN ] Derivative Progress: 1778/1881 symbols completed. VTR took 1.4s. Estimated remaining: 42.0s. Rate: 147.3 symbols/min [2025-10-27T22:16:42.710233] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-27T22:16:42.710176] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:42.716585] [INFO ] [MAIN ] Derivative Progress: 1779/1881 symbols completed. VTS took 1.4s. Estimated remaining: 41.5s. Rate: 147.3 symbols/min [2025-10-27T22:16:42.717243] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:42.936496] [DEBUG] [LOCAL ] VVX: Loaded 22918 existing records from primary storage. [2025-10-27T22:16:42.938141] [INFO ] [MAIN ] VVX: Loaded 22918 primary data records. [2025-10-27T22:16:43.060372] [DEBUG] [LOCAL ] VVV: Loaded 50075 existing records from primary storage. [2025-10-27T22:16:43.070947] [INFO ] [MAIN ] VVV: Loaded 50075 primary data records. [2025-10-27T22:16:43.410635] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:43.661127] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:43.661301] [INFO ] [MAIN ] VVR: Generated 138 derivative records from 30814 primary records. [2025-10-27T22:16:43.675828] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-27T22:16:43.694458] [DEBUG] [LOCAL ] VVR: Derivative data saved (138 records). [2025-10-27T22:16:43.696179] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-27T22:16:43.698123] [INFO ] [MAIN ] Derivative Progress: 1780/1881 symbols completed. VVR took 1.2s. Estimated remaining: 41.2s. Rate: 147.2 symbols/min [2025-10-27T22:16:43.699399] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:43.713403] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:43.763519] [INFO ] [MAIN ] VVX: Generated 138 derivative records from 22918 primary records. [2025-10-27T22:16:43.763948] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-27T22:16:43.781526] [DEBUG] [LOCAL ] VVX: Derivative data saved (138 records). [2025-10-27T22:16:43.794453] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-27T22:16:43.796896] [INFO ] [MAIN ] Derivative Progress: 1781/1881 symbols completed. VVX took 1.1s. Estimated remaining: 40.7s. Rate: 147.3 symbols/min [2025-10-27T22:16:43.797149] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:43.799471] [DEBUG] [LOCAL ] VYX: Loaded 48119 existing records from primary storage. [2025-10-27T22:16:43.802466] [INFO ] [MAIN ] VYX: Loaded 48119 primary data records. [2025-10-27T22:16:43.826307] [INFO ] [MAIN ] VVV: Generated 138 derivative records from 50075 primary records. [2025-10-27T22:16:43.850829] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-27T22:16:43.928847] [DEBUG] [LOCAL ] VVV: Derivative data saved (138 records). [2025-10-27T22:16:43.929347] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-27T22:16:43.932074] [INFO ] [MAIN ] Derivative Progress: 1782/1881 symbols completed. VVV took 1.2s. Estimated remaining: 40.3s. Rate: 147.3 symbols/min [2025-10-27T22:16:43.947947] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:44.152630] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-27T22:16:44.153273] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-27T22:16:44.494067] [DEBUG] [LOCAL ] W: Loaded 53407 existing records from primary storage. [2025-10-27T22:16:44.494277] [INFO ] [MAIN ] W: Loaded 53407 primary data records. [2025-10-27T22:16:44.627257] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:44.862012] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:44.881934] [INFO ] [MAIN ] VYX: Generated 138 derivative records from 48119 primary records. [2025-10-27T22:16:44.884398] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-27T22:16:44.902268] [DEBUG] [LOCAL ] VYX: Derivative data saved (138 records). [2025-10-27T22:16:44.902674] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-27T22:16:44.905696] [INFO ] [MAIN ] Derivative Progress: 1783/1881 symbols completed. VYX took 1.2s. Estimated remaining: 39.9s. Rate: 147.2 symbols/min [2025-10-27T22:16:44.924753] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:44.949403] [INFO ] [MAIN ] VZ: Generated 138 derivative records from 53791 primary records. [2025-10-27T22:16:44.953388] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-27T22:16:44.970178] [DEBUG] [LOCAL ] VZ: Derivative data saved (138 records). [2025-10-27T22:16:44.972470] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-27T22:16:44.975080] [INFO ] [MAIN ] Derivative Progress: 1784/1881 symbols completed. VZ took 1.2s. Estimated remaining: 39.5s. Rate: 147.3 symbols/min [2025-10-27T22:16:44.981334] [INFO ] [MAIN ] W: Generated 138 derivative records from 53407 primary records. [2025-10-27T22:16:44.981469] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-27T22:16:44.994499] [DEBUG] [LOCAL ] W: Derivative data saved (138 records). [2025-10-27T22:16:44.994563] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-27T22:16:44.997941] [INFO ] [MAIN ] Derivative Progress: 1785/1881 symbols completed. W took 1.0s. Estimated remaining: 39.1s. Rate: 147.4 symbols/min [2025-10-27T22:16:44.998291] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:44.998410] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:44.998799] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:45.066506] [DEBUG] [LOCAL ] WAB: Loaded 43665 existing records from primary storage. [2025-10-27T22:16:45.078591] [INFO ] [MAIN ] WAB: Loaded 43665 primary data records. [2025-10-27T22:16:45.079082] [DEBUG] [LOCAL ] WAT: Loaded 35383 existing records from primary storage. [2025-10-27T22:16:45.079685] [DEBUG] [LOCAL ] WAL: Loaded 45573 existing records from primary storage. [2025-10-27T22:16:45.100217] [INFO ] [MAIN ] WAL: Loaded 45573 primary data records. [2025-10-27T22:16:45.100135] [INFO ] [MAIN ] WAT: Loaded 35383 primary data records. [2025-10-27T22:16:46.071759] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:46.095267] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:46.120724] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:16:46.192765] [INFO ] [MAIN ] WAL: Generated 138 derivative records from 45573 primary records. [2025-10-27T22:16:46.197395] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-27T22:16:46.214190] [DEBUG] [LOCAL ] WAL: Derivative data saved (138 records). [2025-10-27T22:16:46.218474] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-27T22:16:46.220950] [INFO ] [MAIN ] Derivative Progress: 1786/1881 symbols completed. WAL took 1.2s. Estimated remaining: 38.7s. Rate: 147.2 symbols/min [2025-10-27T22:16:46.221266] [INFO ] [MAIN ] WAB: Generated 138 derivative records from 43665 primary records. [2025-10-27T22:16:46.218823] [INFO ] [MAIN ] WAT: Generated 138 derivative records from 35383 primary records. [2025-10-27T22:16:46.221460] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:46.221787] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-27T22:16:46.221923] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-27T22:16:46.254212] [DEBUG] [LOCAL ] WAB: Derivative data saved (138 records). [2025-10-27T22:16:46.252439] [DEBUG] [LOCAL ] WAT: Derivative data saved (138 records). [2025-10-27T22:16:46.254386] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-27T22:16:46.254495] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-27T22:16:46.256936] [INFO ] [MAIN ] Derivative Progress: 1787/1881 symbols completed. WAB took 1.3s. Estimated remaining: 38.3s. Rate: 147.3 symbols/min [2025-10-27T22:16:46.261097] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:46.261382] [INFO ] [MAIN ] Derivative Progress: 1788/1881 symbols completed. WAT took 1.3s. Estimated remaining: 37.9s. Rate: 147.4 symbols/min [2025-10-27T22:16:46.262105] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:46.272476] [DEBUG] [LOCAL ] WBX: Loaded 9485 existing records from primary storage. [2025-10-27T22:16:46.272969] [INFO ] [MAIN ] WBX: Loaded 9485 primary data records. [2025-10-27T22:16:46.501129] [DEBUG] [LOCAL ] WBS: Loaded 48813 existing records from primary storage. [2025-10-27T22:16:46.601072] [DEBUG] [LOCAL ] WCC: Loaded 38119 existing records from primary storage. [2025-10-27T22:16:46.614592] [INFO ] [MAIN ] WCC: Loaded 38119 primary data records. [2025-10-27T22:16:46.614722] [INFO ] [MAIN ] WBS: Loaded 48813 primary data records. [2025-10-27T22:16:47.279500] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:47.335886] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:47.351364] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:47.389450] [INFO ] [MAIN ] WBX: Generated 138 derivative records from 9485 primary records. [2025-10-27T22:16:47.389911] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-27T22:16:47.411004] [DEBUG] [LOCAL ] WBX: Derivative data saved (138 records). [2025-10-27T22:16:47.411227] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-27T22:16:47.413359] [INFO ] [MAIN ] Derivative Progress: 1789/1881 symbols completed. WBX took 1.2s. Estimated remaining: 37.5s. Rate: 147.2 symbols/min [2025-10-27T22:16:47.416332] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:47.439004] [INFO ] [MAIN ] WBS: Generated 138 derivative records from 48813 primary records. [2025-10-27T22:16:47.442542] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-27T22:16:47.469361] [DEBUG] [LOCAL ] WBS: Derivative data saved (138 records). [2025-10-27T22:16:47.469884] [INFO ] [MAIN ] WCC: Generated 138 derivative records from 38119 primary records. [2025-10-27T22:16:47.470060] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-27T22:16:47.470757] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-27T22:16:47.474972] [INFO ] [MAIN ] Derivative Progress: 1790/1881 symbols completed. WBS took 1.3s. Estimated remaining: 37.1s. Rate: 147.3 symbols/min [2025-10-27T22:16:47.484354] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:47.487902] [DEBUG] [LOCAL ] WCC: Derivative data saved (138 records). [2025-10-27T22:16:47.488688] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-27T22:16:47.491197] [INFO ] [MAIN ] Derivative Progress: 1791/1881 symbols completed. WCC took 1.2s. Estimated remaining: 36.6s. Rate: 147.4 symbols/min [2025-10-27T22:16:47.491486] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:47.506601] [DEBUG] [LOCAL ] WCN: Loaded 47789 existing records from primary storage. [2025-10-27T22:16:47.507024] [INFO ] [MAIN ] WCN: Loaded 47789 primary data records. [2025-10-27T22:16:47.678576] [DEBUG] [LOCAL ] WDH: Loaded 17911 existing records from primary storage. [2025-10-27T22:16:47.709738] [INFO ] [MAIN ] WDH: Loaded 17911 primary data records. [2025-10-27T22:16:47.703922] [DEBUG] [LOCAL ] WD: Loaded 22168 existing records from primary storage. [2025-10-27T22:16:47.848405] [INFO ] [MAIN ] WD: Loaded 22168 primary data records. [2025-10-27T22:16:48.487677] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:48.549221] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:48.580133] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:48.624141] [INFO ] [MAIN ] WCN: Generated 138 derivative records from 47789 primary records. [2025-10-27T22:16:48.627081] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-27T22:16:48.649101] [DEBUG] [LOCAL ] WCN: Derivative data saved (138 records). [2025-10-27T22:16:48.649306] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-27T22:16:48.655307] [INFO ] [MAIN ] Derivative Progress: 1792/1881 symbols completed. WCN took 1.2s. Estimated remaining: 36.3s. Rate: 147.2 symbols/min [2025-10-27T22:16:48.656590] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:48.670299] [INFO ] [MAIN ] WD: Generated 138 derivative records from 22168 primary records. [2025-10-27T22:16:48.670734] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-27T22:16:48.670462] [INFO ] [MAIN ] WDH: Generated 138 derivative records from 17911 primary records. [2025-10-27T22:16:48.676545] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-27T22:16:48.697721] [DEBUG] [LOCAL ] WD: Derivative data saved (138 records). [2025-10-27T22:16:48.699789] [DEBUG] [LOCAL ] WDH: Derivative data saved (138 records). [2025-10-27T22:16:48.697835] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-27T22:16:48.699926] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-27T22:16:48.702921] [INFO ] [MAIN ] Derivative Progress: 1793/1881 symbols completed. WD took 1.2s. Estimated remaining: 35.8s. Rate: 147.3 symbols/min [2025-10-27T22:16:48.703130] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:48.705440] [INFO ] [MAIN ] Derivative Progress: 1794/1881 symbols completed. WDH took 1.2s. Estimated remaining: 35.4s. Rate: 147.4 symbols/min [2025-10-27T22:16:48.706539] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:48.714246] [DEBUG] [LOCAL ] WDI: Loaded 20832 existing records from primary storage. [2025-10-27T22:16:48.714475] [INFO ] [MAIN ] WDI: Loaded 20832 primary data records. [2025-10-27T22:16:48.821745] [DEBUG] [LOCAL ] WEA: Loaded 7817 existing records from primary storage. [2025-10-27T22:16:48.825062] [INFO ] [MAIN ] WEA: Loaded 7817 primary data records. [2025-10-27T22:16:49.033833] [DEBUG] [LOCAL ] WDS: Loaded 42786 existing records from primary storage. [2025-10-27T22:16:49.143285] [INFO ] [MAIN ] WDS: Loaded 42786 primary data records. [2025-10-27T22:16:49.912832] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:49.914511] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:50.007028] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:50.058450] [INFO ] [MAIN ] WEA: Generated 138 derivative records from 7817 primary records. [2025-10-27T22:16:50.062573] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-27T22:16:50.083472] [INFO ] [MAIN ] WDI: Generated 138 derivative records from 20832 primary records. [2025-10-27T22:16:50.086913] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-27T22:16:50.109724] [DEBUG] [LOCAL ] WEA: Derivative data saved (138 records). [2025-10-27T22:16:50.114839] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-27T22:16:50.118580] [INFO ] [MAIN ] Derivative Progress: 1795/1881 symbols completed. WEA took 1.4s. Estimated remaining: 35.1s. Rate: 147.2 symbols/min [2025-10-27T22:16:50.120231] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:50.124126] [DEBUG] [LOCAL ] WDI: Derivative data saved (138 records). [2025-10-27T22:16:50.125406] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-27T22:16:50.128695] [INFO ] [MAIN ] Derivative Progress: 1796/1881 symbols completed. WDI took 1.5s. Estimated remaining: 34.6s. Rate: 147.2 symbols/min [2025-10-27T22:16:50.129301] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:50.135290] [INFO ] [MAIN ] WDS: Generated 138 derivative records from 42786 primary records. [2025-10-27T22:16:50.135475] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-27T22:16:50.155254] [DEBUG] [LOCAL ] WDS: Derivative data saved (138 records). [2025-10-27T22:16:50.155743] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-27T22:16:50.159790] [INFO ] [MAIN ] Derivative Progress: 1797/1881 symbols completed. WDS took 1.5s. Estimated remaining: 34.2s. Rate: 147.3 symbols/min [2025-10-27T22:16:50.160296] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:50.197540] [DEBUG] [LOCAL ] WEAV: Loaded 42190 existing records from primary storage. [2025-10-27T22:16:50.197958] [INFO ] [MAIN ] WEAV: Loaded 42190 primary data records. [2025-10-27T22:16:50.584210] [DEBUG] [LOCAL ] WELL: Loaded 52274 existing records from primary storage. [2025-10-27T22:16:50.585333] [INFO ] [MAIN ] WELL: Loaded 52274 primary data records. [2025-10-27T22:16:50.586374] [DEBUG] [LOCAL ] WEC: Loaded 52101 existing records from primary storage. [2025-10-27T22:16:50.586730] [INFO ] [MAIN ] WEC: Loaded 52101 primary data records. [2025-10-27T22:16:51.199544] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:51.231148] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:51.269426] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:51.315744] [INFO ] [MAIN ] WEAV: Generated 138 derivative records from 42190 primary records. [2025-10-27T22:16:51.319737] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-27T22:16:51.319925] [INFO ] [MAIN ] WELL: Generated 138 derivative records from 52274 primary records. [2025-10-27T22:16:51.320048] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-27T22:16:51.340462] [DEBUG] [LOCAL ] WEAV: Derivative data saved (138 records). [2025-10-27T22:16:51.344931] [DEBUG] [LOCAL ] WELL: Derivative data saved (138 records). [2025-10-27T22:16:51.342009] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-27T22:16:51.349547] [INFO ] [MAIN ] Derivative Progress: 1798/1881 symbols completed. WEAV took 1.2s. Estimated remaining: 33.8s. Rate: 147.2 symbols/min [2025-10-27T22:16:51.349670] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-27T22:16:51.353310] [INFO ] [MAIN ] Derivative Progress: 1799/1881 symbols completed. WELL took 1.2s. Estimated remaining: 33.4s. Rate: 147.2 symbols/min [2025-10-27T22:16:51.355052] [INFO ] [MAIN ] WEC: Generated 138 derivative records from 52101 primary records. [2025-10-27T22:16:51.355122] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-27T22:16:51.367189] [DEBUG] [LOCAL ] WEC: Derivative data saved (138 records). [2025-10-27T22:16:51.367244] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-27T22:16:51.369682] [INFO ] [MAIN ] Derivative Progress: 1800/1881 symbols completed. WEC took 1.2s. Estimated remaining: 33.0s. Rate: 147.3 symbols/min [2025-10-27T22:16:51.369995] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:51.370084] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:51.370136] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:51.381789] [DEBUG] [LOCAL ] WF: Loaded 10521 existing records from primary storage. [2025-10-27T22:16:51.381987] [INFO ] [MAIN ] WF: Loaded 10521 primary data records. [2025-10-27T22:16:51.559531] [DEBUG] [LOCAL ] WEX: Loaded 31810 existing records from primary storage. [2025-10-27T22:16:51.585852] [INFO ] [MAIN ] WEX: Loaded 31810 primary data records. [2025-10-27T22:16:51.807105] [DEBUG] [LOCAL ] WES: Loaded 48645 existing records from primary storage. [2025-10-27T22:16:51.833142] [INFO ] [MAIN ] WES: Loaded 48645 primary data records. [2025-10-27T22:16:52.437111] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:52.481390] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:52.523044] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:52.554357] [INFO ] [MAIN ] WF: Generated 138 derivative records from 10521 primary records. [2025-10-27T22:16:52.555227] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-27T22:16:52.571890] [DEBUG] [LOCAL ] WF: Derivative data saved (138 records). [2025-10-27T22:16:52.576116] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-27T22:16:52.581327] [INFO ] [MAIN ] Derivative Progress: 1801/1881 symbols completed. WF took 1.2s. Estimated remaining: 32.6s. Rate: 147.2 symbols/min [2025-10-27T22:16:52.581474] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:52.597485] [INFO ] [MAIN ] WEX: Generated 138 derivative records from 31810 primary records. [2025-10-27T22:16:52.599079] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-27T22:16:52.601380] [INFO ] [MAIN ] WES: Generated 138 derivative records from 48645 primary records. [2025-10-27T22:16:52.602389] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-27T22:16:52.622516] [DEBUG] [LOCAL ] WEX: Derivative data saved (138 records). [2025-10-27T22:16:52.624775] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-27T22:16:52.628041] [DEBUG] [LOCAL ] WES: Derivative data saved (138 records). [2025-10-27T22:16:52.630468] [INFO ] [MAIN ] Derivative Progress: 1802/1881 symbols completed. WEX took 1.3s. Estimated remaining: 32.2s. Rate: 147.2 symbols/min [2025-10-27T22:16:52.630668] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:52.628204] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-27T22:16:52.634485] [INFO ] [MAIN ] Derivative Progress: 1803/1881 symbols completed. WES took 1.3s. Estimated remaining: 31.8s. Rate: 147.3 symbols/min [2025-10-27T22:16:52.635012] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:52.694858] [DEBUG] [LOCAL ] WFG: Loaded 24243 existing records from primary storage. [2025-10-27T22:16:52.695990] [INFO ] [MAIN ] WFG: Loaded 24243 primary data records. [2025-10-27T22:16:52.695821] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-27T22:16:52.701439] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-27T22:16:52.953868] [DEBUG] [LOCAL ] WGO: Loaded 37932 existing records from primary storage. [2025-10-27T22:16:53.019494] [INFO ] [MAIN ] WGO: Loaded 37932 primary data records. [2025-10-27T22:16:53.704496] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:53.738833] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:53.784756] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:53.845971] [INFO ] [MAIN ] WFG: Generated 138 derivative records from 24243 primary records. [2025-10-27T22:16:53.848724] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-27T22:16:53.863745] [INFO ] [MAIN ] WFC: Generated 138 derivative records from 53748 primary records. [2025-10-27T22:16:53.869687] [DEBUG] [LOCAL ] WFG: Derivative data saved (138 records). [2025-10-27T22:16:53.869900] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-27T22:16:53.869975] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-27T22:16:53.871834] [INFO ] [MAIN ] Derivative Progress: 1804/1881 symbols completed. WFG took 1.2s. Estimated remaining: 31.4s. Rate: 147.2 symbols/min [2025-10-27T22:16:53.872821] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:53.888363] [DEBUG] [LOCAL ] WFC: Derivative data saved (138 records). [2025-10-27T22:16:53.888966] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-27T22:16:53.891856] [INFO ] [MAIN ] Derivative Progress: 1805/1881 symbols completed. WFC took 1.3s. Estimated remaining: 31.0s. Rate: 147.2 symbols/min [2025-10-27T22:16:53.893284] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:53.896388] [INFO ] [MAIN ] WGO: Generated 138 derivative records from 37932 primary records. [2025-10-27T22:16:53.896721] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-27T22:16:53.912205] [DEBUG] [LOCAL ] WGO: Derivative data saved (138 records). [2025-10-27T22:16:53.912291] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-27T22:16:53.915745] [INFO ] [MAIN ] Derivative Progress: 1806/1881 symbols completed. WGO took 1.3s. Estimated remaining: 30.5s. Rate: 147.3 symbols/min [2025-10-27T22:16:53.915993] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:53.931805] [DEBUG] [LOCAL ] WHG: Loaded 2977 existing records from primary storage. [2025-10-27T22:16:53.932218] [INFO ] [MAIN ] WHG: Loaded 2977 primary data records. [2025-10-27T22:16:54.102723] [DEBUG] [LOCAL ] WH: Loaded 45314 existing records from primary storage. [2025-10-27T22:16:54.122941] [INFO ] [MAIN ] WH: Loaded 45314 primary data records. [2025-10-27T22:16:54.352879] [DEBUG] [LOCAL ] WHD: Loaded 39696 existing records from primary storage. [2025-10-27T22:16:54.363908] [INFO ] [MAIN ] WHD: Loaded 39696 primary data records. [2025-10-27T22:16:54.992811] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:55.043016] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:55.068913] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:55.097006] [INFO ] [MAIN ] WHG: Generated 138 derivative records from 2977 primary records. [2025-10-27T22:16:55.100058] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-27T22:16:55.122426] [DEBUG] [LOCAL ] WHG: Derivative data saved (138 records). [2025-10-27T22:16:55.124035] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-27T22:16:55.126627] [INFO ] [MAIN ] Derivative Progress: 1807/1881 symbols completed. WHG took 1.2s. Estimated remaining: 30.2s. Rate: 147.1 symbols/min [2025-10-27T22:16:55.128289] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:55.152446] [INFO ] [MAIN ] WH: Generated 138 derivative records from 45314 primary records. [2025-10-27T22:16:55.153017] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-27T22:16:55.156216] [INFO ] [MAIN ] WHD: Generated 138 derivative records from 39696 primary records. [2025-10-27T22:16:55.163576] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-27T22:16:55.168509] [DEBUG] [LOCAL ] WH: Derivative data saved (138 records). [2025-10-27T22:16:55.168714] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-27T22:16:55.171166] [INFO ] [MAIN ] Derivative Progress: 1808/1881 symbols completed. WH took 1.3s. Estimated remaining: 29.8s. Rate: 147.2 symbols/min [2025-10-27T22:16:55.180022] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:55.183276] [DEBUG] [LOCAL ] WHD: Derivative data saved (138 records). [2025-10-27T22:16:55.183816] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-27T22:16:55.186852] [INFO ] [MAIN ] Derivative Progress: 1809/1881 symbols completed. WHD took 1.3s. Estimated remaining: 29.3s. Rate: 147.3 symbols/min [2025-10-27T22:16:55.187120] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:55.203876] [DEBUG] [LOCAL ] WIA: Loaded 4998 existing records from primary storage. [2025-10-27T22:16:55.204114] [INFO ] [MAIN ] WIA: Loaded 4998 primary data records. [2025-10-27T22:16:55.333311] [DEBUG] [LOCAL ] WHR: Loaded 48831 existing records from primary storage. [2025-10-27T22:16:55.339449] [INFO ] [MAIN ] WHR: Loaded 48831 primary data records. [2025-10-27T22:16:55.334079] [DEBUG] [LOCAL ] WINN: Loaded 10950 existing records from primary storage. [2025-10-27T22:16:55.381766] [INFO ] [MAIN ] WINN: Loaded 10950 primary data records. [2025-10-27T22:16:56.200182] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:56.239756] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:56.271672] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:56.319892] [INFO ] [MAIN ] WIA: Generated 138 derivative records from 4998 primary records. [2025-10-27T22:16:56.324524] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-27T22:16:56.340171] [DEBUG] [LOCAL ] WIA: Derivative data saved (138 records). [2025-10-27T22:16:56.340461] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-27T22:16:56.345573] [INFO ] [MAIN ] Derivative Progress: 1810/1881 symbols completed. WIA took 1.2s. Estimated remaining: 29.0s. Rate: 147.1 symbols/min [2025-10-27T22:16:56.346421] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:56.353776] [INFO ] [MAIN ] WINN: Generated 138 derivative records from 10950 primary records. [2025-10-27T22:16:56.353968] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-27T22:16:56.367868] [DEBUG] [LOCAL ] WINN: Derivative data saved (138 records). [2025-10-27T22:16:56.369977] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-27T22:16:56.369890] [INFO ] [MAIN ] WHR: Generated 138 derivative records from 48831 primary records. [2025-10-27T22:16:56.372674] [INFO ] [MAIN ] Derivative Progress: 1811/1881 symbols completed. WINN took 1.2s. Estimated remaining: 28.5s. Rate: 147.2 symbols/min [2025-10-27T22:16:56.372863] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:56.373107] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-27T22:16:56.386033] [DEBUG] [LOCAL ] WHR: Derivative data saved (138 records). [2025-10-27T22:16:56.386240] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-27T22:16:56.388771] [INFO ] [MAIN ] Derivative Progress: 1812/1881 symbols completed. WHR took 1.3s. Estimated remaining: 28.1s. Rate: 147.3 symbols/min [2025-10-27T22:16:56.388964] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:56.415591] [DEBUG] [LOCAL ] WIW: Loaded 20070 existing records from primary storage. [2025-10-27T22:16:56.415720] [INFO ] [MAIN ] WIW: Loaded 20070 primary data records. [2025-10-27T22:16:56.538185] [DEBUG] [LOCAL ] WIT: Loaded 52538 existing records from primary storage. [2025-10-27T22:16:56.538735] [INFO ] [MAIN ] WIT: Loaded 52538 primary data records. [2025-10-27T22:16:56.704100] [DEBUG] [LOCAL ] WK: Loaded 36650 existing records from primary storage. [2025-10-27T22:16:56.719787] [INFO ] [MAIN ] WK: Loaded 36650 primary data records. [2025-10-27T22:16:57.380978] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:57.381829] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:57.445606] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:57.493628] [INFO ] [MAIN ] WIT: Generated 138 derivative records from 52538 primary records. [2025-10-27T22:16:57.495351] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-27T22:16:57.501338] [INFO ] [MAIN ] WIW: Generated 138 derivative records from 20070 primary records. [2025-10-27T22:16:57.514540] [DEBUG] [LOCAL ] WIT: Derivative data saved (138 records). [2025-10-27T22:16:57.514719] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-27T22:16:57.515001] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-27T22:16:57.520442] [INFO ] [MAIN ] Derivative Progress: 1813/1881 symbols completed. WIT took 1.2s. Estimated remaining: 27.7s. Rate: 147.2 symbols/min [2025-10-27T22:16:57.532776] [DEBUG] [LOCAL ] WIW: Derivative data saved (138 records). [2025-10-27T22:16:57.536260] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-27T22:16:57.536158] [INFO ] [MAIN ] WK: Generated 138 derivative records from 36650 primary records. [2025-10-27T22:16:57.538407] [INFO ] [MAIN ] Derivative Progress: 1814/1881 symbols completed. WIW took 1.2s. Estimated remaining: 27.3s. Rate: 147.2 symbols/min [2025-10-27T22:16:57.538694] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-27T22:16:57.550342] [DEBUG] [LOCAL ] WK: Derivative data saved (138 records). [2025-10-27T22:16:57.550407] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-27T22:16:57.553117] [INFO ] [MAIN ] Derivative Progress: 1815/1881 symbols completed. WK took 1.2s. Estimated remaining: 26.9s. Rate: 147.3 symbols/min [2025-10-27T22:16:57.553540] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:57.554029] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:57.553742] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:57.564761] [DEBUG] [LOCAL ] WLKP: Loaded 7160 existing records from primary storage. [2025-10-27T22:16:57.564963] [INFO ] [MAIN ] WLKP: Loaded 7160 primary data records. [2025-10-27T22:16:57.727232] [DEBUG] [LOCAL ] WKC: Loaded 34239 existing records from primary storage. [2025-10-27T22:16:57.749149] [INFO ] [MAIN ] WKC: Loaded 34239 primary data records. [2025-10-27T22:16:57.938229] [DEBUG] [LOCAL ] WLK: Loaded 45684 existing records from primary storage. [2025-10-27T22:16:57.979564] [INFO ] [MAIN ] WLK: Loaded 45684 primary data records. [2025-10-27T22:16:58.626906] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:58.674081] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:58.706222] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:58.746573] [INFO ] [MAIN ] WLKP: Generated 138 derivative records from 7160 primary records. [2025-10-27T22:16:58.751003] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-27T22:16:58.768342] [DEBUG] [LOCAL ] WLKP: Derivative data saved (138 records). [2025-10-27T22:16:58.768494] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-27T22:16:58.772219] [INFO ] [MAIN ] Derivative Progress: 1816/1881 symbols completed. WLKP took 1.2s. Estimated remaining: 26.5s. Rate: 147.2 symbols/min [2025-10-27T22:16:58.775931] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:58.790962] [INFO ] [MAIN ] WLK: Generated 138 derivative records from 45684 primary records. [2025-10-27T22:16:58.789111] [INFO ] [MAIN ] WKC: Generated 138 derivative records from 34239 primary records. [2025-10-27T22:16:58.791112] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-27T22:16:58.791191] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-27T22:16:58.812380] [DEBUG] [LOCAL ] WLK: Derivative data saved (138 records). [2025-10-27T22:16:58.822598] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-27T22:16:58.825088] [DEBUG] [LOCAL ] WKC: Derivative data saved (138 records). [2025-10-27T22:16:58.825188] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-27T22:16:58.827560] [INFO ] [MAIN ] Derivative Progress: 1817/1881 symbols completed. WKC took 1.3s. Estimated remaining: 26.1s. Rate: 147.2 symbols/min [2025-10-27T22:16:58.830778] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:58.830962] [INFO ] [MAIN ] Derivative Progress: 1818/1881 symbols completed. WLK took 1.3s. Estimated remaining: 25.7s. Rate: 147.3 symbols/min [2025-10-27T22:16:58.831422] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:16:58.845026] [DEBUG] [LOCAL ] WLY: Loaded 29484 existing records from primary storage. [2025-10-27T22:16:58.845297] [INFO ] [MAIN ] WLY: Loaded 29484 primary data records. [2025-10-27T22:16:59.234613] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-27T22:16:59.235949] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-27T22:16:59.235867] [DEBUG] [LOCAL ] WM: Loaded 50815 existing records from primary storage. [2025-10-27T22:16:59.236164] [INFO ] [MAIN ] WM: Loaded 50815 primary data records. [2025-10-27T22:16:59.892513] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:59.969153] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:16:59.969914] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:00.017154] [INFO ] [MAIN ] WLY: Generated 138 derivative records from 29484 primary records. [2025-10-27T22:17:00.022414] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-27T22:17:00.050713] [DEBUG] [LOCAL ] WLY: Derivative data saved (138 records). [2025-10-27T22:17:00.054537] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-27T22:17:00.057809] [INFO ] [MAIN ] Derivative Progress: 1819/1881 symbols completed. WLY took 1.3s. Estimated remaining: 25.3s. Rate: 147.1 symbols/min [2025-10-27T22:17:00.059805] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:00.084934] [INFO ] [MAIN ] WMB: Generated 138 derivative records from 53672 primary records. [2025-10-27T22:17:00.088015] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-27T22:17:00.088903] [INFO ] [MAIN ] WM: Generated 138 derivative records from 50815 primary records. [2025-10-27T22:17:00.089877] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-27T22:17:00.112536] [DEBUG] [LOCAL ] WMK: Loaded 14444 existing records from primary storage. [2025-10-27T22:17:00.111389] [DEBUG] [LOCAL ] WMB: Derivative data saved (138 records). [2025-10-27T22:17:00.112958] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-27T22:17:00.115608] [INFO ] [MAIN ] Derivative Progress: 1820/1881 symbols completed. WMB took 1.3s. Estimated remaining: 24.9s. Rate: 147.2 symbols/min [2025-10-27T22:17:00.115803] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:00.112769] [INFO ] [MAIN ] WMK: Loaded 14444 primary data records. [2025-10-27T22:17:00.133921] [DEBUG] [LOCAL ] WM: Derivative data saved (138 records). [2025-10-27T22:17:00.172035] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-27T22:17:00.193457] [INFO ] [MAIN ] Derivative Progress: 1821/1881 symbols completed. WM took 1.4s. Estimated remaining: 24.4s. Rate: 147.3 symbols/min [2025-10-27T22:17:00.207809] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:00.541100] [DEBUG] [LOCAL ] WMS: Loaded 39264 existing records from primary storage. [2025-10-27T22:17:00.542402] [INFO ] [MAIN ] WMS: Loaded 39264 primary data records. [2025-10-27T22:17:00.742441] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-27T22:17:00.748392] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-27T22:17:01.175291] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:01.360465] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:01.375428] [INFO ] [MAIN ] WMK: Generated 138 derivative records from 14444 primary records. [2025-10-27T22:17:01.379106] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-27T22:17:01.408207] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:01.414512] [DEBUG] [LOCAL ] WMK: Derivative data saved (138 records). [2025-10-27T22:17:01.427488] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-27T22:17:01.435430] [INFO ] [MAIN ] Derivative Progress: 1822/1881 symbols completed. WMK took 1.4s. Estimated remaining: 24.1s. Rate: 147.1 symbols/min [2025-10-27T22:17:01.439310] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:01.483328] [INFO ] [MAIN ] WMS: Generated 138 derivative records from 39264 primary records. [2025-10-27T22:17:01.483764] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-27T22:17:01.502285] [INFO ] [MAIN ] WMT: Generated 138 derivative records from 53800 primary records. [2025-10-27T22:17:01.502034] [DEBUG] [LOCAL ] WMS: Derivative data saved (138 records). [2025-10-27T22:17:01.503614] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-27T22:17:01.503790] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-27T22:17:01.515600] [INFO ] [MAIN ] Derivative Progress: 1823/1881 symbols completed. WMS took 1.4s. Estimated remaining: 23.6s. Rate: 147.2 symbols/min [2025-10-27T22:17:01.531149] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:01.533268] [DEBUG] [LOCAL ] WMT: Derivative data saved (138 records). [2025-10-27T22:17:01.535058] [DEBUG] [LOCAL ] WNC: Loaded 37717 existing records from primary storage. [2025-10-27T22:17:01.535833] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-27T22:17:01.535936] [INFO ] [MAIN ] WNC: Loaded 37717 primary data records. [2025-10-27T22:17:01.539221] [INFO ] [MAIN ] Derivative Progress: 1824/1881 symbols completed. WMT took 1.3s. Estimated remaining: 23.2s. Rate: 147.2 symbols/min [2025-10-27T22:17:01.539998] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:01.760759] [DEBUG] [LOCAL ] WOR: Loaded 23081 existing records from primary storage. [2025-10-27T22:17:01.882215] [INFO ] [MAIN ] WOR: Loaded 23081 primary data records. [2025-10-27T22:17:02.003384] [DEBUG] [LOCAL ] WOLF: Loaded 52894 existing records from primary storage. [2025-10-27T22:17:02.020184] [INFO ] [MAIN ] WOLF: Loaded 52894 primary data records. [2025-10-27T22:17:02.580955] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:02.635096] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:02.680509] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:02.814476] [INFO ] [MAIN ] WNC: Generated 138 derivative records from 37717 primary records. [2025-10-27T22:17:02.817077] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-27T22:17:02.837503] [DEBUG] [LOCAL ] WNC: Derivative data saved (138 records). [2025-10-27T22:17:02.839395] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-27T22:17:02.842391] [INFO ] [MAIN ] Derivative Progress: 1825/1881 symbols completed. WNC took 1.4s. Estimated remaining: 22.8s. Rate: 147.1 symbols/min [2025-10-27T22:17:02.842780] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:02.858410] [INFO ] [MAIN ] WOR: Generated 138 derivative records from 23081 primary records. [2025-10-27T22:17:02.859171] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-27T22:17:02.873387] [DEBUG] [LOCAL ] WOR: Derivative data saved (138 records). [2025-10-27T22:17:02.873711] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-27T22:17:02.876753] [INFO ] [MAIN ] Derivative Progress: 1826/1881 symbols completed. WOR took 1.3s. Estimated remaining: 22.4s. Rate: 147.1 symbols/min [2025-10-27T22:17:02.879392] [INFO ] [MAIN ] WOLF: Generated 138 derivative records from 52894 primary records. [2025-10-27T22:17:02.888317] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:02.888605] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-27T22:17:02.901917] [DEBUG] [LOCAL ] WOLF: Derivative data saved (138 records). [2025-10-27T22:17:02.902074] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-27T22:17:02.904734] [INFO ] [MAIN ] Derivative Progress: 1827/1881 symbols completed. WOLF took 1.4s. Estimated remaining: 22.0s. Rate: 147.2 symbols/min [2025-10-27T22:17:02.904982] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:02.918314] [DEBUG] [LOCAL ] WOW: Loaded 30895 existing records from primary storage. [2025-10-27T22:17:02.918547] [INFO ] [MAIN ] WOW: Loaded 30895 primary data records. [2025-10-27T22:17:03.168931] [DEBUG] [LOCAL ] WPC: Loaded 47998 existing records from primary storage. [2025-10-27T22:17:03.271713] [INFO ] [MAIN ] WPC: Loaded 47998 primary data records. [2025-10-27T22:17:03.286989] [DEBUG] [LOCAL ] WPM: Loaded 52788 existing records from primary storage. [2025-10-27T22:17:03.288010] [INFO ] [MAIN ] WPM: Loaded 52788 primary data records. [2025-10-27T22:17:03.948184] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:03.991154] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:04.027710] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:04.062245] [INFO ] [MAIN ] WOW: Generated 138 derivative records from 30895 primary records. [2025-10-27T22:17:04.062832] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-27T22:17:04.083330] [DEBUG] [LOCAL ] WOW: Derivative data saved (138 records). [2025-10-27T22:17:04.083942] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-27T22:17:04.090071] [INFO ] [MAIN ] Derivative Progress: 1828/1881 symbols completed. WOW took 1.2s. Estimated remaining: 21.6s. Rate: 147.1 symbols/min [2025-10-27T22:17:04.103441] [INFO ] [MAIN ] WPM: Generated 138 derivative records from 52788 primary records. [2025-10-27T22:17:04.103776] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-27T22:17:04.107992] [INFO ] [MAIN ] WPC: Generated 138 derivative records from 47998 primary records. [2025-10-27T22:17:04.117731] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-27T22:17:04.121180] [DEBUG] [LOCAL ] WPM: Derivative data saved (138 records). [2025-10-27T22:17:04.121276] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-27T22:17:04.124238] [INFO ] [MAIN ] Derivative Progress: 1829/1881 symbols completed. WPM took 1.2s. Estimated remaining: 21.2s. Rate: 147.1 symbols/min [2025-10-27T22:17:04.135794] [DEBUG] [LOCAL ] WPC: Derivative data saved (138 records). [2025-10-27T22:17:04.135895] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-27T22:17:04.138400] [INFO ] [MAIN ] Derivative Progress: 1830/1881 symbols completed. WPC took 1.3s. Estimated remaining: 20.8s. Rate: 147.2 symbols/min [2025-10-27T22:17:04.139007] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:04.139114] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:04.138946] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:04.198162] [DEBUG] [LOCAL ] WPP: Loaded 34034 existing records from primary storage. [2025-10-27T22:17:04.211825] [INFO ] [MAIN ] WPP: Loaded 34034 primary data records. [2025-10-27T22:17:04.243345] [DEBUG] [LOCAL ] WRBY: Loaded 50611 existing records from primary storage. [2025-10-27T22:17:04.255365] [INFO ] [MAIN ] WRBY: Loaded 50611 primary data records. [2025-10-27T22:17:04.343057] [DEBUG] [LOCAL ] WRB: Loaded 50774 existing records from primary storage. [2025-10-27T22:17:04.363355] [INFO ] [MAIN ] WRB: Loaded 50774 primary data records. [2025-10-27T22:17:05.241135] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:05.253594] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:05.293071] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:05.347125] [INFO ] [MAIN ] WRBY: Generated 138 derivative records from 50611 primary records. [2025-10-27T22:17:05.347235] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-27T22:17:05.364628] [DEBUG] [LOCAL ] WRBY: Derivative data saved (138 records). [2025-10-27T22:17:05.365020] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-27T22:17:05.369029] [INFO ] [MAIN ] Derivative Progress: 1831/1881 symbols completed. WRBY took 1.2s. Estimated remaining: 20.4s. Rate: 147.1 symbols/min [2025-10-27T22:17:05.369182] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:05.376958] [INFO ] [MAIN ] WPP: Generated 138 derivative records from 34034 primary records. [2025-10-27T22:17:05.377452] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-27T22:17:05.402239] [DEBUG] [LOCAL ] WPP: Derivative data saved (138 records). [2025-10-27T22:17:05.402116] [INFO ] [MAIN ] WRB: Generated 138 derivative records from 50774 primary records. [2025-10-27T22:17:05.402513] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-27T22:17:05.404414] [INFO ] [MAIN ] Derivative Progress: 1832/1881 symbols completed. WPP took 1.3s. Estimated remaining: 20.0s. Rate: 147.1 symbols/min [2025-10-27T22:17:05.404492] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-27T22:17:05.404796] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:05.413473] [DEBUG] [LOCAL ] WS: Loaded 23168 existing records from primary storage. [2025-10-27T22:17:05.421921] [INFO ] [MAIN ] WS: Loaded 23168 primary data records. [2025-10-27T22:17:05.435692] [DEBUG] [LOCAL ] WRB: Derivative data saved (138 records). [2025-10-27T22:17:05.444956] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-27T22:17:05.462418] [INFO ] [MAIN ] Derivative Progress: 1833/1881 symbols completed. WRB took 1.3s. Estimated remaining: 19.6s. Rate: 147.2 symbols/min [2025-10-27T22:17:05.480820] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:05.749368] [DEBUG] [LOCAL ] WSM: Loaded 48464 existing records from primary storage. [2025-10-27T22:17:05.749694] [INFO ] [MAIN ] WSM: Loaded 48464 primary data records. [2025-10-27T22:17:05.789888] [DEBUG] [LOCAL ] WSO: Loaded 25997 existing records from primary storage. [2025-10-27T22:17:05.814011] [INFO ] [MAIN ] WSO: Loaded 25997 primary data records. [2025-10-27T22:17:06.373237] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:06.435836] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:06.437887] [INFO ] [MAIN ] WS: Generated 138 derivative records from 23168 primary records. [2025-10-27T22:17:06.457040] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-27T22:17:06.464318] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:06.492471] [DEBUG] [LOCAL ] WS: Derivative data saved (138 records). [2025-10-27T22:17:06.495592] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-27T22:17:06.500115] [INFO ] [MAIN ] Derivative Progress: 1834/1881 symbols completed. WS took 1.1s. Estimated remaining: 19.2s. Rate: 147.1 symbols/min [2025-10-27T22:17:06.501703] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:06.537670] [INFO ] [MAIN ] WSO: Generated 138 derivative records from 25997 primary records. [2025-10-27T22:17:06.537442] [DEBUG] [LOCAL ] WSR: Loaded 22100 existing records from primary storage. [2025-10-27T22:17:06.540451] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-27T22:17:06.540796] [INFO ] [MAIN ] WSR: Loaded 22100 primary data records. [2025-10-27T22:17:06.575309] [DEBUG] [LOCAL ] WSO: Derivative data saved (138 records). [2025-10-27T22:17:06.593901] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-27T22:17:06.600862] [INFO ] [MAIN ] WSM: Generated 138 derivative records from 48464 primary records. [2025-10-27T22:17:06.602895] [INFO ] [MAIN ] Derivative Progress: 1835/1881 symbols completed. WSO took 1.1s. Estimated remaining: 18.8s. Rate: 147.1 symbols/min [2025-10-27T22:17:06.623497] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-27T22:17:06.623446] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:06.674266] [DEBUG] [LOCAL ] WSM: Derivative data saved (138 records). [2025-10-27T22:17:06.679723] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-27T22:17:06.692715] [INFO ] [MAIN ] Derivative Progress: 1836/1881 symbols completed. WSM took 1.3s. Estimated remaining: 18.3s. Rate: 147.2 symbols/min [2025-10-27T22:17:06.692925] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:06.896569] [DEBUG] [LOCAL ] WST: Loaded 36589 existing records from primary storage. [2025-10-27T22:17:06.897341] [INFO ] [MAIN ] WST: Loaded 36589 primary data records. [2025-10-27T22:17:07.025413] [DEBUG] [LOCAL ] WT: Loaded 48144 existing records from primary storage. [2025-10-27T22:17:07.031431] [INFO ] [MAIN ] WT: Loaded 48144 primary data records. [2025-10-27T22:17:07.433291] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:07.624137] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:07.640943] [INFO ] [MAIN ] WSR: Generated 138 derivative records from 22100 primary records. [2025-10-27T22:17:07.642967] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-27T22:17:07.668102] [DEBUG] [LOCAL ] WSR: Derivative data saved (138 records). [2025-10-27T22:17:07.669220] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-27T22:17:07.674821] [INFO ] [MAIN ] Derivative Progress: 1837/1881 symbols completed. WSR took 1.2s. Estimated remaining: 17.9s. Rate: 147.1 symbols/min [2025-10-27T22:17:07.675467] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:07.693371] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:07.720288] [INFO ] [MAIN ] WST: Generated 138 derivative records from 36589 primary records. [2025-10-27T22:17:07.721984] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-27T22:17:07.749767] [DEBUG] [LOCAL ] WST: Derivative data saved (138 records). [2025-10-27T22:17:07.751154] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-27T22:17:07.753791] [INFO ] [MAIN ] Derivative Progress: 1838/1881 symbols completed. WST took 1.1s. Estimated remaining: 17.5s. Rate: 147.1 symbols/min [2025-10-27T22:17:07.754067] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:07.779762] [DEBUG] [LOCAL ] WTI: Loaded 44692 existing records from primary storage. [2025-10-27T22:17:07.782259] [INFO ] [MAIN ] WTI: Loaded 44692 primary data records. [2025-10-27T22:17:07.782449] [INFO ] [MAIN ] WT: Generated 138 derivative records from 48144 primary records. [2025-10-27T22:17:07.782704] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-27T22:17:07.870253] [DEBUG] [LOCAL ] WT: Derivative data saved (138 records). [2025-10-27T22:17:07.875565] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-27T22:17:07.889434] [INFO ] [MAIN ] Derivative Progress: 1839/1881 symbols completed. WT took 1.2s. Estimated remaining: 17.1s. Rate: 147.2 symbols/min [2025-10-27T22:17:07.896873] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:08.141852] [DEBUG] [LOCAL ] WTS: Loaded 16949 existing records from primary storage. [2025-10-27T22:17:08.140520] [DEBUG] [LOCAL ] WTRG: Loaded 50865 existing records from primary storage. [2025-10-27T22:17:08.142175] [INFO ] [MAIN ] WTRG: Loaded 50865 primary data records. [2025-10-27T22:17:08.163777] [INFO ] [MAIN ] WTS: Loaded 16949 primary data records. [2025-10-27T22:17:08.765681] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:08.826427] [INFO ] [MAIN ] WTI: Generated 138 derivative records from 44692 primary records. [2025-10-27T22:17:08.839282] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:08.839548] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:08.862329] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-27T22:17:08.885487] [DEBUG] [LOCAL ] WTI: Derivative data saved (138 records). [2025-10-27T22:17:08.885674] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-27T22:17:08.892880] [INFO ] [MAIN ] Derivative Progress: 1840/1881 symbols completed. WTI took 1.2s. Estimated remaining: 16.7s. Rate: 147.1 symbols/min [2025-10-27T22:17:08.893578] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:08.936719] [INFO ] [MAIN ] WTRG: Generated 138 derivative records from 50865 primary records. [2025-10-27T22:17:08.938515] [INFO ] [MAIN ] WTS: Generated 138 derivative records from 16949 primary records. [2025-10-27T22:17:08.938626] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-27T22:17:08.938693] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-27T22:17:08.962609] [DEBUG] [LOCAL ] WTS: Derivative data saved (138 records). [2025-10-27T22:17:08.963158] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-27T22:17:08.980320] [DEBUG] [LOCAL ] WTRG: Derivative data saved (138 records). [2025-10-27T22:17:08.980475] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-27T22:17:08.978908] [INFO ] [MAIN ] Derivative Progress: 1841/1881 symbols completed. WTS took 1.1s. Estimated remaining: 16.3s. Rate: 147.1 symbols/min [2025-10-27T22:17:08.982894] [INFO ] [MAIN ] Derivative Progress: 1842/1881 symbols completed. WTRG took 1.2s. Estimated remaining: 15.9s. Rate: 147.2 symbols/min [2025-10-27T22:17:08.982779] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:08.983029] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:08.984717] [DEBUG] [LOCAL ] WTTR: Loaded 44314 existing records from primary storage. [2025-10-27T22:17:08.985119] [INFO ] [MAIN ] WTTR: Loaded 44314 primary data records. [2025-10-27T22:17:09.395762] [DEBUG] [LOCAL ] WWW: Loaded 49169 existing records from primary storage. [2025-10-27T22:17:09.398216] [INFO ] [MAIN ] WWW: Loaded 49169 primary data records. [2025-10-27T22:17:09.398106] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-27T22:17:09.398600] [INFO ] [MAIN ] WU: Loaded 53487 primary data records. [2025-10-27T22:17:10.021275] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:10.074337] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:10.103606] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:10.131016] [INFO ] [MAIN ] WTTR: Generated 138 derivative records from 44314 primary records. [2025-10-27T22:17:10.134885] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-27T22:17:10.151094] [DEBUG] [LOCAL ] WTTR: Derivative data saved (138 records). [2025-10-27T22:17:10.152984] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-27T22:17:10.155319] [INFO ] [MAIN ] Derivative Progress: 1843/1881 symbols completed. WTTR took 1.3s. Estimated remaining: 15.5s. Rate: 147.1 symbols/min [2025-10-27T22:17:10.178754] [INFO ] [MAIN ] WU: Generated 138 derivative records from 53487 primary records. [2025-10-27T22:17:10.178873] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-27T22:17:10.178581] [INFO ] [MAIN ] WWW: Generated 138 derivative records from 49169 primary records. [2025-10-27T22:17:10.179435] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-27T22:17:10.202035] [DEBUG] [LOCAL ] WWW: Derivative data saved (138 records). [2025-10-27T22:17:10.203221] [DEBUG] [LOCAL ] WU: Derivative data saved (138 records). [2025-10-27T22:17:10.203296] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-27T22:17:10.203383] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-27T22:17:10.205285] [INFO ] [MAIN ] Derivative Progress: 1844/1881 symbols completed. WWW took 1.2s. Estimated remaining: 15.1s. Rate: 147.1 symbols/min [2025-10-27T22:17:10.208624] [INFO ] [MAIN ] Derivative Progress: 1845/1881 symbols completed. WU took 1.2s. Estimated remaining: 14.7s. Rate: 147.2 symbols/min [2025-10-27T22:17:10.209220] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:10.209335] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:10.209153] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:10.238520] [DEBUG] [LOCAL ] XFLT: Loaded 29571 existing records from primary storage. [2025-10-27T22:17:10.252503] [INFO ] [MAIN ] XFLT: Loaded 29571 primary data records. [2025-10-27T22:17:10.445379] [DEBUG] [LOCAL ] WY: Loaded 53202 existing records from primary storage. [2025-10-27T22:17:10.447301] [INFO ] [MAIN ] WY: Loaded 53202 primary data records. [2025-10-27T22:17:10.447195] [DEBUG] [LOCAL ] XHR: Loaded 43013 existing records from primary storage. [2025-10-27T22:17:10.590777] [INFO ] [MAIN ] XHR: Loaded 43013 primary data records. [2025-10-27T22:17:11.281949] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:11.331234] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:11.365321] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:11.395466] [INFO ] [MAIN ] XFLT: Generated 138 derivative records from 29571 primary records. [2025-10-27T22:17:11.396318] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-27T22:17:11.416862] [DEBUG] [LOCAL ] XFLT: Derivative data saved (138 records). [2025-10-27T22:17:11.417017] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-27T22:17:11.419059] [INFO ] [MAIN ] Derivative Progress: 1846/1881 symbols completed. XFLT took 1.2s. Estimated remaining: 14.3s. Rate: 147.1 symbols/min [2025-10-27T22:17:11.419709] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:11.446917] [INFO ] [MAIN ] WY: Generated 138 derivative records from 53202 primary records. [2025-10-27T22:17:11.447325] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-27T22:17:11.458298] [INFO ] [MAIN ] XHR: Generated 138 derivative records from 43013 primary records. [2025-10-27T22:17:11.463076] [DEBUG] [LOCAL ] WY: Derivative data saved (138 records). [2025-10-27T22:17:11.463303] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-27T22:17:11.463170] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-27T22:17:11.465693] [INFO ] [MAIN ] Derivative Progress: 1847/1881 symbols completed. WY took 1.3s. Estimated remaining: 13.9s. Rate: 147.1 symbols/min [2025-10-27T22:17:11.465953] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:11.493609] [DEBUG] [LOCAL ] XHR: Derivative data saved (138 records). [2025-10-27T22:17:11.493926] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-27T22:17:11.496620] [INFO ] [MAIN ] Derivative Progress: 1848/1881 symbols completed. XHR took 1.3s. Estimated remaining: 13.4s. Rate: 147.2 symbols/min [2025-10-27T22:17:11.496981] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:11.525492] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-27T22:17:11.525814] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-27T22:17:11.590774] [DEBUG] [LOCAL ] XPER: Loaded 30387 existing records from primary storage. [2025-10-27T22:17:11.624137] [INFO ] [MAIN ] XPER: Loaded 30387 primary data records. [2025-10-27T22:17:12.011559] [DEBUG] [LOCAL ] XPEV: Loaded 53614 existing records from primary storage. [2025-10-27T22:17:12.048631] [INFO ] [MAIN ] XPEV: Loaded 53614 primary data records. [2025-10-27T22:17:12.615629] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:12.653868] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:12.705939] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:12.737146] [INFO ] [MAIN ] XOM: Generated 138 derivative records from 53793 primary records. [2025-10-27T22:17:12.739948] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-27T22:17:12.764668] [DEBUG] [LOCAL ] XOM: Derivative data saved (138 records). [2025-10-27T22:17:12.769368] [INFO ] [MAIN ] XPER: Generated 138 derivative records from 30387 primary records. [2025-10-27T22:17:12.769799] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-27T22:17:12.765259] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-27T22:17:12.772936] [INFO ] [MAIN ] Derivative Progress: 1849/1881 symbols completed. XOM took 1.4s. Estimated remaining: 13.1s. Rate: 147.0 symbols/min [2025-10-27T22:17:12.775329] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:12.790722] [DEBUG] [LOCAL ] XPER: Derivative data saved (138 records). [2025-10-27T22:17:12.792569] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-27T22:17:12.794582] [INFO ] [MAIN ] XPEV: Generated 138 derivative records from 53614 primary records. [2025-10-27T22:17:12.794717] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-27T22:17:12.797618] [INFO ] [MAIN ] Derivative Progress: 1850/1881 symbols completed. XPER took 1.3s. Estimated remaining: 12.6s. Rate: 147.1 symbols/min [2025-10-27T22:17:12.798146] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:12.810383] [DEBUG] [LOCAL ] XPEV: Derivative data saved (138 records). [2025-10-27T22:17:12.810473] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-27T22:17:12.812986] [INFO ] [MAIN ] Derivative Progress: 1851/1881 symbols completed. XPEV took 1.3s. Estimated remaining: 12.2s. Rate: 147.2 symbols/min [2025-10-27T22:17:12.813252] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:12.895018] [DEBUG] [LOCAL ] XPOF: Loaded 36549 existing records from primary storage. [2025-10-27T22:17:12.895757] [DEBUG] [LOCAL ] XPRO: Loaded 45635 existing records from primary storage. [2025-10-27T22:17:12.896047] [INFO ] [MAIN ] XPRO: Loaded 45635 primary data records. [2025-10-27T22:17:12.895905] [INFO ] [MAIN ] XPOF: Loaded 36549 primary data records. [2025-10-27T22:17:12.897519] [DEBUG] [LOCAL ] XPO: Loaded 47324 existing records from primary storage. [2025-10-27T22:17:12.960060] [INFO ] [MAIN ] XPO: Loaded 47324 primary data records. [2025-10-27T22:17:13.846932] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:13.874237] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:13.906934] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:13.969069] [INFO ] [MAIN ] XPOF: Generated 138 derivative records from 36549 primary records. [2025-10-27T22:17:13.973677] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-27T22:17:13.992460] [DEBUG] [LOCAL ] XPOF: Derivative data saved (138 records). [2025-10-27T22:17:13.992886] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-27T22:17:14.000810] [INFO ] [MAIN ] Derivative Progress: 1852/1881 symbols completed. XPOF took 1.2s. Estimated remaining: 11.8s. Rate: 147.0 symbols/min [2025-10-27T22:17:13.998227] [INFO ] [MAIN ] XPRO: Generated 138 derivative records from 45635 primary records. [2025-10-27T22:17:14.001296] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:14.001117] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-27T22:17:14.018198] [INFO ] [MAIN ] XPO: Generated 138 derivative records from 47324 primary records. [2025-10-27T22:17:14.017989] [DEBUG] [LOCAL ] XPRO: Derivative data saved (138 records). [2025-10-27T22:17:14.018397] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-27T22:17:14.018817] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-27T22:17:14.020949] [INFO ] [MAIN ] Derivative Progress: 1853/1881 symbols completed. XPRO took 1.2s. Estimated remaining: 11.4s. Rate: 147.1 symbols/min [2025-10-27T22:17:14.028432] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:14.033236] [DEBUG] [LOCAL ] XPO: Derivative data saved (138 records). [2025-10-27T22:17:14.033845] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-27T22:17:14.036903] [INFO ] [MAIN ] Derivative Progress: 1854/1881 symbols completed. XPO took 1.3s. Estimated remaining: 11.0s. Rate: 147.2 symbols/min [2025-10-27T22:17:14.037167] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:14.060054] [DEBUG] [LOCAL ] XYF: Loaded 27009 existing records from primary storage. [2025-10-27T22:17:14.060219] [INFO ] [MAIN ] XYF: Loaded 27009 primary data records. [2025-10-27T22:17:14.203294] [DEBUG] [LOCAL ] YALA: Loaded 35827 existing records from primary storage. [2025-10-27T22:17:14.214167] [INFO ] [MAIN ] YALA: Loaded 35827 primary data records. [2025-10-27T22:17:14.505601] [DEBUG] [LOCAL ] XYL: Loaded 47440 existing records from primary storage. [2025-10-27T22:17:14.516068] [INFO ] [MAIN ] XYL: Loaded 47440 primary data records. [2025-10-27T22:17:15.037672] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:15.079138] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:15.121089] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:15.146954] [INFO ] [MAIN ] XYF: Generated 138 derivative records from 27009 primary records. [2025-10-27T22:17:15.147561] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-27T22:17:15.166001] [DEBUG] [LOCAL ] XYF: Derivative data saved (138 records). [2025-10-27T22:17:15.167569] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-27T22:17:15.171160] [INFO ] [MAIN ] Derivative Progress: 1855/1881 symbols completed. XYF took 1.2s. Estimated remaining: 10.6s. Rate: 147.1 symbols/min [2025-10-27T22:17:15.172867] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:15.187600] [INFO ] [MAIN ] YALA: Generated 138 derivative records from 35827 primary records. [2025-10-27T22:17:15.187816] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-27T22:17:15.204117] [DEBUG] [LOCAL ] YALA: Derivative data saved (138 records). [2025-10-27T22:17:15.204204] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-27T22:17:15.206809] [INFO ] [MAIN ] Derivative Progress: 1856/1881 symbols completed. YALA took 1.2s. Estimated remaining: 10.2s. Rate: 147.1 symbols/min [2025-10-27T22:17:15.207024] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:15.220746] [INFO ] [MAIN ] XYL: Generated 138 derivative records from 47440 primary records. [2025-10-27T22:17:15.221009] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-27T22:17:15.233566] [DEBUG] [LOCAL ] XYL: Derivative data saved (138 records). [2025-10-27T22:17:15.233666] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-27T22:17:15.236608] [INFO ] [MAIN ] Derivative Progress: 1857/1881 symbols completed. XYL took 1.2s. Estimated remaining: 9.8s. Rate: 147.2 symbols/min [2025-10-27T22:17:15.237500] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:15.251260] [DEBUG] [LOCAL ] YELP: Loaded 44920 existing records from primary storage. [2025-10-27T22:17:15.251636] [INFO ] [MAIN ] YELP: Loaded 44920 primary data records. [2025-10-27T22:17:15.486444] [DEBUG] [LOCAL ] YETI: Loaded 52451 existing records from primary storage. [2025-10-27T22:17:15.622680] [INFO ] [MAIN ] YETI: Loaded 52451 primary data records. [2025-10-27T22:17:15.657307] [DEBUG] [LOCAL ] YEXT: Loaded 42731 existing records from primary storage. [2025-10-27T22:17:15.667538] [INFO ] [MAIN ] YEXT: Loaded 42731 primary data records. [2025-10-27T22:17:16.246108] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:16.288588] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:16.324328] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:16.348793] [INFO ] [MAIN ] YELP: Generated 138 derivative records from 44920 primary records. [2025-10-27T22:17:16.351579] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-27T22:17:16.367808] [DEBUG] [LOCAL ] YELP: Derivative data saved (138 records). [2025-10-27T22:17:16.368071] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-27T22:17:16.370454] [INFO ] [MAIN ] Derivative Progress: 1858/1881 symbols completed. YELP took 1.2s. Estimated remaining: 9.4s. Rate: 147.1 symbols/min [2025-10-27T22:17:16.389601] [INFO ] [MAIN ] YETI: Generated 138 derivative records from 52451 primary records. [2025-10-27T22:17:16.389845] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-27T22:17:16.404342] [DEBUG] [LOCAL ] YETI: Derivative data saved (138 records). [2025-10-27T22:17:16.404467] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-27T22:17:16.407313] [INFO ] [MAIN ] Derivative Progress: 1859/1881 symbols completed. YETI took 1.2s. Estimated remaining: 9.0s. Rate: 147.1 symbols/min [2025-10-27T22:17:16.409622] [INFO ] [MAIN ] YEXT: Generated 138 derivative records from 42731 primary records. [2025-10-27T22:17:16.409726] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-27T22:17:16.421003] [DEBUG] [LOCAL ] YEXT: Derivative data saved (138 records). [2025-10-27T22:17:16.421060] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-27T22:17:16.423509] [INFO ] [MAIN ] Derivative Progress: 1860/1881 symbols completed. YEXT took 1.2s. Estimated remaining: 8.6s. Rate: 147.2 symbols/min [2025-10-27T22:17:16.423901] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:16.424015] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:16.424070] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:16.506347] [DEBUG] [LOCAL ] YOU: Loaded 49363 existing records from primary storage. [2025-10-27T22:17:16.519986] [INFO ] [MAIN ] YOU: Loaded 49363 primary data records. [2025-10-27T22:17:16.521604] [DEBUG] [LOCAL ] YPF: Loaded 50749 existing records from primary storage. [2025-10-27T22:17:16.532861] [INFO ] [MAIN ] YPF: Loaded 50749 primary data records. [2025-10-27T22:17:16.620614] [DEBUG] [LOCAL ] YMM: Loaded 52573 existing records from primary storage. [2025-10-27T22:17:16.632552] [INFO ] [MAIN ] YMM: Loaded 52573 primary data records. [2025-10-27T22:17:17.430500] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:17.474667] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:17.473093] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:17.548104] [INFO ] [MAIN ] YOU: Generated 138 derivative records from 49363 primary records. [2025-10-27T22:17:17.548489] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-27T22:17:17.569438] [DEBUG] [LOCAL ] YOU: Derivative data saved (138 records). [2025-10-27T22:17:17.572397] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-27T22:17:17.574596] [INFO ] [MAIN ] Derivative Progress: 1861/1881 symbols completed. YOU took 1.2s. Estimated remaining: 8.2s. Rate: 147.1 symbols/min [2025-10-27T22:17:17.576736] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:17.581668] [INFO ] [MAIN ] YPF: Generated 138 derivative records from 50749 primary records. [2025-10-27T22:17:17.583500] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-27T22:17:17.584566] [INFO ] [MAIN ] YMM: Generated 138 derivative records from 52573 primary records. [2025-10-27T22:17:17.594894] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-27T22:17:17.599379] [DEBUG] [LOCAL ] YPF: Derivative data saved (138 records). [2025-10-27T22:17:17.599896] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-27T22:17:17.603147] [INFO ] [MAIN ] Derivative Progress: 1862/1881 symbols completed. YPF took 1.2s. Estimated remaining: 7.7s. Rate: 147.1 symbols/min [2025-10-27T22:17:17.603288] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:17.615183] [DEBUG] [LOCAL ] YRD: Loaded 10814 existing records from primary storage. [2025-10-27T22:17:17.616691] [INFO ] [MAIN ] YRD: Loaded 10814 primary data records. [2025-10-27T22:17:17.639859] [DEBUG] [LOCAL ] YMM: Derivative data saved (138 records). [2025-10-27T22:17:17.649903] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-27T22:17:17.658494] [INFO ] [MAIN ] Derivative Progress: 1863/1881 symbols completed. YMM took 1.2s. Estimated remaining: 7.3s. Rate: 147.2 symbols/min [2025-10-27T22:17:17.658779] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:17.954265] [DEBUG] [LOCAL ] YSG: Loaded 25638 existing records from primary storage. [2025-10-27T22:17:17.954496] [INFO ] [MAIN ] YSG: Loaded 25638 primary data records. [2025-10-27T22:17:18.214764] [DEBUG] [LOCAL ] YUM: Loaded 51032 existing records from primary storage. [2025-10-27T22:17:18.280915] [INFO ] [MAIN ] YUM: Loaded 51032 primary data records. [2025-10-27T22:17:18.483704] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:18.641205] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:18.668728] [INFO ] [MAIN ] YRD: Generated 138 derivative records from 10814 primary records. [2025-10-27T22:17:18.668884] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-27T22:17:18.685657] [DEBUG] [LOCAL ] YRD: Derivative data saved (138 records). [2025-10-27T22:17:18.687560] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-27T22:17:18.690607] [INFO ] [MAIN ] Derivative Progress: 1864/1881 symbols completed. YRD took 1.1s. Estimated remaining: 6.9s. Rate: 147.1 symbols/min [2025-10-27T22:17:18.698603] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:18.707320] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:18.730954] [INFO ] [MAIN ] YSG: Generated 138 derivative records from 25638 primary records. [2025-10-27T22:17:18.731273] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-27T22:17:18.747472] [DEBUG] [LOCAL ] YSG: Derivative data saved (138 records). [2025-10-27T22:17:18.750058] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-27T22:17:18.752912] [INFO ] [MAIN ] Derivative Progress: 1865/1881 symbols completed. YSG took 1.1s. Estimated remaining: 6.5s. Rate: 147.2 symbols/min [2025-10-27T22:17:18.753225] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:18.777121] [INFO ] [MAIN ] YUM: Generated 138 derivative records from 51032 primary records. [2025-10-27T22:17:18.777231] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-27T22:17:18.790402] [DEBUG] [LOCAL ] YUM: Derivative data saved (138 records). [2025-10-27T22:17:18.803362] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-27T22:17:18.806854] [INFO ] [MAIN ] Derivative Progress: 1866/1881 symbols completed. YUM took 1.1s. Estimated remaining: 6.1s. Rate: 147.2 symbols/min [2025-10-27T22:17:18.807104] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:18.808247] [DEBUG] [LOCAL ] YUMC: Loaded 52547 existing records from primary storage. [2025-10-27T22:17:18.808549] [INFO ] [MAIN ] YUMC: Loaded 52547 primary data records. [2025-10-27T22:17:18.994170] [DEBUG] [LOCAL ] ZBH: Loaded 50575 existing records from primary storage. [2025-10-27T22:17:19.018069] [INFO ] [MAIN ] ZBH: Loaded 50575 primary data records. [2025-10-27T22:17:19.017985] [DEBUG] [LOCAL ] ZEPP: Loaded 20120 existing records from primary storage. [2025-10-27T22:17:19.183496] [INFO ] [MAIN ] ZEPP: Loaded 20120 primary data records. [2025-10-27T22:17:19.799910] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:19.851101] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:19.858475] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:19.905584] [INFO ] [MAIN ] YUMC: Generated 138 derivative records from 52547 primary records. [2025-10-27T22:17:19.906798] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-27T22:17:19.926601] [DEBUG] [LOCAL ] YUMC: Derivative data saved (138 records). [2025-10-27T22:17:19.929290] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-27T22:17:19.936311] [INFO ] [MAIN ] Derivative Progress: 1867/1881 symbols completed. YUMC took 1.2s. Estimated remaining: 5.7s. Rate: 147.1 symbols/min [2025-10-27T22:17:19.936675] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:19.941492] [INFO ] [MAIN ] ZEPP: Generated 138 derivative records from 20120 primary records. [2025-10-27T22:17:19.944363] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-27T22:17:19.959009] [INFO ] [MAIN ] ZBH: Generated 138 derivative records from 50575 primary records. [2025-10-27T22:17:19.959102] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-27T22:17:19.958873] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (138 records). [2025-10-27T22:17:19.959210] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-27T22:17:19.962450] [INFO ] [MAIN ] Derivative Progress: 1868/1881 symbols completed. ZEPP took 1.2s. Estimated remaining: 5.3s. Rate: 147.2 symbols/min [2025-10-27T22:17:19.969967] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:19.974828] [DEBUG] [LOCAL ] ZBH: Derivative data saved (138 records). [2025-10-27T22:17:19.974903] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-27T22:17:19.977317] [INFO ] [MAIN ] Derivative Progress: 1869/1881 symbols completed. ZBH took 1.2s. Estimated remaining: 4.9s. Rate: 147.2 symbols/min [2025-10-27T22:17:19.977614] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:20.018218] [DEBUG] [LOCAL ] ZH: Loaded 24122 existing records from primary storage. [2025-10-27T22:17:20.018351] [INFO ] [MAIN ] ZH: Loaded 24122 primary data records. [2025-10-27T22:17:20.146408] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-27T22:17:20.150014] [DEBUG] [LOCAL ] ZGN: Loaded 40668 existing records from primary storage. [2025-10-27T22:17:20.150373] [INFO ] [MAIN ] ZETA: Loaded 53618 primary data records. [2025-10-27T22:17:20.160888] [INFO ] [MAIN ] ZGN: Loaded 40668 primary data records. [2025-10-27T22:17:20.962211] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:21.016799] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:21.018729] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:21.067395] [INFO ] [MAIN ] ZH: Generated 138 derivative records from 24122 primary records. [2025-10-27T22:17:21.068763] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-27T22:17:21.085816] [DEBUG] [LOCAL ] ZH: Derivative data saved (138 records). [2025-10-27T22:17:21.088041] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-27T22:17:21.093218] [INFO ] [MAIN ] Derivative Progress: 1870/1881 symbols completed. ZH took 1.1s. Estimated remaining: 4.5s. Rate: 147.1 symbols/min [2025-10-27T22:17:21.093492] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:21.105078] [INFO ] [MAIN ] ZETA: Generated 138 derivative records from 53618 primary records. [2025-10-27T22:17:21.106440] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-27T22:17:21.118418] [INFO ] [MAIN ] ZGN: Generated 138 derivative records from 40668 primary records. [2025-10-27T22:17:21.120040] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-27T22:17:21.122179] [DEBUG] [LOCAL ] ZETA: Derivative data saved (138 records). [2025-10-27T22:17:21.122550] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-27T22:17:21.135749] [INFO ] [MAIN ] Derivative Progress: 1871/1881 symbols completed. ZETA took 1.2s. Estimated remaining: 4.1s. Rate: 147.2 symbols/min [2025-10-27T22:17:21.138971] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:21.143277] [DEBUG] [LOCAL ] ZGN: Derivative data saved (138 records). [2025-10-27T22:17:21.156726] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-27T22:17:21.159636] [INFO ] [MAIN ] Derivative Progress: 1872/1881 symbols completed. ZGN took 1.2s. Estimated remaining: 3.7s. Rate: 147.2 symbols/min [2025-10-27T22:17:21.160070] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:21.191380] [DEBUG] [LOCAL ] ZIM: Loaded 53434 existing records from primary storage. [2025-10-27T22:17:21.191694] [INFO ] [MAIN ] ZIM: Loaded 53434 primary data records. [2025-10-27T22:17:21.317233] [DEBUG] [LOCAL ] ZIP: Loaded 43222 existing records from primary storage. [2025-10-27T22:17:21.328119] [INFO ] [MAIN ] ZIP: Loaded 43222 primary data records. [2025-10-27T22:17:21.500857] [DEBUG] [LOCAL ] ZK: Loaded 38664 existing records from primary storage. [2025-10-27T22:17:21.561752] [INFO ] [MAIN ] ZK: Loaded 38664 primary data records. [2025-10-27T22:17:22.158993] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:22.190955] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:22.234817] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:22.286989] [INFO ] [MAIN ] ZIM: Generated 138 derivative records from 53434 primary records. [2025-10-27T22:17:22.289238] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-27T22:17:22.290195] [INFO ] [MAIN ] ZIP: Generated 138 derivative records from 43222 primary records. [2025-10-27T22:17:22.293351] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-27T22:17:22.307388] [DEBUG] [LOCAL ] ZIM: Derivative data saved (138 records). [2025-10-27T22:17:22.307512] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-27T22:17:22.316416] [INFO ] [MAIN ] Derivative Progress: 1873/1881 symbols completed. ZIM took 1.2s. Estimated remaining: 3.3s. Rate: 147.1 symbols/min [2025-10-27T22:17:22.323949] [DEBUG] [LOCAL ] ZIP: Derivative data saved (138 records). [2025-10-27T22:17:22.325019] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-27T22:17:22.328030] [INFO ] [MAIN ] Derivative Progress: 1874/1881 symbols completed. ZIP took 1.2s. Estimated remaining: 2.9s. Rate: 147.2 symbols/min [2025-10-27T22:17:22.329717] [INFO ] [MAIN ] ZK: Generated 138 derivative records from 38664 primary records. [2025-10-27T22:17:22.329788] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-27T22:17:22.341233] [DEBUG] [LOCAL ] ZK: Derivative data saved (138 records). [2025-10-27T22:17:22.341288] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-27T22:17:22.343719] [INFO ] [MAIN ] Derivative Progress: 1875/1881 symbols completed. ZK took 1.2s. Estimated remaining: 2.4s. Rate: 147.2 symbols/min [2025-10-27T22:17:22.344114] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:22.344197] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:22.344041] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:22.359101] [DEBUG] [LOCAL ] ZKH: Loaded 7200 existing records from primary storage. [2025-10-27T22:17:22.359262] [INFO ] [MAIN ] ZKH: Loaded 7200 primary data records. [2025-10-27T22:17:22.385347] [DEBUG] [LOCAL ] ZTR: Loaded 16304 existing records from primary storage. [2025-10-27T22:17:22.407371] [INFO ] [MAIN ] ZTR: Loaded 16304 primary data records. [2025-10-27T22:17:22.858199] [DEBUG] [LOCAL ] ZTO: Loaded 48934 existing records from primary storage. [2025-10-27T22:17:22.970336] [INFO ] [MAIN ] ZTO: Loaded 48934 primary data records. [2025-10-27T22:17:23.311339] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-27T22:17:23.354828] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:23.409585] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:23.428963] [INFO ] [MAIN ] ZKH: Generated 138 derivative records from 7200 primary records. [2025-10-27T22:17:23.431998] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-27T22:17:23.448563] [DEBUG] [LOCAL ] ZKH: Derivative data saved (138 records). [2025-10-27T22:17:23.448970] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-27T22:17:23.451210] [INFO ] [MAIN ] Derivative Progress: 1876/1881 symbols completed. ZKH took 1.1s. Estimated remaining: 2.0s. Rate: 147.1 symbols/min [2025-10-27T22:17:23.454664] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:23.464968] [INFO ] [MAIN ] ZTR: Generated 138 derivative records from 16304 primary records. [2025-10-27T22:17:23.466754] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-27T22:17:23.481918] [DEBUG] [LOCAL ] ZTR: Derivative data saved (138 records). [2025-10-27T22:17:23.482174] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-27T22:17:23.484735] [INFO ] [MAIN ] Derivative Progress: 1877/1881 symbols completed. ZTR took 1.1s. Estimated remaining: 1.6s. Rate: 147.2 symbols/min [2025-10-27T22:17:23.486387] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:23.494824] [INFO ] [MAIN ] ZTO: Generated 138 derivative records from 48934 primary records. [2025-10-27T22:17:23.494973] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-27T22:17:23.509204] [DEBUG] [LOCAL ] ZTO: Derivative data saved (138 records). [2025-10-27T22:17:23.509408] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-27T22:17:23.512592] [INFO ] [MAIN ] Derivative Progress: 1878/1881 symbols completed. ZTO took 1.2s. Estimated remaining: 1.2s. Rate: 147.3 symbols/min [2025-10-27T22:17:23.526083] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-27T22:17:23.566478] [DEBUG] [LOCAL ] ZVIA: Loaded 35788 existing records from primary storage. [2025-10-27T22:17:23.566716] [INFO ] [MAIN ] ZVIA: Loaded 35788 primary data records. [2025-10-27T22:17:23.567859] [DEBUG] [LOCAL ] ZTS: Loaded 53087 existing records from primary storage. [2025-10-27T22:17:23.568020] [INFO ] [MAIN ] ZTS: Loaded 53087 primary data records. [2025-10-27T22:17:23.879773] [DEBUG] [LOCAL ] ZWS: Loaded 41904 existing records from primary storage. [2025-10-27T22:17:24.009714] [INFO ] [MAIN ] ZWS: Loaded 41904 primary data records. [2025-10-27T22:17:24.523497] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:24.551591] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:24.591458] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-27T22:17:24.642006] [INFO ] [MAIN ] ZTS: Generated 138 derivative records from 53087 primary records. [2025-10-27T22:17:24.643684] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-27T22:17:24.658145] [DEBUG] [LOCAL ] ZTS: Derivative data saved (138 records). [2025-10-27T22:17:24.658389] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-27T22:17:24.662817] [INFO ] [MAIN ] Derivative Progress: 1879/1881 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 147.1 symbols/min [2025-10-27T22:17:24.674995] [INFO ] [MAIN ] ZVIA: Generated 138 derivative records from 35788 primary records. [2025-10-27T22:17:24.677213] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-27T22:17:24.677122] [INFO ] [MAIN ] ZWS: Generated 138 derivative records from 41904 primary records. [2025-10-27T22:17:24.677957] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-27T22:17:24.701513] [DEBUG] [LOCAL ] ZWS: Derivative data saved (138 records). [2025-10-27T22:17:24.701576] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (138 records). [2025-10-27T22:17:24.701813] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-27T22:17:24.704884] [INFO ] [MAIN ] Derivative Progress: 1880/1881 symbols completed. ZWS took 1.2s. Estimated remaining: 0.4s. Rate: 147.2 symbols/min [2025-10-27T22:17:24.701742] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-27T22:17:24.707543] [INFO ] [MAIN ] Derivative Progress: 1881/1881 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.0s. Rate: 147.3 symbols/min [2025-10-27T22:17:24.708274] [INFO ] [MAIN ] Parallel derivative generation completed in 12m 46s [2025-10-27T22:17:24.708346] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1881/1881 symbols) [2025-10-27T22:17:27.620742] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1881/1881 @ 100.00%)' [2025-10-27T22:17:27.621366] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-27T22:17:27.621593] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-27T22:17:27.621794] [INFO ] [STATE ] Last completion updated: 2025-10-27T22:17:27.621689